US11967347B2 - Information processing apparatus and non-transitory computer readable medium storing program - Google Patents

Information processing apparatus and non-transitory computer readable medium storing program Download PDF

Info

Publication number
US11967347B2
US11967347B2 US16/866,504 US202016866504A US11967347B2 US 11967347 B2 US11967347 B2 US 11967347B2 US 202016866504 A US202016866504 A US 202016866504A US 11967347 B2 US11967347 B2 US 11967347B2
Authority
US
United States
Prior art keywords
subtitle
time point
display
motion picture
displayed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/866,504
Other versions
US20210201957A1 (en
Inventor
Masakazu Ogawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Business Innovation Corp
Original Assignee
Fujifilm Business Innovation Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Business Innovation Corp filed Critical Fujifilm Business Innovation Corp
Assigned to FUJI XEROX CO., LTD. reassignment FUJI XEROX CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: OGAWA, MASAKAZU
Assigned to FUJIFILM BUSINESS INNOVATION CORP. reassignment FUJIFILM BUSINESS INNOVATION CORP. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: FUJI XEROX CO., LTD.
Publication of US20210201957A1 publication Critical patent/US20210201957A1/en
Application granted granted Critical
Publication of US11967347B2 publication Critical patent/US11967347B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/11—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information not detectable on the record carrier
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/036—Insert-editing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/278—Subtitling

Definitions

  • the present invention relates to an information processing apparatus and a non-transitory computer readable medium storing a program.
  • JP2003-224773A discloses a subtitle editing and preview assistance system including a section that associates a display starting timing and a display ending timing of a display unit subtitle of a target of editing with corresponding timing positions on a timeline denoting an elapse in time of a broadcasting program of the target of editing as a time axis, a section that displays a display starting position and an ending position of the display unit subtitle by matching the display starting position and the ending position to the display starting timing and the ending timing of the subtitle associated on the timeline, and a section that corrects the display starting timing or the display ending timing of the display unit subtitle by moving the displayed display starting position or the displayed ending position of the display unit subtitle.
  • JP2003-224807A discloses a subtitled broadcasting program editing assistance system that is a system assisting subtitled broadcasting program editing of creating a final subtitled broadcasting program by correcting created subtitled broadcasting program data and includes a display section that, at the time of performing a linefeed or a page break in a subtitle screen editing work, displays a post-correction subtitle screen of the subtitle screen and displays the post-correction subtitle screens before and after reflection of the correction in parallel.
  • a display timing of the subtitle provided to the motion picture may be intended to be changed by shifting the display timing forward or rearward.
  • the user needs to record a display starting time point and a display ending time point of the subtitle of which the display timing is intended to be changed while playing back the motion picture, and perform adjustment by repeatedly playing back the same content by rewinding playback of the motion picture. Adjusting the display timing of the subtitle forward or rearward is not easy.
  • Non-limiting embodiments of the present disclosure relate to an information processing apparatus and a non-transitory computer readable medium storing a program that, in a case of adjusting a display timing of a subtitle provided to a motion picture, cause a user to more easily recognize the display timing of the subtitle than in a case where notification information for notifying the user that the current playback time point is a specific time before or after a time point at which display of the subtitle is started or ended is not displayed before or after a display starting time point and a display ending time point of the subtitle.
  • aspects of certain non-limiting embodiments of the present disclosure overcome the above disadvantages and/or other disadvantages not described above.
  • aspects of the non-limiting embodiments are not required to overcome the disadvantages described above, and aspects of the non-limiting embodiments of the present disclosure may not overcome any of the disadvantages described above.
  • an information processing apparatus including a memory, and a processor, in which the memory stores a motion picture, a subtitle set in the motion picture, and a display starting time point and a display ending time point of the subtitle, and the processor is configured to display the subtitle in the motion picture being played back in accordance with a current playback time point and display notification information for notifying a user that the current playback time point is a specific time before or after a time point at which display of the subtitle is started or ended at the specific time before or after the display starting time point or the display ending time point of the subtitle in the motion picture.
  • FIG. 1 is a system diagram illustrating a configuration of a multimedia content generation system according to one exemplary embodiment of the present invention
  • FIG. 2 is a block diagram illustrating a hardware configuration of an editing processing server 10 according to one exemplary embodiment of the present invention
  • FIG. 3 is a block diagram illustrating a functional configuration of the editing processing server 10 according to one exemplary embodiment of the present invention
  • FIG. 4 A is a diagram illustrating one example of subtitle data stored in a data storage unit 33 of the editing processing server 10
  • FIG. 4 B is a diagram illustrating one example of notification data generated from the subtitle data in FIG. 4 A ;
  • FIG. 5 A is a diagram illustrating one example of a display screen displayed on a terminal apparatus 20 in a playback mode
  • FIG. 5 B is a diagram illustrating one example of the display screen displayed on the terminal apparatus 20 in an editing mode
  • FIG. 6 A to FIG. 6 C are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20 ;
  • FIG. 7 is a diagram illustrating one example of the display screen displayed on the terminal apparatus 20 ;
  • FIG. 8 A to FIG. 8 C are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20 ;
  • FIG. 9 A to FIG. 9 C are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20 ;
  • FIG. 10 is a diagram illustrating one example of the display screen displayed on the terminal apparatus 20 ;
  • FIG. 11 A to FIG. 11 C are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20 ;
  • FIG. 12 is a flowchart illustrating a summary of a process in the editing processing server 10 according to one exemplary embodiment of the present invention.
  • FIG. 13 A and FIG. 13 B are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20 ;
  • FIG. 14 is a flowchart illustrating a summary of the process in the editing processing server 10 according to one exemplary embodiment of the present invention.
  • FIG. 15 A and FIG. 15 B are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20 ;
  • FIG. 16 A and FIG. 16 B are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20 .
  • FIG. 1 is a system diagram illustrating a configuration of a multimedia content generation system according to one exemplary embodiment of the present invention.
  • the multimedia content generation system is configured with an editing processing server 10 and a terminal apparatus 30 such as a personal computer (hereinafter, abbreviated to personal com) connected to each other through a network 1 and a terminal apparatus 20 such as a smartphone or a tablet terminal connected by a wireless line through a wireless LAN terminal 2 .
  • a terminal apparatus 30 such as a personal computer (hereinafter, abbreviated to personal com) connected to each other through a network 1 and a terminal apparatus 20 such as a smartphone or a tablet terminal connected by a wireless line through a wireless LAN terminal 2 .
  • the multimedia content generation system of this exemplary embodiment generates a multimedia content into which various contents such as a motion picture, a still picture, a voice, a text, and an automatic translation are combined.
  • the multimedia content may be generated by storing data for providing a subtitle to the motion picture in the editing processing server 10 by the terminal apparatus 30 or adjusting a display timing of the subtitle provided to the motion picture in the data stored in the editing processing server 10 by shifting the display timing forward or rearward by the terminal apparatus 20 .
  • the subtitle refers to information that is additional information for the motion picture such as an explanation, a conversation, and a translation displayed on a screen of the motion picture such as a movie or a television program using a text.
  • the editing processing server 10 is an information processing apparatus on which editing software for generating the multimedia content by editing such various contents is installed.
  • the terminal apparatus 20 and the terminal apparatus 30 are information processing apparatuses that acquire the motion picture and generate the multimedia content using the editing software operating on the editing processing server 10 .
  • the editing software may not be installed on the editing processing server 10 . Instead, the editing software may be directly installed on the terminal apparatus 20 and the terminal apparatus 30 .
  • FIG. 2 a hardware configuration of the editing processing server 10 in the multimedia content generation system of this exemplary embodiment is illustrated in FIG. 2 .
  • the editing processing server 10 includes a CPU 11 , a memory 12 , a storage apparatus 13 such as a hard disk drive (HDD), a communication interface (IF) 14 transmitting and receiving data to and from an external apparatus or the like such as the terminal apparatuses 20 and 30 through the network 1 , and a user interface (UI) apparatus 15 including a touch panel or a liquid crystal display, and a keyboard. These constituents are connected to each other through a control bus 16 .
  • a control bus 16 a control bus 16 .
  • the CPU 11 controls the operation of the editing processing server 10 by executing a predetermined process based on a control program stored in the memory 12 or the storage apparatus 13 .
  • the CPU 11 is described as reading and executing the control program stored in the memory 12 or the storage apparatus 13 .
  • the program may be stored in a storage medium such as a CD-ROM and provided to the CPU 11 .
  • FIG. 3 is a block diagram illustrating a functional configuration of the editing processing server 10 implemented by executing the control program.
  • the editing processing server 10 of this exemplary embodiment includes a data communication unit 31 , a control unit 32 , and a data storage unit 33 .
  • the data communication unit 31 performs data communication with the terminal apparatuses 20 and 30 through the network 1 .
  • the control unit 32 controls the operation of the editing processing server 10 and includes a switching unit 41 , a reset unit 42 , a playback unit 43 , a display control unit 44 , a user operation reception unit 45 , and a notification data generation unit 46 .
  • the data storage unit 33 stores various content data such as the motion picture on which an editing process is to be performed.
  • the display control unit 44 controls a screen displayed on the terminal apparatuses 20 and 30 .
  • the user operation reception unit 45 receives a location selected by a user in the terminal apparatuses 20 and 30 .
  • the playback unit 43 plays back the motion picture from a playback time point corresponding to the location received by the user operation reception unit 45 in the case of playing back the motion picture in which the subtitle is set.
  • the reset unit 42 resets a display starting time point or a display ending time point of the subtitle set in the motion picture.
  • the switching unit 41 switches between an editing mode in which the display starting time point or the display ending time point of the subtitle set in the motion picture is reset, and a playback mode in which the motion picture is played back.
  • the notification data generation unit 46 generates the subtitle set in the motion picture, a subtitle as notification information for notifying the user of a specific time before or after the display starting time point or the display ending time point of the subtitle based on the display starting time point and the display ending time point of the subtitle, and a subtitle as specific information as information for specifying the subtitle to be notified to the user in the case of notifying the user of the specific time before the display starting time point of the subtitle or the specific time after the display ending time point, and stores display starting time points and display ending time points of these subtitles in the data storage unit 33 in association with each other as notification data.
  • Examples of the notification information are exemplified by “0 seconds before a subtitle display” “0 seconds after the start”, and “0 seconds before the end”.
  • Examples of the specific information are exemplified by at least a part of the subtitle set in the motion picture.
  • the display control unit 44 displays the subtitle as the notification information and the subtitle as the specific information in the motion picture being played back in accordance with the current playback time point based on the notification data stored in the data storage unit 33 .
  • the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point and displays the subtitle as the notification information for notifying the user that the current playback time point is the specific time before or the time after the display starting or ending time point of the subtitle at the specific time before or after the display starting time point or the display ending time point of the subtitle in the motion picture.
  • the display control unit 44 displays the subtitle as the notification information in the motion picture and displays the subtitle as the specific information, for example, at least a part of the subtitle set in the motion picture, in the motion picture being played back in accordance with the current playback time point.
  • the display control unit 44 does not display the subtitle as the notification information and the subtitle as the specific information in the motion picture.
  • FIG. 4 A and FIG. 4 B are diagrams illustrating one example of data stored in the data storage unit 33 .
  • the data storage unit 33 stores the motion picture, the subtitle set in the motion picture, and the display starting time point and the display ending time point of the subtitle in association with each other as subtitle data.
  • the notification data generation unit 46 Based on the subtitle data illustrated in FIG. 4 A , the notification data generation unit 46 , for example, as illustrated in FIG. 4 B , generates the subtitle as the notification information for notifying the user of three seconds before or after the start, two seconds before or after the start, one second before or after the start, zero seconds for the start, three seconds before or after the end, two seconds before or after the end, one second before or after the end, and zero seconds for the end at three seconds before or after, two seconds before or after, and one second before or after each of the display starting time point and the display ending time point of the subtitle set in the motion picture and zero seconds for each of the display starting time point and the display ending time point, and the subtitle as the specific information for specifying the subtitle to be notified to the user in the case of notifying the user of three seconds before, two seconds before, and one second before the display starting time point, zero seconds for the display ending time point, one second after, two seconds after, and three seconds after the display ending time point before the display starting time point or after the display ending
  • the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point, counts down before the display starting time point of the subtitle from, for example, three seconds before the display starting time point of the subtitle, and displays, in the motion picture, the subtitle as the notification information for three seconds before the start of display of the subtitle, two seconds before the start, and one second before the start and the subtitle “(grandfather has gone to mountain . . . )” as the specific information for at least a part of the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture.
  • the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point, counts up from the display starting time point of the subtitle to, for example, three seconds after the display starting time point of the subtitle, and displays, in the motion picture, the subtitle as the notification information for zero seconds for the start of display of the subtitle, one second after the start, two seconds after the start, and three seconds after the start and the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture.
  • the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point, counts down before the display ending time point of the subtitle from, for example, three seconds before the display ending time point of the subtitle, and displays, in the motion picture, the subtitle as the notification information for three seconds before the end of display of the subtitle, two seconds before the end, and one second before the end and the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture.
  • the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point, counts up from the display ending time point of the subtitle to, for example, three seconds after the display ending time point of the subtitle, and displays, in the motion picture, the subtitle as the notification information for zero seconds for the end of display of the subtitle, one second after the end, two seconds after the end, and three seconds after the end and the subtitle “( . . . laundry)” as the specific information for at least a part of the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture.
  • the display control unit 44 displays a reset button as a reset section, described later, in accordance with the subtitle.
  • the reset button is information for resetting the display starting time point or the display ending time point of the subtitle set in the motion picture.
  • the display control unit 44 displays information for selecting whether or not to change the display ending time point or the display starting time point of the subtitle in accordance with the reset display starting time point or the reset display ending time point of the subtitle in the motion picture.
  • the reset unit 42 changes the display ending time point or the display starting time point of the subtitle in accordance with the reset display starting time point or the reset display ending time point of the subtitle.
  • the reset unit 42 does not change the display ending time point or the display starting time point of the subtitle in accordance with the reset display starting time point or the reset display ending time point of the subtitle.
  • the reset unit 42 may switch between changing and not changing the display ending time point or the display starting time point of the subtitle depending on whether the reset time point is the display starting time point or the display ending time point of the subtitle. For example, in a case where the display starting time point is reset, the reset unit 42 changes the display ending time point in accordance with the reset display setting time point. Ina case where the display ending time point is reset, the reset unit 42 may not change the display starting time point in accordance with the reset display ending time point.
  • the display control unit 44 may display the subtitle as the notification information, at least a part of the subtitle set in the motion picture which is the subtitle as the specific information, and the reset button as the reset section which is information for resetting performed by the reset unit 42 in the motion picture.
  • the display control unit 44 may display the subtitle as the notification information, at least a part of the subtitle set in the motion picture which is the subtitle as the specific information, and the reset button as the reset section which is information for resetting performed by the reset unit 42 in the motion picture even in the full screen display state.
  • the playback unit 43 plays back the motion picture from, for example, three seconds which is a preset time before the reset display starting time point or the reset display ending time point of the subtitle. Accordingly, in a case where the display of the subtitle is reset, the user may check whether or not the resetting is appropriate.
  • FIG. 5 A is a diagram illustrating a display screen of the terminal apparatus 20 in the playback mode in which the motion picture is played back.
  • FIG. 5 B is a diagram illustrating the display screen of the terminal apparatus 20 in the editing mode in which the display timing of the subtitle set in the motion picture is adjusted.
  • a motion picture display screen 52 on which the motion picture is displayed a seekbar 53 for switching a playback position of the motion picture, and an operation button 55 such as a playback button, a stop button, a rewind button, a fast forward button, and a volume switching button for the motion picture are displayed.
  • a pointer 54 is displayed on the seekbar 53 .
  • the playback position of the motion picture may be switched by moving the pointer 54 on the seekbar 53 .
  • a switching button 51 that is a switching section for switching the display screen of the terminal apparatus 20 in the playback mode to the display screen in the editing mode by the switching unit 41 is displayed.
  • the display screen of the terminal apparatus 20 is switched to the editing mode illustrated in FIG. 5 B .
  • the motion picture is displayed in full screen on the display screen of the terminal apparatus 20 and is displayed larger than the motion picture in the playback mode.
  • a subtitle 56 as the notification information As illustrated in FIG. 5 B , in the editing mode, the motion picture is displayed in full screen on the display screen of the terminal apparatus 20 and is displayed larger than the motion picture in the playback mode.
  • a subtitle 56 as the notification information As illustrated in FIG. 5 B , in the editing mode, the motion picture is displayed in full screen on the display screen of the terminal apparatus 20 and is displayed larger than the motion picture in the playback mode.
  • a subtitle 56 as the notification information
  • a subtitle 57 as the specific information
  • a reset button 58 for resetting the display starting time point or the display ending time point of the subtitle are displayed.
  • the switching button 51 for switching the display screen of the terminal apparatus 20 in the editing mode to the display screen in the playback mode is displayed.
  • the display screen of the terminal apparatus 20 is switched to the playback mode illustrated in FIG. 5 A .
  • the switching button 51 capable of switching between the playback mode and the editing mode is displayed on the display screen of the terminal apparatus 20 , and the playback mode and the editing mode are configured to be switchable each time the switching button 51 is tapped.
  • Tapping refers to an operation of touching the display screen with a finger or the like such as lightly hitting the display screen with a finger, a touch pen, or the like.
  • the subtitle 56 as the notification information such as “three seconds before the start”, the subtitle 57 as the specific information such as “(grandfather . . . )” which is a part of the subtitle displayed after three seconds, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is three seconds before the display starting time point are displayed as illustrated in FIG. 6 A .
  • the subtitle 56 as the notification information such as “two seconds before the start”, the subtitle 57 as the specific information such as “(grandfather . . . )” which is a part of the subtitle displayed after two seconds, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is two seconds before the display starting time point are displayed as illustrated in FIG. 6 B .
  • the subtitle 56 as the notification information such as “one second before the start”, the subtitle 57 as the specific information such as “(grandfather . . . )” which is a part of the subtitle displayed after one second, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is one second before the display starting time point are displayed as illustrated in FIG. 6 C .
  • the subtitle 56 as the notification information such as “zero seconds for the start” and the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture are displayed as illustrated in FIG. 7 .
  • the subtitle 56 as the notification information such as “one second after the start”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is one second after the display starting time point are displayed as illustrated in FIG. 8 A .
  • the subtitle 56 as the notification information such as “two seconds after the start”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is two seconds after the display starting time point are displayed as illustrated in FIG. 8 B .
  • the subtitle 56 as the notification information such as “three seconds after the start”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is three seconds after the display starting time point are displayed as illustrated in FIG. 8 C .
  • the subtitle 56 as the notification information such as “three seconds before the end”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is three seconds before the display ending time point are displayed as illustrated in FIG. 9 A .
  • the subtitle 56 as the notification information such as “two seconds before the end”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is two seconds before the display ending time point are displayed as illustrated in FIG. 9 B .
  • the subtitle 56 as the notification information such as “one second before the end”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is one second before the display ending time point are displayed as illustrated in FIG. 9 C .
  • the subtitle 56 as the notification information such as “zero seconds for the end” and the subtitle 57 as the specific information such as “( . . . laundry)” which is a part of the subtitle displayed before the end are displayed as illustrated in FIG. 10 .
  • the subtitle 56 as the notification information such as “one second after the end”, the subtitle 57 as the specific information such as “( . . . laundry)” which is a part of the subtitle displayed before one second, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is one second after the display ending time point are displayed as illustrated in FIG. 11 A .
  • the subtitle 56 as the notification information such as “two seconds after the end”, the subtitle 57 as the specific information such as “( . . . laundry)” which is a part of the subtitle displayed before two seconds, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is two seconds after the display ending time point are displayed as illustrated in FIG. 11 B .
  • the subtitle 56 as the notification information such as “three seconds after the end”, the subtitle 57 as the specific information such as “( . . . laundry)” which is a part of the subtitle displayed before three seconds, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is three seconds after the display ending time point are displayed as illustrated in FIG. 11 C .
  • FIG. 12 to FIG. 15 B a summary of operation in the editing processing server 10 will be described using FIG. 12 to FIG. 15 B .
  • the summary will be described using a case where the notification data of the display starting time point or the display ending time point of the subtitle generated by the notification data generation unit 46 is stored in the data storage unit 33 .
  • step S 10 the display control unit 44 displays the notification data in accordance with the playback time point of the motion picture.
  • the display control unit 44 displays the subtitle 56 as the notification information which is displayed by counting the time point to the start of display of the subtitle and the time point from the start of display of the subtitle in accordance with the playback time point of the motion picture, and the reset button 58 for resetting the display starting time point of the subtitle to [from here].
  • the display control unit 44 displays the subtitle 57 as the specific information in accordance with the subtitle 56 in the case of displaying the subtitle 56 .
  • step S 11 in a case where the reset button 58 of [from here] is tapped, the reset unit 42 in step S 12 resets the display starting time point of the subtitle to the time point at which the reset button 58 of [from here] is tapped.
  • the display starting time point of the subtitle is reset to two seconds before the display starting time point of the subtitle at which the reset button 58 is tapped.
  • a selection screen for selecting whether or not to change the display ending time point in accordance with the reset display starting time point of the subtitle is displayed as illustrated in FIG. 13 B .
  • step S 13 in a case where “do not change” is selected on the selection screen illustrated in FIG. 13 B , the playback unit 43 in step S 15 plays back the motion picture from three seconds before the reset display starting time point of the subtitle and displays a preview screen using the display control unit 44 .
  • step S 13 in a case where “change” is selected on the selection screen illustrated in FIG. 13 B , the reset unit 42 in step S 14 changes the display ending time point in accordance with the reset display starting time point of the subtitle. Specifically, in a case where the display starting time point of the subtitle is reset to, for example, two seconds before the display starting time point, the reset unit 42 changes the display ending time point to two seconds before the display ending time point in accordance with the reset display starting time point. In addition, in a case where the display starting time point of the subtitle is reset to, for example, two seconds after the display starting time point, the reset unit 42 changes the display ending time point to two seconds after the display ending time point in accordance with the reset display starting time point.
  • step S 15 the playback unit 43 plays back the motion picture from three seconds before the reset display starting time point of the subtitle and displays the preview screen using the display control unit 44 .
  • step S 20 the display control unit 44 displays the notification data in accordance with the playback time point of the motion picture. Specifically, the display control unit 44 displays the subtitle 56 as the notification information which is displayed by counting the time point to the end of display of the subtitle and the time point from the end of display of the subtitle, and the reset button 58 for resetting the display ending time point of the subtitle to [to here]. In addition, in a case where the playback time point of the motion picture is after the display ending time point of the subtitle, the display control unit 44 displays the subtitle 57 as the specific information in accordance with the subtitle 56 in the case of displaying the subtitle 56 .
  • step S 21 in a case where the reset button 58 of [to here] is tapped, the reset unit 42 in step S 22 resets the display ending time point of the subtitle to the time point at which the reset button 58 of [to here] is tapped.
  • the display ending time point of the subtitle is reset to two seconds after the display ending time point of the subtitle at which the reset button 58 is tapped.
  • a selection screen for selecting whether or not to change the display starting time point in accordance with the reset display ending time point of the subtitle is displayed as illustrated in FIG. 15 B .
  • step S 23 in a case where “do not change” is selected on the selection screen illustrated in FIG. 15 B , the playback unit 43 in step S 26 plays back the motion picture from three seconds before the reset display ending time point of the subtitle and displays the preview screen using the display control unit 44 .
  • step S 23 in a case where “change” is selected on the selection screen illustrated in FIG. 15 B , the reset unit 42 in step S 24 changes the display starting time point in accordance with the reset display ending time point of the subtitle. Specifically, in a case where the display ending time point of the subtitle is reset to, for example, two seconds after the display ending time point, the reset unit 42 changes the display starting time point to two seconds after the display starting time point in accordance with the reset display ending time point. In addition, in a case where the display ending time point of the subtitle is reset to, for example, two seconds before the display ending time point, the reset unit 42 changes the display starting time point to two seconds before the display starting time point in accordance with the reset display ending time point.
  • step S 25 the playback unit 43 plays back the motion picture from three seconds before the reset display starting time point of the subtitle and displays the preview screen using the display control unit 44 .
  • FIG. 16 A and FIG. 16 B illustrate one example of the display screen of the terminal apparatus 20 in the editing mode.
  • the subtitle 57 as the specific information is displayed at a specific time before the display starting time point of the subtitle or a specific time after the display ending time point.
  • the subtitle 57 is at least a part of the subtitle set in the motion picture and is displayed by omitting a part of the subtitle set in the motion picture.
  • the display control unit 44 displays the subtitle 57 having omission without omission as illustrated in FIG. 16 B .
  • the display control unit 44 displays the subtitle 57 in which a part of the subtitle is omitted as illustrated in FIG. 16 A .
  • the subtitles such as the notification information and the specific information may be displayed in overlay on the motion picture while the motion picture is being played back in the full screen display state, and the user may adjust the display timing of the subtitle forward or rearward while playing back and checking the motion picture on the display screen. That is, even before the subtitle is displayed or after the subtitle is displayed in the motion picture, the display timing may be adjusted forward or rearward while the subtitle being displayed or the subtitle displayed in the motion picture and the display timing of the subtitle are being checked.
  • the exemplary embodiment is described using a case where the display timing is adjusted forward or rearward using the terminal apparatus 20 .
  • the present invention is not limited to the exemplary embodiment and may also be applied to a case where the terminal apparatus 30 is used.
  • the exemplary embodiment is described using a case where the display timing of the subtitle provided to the motion picture is adjusted.
  • the present invention is not limited to the exemplary embodiment and may also be applied to a case where the display timing of the subtitle obtained by performing voice recognition on the voice of the motion picture is adjusted.
  • processor refers to hardware in abroad sense.
  • Examples of the processor include general processors (e.g., CPU: Central Processing Unit), and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, and programmable logic device).
  • processor is broad enough to encompass one processor or plural processors in collaboration which are located physically apart from each other but may work cooperatively.
  • the order of operations of the processor is not limited to one described in the embodiments above, and may be changed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)
  • Digital Computer Display Output (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Circuits (AREA)

Abstract

An information processing apparatus includes a memory, and a processor, in which the memory stores a motion picture, a subtitle set in the motion picture, and a display starting time point and a display ending time point of the subtitle, and the processor is configured to display the subtitle in the motion picture being played back in accordance with a current playback time point and display notification information for notifying a user that the current playback time point is a specific time before or after a time point at which display of the subtitle is started or ended at the specific time before or after the display starting time point or the display ending time point of the subtitle in the motion picture.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2019-234336 filed Dec. 25, 2019.
BACKGROUND (i) Technical Field
The present invention relates to an information processing apparatus and a non-transitory computer readable medium storing a program.
(ii) Related Art
JP2003-224773A discloses a subtitle editing and preview assistance system including a section that associates a display starting timing and a display ending timing of a display unit subtitle of a target of editing with corresponding timing positions on a timeline denoting an elapse in time of a broadcasting program of the target of editing as a time axis, a section that displays a display starting position and an ending position of the display unit subtitle by matching the display starting position and the ending position to the display starting timing and the ending timing of the subtitle associated on the timeline, and a section that corrects the display starting timing or the display ending timing of the display unit subtitle by moving the displayed display starting position or the displayed ending position of the display unit subtitle.
JP2003-224807A discloses a subtitled broadcasting program editing assistance system that is a system assisting subtitled broadcasting program editing of creating a final subtitled broadcasting program by correcting created subtitled broadcasting program data and includes a display section that, at the time of performing a linefeed or a page break in a subtitle screen editing work, displays a post-correction subtitle screen of the subtitle screen and displays the post-correction subtitle screens before and after reflection of the correction in parallel.
SUMMARY
In the case of performing an editing operation of providing a subtitle to a motion picture, a display timing of the subtitle provided to the motion picture may be intended to be changed by shifting the display timing forward or rearward.
However, in normal playback of the motion picture, a display of the subtitle is suddenly started during playback of the motion picture, and the display of the displayed subtitle is finished. Thus, a user may not easily recognize a starting timing or an ending timing of the display of the subtitle.
Consequently, the user needs to record a display starting time point and a display ending time point of the subtitle of which the display timing is intended to be changed while playing back the motion picture, and perform adjustment by repeatedly playing back the same content by rewinding playback of the motion picture. Adjusting the display timing of the subtitle forward or rearward is not easy.
Aspects of non-limiting embodiments of the present disclosure relate to an information processing apparatus and a non-transitory computer readable medium storing a program that, in a case of adjusting a display timing of a subtitle provided to a motion picture, cause a user to more easily recognize the display timing of the subtitle than in a case where notification information for notifying the user that the current playback time point is a specific time before or after a time point at which display of the subtitle is started or ended is not displayed before or after a display starting time point and a display ending time point of the subtitle.
Aspects of certain non-limiting embodiments of the present disclosure overcome the above disadvantages and/or other disadvantages not described above. However, aspects of the non-limiting embodiments are not required to overcome the disadvantages described above, and aspects of the non-limiting embodiments of the present disclosure may not overcome any of the disadvantages described above.
According to an aspect of the present disclosure, there is provided an information processing apparatus including a memory, and a processor, in which the memory stores a motion picture, a subtitle set in the motion picture, and a display starting time point and a display ending time point of the subtitle, and the processor is configured to display the subtitle in the motion picture being played back in accordance with a current playback time point and display notification information for notifying a user that the current playback time point is a specific time before or after a time point at which display of the subtitle is started or ended at the specific time before or after the display starting time point or the display ending time point of the subtitle in the motion picture.
BRIEF DESCRIPTION OF THE DRAWINGS
Exemplary embodiment(s) of the present invention will be described in detail based on the following figures, wherein:
FIG. 1 is a system diagram illustrating a configuration of a multimedia content generation system according to one exemplary embodiment of the present invention;
FIG. 2 is a block diagram illustrating a hardware configuration of an editing processing server 10 according to one exemplary embodiment of the present invention;
FIG. 3 is a block diagram illustrating a functional configuration of the editing processing server 10 according to one exemplary embodiment of the present invention;
FIG. 4A is a diagram illustrating one example of subtitle data stored in a data storage unit 33 of the editing processing server 10, and FIG. 4B is a diagram illustrating one example of notification data generated from the subtitle data in FIG. 4A;
FIG. 5A is a diagram illustrating one example of a display screen displayed on a terminal apparatus 20 in a playback mode, and FIG. 5B is a diagram illustrating one example of the display screen displayed on the terminal apparatus 20 in an editing mode;
FIG. 6A to FIG. 6C are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20;
FIG. 7 is a diagram illustrating one example of the display screen displayed on the terminal apparatus 20;
FIG. 8A to FIG. 8C are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20;
FIG. 9A to FIG. 9C are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20;
FIG. 10 is a diagram illustrating one example of the display screen displayed on the terminal apparatus 20;
FIG. 11A to FIG. 11C are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20;
FIG. 12 is a flowchart illustrating a summary of a process in the editing processing server 10 according to one exemplary embodiment of the present invention;
FIG. 13A and FIG. 13B are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20;
FIG. 14 is a flowchart illustrating a summary of the process in the editing processing server 10 according to one exemplary embodiment of the present invention;
FIG. 15A and FIG. 15B are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20; and
FIG. 16A and FIG. 16B are diagrams illustrating one example of the display screen displayed on the terminal apparatus 20.
 DETAILED DESCRIPTION
Next, an exemplary embodiment of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a system diagram illustrating a configuration of a multimedia content generation system according to one exemplary embodiment of the present invention.
As illustrated in FIG. 1 , the multimedia content generation system according to one exemplary embodiment of the present invention is configured with an editing processing server 10 and a terminal apparatus 30 such as a personal computer (hereinafter, abbreviated to personal com) connected to each other through a network 1 and a terminal apparatus 20 such as a smartphone or a tablet terminal connected by a wireless line through a wireless LAN terminal 2.
The multimedia content generation system of this exemplary embodiment generates a multimedia content into which various contents such as a motion picture, a still picture, a voice, a text, and an automatic translation are combined. According to the multimedia content generation system of this exemplary embodiment, for example, the multimedia content may be generated by storing data for providing a subtitle to the motion picture in the editing processing server 10 by the terminal apparatus 30 or adjusting a display timing of the subtitle provided to the motion picture in the data stored in the editing processing server 10 by shifting the display timing forward or rearward by the terminal apparatus 20.
The subtitle refers to information that is additional information for the motion picture such as an explanation, a conversation, and a translation displayed on a screen of the motion picture such as a movie or a television program using a text.
The editing processing server 10 is an information processing apparatus on which editing software for generating the multimedia content by editing such various contents is installed. The terminal apparatus 20 and the terminal apparatus 30 are information processing apparatuses that acquire the motion picture and generate the multimedia content using the editing software operating on the editing processing server 10.
The editing software may not be installed on the editing processing server 10. Instead, the editing software may be directly installed on the terminal apparatus 20 and the terminal apparatus 30.
Next, a hardware configuration of the editing processing server 10 in the multimedia content generation system of this exemplary embodiment is illustrated in FIG. 2 .
As illustrated in FIG. 2 , the editing processing server 10 includes a CPU 11, a memory 12, a storage apparatus 13 such as a hard disk drive (HDD), a communication interface (IF) 14 transmitting and receiving data to and from an external apparatus or the like such as the terminal apparatuses 20 and 30 through the network 1, and a user interface (UI) apparatus 15 including a touch panel or a liquid crystal display, and a keyboard. These constituents are connected to each other through a control bus 16.
The CPU 11 controls the operation of the editing processing server 10 by executing a predetermined process based on a control program stored in the memory 12 or the storage apparatus 13. In this exemplary embodiment, the CPU 11 is described as reading and executing the control program stored in the memory 12 or the storage apparatus 13. Alternatively, the program may be stored in a storage medium such as a CD-ROM and provided to the CPU 11.
FIG. 3 is a block diagram illustrating a functional configuration of the editing processing server 10 implemented by executing the control program.
As illustrated in FIG. 3 , the editing processing server 10 of this exemplary embodiment includes a data communication unit 31, a control unit 32, and a data storage unit 33.
The data communication unit 31 performs data communication with the terminal apparatuses 20 and 30 through the network 1.
The control unit 32 controls the operation of the editing processing server 10 and includes a switching unit 41, a reset unit 42, a playback unit 43, a display control unit 44, a user operation reception unit 45, and a notification data generation unit 46.
The data storage unit 33 stores various content data such as the motion picture on which an editing process is to be performed.
The display control unit 44 controls a screen displayed on the terminal apparatuses 20 and 30.
The user operation reception unit 45 receives a location selected by a user in the terminal apparatuses 20 and 30.
The playback unit 43 plays back the motion picture from a playback time point corresponding to the location received by the user operation reception unit 45 in the case of playing back the motion picture in which the subtitle is set.
The reset unit 42 resets a display starting time point or a display ending time point of the subtitle set in the motion picture.
The switching unit 41 switches between an editing mode in which the display starting time point or the display ending time point of the subtitle set in the motion picture is reset, and a playback mode in which the motion picture is played back.
The notification data generation unit 46 generates the subtitle set in the motion picture, a subtitle as notification information for notifying the user of a specific time before or after the display starting time point or the display ending time point of the subtitle based on the display starting time point and the display ending time point of the subtitle, and a subtitle as specific information as information for specifying the subtitle to be notified to the user in the case of notifying the user of the specific time before the display starting time point of the subtitle or the specific time after the display ending time point, and stores display starting time points and display ending time points of these subtitles in the data storage unit 33 in association with each other as notification data. Examples of the notification information are exemplified by “0 seconds before a subtitle display” “0 seconds after the start”, and “0 seconds before the end”. Examples of the specific information are exemplified by at least a part of the subtitle set in the motion picture.
The display control unit 44 displays the subtitle as the notification information and the subtitle as the specific information in the motion picture being played back in accordance with the current playback time point based on the notification data stored in the data storage unit 33.
That is, in the case of the editing mode, the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point and displays the subtitle as the notification information for notifying the user that the current playback time point is the specific time before or the time after the display starting or ending time point of the subtitle at the specific time before or after the display starting time point or the display ending time point of the subtitle in the motion picture.
In the case of notifying the user of the specific time before the display starting time point of the subtitle or the specific time after the display ending time point, the display control unit 44 displays the subtitle as the notification information in the motion picture and displays the subtitle as the specific information, for example, at least a part of the subtitle set in the motion picture, in the motion picture being played back in accordance with the current playback time point.
In the case of the playback mode, the display control unit 44 does not display the subtitle as the notification information and the subtitle as the specific information in the motion picture.
FIG. 4A and FIG. 4B are diagrams illustrating one example of data stored in the data storage unit 33.
As illustrated in FIG. 4A, the data storage unit 33 stores the motion picture, the subtitle set in the motion picture, and the display starting time point and the display ending time point of the subtitle in association with each other as subtitle data.
Based on the subtitle data illustrated in FIG. 4A, the notification data generation unit 46, for example, as illustrated in FIG. 4B, generates the subtitle as the notification information for notifying the user of three seconds before or after the start, two seconds before or after the start, one second before or after the start, zero seconds for the start, three seconds before or after the end, two seconds before or after the end, one second before or after the end, and zero seconds for the end at three seconds before or after, two seconds before or after, and one second before or after each of the display starting time point and the display ending time point of the subtitle set in the motion picture and zero seconds for each of the display starting time point and the display ending time point, and the subtitle as the specific information for specifying the subtitle to be notified to the user in the case of notifying the user of three seconds before, two seconds before, and one second before the display starting time point, zero seconds for the display ending time point, one second after, two seconds after, and three seconds after the display ending time point before the display starting time point or after the display ending time point of the subtitle. The notification data generation unit 46 stores the display starting time points and the display ending time points of these subtitles in the data storage unit 33 in association with each other as the notification data.
Specifically, the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point, counts down before the display starting time point of the subtitle from, for example, three seconds before the display starting time point of the subtitle, and displays, in the motion picture, the subtitle as the notification information for three seconds before the start of display of the subtitle, two seconds before the start, and one second before the start and the subtitle “(grandfather has gone to mountain . . . )” as the specific information for at least a part of the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture.
In addition, the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point, counts up from the display starting time point of the subtitle to, for example, three seconds after the display starting time point of the subtitle, and displays, in the motion picture, the subtitle as the notification information for zero seconds for the start of display of the subtitle, one second after the start, two seconds after the start, and three seconds after the start and the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture.
In addition, the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point, counts down before the display ending time point of the subtitle from, for example, three seconds before the display ending time point of the subtitle, and displays, in the motion picture, the subtitle as the notification information for three seconds before the end of display of the subtitle, two seconds before the end, and one second before the end and the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture.
In addition, the display control unit 44 displays the subtitle in the motion picture being played back in accordance with the current playback time point, counts up from the display ending time point of the subtitle to, for example, three seconds after the display ending time point of the subtitle, and displays, in the motion picture, the subtitle as the notification information for zero seconds for the end of display of the subtitle, one second after the end, two seconds after the end, and three seconds after the end and the subtitle “( . . . laundry)” as the specific information for at least a part of the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture.
In addition, in the case of displaying the subtitle as the notification information in the motion picture based on the notification data illustrated in FIG. 4B, the display control unit 44 displays a reset button as a reset section, described later, in accordance with the subtitle. The reset button is information for resetting the display starting time point or the display ending time point of the subtitle set in the motion picture.
In a case where the display starting time point or the display ending time point of the subtitle is reset by the reset unit 42, the display control unit 44 displays information for selecting whether or not to change the display ending time point or the display starting time point of the subtitle in accordance with the reset display starting time point or the reset display ending time point of the subtitle in the motion picture.
In a case where “change the display ending time point or the display starting time point of the subtitle in accordance with the reset display starting time point or the reset display ending time point of the subtitle” is received by the user operation reception unit 45, the reset unit 42 changes the display ending time point or the display starting time point of the subtitle in accordance with the reset display starting time point or the reset display ending time point of the subtitle.
In addition, in a case where “do not change the display ending time point or the display starting time point of the subtitle in accordance with the reset display starting time point or the reset display ending time point of the subtitle” is received by the user operation reception unit 45, the reset unit 42 does not change the display ending time point or the display starting time point of the subtitle in accordance with the reset display starting time point or the reset display ending time point of the subtitle.
The reset unit 42 may switch between changing and not changing the display ending time point or the display starting time point of the subtitle depending on whether the reset time point is the display starting time point or the display ending time point of the subtitle. For example, in a case where the display starting time point is reset, the reset unit 42 changes the display ending time point in accordance with the reset display setting time point. Ina case where the display ending time point is reset, the reset unit 42 may not change the display starting time point in accordance with the reset display ending time point.
In addition, even in a full screen display state that is a state where the current playback time point such as a seekbar is not displayed in the motion picture being played back, the display control unit 44 may display the subtitle as the notification information, at least a part of the subtitle set in the motion picture which is the subtitle as the specific information, and the reset button as the reset section which is information for resetting performed by the reset unit 42 in the motion picture.
That is, in the editing mode, the display control unit 44 may display the subtitle as the notification information, at least a part of the subtitle set in the motion picture which is the subtitle as the specific information, and the reset button as the reset section which is information for resetting performed by the reset unit 42 in the motion picture even in the full screen display state.
In a case where the display starting time point or the display ending time point of the subtitle is reset, the playback unit 43 plays back the motion picture from, for example, three seconds which is a preset time before the reset display starting time point or the reset display ending time point of the subtitle. Accordingly, in a case where the display of the subtitle is reset, the user may check whether or not the resetting is appropriate.
Next, the operation of the editing processing server 10 in the multimedia content generation system of this exemplary embodiment will be described in detail with reference to the drawings.
FIG. 5A is a diagram illustrating a display screen of the terminal apparatus 20 in the playback mode in which the motion picture is played back. FIG. 5B is a diagram illustrating the display screen of the terminal apparatus 20 in the editing mode in which the display timing of the subtitle set in the motion picture is adjusted.
As illustrated in FIG. 5A, in the playback mode, a motion picture display screen 52 on which the motion picture is displayed, a seekbar 53 for switching a playback position of the motion picture, and an operation button 55 such as a playback button, a stop button, a rewind button, a fast forward button, and a volume switching button for the motion picture are displayed. A pointer 54 is displayed on the seekbar 53. The playback position of the motion picture may be switched by moving the pointer 54 on the seekbar 53. In addition, a switching button 51 that is a switching section for switching the display screen of the terminal apparatus 20 in the playback mode to the display screen in the editing mode by the switching unit 41 is displayed.
In a case where the switching button 51 displayed on the display screen of the terminal apparatus 20 in the playback mode is tapped, the display screen of the terminal apparatus 20 is switched to the editing mode illustrated in FIG. 5B.
As illustrated in FIG. 5B, in the editing mode, the motion picture is displayed in full screen on the display screen of the terminal apparatus 20 and is displayed larger than the motion picture in the playback mode. In the motion picture displayed in full screen, a subtitle 56 as the notification information, a subtitle 57 as the specific information, and a reset button 58 for resetting the display starting time point or the display ending time point of the subtitle are displayed. In addition, the switching button 51 for switching the display screen of the terminal apparatus 20 in the editing mode to the display screen in the playback mode is displayed.
In a case where the switching button 51 displayed on the display screen of the terminal apparatus 20 in the editing mode is tapped, the display screen of the terminal apparatus 20 is switched to the playback mode illustrated in FIG. 5A.
That is, the switching button 51 capable of switching between the playback mode and the editing mode is displayed on the display screen of the terminal apparatus 20, and the playback mode and the editing mode are configured to be switchable each time the switching button 51 is tapped.
Tapping refers to an operation of touching the display screen with a finger or the like such as lightly hitting the display screen with a finger, a touch pen, or the like.
Next, one example of the display screen of the terminal apparatus 20 in the editing mode will be specifically described based on FIG. 6A to FIG. 11C. In the following example, a display of the switching button 51 is omitted.
At three seconds before the display starting time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “three seconds before the start”, the subtitle 57 as the specific information such as “(grandfather . . . )” which is a part of the subtitle displayed after three seconds, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is three seconds before the display starting time point are displayed as illustrated in FIG. 6A.
At two seconds before the display starting time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “two seconds before the start”, the subtitle 57 as the specific information such as “(grandfather . . . )” which is a part of the subtitle displayed after two seconds, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is two seconds before the display starting time point are displayed as illustrated in FIG. 6B.
At one second before the display starting time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “one second before the start”, the subtitle 57 as the specific information such as “(grandfather . . . )” which is a part of the subtitle displayed after one second, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is one second before the display starting time point are displayed as illustrated in FIG. 6C.
At the display starting time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “zero seconds for the start” and the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture are displayed as illustrated in FIG. 7 .
At one second after the display starting time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “one second after the start”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is one second after the display starting time point are displayed as illustrated in FIG. 8A.
At two seconds after the display starting time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “two seconds after the start”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is two seconds after the display starting time point are displayed as illustrated in FIG. 8B.
At three seconds after the display starting time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “three seconds after the start”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display starting time point of the subtitle to [from here] which is three seconds after the display starting time point are displayed as illustrated in FIG. 8C.
At three seconds before the display ending time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “three seconds before the end”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is three seconds before the display ending time point are displayed as illustrated in FIG. 9A.
At two seconds before the display ending time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “two seconds before the end”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is two seconds before the display ending time point are displayed as illustrated in FIG. 9B.
At one second before the display ending time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “one second before the end”, the subtitle “grandfather has gone to mountain for firewood and grandmother has gone to river for laundry” set in the motion picture, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is one second before the display ending time point are displayed as illustrated in FIG. 9C.
At the display ending time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “zero seconds for the end” and the subtitle 57 as the specific information such as “( . . . laundry)” which is a part of the subtitle displayed before the end are displayed as illustrated in FIG. 10 .
At one second after the display ending time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “one second after the end”, the subtitle 57 as the specific information such as “( . . . laundry)” which is a part of the subtitle displayed before one second, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is one second after the display ending time point are displayed as illustrated in FIG. 11A.
At two seconds after the display ending time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “two seconds after the end”, the subtitle 57 as the specific information such as “( . . . laundry)” which is a part of the subtitle displayed before two seconds, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is two seconds after the display ending time point are displayed as illustrated in FIG. 11B.
At three seconds after the display ending time point of the subtitle during playback of the motion picture, the subtitle 56 as the notification information such as “three seconds after the end”, the subtitle 57 as the specific information such as “( . . . laundry)” which is a part of the subtitle displayed before three seconds, and the reset button 58 for resetting the display ending time point of the subtitle to [to here] which is three seconds after the display ending time point are displayed as illustrated in FIG. 11C.
Next, a summary of operation in the editing processing server 10 will be described using FIG. 12 to FIG. 15B. The summary will be described using a case where the notification data of the display starting time point or the display ending time point of the subtitle generated by the notification data generation unit 46 is stored in the data storage unit 33.
First, the summary of operation in the editing processing server 10 in the case of resetting the display starting time point of the subtitle will be described using FIG. 12 to FIG. 13B.
In step S10, the display control unit 44 displays the notification data in accordance with the playback time point of the motion picture. Specifically, the display control unit 44 displays the subtitle 56 as the notification information which is displayed by counting the time point to the start of display of the subtitle and the time point from the start of display of the subtitle in accordance with the playback time point of the motion picture, and the reset button 58 for resetting the display starting time point of the subtitle to [from here]. In addition, in a case where the playback time point of the motion picture is before the display starting time point of the subtitle, the display control unit 44 displays the subtitle 57 as the specific information in accordance with the subtitle 56 in the case of displaying the subtitle 56.
In step S11, in a case where the reset button 58 of [from here] is tapped, the reset unit 42 in step S12 resets the display starting time point of the subtitle to the time point at which the reset button 58 of [from here] is tapped.
Specifically, on the display screen corresponding to the playback time point of the motion picture in the editing mode as illustrated in FIG. 13A, in a case where the reset button 58 of [from here] is tapped in a case where the subtitle 56 as the notification information is “two seconds before the start”, the display starting time point of the subtitle is reset to two seconds before the display starting time point of the subtitle at which the reset button 58 is tapped.
In a case where the display starting time point of the subtitle is reset, a selection screen for selecting whether or not to change the display ending time point in accordance with the reset display starting time point of the subtitle is displayed as illustrated in FIG. 13B.
In step S13, in a case where “do not change” is selected on the selection screen illustrated in FIG. 13B, the playback unit 43 in step S15 plays back the motion picture from three seconds before the reset display starting time point of the subtitle and displays a preview screen using the display control unit 44.
In step S13, in a case where “change” is selected on the selection screen illustrated in FIG. 13B, the reset unit 42 in step S14 changes the display ending time point in accordance with the reset display starting time point of the subtitle. Specifically, in a case where the display starting time point of the subtitle is reset to, for example, two seconds before the display starting time point, the reset unit 42 changes the display ending time point to two seconds before the display ending time point in accordance with the reset display starting time point. In addition, in a case where the display starting time point of the subtitle is reset to, for example, two seconds after the display starting time point, the reset unit 42 changes the display ending time point to two seconds after the display ending time point in accordance with the reset display starting time point.
In step S15, the playback unit 43 plays back the motion picture from three seconds before the reset display starting time point of the subtitle and displays the preview screen using the display control unit 44.
Next, the summary of operation in the editing processing server 10 in the case of resetting the display ending time point of the subtitle will be described using FIG. 14 to FIG. 15B.
In step S20, the display control unit 44 displays the notification data in accordance with the playback time point of the motion picture. Specifically, the display control unit 44 displays the subtitle 56 as the notification information which is displayed by counting the time point to the end of display of the subtitle and the time point from the end of display of the subtitle, and the reset button 58 for resetting the display ending time point of the subtitle to [to here]. In addition, in a case where the playback time point of the motion picture is after the display ending time point of the subtitle, the display control unit 44 displays the subtitle 57 as the specific information in accordance with the subtitle 56 in the case of displaying the subtitle 56.
In step S21, in a case where the reset button 58 of [to here] is tapped, the reset unit 42 in step S22 resets the display ending time point of the subtitle to the time point at which the reset button 58 of [to here] is tapped.
Specifically, on the display screen corresponding to the playback time point of the motion picture in the editing mode as illustrated in FIG. 15A, in a case where the reset button 58 of [to here] is tapped in a case where the subtitle 56 as the notification information is “two seconds after the end”, the display ending time point of the subtitle is reset to two seconds after the display ending time point of the subtitle at which the reset button 58 is tapped.
In a case where the display ending time point of the subtitle is reset, a selection screen for selecting whether or not to change the display starting time point in accordance with the reset display ending time point of the subtitle is displayed as illustrated in FIG. 15B.
In step S23, in a case where “do not change” is selected on the selection screen illustrated in FIG. 15B, the playback unit 43 in step S26 plays back the motion picture from three seconds before the reset display ending time point of the subtitle and displays the preview screen using the display control unit 44.
In step S23, in a case where “change” is selected on the selection screen illustrated in FIG. 15B, the reset unit 42 in step S24 changes the display starting time point in accordance with the reset display ending time point of the subtitle. Specifically, in a case where the display ending time point of the subtitle is reset to, for example, two seconds after the display ending time point, the reset unit 42 changes the display starting time point to two seconds after the display starting time point in accordance with the reset display ending time point. In addition, in a case where the display ending time point of the subtitle is reset to, for example, two seconds before the display ending time point, the reset unit 42 changes the display starting time point to two seconds before the display starting time point in accordance with the reset display ending time point.
In step S25, the playback unit 43 plays back the motion picture from three seconds before the reset display starting time point of the subtitle and displays the preview screen using the display control unit 44.
Next, a modification example of the display screen of the terminal apparatus 20 in the editing mode will be described.
FIG. 16A and FIG. 16B illustrate one example of the display screen of the terminal apparatus 20 in the editing mode. As illustrated in FIG. 16A, on the display screen in the editing mode, the subtitle 57 as the specific information is displayed at a specific time before the display starting time point of the subtitle or a specific time after the display ending time point. The subtitle 57 is at least a part of the subtitle set in the motion picture and is displayed by omitting a part of the subtitle set in the motion picture.
In a case where the subtitle 57 or a vicinity of the subtitle 57 in which a part of the subtitle is omitted as illustrated in FIG. 16A is tapped, the display control unit 44 displays the subtitle 57 having omission without omission as illustrated in FIG. 16B.
In addition, after an elapse of a certain time from the display of the full text of the subtitle 57 without omission as illustrated in FIG. 16B, or in a case where the subtitle 57 or the vicinity of the subtitle 57 displayed without omission is tapped, the display control unit 44 displays the subtitle 57 in which a part of the subtitle is omitted as illustrated in FIG. 16A.
As described above, even with a terminal apparatus such as the terminal apparatus 20 having a smaller display screen than the terminal apparatus 30, the subtitles such as the notification information and the specific information may be displayed in overlay on the motion picture while the motion picture is being played back in the full screen display state, and the user may adjust the display timing of the subtitle forward or rearward while playing back and checking the motion picture on the display screen. That is, even before the subtitle is displayed or after the subtitle is displayed in the motion picture, the display timing may be adjusted forward or rearward while the subtitle being displayed or the subtitle displayed in the motion picture and the display timing of the subtitle are being checked.
The exemplary embodiment is described using a case where the display timing is adjusted forward or rearward using the terminal apparatus 20. However, the present invention is not limited to the exemplary embodiment and may also be applied to a case where the terminal apparatus 30 is used.
In addition, the exemplary embodiment is described using a case where the display timing of the subtitle provided to the motion picture is adjusted. However, the present invention is not limited to the exemplary embodiment and may also be applied to a case where the display timing of the subtitle obtained by performing voice recognition on the voice of the motion picture is adjusted.
In the embodiments above, the term “processor” refers to hardware in abroad sense. Examples of the processor include general processors (e.g., CPU: Central Processing Unit), and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, and programmable logic device).
In the embodiments above, the term “processor” is broad enough to encompass one processor or plural processors in collaboration which are located physically apart from each other but may work cooperatively. The order of operations of the processor is not limited to one described in the embodiments above, and may be changed.
The foregoing description of the exemplary embodiments of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, thereby enabling others skilled in the art to understand the invention for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalents.

Claims (10)

What is claimed is:
1. An information processing apparatus comprising:
a memory; and
a processor,
wherein the memory stores a motion picture, a first subtitle set in the motion picture, and a display starting time point and a display ending time point of the first subtitle, and
the processor is configured to
display the first subtitle on a first region in the motion picture being played back in accordance with a current playback time point, wherein the first subtitle is superimposed onto the motion picture and describes image contents in the motion picture at the current playback time point, and
display a second subtitle as notification information on a second region in the motion picture, wherein the second region is different from the first region,
wherein the second subtitle is superimposed onto the motion picture while the motion picture is being played back to notify a user the display starting time point of the first subtitle, wherein the display starting time point of the first subtitle is an amount of time for which the first subtitle has been being displayed or to be displayed from the current playback time point, or
wherein the second subtitle is superimposed onto the motion picture while the motion picture is being played back to notify the user the display ending time point of the first subtitle, wherein the display ending time point of the first subtitle is an amount of time for which the first subtitle has been stopped being displayed or to be stopped being displayed from the current playback time point.
2. The information processing apparatus according to claim 1,
wherein the processor is configured to
display the second subtitle in the motion picture even in a state where the current playback time point is not displayed in the motion picture being played back.
3. The information processing apparatus according to claim 1,
wherein the processor is configured to, in a case of displaying the second subtitle in the motion picture,
display, in the motion picture, information for resetting the display starting time point or the display ending time point of the first subtitle set in the motion picture.
4. The information processing apparatus according to claim 2,
wherein in a case of displaying the second subtitle in the motion picture, the processor is configured to
display, in the motion picture, information for resetting the display starting time point or the display ending time point of the first subtitle set in the motion picture.
5. The information processing apparatus according to claim 3,
wherein the processor is further configured to, in a case where the display starting time point or the display ending time point of the first subtitle is reset,
display information for selecting whether or not to change the display ending time point or the display starting time point of the first subtitle in accordance with the reset display starting time point or the reset display ending time point of the first subtitle in the motion picture.
6. The information processing apparatus according to claim 3,
wherein the processor is configured to,
in a case where the display starting time point or the display ending time point of the first subtitle is reset, play back the motion picture from a preset time before the reset display starting time point or the reset display ending time point of the first subtitle.
7. The information processing apparatus according to claim 1,
wherein the processor is configured to
switch between an editing mode in which the second subtitle is displayed in the motion picture and a playback mode in which the motion picture is played back without displaying the second subtitle in the motion picture.
8. The information processing apparatus according to claim 7,
wherein the processor is configured to, in the editing mode,
display the second subtitle in the motion picture even in a state where the playback time point of the motion picture is not displayed.
9. A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising:
storing a motion picture, a first subtitle set in the motion picture, and a display starting time point and a display ending time point of the first subtitle; and
displaying the first subtitle on a first region in the motion picture being played back in accordance with a current playback time point, wherein the first subtitle is superimposed onto the motion picture and describes image contents in the motion picture at the current playback time point, and
displaying a second subtitle as notification information on a second region in the motion picture, wherein the second region is different from the first region,
wherein the second subtitle is superimposed onto the motion picture while the motion picture is being played back to notify a user the display starting time point of the first subtitle, wherein the display starting time point of the first subtitle is an amount of time for which the first subtitle has been being displayed or to be displayed from the current playback time point, or
wherein the second subtitle is superimposed onto the motion picture while the motion picture is being played back to notify the user the display ending time point of the first subtitle, wherein the display ending time point of the first subtitle is an amount of time for which the first subtitle has been stopped being displayed or to be stopped being displayed from the current playback time point.
10. An information processing apparatus comprising:
a memory; and
a processor,
wherein the memory stores a motion picture, a subtitle set in the motion picture, and a display starting time point and a display ending time point of the subtitle, and
the processor is configured to
display the subtitle in the motion picture being played back in accordance with a current playback time point and display notification information in the motion picture,
wherein the notification information is to notify a user that the display starting time point of the subtitle is started at a specific time before or after the current playback time point, and wherein the notification information is displayed at the specific time, or
wherein the notification information is to notify the user that the display ending time point of the subtitle is ended at another specific time before or after the current playback time point, and wherein the notification is displayed at the another specific time, and
in a case of displaying the notification information in the motion picture, display, in the motion picture, information for resetting the display starting time point or the display ending time point of the subtitle set in the motion picture.
US16/866,504 2019-12-25 2020-05-04 Information processing apparatus and non-transitory computer readable medium storing program Active 2041-12-23 US11967347B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019234336A JP7516757B2 (en) 2019-12-25 2019-12-25 Information processing device and program
JP2019-234336 2019-12-25

Publications (2)

Publication Number Publication Date
US20210201957A1 US20210201957A1 (en) 2021-07-01
US11967347B2 true US11967347B2 (en) 2024-04-23

Family

ID=76458633

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/866,504 Active 2041-12-23 US11967347B2 (en) 2019-12-25 2020-05-04 Information processing apparatus and non-transitory computer readable medium storing program

Country Status (3)

Country Link
US (1) US11967347B2 (en)
JP (1) JP7516757B2 (en)
CN (1) CN113038226A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003224807A (en) 2002-01-28 2003-08-08 Telecommunication Advancement Organization Of Japan Subtitle program editing support system and semi-automatic subtitle program production system
JP2003224773A (en) 2002-01-28 2003-08-08 Telecommunication Advancement Organization Of Japan Subtitle editing support system by moving the boundaries of subtitles placed on the timeline
US20070140656A1 (en) 2005-12-20 2007-06-21 Vestel Elektronik Sanayi Ve Ticaret A.S. Method and apparatus for synchronizing subtitles with a video
JP2008312066A (en) 2007-06-15 2008-12-25 Casio Hitachi Mobile Communications Co Ltd Subtitled video playback device and program
JP2014116828A (en) 2012-12-11 2014-06-26 Sharp Corp Digital broadcast receiver, caption display method and program
US20150055932A1 (en) * 2013-08-23 2015-02-26 Canon Kabushiki Kaisha Image recording apparatus and method, and image playback apparatus and method
US20210042464A1 (en) * 2018-04-13 2021-02-11 Young Seok HWANG Playable text editor and editing method therefor

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101816174A (en) * 2007-10-05 2010-08-25 夏普株式会社 Contents display control apparatus, and contents display control method, program and storage medium
CN104967910B (en) * 2014-10-29 2018-11-23 广州酷狗计算机科技有限公司 Multimedia progress monitoring method and device
CN105959773B (en) * 2016-04-29 2019-06-18 魔方天空科技（北京）有限公司 Method and device for processing multimedia files

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003224807A (en) 2002-01-28 2003-08-08 Telecommunication Advancement Organization Of Japan Subtitle program editing support system and semi-automatic subtitle program production system
JP2003224773A (en) 2002-01-28 2003-08-08 Telecommunication Advancement Organization Of Japan Subtitle editing support system by moving the boundaries of subtitles placed on the timeline
US20070140656A1 (en) 2005-12-20 2007-06-21 Vestel Elektronik Sanayi Ve Ticaret A.S. Method and apparatus for synchronizing subtitles with a video
JP2008312066A (en) 2007-06-15 2008-12-25 Casio Hitachi Mobile Communications Co Ltd Subtitled video playback device and program
JP2014116828A (en) 2012-12-11 2014-06-26 Sharp Corp Digital broadcast receiver, caption display method and program
US20150055932A1 (en) * 2013-08-23 2015-02-26 Canon Kabushiki Kaisha Image recording apparatus and method, and image playback apparatus and method
US20210042464A1 (en) * 2018-04-13 2021-02-11 Young Seok HWANG Playable text editor and editing method therefor

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Office Action of Japan Counterpart Application", dated Jan. 9, 2024, with English translation thereof, p. 1-p. 6.

Also Published As

Publication number Publication date
US20210201957A1 (en) 2021-07-01
CN113038226A (en) 2021-06-25
JP7516757B2 (en) 2024-07-17
JP2021103845A (en) 2021-07-15

Similar Documents

Publication Publication Date Title
CN108900902B (en) Method, device, terminal equipment and storage medium for determining video background music
US20130346865A1 (en) Dynamic wallpaper of mobile systems
US11924617B2 (en) Method for projecting screen, display device, screen projection terminal, and storage medium
EP3216025B1 (en) Media presentation modification using audio segment marking
US20210029421A1 (en) Method and apparatus for releasing video file
WO2015183733A1 (en) Control of camera function using a virtual button and finger gestures
US12028583B2 (en) Information processing apparatus and non-transitory computer readable medium storing program
RU2599052C2 (en) Method and device for switching image
US9268397B2 (en) Information processor, information processing method, and computer program product for processing information input by user
US20140240472A1 (en) 3d subtitle process device and 3d subtitle process method
JP2011211481A (en) Video/audio player
US11126399B2 (en) Method and device for displaying sound volume, terminal equipment and storage medium
US11076121B2 (en) Apparatus and associated methods for video presentation
US10353568B2 (en) Display apparatus for controlling display of images based on detected touch operations
US20210073479A1 (en) Information processing apparatus and non-transitory computer readable medium
US11967347B2 (en) Information processing apparatus and non-transitory computer readable medium storing program
US9525854B2 (en) Information processing method and electronic device
US20150074595A1 (en) Electronic Book Apparatus, Page Feeding Method, and Page Feeding Program of Electronic Book
CN113596561A (en) Video stream playing method and device, electronic equipment and computer readable storage medium
JP6609795B2 (en) VIDEO / AUDIO PROCESSING DEVICE, VIDEO / AUDIO PROCESSING METHOD, AND PROGRAM
CN111954068B (en) Method and device for video definition switching and electronic device
US20240205490A1 (en) System and method for dynamic presentation of graphical and video content
US20170272685A1 (en) Method for video playing and electronic device
JP2010028734A (en) Image processing unit
JP2018006908A (en) Video processing device and method for changing resolution of video

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: FUJI XEROX CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OGAWA, MASAKAZU;REEL/FRAME:052578/0563

Effective date: 20200305

STCT Information on status: administrative procedure adjustment

Free format text: PROSECUTION SUSPENDED

AS Assignment

Owner name: FUJIFILM BUSINESS INNOVATION CORP., JAPAN

Free format text: CHANGE OF NAME;ASSIGNOR:FUJI XEROX CO., LTD.;REEL/FRAME:056223/0414

Effective date: 20210401

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE