KR101832464B1 - Device and method for providing moving picture, and computer program for executing the method - Google Patents

Abstract

According to an embodiment of the present invention, there is provided a method of providing a moving picture, comprising: receiving an original moving picture signal including information of the original moving picture by a communication unit; Generating a delayed moving picture signal including information on a delayed moving picture in which the original moving picture is delayed by a first time by a control unit; Transmitting at least one of the original moving picture signals to at least one or more caption input terminals by the communication unit; Receiving, by the communication unit, a delay signal including a subtitle signal including information on a subtitle of the original moving picture from the subtitle input terminal and information for delaying the output of the subtitle; Generating, by the control unit, an output time signal indicating a time at which the subtitle is output on the delayed moving picture based on the delayed signal; Transmitting the delayed moving picture signal to the viewer terminal by the communication unit; And transmitting, by the communication unit, the output time signal and the caption signal to the viewer terminal, wherein the caption signal includes at least one of a caption input by a user of the caption input terminal, At least one of a subtitle generated by an internal automatic translation program, a subtitle generated by an automatic translation program outside the subtitle input terminal, and a subtitle automatically generated by a speech recognition computer program of the subtitle input terminal .

Description

Technical Field [0001] The present invention relates to a video providing apparatus, a video providing method, and a computer program,

Embodiments of the present invention relate to a moving picture providing apparatus, a moving picture providing method, and a computer program.

As the image processing technology and the electronic communication technology are developed, a person who wants to provide a moving picture can perform broadcasting through a communication network such as the Internet using an electronic device, and a person who wants to watch a moving picture can also watch a moving picture It was possible.

However, most videos contain conversations or text in a specific language, and only those who can understand the language can fully enjoy the video. In the case of already-produced videos, it is possible to include subtitles created later in the video and play them together, but it is difficult to provide subtitles for the videos provided by live broadcasting.

The above-described background technology is technical information that the inventor holds for the derivation of the present invention or acquired in the process of deriving the present invention, and can not necessarily be a known technology disclosed to the general public prior to the filing of the present invention.

Korean Published Patent Application No. 2001-0099414 A

Embodiments of the present invention provide a moving image providing apparatus capable of delaying an original moving image for a predetermined period of time to provide the moving image to a viewer terminal, receiving a caption from the caption inputting terminal for the delayed time and providing the caption to the viewer terminal, , And a computer program.

Embodiments of the present invention provide a moving picture providing apparatus capable of providing information on a timing of displaying a caption along with a caption to a viewer terminal so that the caption can be displayed at a correct timing on a moving picture provided to the viewer terminal, , And a computer program.

According to an embodiment of the present invention, there is provided a method of providing a moving picture, comprising: receiving an original moving picture signal including information of the original moving picture by a communication unit; Generating a delayed moving picture signal including information on a delayed moving picture in which the original moving picture is delayed by a first time by a control unit; The communication unit transmits at least one of the original moving picture signals to at least one or more caption input terminals by the communication unit, a caption signal including information on the caption for the original moving picture from the caption input terminal, And receiving a delay signal including information for delaying the output of the subtitles; Generating, by the control unit, an output time signal indicating a time at which the subtitle is output on the delayed moving picture based on the delayed signal; Transmitting the delayed moving picture signal to the viewer terminal by the communication unit; And transmitting the output time signal and the caption signal to the viewer terminal by the communication unit.

The subtitle signal may include at least one of a subtitle input by a user of the subtitle input terminal, a subtitle generated by an automatic translation program in the subtitle input terminal, a subtitle generated by an automatic translation program outside the subtitle input terminal, And a subtitle automatically generated by the speech recognition computer program of the subtitle input terminal.

The user can input audiovisual information included in the caption to the caption input terminal by using at least one of a keyboard, a touch pad, and a microphone of the caption input terminal.

The user can input the subtitle by selecting at least some characters of a preset idiom or a previously created subtitle.

Wherein the viewer terminal outputs at least one of visual symbol and auditory information included in the caption signal together with the moving picture signal and outputs audible information included in the caption signal when the audiovisual information is output Dubbing) can be output.

Wherein the step of transmitting the output time signal and the caption signal to the viewer terminal further comprises providing information on the caption signal to the viewer terminal, wherein the information on the caption signal includes information on selection of the caption of another viewer Information about recommendation of the caption of another viewer, information on caption recommendation information about the original moving picture of the video provider, and information related to the caption provided by the caption inputter.

Wherein the delay signal is a signal including information of a second time for delaying the output of the subtitle, and the step of generating the output time signal comprises: a step of, when the subtitle input terminal transmits the subtitle signal A first time delayed from the first time by a length of time obtained by subtracting the second time from the first time and generates the output time signal so that the subtitle can be output on the delayed moving picture at the first time The second time may be determined by inputting a caption inputting to the caption inputterminal.

The moving picture providing method according to an embodiment of the present invention is characterized in that the controller predicts a time required for a moving picture viewer to read the caption based on at least one of a length of the caption, Determining a sustain period in which the output of the subtitles is to be maintained according to a time required to generate the sustain period signal, and generating a sustain period signal including information on the determined sustain period.

At this time, the step of transmitting the output time signal and the caption signal to the viewer terminal may further transmit the sustain period signal.

Other aspects, features, and advantages will become apparent from the following drawings, claims, and detailed description of the invention.

According to the present invention, it is possible to provide a moving picture providing apparatus and a moving picture providing apparatus capable of providing an original moving picture by a predetermined delay time to the viewer terminal, receiving the caption from the caption inputting terminal for the delayed time, Methods, and computer programs.

The present invention also provides a moving picture providing apparatus, a moving picture providing method, and a computer program capable of providing information on a timing of displaying a caption and a corresponding caption to a viewer terminal so that a caption can be displayed at a correct timing on a moving picture provided to the viewer terminal Can be provided.

1 is a view schematically showing a configuration of a moving picture providing system according to an embodiment of the present invention.
2 is a block diagram schematically showing an example of the internal configuration of the moving picture providing apparatus of Fig.
3 and 4 are block diagrams schematically illustrating an example of the internal configuration of a caption input terminal according to an embodiment of the present invention.
5 to 21 are flowcharts schematically illustrating an example of a moving picture providing method according to an embodiment of the present invention.

Embodiments of the present invention are capable of various transformations, and specific embodiments are illustrated in the drawings and described in detail in the description. The effects and features of the embodiments, and how to accomplish them, will be apparent with reference to the following detailed description together with the drawings. However, the embodiments are not limited to the embodiments described below, but may be implemented in various forms.

Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or corresponding elements throughout the drawings, and a duplicate description thereof will be omitted.

In the following embodiments, the terms first, second, and the like are used for the purpose of distinguishing one element from another element, not the limitative meaning.

In the following examples, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise.

In the following embodiments, terms such as inclusive or having mean that a feature or element described in the specification is present, and do not exclude the possibility that one or more other features or elements are added in advance.

In the drawings, components may be exaggerated or reduced in size for convenience of explanation. For example, the sizes and thicknesses of the respective components shown in the drawings are arbitrarily shown for convenience of explanation, and the following embodiments are not necessarily drawn to scale.

In the present specification, a moving picture may include audiovisual information. That is, the moving picture may include information of a sound (e.g., a voice) generated by a real person, a virtual person, a surrounding object, or a background appearing in the moving picture. These videos may include movies, news, dramas, cartoons, and various types of personal broadcasting images provided through a communication network such as the Internet. In this specification, a moving image may include still images displayed over a certain period of time.

In the present specification, the caption may be a symbol representing a variety of audiovisual types of information expressed in a moving picture in a visual form. For example, various kinds of information represented in a moving picture may include sound generated by a real person, a virtual person, a surrounding object, a background, or the like appearing in the moving picture, and may include motion, shape, color, smell, Information may also be included. The caption may be a visual symbol including characters, punctuation marks, figures, pictures, or photographs representing such information. In addition, in this specification, the caption may be a sound in which various kinds of audio-visual information represented in a moving picture are expressed in an auditory form, regardless of its name. For example, when a person or a narrator who appears in a moving picture performs an ambassador using a first language, a voice translated into a second language for the ambassador may be a subtitle. At this time, the voice translated into the second language may be a voice of a natural person performing translation, or a voice generated by the voice generating program.

1 is a view schematically showing a configuration of a moving picture providing system according to an embodiment of the present invention.

Referring to FIG. 1, a moving picture providing system 10 according to an embodiment of the present invention may include a moving picture providing apparatus 100. The moving picture providing system 10 may further include a video provider terminal 200, a caption input terminal 300, a viewer terminal 400, and a communication network 500.

The moving picture providing system 10 according to an embodiment of the present invention can provide the moving picture supplied from the moving picture provider terminal 200 to the viewer terminal 400. [ Also, it is possible to provide the subtitles generated from the subtitle input terminal 300 to the viewer terminal 400.

The moving picture providing apparatus 100 may be a device for performing a moving picture providing service by the moving picture providing system 10. That is, the moving picture providing apparatus 100 can receive a moving picture signal including moving picture information supplied from the moving picture provider terminal 200. In addition, the moving picture providing apparatus 100 may provide a corresponding moving picture signal to the caption input terminal 300, thereby providing a user of the caption inputting terminal 300 with an opportunity to input the caption for the moving picture. In addition, the moving picture providing apparatus 100 can receive the caption signal including the caption information from the caption input terminal 300. The moving picture providing apparatus 100 may provide various signals to the viewer terminal 400 so that the moving picture and the caption for the moving picture can be reproduced on the viewer terminal 400. [ The moving picture providing apparatus 100 may be a server storing data (e.g., moving pictures and captions) for performing a moving picture providing service. At this time, the moving picture providing apparatus 100 may be composed of a plurality of servers according to the amount of connection or the amount of data.

In addition to providing a moving image providing service, the moving image providing apparatus 100 may be a server that provides various services for enhancing general search services and other user's convenience. That is, the video providing apparatus 100 may provide various services such as search, e-mail, blog, social network service, news, and shopping information in addition to the video providing service.

Alternatively, the moving picture providing apparatus 100 may be a terminal connected to a server providing a portal service such as search, e-mail, news, and shopping, and requesting information to the portal service, And may be a server that provides a web page to provide. Here, the moving picture providing apparatus 100 and the portal service providing server may be separate servers physically separated from each other or may be the same server separated only conceptually.

The moving picture providing apparatus 100 may include a communication unit 110 and a control unit 120.

The communication unit 110 may receive a signal related to a moving picture desired by the moving picture provider terminal 200. In addition, the communication unit 110 may provide a moving picture related signal to the caption input terminal 300 and may receive the caption signal for the moving picture from the caption input terminal 300. [ In addition, the communication unit 110 may provide the viewer terminal 400 with a video related signal and a caption signal.

The communication unit 110 includes a Bluetooth communication unit, a Bluetooth low energy communication unit, a near field communication unit, a WLAN communication unit, a Zigbee communication unit, an IrDA (infrared data association) communication unit, a WFD (Wi-Fi Direct) communication unit, UWB (ultra wideband) communication unit, Ant + communication unit, and the like.

The control unit 120 can generally control the overall operation of the moving picture providing apparatus 100. For example, the control unit 120 may control the signal transmitting / receiving operation of the communication unit 110 to permit or prohibit the signal transmission / reception of the communication unit 110.

The control unit 120 may include any kind of device capable of processing data, such as a processor. Herein, the term " processor " may refer to a data processing apparatus embedded in hardware, for example, having a circuit physically structured to perform a function represented by a code or an instruction contained in the program. As an example of the data processing apparatus built in hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application specific integrated circuit (ASIC) ), A field programmable gate array (FPGA), and the like, but the scope of the present invention is not limited thereto.

2, the moving picture providing apparatus 100 may further include a memory 130, a program storage unit 140, and a database 150 in addition to the communication unit 110 and the control unit 120.

The memory 130 may perform a function of temporarily or permanently storing data processed by the controller 120. Here, the memory 130 may include magnetic storage media or flash storage media, but the scope of the present invention is not limited thereto.

The program storage unit 140 may be a component that loads software for performing various operations that are necessary or auxiliary to perform a moving image providing service.

The database 150 may store data received from the video provider terminal 200, the caption input terminal 300, the viewer terminal 400, or other electronic devices. The communication unit 110 may receive a signal including information of specific data from the video provider terminal 200, the caption input terminal 300 or the viewer terminal 400, and the database 150 may store the data . The communication unit 110 may receive a request signal for providing specific data from the video provider terminal 200, the caption input terminal 300 or the viewer terminal 400, The data corresponding to the request signal can be selected. The communication unit 110 can provide the selected data to the electronic device that has transmitted the request signal.

Referring again to FIG. 1, the video provider terminal 200 may be a device for providing moving pictures within the moving picture providing system 10. [ At this time, the moving picture supplied from the moving picture provider terminal 200 may be a moving picture produced directly by the moving picture provider terminal 200, or may be a moving picture received by the moving picture provider terminal 200 from an external source. The moving picture signal including information on the moving picture supplied by the moving picture provider terminal 200 may be transmitted to the moving picture providing apparatus 100 through the communication network 500.

The caption input terminal 300 can generate a caption for a moving picture supplied by the video provider terminal 200. [ At this time, the subtitle generated by the subtitle input terminal 300 may be a subtitle inputted by the user of the subtitle input terminal 300. [ Alternatively, the subtitle generated by the subtitle input terminal 300 may be a subtitle automatically generated by an automatic translation computer program or a speech recognition computer program inside or outside the subtitle input terminal 300. The plurality of caption input terminals 300 included in one moving picture providing system 10 may be plural. That is, one moving picture providing system 10 may include a first caption input terminal 300a and a second caption input terminal 300b, and each of the caption input terminals 300 may include one caption input terminal And subtitles, respectively.

The viewer terminal 400 may be a device for displaying a moving picture supplied by the moving picture provider terminal 200 and a caption generated by the caption input terminal 300. [ That is, the viewer terminal 400 can receive the caption signal including the moving picture signal including the moving picture information and the caption information, and provide the moving picture and the caption to the user of the viewer terminal 400 using the signals . The viewer terminal 400 included in one moving picture providing system 10 may be plural. In other words, one moving picture providing system 10 may include a first viewer terminal 400a and a second viewer terminal 400b, and each of the viewer terminals 400 may play back the same or different moving pictures, You can display subtitles that are the same or different from each other.

At this time, the subtitle displayed on the viewer terminal 400 may be a character created with a visual symbol, but may be a sound expressed in an auditory form as described above. That is, when a subtitle signal including audio information is generated in the subtitle input terminal 300, the viewer terminal 400 receives the corresponding signal from the moving picture providing apparatus 100, And output through the acoustic unit. At this time, the sound expressed in the audible form may be the voice dubbed by the user of the caption input terminal 300.

The video provider terminal 200, the caption input terminal 300, and the viewer terminal 400 can be borrowed without restriction from any electronic device capable of transmitting and receiving data with other devices in a wired / wireless communication environment. Specifically, each of the video provider terminal 200, the caption input terminal 300, and the viewer terminal 400 may be a desktop top, a notebook PC, a tablet PC, a smartphone, , A smart TV, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a micro server, a global positioning system (GPS) device, an electronic book terminal, a digital broadcast terminal, a navigation device, a kiosk, Other mobile or non-mobile computing devices, but the invention is not so limited. Each of the video provider terminal 200, the caption input terminal 300, and the viewer terminal 400 may include various devices capable of receiving touch input such as an electronic board, a touch table, An accessory such as a clock, a pair of glasses, a hair band and a ring having a data processing function, but the present invention is not limited thereto.

The communication network 500 may serve to electronically connect the moving picture providing apparatus 100 with each of the video provider terminal 200, the caption input terminal 300 and the viewer terminal 400. That is, the communication network 500 may mean a connection path between electronic devices capable of transmitting and receiving data with other devices in a wired / wireless communication environment. The communication network 500 may be a wired network such as LANs (Local Area Networks), WANs (Wide Area Networks), MANs (Metropolitan Area Networks), ISDNs (Integrated Service Digital Networks), wireless LANs, CDMA, Bluetooth, But the scope of the present invention is not limited thereto.

3 and 4 are block diagrams schematically illustrating an example of the internal configuration of a caption input terminal according to an embodiment of the present invention.

3, the caption input terminal 300 according to an exemplary embodiment of the present invention may include a communication unit 310, an input unit 320, an output unit 330, and a control unit 340.

The communication unit 310 can receive a signal related to the moving image from the moving image providing apparatus 100. [ In addition, the communication unit 310 may provide a caption signal including caption information to the moving picture providing apparatus 100.

The communication unit 310 may be a Bluetooth communication unit, a BLE communication unit, a short-range wireless communication unit, a WLAN communication unit, a Zigbee communication unit, an infrared communication unit, a WFD communication unit, a UWB communication unit, and an Ant communication unit.

The input unit 320 can receive various requests from the user of the caption input terminal 300. For example, the input unit 320 may receive a request to receive a moving image from a user of the caption input terminal 300, a request to reproduce the received moving image, and a request to transmit a caption signal. In addition, the input unit 320 can receive the caption information input by the user of the caption input terminal 300. The input unit 320 may receive a voice input of a user, a character input of a user, an input of a user pressing a button, or a touch input of a user, but the scope of the present invention is not limited thereto.

The output unit 330 may output signals for transmitting information to the user of the caption input terminal 300 in various forms. For example, the output unit 330 may output audiovisual information about the video information and sound of the received moving image.

Referring to FIG. 4, the output unit 330 may include a display unit 331 and an acoustic unit 332. The caption input terminal 300 may further include a memory 350 and a program storage unit 360 in addition to the communication unit 310, the input unit 320, the output unit 330, and the control unit 340.

The display unit 331 may display information intended to be visually displayed among the information included in the moving image signal. For example, the display unit 331 can output the image information included in the moving image signal to at least a part of the area of the display unit 331.

The display unit 331 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three- display, and electrophoretic display. However, the scope of the present invention is not limited thereto. Also, depending on the implementation of the caption input terminal 300, the caption input terminal 300 may include two or more display units 331.

The acoustic unit 332 may output information intended to be transmitted in an audible form among the information included in the moving picture signal. For example, the acoustic unit 332 may output information on sound included in the moving picture signal. The acoustic unit 332 can output sounds having different lengths, frequencies, intensities, elevations, or strokes according to the type of notification.

The acoustic unit 332 may include at least one of a tuner, an equalizer, a headphone, an earphone, and various types of speakers, but the scope of the present invention is not limited thereto. That is, the acoustic unit 332 may be a variety of devices capable of generating sound through an electric or mechanical method.

The memory 350 can perform a function of temporarily or permanently storing data processed by the control unit 340. Herein, the memory 350 may include a magnetic storage medium or a flash storage medium, but the scope of the present invention is not limited thereto. The program storage unit 360 may be a component that loads software for performing various operations that are necessary or auxiliary for performing a moving image providing service.

5 to 21 are flowcharts schematically illustrating an example of a moving picture providing method according to an embodiment of the present invention. Hereinafter, a moving picture providing method using the moving picture providing apparatus 100 as described above with reference to FIGS. 5 to 19 will be described, and then the caption inputting terminal 300 described above with reference to FIGS. 20 and 21 will be described. Describes how to provide subtitles for moving images.

First, referring to FIG. 5, the moving picture providing apparatus 100 may perform a step of receiving an original moving picture signal (operation S100). At this time, the original moving picture signal may include information on the original moving picture. That is, the original moving image signal may be a signal including various information necessary for reproducing the original moving image. The various information may include, for example, image information for at least a part of frames of the moving image, sound information about sound output during moving picture playback, information about the moving picture codec, and the like. The moving picture providing apparatus 100 can receive the original moving picture signal from the moving picture provider terminal 200. The reception of the original moving picture signal may be performed by the communication unit 110 of the moving picture providing apparatus 100.

Thereafter, the moving picture providing apparatus 100 may perform a step of generating a delay moving picture signal (step S200). The delay video signal may include information on the delay video. At this time, the delayed moving picture may be a moving picture in which the original moving picture is delayed by the first time. The delayed moving picture signal may be a signal newly generated separately from the original moving picture signal, or may be a signal temporarily provided after the first time has elapsed after temporarily storing the original moving picture signal. That is, the motion-picture providing apparatus 100 generates a delayed moving picture signal by generating a new moving picture whose playback time is delayed by the first time from the original moving picture signal and generating a signal including the new moving picture signal And may also mean a delay operation in the operation of simply storing and delaying the original video signal for the first time.

Here, the first time may be a time arbitrarily set by the administrator of the moving picture providing apparatus 100 or the user of the moving picture provider terminal 200. The first time may be an allowable time for the moving picture providing apparatus 100 to provide the moving picture and the caption to the viewer terminal 400 together. Specifically, the first time is the time required for the moving picture providing apparatus 100 to transmit the original moving picture signal to the caption input terminal 300, the time required for the caption input terminal 300 to generate the caption A time required for the time when the moving picture providing apparatus 100 receives a caption signal from the caption input terminal 300, and the like. The generation of the delayed moving picture signal may be performed by the control unit 120 of the moving picture providing apparatus 100.

In addition, the moving picture providing apparatus 100 may perform the step of transmitting the original moving picture signal to the caption input terminal 300 (step S300). At this time, the moving picture providing apparatus 100 may transmit the original moving picture signal received from the moving picture provider terminal 200 as it is, or transmit the original moving picture signal by delaying the time shorter than the first time. Alternatively, the moving picture providing apparatus 100 may newly generate and transmit a signal including information extracted from the original moving picture signal received from the moving picture provider terminal 200. That is, the resolution, the number of frames per second, the codec, and the like of the moving image signal received from the moving image provider terminal 200 are determined by the resolution of the moving image signal by the original moving image signal transmitted to the subtitle input terminal 300, , A codec, and the like. The transmission of the original moving picture signal may be performed by the communication unit 110 of the moving picture providing apparatus 100.

Thereafter, the moving picture providing apparatus 100 may perform the step of receiving the caption signal and the delay signal from the caption input terminal 300 (step S400). The caption signal may be a signal including information of the caption generated by the caption input terminal 300, and the caption may be a caption related to the content of the original video. The delay signal may be a signal including information for delaying the display of the subtitles. Specifically, the user of the caption input terminal 300 can directly write a caption for a part of the video while directly viewing the original video. At this time, it may take time for the user of the caption input terminal 300 to watch the contents of the moving picture and to make the contents into the caption. For example, if a user listens to the word 'Hello' and writes subtitles in English, 'hello', the time to listen to 'Hello', the time to think how to translate 'Hello' in English, It may take time to type the content 'hello' or to speak in voice. As a result, when the subtitle is displayed on the moving picture on the basis of the time when the moving picture providing apparatus 100 receives the subtitle signal, there is a possibility that the picture and the subtitle are not synchronized with each other. The delay signal may include information on delay times generated by a user of the subtitle input terminal 300. [ The reception of the caption signal and the delay signal may be performed by the communication unit 110 of the moving picture providing apparatus 100. Specific examples of the information included in the delay signal will be described with reference to FIGS. 6 and 7. FIG.

Thereafter, the moving picture providing apparatus 100 may perform the step of generating the display time signal (step S500). The moving picture providing apparatus 100 may generate a display time signal based on the delay signal, and the display time signal may be a signal indicating the time at which the caption is to be displayed on the delayed moving picture. As described above, the delay signal may be a signal including information on delay times generated by the user of the subtitle input terminal 300, and the moving picture providing apparatus 100 may actually use the information Can be determined. The generation of the display time signal may be performed by the control unit 120 of the moving picture providing apparatus 100. Specific examples of generating the display time signal will be described with reference to FIGS. 6 to 8. FIG.

Meanwhile, the moving picture providing apparatus 100 may perform the step of transmitting the delay moving picture signal to the viewer terminal 400 (step S600). The transmission of the delayed moving picture signal may be performed by the communication unit 110 of the moving picture providing apparatus 100.

Also, the moving picture providing apparatus 100 may perform the step of transmitting the caption signal and the display time signal to the viewer terminal 400 (step S700). The transmission of the caption signal and the display time signal may be performed by the communication unit 110 of the moving picture providing apparatus 100.

According to steps S600 and S700 described above, the moving picture providing apparatus 100 can display the captions corresponding to the moving pictures while the viewer terminal 400 plays the moving pictures. At this time, the moving picture providing apparatus 100 provides a display time signal indicating when the corresponding caption is to be displayed in the moving picture, so that the viewer terminal 400 can display the caption at the timing intended by the moving picture providing apparatus 100 So that it can be displayed.

5, the step S300 is performed after the step S200, but the present invention is not limited thereto. The step S300 may be performed before the step S200, or may be performed simultaneously with the step S200. Also, steps S600 and S700 may be performed in reverse order or simultaneously.

Alternatively, according to the embodiment shown in FIG. 6, step S500 of the moving picture providing method may include a step of calculating the first time and generating a display time signal (step S510). Specifically, the delay signal received from the subtitle input terminal 300 may be a signal including information of the second time. The second time may be a time designated by the user of the caption input terminal 300 and represents a delay time spent in the process of generating the content watched by the user himself / herself as caption. In this case, the moving picture providing apparatus 100 transmits the caption signal transmitted from the caption input terminal 300 to the time when the caption input terminal 300 transmits the caption signal or the caption signal transmitted from the caption input terminal 300, It is possible to calculate the first time delayed by the time of the length minus the second time from the first time.

Hereinafter, the calculation process of the first time will be described in the order of the logical operations. First, the moving picture providing apparatus 100 may delay the first time at the time when the caption signal is completed. This operation means that the moving picture provided by the moving picture providing apparatus 100 to the viewer terminal 400 is delayed by the first time so that the time difference between the moving picture between the caption inputting terminal 300 and the viewer terminal 400 It may be for correction. Thereafter, the moving picture providing apparatus 100 can calculate the time advanced by the second time. This operation may be for correcting a time difference due to a delay time required for a user of the caption input terminal 300 to generate a caption.

In step S510, the moving picture providing apparatus 100 can calculate the first time, which is the subtitle display time at which synchronization between the delayed moving picture and the subtitles can be matched, and generate the display time signal indicating the time.

Alternatively, according to the embodiment shown in FIG. 7, step S400 of the moving picture providing method may include receiving the input start time signal (step S410), and step S500 may calculate the second time, (Operation S520). Specifically, the delay signal received from the subtitle input terminal 300 may be a signal including information of the second time. When the user of the caption input terminal 300 starts inputting the caption, the caption input terminal 300 transmits an input start time signal including information indicating that caption input is started to the video providing apparatus 100 Can be transmitted. At this time, the second time is a time directly specified by the user of the subtitle input terminal 300, and displays a delay time from the moment when the user himself / herself starts watching a specific part of the moving image to the start of inputting the subtitle Lt; / RTI > It may be that the delay time spent in the process of generating the watched contents as subtitles is shown. In this case, the moving picture providing apparatus 100 transmits the caption signal transmitted from the caption input terminal 300 to the time when the caption input terminal 300 transmits the caption signal or the caption signal transmitted from the caption input terminal 300, The second time delayed by the time length obtained by subtracting the second time from the first time can be calculated.

Hereinafter, the calculation process of the second time will be described in the order of the logical operation. First, the moving picture providing apparatus 100 may delay the first time at the time when the caption signal is completed. This operation means that the moving picture provided by the moving picture providing apparatus 100 to the viewer terminal 400 is delayed by the first time so that the time difference between the moving picture between the caption inputting terminal 300 and the viewer terminal 400 It may be for correction. Thereafter, the moving picture providing apparatus 100 can calculate the time advanced by the second time. This operation may be for correcting the time difference due to the delay time from the moment when the user of the caption input terminal 300 starts to start capturing the caption to the start of caption input.

According to the steps S410 and S520, the moving picture providing apparatus 100 can calculate the second time, which is the subtitle display time at which synchronization between the delayed moving picture and the subtitles can be matched, and generates the display time signal indicating the time have.

Alternatively, according to the embodiment shown in FIG. 8, step S500 of the moving picture providing method may include a step of generating a display time signal by determining the subtitle display time based on the feature of the subtitle (operation S530). At this time, the characteristics of the caption may include the length of the caption, the language of the caption, alphabets included in the caption, or the types of the words. That is, the moving picture providing apparatus 100 can estimate the estimated time that the user of the caption input terminal 300 would have taken to input the caption based on the characteristics of the caption such as the length of the caption. Thereafter, the moving picture providing apparatus 100 transmits the caption signal transmitted from the caption input terminal 300 to the caption input terminal 300 from the time when the caption input terminal 300 transmits the caption signal or the caption signal transmitted from the caption input terminal 300, Alternatively, the time delayed by the length of time obtained by subtracting the estimated time from the first time may be calculated from the time when the caption is input on the caption input terminal 300.

In step S530, the moving picture providing apparatus 100 can calculate the subtitle display time that can synchronize the delayed moving picture with the subtitle, and generate the display time signal indicating the corresponding time.

Alternatively, according to the embodiment shown in FIG. 9, step S700 of the moving picture providing method may include transmitting a hold time signal to the viewer terminal 400 (step S710). Specifically, the retention time signal may be a signal including information of the display retention time for maintaining the display of the caption. That is, the moving picture providing apparatus 100 may provide the viewer terminal 400 with a signal indicating how long the caption provided to the viewer terminal 400 should be displayed on the viewer terminal 400 for a certain period of time.

In this case, the holding time signal may be a signal received from the subtitle input terminal 300 by the moving picture providing apparatus 100. That is, according to the embodiment shown in FIG. 10, step S400 of the moving picture providing method may include receiving the holding time signal (step S420). That is, the user of the caption input terminal 300 can determine for himself / herself how long the caption input by the caption input terminal 300 should be displayed. For example, if the caption is relatively short, such as 'hello', the user of the caption input terminal 300 can determine the caption retention time to be relatively short. If the caption is a relatively long sentence, The user of the portable terminal 300 can determine the caption holding time as a relatively long time. The moving picture providing apparatus 100 can receive the holding time signal including the information of the corresponding caption holding time and transmit the signal to the viewer terminal 400 together with the caption signal.

Alternatively, the holding time signal may be a signal generated directly by the moving picture providing apparatus 100. [ That is, according to the embodiment shown in FIG. 11, before the step S700, the moving picture providing method may further include a step (S690) of generating a holding time signal based on the characteristics of the subtitles. At this time, the characteristics of the caption may include the length of the caption, the language of the caption, alphabets included in the caption, or the types of the words. That is, the moving picture providing apparatus 100 can estimate the time required for the user of the viewer terminal 400 to read the caption when watching a moving image based on the characteristics of the caption such as the length of the caption. The moving picture providing apparatus 100 can determine the caption holding time based on the predicted time and generates a holding time signal including information of the caption holding time and transmits it to the viewer terminal 400 together with the caption signal . The generation of the retention time signal may be performed by the control unit 120 of the moving picture providing apparatus 100.

In step S710, the moving picture providing apparatus 100 may provide the viewer terminal 400 with information on how long it may be desirable to display the respective subtitles on the moving picture.

On the other hand, the viewer terminal 400 can display each caption on the display unit during a caption holding time according to the retention time signal. At this time, if the second caption is to be displayed before the caption retention time for the first caption has elapsed, the viewer terminal 400 may delete the first caption early and display the second caption, The second caption may be displayed after moving the position of the caption, or the second caption may be displayed at a position not overlapping the first caption.

Alternatively, according to the embodiment shown in FIG. 12, step S700 of the moving picture providing method may include transmitting a display position signal to the viewer terminal 400 (step S720). Specifically, the display position signal may be a signal including information on the display unit of the viewer terminal 400 or the position where the caption is to be displayed on the moving picture. For example, the display position signal may be a signal for designating a position of a caption to be displayed at a lower end of a display unit of the viewer terminal 400, or a signal for designating a position of a caption to be displayed in a speech balloon form at a specific position of a moving image. That is, the moving picture providing apparatus 100 may provide a display position signal indicating to which position on the viewer terminal 400 the caption provided to the viewer terminal 400 should be displayed, to the viewer terminal 400.

In this case, the display position signal may be a signal directly generated by the moving picture providing apparatus 100. That is, according to the embodiment shown in FIG. 13, before the step S700, the moving picture providing method may further include a step of generating a display position signal corresponding to the caption input terminal 300 (S695). At this time, the moving picture providing apparatus 100 can determine the display position of the subtitle based on the type of the subtitle input terminal 300. For example, when each of the first and second caption input terminal devices 300a and 300b transmits a caption to the moving picture providing apparatus 100, the moving picture providing apparatus 100 transmits the first caption inputting device The subtitles received from the terminal 300a may be displayed on the left side of the display unit of the viewer terminal 400 and the subtitles received from the second caption input terminal 300b may be displayed on the display unit of the viewer terminal 400 The position can be determined to be displayed on the right side. The moving picture providing apparatus 100 may generate a display position signal including the information of the corresponding caption display position and transmit it to the viewer terminal 400 together with the caption signal. The generation of the display position signal may be performed by the control unit 120 of the moving picture providing apparatus 100.

Alternatively, the display position signal may be a signal received from the subtitle input terminal 300 by the moving picture providing apparatus 100. That is, according to the embodiment shown in FIG. 14, step S400 of the moving picture providing method may include receiving the display position signal (step S430). That is, the user of the caption input terminal 300 can determine by itself which position the caption input by the caption input terminal 300 should be displayed in the moving image. For example, if the caption is about the metabolism of a person sitting on the right side of the moving picture, the caption input terminal 300 determines the display position of the caption to the right, . The moving picture providing apparatus 100 can receive the display position signal including the information of the caption display position and transmit the signal to the viewer terminal 400 together with the caption signal.

In step S720, the moving picture providing apparatus 100 may provide the viewer terminal 400 with information on where the respective captions should be displayed.

Alternatively, according to the embodiment shown in FIG. 15, step S300 of the moving picture providing method may include transmitting the original moving picture signal to the first and second caption input terminals 300a and 300b (step S310) Step S400 may include receiving each of the first and second caption signals from the first and second caption input terminals 300a and 300b respectively (step S440), and step S700 may include receiving the first and second caption signals from the first and second caption input terminals 300a and 300b, 2 < / RTI > subtitle signal to the viewer terminal 400. In this case,

That is, there may be a plurality of the caption input terminals 300 for transmitting and receiving the moving picture signals and the caption signals to and from one moving picture providing apparatus 100. Also, the moving picture providing apparatus 100 may transmit at least one of the first and second caption signals to the viewer terminal.

In this case, the moving picture providing apparatus 100 may transmit at least one of the first and second caption signals to the viewer terminal 400 in consideration of various conditions. In other words, according to the embodiment shown in FIG. 16, step S730 of the moving picture providing method may include transmitting at least one of the first and second caption signals in consideration of various conditions (step S731).

Various conditions considered by the moving picture providing apparatus 100 include a request from the viewer terminal 400, nationality information of a location where the viewer terminal 400 exists, language information of the corresponding nationality, specific subtitles from the viewer terminal 400, Whether or not a signal is designated, whether a specific subtitle signal is rejected from the viewer terminal 400, a request of the subtitle input terminal 300, and the like. That is, for example, when the first viewer terminal 400a is an electronic device existing in China, the moving picture providing apparatus 100 can transmit only the caption signal written in Chinese to the first viewer terminal 400a. In another example, if there is a request to reject the first caption signal from the second viewer terminal 400b, the moving picture providing apparatus 100 may transmit only the second caption signal to the second viewer terminal 400b .

At this time, the moving picture providing apparatus 100 can provide the viewer terminal 400 with information that can be considered when the viewer terminal 400 designates or rejects a specific caption signal. This information may include information on specific caption selection information of another viewer terminal 400, specific caption recommendation information of the other viewer terminal 400, specific caption recommendation information of the video provider terminal 200, or information directly provided from the caption input terminal 300 And the like. For example, the moving picture providing apparatus 100 may include information indicating that the first viewer terminal 400a has selected the first caption signal, information indicating that the first caption signal is recommended, Information indicating that the subtitle signal has been ignored, and the like to the second viewer terminal 400b. In another example, the moving picture providing apparatus 100 may display information about the own caption provided by the caption input terminal 300 (for example, information indicating that the caption input by the caption input terminal 300 may include a profanity, Information to be created for the first time) to the second viewer terminal 400b.

On the other hand, the moving picture providing apparatus 100 may transmit a plurality of subtitle signals to the viewer terminal 400, select a specific subtitle signal from the viewer terminal 400, and display only the subtitle included in the corresponding signal. The moving picture providing apparatus 100 may block transmission of a specific caption signal regardless of a request from the viewer terminal 400 or may transmit the caption signal to each of the viewer terminals 400, Lt; RTI ID = 0.0 > selected < / RTI >

17, step S700 of the moving picture providing method may include transmitting the first caption font signal to the viewer terminal 400 (step S740), and transmitting the second caption font signal to the viewer terminal 400) (S750). Specifically, the moving picture providing apparatus 100 transmits a first caption font signal including information for displaying the first caption to the first character size, the first character color, or the first font, together with the first caption signal, 400). Similarly, the moving picture providing apparatus 100 transmits a second caption font signal including information for displaying the second caption to the second character size, the second character color, or the second font, together with the second caption signal, to the viewer terminal 400 ). ≪ / RTI > Generally, the character size, color, font, etc. of the subtitles can be determined by the terminal of the viewer of the moving image, that is, the viewer terminal 400. However, the moving picture providing apparatus 100 may be configured such that the first caption received from the first caption input terminal 300a and the second caption received from the second caption input terminal 300b are distinguished from each other on the viewer terminal 400 It is possible to transmit a caption font signal including font information of each of the first and second captions to the viewer terminal 400. [ In this case, the first and second caption font signals may be signals directly generated by the moving picture providing apparatus 100, and the first and second caption font signals may be respectively transmitted to the first and second caption input terminals 300a and 300b, Or may be a signal received from each. On the other hand, the moving picture providing apparatus 100 may not transmit a separate caption font signal to the viewer terminal 400, and may directly determine and display the font of each caption on the viewer terminal 400 side.

Alternatively, according to the embodiment shown in FIG. 18, the moving picture providing method may further include receiving the feedback signal after step S700 (step S800). That is, the moving picture providing apparatus 100 may receive a feedback signal from the viewer terminal 400. [ The feedback signal may include an evaluation of the provided caption. Specifically, the moving picture providing apparatus 100 includes information on various types of feedback such as feedback that the translation of the caption is not correct from the viewer terminal 400, feedback that the synchro is not well suited between the caption and the moving picture, Lt; / RTI > The reception of the feedback signal may be performed by the communication unit 110 of the moving picture providing apparatus 100.

Alternatively, the moving picture providing apparatus 100 may transmit a feedback signal to the caption input terminal 300 according to the embodiment shown in FIG. That is, the moving picture providing method may further include transmitting the feedback signal to the caption input terminal 300 after step S800 (step S900). The transmission of the feedback signal may be performed by the communication unit 110 of the moving picture providing apparatus 100.

In step S800, the moving picture providing apparatus 100 can obtain feedback of viewers for the entire moving picture providing system 10. Also, in step S900, the moving picture providing apparatus 100 can obtain information on how the viewers feedback on the caption input terminal 300 to the user.

Referring to FIG. 20, the subtitle input terminal 300 may perform the step of receiving the original moving picture signal from the moving picture providing apparatus 100 (step S1100). The reception of the original moving picture signal can be performed by the communication unit 310 of the caption input terminal 300.

Thereafter, the subtitle input terminal 300 may perform the step of outputting the original moving picture (step S1200). That is, the subtitle input terminal 300 can reproduce the original video so that the user of the subtitle input terminal 300 can create the subtitle while watching the original video directly. The output of the original moving picture may be performed by the output unit 330 of the caption input terminal 300.

Thereafter, the caption input terminal 300 may perform the step of receiving the caption (S1300). At this time, the user of the caption input terminal 300 may input the caption through an input device such as a keyboard or a touch pad, input the caption by voice through the microphone, or input a predetermined idiom or pre- It is possible to select at least some characters and input the characters as at least part of the caption to be input.

In addition, the subtitle input terminal 300 may receive a subtitle automatically generated by an automatic translation computer program inside or outside the subtitle input terminal 300. That is, the caption input terminal 300 may receive not the caption input by the user of the caption input terminal 300, which is a natural person, but the caption automatically generated by the computer algorithm. In step S1300, the caption input terminal 300 automatically captures the caption using an automatic translation computer program or a speech recognition computer program installed in the caption input terminal 300, regardless of the expression 'receive caption' . The operation of receiving the caption may be performed by the input unit 320 of the caption input terminal 300.

Subsequently, the subtitle input terminal 300 can perform a step of generating a subtitle signal and a delay signal (step S1400). The caption input terminal 300 can generate a caption signal including information of the caption input from the user. At this time, the caption signal may be a signal written in a programming language interpretable by the moving picture providing apparatus 100 or the viewer terminal 400. The caption signal may be transmitted through the communication unit 310 of the caption input terminal 300 or may be an electronic signal generated in a form that the communication unit 110 of the moving picture providing apparatus 100 can receive. As described above, the delay signal may be a signal including information for delaying the display of the subtitles. The generation of the caption signal and the delay signal can be performed by the control unit 340 of the caption input terminal 300.

Subsequently, the subtitle input terminal 300 can transmit the subtitle signal and the delay signal to the moving picture providing apparatus 100. The transmission of the caption signal and the delay signal may be performed by the communication unit 310 of the caption input terminal 300.

Alternatively, according to the embodiment shown in FIG. 21, step S1300 of the moving picture providing method may include receiving a request to delay the display of the subtitles by a second time (step S1310), and step S1400 And generating a delay signal including information on two hours (S1410). Specifically, the user of the caption input terminal 300 can estimate the time spent in the process of inputting the caption, that is, the second time. In this case, the caption input terminal 300 may receive a request from the user to display the caption by delaying the caption by a second time. Thereafter, the subtitle input terminal 300 may generate a delay signal including information on the second time.

According to the moving picture providing method of the present invention, the original moving picture is delayed by a predetermined time to be provided to the viewer terminal, and the caption is input from the caption input terminal for the delayed time to provide the caption to the viewer terminal. In addition, through the moving picture providing method of the present invention, it is possible to provide the viewer terminal with information about the timing of displaying the caption along with the caption so that the caption can be displayed at the correct timing on the moving picture provided to the viewer terminal.

The embodiments of the present invention described above can be embodied in the form of a computer program that can be executed on various components on a computer, and the computer program can be recorded on a computer-readable medium. At this time, the medium may be a program that continuously stores a computer executable program, or temporarily stores the program for execution or downloading. In addition, the medium may be a variety of recording means or storage means in the form of a combination of a single hardware or a plurality of hardware, but is not limited to a medium directly connected to a computer system, but may be dispersed on a network. Examples of the medium include a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as CD-ROM and DVD, a magneto-optical medium such as a floptical disk, ROM, RAM, flash memory, and the like, for storing program instructions. As another example of the medium, a recording medium or a storage medium managed by a site or a server that supplies or distributes an application store or various other software to distribute the application may be mentioned.

Meanwhile, the computer program may be specifically designed and configured for the present invention or may be known and used by those skilled in the computer software field. Examples of computer programs may include machine language code such as those produced by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like.

The specific acts described in the present invention are, by way of example, not intended to limit the scope of the invention in any way. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of such systems may be omitted. Also, the connections or connecting members of the lines between the components shown in the figures are illustrative of functional connections and / or physical or circuit connections, which may be replaced or additionally provided by a variety of functional connections, physical Connection, or circuit connections. Also, unless explicitly referred to as " essential ", " important ", etc., it may not be a necessary component for application of the present invention.

Accordingly, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all ranges that are equivalent to or equivalent to the claims of the present invention as well as the claims .

10: Video delivery system
100: Video providing device
110:
120:
200: Video provider terminal
300: Subtitle input terminal
310:
320:
330: Output section
340:
400: viewer terminal
500: Network

Claims (7)

In a method for providing a moving picture,
Receiving, by the communication unit, an original moving picture signal including information of the original moving picture;
Generating a delayed moving picture signal including information on a delayed moving picture in which the original moving picture is delayed by a first time by a control unit;
Transmitting at least one of the original moving picture signals to at least one or more caption input terminals by the communication unit;
Receiving, by the communication unit, a delay signal including a subtitle signal including information on a subtitle of the original moving picture from the subtitle input terminal and information for delaying the output of the subtitle;
Generating, by the control unit, an output time signal indicating a time at which the subtitle is output on the delayed moving picture based on the delayed signal;
Transmitting the delayed moving picture signal to the viewer terminal by the communication unit; And
And transmitting the output time signal and the caption signal to the viewer terminal by the communication unit,
Wherein the step of transmitting the output time signal and the caption signal to the viewer terminal comprises:
And providing information on the caption signal to the viewer terminal,
The information on the caption signal may include information on selection of the caption of another viewer, information on recommendation of the caption of another viewer, caption recommendation information on the original moving picture of the video provider, And information related to the content,
Wherein the caption signal includes at least one of a caption input by a user of the caption input terminal, a caption generated by an automatic translation program in the caption input terminal, a caption generated by an automatic translation program outside the caption input terminal, And subtitles automatically generated by the speech recognition computer program of the subtitle input terminal. The method of claim 1, wherein
Wherein the user inputs audiovisual information included in the caption to at least one of a keyboard, a touch pad, and a microphone of the caption input terminal to the caption input terminal. The method of claim 1, wherein
Wherein the user inputs the caption by selecting at least some characters of a predetermined idiom or a pre-created caption. The method of claim 1, wherein
Wherein the viewer terminal outputs at least one of visual symbol and auditory information included in the caption signal together with the moving picture signal,
And outputting the audio information included in the caption signal in a form of Dubbing when outputting the auditory information. delete The method of claim 1, wherein
Wherein the delay signal is a signal including a second time information for delaying the output of the subtitle,
Wherein the step of generating the output time signal comprises:
Wherein the control unit calculates a first time delayed from a time at which the caption input terminal transmits the caption signal by a length of time obtained by subtracting the second time from the first time, Generating the output time signal so as to be output on the delay moving picture,
Wherein the second time is determined by an input of a caption inputter for the caption input terminal. The method of claim 1, wherein
The moving picture providing method
The control unit predicts a time required for the moving picture viewer to read the caption based on at least one of the length of the caption, the language, and the words included in the caption, and maintains the output of the caption in accordance with the estimated time And generating a sustain period signal including information on the determined sustain period,
Wherein the step of transmitting the output time signal and the caption signal to the viewer terminal further comprises transmitting the sustain period signal.

Images