KR20170132561A - Method and System for Interworking Video Subtitle and IoT Device - Google Patents

Abstract

Disclosed are a method and a system for interlocking a video subtitle and an IoT device. More specifically, the present invention provides a technology transmitting a scenario to an IoT device by using a subtitle file provided when a user watches a video, and providing a realistic viewing environment. The system for interlocking a video subtitle and an IoT device comprises: a subtitle file receiving part receiving the subtitle file provided to a played video file; an IoT subtitle analyzing part removing control and special letters including HTML tag information from the received subtitle file, and parsing and analyzing subtitle content; an IoT scenario generating part generating an operation scenario for transmitting to at least one IoT device installed in advance by using the analyzed result of the subtitle file; and an operation scenario transmitting part transmitting the generated operation scenario to the at least one IoT device, and operating the at least one IoT device.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and system for interworking video subtitles with an IoT device,

The embodiments described below relate to a method and system for interworking of a moving picture caption and an IoT device, and more particularly, to a moving picture caption and a moving picture caption providing a realistic viewing environment by transmitting a scenario to an IoT device using a caption file provided when capturing a moving picture And more particularly, to a method and system for interworking IoT devices.

2. Description of the Related Art [0002] Currently, a technique for playing back a moving image file that is stored in advance through a digital device such as a personal computer or downloaded in a streaming manner has become widespread. The moving picture file is encoded by various compression codecs, and is decoded and reproduced by the reproduction program. In addition, a technique for displaying a subtitle file created in advance on a screen together with a moving image file, which allows the user to view the translated content through a subtitle capable of being readable in the case of a moving picture file that can not be viewed in a native language, is widely used.

The subtitle file is usually created separately from the video file and exists as a separate file.

Korean Patent Laid-open Publication No. 10-2015-0057591 relates to a method and apparatus for generating caption data for such a moving picture file, and a method and apparatus for generating caption data for a moving picture file capable of automatically generating and synchronizing a moving picture caption through voice recognition Is described.

Embodiments describe a method and system for interworking between a moving picture caption and an IoT device. More specifically, the present invention provides a technique for providing a realistic viewing environment by transmitting a scenario to an IoT device using a caption file provided when capturing a moving picture.

Embodiments can feel immersive and realistic feeling by motion of IoT device such as lighting, speaker, air conditioner, and chair when watching a moving image by generating and transmitting an operation scenario transmitted to the IoT device by parsing or analyzing the subtitle file of the reproduced moving picture And to provide a method and system for interworking with a moving picture caption and an IoT device.

According to an embodiment of the present invention, there is provided an interworking system of a moving picture caption and an IoT device, comprising: a caption file receiving unit for receiving a caption file provided in a moving picture file to be reproduced; An IoT caption analyzing unit for removing control and special characters including HTML tag information from the received caption file and parsing and analyzing caption contents; An IoT scenario generation unit for generating an operation scenario for delivering to the at least one more installed IoT device using the analyzed result of the subtitle file; And an operation scenario transmission unit operable to transmit the generated operation scenario to the at least one IoT device to operate the at least one IoT device.

The IoT caption analyzing unit removes control and special characters including HTML tag information from the received caption file and parses and analyzes the contents of the caption with the control and special characters removed to perform the operation of the at least one IoT device It is possible to recognize the character matched with the preset character and obtain the recognized time information of the character.

The IoT scenario generation unit collects at least one of the recognized character and time information, recognizes the at least one installed IoT device installed in the IoT device, and recognizes the at least one IoT device installed using the collected at least one character and time information. An operation scenario for operating the IoT device can be created.

And an IoT control character input unit for inputting the operation scenario for operating the at least one IoT device from a user as an IoT control character and providing a subtitle file to which the IoT control character is added.

The interlocking system of the moving picture caption and the IoT device is implemented as a dongle and connected to the moving picture reproducing apparatus, the IoT device or the router connected to the IoT device by wire / wireless communication, Wherein the caption file receiving unit receives a caption file provided to a moving picture file to be reproduced according to driving of the moving picture reproducing apparatus and the operation scenario transmitting unit transmits the generated operation scenario to the at least one or more IoT devices connected thereto .

According to another embodiment of the present invention, there is provided a method of interworking a moving picture caption and an IoT device, the method comprising: receiving a caption file provided to a moving picture file to be reproduced; Removing control and special characters including HTML tag information from the received subtitle file and parsing and analyzing subtitle contents; Generating an action scenario for delivering to the at least one more IoT device installed using the analyzed result of the subtitle file; And transmitting the generated operation scenario to the at least one IoT device to operate the at least one IoT device.

The step of removing control and special characters including HTML tag information from the received subtitle file and parsing and analyzing the subtitle contents may include removing control and special characters including HTML tag information from the received subtitle file; Parsing and analyzing subtitle contents in which the control and special characters are removed, recognizing characters matched with preset characters for operation of the at least one IoT device; And acquiring time information of the recognized character, wherein the step of generating an operation scenario for delivering to the previously installed at least one IoT device using the analyzed result of the subtitle file, Collecting at least one time information; Recognizing said at least one more IoT device installed; And generating an operation scenario for operating the at least one installed at least one IoT device using the collected at least one character and time information.

According to the embodiments, by generating or transmitting an operation scenario to be transmitted to the IoT device by parsing or analyzing the subtitle file of the moving picture to be reproduced, it is possible to realize immersion feeling and presence feeling by the operation of the IoT device such as illumination, speaker, air conditioner, It is possible to provide a method and system for interlocking video subtitles and IoT devices that can be sensed.

According to the embodiments, a method and system for interlocking IoT devices and a moving picture caption that provides a more realistic and realistic viewing environment than a conventional environment is provided by using an IoT device and subtitle file installed without investment cost can do.

1 is a diagram for explaining an interworking system of a moving picture caption and an IoT device according to an exemplary embodiment of the present invention.
2 is a block diagram illustrating an interworking system of a moving picture caption and an IoT device according to an exemplary embodiment of the present invention.
3 is a flowchart illustrating a method of interworking between a moving picture caption and an IoT device according to an exemplary embodiment of the present invention.
4 is a flowchart illustrating a method of parsing and analyzing subtitle contents according to an exemplary embodiment.
5 is a flow diagram illustrating a method for generating an operational scenario for delivery to an IoT device in accordance with one embodiment.

Hereinafter, embodiments will be described with reference to the accompanying drawings. However, the embodiments described may be modified in various other forms, and the scope of the present invention is not limited by the embodiments described below. In addition, various embodiments are provided to more fully describe the present invention to those skilled in the art. The shape and size of elements in the drawings may be exaggerated for clarity.

The embodiments described below relate to a method and system for providing a more realistic viewing environment by transmitting a scenario to an IoT device using a subtitle file provided when viewing moving images.

Video, audio, and subtitle files are usually provided for video viewing. At this time, the subtitle file is used for understanding the progress of the moving picture and outputting the corresponding character at the bottom of the screen at that time to help the viewer understand or translate. The embodiments described below can provide a function of automatically generating analysis and operation scenarios using an existing subtitle file and operating in conjunction with the IoT device without additional scenarios or additional work for the IoT device.

1 is a diagram for explaining an interworking system of a moving picture caption and an IoT device according to an exemplary embodiment of the present invention.

1, an interworking system 100 of a moving picture caption and an IoT device according to an exemplary embodiment of the present invention includes a moving picture reproducing apparatus 110, a display apparatus 120, at least one IoT device 130, 131 and 132, And generate and transmit an operation scenario to be transmitted to the IoT device 130 by parsing or analyzing the subtitle file of the moving picture file to be connected and reproduced.

The interworking system 100 of the moving picture caption and the IoT device according to this embodiment includes a caption file receiving unit for receiving the caption file, an IoT caption analyzing unit for parsing and analyzing the received caption file, and an IoT device An IoT scenario generating unit for generating an operation scenario to be transmitted to the IoT device 130, and an operation scenario transmitting unit for transmitting the generated scenario to the IoT device 130. [

The moving picture reproducing apparatus 110 is a device for reproducing a moving picture file, and may be an application for reproducing a multimedia player or a moving picture file, which is a separate device.

For example, the moving picture reproducing apparatus 110 may be a multimedia player, a PC, a notebook, a wireless communication terminal, a smart phone, a portable media player (PMP), a personal digital assistant (PDA), a tablet PC, (Set-top box), smart TV, and the like.

An application for playing a moving picture file may be variously present in a user terminal. For example, there are Windows Media Player, GOM Player, KM Player, and the like, which are embedded in a mobile embedded application such as a smart phone, Applications that play movie files that are executed on the terminal include an MX player (MX Player) and the like. An application for playing a moving image file can generally execute a moving image file, a sound source file, a subtitle file, and the like.

The display device 120 can display subtitles corresponding to moving pictures and moving pictures composed of one or more image frames to be reproduced. The display device 120 can be a multimedia player, a PC, a notebook, a wireless communication terminal, a smart phone, Media player, a PDA (personal digital assistant), a tablet PC, a set-top box, a smart TV, and the like.

Here, the moving picture reproducing apparatus 110 and the display apparatus 120 may use the same apparatus.

The moving picture captioning system and the IoT device interworking system 100 according to an exemplary embodiment may be implemented as a dongle, a separate device, or an application and may be connected to the moving picture reproducing apparatus 110, the IoT device 130, or the IoT device 130 ) And a wired or wireless communication with the router connected thereto. Also, the moving picture reproducing apparatus 110 may be provided as a single product integrated with the interlocking system 100 of the moving picture caption and the IoT device.

Here, the dongle allows users to move video files used in existing smart devices to the big screen such as TV.

For example, a high definition multimedia interface (HDMI) input terminal is formed on a display device 120 such as a TV, so that an HDMI input is possible. A dongle is connected to an HDMI (High Definition Multimedia Interface) The dongle and the display device 120 can be connected to each other.

The wired / wireless communication includes wireless communication modules such as mobile communication and satellite communication, wired communication modules such as the Internet, Wi-Fi, bluetooth, UWB (Ultra Wideband) and NFC (Near Field Communication), Zigbee Or a short-range wireless communication module such as a wireless communication module.

When the user operates the moving picture reproducing apparatus 110 to watch a moving picture, if the caption file is a moving image, the caption file receiving unit can receive the caption file of the moving picture file. Then, the IoT subtitle analyzing unit analyzes only the pure subtitle contents by removing control and special characters including the HTML tag information from the received subtitle file, and transmits the analysis result to the IoT scenario generating unit.

Accordingly, the IoT scenario generation unit can create an operation scenario based on the installed IoT device 130 based on the received analysis result. The operation scenario transmission unit may transmit the operation scenario generated in the IoT scenario generation unit to the IoT device 130. [

Video, audio, and subtitles (if any) to the screen through the display device 120, and the IoT device 130 can perform the operation in the scenario received at an appropriate time.

The following is a more detailed description of a video caption and an interworking system of IoT devices according to an embodiment.

2 is a block diagram illustrating an interworking system of a moving picture caption and an IoT device according to an exemplary embodiment of the present invention.

2, an interworking system 200 of a moving picture caption and an IoT device according to an exemplary embodiment of the present invention includes a caption file receiving unit 210, an IoT caption analyzing unit 220, an IoT scenario generating unit 230, (240). ≪ / RTI > The interworking system 200 of the moving picture caption and the IoT device may further include an IoT control character input unit.

The interworking system 200 of the moving picture caption and the IoT device according to one embodiment of the present invention may be realized as a dongle or a separate device or may be implemented as an application of a smart device. The moving picture caption and the IoT device interworking system 200 according to one embodiment may be implemented as a dongle or a separate device or an application and may be connected to the moving picture reproducing apparatus 250, the IoT device 270, or the IoT device 270, And may be connected to a router connected thereto through wired / wireless communication.

The caption file receiving unit 210 may receive the caption file provided to the moving picture file to be reproduced.

That is, the caption file receiving unit 210 can receive a caption file provided to a moving picture file, which is connected to the moving picture reproducing apparatus by wired or wireless communication and is reproduced according to the driving of the moving picture reproducing apparatus.

The IoT caption analyzing unit 220 can remove control and special characters including HTML tag information from the received caption file, and can parse and analyze caption contents.

More specifically, the IoT caption analyzing unit 220 removes control and special characters including the HTML tag information from the received caption file, parses and analyzes the content of the subtitle removed from the control and special characters, , It is possible to acquire time information of the recognized character by recognizing the character matched with the predetermined character. Here, the predetermined character and the character matched with the preset character may include a symbol, a word, a sentence, and the like.

The IoT scenario generating unit 230 may generate an operation scenario for delivering the IoT scenario to at least one of the at least one IoT device 270 using the analyzed result of the subtitle file.

More specifically, the IoT scenario generation unit 230 collects at least one recognized character and time information, recognizes at least one installed IoT device 270 installed therein, and uses at least one character and time information An operation scenario for operating at least one installed IoT device 270 may be created.

The IoT (Internet of Thing) device is a device that is connected to a wired or wireless Internet and can communicate, for example, a smart light that is connected to a network and can be manipulated or adjusted in brightness, A movable chair connected to the network and capable of operating the switch, and the like.

For example, the operation scenario for operating the IoT device 270 may dim the brightness of the smart light or shut off the power of the smart light to implement the dark environment in the moving image in the viewing environment. As another example, an operational scenario for operating the IoT device 270 may cause the smart light to blink to implement a lightning striking scene in the moving picture into the viewing environment. As another example, the operational scenario for operating the IoT device 270 may be moved to shake the smart chair where the user sits to implement a situation where the train in the moving picture is shaken into the viewing environment. As another example, an operation scenario for operating the IoT device 270 may operate a smart air conditioner or a fan to implement a wind situation in a moving picture in a viewing environment.

The operation scenario transmitting unit 240 can operate the at least one IoT device 270 by transmitting the generated operation scenario to at least one IoT device 270. [

That is, the operation scenario transmitting unit 240 may transmit the generated operation scenario to at least one IoT device 270 connected by wire or wireless communication.

Furthermore, the interworking system 200 of the moving picture caption and the IoT device according to an embodiment may further include an IoT control character input unit.

The IoT control character input unit may receive an operation scenario for operating at least one IoT device 270 from a user as an IoT control character and provide a subtitle file to which an IoT control character is added.

Here, the IoT control character input unit may provide a caption file including an IoT control character through a separate input device provided by a user, and may receive a caption file including an IoT control character from a separate electronic device have. For example, the IoT control character input unit may receive a caption file including the IoT control character from the service provider.

The interworking system 200 of the moving picture caption and the IoT device according to one embodiment of the present invention may be realized as a dongle or a separate device or may be implemented as an application of a smart device.

For example, the interlocking system 200 of the moving picture caption and the IoT device is implemented as a dongle, and the dongle is connected to the moving picture reproducing device, the IoT device 270, or the router connected to the IoT device 270 through wire / . Also, the dongle can be provided as a single product integrated with the moving picture reproducing apparatus.

More specifically, by connecting a dongle to a TV capable of inputting a HDMI (High Definition Multimedia Interface), a caption file of a moving picture reproduced in a dongle is received and parsed and analyzed, And transmit the generated operation scenarios to the IoT device 270. [

In this way, according to one embodiment, an operation scenario transmitted to the IoT device 270 is parsed or analyzed by parsing or analyzing a subtitle file of a moving picture to be reproduced, and thereby an IoT device such as a lighting, a speaker, an air conditioner, 270) can feel immersion and presence feeling.

3 is a flowchart illustrating a method of interworking between a moving picture caption and an IoT device according to an exemplary embodiment of the present invention. FIG. 4 is a flowchart illustrating a method of parsing and analyzing subtitle contents according to an embodiment. FIG. 5 is a flowchart illustrating a method of generating an operation scenario for delivering to an IoT device according to an exemplary embodiment.

Referring to FIG. 3, a method for interworking between a moving picture caption and an IoT device according to an exemplary embodiment includes receiving (310) a caption file provided in a moving picture file to be reproduced, A step 320 of parsing and analyzing the subtitle contents, a step 330 of generating an operation scenario for delivering the subtitle file to at least one more IoT devices installed using the analyzed result of the subtitle file, And transmitting (340) the scenario to at least one or more IoT devices to operate the at least one IoT device.

Referring to FIG. 4, the step of removing control and special characters including HTML tag information in the subtitle file and parsing and analyzing the subtitle contents includes removing control and special characters including HTML tag information from the received subtitle file. Parsing and analyzing subtitle contents in which control and special characters have been removed, and recognizing characters matched with predetermined characters for operation of at least one IoT device; And acquiring time information of the recognized character.

Referring to FIG. 5, the step of generating an action scenario for delivering to an initially installed at least one IoT device using the analyzed result of the subtitle file may include: collecting at least one recognized character and time information; Recognizing at least one or more IoT devices installed therein; And generating an operation scenario for operating the at least one installed IoT device using the collected at least one character and time information.

According to the embodiments of the present invention, there is provided a method and system for interworking with a moving picture caption and an IoT device that provide a more realistic and realistic viewing environment in comparison with an existing environment by using an IoT device and subtitle file installed without investment cost, Can be provided.

Hereinafter, a method of interlocking a moving picture caption and an IoT device according to an embodiment will be described in more detail with an example.

The method of interlocking the moving picture caption and the IoT device according to the embodiment can be explained more concretely by using the interlocking system 200 of the moving picture caption and the IoT device according to the embodiment described in FIG. The interworking system 200 of a moving picture caption and an IoT device according to an embodiment includes a caption file receiving unit 210, an IoT caption analyzing unit 220, an IoT scenario generating unit 230, and an operation scenario transmitting unit 240 . The interworking system 200 of the moving picture caption and the IoT device may further include an IoT control character input unit.

In step 310, the caption file receiving unit 210 may receive a caption file provided to a moving picture file to be reproduced.

In step 320, the IoT caption analyzer 220 removes control and special characters including HTML tag information from the received caption file, and parses and analyzes the caption contents.

More specifically, in step 321, the IoT caption analyzer 220 can remove control and special characters including HTML tag information from the received caption file.

In step 322, the IoT caption analyzer 220 parses and analyzes the contents of the caption subtracted from the control and special characters, and recognizes characters matched with predetermined characters for the operation of the at least one IoT device. Here, the predetermined character and the character matched with the preset character may include a symbol, a word, a sentence, and the like.

The recognized characters may be one or a plurality of recognized characters, and if there are a plurality of recognized characters, the characters may be combined and analyzed.

In step 323, the IoT caption analyzing unit 220 can obtain the time information of the recognized character. Then, the IoT caption analyzing unit 220 can transmit the recognized character and time information to the IoT scenario generating unit 230.

In step 330, the IoT scenario generating unit 230 may generate an operation scenario for delivering the IoT scenario to at least one of the at least one IoT device using the analyzed result of the subtitle file.

More specifically, in step 331, the IoT scenario generation unit 230 may collect at least one recognized character and time information.

In step 332, the IoT scenario generating unit 230 may recognize at least one installed IoT device.

In step 333, the IoT scenario generating unit 230 may generate an operation scenario for operating at least one or more IoT devices installed using at least one character and time information collected.

The collected characters may be one or a plurality of characters, and if there are a plurality of collected characters, an operation scenario for operating at least one IoT device may be generated by combining the characters.

In operation 340, the operation scenario transmitting unit 240 may operate the at least one IoT device by transmitting the generated operation scenario to at least one IoT device.

For example, the operation scenario for operating the IoT device may be to adjust the power or brightness of the smart light, change the color of the light, and blink the light to implement the environment in the moving picture as a viewing environment. In addition, the user can move the sitting smart chair to shake or adjust the wind effect or temperature through air conditioner, fan, or hot air fan. It is also possible to adjust the volume of the speaker. Moreover, the operational scenarios for operating the IoT device may be interlocked with the various IoT devices provided, for example, the IoT device may include an air injection device, a flavor emitting device, a soap drop device, Devices, and the like.

Meanwhile, the IoT control character input unit may receive an operation scenario for operating at least one IoT device from a user as IoT control characters, and provide a subtitle file to which the IoT control character is added.

Here, the IoT control character input unit may provide a caption file including an IoT control character through a separate input device provided by a user, and may receive a caption file including an IoT control character from a separate electronic device have. For example, the IoT control character input unit may receive a caption file including the IoT control character from the service provider.

Hereinafter, a method of interlocking a moving picture caption and an IoT device according to an embodiment will be described in more detail with an example.

The method of interlocking the moving picture caption and the IoT device according to one embodiment can be operated using the interlocking system 200 of the moving picture caption and the IoT device according to the embodiment described in FIG. The interworking system 200 of a moving picture caption and an IoT device according to an exemplary embodiment may include an IoT caption analyzing unit 220 and an IoT scenario generating unit 230. The interworking system 200 between the moving picture caption and the IoT device may further include a caption file receiving unit 210 and an operation scenario transmitting unit 240. [

The IoT subtitle analyzing unit analyzes the string that the IoT device can operate in the subtitle file and transmits the analyzed string to the IoT scenario generating unit.

Below is a part of subtitle file of existing video file.

<SYNC Start = 216993> <P Class = ENUSCC> The final game of the 5th season of the throne game - <Mother God's mercy>

<SYNC Start = 221993> <P Class = ENUSCC> &nbsp;

<SYNC Start = 242639><P Class = ENUSCC> Watch the wind

<SYNC Start = 247127><P Class = ENUSCC> The God of Light has kept the promise <br>

<SYNC Start = 249763><P Class = ENUSCC> His fire melted his eyes and removed them

<SYNC Start = 258805><P Class = ENUSCC> God showed Bolton's flag burning

<SYNC Start = 287717> <P Class = ENUSCC> Sort the rows

<SYNC Start = 289252> <P Class = ENUSCC> Charge

<SYNC Start = 294341><P Class = ENUSCC> The dawn is getting closer

<SYNC Start = 295675> <P Class = ENUSCC> There were a lot of desertions yesterday

<SYNC Start = 301898> <P Class = ENUSCC> How much?

<SYNC Start = 303600> <P Class = ENUSCC> Nearly half

<SYNC Start = 305327><P Class = ENUSCC> The storm is coming and coming.

The IoT caption analyzing unit recognizes a character string indicated in bold above and transmits it to the IoT scenario generating unit for generating the IoT scenario together with the corresponding time such as SYNC Start = 242639.

Accordingly, the IoT scenario generation unit can analyze the scenario in which the IoT caption analysis unit assembles the received character string.

For example, if the current IoT device is connected to an LED light, an electric fan, an air conditioner, and an IoT-enabled speaker if the wind, light, fire, Since the volume control is possible, the IoT scenario generation unit can create the following scenario and transmit it to the corresponding IoT device at a predetermined time.

- Increase the strength of the fan or air conditioner gradually (Start = 242639 ~ 287717)

- Continue to light red light gradually (Start = 247127 ~ 294341)

- You can increase the volume of the connected audio device (Start = 305327) and then restore the normal volume.

In addition, a caption file including additional IoT control characters may be provided in order to provide a more accurate viewing environment to the existing caption file.

Below is an example of adding the IoT control character to the existing subtitle file.

<SYNC Start = 216993> <P Class = ENUSCC> The final game of the 5th season of the throne game - <Mother God's mercy>

<SYNC Start = 221993> <P Class = ENUSCC> &nbsp;

<SYNC Start = 242639><P Class = ENUSCC> Watch the wind

<SYNC Start = 247127><P Class = ENUSCC> The God of Light has kept the promise <br>

<SYNC Start = 249763><P Class = ENUSCC> His fire melted his eyes and removed them

<SYNC Start = 258805><P Class = ENUSCC> God showed Bolton's flag burning

<SYNC Start = 287717> <P Class = ENUSCC> Sort the rows

<SYNC Start = 289252> <P Class = ENUSCC> Charge

<SYNC Start = 294341><P Class = ENUSCC> The dawn is getting closer

<- IOT = light color = red dur = 3s ->

<SYNC Start = 295675> <P Class = ENUSCC> There were a lot of desertions yesterday

<SYNC Start = 301898> <P Class = ENUSCC> How much?

<SYNC Start = 303600> <P Class = ENUSCC> Nearly half

<SYNC Start = 305327><P Class = ENUSCC> The storm is coming and coming.

<- IOT = fan level = 2 dur = 3s ->

The caption file including such IoT control characters is not displayed on the display device but can control at least one IoT device to be interlocked.

The embodiments described above have the effect of providing a more realistic and realistic viewing environment compared to the existing environment when viewing a moving image by using the IoT device and the subtitle file installed without investment cost.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, controller, arithmetic logic unit (ALU), digital signal processor, microcomputer, field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing apparatus may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI &gt; or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

100, 200: Interlocking system of moving subtitle and IoT device
110, &lt; / RTI &gt; 250:
120, 260: display device
130, 270: IoT device
210: Subtitle file receiving unit
220: IoT caption analyzing unit
230: IoT scenario generation unit
240: Operation scenario transmission unit

Claims (7)

A caption file receiving unit for receiving a caption file provided to a moving picture file to be reproduced;
An IoT caption analyzing unit for removing control and special characters including HTML tag information from the received caption file and parsing and analyzing caption contents;
An IoT scenario generation unit for generating an operation scenario for delivering to the at least one more installed IoT device using the analyzed result of the subtitle file; And
And transmits the generated operation scenario to the at least one IoT device to operate the at least one IoT device.
IoT device interworking system. The method according to claim 1,
The IoT caption analyzing unit,
The control and special characters including the HTML tag information are removed from the received subtitle file, and the contents of the subtitle removed from the control and special characters are parsed and analyzed to match the preset characters for the operation of the at least one IoT device Recognizing a character and acquiring time information of the recognized character
And the IoT device interlocking system. 3. The method of claim 2,
Wherein the IoT scenario generating unit comprises:
Recognizing the at least one or more IoT devices installed and collecting at least one of the recognized character and time information and operating the at least one or more IoT devices installed using the collected at least one character and time information Creating an action scenario
And the IoT device interlocking system. The method according to claim 1,
An IoT control character input unit for inputting the operation scenario for operating the at least one IoT device from a user as an IoT control character and providing a caption file to which the IoT control character is added,
And an IoT device interlocking system. The method according to claim 1,
The interlocking system of the moving picture caption and the IoT device is realized as a dongle and is connected to the moving picture reproducing apparatus, the IoT device or the router connected to the IoT device by wired / wireless communication, or integrated into the moving picture reproducing apparatus And,
Wherein the caption file receiving unit receives a caption file provided to a moving picture file to be reproduced according to driving of the moving picture reproducing apparatus and the operation scenario transmitting unit transmits the generated operation scenario to the at least one or more connected IoT devices
And the IoT device interlocking system. Receiving a subtitle file provided in a moving picture file to be reproduced;
Removing control and special characters including HTML tag information from the received caption file and parsing and analyzing caption contents;
Generating an action scenario for delivering to the at least one more IoT device installed using the analyzed result of the subtitle file; And
And transmitting the generated operation scenario to the at least one IoT device to operate the at least one IoT device
A method of interworking between a moving picture caption and an IoT device. The method according to claim 6,
The step of removing control and special characters including HTML tag information from the subtitle file and parsing and analyzing the contents of the subtitle,
Removing control and special characters including HTML tag information from the received subtitle file;
Parsing and analyzing subtitle contents in which the control and special characters are removed, recognizing characters matched with preset characters for operation of the at least one IoT device; And
Acquiring time information of the recognized character
Lt; / RTI &gt;
Generating an action scenario for delivering to the at least one more IoT device installed using the analyzed result of the subtitle file,
Collecting at least one of the recognized character and time information;
Recognizing said at least one more IoT device installed; And
Generating an operation scenario for operating the at least one installed IoT device using at least one of the collected character and time information;
A method of interworking between a moving picture caption and an IoT device.

Images