KR102056142B1 - Multi-language subtitle and sound providing system using streaming glass - Google Patents

Abstract

The present invention relates to a multilingual subtitle and sound providing system using streaming glass. According to the present invention, an image unit including a screen and a speaker on which an image is displayed; The video information stored on the screen is stored in the video server to reproduce the video and the streaming video streaming on the video server based on augmented reality including a streaming glass for displaying the caption of the video, the video server is the screen A storage unit for storing image information of the image being displayed on the; A playback unit for displaying the image of the image information on the screen and reproducing the main sound in the speaker, and a transmission unit for streaming subtitles corresponding to the language received from the streaming glass in accordance with the image displayed on the screen on the streaming glass. In addition, the image information may provide a multilingual subtitle and sound providing system using a streaming glass including a video, a main sound, and a multilingual subtitle.

Description

Multi-language subtitle and sound providing system using streaming glass}

The present invention relates to a multilingual subtitle and sound providing system using streaming glass, and more specifically, to provide multilingual subtitles and sounds so that multinational people can watch foreign videos. The present invention relates to a multilingual subtitle and sound providing system using streaming glass.

Currently, not only in Korea, but also in a multicultural society around the world, multicultural families are increasing.

However, the video service provided by not only Korea but also other movie theaters and film festivals is provided to the local people (Korea = Koreans), so it is difficult for foreigners staying in the country to freely watch the cultural service.

As a result, they were blocked by language barriers, which made it difficult to experience and share culture through films of other countries.

Therefore, it is necessary to provide a cultural experience service that allows people from all over the world to simultaneously sympathize in real time in a single space through services provided in a foreign language and sound.

In order to solve the above problems, the present invention provides multi-language subtitles and sounds so that multinational people can watch foreign images, multi-language subtitles and sounds using streaming glass that allows multi-national people to watch a video in their native language at the same time. To provide a system.

In order to solve the above problems, the multi-language subtitle and sound providing system using the streaming glass according to an embodiment of the present invention comprises an image unit including a screen and a speaker on which the image is screened; The video information stored on the screen is stored in the video server to reproduce the video and the streaming video streaming on the video server based on augmented reality including a streaming glass for displaying the caption of the video, the video server is the screen A storage unit for storing image information of the image being displayed on the; A playback unit for displaying the image of the image information on the screen and reproducing the main sound in the speaker, and a transmission unit for streaming subtitles corresponding to the language received from the streaming glass in accordance with the image displayed on the screen on the streaming glass. In addition, the image information may provide a multilingual subtitle and sound providing system using a streaming glass including a video, a main sound, and a multilingual subtitle.

The streaming glass may further include a camera for photographing a wearer's viewpoint; A screen unit displaying a moving image photographed by the camera and displaying a caption of the image; It may include an input unit for receiving a language selected from the wearer and a control unit for transmitting the selected language from the wearer to the image server, receiving the subtitle from the image server, and displays the subtitle on the screen unit. .

The input unit may receive a setting value of zoom in and zoom out of the camera from the wearer, and the controller may control the camera according to the input setting value of zoom in and zoom out.

The controller may recognize an area of the screen in the video photographed by the camera and control the caption to be displayed on the recognized area of the screen.

The input unit may receive a position of the virtual line in the area of the screen from the wearer, and the controller may control the caption to be displayed on the input virtual line.

The streaming glass may further include a headset for outputting the sound of the image, and the image information may further include a multilingual sound.

The input unit may receive whether the sound service is input from the wearer, and the controller transmits the input or not of the sound service to the video server, and when receiving the sound service, outputs a sound corresponding to a language selected from the video server. And receiving and controlling the sound to be output to the headset.

The streaming glass may further include a microphone capable of recognizing the wearer's voice, and when the word is input from the microphone, the controller extracts a language of the word to the image server. Characterized in that the transmission.

The multilingual subtitle and sound providing system using streaming glass according to an embodiment of the present invention can provide a multilingual subtitle and sound so that multinational people can watch a foreign video so that multinational people can simultaneously view a single image in their native language.

Accordingly, foreigners can experience the culture through the film of the country.

1 is a block diagram of a multilingual subtitle and sound providing system using streaming glass according to an embodiment of the present invention.
Figure 2 is a block diagram showing the configuration of a video server according to an embodiment of the present invention.
3 is an exemplary view showing a streaming glass according to an embodiment of the present invention.
Figure 4 is a block diagram showing the configuration of a streaming glass according to an embodiment of the present invention.

Hereinafter, the description of the present invention with reference to the drawings is not limited to the specific embodiments, various changes may be made and various embodiments may be provided. In addition, the contents described below should be understood to include all transformations, equivalents, and substitutes included in the spirit and technical scope of the present invention.

In the following description, terms such as “first” and “second” are terms used to describe various components, and are not limited in themselves, and are used only to distinguish one component from other components.

Like reference numerals used throughout the present specification refer to like elements.

As used herein, the singular forms "a", "an" and "the" include plural forms unless the context clearly indicates otherwise. In addition, the terms "comprise", "comprise" or "have" described below are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist. It is to be understood that it does not exclude in advance the possibility of the presence or the addition of one or more other features or numbers, steps, actions, components, parts or combinations thereof.

Hereinafter, an embodiment of the present invention will be described in detail with reference to FIGS. 1 to 4.

1 is a block diagram of a multilingual subtitle and sound providing system using streaming glass according to an embodiment of the present invention.

2 is a block diagram showing the configuration of a video server according to an embodiment of the present invention.

3 is an exemplary view showing a streaming glass according to a practical example of the present invention.

4 is a block diagram showing the configuration of a streaming glass according to an embodiment of the present invention.

In the multilingual subtitle and sound providing system using streaming glass according to an embodiment of the present invention, a video service provided for not only Korea but also other countries' movie theaters and film festivals is provided to local citizens. Due to the difficulty of freely viewing cultural services, it was developed to provide multilingual subtitles and sound so that multinational people can simultaneously view a video in their own language.

The multilingual subtitle and sound providing system using the streaming glass may include the image unit 100, the image server 200, and the streaming glass 300 with reference to FIG. 1.

Each component of such a system can generally be connected via a network. A network refers to a connection structure capable of exchanging information between nodes such as devices and servers. Examples of such a network include a 3rd generation partnership project (3GPP) network and a long term evolution (LTE) network. , World Interoperability for Microwave Access (WIMAX) network, Internet, Local Area Network (LAN), Wireless Local Area Network (WLAN), Wide Area Network (WAN), Personal Area Network (PAN), Bluetooth (Bluetooth) Networks, satellite broadcasting networks, analog broadcasting networks, DMB (Digital Multimedia Broadcasting) networks and the like, but are not limited to these.

More specifically, the image unit 100 may include a screen (not shown) on which an image is displayed and a speaker (not shown) on which a main sound is output.

The screen (not shown) may be displayed by transmitting an image from an image output device (not shown) that receives the image from the image server 200, but the image may be screened, but is not limited thereto. You can also display the video on your own.

A speaker (not shown) may receive a main sound of image information from the image server 200 and reproduce the main sound.

Accordingly, people who do not wear the streaming glass 300 can watch the image without subtitles.

The image server 200 may store image information of an image displayed on a screen (not shown) and reproduce the image. In addition, one of the multilingual subtitles may be transmitted to the streaming glass 300.

In addition, the video server 200 streams the subtitles to the streaming glass 300 in accordance with the playback of the video and the main sound screened on the video unit 100, the video and sound and the streaming glass screened on the video unit 100 ( The synchronization of the subtitles provided to 300 may be provided to match.

More specifically, referring to FIG. 2, the image server 200 may include a storage 210, a playback 220, and a transmitter 230.

The storage unit 210 may store image information about an image displayed on a screen (not shown).

Here, the image information may include an image, a main sound, subtitles in multiple languages, and sound in multiple languages. That is, a single video includes subtitles and sounds of multiple languages in addition to the main sound.

The image information stored in the storage unit 210 may be uploaded by the administrator who manages the image server 200 to access the image server 200 and store the image information.

The playback unit 220 may be connected to the image unit 100 to display an image of the image information on a screen (not shown) and to reproduce the main sound in the speaker (not shown). More specifically, an image of the image information may be transmitted to an image output device (not shown) to be controlled and displayed on a screen (not shown).

The transmitter 230 may select a subtitle corresponding to a language received from the streaming glass 300.

That is, the transmitter 230 may select a caption matching a language received from the streaming glass 300 among a plurality of captions.

In addition, the transmission unit 230 may stream the selected subtitles to the streaming glass 300 in accordance with the video screened by the video unit 100.

The streaming glass 300 is an augmented reality-based device and may be streamed to the image server 200 to display captions of an image. That is, the streaming glass 300 may provide an augmented reality-based screen to the wearer and visually provide the wearer as if the caption is on a screen (not shown) when the wearer wears the glasses together.

To this end, referring to FIGS. 3 and 4, the streaming glass 300 includes a camera 310, a screen unit 320, an input unit 330, a headset 340, a microphone 350, a power supply unit 360, and The controller 370 may be included.

The camera 310 may be provided in the streaming glass 300 to photograph the view of the wearer and transmit the captured view to the controller 370. Accordingly, a video such as a wearer's view may be displayed on the screen 320 in real time through the controller 370.

As a result, the wearer can visually view through the screen unit 320 as if the wearer is wearing the streaming glass 300.

In addition, the camera 310 may be provided in the streaming glass 300 so that the wearer can freely adjust the angle in the up, down, left and right directions.

The screen 320 may display a video photographed by the camera 310 and display captions of the video.

Accordingly, the screen 320 displays a video captured by the camera 310, and the subtitles streamed from the image server 200 are displayed on the screen 320 where the video is displayed to be virtually overlapped with each other. Augmented reality can be realized as the virtual reality and the real world are shown at the same time as the subtitles are shown in the video screen.

The input unit 330 may receive a language selected by the wearer. In this case, the input unit 330 may be a touch type or a button type, but may be configured in various ways and received from a wearer.

For example, when the wearer presses the input unit 330, a language list (Korean, English, Chinese, etc.) is displayed on the display unit 320, and the wearer may select one of the language lists through the input unit 330.

In addition, the input unit 330 may receive a set value of zoom-in and zoom-out of the camera 310 from the wearer.

Accordingly, the zoom-in and zoom-out of the camera 310 may be controlled through the controller 370.

For example, in a movie theater, a wearer sitting in a front seat that is too close to a screen (not shown) or in a back seat that is too far away may adjust the screen to a size that is convenient for viewing so that the viewer can watch the image.

If the subtitle is displayed in the area of the screen, the subtitle is too small because the distance to the screen (not shown) is too small, or the subtitle is too large because the distance is too close to the screen (not shown). You can feel it so you can adjust it.

In addition, the input unit 330 may receive a position of the virtual line in the area of the screen from the wearer.

Accordingly, the position of the subtitle displayed on the screen 320 through the controller 370 may be adjusted to a wearer's own view so that the subtitle may be set at a position that is easy to see.

For example, when trying to adjust the position of the virtual line through the input unit 330, the virtual line is displayed in the area of the screen, when the wearer adjusts the position of the virtual line through the input unit 330 and completes the position of the completed pseudo line Can be (set).

In addition, the input unit 330 may receive a sound service input from the wearer.

This allows the wearer to select whether or not to provide a sound service. The sound service provides the wearer with the headset 340 a sound corresponding to a language selected by the wearer among multilingual sounds.

Accordingly, the wearer can watch while listening to a sound corresponding to the language (native language) selected by the wearer while watching the image.

The headset 340 may output a sound of an image. That is, the sound corresponding to the language selected by the wearer among the multilingual sounds of the image information may be output through the headset 340 and provided to the wearer.

In addition, the headset 340 may be formed to cover all of the wearer's ears.

This is because the main sound is output through the speaker (not shown) when viewing the image, so that different sound is output through the headset 340, so that the sound from the main sound and the headset 340 overlap and prevent confusion. You can increase your concentration.

The microphone 350 may recognize a wearer's voice and set a language.

That is, when the '350' is input from the wearer, the microphone 350 may transmit the same to the controller 370 so that the language of the 'word' may be extracted and selected.

The power supply unit 360 may supply power to the streaming glass 300. The power supply unit 360 is most preferably used as a battery and can be connected to an external power source for charging. However, the power supply unit 360 may be formed in various configurations.

The controller 370 may transmit the selected language from the wearer to the image server 200, and receive the subtitle corresponding to the language from the image server 200 so that the subtitle is displayed on the screen 320.

In addition, the controller 370 may receive the setting values of the zoom in and the zoom out of the camera 310 from the input unit 330, and control the camera 310 according to the setting values of the zoom in and the zoom out.

In addition, the controller 370 may control to receive the video captured by the camera 310 and display the video on the screen 320.

In addition, the controller 370 may recognize the area of the screen by analyzing the video received from the camera 310.

That is, the controller 370 recognizes an area of the screen in real time based on information about a screen (not shown) that has been pre-learned, and displays the subtitle streamed from the image server 200 in the area of the recognized screen. Can be controlled.

Accordingly, the position of the screen (not shown) is moved by the wearer's movement in the screen unit 320 and the position of the subtitle may be automatically adjusted as the viewpoint changes.

This allows the wearer to watch the image without visual discomfort.

In addition, the controller 370 may control the subtitle streamed from the image server 200 to be displayed at the position (virtual line) of the virtual line received from the input unit 330.

This may improve the visual comfort of the wearer by controlling the position of the caption displayed in the area of the screen according to the wearer's setting.

In addition, the controller 370 may receive a sound service (Yes or No) from the input unit 330 and transmit the received sound service to the image server 200.

In addition, when receiving a sound service (when the sound service is Yes), the controller 370 may receive a sound corresponding to a language from the video server 200 (stream) and control the output to the headset 340. have.

In addition, when the 'word' is input from the microphone 350, the controller 370 may extract the language of the 'word' and transmit the extracted language to the image server 200. The language is selected, and the image server 200 may transmit the subtitles or sounds corresponding to the language among the multilingual subtitles or the sounds to the controller 370 according to the received language.

For example, when 'word' is set to 'greetings' of each country, if 'hello' is input to the microphone 350, the control unit 370 receives 'hello' and extracts the language of 'hello' The extracted language may be extracted and Korean (the extracted language) may be transmitted to the image server 200.

That is, the word 'word' is a standard word of the country or a word registered in the dictionary, and can be changed and added according to the setting.

In addition, the controller 370 may receive a signal from the on / off switch (not shown) to turn on / off the power of the streaming glass 300.

In addition, the streaming glass 300 may further include an on / off switch (not shown) for turning on / off the power of the streaming glass 300.

As described above, the system of the present invention turns on the streaming glass 300 and sets a language, a position of a virtual line, and transmits the image to the image server 200 before the image is displayed on the image unit 100. As the video is screened at the streaming glass 300 may be streamed to display subtitles.

As described above, the multilingual subtitle and sound providing system using the streaming glass according to the embodiment of the present invention provides multilingual subtitles and sound so that multinational people can watch foreign images so that the multinational people can simultaneously display one image. You can watch as.

Accordingly, foreigners can experience the culture through the film of the country.

Although the embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art may carry out in other specific forms without changing the technical spirit or essential features of the present invention. I can understand that. Accordingly, the embodiments described above are exemplary in all respects and not restrictive.

100: video unit
200: video server
210: storage unit
220: playback unit
230: transmission unit
300: streaming glass
310: camera
320: screen portion
330: input unit
340: headset
350: microphone
360: power supply
370: control unit

Claims (7)

An image unit including a screen and a speaker on which an image is displayed;
An image server storing image information on an image displayed on the screen and reproducing the image;
Including a streaming glass to display the caption of the video streamed to the video server on the basis of augmented reality,
The video server,
A storage unit which stores image information of an image displayed on the screen;
A playback unit for displaying the image of the image information on the screen and reproducing the main sound in the speaker;
It includes a transmission unit for streaming the subtitle corresponding to the language received from the streaming glass in accordance with the image screened on the screen in the streaming glass,
The video information,
Include video, main sound, multi-language subtitles,
The streaming glass,
A camera for photographing the wearer's viewpoint;
A screen unit displaying a moving image photographed by the camera and displaying a caption of the image;
An input unit for receiving a language selected from the wearer;
A control unit which transmits a language selected from the wearer to the image server, receives the subtitles from the image server, and controls the subtitles to be displayed on the screen unit;
Further comprising a microphone for recognizing the wearer's voice,
The control unit,
When the word is input from the microphone, the language of the word is extracted and transmitted to the video server.
The video server,
Transmits the subtitles corresponding to the language among the subtitles of the multilingual language to the controller according to the received language;
The streaming glass,
Further comprising a headset for outputting the sound of the image,
The video information,
Including multilingual sound,
The input unit,
Receiving the sound service from the wearer;
The control unit,
Transmits the input or not of the sound service to the video server, and receives the sound corresponding to the selected language from the video server when receiving the sound service, and controls the sound to be output to the headset.
The control unit,
Recognizes the area of the screen in the video taken from the camera, and controls to display the subtitle in the recognized area of the screen,
The input unit,
Receiving the position of the virtual line in the area of the screen from the wearer,
The control unit,
Multi-language subtitle and sound providing system using the streaming glass, characterized in that the control to display the subtitle on the input virtual line.
delete delete delete delete delete delete

Images