KR102440901B1 - Live streaming server which can insert the two-dimensional code, to be used for looking up contents data, in the realtime video, and the operating method thereof - Google Patents

Abstract

A live streaming server which can insert 2D code used for looking up content data in a real-time video, and an operating method thereof are disclosed. The present invention suggests a live streaming server which can insert 2D code used for looking up content data in a real-time video and an operating method of the same. Thus, it is possible to support an increase in the usability of a live streaming service.

Description

A live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time video and its operation method VIDEO, AND THE OPERATING METHOD THEREOF}

The present invention relates to a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image, and an operating method thereof.

Recently, as electronic terminals such as computers, smart phones, or tablet PCs have been widely used, various types of video contents that can be viewed using such electronic terminals have appeared.

In addition, as the spread of COVID-19 around the world is prolonged, in a situation where contact and movement between people are limited, viewers who spend their leisure time watching various videos using electronic terminals instead of doing outdoor activities are increasing. have.

In particular, in recent years, by transmitting real-time image data received from an image transmitting terminal of an image transmitter to a viewer's image reproducing terminal, through a live streaming service that supports viewers to view real-time images, viewers who watch real-time images is increasing

On the other hand, since the information that the video sender can provide to viewers through real-time video is limited, there are cases where the video sender wants to additionally provide content to supplement the content of the real-time video to viewers while the real-time video is being played. many.

If, in a live streaming service, a technology capable of inserting a two-dimensional code used for inquiring content data into a real-time image is introduced, the video transmitter can provide more diverse content to the viewers, and the viewers can use the two-dimensional code Through this, the usability of the live streaming service can be increased in that the content provided by the video transmitter can be easily inquired.

Therefore, in order to support the increase in the usability of the live streaming service, it is necessary to study a technology capable of inserting a two-dimensional code used for inquiring content data into a real-time image.

An object of the present invention is to support a live streaming service to increase usability by providing a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image and an operating method thereof.

A live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention, while receiving the first content data from the image transmitting terminal of the image sender, to the real-time image, When a processing request instructing to include inquiry information for inquiring the first content data is received, a main identification number of n (n is a natural number equal to or greater than 2) digits and k (k is 2) for use as the inquiry information an identification number generating unit that randomly generates a secondary identification number of digits or more), a first primary identification number is generated as the primary identification number, and a first secondary identification number is generated as the secondary identification number An authentication token calculation unit for calculating a first authentication token by applying the first main identification number and the first auxiliary identification number as inputs to a preset token generating function for generating, when the first authentication token is calculated, the A first authentication token and the first auxiliary identification number are stored in a content storage in correspondence with the first content data, and a two-dimensional code including the first main identification number and data for the first authentication token is generated. After the code generator and the two-dimensional code are generated, when real-time image data that is a target of live streaming is received from the image transmission terminal, voice recognition for the real-time image data is performed through a pre-built voice recognition model. After generating a caption by performing a method, inserting the caption and the two-dimensional code into a preset caption display area of the real-time image data, and then displaying the real-time image data into which the caption and the two-dimensional code are inserted into the viewer's image and a data transmission unit for transmitting to the reproduction terminal.

In addition, the operating method of a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention is performed while receiving the first content data from the image transmitting terminal of the image transmitter. , when a processing request instructing to include inquiry information for inquiring the first content data in the real-time image is received, a main identification number of n (n is a natural number equal to or greater than 2) digit number for use as the inquiry information; A step of randomly generating an auxiliary identification number of k (k is a natural number of 2 or more) digits, when a first main identification number is generated as the main identification number and a first auxiliary identification number is generated as the auxiliary identification number, authentication calculating a first authentication token by applying the first main identification number and the first auxiliary identification number as inputs to a preset token generation function for generating a token; when the first authentication token is calculated, the first authentication token One authentication token and the first auxiliary identification number are stored in a content storage in correspondence with the first content data, and a two-dimensional code including the first main identification number and data for the first authentication token is generated. After the step and the two-dimensional code is generated, when real-time image data, which is the target of live streaming, is received from the image transmitting terminal, by performing voice recognition on the real-time image data through a pre-built voice recognition model. After generating a subtitle, inserting the subtitle and the 2D code in a preset subtitle display area of the real-time image data, the real-time image data into which the subtitle and the 2D code are inserted is transmitted to a viewer's image reproducing terminal It includes the step of transmitting.

The present invention can support to increase the usability of a live streaming service by providing a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image and an operating method thereof.

1 is a diagram illustrating a structure of a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention.
FIG. 2 is a view for explaining the operation of a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention.
3 is a flowchart illustrating an operation method of a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. These descriptions are not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In describing each drawing, like reference numerals are used for similar components, and unless otherwise defined, all terms used in this specification, including technical or scientific terms, refer to those of ordinary skill in the art to which the present invention belongs. It has the same meaning as is commonly understood by those who have it.

In this document, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated. In addition, in various embodiments of the present invention, each of the components, functional blocks or means may be composed of one or more sub-components, and the electrical, electronic, and mechanical functions performed by each component are electronic. A circuit, an integrated circuit, an ASIC (Application Specific Integrated Circuit), etc. may be implemented with various well-known devices or mechanical elements, and may be implemented separately or two or more may be integrated into one.

On the other hand, the blocks in the accompanying block diagram or steps in the flowchart are computer program instructions that are loaded in a processor or memory of equipment capable of data processing, such as a general-purpose computer, a special-purpose computer, a portable notebook computer, and a network computer, and perform specified functions. can be interpreted as meaning Since these computer program instructions may be stored in a memory provided in a computer device or in a memory readable by a computer, the functions described in the blocks of the block diagram or the steps of the flowchart are produced in an article containing instruction means for performing the same. it might be In addition, each block or each step may represent a module, segment, or portion of code comprising one or more executable instructions for executing the specified logical function(s). It should also be noted that, in some alternative embodiments, it is possible for the functions recited in blocks or steps to be executed out of the prescribed order. For example, two blocks or steps shown one after another may be performed substantially simultaneously or in the reverse order, and in some cases, some blocks or steps may be omitted.

1 is a diagram illustrating a structure of a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention.

Referring to FIG. 1 , a live streaming server 110 capable of inserting a two-dimensional code used for inquiring content data into a real-time image includes an identification number generation unit 111 , an authentication token calculation unit 112 , and a code generation unit. 113 and a data transmission unit 114 .

The identification number generator 111 is configured to include inquiry information for inquiring the first content data in the real-time image while the first content data is received from the image transmission terminal 121 of the image transmitter 120 . When a processing request indicating is received, a primary identification number of n (n is a natural number equal to or greater than 2) digits and an auxiliary identification number of k (k is a natural number greater than or equal to 2) digits are randomly generated for use as the inquiry information.

For example, let n be '3' and k be '4', and while 'content data 1' is received from the image transmission terminal 121 of the video transmitter 120, 'content data 1' is displayed in the real-time image. When it is said that a processing request instructing to include inquiry information for inquiry is received, the identification number generating unit 111 is a '3' digit main identification number and '4' digit auxiliary number for use as the inquiry information. An identification number can be randomly generated.

In this way, when the first main identification number is generated as the main identification number by the identification number generation unit 111 and the first auxiliary identification number is generated as the auxiliary identification number, the authentication token calculation unit 112 generates an authentication token A first authentication token is calculated by applying the first primary identification number and the first auxiliary identification number as inputs to a preset token generation function for generating.

At this time, according to an embodiment of the present invention, when the first main identification number and the first auxiliary identification number are applied as inputs, the token generation function uses n numbers constituting the first main identification number as components. After generating an operation matrix having a size of n x k by calculating a Kronecker product between an n-dimensional column vector having , may be a function of calculating a Euclidean norm of the operation matrix as the first authentication token.

Here, the Euclidean norm is an L2 norm for indicating the size of a vector or matrix, and may be calculated according to Equation 1 below.

는 유클리드 노름을 의미하고, x_i는 벡터나 행렬에 포함되어 있는 i번째 성분을 의미한다.In Equation 1 above

denotes the Euclidean norm, and x _i denotes the i-th component included in a vector or matrix.

In addition, the Kronecker product refers to a matrix specifically expressing the tensor product of two matrices. A matrix A having a size of a x b as in Equation 2 below and a matrix B having a size of p x q as in Equation 3 below. Given that , the Kronecker product between matrix A and matrix B can be expressed as Equation 4 below.

For example, as in the above-described example, let n be '3', let k be '4', and as the main identification number, it is assumed that the first main identification number is generated such as '123', and the auxiliary identification number Assume that the first auxiliary identification number is generated as '4567'.

Then, the authentication token calculating unit 112 may apply the first main identification number '123' and the first auxiliary identification number '4567' to the token generation function as inputs.

'이고, 상기 제1 보조 식별번호인 '4567'을 구성하는 '4'개의 숫자들을 성분으로 갖는 '4'차원의 행벡터는 '[4 5 6 7]' 이므로, 상기 토큰 생성 함수는 '

'과 '[4 5 6 7]' 간의 크로네커 곱을 연산하여, '3 x 4'의 크기를 갖는 연산 행렬을 '

'과 같이 생성한 후, 상기 연산 행렬의 유클리드 노름인 '42'를 상기 제1 인증 토큰으로 산출할 수 있다.In relation to this, a '3'-dimensional column vector having '3' numbers constituting '123', which is the first main identification number, as a component is '

', and the '4'-dimensional row vector having '4' numbers constituting the first auxiliary identification number '4567' as a component is '[4 5 6 7]', so the token generation function is '

By calculating the Kronecker product between ' and '[4 5 6 7]', an operation matrix having a size of '3 x 4' is '

After generating as ', '42', which is the Euclidean norm of the operation matrix, may be calculated as the first authentication token.

In this way, when the first authentication token is calculated by the authentication token calculating unit 112 , the code generating unit 113 associates the first authentication token and the first auxiliary identification number with the first content data to provide content Stored in the storage, and generate a two-dimensional code including data for the first main identification number and the first authentication token.

Here, the two-dimensional code means a code capable of inserting information such as various characters on a two-dimensional image pattern, and a QR code (Quick Response Code), veri code, dot code, etc. are used, A digital code or the like capable of expressing predetermined data on a two-dimensional image through a pixel space composed of a plurality of dots disclosed in Korean Patent No. 10-1897960 may be used.

For example, as in the above example, the first main identification number is '123', the first auxiliary identification number is '4567', and the first authentication token is 'by the authentication token calculation unit 112'. When it is calculated as '42', the code generation unit 113 generates '42', which is the first authentication token, and '4567', which is the first auxiliary identification number, as shown in Table 1 below, and 'content data 1' and can be stored in the content repository.

authentication token secondary identification number content data 42 4567 content data 1 ... ... ...

At the same time, the code generator 113 may generate a two-dimensional code including data for '123', which is the first main identification number, and '42', which is the first authentication token.

In this way, after the two-dimensional code is generated by the code generating unit 113, when real-time image data, which is the target of live streaming, is received from the image transmitting terminal 121, the data transmitting unit 114 is configured in advance. A subtitle is generated by performing voice recognition on the real-time image data through a voice recognition model, the subtitle and the two-dimensional code are inserted in a preset subtitle display area of the real-time image data, and then the subtitle and the The real-time image data into which the two-dimensional code is inserted is transmitted to the image reproduction terminal 131 of the viewer 130 .

For example, as in the above-described example, the two-dimensional code including data for '123', which is the first main identification number, and '42', which is the first authentication token, is generated by the code generator 113. After that, when it is said that 'real-time image data 1', which is the target of live streaming, is received from the image transmission terminal 121, the data transmission unit 114 through the pre-built voice recognition model, the 'real-time image A caption may be generated by performing voice recognition on data 1', and the caption and the two-dimensional code may be inserted into a preset caption display area of 'real-time image data 1'.

Thereafter, the data transmission unit 114 may transmit the 'real-time image data 1' in which the subtitle and the 2D code are inserted to the image reproduction terminal 131 of the viewer 130 .

At this time, according to an embodiment of the present invention, when the real-time image data is received from the live streaming server 110, the image reproduction terminal 131 reproduces the real-time image data and displays the real-time image on the screen at the same time. , the subtitle and the 2D code may be displayed in the subtitle display area.

For example, as in the above example, as the data transmission unit 114 transmits the 'real-time image data 1' into which the subtitle and the two-dimensional code are inserted to the image reproduction terminal 131, the image reproduction terminal 131 is When 'real-time image data 1' is received, the image reproduction terminal 131 reproduces 'real-time image data 1' and displays the real-time image on the screen 200 as shown in FIG. 2 , and at the same time , the subtitle and the 2D code 220 may be displayed in the subtitle display area 210 .

In relation to this, the example of FIG. 2 shows an example in which a digital code capable of expressing predetermined data on a two-dimensional image through a pixel space composed of a plurality of dots is inserted into the two-dimensional code 220 . As shown in the figure shown in FIG. 2, this digital code is composed of yellow dots, so when contrasted with the white background, the color contrast is not clear, so it is difficult to clearly observe with the naked eye, but the electronic terminal In that the camera can perform the identification of the yellow dot differently from the human eye, the pattern of the yellow dot can be clearly identified through the electronic terminal. Accordingly, when 'real-time image data 1' is reproduced in the image reproduction terminal 131, the viewer 130 recognizes the two-dimensional code 220 using a predetermined mobile terminal 132 possessed by the viewer 130. , the mobile terminal 132 may identify the information included in the two-dimensional code 220 by identifying the pattern of yellow dots.

According to an embodiment of the present invention, the live streaming server 110 may further include an auxiliary identification number extraction unit 115 , a token verification unit 116 and a content transmission unit 117 .

The auxiliary identification number extraction unit 115 holds the two-dimensional code inserted in the subtitle display area of the real-time image displayed as the real-time image data is reproduced by the viewer 130 in the image reproduction terminal 131, and Due to being scanned and recognized by the mobile terminal 132, the first main identification number and data for the first authentication token included in the two-dimensional code are received from the mobile terminal 132, the second When a content data inquiry request based on the first primary identification number and the first authentication token is received, a secondary identification number stored corresponding to the same authentication token as the first authentication token is extracted from the content storage.

The token confirmation unit 116 is an auxiliary identification number stored in correspondence with the same authentication token as the first authentication token from the content storage by the auxiliary identification number extraction unit 115, and when the first auxiliary identification number is extracted , the calculation result calculated when the first auxiliary identification number extracted from the content storage and the first main identification number received from the mobile terminal 132 are applied as inputs to the token generation function is the first authentication token Check whether this is

When it is confirmed by the token confirmation unit 116 that the calculation result is the first authentication token, the content transmission unit 117 is configured to store the first content stored in correspondence with the first auxiliary identification number from the content storage. After data is extracted, the first content data is transmitted to the mobile terminal 132 .

Hereinafter, operations of the auxiliary identification number extraction unit 115 , the token verification unit 116 , and the content transmission unit 117 will be described in detail, for example.

First, according to the above-described example, as the real-time image data is reproduced in the image reproduction terminal 131, the two-dimensional code 220 inserted into the caption display area 210 of the real-time image as shown in FIG. 2 . ) is being displayed on the screen 200, and it is assumed that the two-dimensional code 220 is scanned and recognized by the mobile terminal 132 possessed by the viewer 130.

In relation, according to the above-described example, since the two-dimensional code 220 includes data for '123', which is the first main identification number, and '42', which is the first authentication token, the mobile terminal 132 is From the two-dimensional code 220, data for '123', which is the first main identification number, and '42', which is the first authentication token, may be extracted.

Then, the mobile terminal 132 transmits the data for the first main identification number '123' and the first authentication token '42' to the live streaming server 110, the first main identification number and A content data inquiry request based on the first authentication token may be transmitted.

Accordingly, in the live streaming server 110, while receiving the data for the first main identification number '123' and the first authentication token '42', when the content data inquiry request is received, the auxiliary identification number The extraction unit 115 may extract an auxiliary identification number stored in correspondence with the same authentication token as '42', which is the first authentication token, from the content storage as shown in Table 1 above.

In relation to this, since the auxiliary identification number stored in correspondence with the authentication token identical to '42' in the content storage as shown in Table 1 is '4567', the auxiliary identification number extracting unit 115 provides the contents as shown in Table 1 above. You can extract '4567' from the repository.

Then, the token confirmation unit 116 applies '4567' extracted from the content storage as shown in Table 1 and '123', which is the first main identification number received from the mobile terminal 132, as inputs to the token generation function. It can be checked whether the calculated result calculated when the '42' is the first authentication token.

As a result, when it is confirmed that the calculation result is '42', the content transmission unit 117 stores the '4567' stored in correspondence with the first auxiliary identification number '4567' from the content storage as shown in Table 1 above. After extracting content data 1', 'content data 1' may be transmitted to the mobile terminal 132 .

At this time, according to an embodiment of the present invention, the content transmission unit 117 is configured to encrypt the first content data and transmit it to the image reproduction terminal 131 , and the content encryption unit 118 and the transmission processing unit 119 . ) may be included.

When the content encryption unit 118 determines that the calculation result is the first authentication token by the token confirmation unit 116, the first content stored in correspondence with the first auxiliary identification number from the content storage After extracting data and randomly generating an encryption key for encrypting the first content data, the first content data is encrypted with the encryption key.

When the first content data is encrypted by the content encryption unit 118 , the transmission processing unit 119 transmits the encrypted first content data to the mobile terminal 132 and, at the same time, to the video playback terminal 131 . , transmits an exposure command instructing to expose the encryption key on the screen on which the real-time image is displayed.

Hereinafter, the operations of the content encryption unit 118 and the transmission processing unit 119 will be described in detail using an example.

First, as in the above-described example, it is assumed that the calculation result is confirmed to be '42', which is the first authentication token, by the token confirmation unit 116 .

Then, the content encryption unit 118 may extract 'content data 1' stored corresponding to '4567', which is the first auxiliary identification number, from the content storage as shown in Table 1, and 'content data 1' You can randomly generate an encryption key for encrypting .

In this case, when the encryption key is referred to as 'encryption key 1', the content encryption unit 118 may encrypt 'content data 1' with 'encryption key 1'.

Then, the transmission processing unit 119 transmits the encrypted 'content data 1' to the mobile terminal 132 and, at the same time, to the image reproduction terminal 131, 'encryption key 1' on the screen on which the real-time image is displayed. You can send an exposure command instructing to expose '.

At this time, when the exposure command is received from the live streaming server 110 , the image reproduction terminal 131 may expose 'encryption key 1' on the screen on which the real-time image is displayed in response to the exposure command. .

At this time, according to an embodiment of the present invention, the mobile terminal 132 receives the encrypted first content data from the live streaming server 110 , for the viewer 130 , After displaying an input guide message instructing to input the encryption key, which is exposed through the screen on which the real-time image is displayed, to the mobile terminal 132 , the encryption key is transmitted to the mobile terminal 132 by the viewer 130 . When input to , the first content data encrypted with the encryption key may be decrypted and displayed on the screen.

For example, as in the above example, as the transmission processing unit 119 transmits the encrypted 'content data 1' to the mobile terminal 132 , it is assumed that the encrypted 'content data 1' is received by the mobile terminal 132 . lets do it.

Then, the mobile terminal 132 instructs the viewer 130 to input 'encryption key 1' exposed through the screen on which the real-time image of the video reproduction terminal 131 is displayed to the mobile terminal 132 . You can display an input guide message that says

In this regard, according to the above-described example, since 'encryption key 1' is exposed on the screen on which the real-time image of the image reproducing terminal 131 is displayed, the viewer 130 can display the real-time image of the image reproducing terminal 131 in the real time. After checking the 'encryption key 1' through the screen on which the image is displayed, the 'encryption key 1' may be input into the mobile terminal 132 according to the input guide message.

At this time, according to the above example, since the encrypted 'content data 1' is data generated by encrypting the 'content data 1' by the content encryption unit 118 with the 'encryption key 1', the mobile terminal 132 is With the 'encryption key 1', the encrypted 'content data 1' can be decrypted and displayed on the screen.

3 is a flowchart illustrating an operation method of a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention.

In step S310, when a processing request for instructing to include inquiry information for inquiring the first content data in a real-time image is received from the image transmitting terminal of the image transmitter while the first content data is received, the inquiry A primary identification number of n (n is a natural number greater than or equal to 2) digit number for use as information and an auxiliary identification number of k (k is a natural number greater than or equal to 2) digit number are randomly generated.

In step S320, a first main identification number is generated as the main identification number, and when a first auxiliary identification number is generated as the auxiliary identification number, in a preset token generating function for generating an authentication token, the first main identification number is A first authentication token is calculated by applying the identification number and the first auxiliary identification number as inputs.

In step S330, when the first authentication token is calculated, the first authentication token and the first auxiliary identification number are stored in a content storage in correspondence with the first content data, and the first main identification number and the A two-dimensional code including data for the first authentication token is generated.

In step S340, after the two-dimensional code is generated, when real-time image data that is a target of live streaming is received from the image transmitting terminal, voice recognition for the real-time image data is performed through a pre-built voice recognition model. After generating a caption by performing a method, inserting the caption and the two-dimensional code into a preset caption display area of the real-time image data, and then displaying the real-time image data into which the caption and the two-dimensional code are inserted into the viewer's image transmitted to the playback terminal.

At this time, according to an embodiment of the present invention, when the first main identification number and the first auxiliary identification number are applied as inputs, the token generation function uses n numbers constituting the first main identification number as components. After generating an arithmetic matrix having a size of n x k by calculating the Kronecker product between an n-dimensional column vector having an n-dimensional column vector and a k-dimensional row vector having k numbers constituting the first auxiliary identification number as components, It may be a function for calculating the Euclidean norm as the first authentication token.

In addition, according to an embodiment of the present invention, when the real-time image data is received from the live streaming server, the image reproduction terminal reproduces the real-time image data to display the real-time image on the screen, and at the same time, the caption The subtitle and the 2D code may be displayed on the display area.

In addition, according to an embodiment of the present invention, in the method of operating the live streaming server, the two-dimensional code inserted into the subtitle display area of the real-time image displayed as the real-time image data is reproduced in the image reproduction terminal is , As data for the first main identification number and the first authentication token included in the two-dimensional code is received from the mobile terminal by being scanned and recognized by the mobile terminal held by the viewer, the When a content data inquiry request is received based on a first primary identification number and the first authentication token, extracting a secondary identification number stored in correspondence with the same authentication token as the first authentication token from the content storage, the content As an auxiliary identification number stored in correspondence with the same authentication token as the first authentication token from the storage, when the first auxiliary identification number is extracted, the first auxiliary identification number extracted from the content storage and received from the mobile terminal Checking whether the calculation result calculated when the first main identification number is applied as an input to the token generation function becomes the first authentication token, and confirming that the calculation result becomes the first authentication token The method may further include extracting the first content data stored in correspondence with the first auxiliary identification number from the content storage, and then transmitting the first content data to the mobile terminal.

In this case, in the step of transmitting the first content data to the mobile terminal, if it is confirmed that the calculation result becomes the first authentication token, the first stored in correspondence with the first auxiliary identification number from the content storage After extracting content data and randomly generating an encryption key for encrypting the first content data, encrypting the first content data with the encryption key, and when the first content data is encrypted, to the mobile terminal , transmitting the encrypted first content data and simultaneously transmitting, to the video reproducing terminal, an exposure command instructing to expose the encryption key on a screen on which the real-time video is displayed. .

At this time, when the encrypted first content data is received from the live streaming server, the mobile terminal transmits the encryption key, which is exposed through a screen on which the real-time image of the image reproduction terminal is displayed, to the viewer. After displaying an input guide message instructing the mobile terminal to input, when the encryption key is input to the mobile terminal by the viewer, the first content data encrypted with the encryption key is decrypted and displayed on the screen. can

The operating method of the live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention has been described with reference to FIG. 3 . Here, the operating method of the live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention is the live streaming server 110 described with reference to FIGS. 1 and 2 . Since it may correspond to the configuration of the operation of , a more detailed description thereof will be omitted.

The operating method of a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention is implemented as a computer program stored in a storage medium for execution through combination with a computer can be

In addition, the operating method of the live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image according to an embodiment of the present invention is implemented in the form of a program command that can be executed through various computer means. It may be recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, in the present invention, specific matters such as specific components, etc., and limited embodiments and drawings have been described, but these are only provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , various modifications and variations are possible from these descriptions by those of ordinary skill in the art to which the present invention pertains.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and not only the claims described below, but also all those with equivalent or equivalent modifications to the claims will be said to belong to the scope of the spirit of the present invention. .

110: a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time video
111: identification number generation unit 112: authentication token calculation unit
113: code generation unit 114: data transmission unit
115: auxiliary identification number extraction unit 116: token verification unit
117: content transmission unit 118: content encryption unit
119: transmission processing unit
120: video transmitter
121: video transmission terminal
130: viewers
131: video playback terminal
132: mobile terminal

Claims (12)

A live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image,
When a processing request instructing to include inquiry information for inquiring the first content data in a real-time video while receiving the first content data from the image transmitting terminal of the image sender is received, to be used as the inquiry information an identification number generator for randomly generating a main identification number of n (n is a natural number of 2 or more) digits and a secondary identification number of k (k is a natural number of 2 or more) digits;
When a first main identification number is generated as the main identification number, and a first auxiliary identification number is generated as the auxiliary identification number, in a preset token generation function for generating an authentication token, the first main identification number and the second identification number are generated. 1 An authentication token calculation unit for calculating a first authentication token by applying an auxiliary identification number as an input;
When the first authentication token is calculated, the first authentication token and the first auxiliary identification number are stored in a content storage in correspondence with the first content data, and the first main identification number and the first authentication token are stored in the content storage. a code generator for generating a two-dimensional code including data for and
After the two-dimensional code is generated, when real-time video data, which is the target of live streaming, is received from the video transmission terminal, the caption is generated by performing speech recognition on the real-time video data through a pre-built speech recognition model. generating, inserting the subtitle and the two-dimensional code in a preset subtitle display area of the real-time image data, and then transmitting the real-time image data into which the subtitle and the two-dimensional code are inserted to a video reproducing terminal of a viewer data transmission unit
A live streaming server that includes. According to claim 1,
The token generation function is
When the first main identification number and the first auxiliary identification number are applied as inputs, an n-dimensional column vector having n numbers constituting the first main identification number as a component, and the first auxiliary identification number are configured After generating an arithmetic matrix having a size of nxk by calculating a Kronecker product between k-dimensional row vectors having k numbers as components, the Euclidean norm of the arithmetic matrix is first authenticated A live streaming server, characterized in that it is a function that calculates in tokens. According to claim 1,
The video playback terminal
When the real-time image data is received from the live streaming server, the real-time image data is reproduced to display the real-time image on the screen, and the subtitle and the two-dimensional code are displayed in the subtitle display area. live streaming server. According to claim 1,
In the video reproduction terminal, the two-dimensional code inserted in the caption display area of the real-time video displayed as the real-time video data is reproduced is scanned and recognized by the mobile terminal owned by the viewer, so that the mobile While the data for the first main identification number and the first authentication token included in the two-dimensional code are received from the terminal, a content data inquiry request based on the first main identification number and the first authentication token is received an auxiliary identification number extraction unit for extracting an auxiliary identification number stored in correspondence with the same authentication token as the first authentication token from the content storage;
As an auxiliary identification number stored in correspondence with the same authentication token as the first authentication token from the content storage, when the first auxiliary identification number is extracted, the first auxiliary identification number extracted from the content storage and the mobile terminal a token confirmation unit that confirms whether the calculation result calculated when the first main identification number received from the input is applied to the token generation function is the first authentication token; and
When it is confirmed that the calculation result becomes the first authentication token, the first content data stored in correspondence with the first auxiliary identification number is extracted from the content storage, and then the first content data is transferred to the mobile terminal. content transmission unit
A live streaming server further comprising a. 5. The method of claim 4,
The content transmission unit
When it is confirmed that the calculation result becomes the first authentication token, the first content data stored in correspondence with the first auxiliary identification number is extracted from the content storage, and encryption for encrypting the first content data a content encryption unit that randomly generates a key and then encrypts the first content data with the encryption key; and
When the first content data is encrypted, the encrypted first content data is transmitted to the mobile terminal and, at the same time, the video reproduction terminal is instructed to expose the encryption key on the screen on which the real-time image is displayed. Transmission processing unit that transmits an exposure command to indicate
including,
The mobile terminal is
When the encrypted first content data is received from the live streaming server, the viewer is instructed to input the encryption key exposed through the screen on which the real-time image of the video reproducing terminal is displayed to the mobile terminal. After displaying an input guide message instructing, when the encryption key is input to the mobile terminal by the viewer, the encrypted first content data is decrypted with the encryption key and displayed on the screen. server. A method of operating a live streaming server capable of inserting a two-dimensional code used for inquiring content data into a real-time image,
When a processing request instructing to include inquiry information for inquiring the first content data in a real-time video while receiving the first content data from the image transmitting terminal of the image sender is received, to be used as the inquiry information Randomly generating a primary identification number of n (n is a natural number of 2 or more) digits and a secondary identification number of k (k is a natural number of 2 or more) digits;
When a first main identification number is generated as the main identification number, and a first auxiliary identification number is generated as the auxiliary identification number, in a preset token generation function for generating an authentication token, the first main identification number and the second identification number are generated. 1 applying an auxiliary identification number as an input to calculate a first authentication token;
When the first authentication token is calculated, the first authentication token and the first auxiliary identification number are stored in a content storage in correspondence with the first content data, and the first main identification number and the first authentication token are stored in the content storage. generating a two-dimensional code including data for and
After the two-dimensional code is generated, when real-time video data, which is the target of live streaming, is received from the video transmission terminal, the caption is generated by performing speech recognition on the real-time video data through a pre-built speech recognition model. generating, inserting the subtitle and the two-dimensional code in a preset subtitle display area of the real-time image data, and then transmitting the real-time image data into which the subtitle and the two-dimensional code are inserted to a video reproducing terminal of a viewer step
A method of operation of a live streaming server comprising a. 7. The method of claim 6,
The token generation function is
When the first main identification number and the first auxiliary identification number are applied as inputs, an n-dimensional column vector having n numbers constituting the first main identification number as a component, and the first auxiliary identification number are configured After generating an arithmetic matrix having a size of nxk by calculating a Kronecker product between k-dimensional row vectors having k numbers as components, the Euclidean norm of the arithmetic matrix is first authenticated A method of operating a live streaming server, characterized in that it is a function that is calculated as a token. 7. The method of claim 6,
The video playback terminal
When the real-time image data is received from the live streaming server, the real-time image data is reproduced to display the real-time image on the screen, and the subtitle and the two-dimensional code are displayed in the subtitle display area. How a live streaming server works. 7. The method of claim 6,
In the video reproduction terminal, the two-dimensional code inserted in the caption display area of the real-time video displayed as the real-time video data is reproduced is scanned and recognized by the mobile terminal owned by the viewer, so that the mobile While the data for the first main identification number and the first authentication token included in the two-dimensional code are received from the terminal, a content data inquiry request based on the first main identification number and the first authentication token is received if it is, extracting an auxiliary identification number stored in correspondence with the same authentication token as the first authentication token from the content storage;
As an auxiliary identification number stored in correspondence with the same authentication token as the first authentication token from the content storage, when the first auxiliary identification number is extracted, the first auxiliary identification number extracted from the content storage and the mobile terminal confirming whether a calculation result calculated when the first main identification number received from the token generation function is applied as an input to the token generation function is the first authentication token; and
When it is confirmed that the calculation result becomes the first authentication token, the first content data stored in correspondence with the first auxiliary identification number is extracted from the content storage, and then the first content data is transferred to the mobile terminal. Steps to send
The method of operation of a live streaming server further comprising a. 10. The method of claim 9,
Transmitting the first content data to the mobile terminal
When it is confirmed that the calculation result becomes the first authentication token, the first content data stored in correspondence with the first auxiliary identification number is extracted from the content storage, and encryption for encrypting the first content data after randomly generating a key, encrypting the first content data with the encryption key; and
When the first content data is encrypted, the encrypted first content data is transmitted to the mobile terminal and, at the same time, the video reproduction terminal is instructed to expose the encryption key on the screen on which the real-time image is displayed. Sending an exposure command to direct
including,
The mobile terminal is
When the encrypted first content data is received from the live streaming server, the viewer is instructed to input the encryption key exposed through the screen on which the real-time image of the video reproducing terminal is displayed to the mobile terminal. After displaying an input guide message instructing, when the encryption key is input to the mobile terminal by the viewer, the encrypted first content data is decrypted with the encryption key and displayed on the screen. How the server works. A computer-readable recording medium recording a computer program for executing the method of any one of claims 6 to 10 through combination with a computer. A computer program stored in a storage medium for executing the method of any one of claims 6 to 10 through combination with a computer.

Images