KR101914661B1 - Additional information display system for real-time broadcasting service through automatic recognition of object of video object - Google Patents

Abstract

The present invention relates to an additional information display system for a real-time broadcasting service using automatic recognition of an object of a video comprising: an information suitability determination unit to receive information classified by an information classification unit for acquiring information from a video acquired from a photographing means to determine information suitability in accordance with a type and an environment of the classified information for identification as information meaningfully usable in a real-time broadcasting environment and additional information output; a database unit to store data for a plurality of pieces of additional information connected to the classified information; and an output information selection unit to receive classified information which is determined to have suitability by the information suitability determination unit, and related information for currently displayed additional information to determine a recognition range of a viewer and types of additional information which can be displayed in a broadcast, and select a type of additional information with a real-time expression having suitability for a current video among the determined types of additional information in the database stored in the database unit to supply selected additional information and information on an output condition thereof to an additional information output unit to allow the additional information output unit to superimpose the selected additional information on a video of a real-time broadcast while satisfying the output conditions. According to the present invention, additional information such as captions, effects, and sounds can be outputted to be transmitted or stored without separate additional equipment or experts in video production and a real-time broadcast to reduce costs for video production and real-time broadcast production.

Description

[0001] The present invention relates to an additional information display system for real-time broadcasting service through automatic recognition of an object of a video object,

The present invention relates to a system for displaying additional information for a real-time broadcast service, and more particularly, to a system and method for automatically displaying a content of a broadcast content, And an additional information display system for real time broadcasting service through a recognition function.

With the rapid growth of the electronic information industry today, the number of Internet users has greatly increased owing to the development of various multimedia technologies and the commercialization of information. In addition to broadcasting through existing airwaves and cables, broadcasting A broadcasting service is provided.

In order to enhance the competitiveness of the broadcasting service in the environment where the various broadcasting services are provided and to increase the meaning of the broadcasting or the information transmission power, additional information such as subtitles, effects and sounds are displayed in the real- To do this, we need a computer graphic device, a keyboard, etc., and a skilled input person who uses it. It is necessary to manually input the information to be transmitted together with the image, check the reflection thereof, Do.

In the related art, Korean Patent Laid-Open No. 10-2007-0009891 entitled " Real-Time Broadcast Subtitle Input and Transmission System "has been proposed. In order to input broadcast subtitles in real time, It is a system that enables subtitles to be input and transmitted to a real-time broadcasting service through a device, a media file, and a modification process.

However, in order to grasp the subject and the contents appearing on the broadcast, at least two skilled human experts are required and manually input through a device such as a keyboard, and only the character caption information of the designated form is added I had an inconvenience to do.

As another conventional technique, Korean Patent Registration No. 10-0828166 entitled " METHOD FOR EXTRACTION METHOD USING VOICE RECOGNITION AND Caption Recognition of Moving Picture, Moving Image Searching Method Using Metadata, and Recording Medium Recorded Thereof " It is a system to record the contents and the exposure time information as metadata and to improve the contents retrieval and management convenience of the video contents. By using the technology, all the information of the video object is transformed into the character and recorded, thereby improving the convenience of management.

However, this conventional technique has a problem that it takes a lot of time to perform system operation for collecting / modifying / storing data, and can only be applied to video images that have already been recorded.

As another conventional technique, Korean Patent No. 10-0886489 "A method and system for synthesizing a decorating effect according to a facial expression during a video call" has been proposed. This is because the template and the decorating effect image And automatically synthesizes and provides a user's face and a decorating effect image according to the user's facial expression of the digital device by referring to the facial expression template DB stored so as to correspond.

However, this conventional technique has a problem that it is difficult to expand the application because the use range is restricted to the video call.

In order to solve the problems of the related art as described above, the present invention provides a function of automatically grasping the contents of broadcast contents in a system and outputting additional information such as appropriate subtitles, sound effects, etc. to a screen or audio, It is possible to easily provide supplementary information even without preparing a manpower or a separate apparatus, and to automatically input and transmit interaction contents using various images and subject tracking techniques in addition to characters and sound effects, It is possible not only to record additional information immediately on broadcasts and video objects photographed in real time but also to process all information based on character data and analyze information such as text, Real-time classification by category In the technique of synthesizing the effect of decorating the template in real time by recognizing the facial expression information by tracking the user's face spot recognition, real-time interaction effect between the displayed effect and the user and interaction effect And to provide content such as a game utilizing the same.

Other objects of the present invention will become readily apparent from the following description of the embodiments.

According to an aspect of the present invention, there is provided an information processing apparatus for receiving information distinguished by an information classification unit for acquiring information from a video object obtained from a photographing unit, An information suitability judging unit for judging information suitability according to the type and environment of the discriminated information for identification as information and output of additional information; A database for storing a database of a plurality of pieces of additional information connected to the classified information; And information related to the additional information currently being displayed and the classified information determined to be conformable by the information suitability determining unit, determines the type of additional information that can be displayed on the broadcast and the perceived range of the viewer, Selecting from the database stored in the database unit the type of the additional information whose real-time representation is suitable for the current video among the types of the additional information, and providing information on the output condition thereof to the additional information output unit together with the selected additional information, And an output information selection unit for allowing the additional information output unit to synthesize the selected additional information to the video material of the real-time broadcasting while satisfying the output condition, wherein the additional information display system for real- do.

Extracting a face from the video image photographed by the photographing means by the face extracting unit, extracting the voice by the audio extracting unit, extracting the action by the action extracting unit, extracting the trademark by the label extracting unit, The information classification unit may further include an information classification unit for providing a face, a voice, an action, a trademark, and a character or an image to the information suitability determination unit as the divided information by extracting a character or an image by the image extraction unit .

The information suitability determining unit considers that the additional information is displayed on the screen for a predetermined period of time or output audio by the perceived time considering display unit in order to output identification and additional information as information that can be used in a real time broadcasting environment, Considering that the additional information is displayed within a predetermined time after the metabolism, gesture or trademark is exposed by the display unit, the information amount consideration display unit considers the position and size of the additional information to be displayed so as not to overlap with the object of the video object or to interfere with each other The consideration of the background sound of the video object and the effect sound of the additional information are not overlapped with each other, and it is considered by the recognizable consideration display section that the object image and the sound are separated and displayed in units of analyzing the video object. Can be processed within the cognitive range In consideration of the efficiency of data, weights are assigned to the type, processing speed, size, holding time, and category of additional information to determine information suitability according to the type and environment of the classified information, The priority information of the additional information to be displayed on the screen is determined and the remaining time and priority information of the currently outputted information are determined in real time to constitute a timeline, the additional information use history of the user is recorded, By storing the additional information list value on a user-by-user basis, preference information on the additional information list information can be reflected.

The database unit may include an output database unit for storing a unique ID, an output position, an output duration, an information amount, an output type, and a set status of the output as the additional information; A store database unit for storing the goods of the additional information corresponding to the fee purchased by the customer and the set information thereof; And a customer database unit for storing the customer information, purchase history, possession product, and usage period, and the information suitability determining unit determines whether or not the identification information provided by the customer or the identification provided by the client system operated by the customer Information on the additional information that the customer can purchase and use in the customer database unit from the information, and judges not only the free supplementary information but also the retrieved paid supplementary information when determining the information suitability.

The additional information provided from the output information selection unit applied to the subject of the video object is modified in real time by applying physical values to the direction or effect of the motion of the subject or the effect of the motion of another subject, And an additional information output unit for recognizing a specific part and realizing data in real time to use the additional effect.

The user may further record the use history of the additional information and measure the preference based on the frequency of use for each additional information, record the frequency of use of the paid function of the customer, and calculate the usage frequency for the advertisement event.

According to the additional information display system for real-time broadcasting service through the automatic recognition of the object of the video image according to the present invention, additional information such as subtitles, effects and sounds can be output without any additional equipment or expert personnel It is possible to reduce the cost for production of video material and real time broadcasting, and also to improve the quality and meaning transference even in the case of Internet broadcasts not produced by professional broadcasters.

FIG. 1 is a block diagram illustrating a system for displaying additional information for real-time broadcasting service through automatic recognition of a subject of a video according to an embodiment of the present invention.
2 is a view for explaining an interaction of a system for displaying additional information for a real time broadcasting service through a function of automatically recognizing a subject of a video according to an embodiment of the present invention.
3 is a block diagram illustrating a database unit of a system for displaying additional information for a real-time broadcast service through automatic recognition of a subject of a video according to an embodiment of the present invention.
4 to 8 illustrate an image of a video image having additional information displayed by a system for displaying real time broadcast service additional information through automatic recognition of a video object according to an embodiment of the present invention.

The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated and described in detail in the drawings. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but is to be understood to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention, And the scope of the present invention is not limited to the following examples.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings, wherein like or corresponding elements are denoted by the same reference numerals, and redundant explanations thereof will be omitted.

FIG. 1 is a block diagram illustrating a system for displaying additional information for real-time broadcasting service through automatic recognition of a subject of a video according to an embodiment of the present invention.

Referring to FIG. 1, an additional information display system 100 for real-time broadcasting service through automatic recognition of a subject of a video object according to an embodiment of the present invention includes an information suitability determining unit 120, a database unit 130, And a selection unit 140.

The information suitability determining unit 120 receives the information classified by the information classifying unit 110 that obtains information from the video image obtained from the photographing unit 170 and determines the information as the information that can be used in a real- The information suitability is judged according to the type and environment of the classified information for the additional information output.

In order to output identification information and additional information as information that can be used in a real-time broadcasting environment, the information suitability determining unit 120 is largely applied to two criteria, namely, a viewer's perception range and a technically processable range. Considering the processing within the perceptible time of the viewer, considering the display within the amount of perceptible reference data of the viewer, considering the display within the perceivable speed and effect of the viewer, The suitability of the information classified by the information classification unit 110 may be determined through a significant usability of the additional information connected thereto. More specifically, the information suitability determining unit 120 may consider that the additional information is displayed on the screen or output audio for a predetermined time, for example, at least one second, by the perceived time considering display unit 121, Gesture or trademark is exposed, the additional information may be displayed within a predetermined period of time, for example, within a maximum of 3 seconds, and the information amount consideration display unit 123 may display the information on the basis of the position and size of the additional information, The background sound of the video and the sound of the additional information do not overlap with each other, and the recognizable consideration display unit 124 separates the image and sound of the object in the video object into units And the processing time considering display section 125 displays the processing time in the viewer's perception range Li can take into account the efficiency of the available data.

The information suitability determining unit 120 assigns weights to the type, processing speed, size, holding time, and category of the additional information to determine information suitability according to the type and environment of the classified information, Determines the priority of the additional information to be displayed on the screen, determines the remaining time and priority information of the currently outputted information in real time to construct a time line (metadata), records the additional information usage details of the user , And the frequently used additional information list value is stored in the database unit 130 for each user, so that the efficiency of the information processing can be improved by reflecting the preference information. The conformity determination and information display order by the information suitability determining unit 120 is such that the displayed information and the newly displayed information are transmitted, the additional information usable for the displayed information is selected, and the weight of the selected additional information Determines a priority order, and transmits the information list, which is recognizable by the viewer, to the client system in consideration of the information displayed on the current video object, thereby outputting the additional information to the video object. In addition, the priority among the supplementary information connected to each of the plurality of pieces of information on the video object can be determined by weight. For example, the supplementary supplementary information has priority over the supplementary supplementary information, the Korean subtitle has priority over the foreign language subtitle, The higher priority is given to the larger one in the range and the higher the degree of similarity is given priority when the degree of similarity or similarity between the divided information of the video and the additional information is expressed in numerical value or percentage. Alternatively, the information suitability determining unit 120 may limit the amount of additional information such as an image or a video to a predetermined range, for example, not exceeding 70%. In case of additional information corresponding to music, 10 seconds, for example, about 5 seconds.

Referring to FIG. 3, the database unit 130 stores a database of a plurality of additional information connected to the classified information. The database unit 130 includes an output database 131 for storing a unique ID, an output position, an output duration, an amount of information, an output type, and whether or not the output is a supplementary information; A store database 132 storing merchandise of the additional information and the set information thereof, and a customer database 133 storing the customer's information, the purchase history, the merchandise, and the usage period. In this way, the database unit 130 can design the output product, the store, and the customer data in a multiplex structure to improve efficiency and reliability.

The information suitability determining unit 120 searches the customer database 133 for products corresponding to the additional information that the customer can purchase by using the identification information provided by the customer or the identification information provided by the client system operated by the customer , It is possible to judge not only the free additional information but also the retrieved paid supplementary information when determining the information suitability. The unique ID is a unique identification ID of each additional information, and is used for identification and tracking. The type of information is a record of what information corresponds to face, voice, motion, text, image, and trademark. The output type includes information on the type of information to be displayed on the screen, subtitle, effect, sound, image, advertisement, and other functions such as face detection. The output position and output duration are the duration (possible) time of the output, the position information possible value and the attribute. Whether or not the set information indicates whether a plurality of pieces of additional information are bundled together so as to have an association or the same concept, and can be purchased or used together. The store database unit 132 stores, as information, goods handling store information, which is an item from which additional information can be purchased, information on products, a unique ID of the output item included in the set item in the case of a set, The customer database unit 133 records customer setting information and frequency of use as well as a database of customer information, a customer's unique ID, purchasing history, possession and useable products, remaining service life of the product, .

Here, the client system passes through the information suitability determining process of the information suitability determining unit 120 corresponding to the present system, and selects the additional information selected from the output information selecting unit 140 to the photographing unit 170 according to the proper position and time of the screen. The system for providing a real-time broadcasting or a real-time image in which real-time broadcasting or real-time image is provided in addition to real-time images obtained by the image-taking means (170) An information classification unit 110 for providing face information, voice, action, trademark, and character or image as divided information to the information suitability determining unit 120; And an additional information output unit 150 for allowing the user to use the video camera. An output control unit 181 for synthesizing the supplementary information provided by the supplementary information output unit 150 to the video image photographed by the image pickup means 170 and providing the synthesized supplementary information in real time broadcasting, An input unit 184 for inputting commands and information required for the control, and a display unit 182 for displaying video images output by the output control unit 181 in real time. Further, the system 100 according to the present invention may be configured to be connected to receive and transmit information by communication with the client system via the communication unit 183, for example, as in the present embodiment, or as another example, As another example, or separately from the client system, but may be configured to be connected to exchange information through a cable.

Various communication methods including 3G, LTE, and Wi-Fi may be applied to the communication unit 183 in which the client system is additionally provided for communication with the system 100 according to the present invention, as in the present embodiment. Meanwhile, the information classifying unit 110 and the additional information outputting unit 150, which will be described later, may be configured to be located in the system 100 according to the present invention. However, considering the efficiency thereof, The information classification unit 110 and the additional information output unit 150 are connected to the outside of the client system by the communication unit 183 Not only enables the information suitability determining unit 120 and the output information selecting unit 140 to transmit and receive information and signals but also plays a role of transmitting video images by the output control unit 181 in real time broadcasting . Here, the photographing means 170 includes a camera 171 for acquiring video, a microphone 172 for inputting audio, and a sensor 173 for sensing the surrounding environment. As the sensor 173, for example, a depth sensor may be used. The depth sensor includes a CMOS sensor and an infrared laser beam projector. When the infrared laser beam is irradiated, the reflected laser beam point is received by the CMOS sensor, The distance is measured and the subject can be recognized by the processing of these data. In addition, the client system may be provided with a speaker (not shown) for outputting audio, or may be provided separately or integrally with the display unit 182.

2, in the client system, the additional information output unit 150 and the output control unit 181 are configured to enable the effect of the additional information exposed on the screen and the interaction of the subject by the display unit 182 or real- (Effects A and B) are applied to the subject (subjects A and B) through real-time rendering, physical application, world coordinates, and the like, unlike the conventional method of outputting additional information to a specific position The effect of the additional information (effect C) can be modified in a variety of ways, such as a single gravity or a physical value such as gravity, Or a specific value of a screen such as a face of a subject can be recognized and used as additional information by realizing data in real time.

1, the output information selection unit 140 receives the divided information determined to be conformable by the information suitability determining unit 120 and the related information about the currently displayed additional information, The type of additional information that can be displayed on the broadcast and the type of additional information whose real-time representation is suitable for the current video among the determined types of additional information is selected from the database stored in the database unit 130, Information on the output condition thereof is supplied to the additional information output unit 150 so that the additional information output unit 150 can synthesize the selected additional information so as to be exposed for a suitable position and time in the video material of the real- . Here, the related information on the currently displayed additional information may include a list of currently displayed additional information, a remaining exposure time, a weight in the screen, and a processing buffer. Further, the type of additional information having relevance may mean image, audio, screen weight, file size, processing speed, and the like. The information on the output condition may mean output time, screen weight, size, and the like.

The additional information display system 100 for real-time broadcast service through automatic recognition of a subject of a video object according to an embodiment of the present invention extracts a face from a video image photographed by the photographing means 170 by the face extracting unit 111 , The audio extracting unit 112 extracts the audio, the operation extracting unit 113 extracts the operation, the trademark extracting unit 114 extracts the trademark, and the character / image extracting unit 115 extracts The information classification unit 110 may further include a facial feature, a voice, an action, a trademark, and a character or an image to the information suitability judging unit 120 as separated information, by extracting a character or an image. The information classification unit 110 recognizes a subject such as an individual or a plurality of people, objects, images, audio, and background appearing in a video object, divides the information of the corresponding object into stages, The information is not directly transmitted to the information suitability determining unit 120 but the information is first classified in the client system and transmitted to the information suitability determining unit 120 of the system 100 of the present invention. And classify them according to the kind of information.

In the case of a type of information, when the subject is a person by the facial extracting unit 111 applying an image processing technique for extracting a specific image from the facial image, the facial position is determined and the facial main point By tracking the location information and the changing path. The voice can be obtained by determining whether music, a specific language, a word, or a sentence by the audio extracting unit 112 using a process technique of collecting audio signals from the video and converting the voice into text. The operation can be obtained by determining whether the specific type or gesture included in the database and the contents thereof are determined by the operation extracting unit 113 using the image process technique for recognizing the motion of the moving subject. A brand and a product together with a trademark by a trademark extracting unit 114 to which an image process technique for extracting a specific trademark, a brand, and a product stored in the database unit 130 from the image is applied. A character or an image can be obtained by analyzing a character image image by a character / image extracting unit 115 applying a process technique for extracting and converting text from an image process technique and judging whether it is a character or a QR code or an image have.

The additional information display system 100 for real-time broadcasting service through automatic recognition of a subject of a video object according to an embodiment of the present invention is characterized in that the additional information provided from the output information selector 140 applied to a subject of a video object is a physical value An additional information output unit 150 for modifying a direction or an effect output in response to motion of the subject or motion of another subject in real time and recognizing a specific part of the subject and realizing data in real time to use the additional effect, As shown in FIG.

In addition, according to an embodiment of the present invention, a system for displaying additional information for a real-time broadcast service 100 through a function of automatically recognizing a subject of a video object records the use history of additional information of a customer, A statistical calculation unit 160 for calculating the usage frequency of the fee-for-use function of the customer, and the frequency of use for the advertisement event. The statistical calculation unit 160 records the use history of customer's additional information and measures the preference based on the frequency of use of each additional information, records the frequency of use of the fee-based function, counts the usage frequency for events such as advertisements, It is possible to suggest a customized service and function reflecting user 's preference by collecting and data - use history of supplementary information such as subtitle and effect reflected in real - The number of exposures and the weight on the screen are calculated to collect data by user and effect, and the quantified data can be used as a basis for indirect advertisement.

An example in which additional information is synthesized in real time broadcasting according to the additional information display system for real time broadcasting service through the automatic recognition of the object of the video object according to the present invention will be described as follows.

As shown in FIG. 4, the audio extracting unit 112 of the information classifying unit 110 can recognize the audio of the subject and display it as a caption. For example, the audio extracting unit 112 It is recognized by extraction and displayed as a caption on the screen. At this time, the additional information is determined by the information suitability judging unit 120, and the output information selecting unit 140 selects the additional information, which is selected from the plurality of divided information, And display time.

5, when the audio extracting unit 112 of the information classifying unit 110 recognizes the audio of the subject, the audio classifying unit 110 displays the subtitle corresponding to the audio of the subject in the information classifying unit 110, the information suitability determining unit 120 ), The output information selection unit 140 and the additional information output unit 150, it is possible to recognize the foreign language and display the subtitle corresponding to the recognized language. On the other hand, when recognizing Chinese greetings as voices, a type or a method for the expression language can be selected so that the subtitles of the language corresponding to the voice are displayed by the input by the input unit 184, or the subtitles are translated into Korean have.

As shown in FIG. 6, when the trademark extracting unit 114 of the information classifying unit 110 recognizes a specific trademark expressed on a product on the screen or the like, the information suitability determining unit 120 and / The output information selecting unit 140 can display the conforming trademark for a predetermined time in a predetermined position and size. At this time, the information suitability determining unit 120 and the output information selecting unit 140 may follow a predetermined specification such that the background, subtitle, and sound output on the screen match the advertisement.

7, when the information classification unit 110 extracts the character / image extraction unit 115 and recognizes the designated color on the screen, the information suitability determination unit 120 and the additional information output unit 150 The image or image can be converted to a color designated by a predetermined chroma key technique.

As shown in FIG. 8, the face extracting unit 111 of the information classifying unit 110 recognizes the face-to-face ratio of the subject, extracts the face, synthesizes the face matching the face as additional information, It can be synthesized as additional information, and when the change in expression such as the opening of the mouth is sensed, it is possible to synthesize additional information in the meaning of yawning associated with it or to take a predetermined drink or food. Can be dynamically displayed.

According to the present invention, additional information such as caption, effect, and sound can be outputted and stored without any additional equipment or professional manpower in video production and real-time broadcasting. The cost can be reduced.

Also, according to the present invention, it is possible to expect an effect of improving quality even in the case of Internet broadcasts not produced by a professional broadcaster.

Although the present invention has been described with reference to the accompanying drawings, it is to be understood that various changes and modifications may be made without departing from the spirit and scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the scope of the appended claims and equivalents thereof.

110: information classifying unit 111: face extracting unit
112: Audio extraction unit 113: Operation extraction unit
114: trademark extracting unit 115: character / image extracting unit
120: information suitability judging unit 121:
122: plausibility consideration display section 123: information amount consideration display section
124: recognizable consideration display section 125: processing time consideration display section
130: Database part 131: Output database part
132: store database unit 133: customer database unit
140: output information selection unit 150: additional information output unit
160: statistical calculation unit 170: photographing means
171: camera 172: microphone
173: sensor 181: output control section
182: display section 183: communication section
184:

Claims (6)

The information classified by the information classifying unit for acquiring information from the video object obtained from the photographing unit is received and the information about the type and the environment of the classified information is input for identification and additional information output as information that can be used in a real- An information suitability determining unit for determining information suitability according to the information suitability;
A database for storing a database of a plurality of pieces of additional information connected to the classified information;
The information suitability determining unit receives the divided information determined to be conformable and the related information about the currently displayed additional information to determine the cognitive range of the viewer and the type of the additional information that can be displayed on the broadcast, The type of the additional information whose real-time representation is suitable for the current video is selected from the database stored in the database unit and the information about the output condition thereof is supplied to the additional information output unit together with the selected additional information, An information output unit for combining the selected additional information with a video image of a real-time broadcast while satisfying the output condition;
Extracting a face from the video image photographed by the photographing means by the face extracting unit, extracting the voice by the audio extracting unit, extracting the action by the action extracting unit, extracting the trademark by the label extracting unit, An information classifying unit for extracting a character or an image by the image extracting unit and providing the facial expression, voice, motion, trademark, and character or image to the information suitability determining unit as the distinguished information;
And an additional information display system for real time broadcasting service through automatic recognition of a subject of a video object. delete The method according to claim 1,
The information suitability determining unit may determine,
In order to identify and output additional information as information that can be used in a real-time broadcast environment, it is considered that the additional information is displayed on the screen for a predetermined time or the audio is outputted by the perceived time considering display unit, Or considering that the additional information is displayed within a predetermined time after exposing the trademark and that the information amount consideration display unit considers the position and the size of the additional information to be overlapped or not to interfere with the subject of the video image, Considering that the effect sounds of the additional information are not overlapped with each other and considering that the object image and the sound are separated and displayed in the unit of analysis by the recognizable consideration display unit, Considering the efficiency of the system, In order to judge information suitability according to the type and environment of the classified information, weights of the type, the processing speed, the size, the holding time and the category of the additional information are given respectively, and the additional information to be displayed on the screen based on the weight Determines the priority, determines the remaining time and priority information of the currently outputted information in real time to construct a timeline, records the additional information usage history of the user, and stores frequently used additional information list values by user The additional information display system for real time broadcast service through automatic recognition of the object of the video object. The method according to claim 1,
The database unit,
An output database unit for storing a unique ID, an output position, an output duration time, an information amount, an output type, and a set status of the output as the additional information;
A store database unit for storing the goods of the additional information corresponding to the fee purchased by the customer and the set information thereof; And
And a customer database unit for storing the customer information, purchase history, possession product, and usage period,
The information suitability determining unit may determine,
A customer searching for a product for the additional information purchased by the customer in the customer database unit from the identification information provided by the customer or the identification information provided by the client system operated by the customer, A supplementary information display system for real time broadcasting service through automatic recognition of a subject of a video object, which determines not only additional information but also paid supplementary information searched. The method according to claim 1,
The additional information provided from the output information selection unit applied to the subject of the video object is modified in real time by applying physical values to the direction or effect of the motion of the subject or the effect of the motion of another subject, And an additional information output unit for recognizing a specific part and realizing data in real time so as to use the additional effect, the additional information display system for real time broadcasting service through automatic recognition of the object of the video object. The method according to claim 1,
And a statistical calculation unit for calculating a frequency of usage for the advertisement event, recording the usage history of the customer's additional information, measuring the preference based on the frequency of use for each additional information, An additional information display system for real - time broadcast service through recognition function.

Images