KR20150120687A - Additional information providing method using object recognition for stream images of digital broadcasting - Google Patents

Additional information providing method using object recognition for stream images of digital broadcasting Download PDF

Info

Publication number
KR20150120687A
KR20150120687A KR1020140046614A KR20140046614A KR20150120687A KR 20150120687 A KR20150120687 A KR 20150120687A KR 1020140046614 A KR1020140046614 A KR 1020140046614A KR 20140046614 A KR20140046614 A KR 20140046614A KR 20150120687 A KR20150120687 A KR 20150120687A
Authority
KR
South Korea
Prior art keywords
information
moving picture
picture file
file
related information
Prior art date
Application number
KR1020140046614A
Other languages
Korean (ko)
Inventor
준 허
전현수
Original Assignee
주식회사 아론티
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 아론티 filed Critical 주식회사 아론티
Priority to KR1020140046614A priority Critical patent/KR20150120687A/en
Publication of KR20150120687A publication Critical patent/KR20150120687A/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23109—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion by placing content in organized collections, e.g. EPG data repository
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/232—Content retrieval operation locally within server, e.g. reading video streams from disk arrays
    • H04N21/2323—Content retrieval operation locally within server, e.g. reading video streams from disk arrays using file mapping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention relates to a method for providing additional information using object recognition in a digital broadcasting stream image and, more particularly, to a method which searches for, in the digital broadcasting stream image, a moving image file that objects inputted by a user appear among a plurality of moving image files stored in a database, and an appearance position, obtains information on content related to an object while viewing the searched moving image file, and purchases a product. According to the present invention, the method comprises the following steps: inserting information on a program and information on content into a moving image file in a system for inserting a moving image file object information according to an operation of an operator, and storing the same in a database; providing a search screen of the moving image file and inputting a search condition when a user terminal is accessed to a media server; when the search condition is inputted, searching for, by the media server, moving image files which satisfy the search condition thereof in the database, and displaying the same; when one among the displayed moving image files is selected, transmitting the selected moving image file to the user terminal; when the touch pointer is positioned on a predetermined object appeared in a play screen while the user terminal plays the transmitted moving image file, and tracks a position of the touch pointer, searching for a name of an object in which the touch pointer is positioned, from the information on content, and displaying the same with a QR code or tool-tip; and searching for a detailed description with respect to the object having the touch pointer positioned thereon from the information on content and displaying the same in a display area of the detailed description when the touch pointer is positioned on the object and clicks the same.

Description

[0001] The present invention relates to a method of providing additional information using object recognition in a digital broadcast stream image,

The present invention relates to a method for providing additional information using object recognition in a digital broadcast stream image.

After the viewer accesses the smart device, computer, etc., the information or service on the site is utilized. Further, the Internet is not limited to communication among people belonging to a specific service group but is not classified into a country or an area, and is becoming the most popular information acquisition and information communication network. In a digital broadcast stream image that performs a predetermined broadcast using the Internet, various useful video files are stored in a database, and a search system of video files is provided to an Internet user so that a desired video file can be searched and replayed .

The retrieval system of the moving picture file includes a database separately from the database in which the moving picture file is stored. In the separate database, various information related to the moving picture file, such as a program name, a broadcasting station name, a production company, ), A director / PD name, a genre name, a character, indirect advertisement product information, and a path name in which a moving picture file is located are stored in advance. When the user desires to search for a moving picture file, A predetermined desired video file can be searched for and viewed. However, the conventional moving image file searching system can only search a desired moving image file, and can not directly search only a specific scene in which the corresponding object appears by searching for specific scenes or objects in the moving image file. When it is desired to view a specific scene in a moving picture file, the user searches for a specific moving picture file and directly searches for the desired scene while moving the playback position of the searched moving picture file.

Furthermore, the user can only recognize that an object such as a character or a small object appears on a reproduction screen of a moving image file, and can not acquire or purchase detailed information about the object.

Therefore, it is an object of the present invention to provide an information recording method and a program, which are capable of recording predetermined program-related information such as a program name of a moving image file, a broadcasting station name, a manufacturer company, a production date, a supervisor / PD name, a genre, Related information related to various objects such as characters and accessories appearing on the screen is inserted into a moving picture file and the moving picture file and the detailed scene The present invention also provides a method of providing additional information using object recognition in a digital broadcast stream image.

It is another object of the present invention to provide a method and apparatus for playing back a searched video file and acquiring predetermined information related to various objects appearing on the screen, To provide a method of providing.

In order to accomplish the above object, there is provided a method of providing additional information using object recognition in a digital broadcast stream image, comprising the steps of: Related information related to objects appearing on the playback screen, and stores the content-related information in a database. When the user terminal is connected to the media server via the Internet, it is determined whether to select a search for a video file, The media server provides a search screen of a video file to input a search condition, and when the user terminal inputs a search condition, the media server searches the database for video files satisfying the search condition and displays , And among the displayed video files When one of the user terminals selects the video file, the selected video file is searched from the database and transmitted to the user terminal. It is determined whether the user terminal clicks while tracing the position of the touch pointer while the user terminal plays back the video file, When a touch pointer is positioned on an object appearing in a result playback screen and the name of the object in which the touch pointer is located among the contents related information inserted in the moving picture file is not searched for and a query code or a tool tip , &Quot; speech balloon help "), and when the touch pointer is positioned on an object appearing on the playback screen as a result of tracking and determination, a detailed description of the object where the touch pointer is located is searched, On the display unit.

The program related information includes a program name of a moving picture file, a broadcast station name, a producer company, a production date, a supervisor / PD name, a genre, indirect advertisement product information, and characters.

In the insertion of the program-related information and the content-related information, the system for inserting the moving picture file object information displays the editing screen of the moving picture file, selects the moving picture file to be edited, It is determined whether the cut information according to the operation of the operator is inputted while the moving picture file is being reproduced at the set reproduction speed or the input of the pause command according to the operation of the operator or the reproduction position of the moving picture file is the cut information position , Cut information is inserted into the current playback position of the moving picture file when the input of the cut information is judged, and playback of the moving picture file is paused when the input of the pause command or the playback position of the moving picture file is judged to be the cut information position And a contents-related information related to the objects displayed on the reproduction screen of the moving picture file according to the operation of the operator Characterized in that the storage by inserting the information. When inserting the content-related information, the number of tracking lines, the range of each region, the accuracy of each region, and the object information of the object to be inserted with the content-related information are inputted and the video file is automatically reproduced by selecting the object, And the area coordinates of the corresponding object are tracked and stored according to the number of tracking lines, the range of each area, and the accuracy of each area.

In addition, when inserting the content-related information, the content-related information for the object is inputted and the moving image is reproduced, the area of the object is set and displayed according to the manipulation of the operator and the area of the set object is moved The time information of the moving picture file to be reproduced is set, and the coordinates of the moved object area are tracked and stored.

The content-related information includes an ID of the object, a name of the object, and a detailed description of the object.

When the user touches the touch point in the detailed description display field, the URL of the object displaying the detailed description in the detailed description display field is searched from the content related information, And accesses the corresponding media server of the URL so as to acquire and shop.

As described in detail above, the present invention inserts program related information and content object related information of a moving picture file into a moving picture file, searches for desired moving picture files and scenes by using the inserted program related information and the content related object information The user can accurately search and view the scene desired by the user.

Further, it is possible to acquire detailed information (an indirect advertisement object product, etc.) of a predetermined object by using information related to the content object to be inserted into the moving picture file, as well as to purchase by performing an Internet shopping.

Accordingly, the present invention can be utilized as an application solution for broadcast-related industries as well as for detecting commercial blind code information from real-time over-the-air broadcast and cable broadcast video streams.

FIG. 1 is a diagram illustrating a system for inserting program-related information and content-related information into a moving image file according to the present invention.
2 is a signal flow diagram illustrating the operation of inserting program related information and content related information into a moving picture file according to the present invention,
FIG. 3 and FIG. 4 illustrate a reproduction control screen of a moving picture file displayed on a monitor when the program related information and the content related information are inserted into the moving picture file according to the present invention and the input screen of the program related information and the content related information 5A and 5B are signal flow diagrams showing the contents-related information insertion routine of FIG. 2,
6 is a diagram showing a configuration of a system for searching and viewing a moving picture file stored in a database and acquiring and purchasing information about the object in the present invention,
7A and 7B are a signal flow diagram illustrating a process of searching for and viewing a moving picture file stored in a database and acquiring and purchasing information about the object in the present invention,
FIG. 8 is a diagram illustrating an example of a search screen provided when a moving picture file stored in a database is searched in the present invention.

Hereinafter, a method of providing additional information using object recognition in a digital broadcast stream image according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a system for inserting program-related information and content-related information into a moving image file according to the present invention. Here, reference numeral 100 denotes a controller for inserting moving picture file object information such as a central processing unit. The video file object information inserting control unit 100 adds predetermined program related information such as program name, broadcasting station name, production company, production date, supervision / PD name, genre and characters of the video file, Related information related to various objects such as characters displayed on the reproduction screen of the moving picture file and indirect products of the indirect advertisement product information.

Reference numeral 110 denotes a database of a hard disk or the like and stores a predetermined moving picture file and a predetermined editing program for editing predetermined moving picture files and inserting predetermined program related information and contents related information.

Reference numeral 120 denotes a monitor for displaying the operation of inserting the predetermined program-related information and the content-related information into the predetermined moving picture file by the controller 100 for inserting the moving picture file object information.

Reference numeral 130 denotes an operation command input unit 130 including a keyboard, a mouse, a touch pointer, etc., and outputs predetermined program related information, content related information, a predetermined operation command, and the like to the moving picture file object information inserting control unit 100 ).

FIG. 2 is a signal flow diagram illustrating an operation of inserting program related information and content related information into a moving picture file using a predetermined editing program using the moving picture file object information insertion system of FIG. 1 according to the present invention. As shown in the figure, the controller 100 for inserting the moving picture file object information performs an initializing operation in step S200.

When the operator operates the operation command input unit 130 to command execution of a predetermined moving image editing program stored in the database 110 after the initialization operation of the step 200 is completed, 100 executes the moving image editing program and displays an editing screen capable of inserting predetermined program related information and content related information into the moving image file on the screen of the monitor 120 in step 202. [ For example, a playback control screen of a moving image file as shown in FIG. 3 and a program related information and a content-related information input screen of a moving image file as shown in FIG. 4 are displayed on the monitor 120 together.

In the next step 204, one video file to be inserted with predetermined program-related information and content-related information among a plurality of video files stored in the database 110 is selected. For example, when the operator selects the 'Open' button 300 by operating a mouse or the like on the reproduction control screen of the moving picture file of FIG. 3, the moving picture file object information inserting control unit 100 is stored in the database 110 And displays the entire video file on the screen of the monitor 120. The operator selects one video file to insert predetermined program related information and content related information among the displayed video files.

In the next step 208, a speed at which the selected moving picture file is reproduced is input to the reproduction speed input field 302 of FIG. 3, and it is determined whether the operator selects the reproduction key 304 in step 210.

If the operator selects the play key 304 in step 210, the controller 100 for inserting the moving picture file object information extracts a predetermined moving picture file selected by the operator in step 212 from the database 110, Reproduced at the reproduction speed set in the reproduction speed input field 302, and the reproduction screen is displayed in the display window 306. [

When the operator selects the 'cut information input' key 308 on the reproduction control screen of the moving picture file shown in FIG. 3, the controller 100 for inserting the moving picture file object information inputs the cut information in step 214 And inserts the cut information at the current reproduction position of the moving picture file in step 216. [

If the reproduction of the moving picture file is not completed as a result of the determination at step 218, the process returns to step 212 and the 'Cut information input' key 308 is selected, The process of inserting the cut information into the current reproduction position of the file is repeatedly performed. When the reproduction of the moving image file is completed, the process returns to step 204. [

That is, when motion of predetermined objects such as a character and a small object appearing in a predetermined moving picture file to be reproduced is fast, the operator sets the object in advance and inputs the predetermined content-related information When the user selects the 'Cut information input' key 214, the cut information is inserted into the current playback position of the moving image file to divide the moving image file.

If the operator selects the 'pause' key 310 in step 220 or the current position at which the moving picture file is reproduced is not cut information (not shown) in step 220 without selecting the cut information input key 308 in step 214, The moving picture file object information inserting control unit 100 temporarily suspends the reproduction of the moving picture file in step 222 and performs the contents related information insertion routine described later in step 224, Insert information.

In the next step 226, it is determined whether the reproduction of the moving picture file is completed. If the reproduction of the moving picture file is not completed as a result of the determination, the process returns to step 212 and repeatedly inserts the content- The process returns to step 204. In step 204,

That is, when the motion of predetermined objects appearing in a predetermined moving picture file to be reproduced is fast, the operator must preliminarily divide the moving picture file and input predetermined content-related information as described above. However, When the motion of predetermined objects is slow, the operator can directly enter the content-related information for a predetermined object without dividing the moving picture file, and the operator can select the 'pause' key 310 or the cut- , The reproduction of the moving picture file is temporarily stopped and the content related information insertion routine of step 224 is performed to insert the content related information.

As shown in FIG. 5, the contents-related information insertion routine of the step 224 determines whether the contents-related object information insertion control unit 100 selects automatic or manual by the operator in step S 500. That is, the operator determines whether the operator selects the 'auto' key 401 or the 'manual' key 402 in the object input field 400 of the content-related information input screen of FIG.

If the operator selects the automatic mode by pressing the 'AUTO' key 401, the number of trace lines is input to the input line 403 of the number of trace lines in step 504, and in step 506, In step 508, the accuracy of each object region is input to the accuracy field 405 for each region. That is, the number of tracking lines sets a polygon according to the shape of a predetermined object displayed on the reproduction screen of the moving picture file. When the shape of a predetermined object is triangular, 3 is input as the number of tracking lines, If the shape of a predetermined object is a rectangle, a value of 4 is input as the number of traced lines, and a predetermined object is traced by a rectangle, and a polygon value according to the shape of a predetermined object is input as the number of trace lines . The range for each area sets the number of pixels to be sampled. When the operator selects a predetermined object, the range of pixels to be sampled is set around the selected position. The area-specific accuracy is set to determine an error value of an object, and determine pixels within a predetermined range based on an average value of R, G, and B of the pixels within the set range.

In step 510, predetermined content-related information related to the object is input to the object information input field 410. In step 510, The predetermined content-related information for the object includes, for example, an ID of the object, a name of the object, a detailed description of the object, and a URL of a web site that can acquire and purchase more detailed information via the Internet The ID of the object, the name of the object, the name of the object in the ID input field 411 of the object in the object information input field 410, the name input field 412 of the object, the detailed description input field 414 of the object, and the URL input field 415 Enter the detailed description and URL for each.

In the next step 512, among the plurality of objects appearing on the temporary screen of the moving picture file displayed on the display window 306 of the reproduction control screen of the moving picture file of FIG. 3, It is determined whether the corresponding object of the content-related information is selected. If a predetermined object is selected, the reproducing operation of the moving picture file is performed in step 514.

A screen of the moving picture file to be played back at this time is displayed on the display window 306 of the playback control screen of the moving picture file of Fig.

In this state, the control unit 100 for inserting the content-related object information sets the reproduction time information in the moving picture file reproduced in the step 516, tracks the area coordinates of the corresponding object located at the corresponding time, In the coordinate value input field 413 in the input field 410. [

That is, the control unit 100 for inserting the content-related object information forms a polygon according to the number of the traced lines inputted and generates a polygon based on the position of the predetermined object clicked by the user, And the size of the polygon is reduced or enlarged according to pixels having an error value within a range of the accuracy of the input area from the average value calculated after calculating the average value of R, G, and B of the sampled pixels, Sets the region of the object, tracks the coordinates of the region to be set, and stores the coordinates in accordance with the reproduction time information in the moving picture file.

In the next step 518, it is determined whether the operator selects the 'pause' key 310 or the cut information position of the moving picture file to be reproduced. If the operator does not select the 'pause' key 310 Or if it is not the cut information position of the moving image file, the process returns to step 514 to repeat the operation of tracking and storing the coordinate of the moving image file while continuing to play the moving image file.

If the operator selects the 'pause' key 310 as a result of the judgment in the step 518 or the cut information position of the moving picture file to be reproduced, the control part 100 for inserting the object- Pause playback of the file. In the next step, it is determined whether the worker selects the 'complete' key 312. If the 'Complete' key 312 is not selected as a result of the determination, the process returns to step 504, and the coordinates of the next object are tracked and stored repeatedly as described above. When the selection is made, the operation of tracking and storing the coordinates of the object is stopped and returned.

If the automatic setting is not set in the step 500 and the operator selects the 'manual' key 402 and the manual setting is set in the step 500, the contents-related object information inserting control part 100 proceeds to step 526 ) ≪ / RTI > 4, various information related to the object is inputted into the object input field 400 and the object information field 410, and the number of traced lines 403, the field-specific range input field 404 of the object input field 400, And the number of trace lines to track the object in the ID input field 411, the object name input field 412, the detailed description input field 414, and the URL input field 415 of the object information field 410, , The accuracy of each object's area and area, the ID of the object, the object name, the detailed description of the object, and the URL.

In the next step 526, when the operator selects the 'play' key 304 to command the playback of the moving image file, the content-related object information inserting control unit 100 reproduces the moving image file in step 528, On the display window 306 of the reproduction control screen of the moving picture file of the moving picture file of FIG. 5A. In step 530, it is determined whether the operator sets the area of the object. That is, a predetermined object displayed on the playback control screen of the moving image file of FIG. 3 is dragged by an operator along the outline of the object to set a region of a predetermined object, In step 530, the controller 100 for inserting the related object information determines whether an operator sets an area of a predetermined object by dragging a mouse.

If a region of a predetermined object is set in step 530, the controller 100 for inserting the related object information displays the area set by the user for the predetermined object in step 532, and in step 534, The set area is moved according to the movement, the play time information of the moving picture file to be played is set in step 536, the coordinates in the set area of the moved object are tracked, And stores it.

In the next step 538, it is determined whether the operator selects the 'pause' key 310 or the cut information position of the moving picture file to be reproduced. If the operator does not select the 'pause' The process returns to step 534 to repeat the operation of tracking and storing the coordinates of the area while the moving picture file is continuously reproduced.

If the operator selects the 'pause' key 310 as a result of the determination in step 538 or the cut information position of the moving picture file to be reproduced, the controller 100 for inserting the content-related object information, in step 540, The reproduction of the moving picture file is paused, and in a next step 542 it is judged whether the operator selects the 'complete' key 312. If the 'Complete' key 312 is not selected as a result of the determination, the process returns to step 526 and tracks and stores the coordinates of the next object are repeatedly performed. In step 542, ) Is selected, the operation of tracking and storing the coordinates of the object is stopped and returned.

When the user terminal accesses the media server via the Internet, the video file stored in the media server may be searched for and viewed from the media server. do.

6 is a diagram illustrating a system configuration for searching and viewing a moving picture file stored in a database and obtaining and purchasing information about an object in the additional information providing method of the present invention. Reference numeral 600 denotes the Internet, which is a data communication network based on TCP / IP. Reference numeral 610 denotes a program for searching and viewing a video file through the Internet, acquiring information about a predetermined object appearing on a video file playback screen, And is a plurality of user terminals used by purchasing users.

Reference numeral 620 denotes a database for storing and outputting a plurality of video files storing program related information and content related information, a video file searching program capable of searching for the video files, and the like, A media server for providing a moving picture file for browsing and viewing a moving picture file stored in the database 620 when accessing through the Internet 600.

Here, it is assumed that a plurality of video files and a video file search program capable of searching for the video files are stored in the database 620 of the video file providing media server 630, A database server and a streaming server separately from the server 630 and can separately store a moving image file search program and a plurality of moving image files that can search for moving image files in a database of a database server and a streaming server, .

Reference numeral 640 denotes a media server for providing and selling object information for providing and selling information on a predetermined object when the user terminal 610 is connected through the Internet 600.

7A and 7B are diagrams illustrating a method of providing supplementary information according to an exemplary embodiment of the present invention. Referring to FIGS. 7A and 7B, a user terminal searches for a moving image file stored in a database of a media server for providing a moving image file, And acquiring and purchasing detailed information on the object in the step of acquiring the object. As shown in FIG. 7A, the media server 630 for providing a moving image file determines whether the user terminal 610 is connected through the Internet 600 in operation 700. When the user terminal 610 is connected in step 700, the media server 630 for providing the moving image file determines in step 702 whether the user terminal 610 requests to search for a moving image file.

When the user terminal 610 requests the object information search of the moving image file, the media server 630 for providing the moving image file provides the object information search screen of the moving image file to the user terminal 610 in step 704.

For example, when a moving picture content name is selected as shown in FIG. 8, a screen for searching shopping object information is provided.

In the next step 706, as the user manipulates the user terminal 610, a search condition such as a genre and a search word to be searched for a moving image file is input to the input fields 802, 804, and 806. In step 708, When the user selects the key 808 in step 710, the media server 630 for providing a moving image file selects a predetermined number of moving pictures, which are input to the input fields 802, 804, and 806, And searches for and displays all the video files satisfying the search conditions such as the genre and the search word. For example, as shown in FIG. 9, a searched video file is displayed on a search result screen so that the user can confirm the searched video file.

In the next step 712, it is determined whether the user selects one video file desired to view from among the searched video files. If the user selects a video file, the media server 630 for providing the moving picture file, in step 714, A predetermined video file selected by the user is derived from the database 620 and transmitted to the user terminal 610 via the Internet 600 for playback and viewing. For example, as shown in FIG. 10, the user's terminal 610 displays a playback screen of a video file selected by the user so that the user can view the playback screen.

In the next step 716, the position of the touch pointer of the user terminal 610 is tracked, and the position of the tracked touch pointer is determined in step 718. That is, it is determined whether a touch pointer is positioned at a coordinate position of an object such as a character or a small object appearing on the reproduction screen of the moving picture file.

If the location of the touch pointer is the location of the object in step 718, the user terminal 610 searches the content related information of the corresponding object in step 720 and displays the name of the corresponding object. For example, in FIG. 10, when a touch pointer is positioned at a position of a t-shirt wearing a character, an auxiliary window of a squeegee code or a tool tip function is formed at the position of the touch pointer, and a t- Is displayed.

In the next step 722, it is determined whether or not the screen is touched. In the case of touching, the position of the current touch pointer is determined in step 724 as shown in FIG. 7B.

If the pointer of the touch is the object position in step 726, for example, a detailed description display field is formed at the bottom of the playback screen, and a detailed description of the object is retrieved from the content- Display in the display field.

If it is determined in step 730 that the location of the touch point is the location of the quay code description display field, the URL of the corresponding object is searched in step 732, and in step 734, Provides detailed information about the object, provides object information for shopping, and accesses the media server 640 for shopping, acquires detailed information about the object, and purchases it as in a normal method.

100 - Video object information insertion control unit
110 - Media server database
120 - display device
130 - Operation command input part
600 - Internet
610 - User terminal
620 - Database
630 - Media Server
640 - Providing object information and shopping mall server

Claims (8)

In the moving picture file object information inserting system, in the moving picture file according to the operation of the operator, program related information related to the moving picture file and
Related information related to objects appearing on a playback screen;
A second step of storing the moving picture file into which the program related information and the content related information are inserted in the database of the media server in the first step;
A third step of determining whether to search for a moving picture file when the user terminal is connected to the media server via the Internet;
A fourth step of causing the media server to input a search condition by providing a search screen of a video file when the user terminal selects search of a video file in the third step;
A fifth step of the media server searching the database for video files satisfying the search condition when the user terminal inputs a search condition in the fourth step;
If the user terminal selects one of the video files displayed in the fifth step, searching the database for the selected video file and transmitting the selected video file to the user terminal;
A seventh step of determining whether the moving picture file transmitted in the sixth step is clicked while tracking the position of the touch pointer or the mouse pointer while the user terminal plays back the moving picture file;
In the seventh step, when the touch pointer is positioned on the object appearing on the tracking result playback screen and the touch pointer is not clicked, the name of the object in which the touch pointer is located is extracted from the content related information inserted in the moving picture file, An eighth process of displaying; And
And a ninth step of searching for a detailed description of the object in which the touch pointer is located and displaying the detailed description in the detailed description display field when the touch pointer is positioned on the object appearing on the tracking result playback screen in the seventh step A method of providing additional information using object recognition in a digital broadcast stream image. The information processing apparatus according to claim 1, wherein the program related information comprises:
A program name of a moving picture file, a broadcasting station name, a production company, a production date, a supervisory / PD name, a genre, object product information, and characters. The method of claim 1, wherein the first step comprises:
The system for inserting the moving picture file object information displays an editing screen of the moving picture file, program related information of the moving picture file, and a content related information input screen;
A twelfth step of selecting a video file to be edited by the operator from among the video files displayed in step 11, inputting program related information related to the video file, and setting a playback speed of the video file;
In the twelfth step, when the moving picture file object information insertion system plays back the moving picture file at the set playback speed, the cut information according to the operation of the operator is input, or the input of the pause command or the reproduction position of the moving picture file A thirteenth step of determining whether the cut information is located;
14. The method of claim 13, further comprising the step of inserting the cut information at a current playback position of the moving picture file when the input of the cut information of the thirteenth process is determined. And
If it is determined in step 13 that the input of the pause command or the reproduction position of the moving picture file is the cut information position, the reproduction of the moving picture file is suspended and the moving picture file is reproduced And storing the content-related information inserted and stored in the digital broadcasting stream image. 4. The method of claim 3, wherein the fifteenth step comprises:
A video file is automatically reproduced by selecting the object by inputting the number of tracking lines of the object to be inserted with the content related information, the range of each region, the accuracy of each region, and the object information and setting the time information of the moving picture file to be reproduced The number of tracking lines input,
Wherein the area coordinates of the object are tracked and stored according to the area-specific range and the area-specific accuracy, and the additional information is provided using the object recognition in the digital broadcast stream image. 4. The method of claim 3, wherein the fifteenth step comprises:
Entering content-related information about an object and setting and displaying the area of the object according to the operation of the operator while playing the video
And setting the time information of the moving picture file to be reproduced while moving the set object area according to the operation of the operator and tracking and storing the coordinates of the moved object area. To provide additional information. 4. The method of claim 3, wherein the fifteenth step comprises:
A twenty-first step of determining whether the operator sets automatic or manual;
A twenty-second step of determining whether to select an object by inputting the number of trace lines, the range of each area, the accuracy of each area, and the object information of the object to be inserted with the content-related information,
If an object is selected in step 22, time information on the reproduction time of the moving picture file is set while reproducing the moving picture file, and the area coordinates of the selected object are set according to the number of traced lines, A step 23 of inserting and storing the moving picture file in the moving picture file; And
A 24th step of inputting information about an object and reproducing a moving picture file when manual determination is made as a result of the checking in step 21;
In the twenty-fourth step, an object area is set and displayed according to the operation of the operator on the reproduction screen of the moving picture file to be reproduced, and the time information of the moving picture file to be reproduced is set and moved while moving the set object area according to the operation of the operator And tracking the coordinates of the object region in the moving image file to store the moving image in the moving image file. 7. The information processing apparatus according to any one of claims 1 and 6 to 6, wherein the content related information comprises:
The ID of the object, the name of the object, and a detailed description of the object. The method of claim 1, wherein the seventh step comprises:
If the user touches the touch point in the detailed description display field, the URL of the object in which the detailed description is displayed in the detailed description display field is searched from the content related information, and the user obtains detailed information about the object And connecting to a corresponding media server of the URL so as to perform shopping.
KR1020140046614A 2014-04-18 2014-04-18 Additional information providing method using object recognition for stream images of digital broadcasting KR20150120687A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020140046614A KR20150120687A (en) 2014-04-18 2014-04-18 Additional information providing method using object recognition for stream images of digital broadcasting

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140046614A KR20150120687A (en) 2014-04-18 2014-04-18 Additional information providing method using object recognition for stream images of digital broadcasting

Publications (1)

Publication Number Publication Date
KR20150120687A true KR20150120687A (en) 2015-10-28

Family

ID=54428841

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140046614A KR20150120687A (en) 2014-04-18 2014-04-18 Additional information providing method using object recognition for stream images of digital broadcasting

Country Status (1)

Country Link
KR (1) KR20150120687A (en)

Similar Documents

Publication Publication Date Title
US8001116B2 (en) Video player for exhibiting content of video signals with content linking to information sources
US8074161B2 (en) Methods and systems for selection of multimedia presentations
US5963203A (en) Interactive video icon with designated viewing position
USRE38401E1 (en) Interactive video icon with designated viewing position
EP3322192A1 (en) Method for intuitive video content reproduction through data structuring and user interface device therefor
US20090259955A1 (en) System and method for providing digital multimedia presentations
US10186300B2 (en) Method for intuitively reproducing video contents through data structuring and the apparatus thereof
JP2006209658A (en) Device and method for display output and computer program
US20130074139A1 (en) Distributed system for linking content of video signals to information sources
KR20090093904A (en) Apparatus and method for scene variation robust multimedia image analysis, and system for multimedia editing based on objects
CN105243093A (en) Singer recommendation method and apparatus
JP6031096B2 (en) Video navigation through object position
CN106713973A (en) Program searching method and device
KR20100118896A (en) Method and apparatus for providing information of objects in contents and contents based on the object
JP2006209657A (en) Device and method for authoring and computer program
KR100420633B1 (en) Method for data broadcasting
KR20150120687A (en) Additional information providing method using object recognition for stream images of digital broadcasting
US10990456B2 (en) Methods and systems for facilitating application programming interface communications
KR100537442B1 (en) Information providing method by object recognition
KR100486682B1 (en) Method for searching information in moving pictures
WO2000073914A1 (en) Synchronized spatial-temporal browsing of images for selection of indexed temporal multimedia titles
US11170817B2 (en) Tagging tracked objects in a video with metadata
KR20030028278A (en) Information service method by object recognition in internet broadcasting
WO2015075809A1 (en) Intra-dynamic image information search system and intra-dynamic image information search program
EP2763431A1 (en) Method and system of accessing data about products related to a multimedia object

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination