KR20100083679A - Multimedia content generating apparatus, information providing apparatus, information outputting apparatus and methods thereof - Google Patents

Abstract

PURPOSE: A multimedia content generating apparatus, an information providing apparatus, an information outputting apparatus, and a method thereof are provided to enable a user to have simple shopping through a moving picture. CONSTITUTION: A sensor unit(520) receives a signal including an identifier of a transmitter from the transmitter to which a subject is attached. A location determining unit(560) determines coordinates on an image area of the subject displayed on the image area of an image frame. A contents generating unit(550) inserts the identifier and the coordinates on the image area into multimedia contents. In other words, the contents generating unit generates a separate file including the identifier and the coordinates on the image area synchronized with the image frame of the multimedia contents.

Description

Apparatus for generating multimedia content, apparatus for providing information, apparatus for outputting information, and method thereof

The present invention relates to an apparatus for generating multimedia content, an apparatus for providing information, an apparatus for outputting information, and a method thereof, and more particularly, an identifier of an RFID tag attached to a subject and a screen of the subject. The present invention relates to an apparatus for generating multimedia content for embedding image location information into a moving image, an apparatus for providing information, an apparatus for outputting information, and a method thereof.

Today, the demand for information is soaring that it is called the age of information, and access to the Internet, which is likened to a sea of information, to acquire necessary information and enjoy entertainment is becoming commonplace. In particular, access to and use of the World Wide Web (WWW), which supports video, music, or motion pictures in addition to text, are congested.

In addition, text multicasting, which multiplexes text and figure information on one television broadcasting channel and repeatedly provides various text multicasting programs, news, weather forecast, television program guide, leisure information, sports, entertainment, and real-time stocks. Life information such as information is provided.

On the other hand, unlike unilaterally providing programs provided by broadcasting stations to users, Internet TV and Internet Protocol Television (IPTV), which provide interactive services between broadcasting stations and users, have appeared.

Here, IPTV refers to a service that provides information service, moving picture content, and broadcasting to a television receiver using high-speed Internet, which is a type of digital convergence in terms of convergence of the Internet and television. The difference with conventional Internet TV is that it uses a television receiver instead of a computer monitor and a remote control instead of a mouse.

IPTV has no difference from general cable broadcasting or satellite broadcasting in that it provides broadcasting contents including video, but it is characterized by the added interactivity. In other words, unlike a general over-the-air, cable or satellite broadcast, the user can be provided with only the program he wants to watch at a convenient time.

Due to the bidirectionality of the IPTV, the IPTV service provider provides product information to the user and the user can perform shopping by referring to the provided product information.

Here, the number of product information provided to the user is inevitably limited, and the user must select the listed products through shopping broadcasting.

However, a user may want to purchase a product featured in a corresponding video while watching a drama or commercial without going through a shopping broadcast. Accordingly, the present invention provides information on all products appearing on one screen to the user. Appearance is required.

SUMMARY OF THE INVENTION An object of the present invention is to insert an identifier of an RFID tag attached to a subject and position information on a screen of the subject into a video and provide the same to a user.

The objects of the present invention are not limited to the above-mentioned objects, and other objects which are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, an apparatus for generating multimedia content according to an embodiment of the present invention includes a frame generation unit for generating an image frame for a subject and a signal including an identifier of the transmitter from a transmitter attached to the subject. Inserting the identifier and the coordinates on the image area to the multimedia content consisting of the sensor unit, a position determining unit for determining the coordinates on the image area of the subject displayed in the image area of the image frame and the image frame, And a content generator for generating a separate file including the identifier synchronized with the image frame of the multimedia content and the coordinates on the image area.

According to an embodiment of the present invention, an apparatus for providing information corresponds to an identifier of each transmitter attached to at least one subject and coordinates on the image region of the subject displayed in the image region of the image frame for the subject to the identifier. And a receiver for receiving one of the transmitted identifiers in response to the transmission, and a transmitter for transmitting information corresponding to the received identifiers.

An apparatus for outputting information according to an embodiment of the present invention includes a positioning unit for checking a coordinate selected by a user in an image area on which an image frame is being displayed, and the identified coordinates among at least one identifier received with the image frame. And an content extractor configured to output an identifier corresponding to the extracted identifier, and an information corresponding to the extracted identifier.

According to an embodiment of the present invention, a method of generating multimedia content includes generating an image frame for a subject, receiving a signal including an identifier of the transmitter from a transmitter attached to the subject, Determining coordinates on the image area of the subject displayed in the image area, inserting the identifier and the coordinates on the image area into the multimedia content consisting of the image frame, or the identifier synchronized to the image frame of the multimedia content; Generating a separate file including coordinates on the image area.

The method for providing information according to an embodiment of the present invention corresponds to an identifier of each transmitter attached to at least one subject and coordinates on the image region of the subject displayed in the image region of the image frame for the subject to the identifier. Transmitting, receiving an identifier of one of the transmitted identifiers in response to the transmission, and transmitting information corresponding to the received identifier.

A method of outputting information according to an embodiment of the present invention includes the steps of checking a coordinate selected by a user in an image area on which an image frame is being displayed, and corresponding to the checked coordinate among at least one identifier received with the image frame. Extracting an identifier and outputting information corresponding to the extracted identifier.

Specific details of other embodiments are included in the detailed description and the drawings.

According to the above-described apparatus for generating multimedia contents, an apparatus for providing information, an apparatus for outputting information, and a method thereof, the identifier of the RFID (Radio Frequency Identification) tag attached to the subject and the position information on the screen of the subject are displayed. By inserting it into the user, there is an advantage that allows the user to perform a simple shopping through the video.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a flowchart illustrating a process of providing subject information to a user according to an exemplary embodiment of the present invention.

For a user who wants to shop via IPTV (Internet Protocol Television) or receive information on a person or background, the information providing apparatus 200 according to an embodiment of the present invention provides a tag identifier and location information to the user side information output apparatus 300. Transmit to (S110).

Here, the tag identifier and the location information are included in the multimedia content provided by the IPTV station or provided to the user in a separate file. For example, when the user selects one of the broadcast programs (multimedia content) provided by the IPTV station, the user May be provided with a corresponding multimedia content including a tag identifier and location information, or a file including a tag identifier and location information (hereinafter, referred to as a tag data file) together with the multimedia content.

The tag identifier refers to an identifier assigned to a specific subject included in an image frame constituting multimedia content. For example, when an image of a bicycle is included in the image frame, the tag identifier may be an identifier assigned to the bicycle. .

In addition, the location information is information provided in a combination with the tag identifier, and means the location of the object to which the tag identifier is assigned. That is, the location information indicates on-screen coordinates of the object to which the tag identifier is assigned, and may indicate a specific point among the image areas formed by the image frame or an area having a predetermined size based on the specific point. It may be an area having a size in consideration of. A detailed description of the tag identifier and the location information extraction process will be described later with reference to FIG. 4.

The user who receives the multimedia content may select the corresponding product when the desired product appears while watching the multimedia content. For example, a user who is watching a drama may be interested in a hat or a t-shirt worn by the characters in the drama, where the user can select the corresponding hat or t-shirt from the image being displayed using the remote control. .

As described above, the tag identifier and the location information are provided in one combination. Accordingly, when the user selects a specific location on the screen, the information output device 300 receives the location information corresponding to the location along with the corresponding image frame. If it is determined that the location information exists, the tag identifier received together with the location information is extracted (S120).

The extracted tag identifier is transmitted to the information providing apparatus 200 (S130), and the information providing apparatus 200 extracts information (hereinafter referred to as subject information) of the subject corresponding to the received tag identifier (S140). That is, the information providing apparatus 200 stores subject information corresponding to each tag identifier together with at least one tag identifier.

The extracted subject information is transmitted to the information output apparatus 300 (S150). Accordingly, the information output apparatus 300 outputs the received subject information (S160), and the user may be provided with information about the subject selected by the user. Meanwhile, FIG. 1 illustrates that the information providing apparatus 200 transmits the tag identifier and the location information to the information output device 300. However, the tag identifier and the location information are transmitted together with the multimedia content. It may be transmitted by the content providing means.

FIG. 2 is a block diagram illustrating a detailed configuration of the information providing apparatus illustrated in FIG. 1, and the information providing apparatus 200 includes a storage unit 210, a receiver 220, a transmitter 230, and an information extractor 240. It is configured to include.

The receiver 220 transmits the tag identifier of each transmitter attached to the at least one subject and the coordinates on the image region of the subject displayed in the image region of the image frame with respect to the subject in correspondence with the tag identifier. Receives a tag identifier of one of the identifiers. Here, the coordinates on the image region of the subject include coordinates in the subject region occupied by the subject among the image regions of the image frame. Accordingly, the user can designate the subject by selecting an arbitrary position within the subject region without having to select the exact position of the transmitter on the screen.

The storage unit 210 stores the subject information corresponding to the tag identifier, and the information extracting unit 240 serves to extract the corresponding subject information with reference to the received tag identifier. The subject information may include product information, person information, and background information. The product information may include at least one of a product name, a price, a specification, a vendor, and a purchase method of the subject. The person information refers to information on the person as the subject, and may include a name, date of birth, place of origin, address, contact information, and recent status. Background information refers to the information of the surrounding of the subject, which can be understood as information of the place where the subject is being photographed. That is, the background information may include names of the places, directions, accommodation facilities, and entertainment facilities.

The transmitter 230 transmits the extracted subject information to the information output apparatus 300. In addition, when the information providing apparatus 200 performs a multimedia content providing function, the transmitter 230 may transmit multimedia together with a tag identifier and location information (hereinafter referred to as integrated multimedia content) or a tag data file. It may also serve to transmit content to the information output apparatus 300. In this case, the storage unit preferably stores multimedia content and tag data files.

3 is a block diagram illustrating a detailed configuration of the information output device illustrated in FIG. 1. The information output device 300 includes a storage unit 310, a communication unit 320, a pointer control unit 330, and a positioning unit 340. , The identifier extractor 350, and the content playback unit 360.

The communication unit 320 may receive the integrated multimedia content from the information providing apparatus 200 or the multimedia content together with the tag data file, and receives the subject information. In order to receive subject information, the communicator 320 may transmit the identifier extracted by the identifier extractor 350 to the information providing apparatus 200. In addition, the communication unit 320 may serve to receive a control signal for movement of the pointer from the pointing device 810 to be described later.

The pointer controller 330 controls the operation of the pointer with reference to the control signal received from the pointing device 810. The control signal may include a displacement according to the on-screen coordinates or movement of the pointer, and the pointer controller 330 controls the operation of the pointer with reference thereto.

Meanwhile, in the present invention, the pointer may be displayed in the form of a mouse pointer, or may not be displayed without a special form. For example, the user may select a specific object by controlling the movement of the displayed pointer, and generate a motion signal or a button signal to a second object adjacent to the first object currently active while the pointer is not displayed. The second object may be selected and activated.

The location checker 340 checks coordinates selected by the user in the image area on which the image frame is being displayed. As described above, the user can select a specific object by controlling the position of the pointer, and the position checking unit 340 checks the coordinates of the object.

The identifier extractor 350 extracts an identifier corresponding to the coordinates checked by the positioning unit 340 among at least one identifier received with the image frame. That is, each identifier corresponding to at least one or more coordinates of the image area of one image frame is received together with the corresponding image frame. The identifier extractor 350 extracts an identifier corresponding to the input coordinates from the user.

The content reproducing unit 360 plays a role of playing the multimedia content received from the information providing apparatus 200. In addition, the content playback unit 360 according to an embodiment of the present invention serves to output subject information corresponding to the identifier extracted by the identifier extractor 350. Here, the subject information corresponding to the identifier may be subject information of a specific object on the image frame. When the communication unit 320 transmits the identifier extracted by the identifier extractor 350 to the information providing apparatus 200, In response to the subject information, the content reproducing unit 360 outputs the subject information received from the information providing apparatus 200.

The storage unit 310 temporarily stores multimedia content and subject information received from the information providing apparatus 200. For example, the storage 310 may act as a buffer for smooth playback of multimedia content.

In addition, before the specific object is selected by the user, the object information of the object on the image frame may be stored in the storage 310 in advance. In this case, the content reproducing unit 360 may store the subject stored in the storage 310. Information can be extracted and output.

In addition, the content player 360 according to an exemplary embodiment of the present invention may output an icon for at least one subject image included in an image frame, wherein the subject image corresponds to each of at least one identifier. Can be. The user may designate a specific subject by selecting one of the displayed icons. A detailed description of the icon will be described later with reference to FIG. 12.

When the user selects a specific icon, the identifier extractor 350 may extract an identifier corresponding to the selected icon.

FIG. 4 is a diagram illustrating a tag identifier and location information extracted according to an embodiment of the present invention. The tag identifier to be inserted into or included in a multimedia content while generating multimedia content, which is a broadcast program to be provided by an IPTV broadcasting station, is included in the tag data file. And extracting position information.

The multimedia contents producer produces the multimedia contents using the multimedia contents generating apparatus 500, for example, a broadcast production camera. In this case, the wireless transmitters 421, 422, 423, 424, and 425 are attached to the subject. An image of a subject may be received.

For example, as illustrated in FIG. 4, the multimedia contents are attached to the t-shirts, skirts, and shoes worn by the characters, or the wireless transmitters 422 are attached to the bicycle. The generating device 500 generates an image frame for the subject. Also, a wireless transmitter 425 may be attached directly to the person.

Here, each of the radio transmitters 421, 422, 423, 424, and 425 continuously transmits a unique identifier, and the multimedia content generating apparatus 500 may receive a signal receiving means 501 capable of receiving a signal including the unique identifier. ) May be provided.

That is, the multimedia content generating apparatus 500 generates an image frame for a subject while receiving a signal including a unique identifier for each subject. The multimedia content constituting the image frame may include the received unique identifier.

In addition, the multimedia content generating apparatus 500 may be provided with means for identifying the location of the wireless transmitters 421, 422, 423, 424, and 425, whereby the location information is associated with the unique identifier of the corresponding wireless transmitter. It may be included in the multimedia content or may be configured as a tag data file.

The position of the radio transmitters 421, 422, 423, 424, 425 can be confirmed by using a plurality of signal receiving means, in which signals transmitted from one radio transmitter are transmitted to a plurality of signal receiving means arranged at different positions. When received, each signal receiving means detects the strength of the signal and delivers it to the positioning means, the positioning means can check the position of the radio transmitter, that is, the coordinates on the image area with reference to the plurality of received signals. .

In addition, the multimedia content generating apparatus 500 may correspond to its location with a separate identifier to include in the multimedia content or in the tag data file.

Here, the wireless transmitters 421, 422, 423, 424, and 425 may be radio frequency identification (RFID) transponders, and the wireless transmitter and the signal receiving means may be part of an RFID system.

An RFID system consists of a transponder that stores unique information, a transceiver (reader or reader) that functions to read and decrypt, a server (host computer), a network and an application (ERP, SCM).

Transponders, commonly called tags, consist of IC chips and antennas and come in a variety of shapes and sizes. Transponders that are implanted under the skin to track animals are as small as a pencil lead and only 1 cm long. The main functions of the IC chip are data storage, memory size (25 bit ~ 512 kb or more), memory type (read only, read and write type, write once and read multiple times), memory type (EEPROM, FRAM) Depending on the price.

The RFID system may be classified into an inductively coupled method and an electromagnetic wave method according to a wireless access method. The mutual induction method is short-range (within 1m), the electromagnetic wave method is used for medium and long distance RFID, the mutual induction method uses a coil antenna and the electromagnetic wave method uses a high frequency antenna to wirelessly connect to each other.

In mutual induction, the transponders are operated almost manually. That is, all the energy needed for the IC chip of the transponder to operate is supplied by the transceiver. Thus, the antenna coil of the transceiver generates a strong magnetic field in the surrounding area. Part of the emitted magnetic field generates an inductive voltage at the coil antenna of the transponder away from the transceiver, rectifies it, and supplies it with energy for the IC. Electromagnetic wave transponders do not receive enough power from the transceiver to drive IC chips, so they may contain additional batteries for long-range recognition (active).

Transceivers and transponders use a variety of digital encodings to process baseband data. The wireless signal is mainly converted into a high frequency signal and transmitted using a basic three digital modulation schemes, namely, Amplitude Shift Keying (ASK), Frequency Shift Keying (FSK), and Phase Shift Keying (PSK). However, in a specific frequency band (UHF band of the United States), only a specific modulation scheme is required to reduce the human body influence of electromagnetic waves or interference with other communication systems, and the most widely used is spread spectrum (SS). Among the frequency spreading methods, a direct sequence (DS) used for a CDMA mobile phone or a wireless LAN and a frequency hopping (FS) used for Bluetooth are mainly used. However, applying this modulation scheme to a tag requires more complicated circuits and increases the price, so in practice, only the transceiver uses this modulation scheme, and the transponders are made wideband to cover the entire frequency of frequency spreading and ASK, etc. To transmit the signal.

In addition, various signal processing is performed to increase the reliability of data information, and an error rate reduction method using a cyclic redundancy check (CRC) method, an Aloha or a CSMA (Carrier) used in a wireless LAN, etc. to distinguish multiple transponders An anti-collision method using a similar method to Sense Multiple Access, and a data security method using a symmetric or asymmetric encryption algorithm for protecting data are applied. In particular, such signal processing depends on the functionality of the memory of the transponder.

The above has described that the communication method between the radio transmitters 421, 422, 423, 424, 425 and the signal receiving means 501 is by RFID, but wireless communication methods such as infrared communication, Bluetooth, home RF, and wireless LAN are used. Of course you can.

5 is a block diagram illustrating an apparatus for generating multimedia contents according to an embodiment of the present invention, wherein the apparatus for generating multimedia contents 500 includes a frame generator 510, a sensor 520, a storage 530, and a controller 540. ), A content generator 550, a position determiner 560, and a photographing position determiner 570.

The frame generator 510 generates a video frame for a subject. That is, the frame generator 510 receives the light reflected by the subject and converts it into an electrical signal using a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) device. To do.

The electrical signal is converted into a certain shape, and the image conversion includes not only converting an analog signal into a digital signal but also converting it into a shape required for motion detection such as brightness control and noise removal.

Image reception may be performed at night. When the background of the image is dark, the brightness of the entire image may be changed suddenly by the automatic brightness adjustment operation, and the generation of high frequency noise is more severe than when the background of the image is bright.

Since the sudden change in brightness and the generation of noise may cause a fatal error in motion detection, the received image may be converted into an image from which noise is removed.

The sensor unit 520 receives a signal including an identifier of a transmitter from a transmitter attached to a subject. Here, the transmitter may be an RFID transponder, and accordingly, the sensor unit 520 may be an RFID receiver. That is, the sensor unit 520 may receive the RFID signal from the transmitter.

The sensor unit 520 may be configured to include a plurality of sensors provided at different locations, whereby a signal transmitted by one transmitter may be simultaneously sensed by a plurality of sensors.

The position determiner 560 determines the coordinates of the image area of the subject displayed in the image area of the image frame, which includes determining a subject area occupied by the subject in the image area of the image frame. The position determiner 560 may determine the coordinates on the image area of the subject by referring to the strengths of the signals received at a plurality of different positions, where the intensity of the signal is a plurality of sensors constituting the sensor unit 520. It may be detected and delivered by.

Here, the coordinates on the image area may mean a specific point of the two-dimensional plane formed by the image frame. For example, when the resolution of the two-dimensional plane is 1024 x 768, the abscissa coordinate in the image area determined by the position determining unit 560 may be one of 0 to 1023, and the ordinate may be one of 0 to 767. . In addition, the coordinate on the image area according to the embodiment of the present invention may be an area of a predetermined range based on a specific point. For example, when a specific point is (800, 600), and the horizontal and vertical extension range is 10, the horizontal axis coordinates are 796 to 805, and the vertical axis coordinates are 596 to 596 on the image area determined by the position determining unit 560. It may be 605. That is, an area extended by an extension range based on a specific point may be coordinates on the image area. Here, the specific point may be coordinates of the transmitter on the image area.

In addition, the position determiner 560 not only determines the area extended by the preset range as the subject area based on the coordinates of the transmitter, but also determines the subject area by referring to the color or pattern formed around the coordinates of the transmitter. have. That is, the transmitter is attached to the subject, and if the color of the surroundings is similar or the pattern is similar to the basis of the coordinates of the transmitter, the position determiner 560 determines that the same subject and calculates the area to calculate the location information. To generate.

A detailed description of determining the subject area with reference to the color or pattern formed around the coordinates of the transmitter will be described later with reference to FIG. 11.

The content generating unit 550 inserts the identifier and location information of the transmitter into the multimedia content composed of the image frame to generate the integrated multimedia content, or generates a tag data file including the coordinates on the image area and the identifier synchronized to the image frame of the multimedia content. It creates a role. A detailed description of the tag data file will be described later with reference to FIG. 13. Hereinafter, the data including the identifier and the location information of the transmitter is called tag data.

In generating the integrated multimedia content, when the format of the multimedia content is Moving Picture Expert Group (MPEG) 1, 2, or 4, the content generator 550 may insert tag data into the multimedia content by adjoining the image frame. When the format of the multimedia content is MPEG7, the content generator 550 may insert tag data into the header of the multimedia content.

The storage unit 530 stores the integrated multimedia content or the tag data file along with the multimedia content. The storage unit 530 may include a hard disk, a flash memory, a compact flash card (CF), a secure digital card (SD), a smart card (SM), a multimedia card (MMC), or a memory stick. May be provided inside the multimedia content generating apparatus 500 as a module capable of inputting and outputting the data, or may be provided in a separate device.

The photographing position checking unit 570 checks the photographing position of the subject. That is, the photographing position confirming unit 570 confirms the position of the multimedia content generating apparatus 500 generating the multimedia content for the subject. For this purpose, the photographing position confirming unit 570 is a GPS (Global Positioning System) receiver. It may be provided.

In addition, by using the GPS positioning method, a cell tracking method using a mobile telephone network, and a distance calculation method by detecting a received radio signal in a frequency band allocated by a frequency common method, a photographing position checking unit ( 570 may identify the current position. The cell tracking method is a method using analysis of propagation sensitivity between base stations, and the error ranges from 500 to 1500 m.

When the photographing position is confirmed by the photographing position confirming unit 570, the content generating unit 550 sets a specific identifier (hereinafter, referred to as a photographing position identifier) preset for the photographing position and the photographing position in the integrated multimedia content or tag data file. Can be inserted to match. Here, the photographing position identifier may be an RFID tag identifier or may be a separate code arbitrarily set.

As such, as the photographing position and the photographing position identifier are provided, the user may also be provided with information about a place where the subject is being photographed.

The controller 540 controls overall control of the frame generator 510, the sensor 520, the storage 530, the content generator 550, the position determiner 560, and the shooting position determiner 570. It performs the role of relaying data transfer between modules.

FIG. 6 is a diagram illustrating integrated multimedia contents according to an exemplary embodiment of the present invention, in which tag data 640, 650, and 660 are adjacent to respective image frames 610, 620, and 630 constituting the multimedia contents. Figure 600 is inserted into.

According to a video format such as MPEG1, 2, and 4, a plurality of video frames constitute a single video. In FIG. 6, tag data 640, 650, and 660 are adjacent to each video frame 610, 620, and 630. Indicates inserted.

Here, the tag data adjacent to a specific image frame is tag data for the corresponding image frame, and the identifier 641 and the location information 642 included in the tag data correspond to an identifier received from a transmitter of a subject included in the corresponding image frame and the corresponding data frame. Means the location information extracted by determining the position of the transmitter.

That is, the object on the screen can be moved and its position can be changed. Since the position information of the object is provided for each image frame, the user can select the object by tracking the moving object.

FIG. 7 is a diagram illustrating integrated multimedia content according to another exemplary embodiment of the present invention, and illustrates integrated multimedia content 700 including tag data 731, 732, and 733 in a header 710 of the multimedia content.

Unlike MPEG1, 2, and 4, according to the MPEG7 video format, it is not easy to insert tag data into multimedia content by adjoining an image frame. In FIG. 7, a portion 730 of the header 710 is allocated to each image frame. Indicates that tag data 731, 732, 733 has been inserted.

Like the integrated multimedia content 600 of FIG. 6, the integrated multimedia content 700 of FIG. 7 may include tag data including an identifier 741 and location information 742.

 The plurality of tag data 731, 732, and 733 may be arranged in an order corresponding to the image frame included in the video data 720. For example, when the first tag data and the second tag data correspond to the first image frame and the second image frame, respectively, the second tag data is arranged after the first tag data and after the first image frame. The second image frame may be arranged. Accordingly, when a user indicates a specific position on a specific image frame, tag data corresponding to the corresponding image frame may be extracted.

Alternatively, each tag data 731, 732, and 733 included in the header 710 may include a position on the video data 720 of the corresponding image frame.

On the other hand, the tag data 640, 650, 660, 731, 732, 733 shown in Figs. 6 and 7 includes data fields 643, 743, which store user-defined data or for future unclear purposes. It may be omitted as included for use in.

8 is a conceptual diagram illustrating a user selecting a specific position of an image region according to an embodiment of the present invention. The user-side display system that allows a user to select a specific position of the image region may include a pointing device 810 and information output. The device 300 includes a device 300 and a display device 820.

The information output device 300 receives multimedia content, generates a mouse pointer, and changes coordinates of the mouse pointer 822 according to a control signal received from the pointing device 810.

The information output device 300 may be a device equipped with data processing and computing functions such as a personal computer with a central processing unit, a set top box for a TV, or a CPU board embedded in a TV. have. Accordingly, the user may control the movement of the mouse pointer 822 by using a mouse (not shown) connected to the information output device 300.

In addition, the information output apparatus 300 serves to generate the graphic object 821, which is to represent a specific area of the image area of the screen to the user. To this end, the information output apparatus 300 may be provided with means for generating the graphic object 821.

The user may point to a predetermined point of the display area by using the pointing device 810. At this time, the pointing device 810 communicates with the information output device 300 by wireless or wired to communicate the movement of the pointer 822. Transmits a control signal. In other words, when the user applies the movement to the pointing device 810, the motion sensor included in the pointing device detects this, and the detected motion signal is transmitted to the information output device 300. In this case, an inertial sensor may be used as the motion sensor, and details thereof will be omitted since it is beyond the scope of the present invention.

The display device 820 displays the multimedia content and the graphic object 821 received from the information output device 300. The information output device 300 and the display device 820 may be implemented as one device. It may be.

8 illustrates that the coordinates of the mouse pointer 822 are changed by the movement of the pointing device 810 and the mouse pointer 822 is displayed through the display device 820, but the pointing device 810 is simply displayed. The coordinates of the mouse pointer 822 may be changed or the selection of the graphic object 821 may be switched while the mouse pointer 822 is not displayed by manipulation of a button provided in FIG.

For example, a plurality of graphic objects may be displayed on a screen, and a user may select a graphic object of his or her desired among a plurality of graphic objects by using a button provided in the pointing device 810.

FIG. 9 illustrates a detailed configuration of a screen displayed by the display apparatus of FIG. 8, in which a plurality of graphic objects 910, 920, 930, and 940 are displayed on an upper layer of a layer on which received multimedia content is played. It is a figure which shows that.

Whether the graphic objects 910, 920, 930, and 940 are displayed may be determined according to a user's selection. For example, the graphic output object 300 may cause the information output device 300 to use the specific buttons provided in the pointing device 810. 910, 920, 930, 940 can be generated.

That is, when the instruction to create the graphic objects 910, 920, 930, and 940 is received from the pointing device 810, the information output device 300 extracts tag data of an image frame currently being played from the received multimedia content. The graphic objects 910, 920, 930 and 940 are generated by referring to the location information specified in the tag data.

As described above, the location information may be a specific point or an area having a predetermined size among the image areas formed by the image frame. FIG. 9 illustrates graphic objects 910 and 920 having a size corresponding to an area occupied by a subject on the screen. , 930, 940 are shown.

As illustrated in FIG. 9, when the graphic objects 910, 920, 930, and 940 are displayed, the user may switch a graphic object to be instructed by using a button provided in the pointing device 810 or by using a motion sensor. In this case, the graphic object 940 that is indicated may be highlighted and displayed.

10 is a flowchart illustrating a process of generating integrated multimedia content according to an embodiment of the present invention.

In order to generate the integrated multimedia contents, the multimedia contents generating apparatus 500 first generates an image frame for the subject using the provided frame generator 510 (S1010). While generating an image frame, the multimedia content generating apparatus 500 may receive a signal including an identifier of a transmitter from a transmitter attached to a subject in operation S1020.

Here, although the signal receiving step S1020 is performed after the image frame generating step S1010 in FIG. 10, the image frame generating step S1010 and the signal receiving step S1020 may be performed independently of each other. .

As the image frame is generated and the identifier is received, the multimedia content generating apparatus 500 determines the subject position (S1030). The position of the subject may be performed by referring to signal strengths of transmitters received from a plurality of different positions, or may be performed by referring to an image processing result of the generated image frame.

In addition, the multimedia content generating apparatus 500 may generate multimedia content including the generated image frame (S1040), and may insert an identifier and a location, that is, tag data, for each image frame into the multimedia content.

While inserting the tag data into the multimedia content, the multimedia content generating apparatus 500 may insert the tag data into the multimedia content by inserting the tag data into the multimedia content or inserting the tag data into the header of the multimedia content in consideration of the format of the multimedia content.

11 is a view illustrating generation of an area around a tag according to an embodiment of the present invention.

As described above, the user may select a specific subject in the image area using the pointing device 810. When the position to be selected to receive information on the subject is simply the coordinate of the transmitter on the image area, the user You may find it difficult to select the coordinates.

To this end, the multimedia content generating apparatus 500 according to an embodiment of the present invention may generate an image area considering the surrounding image information of each transmitter as position information on a corresponding subject when generating the multimedia content.

That is, the multimedia content generating apparatus 500 determines the shape of the subject by referring to the color or pattern formed around the coordinates of the transmitter, and generates the image area according to the determination result as the location information.

FIG. 11 illustrates that an image region of each object is formed by referring to colors or patterns around the transmitters 421, 422, 423, and 424 attached to sweaters, skirts, bicycles, and shoes, respectively. In addition, according to an embodiment of the present invention, the transmitter 425 may be attached to the person to generate the image area of the person as position information.

Accordingly, the user may be provided with information about the corresponding subject only by selecting one point of the subject area on the screen without selecting the exact coordinates of the transmitter in selecting the specific subject.

12 illustrates an icon of a subject image according to an exemplary embodiment of the present invention.

The user may select a specific subject in the image area by using the pointing device 810. The area formed by referring to a color or pattern formed around the coordinates of the transmitter or an area extended by a preset range based on the coordinates of the transmitter is selected. Although provided as a possible area, a user may feel difficulty in selecting a moving subject.

To this end, the information output apparatus 300 according to the exemplary embodiment of the present invention may output icons 1210, 1220, 1230, and 1240 for each subject displayed on the screen.

For example, when a user selects a specific button provided in the pointing device 810, the information output device 300 extracts a subject to which location information is assigned and displays icons 1210, 1220, 1230, and 1240 for the subject. To create and display it at a specific location on the screen. At this time, the information output apparatus 300 may pause the reproduction of the multimedia content.

Accordingly, the user can be provided with information on the subject corresponding to the icon by selecting the icon displayed in the fixed position.

FIG. 13 is a diagram illustrating a tag data file according to an embodiment of the present invention. FIGS. 6 to 7 illustrate that tag data is included in multimedia content. However, as shown in FIG. 13, the tag data is a separate file. It may exist.

The multimedia content generating device 500 may generate a separate file including the tag data 1340, 1350, and 1360 synchronized for each frame 1310, 1320, and 1330 of the multimedia content. E.g,

Accordingly, the information providing apparatus may provide a separate file together with the multimedia content to the information output apparatus. 13 illustrates that frame 1 1310, frame 2 1320, and frame 3 1330 are synchronized to tag data 1 1340, tag data 2 1350, and tag data 3 1360, respectively.

Each tag data 1340, 1350, and 1360 may include an identifier 1351, location information 1352, and data 1353.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features thereof. You will understand that. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

1 is a flowchart illustrating a process of providing subject information to a user according to an exemplary embodiment of the present invention.

FIG. 2 is a block diagram illustrating a detailed configuration of the information providing apparatus shown in FIG. 1.

3 is a block diagram showing a detailed configuration of the information output device shown in FIG.

4 is a diagram illustrating a tag identifier and location information extracted according to an embodiment of the present invention.

5 is a block diagram illustrating an apparatus for generating multimedia content according to an embodiment of the present invention.

6 is a diagram illustrating integrated multimedia content according to an embodiment of the present invention.

7 is a diagram illustrating integrated multimedia content according to another embodiment of the present invention.

8 is a conceptual diagram illustrating that a user selects a specific position of an image area according to an exemplary embodiment of the present invention.

9 is a diagram illustrating a detailed configuration of a screen displayed by the display apparatus of FIG. 8.

10 is a flowchart illustrating a process of generating integrated multimedia content according to an embodiment of the present invention.

11 is a view illustrating generation of an area around a tag according to an embodiment of the present invention.

12 illustrates an icon of a subject image according to an exemplary embodiment of the present invention.

13 is a diagram illustrating a tag data file according to an embodiment of the present invention.

<Explanation of symbols on main parts of the drawings>

510: frame generator 520: sensor

530: storage unit 540: control unit

550: content generation unit 560: position determination unit

570: shooting position check unit

Claims (40)

A frame generator which generates an image frame for a subject; A sensor unit configured to receive a signal including an identifier of the transmitter from a transmitter attached to the subject; A position determination unit that determines coordinates on the image area of the subject displayed in the image area of the image frame; And The content generating unit inserts the identifier and the coordinates on the video area into the multimedia content consisting of the video frame, or generates a separate file including the identifier and the coordinates on the video area synchronized to the video frame of the multimedia content. Apparatus for generating multimedia content comprising. The method of claim 1, The transmitter is a device for generating multimedia content including a Radio Frequency Identification (RFID) transponder. The method of claim 1, When inserting the identifier and the coordinates on the video area into the multimedia content consisting of the video frame, when the format of the multimedia content is Moving Picture Expert Group (MPEG) 1, 2, or 4, the content generation unit may display the identifier and the Coordinates on an image area to be inserted into the multimedia content by adjoining the image frame, and when the format of the multimedia content is MPEG (Moving Picture Expert Group) 7, the content generation unit includes the identifier and the image in the header of the multimedia content. Apparatus for generating multimedia content inserting coordinates on an area. The method of claim 1, And the location determiner is configured to determine the coordinates on the image area of the subject with reference to the strength of the signal received at a plurality of different locations. The method of claim 1, And the position determiner is configured to determine multimedia contents of the image region of the image frame. The method of claim 5, And the location determiner is configured to determine the multimedia area that extends by a predetermined range based on the coordinates of the transmitter as the subject area. The method of claim 5, And the location determiner is configured to determine the subject area by referring to the color or pattern formed around the coordinates of the transmitter. The method of claim 1, Apparatus for generating a multimedia content further comprising a photographing position checking unit for confirming the photographing position of the subject. The method of claim 8, And the content generation unit generates multimedia content by inserting the multimedia content or the separate file in correspondence with the photographing position and a specific identifier preset for the photographing position. One of the transmitted identifiers in response to transmitting an identifier of each transmitter attached to at least one subject and coordinates on the image region of the subject displayed in the image region of the image frame for the subject in correspondence with the identifier. Receiving unit for receiving the identifier; And And a transmitter for transmitting the information corresponding to the received identifier. The method of claim 10, And the transmitter provides information including a Radio Frequency Identification (RFID) transponder. The method of claim 10, And the information corresponding to the received identifier includes at least one of a product name, a price, a specification, a selling place, and a purchasing method of the subject. The method of claim 10, And information corresponding to the received identifier includes information about a person of the subject. The method of claim 10, And information corresponding to the received identifier includes information about the surrounding of the subject. The method of claim 10, And coordinates on the image area of the subject including coordinates in the subject area occupied by the subject in the image area of the image frame. A position checking unit which checks coordinates selected by a user in an image area on which an image frame is being displayed; An identifier extractor for extracting an identifier corresponding to the identified coordinates among at least one identifier received with the image frame; And And a content reproducing unit configured to output information corresponding to the extracted identifier. The method of claim 16, And a communication unit which transmits the extracted identifier and receives the information in response to the transmission of the identifier. The method of claim 16, The information outputting information including at least one of product information, person information and background information. The method of claim 16, The content reproducing unit outputs an icon for at least one subject image included in the image frame. And the subject image outputs information corresponding to each of the at least one identifier. The method of claim 19, And the identifier extracting unit outputs information for extracting an identifier corresponding to an icon selected by the user among the icons. Generating an image frame for a subject; Receiving a signal including an identifier of the transmitter from a transmitter attached to the subject; Determining coordinates on the image area of the subject displayed in the image area of the image frame; And Inserting the identifier and coordinates on the image area into the multimedia content consisting of the image frame, or generating a separate file including the identifier and coordinates on the image area synchronized to the image frame of the multimedia content; How to create a multimedia content. The method of claim 21, And the transmitter comprises a radio frequency identification (RFID) transponder. The method of claim 21, The step of inserting the identifier and the coordinates on the video area into the multimedia content consisting of the image frame may include the identifier and the coordinates on the video area when the format of the multimedia content is MPEG (Moving Picture Expert Group) 1, 2, or 4. Inserting the multimedia content adjacent to the image frame and inserting the identifier and coordinates on the image area in the header of the multimedia content when the format of the multimedia content is a moving picture expert group (MPEG7). How to create multimedia content. The method of claim 21, The determining of the coordinates on the image area of the subject may include determining the coordinates on the image area of the subject with reference to the strengths of the signals received at a plurality of different positions. The method of claim 21, And determining a subject region occupied by the subject among the image regions of the image frame. 26. The method of claim 25, The determining of the subject area may include determining, as the subject area, an area extended by a preset range based on the coordinates of the transmitter. 26. The method of claim 25, The determining of the subject area may include determining the subject area by referring to a color or a pattern formed around the coordinates of the transmitter. The method of claim 21, Checking the photographing position of the subject. The method of claim 28, And inserting the capturing position and a predetermined specific identifier with respect to the capturing position in correspondence to the multimedia contents or the separate file. Transmitting an identifier of each transmitter attached to at least one subject and coordinates on the image region of the subject displayed in the image region of the image frame for the subject corresponding to the identifier; In response to the transmission, receiving an identifier of one of the transmitted identifiers; And Transmitting information corresponding to the received identifier. 31. The method of claim 30, And the transmitter provides information comprising a Radio Frequency Identification (RFID) transponder. 31. The method of claim 30, And the information corresponding to the received identifier includes at least one of a product name, a price, a specification, a seller, and a purchase method of the subject. 31. The method of claim 30, And information corresponding to the received identifier includes person information of the subject. 31. The method of claim 30, And the information corresponding to the received identifier includes information about the surrounding of the subject. 31. The method of claim 30, And coordinates on the image area of the subject including coordinates in the subject area occupied by the subject in the image area of the image frame. Confirming coordinates selected by the user in the image area on which the image frame is being displayed; Extracting an identifier corresponding to the identified coordinates among at least one identifier received with the image frame; And And outputting information corresponding to the extracted identifier. The method of claim 36, Transmitting the extracted identifier; And Receiving the information in response to the transmission of the identifier. The method of claim 36, The information outputs information including at least one of product information, person information, and background information. The method of claim 36, The method may further include outputting an icon for at least one subject image included in the image frame. The subject image outputs information corresponding to each of the at least one identifier. 40. The method of claim 39, Extracting an identifier corresponding to an icon selected by the user among the icons.

Images