KR101104699B1 - Method And Device for Acquiring Video Content by Using Portable Terminal - Google Patents

Abstract

The present invention relates to a method for acquiring video content image information using a portable terminal.

According to an aspect of the present invention, there is provided a device for acquiring information related to an image in a video content image to which a special code has been added. A mobile terminal which converts the data into a form suitable for transmission and transmits the data to a server connected to the mobile communication network, and receives the related information from the server and displays the information; And a server configured to transmit the extracted extracted information related to the video content image transmitted by the mobile terminal to the server.

According to the present invention, when the content video data with the special code is inserted to the server connected to the mobile communication network through the mobile terminal, the server transmits the information about the content video data to the mobile terminal information on the still image of the video or general still picture It can be known and can be applied to T-commerce.

Content image, special code, server, portable camera, RFID, T-commerce

Description

 Apparatus and method for acquiring information of video content using a mobile terminal {Method And Device for Acquiring Video Content by Using Portable Terminal}

1A is a screen view for inputting a content image using a camera shooting function or a capture function mounted on a mobile terminal according to an embodiment of the present invention;

1B is a block diagram of a server according to an embodiment of the present invention;

1C is a screen example of displaying information transmitted from a server on a mobile terminal;

1D is another screen example of displaying information transmitted from a server on a mobile terminal;

2 is a block diagram of a video content image information acquisition system according to an embodiment of the present invention;

3 is a flowchart of an operation of inputting a content image, converting data, and transmitting the data to a server according to an embodiment of the present invention;

4 is a flowchart illustrating a process of finding and matching information matching a special code to a mobile terminal according to an embodiment of the present invention;

5 is an operation flowchart of a mobile terminal for receiving an information packet from a server according to an embodiment of the present invention.

 <Description of Symbols for Main Parts of Drawings>

210: video processor 218: video data packet transmitter

220: image information display unit 225: information packet receiving unit

250: server connected to the mobile communication network 251: data packet receiver

252: received image packet analyzer 253: information database

254: special code matching unit 255: information packetization unit

256: information packet transmitter

The present invention relates to a method of obtaining information of a specific image in a video content image. More specifically, the present invention relates to a method of acquiring information of a specific image through a server connected to a mobile communication network using a portable terminal, and a portable terminal and a server for performing the same.

Conventionally, a bar code system including a bar code and a bar code reader is mainly used for product management or DB creation. By applying wireless communication technology to this barcode system, more efficient product management and DB creation are possible. This technology is called RFID (Radio Frequency Identification) (RFID), which can be used to wirelessly find information about objects with shapes. The RFID system refers to a system that transmits and receives information about an object and surrounding environment information using radio frequency from an electronic tag of a small chip attached to the object and provides a service related thereto. The RFID system is based on an RF tag and an RF reader. The RF tag stores identification information for identifying individuals such as people, cars, cargo, and livestock, while the RF reader recognizes the identification information through wireless communication. Research using RFID system is being actively conducted and its application field is widely used. A typical example is the case where it is applied to a parking lot facility and a subway toll collection system.

RFID technology basically plays a similar role to a conventional barcode, but has advantages such as storing more information than a barcode, being easy to attach, and transmitting and receiving long distance information. In addition, as sensor technology and miniaturization technology become more advanced, the ability to proactively acquire and process information will be able to do much more than the role of barcodes.

On the other hand, video images and still pictures in a communication system are inefficient to be used for transmission or storage because the data capacity becomes large unless video data is converted. Therefore, the data is transformed and compressed in an error range that cannot be perceived by human vision. Video image data, which is a still image or a continuous form of a still image, determines the data size using R, G, and B values corresponding to each pixel on a spatial domain. Since the data on the spatial domain is inefficient to use, the data on the spatial domain is converted into data on the frequency domain through a transform such as DCT (Discrete Cosine Transform). In the frequency domain, a luminance component sensitive to human vision may be disposed in a low frequency component and a less sensitive component such as a chrominance component may be disposed in a high frequency component to reduce data values of the high frequency component through a quantization process. At this time, the quantization level is adjusted so that the human image does not have a big difference from the original image. The video compression technique applied with these basic principles includes MPEG 1, which is a compression technique used for storing still images, moving images, video CDs, and CD-I. In addition to broadcasting services such as direct satellite broadcasting, cable broadcasting, and high-definition television, the video is designed to freely store multimedia data such as MPEG 2, which is widely used in movies and commercials, and video and video on the Internet. MPEG 4, the streaming standard, and MPEG 7, the next generation compression technology with an interface for describing various types of multimedia information.

Recently, a special code such as a water mark that is invisible on a general screen is added to a specific part of the screen. This water mark causes the special code to appear at a specific frequency when converting spatial domain data into frequency domain data. It is applied to various fields such as security, password, tracking, and DB management. Recently, an object-oriented compression technique is applied to MPEG 4, which is capable of subdividing images in detail and inserting different special codes into the divided images to compress them separately for the divided images. For example, if a person reads a book while wearing a watch and glasses, it means that the images of the watch, glasses, and book can be divided and compressed separately by inserting different special codes on each part. to be. This compression technique can be applied to video content to watch movies or advertisements through a mobile terminal or to take a picture or video using a mobile terminal camera and store it. In proportion to the increase in such movies and video contents, the information of images desired by a mobile terminal user also increases.

Until now, if a mobile device user wants to know the information related to the video or still picture that he / she is watching while viewing the mobile device screen or the video or still image around the user, the mobile device user can remember the simple features that display the video and then send the related information to the Internet, newspaper, There was no choice but to find out from the people around him.

In order to solve this problem, the present invention receives content image data with a special code inserted through a camera of a mobile terminal, converts input data in the spatial domain into data in the frequency domain, and then quantizes the image data of a high frequency component. After reducing and packetizing the packet, the packet is transmitted to the server connected to the mobile communication network through the transmitter, and the server analyzes the special code in the received video data packet, and then selects the information on the content video data stored in the database matching the special code. When the packetized data is transmitted to the mobile terminal through the mobile communication network, the mobile terminal analyzes the received information packet so that the user of the mobile terminal can know the information about the content image in a desired form such as a screen and a sound.

The present invention for achieving this object provides a method for obtaining information of a video content image using a portable terminal. A device for acquiring information related to an image in a video content image to which a special code is assigned, the apparatus suitable for transmitting the video content image to a server through a mobile communication network using a camera attached to a mobile terminal and a camera self-capture function. A mobile terminal which converts the data into a data form and transmits the data to a server connected to the mobile communication network, and receives the related information from the server and displays the information; And a server for transmitting the extracted extracted information related to the video content image transmitted by the mobile terminal to the server.

According to the present invention, when content video data with a special code is inserted to a server connected to a mobile communication network through a mobile terminal, the server transmits information on the content video data to the mobile terminal to associate with a still image of a video or a video of a still picture. Information can be known.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First, in adding reference numerals to the old elements of each drawing, it should be noted that the same reference numerals have the same reference numerals as much as possible even if displayed on different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

1A is a screen view for inputting a content image using a camera photographing function or a capture function mounted on a portable terminal according to an embodiment of the present invention. This shows that the user of the mobile terminal photographs with a camera mounted on the mobile terminal when he / she wants to obtain information related to the TV content image 100 having a special code inserted therein. If the content image is a content image on the screen of the mobile terminal, the content image may be stored using an internal capture function. The captured image 110 may be transmitted to a server connected to a mobile communication network so as to obtain information related to the image through the corresponding server, or store the information in a portable terminal and later retrieve the related information. In addition to TV commercials, video content videos that can be inserted with all special codes, such as TV programs, large commercials attached to buildings, and movies, can also be recorded with a camera mounted on a mobile terminal and transmitted to a server for information related to the video. In addition to the images of the surrounding environment, video content for mobile terminals can use the instant capture function to know the information of the video with the special code.

1B is a block diagram of a server according to an embodiment of the present invention. The image packet data received by the image data packet receiver 151 reconstructs the compressed image packet data by the received data packet analyzer 152 into data on the original frequency domain to obtain a special code corresponding to a special frequency on the frequency domain. Serve The special code matching unit 154 matches the database stored in the server information database 153 with the special code to find information corresponding to the special code. In the information packet construction unit 155, the information is configured in the form of a packet and sent to the information packet transmission unit 156.

1C is an example of a screen displaying information transmitted from a server on a mobile terminal according to an embodiment of the present invention. This is an example of displaying information packets from a server on the screen after being processed by the mobile terminal. It can be displayed by the user of the mobile terminal using a voice or another method. First, the primary content of the information matching the special code is shown. If a special code is inserted in the article screen, data such as a homepage, a production date, a price, a place of purchase, and a contact can be displayed. If a special code is inserted in the person's screen, it may be data such as age, name, gender, contact, and greeting.

1D is another screen example of displaying information transmitted from a server on a mobile terminal according to an embodiment of the present invention. It is an example of a screen in which a mobile terminal user finds more detailed information than information transmitted from a server through the Internet or a telephone connection. The user of the mobile terminal can use the obtained information for T-commerce.

2 is a block diagram of a system for acquiring image information in a video content image according to an embodiment of the present invention. As shown in FIG. 2, in order to obtain information about an image in a video content image according to an embodiment of the present invention, a server connected to a mobile terminal and a mobile communication network is required. Each of the mobile terminal and the server should have the following functions.

The mobile terminal analyzes the information data packet received from the image processor 210 which processes the image data inserted with the special code, the image data packet transmitter 218 which transmits the image data packet, and the server connected to the mobile communication network, The video information display unit 220 displays the information data by a screen, a voice, or other method so that the portable terminal user can know the information data. Among these, the image processor 210 reads the video content image or takes a video content image inserted with a special code into a camera attached to the mobile terminal, and inputs the analog image data on the input spatial domain and the camera image input unit 212. The video data converter 214 converts the data into digital data in the frequency domain, and the video data packet construction unit 216 compresses and packetizes the video data.

On the other hand, the server is composed of a packet data receiver 251, a received image packet analyzer 252, an information database 253, a special code matching unit 254, an information packet configuration unit 255, an information packet transmission unit 256 It includes. The image packet data received by the image data packet receiver is reconstructed by the received data packet analyzer 252 to the data on the original frequency domain to find a specific code corresponding to a special frequency on the frequency domain. The special code matching unit 254 matches a special code with a database stored in the information database 253 in the server and finds information corresponding to the special code. The information data is configured in the form of a packet and sent to the information packet transmitter 256 to transmit the selected information packet to the information packet receiver 225 in the portable terminal via the mobile communication network.

3 is a flowchart illustrating an operation of inputting a content image, converting data, and transmitting the data to a server according to an embodiment of the present invention. The user of the portable terminal photographs a desired screen of the image of the video content inserted with the special code with a camera mounted on the portable terminal and inputs the image into the terminal (S300). Since the input image is analog data in the spatial domain and the size is too large, the input image is converted into digital data in the frequency domain to reduce the data size by removing high frequency components that do not significantly affect human vision (S302). Data on the changed frequency domain is compressed and packetized to be transmitted to the mobile communication network (S304). The video data packet is transmitted to the server connected to the mobile communication network through the video data packet transmitter 218 of the portable terminal (S306).

4 is a flowchart illustrating a process of finding and matching information matching a special code to a mobile terminal according to an embodiment of the present invention. The server connected to the mobile communication network recovers the received video data packet to find the frequency domain value and extracts the special code corresponding to the special frequency (S400). Information in the database matching the found special code is selected (S402). The selected information is packetized into a form suitable for transmission (S446) and transmitted to the mobile terminal through the mobile communication network (S406).

5 is an operation flowchart of a mobile terminal for receiving an information packet from a server according to an embodiment of the present invention. The mobile terminal receives an information packet for the selected content coded content image from a server connected to the mobile communication network (S500), restores and analyzes the packet (S502), and displays the image information through the image display unit of the mobile terminal. The portable terminal user recognizes the information by other means such as voice (S504). The method of acquiring the information of the content image has been recently utilized in digital broadcasting such as digital TV, video-on-demand system, cable broadcasting, and internet broadcasting due to the recent arrival of digital broadcasting and internet broadcasting.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

As described above, according to the present invention, screen information of a digital video content image may be displayed in a manner desired by a user of a mobile terminal through communication between a mobile terminal equipped with a camera and a server of a mobile communication network.

Claims (12)

An apparatus for obtaining image related information associated with a video content image with a special code, In order to receive the video content image using a camera attached to a mobile terminal or a self-capturing function, the data format is converted and transmitted to the mobile communication network for transmission to a server through a mobile communication network, and the image is transmitted from the mobile communication network. A mobile terminal receiving information and displaying the image related information; And Receiving the video content image transmitted by the mobile terminal from the mobile communication network, searching for and extracting the video related information related to the video content image from its database, and extracting the extracted video related information through the mobile communication network. Include servers sending to, The mobile terminal, An image data converter for converting analog data on a spatial frequency of the video content image into which the special code is inserted into digital data on a frequency domain; An image data packet constructing unit for compressing the digital data into which the special code is inserted and using the mobile communication network in a form for compressing the digital data; And An information data analysis unit for restoring and analyzing a video related information packet including the video related information transmitted from the server The system for acquiring video content image related information using a portable terminal comprising a. The method of claim 1, wherein the mobile terminal And a video input unit configured to receive the video content video with the special code inserted therein through the camera. The method of claim 1, wherein the mobile terminal And a video input unit configured to receive the mobile terminal-specific content image having the special code inserted therein through the capture function. delete delete The method of claim 1, wherein the mobile terminal And a video data packet transmitter for transmitting the packet with the special code inserted therein to the server connected to the mobile communication network. The method of claim 1, wherein the mobile terminal And an information packet receiver configured to receive an image related information packet containing the image related information from the server. delete The method of claim 1, wherein the mobile terminal And a video information display unit for displaying the video related information extracted by the information data analyzing unit. 10. The system of claim 9, wherein the server is A packet data analysis unit for extracting the special code by restoring the image-related information packet into which the special code is inserted; A special code matching unit for finding information of a database matching the extracted special code; An information packet construction unit for packetizing the video related information found by the special code matching unit into a form for use in the mobile communication network; And an information packet transmitter for transmitting the image related information packet to the portable terminal through the mobile communication network. The system for acquiring video content image related information using a portable terminal comprising a. A method of transmitting video content video having a special code inserted thereto to a server using a mobile terminal, and obtaining related video information related to a video content video receiving the video related information transmitted by the server. (a) receiving the video content image having the special code inserted therein through a camera mounted on the mobile terminal or capturing and receiving the video content image having the special code inserted therein displayed in the mobile terminal; (b) converting analog data on a spatial domain of the video content image with the special code inserted therein into digital data on a frequency domain; (c) organizing digital data on the frequency domain transformed in step (b) into packets; (d) transmitting the packet configured in step (c) to a server connected to a mobile communication network; (e) receiving an information packet sent from the server; (f) analyzing the received information packet to obtain the image related information; And (g) displaying the obtained image related information on the mobile terminal; And obtaining video content image related information by using a portable terminal. The method of claim 11, wherein the obtaining of the video content image related information using the portable terminal comprises: (d1) analyzing the packet to extract the image related information corresponding to the video content image, and constructing an information packet to be suitable for transmission using the extracted image related information. And obtaining video content image related information by using a mobile terminal.

Images