KR20130126532A - A method providing source information of a subject according to photographing the subject, and a server and a hand-held terminal therefor - Google Patents

Abstract

A method for providing subject source information through the photographing of a subject includes a step of detecting identification information of the subject by using position information of the subject provided from a portable terminal when a camera of the terminal photographs the subject, a step of extracting source information corresponding to the subject, and a step of transmitting the extracted source information to the portable terminal. [Reference numerals] (100) Server detects identification information of the subject by using position information of the subject provided from a portable terminal;(102) Server extracts source information corresponding to the subject by using the identification information;(104) Server transmits the extracted source information to the portable terminal;(106) Portable terminal displays the source information;(AA) Start;(BB) End

Description

A method providing source information of a subject according to photographing the subject, and a server and a hand-held terminal therefor}

According to an embodiment of the present invention, an individual user photographs a subject by using an image capturing camera of a portable terminal, thereby extracting identification information of the subject according to the position-related information of the subject, and thereby source information such as content or advertisement corresponding to the subject. It relates to the technology to provide.

Future computing technology is based on network connectivity, and it integrates entertainment, broadcasting, communication, home appliances, and has functionality and portability. It provides visual and auditory information as well as input and output functions of sensory information, It is expected to develop into a five senses information processing terminal. The five senses information processing terminal is expected to be implemented in augmented reality. The five senses information processing technology is expected to develop into a technology that supports realistic services by combining the senses, sense of smell, and taste information processing with the senses from the visual and auditory centers.

On the other hand, augmented reality is a technology that superimposes a virtual object in the real world that the user sees. It is called Mixed Reality (MR) because it combines real world and virtual world with additional information in real time and displays it as one image. It is a hybrid VR system that converges the real environment and the virtual environment. Since the late 1990s, research and development has been focused on the US and Japan. Augmented reality, a concept that complements the real world with the virtual world, uses a virtual environment made of computer graphics, but the main role is the real environment. Computer graphics serve to provide additional information needed for the real world. By overlapping the three-dimensional virtual image on the real image that the user is viewing, it means that the distinction between the real environment and the virtual screen becomes blurred. Virtual reality technology immerses the user in the virtual environment and cannot see the real environment. However, augmented reality technology, which is a mixture of real environment and virtual objects, allows the user to see the real environment, providing better realism and additional information. For example, when the camera is illuminated with a smartphone camera, information such as the location and phone number of a nearby store is displayed as a stereoscopic image.

In the conventional image and video recording, only photographing was possible, and it was impossible to input some information therein or extract information from an image in the photographing area. In addition, the conventional augmented reality related system has a disadvantage in that accurate search is difficult because it is a method of searching for a corresponding object by comparing only image information.

That is, in the conventional Internet environment, a lot of time and effort was required to find the information he wanted to find, and the quality of information obtained as much as the investment of time and effort should be satisfactory. For example, if you find a jumper that you like to go on the road or watch a TV or video movie, enter the brand and model name of the jumper, or if you do not know the brand and model name, There was a problem such that the name was searched and the related image file was searched. It's also true that finding the same thing in these days, even with the same color jumpers, is hard to find without surfing all over the Internet. Also, if you do not know exactly what you are doing (keyword), you have to search the surrounding information, narrow down the information area of interest, and search related information. Even if you enter the exact word, the providers who provide the information (such as portal companies, Naver, Yahoo, Daum, Google, etc.) will display the information of the companies that paid a lot of money and ordered their website link to the keyword. Therefore, the information of companies that do not (do not pay a lot of keyword link rental costs) is more difficult to connect to users.

The problem to be solved by the present invention is to compare the image information on the subject (people or buildings, etc.) photographed with the camera as well as to capture the source information for the subject to extract the source information using the other information A method of providing subject source information, and a server and a portable terminal therefor.

According to the present invention for solving the above problems, the method of providing the subject source information through the photographing of the subject, when the subject is photographed using a portable terminal equipped with a camera, the server is provided with the position information of the subject provided from the portable terminal Detecting identification information of the subject; Extracting source information corresponding to the subject by the server using the detected identification information; And transmitting, by the server, the extracted source information to the portable terminal.

Providing subject source information through photographing a subject to solve the above problem When the server photographs a subject using a portable terminal equipped with a camera, the server uses the position information of the subject provided from the portable terminal to identify identification information of the subject. An identification information detector for detecting; A source information extracting unit which extracts source information corresponding to the subject by using the detected identification information; An interface unit for transmitting the extracted source information to the portable terminal; An information storage unit for storing data including the identification information and the source information; And a controller for controlling operations of the identification information detector, the source information extractor, the interface unit, and the information storage unit.

A portable terminal for providing subject source information through photographing a subject for solving the above problems includes a position information detection module detecting position related information including a GPS position, an altitude, an azimuth angle, a photographing angle, a photographing magnification, and an angle of view; An image information detection module for detecting image information of an image sensor according to photographing of the subject; A terminal interface module for transmitting the location related information and the image information to the server; A data storage module for storing the location related information and the image information; And a terminal control module for controlling operations of the location information detection module, the image information detection module, the terminal interface module, and the data storage module.

According to the present invention, it is possible to extract the source information (for example, the product information of the subject) of the exact subject, and the diversity of information that can be collected, which cannot be compared with conventional information recognition technology in the image / video. It is greatly increased. Therefore, the individual user can simultaneously and simultaneously collect information on a plurality of flexible and fixed individual interest contents existing in the image even through information activities such as image / video shooting.

In addition, individual users can collect the five senses information (5D) of the individual content through the image and video recording in any space, online and offline, and at the same time, the corresponding source and code at the international standardized shooting angle and altitude coordinate point You can register. Five senses such as various images and videos collected and stored in real time internationally and information collected from individual user's phon account are integrated to form an information environment connected online and offline.

1 is a reference diagram for explaining a connection relationship between a subject, a portable terminal, and a server for explaining the present invention.
2 is a flowchart of an embodiment for explaining a method of providing subject source information through photographing a subject according to the present invention.
FIG. 3 is a flowchart of an exemplary embodiment for describing the 100th step illustrated in FIG. 2.
4 is a block diagram of an embodiment for explaining a portable terminal for providing subject source information through photographing a subject according to the present invention.
5 is a block diagram of an exemplary embodiment for explaining a server for providing subject source information through photographing a subject according to the present invention.
6 is a reference diagram illustrating an operation of a device for photographing a subject by a user on a portable terminal.
7 and 8 are reference diagrams for explaining position recognition of a subject.
9 to 13 are reference diagrams for describing contents related to source information registration.

Hereinafter, a method of providing subject source information through photographing a subject according to the present invention will be described with reference to the accompanying drawings.

1 is a reference diagram for explaining a connection relationship between a subject, a portable terminal, and a server for explaining a method of providing subject source information through photographing a subject according to the present invention.

The subject 10 refers to a target object photographed through a camera mounted on a portable terminal, and includes a person, a building, a sculpture, and the like as the kind of the subject.

The portable terminal 20 is a terminal equipped with a camera for photographing the subject 10, and includes a smartphone, a notebook computer, a tablet PC, a digital camera, and the like. In addition, the portable terminal 20 includes smart glasses capable of capturing images.

The camera mounted on the portable terminal 20 includes all photographing means capable of capturing still images and moving images. The portable terminal 20 transmits the location related information and the image information about the subject 10 collected from the subject 10 to the server 30. To this end, the portable terminal 20 is connected to the server 30 and a wired / wireless network such as the Internet.

The server 30 receives the related information about the subject 10 provided from the portable terminal 20 to identify the subject 10, and supplies the related source information corresponding to the subject 10 to the portable terminal 20. Perform the functions provided by). The server 30 is connected not only to the portable terminal 20 but also to a user terminal (not shown) of the subject 10 through a wired / wireless network.

2 is a flowchart of an embodiment for explaining a method of providing subject source information through photographing a subject according to the present invention.

When photographing a subject using the portable terminal 20 equipped with a camera, the server 30 detects the identification information of the subject using the position information of the subject 10 provided from the portable terminal 20 (step 100). .

FIG. 3 is a flowchart of an exemplary embodiment for describing the 100th step illustrated in FIG. 2.

The portable terminal 20 detects location-related information including its GPS location, altitude, azimuth, shooting angle, shooting magnification, angle of view, and image information of an image sensor according to the shooting of the subject 10 (step 200). . The 200th step will be described in more detail as follows.

First, when a user turns on the portable terminal 20 such as a smartphone or a digital camera and captures image and video content through a recording screen, an application mounted on the portable terminal 20 is automatically executed. Accordingly, the portable terminal 20 is connected to the server 30 for networking.

Thereafter, when the subject 10 is photographed, the application of the portable terminal 20 transmits USIM, MDN, IMSI information, etc. of the portable terminal 20 to the server 30 as user authentication information of the portable terminal 20. . The server 30 compares USIM, MDN and IMSI information for user authentication transmitted from the portable terminal 20 with account information for authentication already registered in the server 30. Accordingly, if the USIM, MDN, IMSI information does not match, the server 30 determines that the user authentication is not valid, and receives a special password code (settable in the user account), or if not knowing the portable terminal 20 Forcibly terminates the driving of the application or activates the lock function of the corresponding portable terminal 20 according to the user's setting, or performs a loss report function.

When the user authentication is normal, the user of the portable terminal 20 captures an image and a video of the subject 10, or according to a default time interval (for example, a user set time interval), the portable terminal ( The application of 20 detects real-time location-related information of the portable terminal 20, that is, its GPS location, altitude, azimuth, shooting angle, shooting magnification, angle of view, and the like. The position-related information thus obtained includes azimuth (horizontal angle measured clockwise from north to side), deviation (degree left / right from checkpoint), altitude difference (up / down from checkpoint), distance (checkpoint Azimuth is provided using 6400 millimeters (approximately 0.056 degrees) used by the North Atlantic Treaty Organization (NATO).

In addition, the application of the portable terminal 20 detects the image information on the subject 10 detected by the image sensor (CCD, etc.) for the image capture of the portable terminal 20.

In addition to detecting location-related information and image information, the portable terminal 20 scans radio waves to the subject 10 by using a parabolic antenna (not shown) included in the portable terminal 20, and the subject 10. The five senses information of the subject 10 may be received through the reflected wave reflected from the object. Here, the five senses information includes image information (visual information), auditory information, taste information, olfactory information, and tactile information about a subject.

The portable terminal 20 is integrated with the portable terminal 20 to collect the five senses information, or includes a five sense information device that can be attached and detached from the portable terminal 20. Such a five sense information device collects information by scanning a radio wave (microwave, ultra low frequency, laser wave, electromagnetic wave, sonar, ultrasound, etc.) to a subject of interest by using a parabolic antenna. The parabola antenna consists of a radiation space that scans radio waves (ultra-high frequency, ultra-low frequency, laser wave, electromagnetic wave, sonar, ultrasonic wave, infrared ray, etc.) to the subject of interest, and numerous hexagonal collection plates that collect reflected waves reflected from the subject. Consists of. The five senses information device is equipped with basic visual and auditory information collecting devices such as video and audio signal recognition functions collected by the portable terminal 20, and is a capsule-shaped (portable) collecting device that collects olfactory, taste, and tactile information. to be.

As a visual information collection method, visual information collected from a subject is divided into color vision (recognition of color), volume (recognition of objects), perspective (reception of distance and proximity), and texture (recognition of surface material). . To this end, the image analyzer of the five sense information devices reads the image signal transmitted from the photographing image sensor.

As the auditory information collection method, the auditory information collected from the subject uses an audio analyzer such as a voice signal recognition device provided in the portable terminal 20. In order to extract only sound information collected from a specific subject, when the user captures a subject, the audio analyzer extracts and analyzes the most powerful sound information that is clearly collected in the shooting direction. Primary reading compared to Along with the identification and image of the subject, the user is asked to select individual sound data directly.The user can click on the sound information (sound and image) he finds among the prominent sounds suggested by the server, You can tell it to extract. The information of the collected sound is collected and stored in largely divided into the height of the sound, the intensity of the sound, the speed of propagation, the temperature around the subject, the tone and the resonance.

As a method of collecting olfactory information, olfactory information is largely divided into types of smell and properties of smell. Kinds of odors are divided into six basic odors: odor, flavor, fruit, resin, odor, and odor. All other odors are defined as mixed odor. Odor properties are divided into nine main properties: ethereal, aromatic, balsamic, molten odor, garlic-like, super odorous, chlorine-like odor, unpleasant and emetic. In order to collect the olfactory information of the subject, the five sense information devices are equipped with an olfactory analyzer, which has conventionally applied neutrons (a rays, γ rays, x rays, electron rays, proton rays, etc.) to a sample (sample) of the subject. By radiating, radioactive, and measuring gamma and beta rays from the sample, the elements contained in the sample are analyzed. Here, of the many elements contained in the sample, when isotopes are generated, the spectrum of the gamma rays emitted therefrom is measured with an electrocooled (e.g.) Ge (germanium) semiconductor detector (portable or mounted in an olfactory analyzer). Can be qualitatively and quantitatively analyzed. In addition, by using an infrared radiator, a method of comparing, contrasting and reading infrared waveforms absorbed from a subject, and various electromagnetic analysis (radiation analysis, X-ray analysis, spectroscopic analysis, flame analysis, light absorption analysis, fluorescence analysis) , Raman analysis, high frequency analysis, etc.) and electrochemical analysis (electrical titration, electroanalysis, electrolytic analysis, polarography, etc.) can be used.

As the taste information collection method, the collected taste information is defined as sweet, salty, sour, bitter, umami, and the like. In order to collect taste information on a subject, the five sense information devices are provided with a taste analyzer, and the taste analyzer uses the infrared radiation device provided in the analyzer to discriminate taste information of the subject. For each molecule, the components are analyzed by infrared rays reflected on the target material using properties of different levels of light absorption, and the wavelength and amount of infrared rays generated at this time are different for each subject, so the waveform of the infrared rays is the same as the fingerprint of the subject. The server compares the infrared waveforms of the subject in advance and the infrared waveforms of the subject being collected and detects the signal of the waveform using an array of artificial materials such as polymers, artificial membranes, semiconductors, and nanoelectronic tongues. ). For example, if the subject is coffee, it is possible to read how much sugar (sweetness) is in the coffee.

As a tactile information collection method, the collected information is classified into tactile sense, warm sense, cooling, pain sense, and unique sense. In order to collect the tactile information of the subject, the five sense information device is equipped with a tactile analyzer, and the tactile analyzer transmits to the subject of interest through the parabola antenna (ultra-high frequency, ultra-low frequency, laser wave, electromagnetic wave, sonar, ultrasonic wave, infrared ray, etc.). ), And collects the information, and collects the difference between the velocity and the direction of the reflected wave that hits the surface according to the type and shape of the subject, and the tactile information previously collected in relation to the expected identity information of the subject. In contrast, the read function is provided. To collect it, you need a parabolic antenna, which consists of a number of hexagonal collection plates. In addition, the five senses information device may collect texture through special gloves. This uses a microcurrent flowing between the surface of the glove, forming a microcurrent film (the opposite charge flowing in the hand) on the surface of the subject, and forming an electrostatic force therebetween to touch the surface of the subject with a charge from the user's hand. In this case, a method of collecting or feeling the texture information by using an electric attraction between the user's fingers is used. At this time, according to the difference in the density and texture of the surface of the subject, the difference in the pressure flowing to the given place is generated, through this, the difference in the magnitude of the voltage occurs, the width of the vibrations that are collected and implemented is also different.

After operation 200, the portable terminal 20 transmits location related information, image information, and five sense information to the server 30 (operation 202). The portable terminal 20 transmits the detected real-time location related information (GPS location, altitude, azimuth, photographing angle, photographing magnification, angle of view, etc.) to the server 30. In addition, the portable terminal 20 transmits image information on the subject 10 detected by an image sensor (CCD, etc.) for image capturing in the terminal to the server 30. In addition, the portable terminal 20 transmits the five senses information received through the parabolic antenna to the server 30. The location related information, the image information, and the five sense information transmitted to the server 30 are stored in the account space of the user of the portable terminal 20 existing in the server 30.

After operation 202, the server 30 detects the position of the subject 10 using the received position related information, image information, and five sense information, and detects identification information corresponding to the detected position of the subject 10 ( Step 204). The server 30 detects a location corresponding to the location related information, the image information, and the five senses information by using the virtual map space model information including the photographing location information of the virtual subjects in the virtual photographing space.

The virtual map space model information is the same as when shooting by collecting the focus of the photographer (the center focus of the camera), that is, the shooting angle (the degree of tilt of the camera) and the azimuth, altitude, and GPS location point of the camera, as in the real world. Virtual map space model information registered at a place point. This is to match all the standard points to the photographing positions of individual users, and to individually register the photographing positions at the time of collecting and registering them. Therefore, in the virtual map space, the sharpness of the image and the video varies depending on the photographer's photographing altitude, photographing angle, photographing azimuth angle, GPS point, and the like. The images of individual users collected during the information shooting are configured in the same information environment as the shooting focus (center focus on the device) during the shooting.

When a photographer photographs a subject of interest (a person, an object, a product, etc.) of interest, an image sensor of a lens mounted in the camera recognizes light and measures a distance from the subject. The camera of the portable terminal 20 automatically orders motor movement according to settings such as magnification and angle of view until the image related to the focus (depth of field) portion of the specific image being photographed is clearest. Finding the maximum sensitivity of the lens and subject, that is, the best mode. At this time, the image sensor is the center of the camera lens, there should be a standard position of the part to rotate the motor. User focus within the shooting screen allows the user to align the subject of interest (person, object, product, place, information, animal, plant, nature, etc.) with the center of focus of the shooting screen, Touch the screen to recognize the contents (simultaneous contents can be recognized at the same time), or when wearing smart glasses, the server computer can recognize this by looking at a specific content area on the screen and blinking the eyes quickly. In the case of DSLR-class cameras, even when the subject (interested content) moves, the moving distance is measured and transmitted to the motor, so that it can be easily tracked.

The server 30 may maximize the light information of the subject collected in the lens based on the GPS position, the altitude, the azimuth, the shooting angle, the moving direction, the moving speed, and the like corresponding to the position-related information of the subject transmitted from the portable terminal 20. Find the sensitivity point and track it continuously (following the subject's movement), and calculate the image sensor and the actual distance to the subject. The server 30 recognizes a calculation difference of a focus recognition method (distance calculation method with a subject) of a lens according to the camera type of various portable terminals, and the user is interested in the image even if the user captures the image through any photographing device. When collecting location information of the content, it performs a function of securing and reprocessing the collection information so as to obtain the same subject location information as other photographic device users. To this end, the server 30 automatically collects the individual photographing lens type (depending on the magnification and angle of view) from the application of the portable terminal, and calculates the distance through the maximum sensitivity time point calculated by the image sensor of the camera according to the lens difference. Differentiate, secure and rework.

That is, it has different image sensors (size, number of pixels, type of sensor (CCD / CMOS)) according to camera type and manufacturer (smartphone, compact, mirrorless, DSLR, etc.). The camera's image sensor combines (or uses a single method) the calculation of finding and focusing the maximum contrast point (or using a single method) to instruct the most optimal image to be delivered to the image sensor. Prior art) difference is bound to occur. The server 30 utilizes information such as camera image sensation (cameraimagesensor.com) to know the size and pixel information of each type of camera manufacturer in the device and the image sensor of the device. Collect. Or, collect information about the direct image sensor mounted on a specific photographing device from the manufacturer. Thereafter, each camera device is placed in a measurement circular position reference point in a virtual circular space (10m in width, 10m in height, 10m in height) of a certain circular shape. This measurement standard position reference point is located at the center point in the circular shooting space.

In the circular virtual shooting space, electronic sensors are mounted at regular intervals toward the center of the image sensor in the camera. Electronic sensors can change position by moving along coordinates. Each individual electronic sensor has a different position coordinate, altitude, angle, and azimuth from the image sensor position, and these values are automatically collected by attaching a measuring device that can measure it in the electronic sensor.

These individual electronic sensors are the same as the position of the subject, and the measurement standard position reference point can be understood as the position of the camera. At the time of shooting, all the electromagnetic sensors are located at the same constant distance point (from the image sensor position), and are connected with the captured image to connect the position of the image by the image sensor and the individual position information during the shooting. Therefore, the server 30 collects position information from the image sensor position of the captured image. Therefore, when a specific individual electronic sensor in the photographed image is clicked with a hand or a mouse, it performs a function of showing position information from the image sensor of the individual electronic sensor. Such shooting is repeated several times in the same shooting environment, thereby reducing the error range through averaging the location information of the collected individual image sensors. In addition, in the circular shooting space, it actually makes a difference in the movement period and position change of the sun (and the source of the light), and provides a shooting environment similar to the real life shooting. By forming the angle and position of different lights, the error range is reduced by averaging the change of position information of individual electronic sensors. In order to analyze the data such as the actual shooting environment, the photographing device located at the reference point of measurement standard image is taken with different position coordinate information, azimuth, altitude, and tilt, and the collected image and the image of the subject (individual electronic sensor) in the image The location information based on the sensor is collected and stored in association with the specific image sensor location information of the server and the individual image sensor location information. Through repeated creation and shooting of similar environment in the same shooting environment (in the same specific image sensor location information and individual image sensor location information, or the same specific image sensor location information and individual image sensor location information, the sun (source of light) information) However, since the error range is reduced by averaging the location information values of the collected individual electronic sensors, it is possible to accurately measure the location information of the subject even in various shooting environment changes that may occur when shooting in a real environment. In this case, the location information of the specific subject photographed in the real environment (based on the image sensor position) is located on the same image distance in the same (or maximum similar) photographing environment collected in the database of the server 30. The image is calculated by comparing the average position information of the subject recognized by the image sensor (contrast focus method and phase difference focus method, etc. according to the usage method of each camera), and through this, the server 30 is a real time position of the photographing device (image sensor). Based on the coordinate information, the location information is calculated by linking the most similar object location point in the most similar shooting environment with the collected DB information in the DB. This function is divided into the case where different lenses are photographed using different magnifications (different angles of view) for each same shooting camera, and the database is collected. The same (very close) location of the same subject, even if all users shoot with different cameras and camera lenses, using the integrated model name of the camera lens and the model name of the camera lens in use, or by automatically recognizing the application information. Allows you to detect information.

The server 30 detects the identification information of the subject by using the image information and the five sense information of the subject together with the detected position information. Here, the identification information of the subject corresponds to index information for specifying which subject is the subject photographed by the portable terminal 20. The server 30 stores image information about a subject in advance in a database (not shown). Therefore, when the subject image information photographed by the portable terminal 20 is received, the server 30 compares the image information stored in the database with the received image information, so that the corresponding subject is the object identification information. Detect. In addition, the server 30 stores five sense information about the subject in advance in a database (not shown). Therefore, when the five sensed information collected through the parabolic antenna is received by the portable terminal 20, the server 30 compares the five sensed information stored in the database with the received five sensed information, which is the corresponding subject, that is, the subject Detects identification information.

In addition, the server 30 collects in real time the location-related information of the subject 10 periodically transmitted from the user terminal (not shown) of the subject 10, and based on the collected real-time position information of the subject 10 It is detected whether the subject photographed by the portable terminal 20 corresponds to the subject. A user terminal such as a smartphone of the subject 10 transmits the location information of the user terminal itself to the server 30 in real time (or once every 10 minutes or 1 minute in consideration of a battery condition). The location information of the subject 10 transmitted to the server 30 is stored in a personal account of the corresponding user terminal. Therefore, the server 30 may specify a subject corresponding to the position related information of the subject transmitted from the portable terminal 20 among the position information of the subject 10 stored in real time. In addition to calculating the position recognition of the subject, in order to increase the accuracy, the location information of the subject detected by the server 30 and the portable terminal 20 are detected by using the Bluetooh and WiFi functions, etc. built in the portable terminal 20. By retrieving the Bluetooh and WiFi transmission / reception AP information present in the surrounding area, the width of the object to be recognized can be minimized. That is, by identifying the user terminals of the subjects in a short distance by using APs of wireless signals such as Bluetooth and WiFi, which are located near the server 30, the portable terminal 20, the time for specifying the subject can be shortened as much as possible. Can be.

On the other hand, when the subject 10 does not have a user terminal capable of confirming the location information, the server 30 is the electronic device AP information and recognition around the position of the subject 10 (within 1m ~ 10m periphery) Search for possible WLAN signal information and the like and detect a subject having the highest matching rate with the image, shape, color, and five sense information (collected in real time) of the subject photographed by the portable terminal 20 among the related objects. .

For example, if a subject is photographed on the street and there is no means for acquiring the location information of the subject itself, an electronic device capable of identifying the AP of a specific residential area adjacent to the subject (exists in a house where the figure stands). The WLAN signal, the GPS signal of the navigation present in the vehicle, the WLAN signal information around the interested person, etc.), and the shape, shape, shape, By comparing 5D Plus information and the like (collected), the object is searched for by finding the highest matching rate. On the other hand, if there is no electronic device or wireless LAN signal that can identify the AP around the person, the latest subject showing the highest matching rate with the person by analyzing the five senses information such as the shape and color of the subject collected during the shooting. Detect information. In this case, unlike the conventional face recognition method, unlike the previous face recognition technology that finds the most similar image information by analyzing the pixels of the simple image, the five sense information of the subject collected during the shooting are collected. Collecting, analyzing, and comparing to identify the subject with the highest matching rate.

After operation 100, the server 30 extracts source information corresponding to the subject 10 using the detected identification information (operation 102). The source information includes advertisement registration information corresponding to the subject 10. For example, when the subject 10 is a human, information such as clothes (shoes, shoes, bags, etc.) worn by the subject corresponds to advertisement registration information. First, the subject directly transmits source information, that is, advertisement registration information to a server. In the case of registering at 30, the server 30 detects a subject having the highest matching rate based on the five senses information such as the photographed image, color, shape, and tactile sense and location-related information, and the source information corresponding to the subject. On the other hand, if source information registered directly by a subject (person) does not exist, images, colors, shapes, and images collected from source information registered by other third parties (company, sponsor, advertiser, etc.) related to the subject It extracts the source information that shows the highest matching rate with the five sense information such as tactile sense, etc. Also, the historical data collected in real time through the server 3 built-in program that collects user's purchase information Detect source information showing the highest matching rate among items purchased from the user's online or offline search and interest search information, and information of other users recently tagged with the subject or linked with related information. Source information showing the highest matching rate (reliability) may be extracted.

After step 102, the server 30 transmits the extracted source information to the portable terminal 20 connected to the wired / wireless network (step 104).

After step 104, the portable terminal 20 displays the source information transmitted from the server 30 (step 106). As source information is displayed on the display screen of the portable terminal 20, the user of the portable terminal 20 may be curious about source information (eg, clothes, shoes, etc. worn by the subject). Ad registration information) can be checked immediately.

On the other hand, when the portable terminal 20 transmits a message to the user terminal of the subject to the server, the server 30 transmits the message transmitted from the portable terminal 20 to the user terminal of the subject. Accordingly, the user terminal of the subject displays a message transmitted from the server. In addition, the server 30 detects the location information of the portable terminal 20 and transmits the detected location information to the user terminal of the subject. Accordingly, the user terminal of the subject displays the location information of the portable terminal 20 transmitted from the server.

Hereinafter, a portable terminal 20 and a server 30 for providing subject source information through photographing a subject according to the present invention will be described with reference to the accompanying drawings.

4 is a block diagram of an embodiment for explaining a portable terminal for providing subject source information through photographing a subject according to the present invention. The image information detection module 300, the position information detection module 310, and a parabolic antenna are shown. 320, a data storage module 330, a terminal interface module 340, and a terminal control module 350.

When the user executes a software (application) for the subject positioning function of the portable terminal 20 such as a smartphone (or 3G, 4G, LTE, CDMA, an electronic device and a terminal with internet connection), the following functions are performed. It will work.

The image information detection module 300 detects image information of an image sensor according to photographing a subject. The image information detection module 300 is a camera device including an image sensor for capturing an image of a subject. The image information detection module 300 photographs an image of a subject and acquires photographed image information.

The location information detection module 310 detects location related information including GPS location, altitude, azimuth, photographing angle, photographing magnification, and angle of view. Position information detection module 310 is azimuth (horizontal angle measured clockwise to a sideline with respect to the north), deviation (degree of the left / right from the check point), altitude difference (up / down difference from the check point) as position-related information ), The distance (distance from the check point), and the like are detected.

The parabola antenna 320 scans radio waves to the subject 10 and receives five sense information of the subject through reflected waves reflected from the subject. The parabola antenna 420 receives sensory information of the visual, auditory, taste, haptic, and olfactory senses of the subject as the five senses information. In particular, the parabola antenna 420 receives material image information such as appearance image information and tactile information as visual information of the subject 10. do.

The data storage module 330 stores the image information detected by the image information detection module 300, the position related information detected by the position information detection module 310, and the five sense information collected by the parabolic antenna 320, respectively. .

The terminal interface module 440 may include image information detected by the image information detection module 300, position related information detected by the location information detection module 310, and five sense information collected by the parabolic antenna 320, respectively. 30).

The terminal control module 450 controls operations of the image information detection module 400, the location information detection module 410, the parabolic antenna 420, the data storage module 430, and the terminal interface module 440.

In addition, as described above, the portable terminal is configured integrally with the portable terminal to collect the five senses information, or includes a detachable five sense information device (not shown) detachable and attachable to the portable terminal. The five sense information devices include an image analyzer for collecting image information of an object, an olfactory analyzer for collecting olfactory information, an audio analyzer for collecting auditory information, a taste analyzer for collecting taste information, and a tactile analyzer for collecting tactile information. have.

5 is a block diagram of an embodiment for explaining a server for providing subject source information through photographing a subject according to the present invention. The interface unit 400, the identification information detector 410, and the source information extractor 420 are illustrated in FIG. ), The information storage unit 430 and the control unit 440.

When receiving the position-related information, the image information and the five senses information of the subject from the portable terminal 20, each component of the server 30 performs the following operation.

The interface unit 400 receives image information, location related information, and five sense information transmitted from the portable terminal 20. To this end, the interface unit 400 is connected to the portable terminal 20 and a wired or wireless network.

The identification information detector 410 detects the identification information of the subject by using the received image information, the location related information, and the five sense information.

The identification information detector 410 detects the location of the subject using location related information including the GPS location, altitude, azimuth, shooting angle, shooting magnification, and angle of view transmitted from the portable terminal. Thereafter, the identification information detector 410 detects the identification information corresponding to the position of the subject by using the image information of the image sensor according to the photographing of the subject and the five sense information of the subject collected by the portable terminal using a parabolic antenna. do.

The identification information detector 410 detects the position of the subject using the virtual map space model information including the photographing position information of the virtual subjects in the virtual photographing space, and also detects the position of the subject transmitted from the user terminal of the subject. The location-related information is collected in real time, and the identification information is detected based on the collected real-time location information of the subject.

The virtual map space model information is the same as when shooting by collecting the focus of the photographer (the center focus of the camera), that is, the shooting angle (the degree of tilt of the camera) and the azimuth, altitude, and GPS location point of the camera, as in the real world. Virtual map space model information registered at a place point. The identification information detecting unit 410 collects light information of the subject collected in the lens based on the GPS position, the altitude, the azimuth, the photographing angle, the moving direction, the moving speed, and the like corresponding to the position-related information of the subject transmitted from the portable terminal 20. Find the maximum sensitivity of the camera and track it continuously (following the subject's movement), and calculate the image sensor and the actual distance to the subject. The server 30 recognizes a calculation difference of a focus recognition method (distance calculation method with a subject) of a lens according to the camera type of various portable terminals, and the user is interested in the image even if the user captures the image through any photographing device. When collecting location information of the content, it performs a function of securing and reprocessing the collection information so as to obtain the same subject location information as other photographic device users. To this end, the server 30 automatically collects the individual photographing lens type (depending on the magnification and angle of view) from the application of the portable terminal, and calculates the distance through the maximum sensitivity time point calculated by the image sensor of the camera according to the lens difference. Differentiate, secure and rework.

The identification information detecting unit 410 has different image sensors (size, number of pixels, types of sensors (CCD / CMOS)) according to camera type and manufacturer (smartphone, compact, mirrorless, DSLR, etc.). Therefore, the camera image sensor finds and focuses the maximum contrast point within the same field of view (combining the contrast focus method and the phase difference focus method on the subject (or using a single method) so that the most optimal image is obtained). The prior art to command to be delivered to) is bound to occur. The server 30 utilizes information such as camera image sensation (cameraimagesensor.com) to know the size and pixel information of each type of camera manufacturer in the device and the image sensor of the device. Collect. Or, collect information about the direct image sensor mounted on a specific photographing device from the manufacturer. Thereafter, each camera device is placed in a measurement circular position reference point in a virtual circular space (10m in width, 10m in height, 10m in height) of a certain circular shape. This measurement standard position reference point is located at the center point in the circular shooting space.

In the circular virtual shooting space, electronic sensors are mounted at regular intervals toward the center of the image sensor in the camera. Electronic sensors can change position by moving along coordinates. Each individual electronic sensor has a different position coordinate, altitude, angle, and azimuth from the image sensor position, and these values are automatically collected by attaching a measuring device that can measure it in the electronic sensor. camera

These individual electronic sensors are the same as the position of the subject, and the measurement standard position reference point can be understood as the position of the camera. At the time of shooting, all the electromagnetic sensors are located at the same constant distance point (from the image sensor position), and are connected with the captured image to connect the position of the image by the image sensor and the individual position information during the shooting. Therefore, the server 30 collects position information from the image sensor position of the captured image. Therefore, when a specific individual electronic sensor in the photographed image is clicked with a hand or a mouse, it performs a function of showing position information from the image sensor of the individual electronic sensor. Such shooting is repeated several times in the same shooting environment, thereby reducing the error range through averaging the location information of the collected individual image sensors. In addition, in the circular shooting space, it actually makes a difference in the movement period and position of the sun (and the source of the light), providing a shooting environment similar to real life shooting. By forming the angle and position of different lights, the error range is reduced by averaging the change of position information of individual electronic sensors. In order to analyze the data such as the actual shooting environment, the photographing device located at the reference point of measurement standard image is taken with different position coordinate information, azimuth, altitude, and tilt, and the collected image and the image of the subject (individual electronic sensor) in the image The location information based on the sensor is collected and stored in association with the specific image sensor location information of the server and the individual image sensor location information. Through repeated creation and shooting of similar environment in the same shooting environment (in the same specific image sensor location information and individual image sensor location information, or the same specific image sensor location information and individual image sensor location information, the sun (source of light) information) However, since the error range is reduced by averaging the location information values of the collected individual electronic sensors, it is possible to accurately measure the location information of the subject even in various shooting environment changes that may occur when shooting in a real environment. In this case, the positional information of the specific subject photographed in the real environment (based on the image sensor position) is located on the same image distance in the same (or maximum similar) photographing environment collected in the information storage unit of the server 30. It is calculated by comparing with the average position information of the subject recognized by the image sensor (recognition according to the use method for each camera such as the contrast focus method and the phase difference focus method), and through this, the identification information detector 410 is a photographing device (image sensor Based on the real-time position coordinate information, the position information is calculated by linking the most similar subject position point in the most similar shooting environment with the collected DB information in the DB. This function is divided into the case where different lenses are photographed using different magnifications (different angles of view) for each same shooting camera, and the database is collected. The same (very close) location of the same subject, even if all users shoot with different cameras and camera lenses, using the integrated model name of the camera lens and the model name of the camera lens in use, or by automatically recognizing the application information. Allows you to detect information.

The identification information detector 410 detects the identification information of the subject by using the image information and the five sense information of the subject together with the detected position information. Here, the identification information of the subject corresponds to index information for specifying which subject is the subject photographed by the portable terminal 20. The identification information detector 410 stores image information about the subject in the information storage unit 430 in advance. Therefore, when the subject image information photographed by the portable terminal 20 is received, the identification information detecting unit 410 compares the image information stored in the information storage unit 430 with the received image information to determine which of the corresponding subjects is the same. That is, the identification information of the subject is detected. In addition, the information storage unit 430 stores five sense information about the subject in the information storage unit 430 in advance. Therefore, when the five sensed information collected through the parabolic antenna is received from the portable terminal 20, the identification information detector 410 compares the five sensed information stored in the information storage unit 430 with the received five sensed information, Which of the subjects is used, that is, identification information of the subject is detected.

In addition, the identification information detecting unit 410 collects in real time the position-related information of the subject 10 periodically transmitted from the user terminal (not shown) of the subject 10, the real-time position information of the collected subject 10 On the basis of the detection, whether the subject photographed by the portable terminal 20 corresponds to the subject. A user terminal such as a smartphone of the subject 10 transmits the location information of the user terminal itself to the server 30 in real time (or once every 10 minutes or 1 minute in consideration of a battery condition). The location information of the subject 10 transmitted to the server 30 is stored in a personal account of the corresponding user terminal. Therefore, the server 30 may specify a subject corresponding to the position related information of the subject transmitted from the portable terminal 20 among the position information of the subject 10 stored in real time. In addition to calculating the position recognition of the subject, in order to increase the accuracy, using the Bluetooh and WiFi functions built in the portable terminal 20, the identification information detector 410 may detect the position information of the subject detected by the server 30. By searching for Bluetooh and WiFi transmission / reception AP information present in the vicinity of the portable terminal 20, the width of the object to be recognized by the subject can be minimized. That is, by identifying the user terminals of the subjects in the near distance by using the AP of the wireless signal such as Bluetooth, WiFi, etc. that exist near the portable terminal 20, the time for specifying the subject may be shortened as much as possible.

On the other hand, when the subject 10 does not have a user terminal capable of confirming the location information, the identification information detector 410 is the electronic device AP information that exists around the position of the subject 10 (within 1m ~ 10m periphery) And searching for recognizable WLAN signal information and the like, and displaying the image, shape, color, and five sense information (collected in real time) of the subject photographed by the portable terminal 20 among the related objects. Detect.

For example, if a subject is photographed on the street and there is no means for acquiring the location information of the subject itself, an electronic device capable of identifying the AP of a specific residential area adjacent to the subject (exists in a house where the figure stands). The WLAN signal, the GPS signal of the navigation present in the vehicle, the WLAN signal information around the interested person, etc.), and the shape, shape, shape, By comparing the five senses information and the like to find the highest matching rate information to identify the subject. On the other hand, if there is no electronic device or wireless LAN signal that can identify the AP around the person, the latest subject showing the highest matching rate with the person by analyzing the five senses information such as the shape and color of the subject collected during the shooting. Detect information. In this case, unlike the conventional face recognition method, unlike the previous face recognition technology that finds the most similar image information by analyzing the pixels of the simple image, the five sense information of the subject collected during the shooting are collected. Collecting, analyzing, and comparing to identify the subject with the highest matching rate.

The source information extracting unit 420 extracts source information corresponding to the subject by using the detected identification information. The source information includes advertisement registration information corresponding to the subject 10. The subject (person) registers source information with the server 30 in advance through the authentication procedure.

For example, when the subject 10 is a human, information such as clothes (shoes, shoes, bags, etc.) worn by the subject corresponds to advertisement registration information. First, the subject directly transmits source information, that is, advertisement registration information to a server. In the case of registering at 30, the source information extracting unit 320 detects a subject having the highest matching rate based on the five senses information such as the photographed image, color, shape, and tactile sense and location related information, and corresponds to the subject. On the other hand, if there is no source information registered directly by the subject (person), the source information extracting unit 320 may be a source registered by another third party (company, sponsor, advertiser, etc.) with respect to the subject. Among the information, source information showing the highest matching rate is extracted from the collected images, colors, shapes, tactile senses, etc. In addition, the source information extracting unit 320 collects user purchase information. By using Ponc (a program embedded in the server 3), it is possible to detect items purchased in real time on-offline of the past user collected in real time, or source information showing the highest matching rate among search information of interest. The source information extracting unit 320 may extract source information showing the highest matching rate (reliability) among information of other users who are recently tagged with the subject or linked with the related information.

The information storage unit 430 stores the identification information detected by the identification information detection unit 410 and the source information extracted by the source information extraction unit 420. In addition, the information storage unit 430 stores the image information and the five sense information to be compared for the identification information extraction.

The interface unit 400 transmits the source information extracted by the source information extracting unit 420 to the portable terminal 20 under the control of the controller 440.

The controller 440 controls the operations of the interface unit 400, the identification information detector 410, the source information extractor 420, and the information storage unit 430.

The portable terminal 20 receiving the source information from the server 30 displays the source information on the display screen. Therefore, the user of the portable terminal 20 can immediately check the source information (for example, advertisement registration information such as clothes, shoes, etc. worn by the subject) of the subject photographed through the camera.

On the other hand, when the portable terminal 20 transmits a message to the user terminal of the subject to the server, the server 30 transmits the message transmitted from the portable terminal 20 to the user terminal of the subject. Accordingly, the user terminal of the subject displays a message transmitted from the server. In addition, the server 30 detects the location information of the portable terminal 20 and transmits the detected location information to the user terminal of the subject. Accordingly, the user terminal of the subject displays the location information of the portable terminal 20 transmitted from the server.

Hereinafter, the contents of the present invention described above will be described based on cases.

6 is a reference diagram illustrating an operation of a device for photographing a subject by a user on a portable terminal.

As shown in FIGS. 6A and 6B, a subject positioning function of a portable terminal 20 such as a smartphone (or 3G, 4G, LTE, CDMA, an electronic device and a terminal which can be connected to the Internet), etc. Run the software (application) for the user, and touch the screen on the screen with the user's desired subject in the shooting screen. Then, the server 30 checks the position of the photographer on the GPS and recognizes the position of the subject (person, product, etc.) that the photographer wants to recognize the source.

7 and 8 are reference diagrams for explaining location recognition of a server. Recognizing the position of the person on the camera 30, the user's selection (touch where the user wants to be recognized by hand on the screen, or location recognition based on the center of focus (focus) of the portable terminal 20) The exact position of the individual content collected via radio waves emitted from a special parabolic antenna mounted on the camera (only shooting angles or special fixed or floating content) (detailed coordinates on the camera's GPS (indoor, wireless data transmission signals) To find the AP address, and use the detailed GPS coordinate recognition method using the gyroscope in the device) based on the position recognition of the portable terminal 20. At this time, the photographed image of the international standardized portable terminal 20 Calculations such as size and shooting angle (which are in) and calculation of azimuth, deviation, altitude difference, distance, etc. of individual content are used. The location information and shape, shape, motion, speed, and direction of individual content collected through the emitted microwaves (etc.) can be collected at the same time, and sourced and ad coded together on the specific content location. .

9 to 13 are reference diagrams for describing contents related to source information registration.

At certain offline locations, image / video photographers can collect information (through automatic and manual recognition) about a number of people, objects, goods, places, plants, and animals that want to be source-identified in the photo shoot.

At this time, depending on whether or not the character discloses his or her information, it can be set.In the case of disclosure, the mobile terminal (and the electronic device with Bluetooth function) that the user has information about the person in the picture ) May be recognized by the photographer's mobile phone terminal (or photographing device) to execute source recognition (search) for the user, and information about the person approved for disclosure may be retrieved at this time.

Once the source identification (such as the ID and name of the character) is made on the picture screen (or video), the source recognition of the character's clothes, shoes, hats, and accessories is made online. Because the search takes place (based on real-time user-defined value criteria, searching for the most valuable information + the information that is highly relevant to the source-aware request), you can actually purchase these items that the person is wearing.

If a user makes a purchase by searching for a product, information, advertisement, link, or site worn by the person, the seller of the product is distributed to the person (in character) at a certain rate. . In addition, real-time live photo / video services recognize various advertisements, content, and information sources for related products such as all persons or products, intangible and tangible products, or any form of information (specific to the image of the person or product). Linking Sources) It can be used for specific sources, advertisements, product sales, consumer induction, campaigns, and information delivery.

All users advertise their clothes, goods, or goods in advance (or in consultation with) the seller (or similar goods sellers) in advance, which results in revenues, such as product sales or user subscriptions. In this case, it can be distributed regularly with the corresponding product companies.

If you advertise in advance with a company (similar to a sponsor), the company will register a 360-degree (up, down, left, right) stereoscopic image of the product as an online (or site) source and sponsor the product. You can associate a particular person's name, ID, or URL with this source. Products that have been registered in advance for online source recognition are more likely to be value searched for users more easily (mainly on products that are source-recognized when matching search after analyzing images, shapes, and colors on the screen of a computer). Since the search is primarily made, it is easy to search the source of the product from the user's point of view).

Users can simply register the source identification of their clothes (the name, product number, company name, etc. of the clothes they are wearing online), the date and time they were dressed, and the place they were wearing (region, location, road, Information such as distance, etc., you can register it online, and select the gender, age, location, occupation, etc. of the user who wants to disclose the source information (and also the specific user base, area, age, Or you can set the date, day of the week, etc. you want to keep private).

In addition, when a user walks down the street wearing source registered clothes (or goods, advertisements, information, etc.), the user is interested in the street and tries to shoot (shooting to identify the source that people who are interested in himself have) Because users need to identify who they are, they need to have a product that enables Bluetooth and GPS satellite positioning (such as mobile phones and terminal devices) and activate the above function.

If the user is walking in the street wearing the source registered clothes and the users who are interested in it have taken the user (take a picture or take a video), the server 30 has two users (the photographer, the source). Satellite positioning of the user wearing the registered product, and Bluetooth interworking is started automatically, and the photographer focuses on the person or product whose focus is on the device, or who wants to recognize the source on the screen. Find and tap on the screen, or focus and press the corresponding source recognition button to find the AP signal (such as Bluetooth and GPS AP addressable electronics and WLAN signals) at the location of the part and find the provider (Find the nearest AP address within an amplitude of at least 1m and recognize it as a user of the device, At this time, for more accurate identification, 5D Plus information such as the shape and shape of the corresponding content may be collected through a radio wave emitted from a special Bharabola antenna and matched with the collected AP address to match the user). It will provide the photographer with the most up-to-date portrait information with the highest matching rate.

Photographs and video clips taken by the photographer will be registered online (various blog windows, social network spaces such as SNS networks, Facebook, Twitter, and search box (Naver, Google)). The video can be retrieved online and provided with the same service, ie if the photographer shoots a specific person or product and registers online (for example, uploading a photo taken yesterday to Facebook). ), Other users see it and recognize people or objects appearing in the picture and video in real time, and are simultaneously stored in the picture or video file.

The source stored at the same time on the image is shared with the picture when the general public sees the picture (where the source person appears) or the video through an electronic device such as a mobile phone or a computer (Internet connection is required). Although not provided concurrently, when the user presses the source identification button above the image screen, it floats over the photo (and video) image. In this case, in the code source, GPS real-time positioning of the person, goods, sculptures and electronic equipment (or special device) of the photographer at the time of shooting and detailed GPS position coordinate recognition using a gyroscope And recognition of shooting angles), recognition of the photographer's focus through the use of microwaves using special parabola antennas, location information of interest content, recognition of the five senses information information, and measurement of camera altitude and altitude of the content of interest based on international standard mean sea level for each country. Source and advertisement code information about the content of interest provided through the information implies information related to the name of the person (product, etc.) or the company trademark, company name, provider, etc. connected to the Internet. Viewers can see the sources that their electronic devices (such as mobile phones and computers) have automatically recognized and stored within the screen of the picture (or video), and also search for the product online or offline. Among the information presented, you can see them listed by the most valuable ranking. With this, users can now collect, deliver, and share all real-time events, online, offline, and people, goods, and advertisements in the real world, not via TV, the Internet, or radio.

Using the present invention, all users now have access to the vast array of information available online and offline, including direct photography, video, live view and live maps, rather than in the same way as TV, radio, email, phone numbers, knowledge and keyword searches. You can use the feature to get information about that source. All image and video data produced by the above invention system (in order to imply the source, GPS positioning function, Bluetooth function, special parabola antenna, detailed GPS location tracking and shooting angle calculation are performed on the camera at the time of shooting. It is possible to use the information of the above technology system even if only one of the special gyroscopes and wireless communication devices (WiFi, 2G, 3G, 4G, etc.) that can detect or send wireless LAN signals can be used. When it is registered and shared among users, special source and Gwangko Code 5D Plus information is implied so that it is not visible on the content (the name or ID of the person, product name, company name, etc. that existed on the content screen at that time). Information).

When other users are viewing the photo (and videos), and need source recognition for products, interests, and information they like in the photo (such as a blog or social network), When the view button is pressed, the source information of the person and goods are displayed on the picture (the original picture becomes white on the screen, and the buttons are located on the screen.) If you click it, you can check the recognized information (person name, brand name, etc.) about the corresponding source part.

For information on people or products without source recognition, users can select the part that they want to recognize by hand or mouse (drawing by selecting the outline) to order the value search based on the user-defined value reference point for this part. The server 30 may be found as similar as possible information about the portion on or offline to provide the highest value by rank.

If the source recognition part, the user inputs the source information (person name, brand name, company name, etc.) recognized in the search range and searches for the part (source, shoes, street, hat, face, etc.) that you want to recognize the source, (30) first checks whether the relevant part of the source (clothes, shoes, street, hat, etc.) and the related source are registered in the corresponding search range (if the name of the person) and compares the shape, color, pattern, etc. of the image, The category is recognized as clothes (user can input the category arbitrarily), and among the clothes uploaded by the person within the range, the most similar information is found and provided. It will be displayed in the value information search box first, and the most similar valued information will be listed in green and listed after the purple information by rank. In addition, the unrecognized part is displayed in red, and the source information uploaded by the user is displayed in black, and the information registered at a national agency or government office is displayed in blue, etc. In the photo (in the content screen) The user's data that does not want to disclose the data on the product (source recognition part) is stored so that the source is recognized and implied on the photo, even if the public tries to recognize it, the source information is controlled so that the personal information is controlled. There is no problem with protection.

Revenue can be generated through the automatic sale and distribution of source and content sources for individual users through the present invention. In other words, the user can directly register a source, receive an advertisement (sponsor), or register information about an object, a person, a product, etc. appearing on the screen when taking a picture / video. It provides a way of communication more advanced than that. The above invention system utilizes microwaves emitted from a special parabolic antenna terminal built into a photographing device when an individual user is photographed, and an altitude and a photographing angle of an image and a video present on a photographing screen of a camera and a smartphone. It collects information such as position, direction, movement, speed, shape, and identity information with the photographing camera. Through screen source selection (source or part recognition with hand or mouse), it automatically collects all kinds of information provided (created) in all real worlds in real time and makes it available for online information.

Meanwhile, the method inventions of the present invention described above can be implemented as computer readable codes / instructions / programs. For example, it may be implemented in a general-purpose digital computer that operates the code / instructions / program using a computer-readable recording medium. The computer-readable recording medium includes a storage medium such as a magnetic storage medium (e.g., a ROM, a floppy disk, a hard disk, a magnetic tape, etc.), an optical reading medium (e.g., a CD-ROM, a DVD, .

Such a method of providing subject source information through photographing a subject of the present invention, and a server and a portable terminal therefor have been described with reference to the embodiment shown in the drawings for clarity, but this is merely illustrative and is common knowledge in the art. Those skilled in the art will appreciate that various modifications and equivalent other embodiments are possible therefrom. Accordingly, the true scope of the present invention should be determined by the appended claims.

10: subject
20: portable terminal
30: Server

Claims (22)

Photographing a subject using a portable terminal equipped with a camera, the server detecting the identification information of the subject using location information of the subject provided from the portable terminal;
Extracting source information corresponding to the subject by the server using the detected identification information; And
And transmitting, by the server, the extracted source information to the portable terminal. The method of claim 1, wherein the detecting of the identification information of the subject comprises:
Detecting, by the portable terminal, location-related information including its GPS location, altitude, azimuth, photographing angle, photographing magnification, and angle of view and image information of an image sensor according to photographing of the subject;
The portable terminal transmitting the location related information and the image information to the server; And
And detecting, by the server, the position of the subject using the position related information and the image information, and detecting the identification information corresponding to the detected position of the subject. How to provide source information. The method of claim 2, wherein the detecting of the position of the subject using the position related information and the image information comprises:
The server detects a subject corresponding to the position-related information and the image information by using the virtual map space model information including the photographing position information of the virtual subjects in the virtual photographing space. How to provide subject source information through The method of claim 2, wherein the detecting of the identification information corresponding to the position of the subject comprises:
Collecting the position-related information of the subject transmitted from the user terminal of the subject in real time, and detecting the identification information on the basis of the collected real-time position information of the subject characterized in that How to Provide. The method of claim 2, wherein the detecting of the identification information of the subject comprises:
After detecting the location-related information and the image information, the portable terminal scanning a radio wave to the subject using a parabolic antenna and receiving five sensed information of the subject through reflected waves reflected from the subject; ,
When the portable terminal transmits the received five sense information to the server together with the location related information and the image information, the server detects the identification information using the location related information, the image information and the five sense information. A method of providing subject source information by photographing a subject. The method of claim 5,
The five senses information includes image information, olfactory information, taste information, auditory information, and tactile information of the subject. The method of claim 1,
And the source information includes advertisement registration information corresponding to the subject. The method of claim 1, wherein the method of providing subject source information by photographing the subject
And displaying, by the portable terminal, the source information transmitted from the server. The method of claim 1, wherein the method of providing subject source information by photographing the subject
When the portable terminal transmits a message to the server to be transmitted to the user terminal of the subject, the server transmits the transmitted message to the user terminal of the subject, and the user terminal displays the message transmitted from the server. Method for providing subject source information through the photographing of the subject, characterized in that. The method of claim 1, wherein the method of providing subject source information by photographing the subject
The server detects the location information of the portable terminal and transmits the location information to the user terminal of the subject, and the user terminal displays the location information transmitted from the server, the subject through the shooting of the subject How to provide source information. An identification information detector configured to detect identification information of the subject by using location information of the subject provided from the portable terminal when photographing a subject using a portable terminal equipped with a camera;
A source information extracting unit which extracts source information corresponding to the subject by using the detected identification information;
An interface unit for transmitting the extracted source information to the portable terminal;
An information storage unit for storing data including the identification information and the source information; And
And a control unit for controlling operations of the identification information detection unit, the source information extraction unit, the interface unit, and the information storage unit. The method of claim 11, wherein the identification information detecting unit
The position of the subject is detected by using the position-related information including the GPS position, altitude, azimuth, shooting angle, shooting magnification, and angle of view transmitted from the portable terminal and image information of the image sensor according to the shooting of the subject. And providing identification information corresponding to the position of the subject, wherein the subject source information is provided by capturing the subject. The method of claim 12, wherein the identification information detecting unit
A subject source through photographing a subject, wherein the position corresponding to the position related information and the image information is detected using the virtual map space model information including the photographing position information of the virtual subjects in the virtual photographing space. Server for providing information. The method of claim 12, wherein the identification information detecting unit
Collecting the position-related information of the subject transmitted from the user terminal of the subject in real time, and detecting the identification information on the basis of the collected real-time position information of the subject characterized in that Provision Server. The method of claim 11, wherein the identification information detecting unit
And when the portable terminal receives the five sensed information of the subject collected using the parabolic antenna, the identification information is detected using the received five sensed information. 16. The method of claim 15,
And the five senses information includes image information, olfactory information, auditory information, taste information, and tactile information of the subject. 12. The method of claim 11,
And the source information includes advertisement registration information corresponding to the subject. 12. The method of claim 11,
When the portable terminal transmits a message to the server to the user terminal of the subject, the server transmits the transmitted message to the user terminal, and the user terminal displays the message transmitted from the server A server for providing subject source information through shooting a subject. 12. The method of claim 11,
The server detects the location information of the portable terminal and transmits the location information to the user terminal of the subject, and the user terminal displays the location information transmitted from the server, the subject through the shooting of the subject How to provide source information. A location information detection module for detecting location related information including a GPS location, an altitude, an azimuth, a shooting angle, a shooting magnification, and an angle of view;
An image information detection module for detecting image information of an image sensor according to photographing of the subject;
A terminal interface module for transmitting the location related information and the image information to the server;
A data storage module for storing the location related information and the image information;
And a terminal control module for controlling the operations of the location information detection module, the image information detection module, the terminal interface module, and the data storage module. . The portable terminal of claim 20, wherein the portable terminal for providing subject source information by photographing the subject comprises:
And a parabolic antenna scanning radio waves on the subject and receiving five sensed information of the subject through reflected waves reflected from the subject.
And the terminal control module controls to transmit the received five sensed information to a server. The portable terminal of claim 20, wherein the portable terminal for providing subject source information by photographing the subject comprises:
In order to collect the five senses information, the portable terminal includes an integrated five sense information device, which is integrated with the portable terminal or detachable and attachable to the portable terminal.
The five senses information device may include an image analyzer for collecting image information of the subject, an olfactory analyzer for collecting olfactory information of the subject, an audio analyzer for collecting auditory information of the subject, a taste analyzer for collecting taste information of the subject, and the And a tactile analyzer for collecting tactile information of a subject, wherein the portable terminal for providing subject source information through photographing the subject.

Images