KR101998328B1 - A method control of motion recognition device using photographed image, and motion recognition method using same, server and program - Google Patents

Abstract

The present invention relates to control of a motion recognition device using a photographed image and a motion recognition method using the same. By analyzing a video made by photographing an image and a motion recognition device together to calculate an actual size of the image and scanning user touch on the image through the motion recognition device to analyze a touched area, various information may be provided to a user.

Description

Technical Field [0001] The present invention relates to a motion recognition apparatus using a photographed image, a motion recognition method using the same, a server and a program,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a control of a motion recognition device using a shot image and a motion recognition method using the same.

The motion recognition device refers to a device that moves the movement of an object or a person to the digital using a sensor. Methods of motion recognition are classified into mechanical, magnetic, and optical.

Light detection and ranging (LIDAR) is a device that measures the distance or atmospheric phenomenon by emitting pulsed laser light into the atmosphere and using the reflector or scattering body, which is also called a laser radar. The time measurement of reflected light is calculated by clock pulse, and its resolution is 5cm at its frequency of 30MHz and 1m at 150MHz, which shows superior detection efficiency than conventional cameras or sensors.

Therefore, if the principle of Lada is applied to the motion recognition device, the detection efficiency of motion will be high, and accurate motion recognition will be possible.

Attempts have also been made to attach / install a motion recognition device to a general image and provide various information as the user touches the image.

When such a technique is applied, it can be applied to various images such as a subway, a bus route map, an advertisement, a movie, a concert poster, etc., so that various information not included in the image can be provided to the user, It is not open to the public.

According to an aspect of the present invention, there is provided a method of controlling a motion recognition apparatus using a photographed image and a motion recognition method using the photographed image, wherein the image and the motion recognition apparatus analyze the photographed image to calculate an actual size of the image .

In addition, the present invention extracts an object image included in an image and stores coordinates of each object image so that the input information of the user scanned by the motion recognition device can be recognized using the captured image The control of the motion recognition device and the motion recognition method using the same can be provided.

In addition, the present invention can provide a control method of a motion recognition device using a photographed image and a motion recognition method using the photographed image, which provides various information corresponding to an object image to be touched by a user to a user.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems which are not mentioned can be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present invention, there is provided a method of controlling a motion recognition device using a captured image and a motion recognition method using the same, the method comprising the steps of: Receiving an image taken by the motion recognition device (Lidar) together; Calculating an actual size of the image based on the image and the actual size of the motion recognition device; And receiving identification information of the image.

Extracting one or more object images including pictures or characters included on the image, and storing coordinates of the images of the respective object images; And receiving tag information or content information of each extracted object image.

Receiving input information including a touch or a gesture of a user on the image scanned through the motion recognition device and recognizing at least one object image located at a coordinate corresponding to the input information; Extracting at least one object information through tag information or content information of the recognized object image; And providing the extracted object information through at least one of a display device, an audio output device, and a user terminal provided at a place where the image is located, wherein the motion recognition device rotates the reflector And obtaining coordinates of the input information including the user's touch or gesture on the image.

Receiving numerical information scanned through the motion recognition device, the numerical information being sequentially drawn on the image from a user; And identifying a terminal matching the numeric information as a user terminal.

Receiving input information of a first gesture of a user scanned through the motion recognition device; And providing the object information to the identified user terminal.

The information extracting step may extract at least one of representative information, real-time information, and announcement information of the image as object information when the recognized object image is a category image indicating identification information of the image.

If the input information of the user is a touch input to an image of an object, the information extraction step may extract the content information allocated to the object image as object information, The tag information of the object image is relatedly retrieved and the matched information is extracted as object information.

If the input information of the user is a touch and drag input from the first object image to the second object image, the information extraction step may include extracting the first object image and the second object image based on the identification information of the image, (Relational information) between the first object image and the second object image based on the identification information of the image or by searching the tag information of the second object image in real time based on the identification information of the image, Is extracted as object information.

If the input information of the user is a range specifying input including two or more object images, the information extracting step may include extracting at least one of two or more object images included in the range specifying input based on the identification information of the image Extracts common information between pieces of information by object information, or searches tag information of two or more object images included in the range designation input based on the identification information of the image in real time and extracts the matched common information as object information.

And setting a scanning range of the motion recognition device based on the calculated actual size of the image.

According to an embodiment of the present invention, there is provided a control method for a motion recognition device using a captured image and a motion recognition server using the same, the image recognition apparatus comprising a motion recognition device (Lidar) attached to one side of the image, A receiving unit receiving the photographed image and receiving identification information of the image; And a calculator for analyzing the image based on the actual size of the motion recognition device and calculating an actual size of the image.

In addition to this, another method for implementing the present invention, another system, and a computer-readable recording medium for recording a computer program for executing the method may be further provided.

The control of the motion recognition device using the captured image according to another embodiment of the present invention and the motion recognition program using the captured image may be performed by controlling the motion recognition device using the above- And stored in the medium.

According to the present invention as described above, there is an effect that the actual size of the image can be calculated on the basis of the image taken together with the motion recognition device and the actual size of the motion recognition device.

In addition, according to the present invention, there is an effect that a position touched by a user's touch input on a general image can be recognized through the coordinates of each object image included in the image and the motion recognition device.

In addition, according to the present invention, various information corresponding to an object image to be touched by a user is provided.

The effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

1 is a flowchart of a method of controlling a motion recognition apparatus using a photographed image according to an embodiment of the present invention and a motion recognition method using the same.
2 is a diagram illustrating a route map of Seoul Subway Line 2 as an image according to an embodiment of the present invention.
FIG. 3 is a view showing object images included in the image of FIG. 2. FIG.
Fig. 4 is a diagram illustrating a user touching a category image in the image of Fig. 2; Fig.
5 is a diagram illustrating a user performing a touch-and-drag input in the image of FIG.
FIG. 6 is a diagram illustrating a user performing range designation in the image of FIG. 2;
7 is a diagram illustrating a user performing a first gesture input in the image of FIG.
FIG. 8 is a diagram illustrating a user performing a touch input for drawing a number in the image of FIG.
Figure 9 is an illustration of a movie poster with an image according to an embodiment of the present invention.
10 is a diagram illustrating a user touching an object image of a trailer view in the image of FIG.
11 is a block diagram of a motion recognition server using the motion recognition device using the photographed image.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. It should be understood, however, that the invention is not limited to the disclosed embodiments, but may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, Is provided to fully convey the scope of the present invention to a technician, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element. Like reference numerals refer to like elements throughout the specification and "and / or" include each and every combination of one or more of the elements mentioned. Although "first "," second "and the like are used to describe various components, it is needless to say that these components are not limited by these terms. These terms are used only to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical scope of the present invention.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense that is commonly understood by one of ordinary skill in the art to which this invention belongs. In addition, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The motion recognition device 20 can acquire the distance and coordinates of the subject and recognize the motion of the subject.

Various conventional techniques can be used as the motion recognition device 20 of the present invention. However, it is preferable to use Lada as the motion recognition device 20 of the present invention.

Light detection and ranging (LiDAR) uses a light source such as a laser to measure the time taken to reflect back from the subject and back to the sensor to obtain the distance and coordinates of the subject.

On the other hand, general non-laser light can be emitted as the motion recognition device 20 of the present invention. Since the motion recognition device 20 of the present invention is widely used for acquiring the distance and coordinates of a near object, even if a general LED (light emitting diode) is used instead of a laser having a high optical density, This is because it enables more precise tracking than laser light.

In addition, the motion recognition device 20 according to the embodiment of the present invention may perform tracking by applying VCSEL or laser as well as LED as a light source.

As a typical example, a motion recognition device 20 may be provided in a display device such as a monitor or a TV not provided with a touch panel, so that the same effect as that of a touch function is inserted in the monitor or TV.

As described above, although the motion recognition device 20 is utilized in various fields, technologies such as attaching / installing the motion recognition device 20 to a general image and providing various information as the user touches the image are disclosed This is not the case.

The applicant of the present application has applied the motion recognition device 20 to a general image and a photograph, not a display device, by utilizing the advantages of the motion recognition device 20, and as a user touches an image or a photograph, The present invention has been made to provide various information.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a flow chart of a method of controlling a motion recognition device using a photographed image according to an embodiment of the present invention and a motion recognition method using the same, and FIGS. 2 to 8 illustrate a route map of Seoul Subway Line 2 And is used as an image to illustrate various situations.

Hereinafter, a control method of a motion recognition apparatus using a photographed image and a motion recognition method using the photographed image according to an embodiment of the present invention will be described with reference to FIG. 1 through FIG.

The control of the motion recognition device using the photographed image according to the embodiment of the present invention and the motion recognition method using the same are performed by a computer and will be described below as being performed mainly by the server 100 in the embodiment.

In addition, providing to the user terminal 300 in the embodiment of the present invention may be interpreted as a meaning provided through the service application installed in the user terminal 300. [

First, the receiving unit 110 of the server 100 receives the captured image together with the image 200 and the motion recognition device (Lidar) 20 attached or installed to one side of the image 200 from the terminal 300. (Step S500)

Preferably, the receiving unit 110 of the server 100 receives an image and a photograph taken by the motion recognition device 20 and the image 200 together, as shown in FIG. 2, by the administrator using the photographing means of the terminal 300 do.

At this time, the administrator who photographed the photographer may directly transmit the photograph to the server 100 via the terminal 300, provide the photographing mode by the service application itself provided by the server 100, , Photos may be automatically sent to the server.

The server 100 may provide a method and a guide for capturing an image to the terminal 300 of the administrator but may be applicable to any image or photograph including the motion recognition device 20 and the image 200 Therefore, the above items can be selectively employed.

Step S500 Next, the calculation unit 120 of the server 100 calculates the actual size of the image 200 based on the image received in step S500 and the actual size of the motion recognition device 20. [ (Step S510)

For example, the size of the image 200 in the captured image: the size of the motion recognition device 20 in the captured image = the size of the actual image 200: the size of the actual motion recognition device 20 And the size of the actual image 200 is calculated.

In addition to the proportional expression exemplified above, any method that can calculate the actual size of the image 200 based on the photographed image and the actual size of the motion recognition device 20 is applicable.

2 is a view illustrating a route map of Seoul Subway Line 2 as an image 200 according to an embodiment of the present invention. (For reference, only a part of subway line 2 was shown for convenience of explanation)

For example, when an administrator shoots an image (200, Seoul subway line 2 route map) in which the motion recognition device 20 is attached at the top as shown in FIG. 2 through the terminal 300, It is possible to calculate the actual size of the image (200, Seoul subway line 2 route map) based on the actual size of the recognizing device 20.

The calculating unit 120 may further include setting a scanning range of the motion recognition device 20 based on the calculated actual size of the image 200. [

For example, when the setting unit 180 of the server 100 is 1000 mm x 1000 mm in size, it may mean setting the scanning range so that the motion recognition device 20 can acquire optical signals of only the corresponding range have.

For another example, when the setting unit 180 of the server 100 is 1000 mm x 1000 mm in size, it means that the scanning range is set so that the motion recognition device 20 scans only the corresponding range.

Thus, it is possible to prevent unnecessary operations from being performed by scanning a portion where the motion recognition device 20 does not need it.

Step S510 Next, the receiving unit 110 of the server 100 receives the identification information of the image 200. [ (Step S520)

Means that the identification information of the image 200 is received from the manager who has photographed the image 200 or another manager.

More specifically, the image 200 may be applied to images of a specific purpose, such as, for example, a subway map, a bus route map, a movie poster, a museum poster, a concert poster, or an advertising poster.

Therefore, the subway, bus, movie, museum, concert, advertisement, and the like can be identification information of the image 200, and the identification information can be used as a base for searching various information according to the input information of the user.

Further, a plurality of pieces of identification information other than one piece of identification information can be stored. For example, "public transportation" together with a subway or a bus may be stored together as identification information, The words representing the image 200 may be stored together as identification information.

In addition, the identification number of the image 200 may be stored together with the identification information so that the location information on which each image 200 is attached and provided can be identified, and each image 200 can be distinguished.

2, the receiving unit 110 of the server 100 can receive the "Seoul Subway Line 2 Route Map" as identification information.

The extracting unit 130 of the server 100 extracts one or more object images 220 including pictures or characters contained on the image 200, (200). (Step S530)

FIG. 3 is a diagram showing object images 220 included in the image 200 of FIG.

The extracting unit 130 of the server 100 analyzes the received image 200 as shown in FIG. 2 and extracts one or more object images including the pictures or characters included in the image 200 (Seoul Subway Line 2 Route Diagram) 220 and storing the coordinates of the object 200 on the image 200. [

Therefore, as shown in FIG. 3, "Seoul Subway Line 2 Route Map", "Hwacheon", "Hongik Univ.", "Sinchon", " Quot ;, " and "EIGERO 4" are extracted.

At this time, the analysis module of the image 200 of the server 100 analyzes the image 200 to determine the relationship between the figure and the character, automatically sets the range of each object image 220, and the manager re- Can be modified.

As such, when the object image 220 is extracted through the extracting unit, the coordinates of the object image 220 on the image 200 can be stored. For example, various methods such as setting the coordinates by starting the lower left end of the image 200 with (X = 0, Y = 0) coordinates are applicable.

In step S530, the storage unit 140 of the server 100 receives tag information or content information of each object image 220 extracted in step S520. (Step S540)

Each object image 220 on the image 200 is extracted through steps S510 to S530 and the information of each extracted object image 220 is input through step S540 as shown in FIG.

More specifically, the name, description, summary, and the like of the object image 220 may be stored in the tag information of the object image 220.

For example, in the object image 220 corresponding to the "Hongik University entrance", Hongik University entrance, Hongik University, Line 2, transit station, Mapo-gu, and Donggyo-dong can be stored as tag information.

In addition, tag information such as Seoul City Hall, Ewha Womans University, Jung-gu, Jungdong, Deoksu Palace, Deoksu Elementary School, Seoul Metropolitan Museum of Art, and Seoul Plaza can be stored in the object image 220 corresponding to the "

Information such as a name, a summary, a location, a surrounding landmark, and a sightseeing spot of the object image 220 can be input as well as the tag information exemplified through the two object images 220.

However, in the above example, the identification information of the image 200 corresponding to the object image 220 is a subway route map, and when the identification information is different, different tag information can be stored.

In addition, the content information may correspond to image data, audio data, and an Internet site corresponding to the object image 220.

For example, if the image 200 is a movie poster and the object image 220 is a "trailer ", the trailer movie data of the movie may be input as the content information of the" trailer &

The setting of the image 200 and the object image 220 is completed through steps S500 through S540 as described above. Hereinafter, various information is provided according to the input information of the user.

The recognition unit 150 of the server 100 receives input information of the user on the scanned image 200 through the motion recognition device 20 and receives at least one object image 220 located at a coordinate corresponding to the input information ). (Step S550)

The input information includes a user's touch or gesture. For example, it is possible to touch a particular object image 220 as if it were clicked or to perform a touch and drag input from the first object image 220 to the second object image 220, have.

The actual size of the image 200 is calculated in step S510 and the coordinate information of the object images 220 included in the image 200 is stored in step S530. When the input information of the user is received through the motion recognition device 20, the user can recognize which object image 220 has been input.

In step S550, the information extraction unit 160 of the server 100 extracts at least one object information through tag information or content information of the object image 220 recognized in step S550. (Step S560)

Next, in step S560, the information providing unit 170 provides the object information extracted in step S560 through at least one of the display device, the audio output device, and the user terminal 300 provided at the location of the image 200 do. (Step S570)

More specifically, various cases may occur depending on the input information of the user, and the details thereof will be described below.

The first case>

4 is a diagram illustrating a user touching a category image 210 in the image 200 of FIG.

In an embodiment of the present invention, an image 200 includes one or more object images 220 and a category image 210. Preferably, at least one of the object images 220 may correspond to a category image 210.

Referring to FIG. 4, the user has touched the category image 210 of "Seoul Subway Line 2 Route Map" in the image 200.

At this time, the category image 210 is also one of the object images 220, but corresponds to the object image 220 representing the image 200 different from other object images 220.

For example, if the image 200 corresponds to a subway route map, the route map of subway line 2, the route map of line 5, and the like can be applied.

As another example, the image 200 may be a bus number if it corresponds to a bus route map.

As another example, if the image 200 corresponds to a movie poster, it may be a movie title.

As such, the category image 210 refers to the object image 220 representing the image 200.

If the object image 220 recognized in step S560 is the category image 210 indicating the identification information of the image 200 in the information extracting step S560, At least one of representative information, real-time information, and announcement information of the image 200 is extracted as object information.

Accordingly, when the category image 210 is touched as shown in FIG. 4, it can be seen that the information of the Seoul subway line 2 is extracted and provided as shown in FIG.

The Seoul Subway Line 2 is a loop line, the number of transit lines is 1 to 9, and the real-time information is extracting information that the operation is delayed due to a breakdown at Jamsil Station. In addition, if there are various announcements, it can be extracted and provided as object information.

In this manner, various information that can not be provided on the image 200 of the subway route map is provided, thereby providing various information to the user.

Second case>

In the information extracting step S560, the information extracting unit 160 of the server 100 determines whether the input information of the user is a touch input for one object image 220, Information is extracted as object information.

If there is no content information allocated to the object image 220, the information extracting unit 160 searches for the tag information of the object image 220 based on the identification information of the image 200, Information is extracted as object information.

For example, when the user touches the "Hongdae entrance" object image 220 in the image 200, the subway line 2 corresponding to the identification information of the image 200 and the Hongdae entrance corresponding to the tag information of the Hongdae entrance , Hongik University, Line 2, transit station, Mapo-gu, Donggyo-dong, and extract matching information as object information.

In addition, the information extraction unit 160 may extract the object information by considering the time information of the user touching the image 200 as well.

For example, the time information of the next train arriving at Hongik University entrance station, the subway timetable of the Hongik University entrance station, the landmark of Hongik University entrance station, sightseeing spot information, information of Hongik University can be matched and extracted as object information.

At this time, the information extracted and matched can be variously selected such that information having the highest degree of matching with the identification information of the image 200 may be selected, and information suitable for the time zone touched by the user may be selected.

If content information is stored in the object image 220, the content information may be extracted and provided as object information.

For example, content information such as a map image of a route from Hong-ik-dong area to Hong-ik university and a road view image around the Hong-ik-dong area may be applied.

In addition, the information collecting unit collects various late reports and feedback of users to classify and store useful information or unnecessary information to the user, and can learn the information extracting unit 160 to improve object information extraction.

Third case>

In the information extraction step S560, the information extraction unit 160 of the server 100 determines whether the input information of the user is the touch and drag input from the first object image 230 to the second object image 240, (Relation information) between the contents information of the first object image 230 and the second object image 240 based on the identification information of the image 200 as object information.

If there is no content information allocated to the object image 220, the information extraction unit 160 extracts the first object image 230 and the second object image 240 based on the identification information of the image 200, And extracts the matched association information (relationship information) as object information.

5 is a diagram illustrating a user performing a touch-and-drag input in the image 200 of FIG.

For example, if the user touches the "merged" object image 220 in the image 200 and dragged to the "viewing" object image 220, "merged" corresponds to the first object image 230, Quot; view "corresponds to the second object image 240.

The information extracting unit 160 may extract the object information by considering the time information of the user touching the image 200, as in the second case.

Accordingly, the information extracting unit 160 extracts the tag information of the subway line 2 corresponding to the identification information of the image 200, the tag information of the "combined" object image 220, and the tag information of the " And the matching information (relation information) matched is extracted as the object information.

At this time, the association information (relation information) means related information and related information between two object images 220.

More specifically, the information of each of the two object images 220 is not extracted as the object image 220 but the common information, differences, etc. between the two object images 220 are derived.

An example of this is shown in Fig.

Referring to FIG. 5, since the user has performed the touch and drag input in the viewing direction from the joining, the object information that takes six stations from joining to viewing and takes about 13 minutes has been derived and provided.

Also, the time information touched by the user is also taken into consideration, so that it can be seen that the next arriving train time is extracted and provided as the object information.

In addition, as shown in FIG. 5, information such as tourist attractions, restaurants, landmarks, etc., which are located between the Hwajong Station and the City Hall Station, may be extracted and provided as object information.

Also, if content information is stored in the object images 220, the content information can be extracted and provided as object information.

For example, since the user is expected to get off at the city hall, images of a landmark (Deoksu Palace, Seoul Plaza, etc.) near the city hall station, a map image (200) showing a walking route from Seoul Station to Seoul City Hall, An image 200 and the like may be applied.

In addition, various sightseeing promotional videos provided by the city of Seoul can be stored as content information, extracted as an object image, and provided.

The fourth case>

In the information extracting step (step S560), when the input information of the user is a range specifying input including two or more object images 220, the information extracting unit 160 of the server 100 identifies the image 200 Common information between the contents information of two or more object images 220 included in the range designation is extracted as object information based on the information.

The information extracting unit 160 searches the tag information of the two or more object images 220 included in the range designation input based on the identification information of the image 200 in real time and outputs the matched common information as object information Can be extracted.

6 is a diagram illustrating a user performing a range designation input in the image 200 of FIG.

6, three object images 220 are included when the user performs a range designation input including "Hiragana", "Hongdae entrance", and "Shinchon" object image 220.

Accordingly, the information extracting unit 160 extracts the common information between the contents information of the three object images 220 as object information based on the identification information of the image 200, or searches the tag information in real time for matching the common information It can be extracted by object information.

For example, common information of three object images 220 as shown in FIG. 6 may be extracted and provided as object information.

Since all three are located near the university, shopping streets, restaurants, etc., it is possible to provide information on restaurants, various sightseeing spots, and various event schedules in nearby areas.

When a user visits for the purpose of sightseeing, it is easy to visit a specific place as the above information is provided, and it is possible to have access to the latest information about the area, and to participate in various events if the schedule is satisfied.

Such a function can not be implemented at all in the image 200 of the subway route map which previously provided only the route information, and it has a great effect to tourists.

Also, as with the other cases, if the content information is stored, the stored content information may be searched and the content information matched with the common point may be extracted and provided as object information.

The information providing unit 170 displays the extracted object information according to the case of the first case, the second case, the third case and the fourth case described above by using a display device, a sound output device, Or through at least one of the user terminals 300.

At this time, the process of identifying the user terminal 300 by the server 100 may be required, and various methods as described below may be applied.

An identification number of the image 200 is described on one side of the image 200. The user executes the service application installed in the terminal 300 and inputs the identification number to the server 100, Can be identified.

As another example, a QR code (Quick Response Code) is included in one side of the image 200, and a user executes a service application installed in the terminal 300, and the server 100 scans the QR code through the photographing unit The user terminal 300 can be identified.

As another example, the server 100 may identify the user terminal 300 as the NFC is installed / attached to one side of the image 200 and recognizes the NFC through the user terminal 300.

However, since there is a problem that the identification number is described, the QR code is attached, or the NFC is installed, it is possible to identify the user terminal 300 through the motion recognition device 20 as follows .

In detail, the receiving unit 110 of the server 100 receives numerical information scanned through the motion recognition device 20. [ At this time, the numerical information means that the image is sequentially drawn on the image 200 from the user.

The identification unit of the server 100 identifies the terminal 300 matching the numeric information to the user terminal 300 and provides the object information.

8 is a diagram illustrating a user performing a touch input for drawing a number in the image 200 of FIG.

As shown in FIG. 8, when the user draws the number of the user terminal 300 on the image 200 (a tool such as a pen can be used but a representative example is described using a finger), the motion recognition device 20 It scans it and recognizes that the user has sequentially entered the number 010-1234-5678.

Since the user terminal 300 has been identified, the information providing unit 170 of the server 100 provides the object information to the terminal 300 corresponding to the 010-1234-5678 number so that the user can receive the information .

In FIG. 8, the user touches the 11-digit number as if they were arranged in order, but since the motion recognition device 20 can scan even if the numbers are superimposed, the touch method and position are not limited Do not.

As described above, since the motion recognition device 20 can scan the input information of the user and identify the user terminal 300 without installing another device to identify the user terminal 300 , It has a remarkable effect in terms of cost and provides convenience to the user.

In one embodiment, when a user touches a specific object image 220 and enters a first gesture on the image 200, providing information of the object image 220 to the user terminal 300 . ≪ / RTI >

More specifically, when the receiving unit 110 of the server 100 receives the input information of the first gesture of the user scanned through the motion recognition device 20, the information providing unit 170 transmits the corresponding object image 220, And provides the object information of the user terminal 300 to the identified user terminal 300.

7 is a diagram illustrating a user performing a first gesture input in the image 200 of FIG.

In FIG. 7, a question mark (?) Is illustrated as a touch with the first gesture. Thus, by using symbols commonly used by people all over the world, such as a question mark, foreigners who do not know the language of the area can simply request information.

FIG. 9 illustrates a movie poster with an image 200 according to an embodiment of the present invention, FIG. 10 illustrates a user touching an object image 220 of a trailer view in the image 200 of FIG. 9 FIG.

2 to 8, the subway route map has been described as an embodiment, and the case of applying to the movie poster through FIGS. 9 and 10 will be further described.

When the server 100 receives the photographed image of the motion recognition device 20 and the image 200, the actual size of the image 200 (movie poster) is calculated, and the object image (220) and stores the coordinates on the image (200) of each object image (220).

Then, tag information or content information of each extracted object image 220 is input.

In the case of a movie poster, the movie title corresponds to the category image 210.

9, the characters drawn on the movie poster, the name of the director, the name of the cast, the name of the cast, the preview of the trailer, and the advance are extracted by the object image 220, respectively.

Also, human figures on the image (200, movie poster) mean the main characters BBB and CCC, respectively.

As an example of the content information and the tag information, the name of the director, the work of the director, a box-office work, and the like can be stored as the tag information in the object image 220 "director name" have.

In addition, the name of the star, the starring work, the winning work, and the like can be stored in the tag image in the object image 220, and the photograph of the star, the main scene, and the like can be stored as the content information.

Also, in the object image 220 "Trailer view ", one or more trailer videos can be stored as content information.

In addition, the object image 220 "advance sale" may store contents information such as a reservation method, a reservation status, a reservation site, and the like.

Accordingly, when the user touches the "view trailer" object image 220 as shown in FIG. 10, the trailer image of the movie can be extracted and provided as the object information by the information providing unit 170 of the server 100.

In addition, when the user touches the object image 220 "Advance", the information providing unit 170 of the server 100 can connect the service application of the user terminal 300 to the movie preview site.

In one embodiment, if the user has performed a range designation input that includes both the main BBB and the CCC, the information extraction unit 160 of the server 100 stores the tag information of the main BBB and the CCC included in the range designation input in real time The extracted common information can be extracted as object information.

As an example of this, information such as a movie in which the main BBB and the CCC appear together can be extracted and provided as object information.

As described above, the control of the motion recognition device 20 using the captured image and the motion recognition method using the captured image according to the embodiment of the present invention can be applied to the image 200 to implement the touch function, 200), and can be applied to various fields.

11 is a block diagram of a motion recognition server 100 using the control of the motion recognition device 20 using a photographed image.

However, in some embodiments, the server 100 may include fewer or more components than the components shown in FIG.

11, the control of the motion recognition device 20 using the captured image according to the embodiment of the present invention and the motion recognition server 100 using the control of the motion recognition device 20 include a receiving unit 110, a calculating unit 120, A storing unit 140, a recognizing unit 150, an information extracting unit 160, and an information providing unit 170.

The receiving unit 110 receives an image of the image 200 and the motion recognition device 20 or Lidar attached or installed on one side of the image 200 and receives the identification information of the image 200.

The calculating unit 120 analyzes the image received by the receiving unit 110 based on the actual size of the motion recognition device 20 and calculates the actual size of the image 200. [

The calculation unit 120 may set the scanning range of the motion recognition device 20 based on the calculated actual size of the image 200. [

The extracting unit 130 extracts one or more object images 220 including pictures or characters included on the image 200. [

The storage unit 140 stores the coordinates of the object 200 on the image 200 extracted by the extracting unit 130.

The recognition unit 150 receives the input information of the user on the scanned image 200 through the motion recognition device 20 and recognizes at least one object image 220 located at a coordinate corresponding to the input information.

The information extraction unit 160 extracts at least one object information through tag information or content information of the object image 220 recognized through the recognition unit 150. [

The information providing unit 170 provides the object information extracted by the information extracting unit 160 through at least one of a display device, an audio output device, and a user terminal 300 provided at a location where the image 200 is located.

The control of the motion recognition device using the photographed image and the motion recognition server using the photographed image according to the embodiment of the present invention described above are different only in the categories of the method and the invention described with reference to FIGS. 1 to 10, An example is omitted.

The control of the motion recognition device using the photographed image and the motion recognition method using the photographed image according to an embodiment of the present invention described above are implemented as a program (or application) to be executed in combination with a server that is hardware, .

The above-described program may be stored in a computer-readable medium such as C, C ++, JAVA, machine language, or the like that can be read by the processor (CPU) of the computer through the device interface of the computer, And may include a code encoded in a computer language of the computer. Such code may include a functional code related to a function or the like that defines necessary functions for executing the above methods, and includes a control code related to an execution procedure necessary for the processor of the computer to execute the functions in a predetermined procedure can do. Further, such code may further include memory reference related code as to whether the additional information or media needed to cause the processor of the computer to execute the functions should be referred to at any location (address) of the internal or external memory of the computer have. Also, when the processor of the computer needs to communicate with any other computer or server that is remote to execute the functions, the code may be communicated to any other computer or server remotely using the communication module of the computer A communication-related code for determining whether to communicate, what information or media should be transmitted or received during communication, and the like.

The medium to be stored is not a medium for storing data for a short time such as a register, a cache, a memory, etc., but means a medium that semi-permanently stores data and is capable of being read by a device. Specifically, examples of the medium to be stored include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, but are not limited thereto. That is, the program may be stored in various recording media on various servers to which the computer can access, or on various recording media on the user's computer.

The steps of a method or algorithm described in connection with the embodiments of the present invention may be embodied directly in hardware, in software modules executed in hardware, or in a combination of both. The software module may be a random access memory (RAM), a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, a hard disk, a removable disk, a CD- May reside in any form of computer readable recording medium known in the art to which the invention pertains.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. Therefore, it should be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

20: Motion recognition device
100: server 110:
120: Calculator 130: Extractor
140: storage unit 150: recognition unit
160: information extracting unit 170: information providing unit
200: Image 210: Category image
220: object image 300: user terminal

Claims (12)

In a manner performed by a computer,
Attaching a motion recognition device to one side of the image;
Receiving an image and an image taken together with a motion recognition device attached or installed on one side of the image;
Calculating an actual size of the image based on the image and the actual size of the motion recognition device;
Setting a scanning range of the motion recognition device based on an actual size of the calculated image; And
And receiving identification information of the image.
Control of motion recognition device using photographed images and motion recognition method using the same.
The method according to claim 1,
Extracting one or more object images including pictures or characters contained on the image, and storing coordinates of the image of each object image; And
And receiving tag information or content information of each extracted object image.
Control of motion recognition device using photographed images and motion recognition method using the same.
3. The method of claim 2,
Receiving input information including a touch or a gesture of a user on the image scanned through the motion recognition device and recognizing at least one object image located at a coordinate corresponding to the input information;
Extracting at least one object information through tag information or content information of the recognized object image; And
And providing the extracted object information through at least one of a display device, an audio output device, and a user terminal at a location where the image is located,
Wherein the motion recognition device rotates the reflector to obtain coordinates for input information including a user's touch or gesture on the image,
Control of motion recognition device using photographed images and motion recognition method using the same.
The method of claim 3,
Receiving numerical information scanned through the motion recognition device, the numerical information being sequentially drawn on the image from a user; And
Further comprising identifying a terminal that matches the numeric information with a user terminal,
Control of motion recognition device using photographed images and motion recognition method using the same.
5. The method of claim 4,
Receiving input information of a first gesture of a user scanned through the motion recognition device; And
And providing the object information to the identified user terminal.
Control of motion recognition device using photographed images and motion recognition method using the same.
The method of claim 3,
In the information extracting step,
If the recognized object image is a category image indicating identification information of the image,
And extracts at least one of representative information, real-time information, and announcement information of the image as object information.
Control of motion recognition device using photographed images and motion recognition method using the same.
The method of claim 3,
In the information extracting step,
If the input information of the user is a touch input to an image of one object,
Extracting the content information allocated to the object image as object information or associating the tag information of the object image based on the identification information of the image and extracting the matched information as object information.
Control of motion recognition device using photographed images and motion recognition method using the same.
The method of claim 3,
In the information extracting step,
If the input information of the user is a touch-and-drag input to the second object image from the first object image,
Extracting association information between contents information of the first object image and the second object image as object information based on the identification information of the image,
And the tag information of the first object image and the second object image is searched in real time based on the identification information of the image, and the matched relation information (relation information) is extracted as the object information.
Control of motion recognition device using photographed images and motion recognition method using the same.
The method of claim 3,
In the information extracting step,
If the input information of the user is a range specifying input including two or more object images,
Extracting, as object information, common information between contents information of two or more object images included in the range designation input based on the identification information of the image,
The tag information of two or more object images included in the range designation input is searched in real time based on the identification information of the image, and the matched common information is extracted as object information.
Control of motion recognition device using photographed images and motion recognition method using the same.
delete delete 9. A motion recognition program stored in a medium for executing the method of any one of claims 1 to 9 in combination with a computer which is hardware.

Images