KR20070073473A - Verification method for moving route of photographing image and data inputing method - Google Patents

Abstract

A method for confirming a movement path of a photographed image of a moving picture and a data input method are provided to overcome the difficulty of a user who is difficult in the use of a mobile device, offer a photo call device of a new type, sense the movement path of the moving picture photographing image which is new and easily used, and convert the moving picture photographing image into data information. An electric signal according to light quantity separately registered by a pixel unit of an image sensor is converted into a digital value by an A/D converter, and the digital value is stored in a memory(S10). Corresponding digital values and positions of pixels located within a uniform range are memorized in the digital value stored in the memory, and the memorized digital value is set up as a reference value. An electric signal according to a newly registered light quantity is converted into a digital value, and the digital value is stored in the memory. The stored digital value is read. The approximate value with the digital value of the reference value is searched, and a position of the pixel having the approximate value is confirmed(S30). The pixel position of the reference value is compared with the pixel position of the approximate value, and a movement path is tracked(S40).

Description

Verification method for moving route of photographing image and data inputing method}

1 is a block diagram schematically illustrating a configuration of a general mobile device;

2 is a block diagram showing a system for identifying an image information data movement path according to the present invention;

3 to 6 is a view showing an example of the reference value search in the image information data movement path confirmation system according to the present invention,

FIG. 7 is a diagram sequentially illustrating a process of confirming a movement path of a photographing module as shown in FIGS. 3 to 6 to identify a symbol such as a character or a shape for creating document data.

FIG. 8 is a diagram sequentially illustrating another process of confirming a movement path of a photographing module as shown in FIGS. 3 to 6 and checking a symbol such as a character or a shape for creating document data.

9 is a flowchart sequentially illustrating a method of confirming a movement path of an image according to the present invention;

10 is a flowchart illustrating a process of inputting a symbol according to a method for confirming a movement path of an image according to the present invention.

According to the present invention, after detecting a moving path and a change of a moving image photographed through a digital camera or the like, the moving path checking method for converting the moving path into text or various images and data for performing the data conversion method The present invention relates to a movement path confirmation system, and further to a data input method based on the data conversion method and the data movement path confirmation system.

Advances in communication means and digital image information data processing technology and advances in integrated technology have made it possible to easily obtain digital information in digital form in everyday life. It is possible to send or receive without restriction of place.

In particular, the current mobile devices, which are integrated with communication technology and digital image information processing technology, have developed into a multi-player that combines the functions of a digital camera as well as wireless internet communication, beyond the means of communication for telephone calls. In addition, various tasks such as wireless internet access and digital imaging can be performed.

On the other hand, as a means of communication through a mobile device, a short message service (SMS) and an e-mail through the wireless Internet, etc., in addition to the basic telephone call. Both the SMS and the e-mail are sent by the sender to a receiver through a GSM (Global System for Mobile communication) system or a wireless Internet system. The written message is made by the sender manipulating the keyboard of the mobile device one by one. In other words, text created through keyboard manipulation is converted into text format and transmitted.

In addition, in the case of a mobile device having a personal digital assistant (PDA) function, an electronic sensitive pad capable of accepting handwritten letters can be transmitted to the receiver instead of the keyboard operation.

As described above, the communication means through the mobile device is limited to the method of receiving and receiving the text and the user's handwriting through the keyboard operation of the mobile device in addition to the telephone call using the voice signal.

Therefore, in the case of a hearing impaired or speech impaired person with a telephone call and a visually impaired person or a person who is inconvenient to use a hand, the use of a mobile device is limited.

In addition, in order to meet the needs of generations who are easily tired of pursuing new ways, developers who develop a variety of means of communication are more likely to use mobile devices in addition to the classic and tedious means of communication such as telephony and keyboard manipulation. We are working to develop a dynamic and fresh means of communication.

Accordingly, the present invention has been made to solve the above problems, while overcoming the obstacles of the user having difficulty in using a mobile device, by providing a new method of communication means to move the fresh and easy to use video recording image It is a technical task to provide a method for checking a moving path of a moving image photographed image and a data input method for detecting a path and converting the data into data information.

The present invention for achieving the above technical problem,

A first storage step of converting an electric signal according to the amount of light individually registered in units of pixels of the image sensor into a digital value by an A / D converter and storing it in a memory;

A reference value setting step of storing a corresponding digital value and a position of pixels within a predetermined range from a digital value stored in the memory and setting the reference value as a reference value;

A second storage step of converting an electric signal according to a newly registered light amount after the first storage step into a digital value and storing the converted digital signal in the memory;

A search step of comparing a digital value stored in the second storage step with a digital value of the reference value to search for a closest approximation value or the same value (hereinafter, referred to as an approximation value), and confirm a location in the pixel of the approximation value; And

A movement route checking step of tracking a movement route by comparing the position of the reference value and the position of the approximation value;

The moving path check method of the video shooting image including a.

In the moving path confirmation method of the video photographed image for achieving the above technical problem,

The first and second storage steps are performed in a mobile device including the image sensor and an A / D converter;

The searching step may be performed in units of the range of the reference value set in the reference value setting step and the number of pixels.

The present invention to achieve the above technical problem,

A first storage step of converting an electric signal according to an amount of light individually registered in units of pixels of an image sensor included in the mobile device into a digital value by an A / D converter and storing it in a memory;

A reference value setting step of storing a corresponding digital value and a position of pixels within a predetermined range from a digital value stored in the memory and setting the reference value as a reference value;

A second storage step of converting an electric signal according to a newly registered light amount after the first storage step into a digital value and storing the converted digital signal in the memory;

The digital value stored in the second storage step is compared with the digital value of the reference value to search for the nearest or equal value (hereinafter, referred to as an approximation value) in the range of the reference value set in the reference value setting step and the number of pixels, and within the pixel of the approximation value. A search step of checking a location;

A movement route checking step of tracking a movement route by comparing the position of the reference value and the position of the approximation value; And

A data retrieval step of retrieving data corresponding to the movement route tracked in the movement route checking step;

A data input method according to a moving path of a video photographed image including a.

In the data input method according to the movement path of the video photographed image for achieving the above technical problem,

The data retrieved in the data retrieval step is a symbol such as a letter or a shape.

In the data input method according to the movement path of the video photographed image for achieving the above technical problem,

In the searching step, the digital value of the pixels within a predetermined range is searched based on the pixel position of the reference value set in the reference value setting step, and then the approximation value is found by calculating a correlation with the digital value of the reference value.

In the data input method according to the movement path of the video photographed image for achieving the above technical problem,

The retrieving step may include: obtaining a correlation within −1 to +1 displacements around the pixel position of the reference value, and approximating a value showing the threshold above when there is a value above the threshold in the correlation; If there is no value greater than or equal to the threshold among the correlations, the correlation within -2 to +2 displacement is obtained to approximate the value closest to one of the correlations.

In the data input method according to the movement path of the video photographed image for achieving the above technical problem,

In the searching step, the correlation of the prediction part is first obtained by predicting which direction the mobile device will move among -2 to +2 displacements based on the pixel position of the reference value. Make this an approximation; If the correlation does not show more than the threshold value, the correlation for the remaining portion of the -2 to +2 displacement is obtained, and the value closest to 1 of the correlations is approximated.

In the data input method according to the movement path of the video photographed image for achieving the above technical problem,

In the reference value setting step, the reference value is a range in which the distribution of digital values for each pixel is complex in content.

In the data input method according to the movement path of the video photographed image for achieving the above technical problem,

Forming a sign input board which is a means for outputting a sign input by a user for transmitting a message such as SMS or mail;

Forming an input symbol confirmation report which is operated separately from the symbol input board while displaying an image of the movement path so that the user can see the movement path of the photographed image;

Displaying a movement route tracked through the movement route checking step on the sign input board; And

Searching for data corresponding to the movement path through the data searching step and outputting the data on the preference input board;

It is to include more.

In the data input method according to the movement path of the video photographed image for achieving the above technical problem,

In the data retrieval step, a search is performed based on the shape of the completed movement path according to a user's input signal that the display of the movement path is completed on the screen of the input symbol confirmation board.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram schematically showing a configuration of a general mobile device, and FIG. 2 is a block diagram showing a system for confirming movement of image information data according to the present invention.

In recent years, the mobile device 100, which is manufactured in addition to a call, which is a unique function, is combined with a digital camera function, and thus video recording is possible. The mobile device 100 having a photographing function includes a voice calling module 130 and a voice receiving module 140 serving as a handset, an input module 150 and 150 'serving as a dial, and controlling them. In addition to the control module 110, which is essentially provided with a power supply module 120 for supplying power for driving the respective modules (110, 130, 140, 150), the photographing module 170 for taking an image ) Is further included. In addition, the output module 160 is also provided to check the image being photographed by the photographing module 170.

In addition, the antenna module 180 may be further configured to include a housing 101 for integrally protecting the module and an antenna 181 for improving the quality of wireless communication.

The image information data movement path confirmation system according to the present invention is based on the above-described configuration of the mobile device 100, and includes the following configurations to achieve the technical problem according to the present invention.

The control module 110 is to manage while controlling the interworking of the other modules, the configuration for the voice signal processing made in the voice transmitting module 130 and the voice receiving module 140, the operation of the output module 160 It includes a configuration for control, a configuration for a wireless call, and a configuration for managing image information photographed through the photographing module 170. However, the above components are basically included in the conventional mobile device, and thus the description thereof will be omitted here because it is not directly related to the present invention, and only the components for the image information data movement path confirmation system according to the present invention will be described intensively. do.

The image information data movement path confirmation system according to the present invention checks digital information on the image photographed by the photographing module 170 and sets reference value setting means 111 for setting at least one reference value, and the movement path of the reference value. The document data is matched with various data such as symbols such as letters or shapes according to the generalized movement path, and the image movement path tracking means 112 for tracking, the movement path checking means 113 for generalizing the tracked movement path, and the like. And a document data creating means 114 to be completed.

9 is a flowchart illustrating a method of confirming a movement path of an image according to the present invention, and the present invention will be described in more detail with reference to FIGS. 1 and 2.

S10; Shooting image A / D conversion stage

The photographing module 170 as a digital camera embedded in the mobile device 100 detects light irradiated onto a charged-coupled device (CCD) through a photographing lens 171 to separate color light, and then an optical sensor It registers to hundreds of thousands of pixels (picture elements: pixels, basic units of image composition), and emits electric signals of various sizes according to the amount of light registered in each pixel. In general, the greater the amount of light, the higher the electrical signal.

When the captured image is emitted as an electric signal via the CCD 172, the A / D converter 173 converts the electric signal into a digital value corresponding thereto.

S20; Steps to set baseline for breadcrumbs

The photographed image converted into a digital value is transmitted and stored to the memory 117, and an arbitrary reference value among the digital values is selected by the reference value setting means 111.

The reference value means that when the user moves while photographing any image with the photographing module 170 embedded in the mobile device 100, the image information data movement path confirmation system according to the present invention can detect the movement direction. In the specific part, the description will be given by way of example.

It is assumed that the photographing module 170 photographs a red circle on a white background. The photographing module 170 is divided into a pixel in which a light amount of a white background is registered and a pixel in which a light amount of a red circle is registered, and a corresponding digital value of the pixel is generated by the A / D converter 173.

When the photographing module 170 is moved during photographing, the pixel in which the light amount of the red circle is registered is changed, and conversely, the registration content change of the pixel means the movement of the photographing module 170. That is, in order to determine the moving path of the image, the image information data moving path checking system according to the present invention designates the digital value of the registered pixel as the reference value.

The reference value may be arbitrarily set each time within a range of pixels, may be fixedly set as a point, and may be set at a position where digital values of pixels are complicatedly arranged for efficient tracking of an image movement path. .

In addition, one or more reference values may be set.

The setting method for the reference value will be described in more detail below.

S30; Search level

The image information data movement path confirmation system according to the present invention detects the movement path of the image being photographed through the photographing module 170 and displays a text message or a symbol corresponding to a character or a shape corresponding to a path to be moved by the user. It can be utilized as document data of communication through the means, for which the image information data movement path confirmation system should be able to detect the movement of the image and its direction.

To do this, the preset reference value is always searched and the position thereof is checked.

Hereinafter, two algorithms for tracking a moving path of an image through a reference value will be described. However, the present invention is not limited thereto, and various modifications can be made without departing from the scope of the following claims.

First embodiment

3 to 6 are views showing a reference value search mode in the image information data movement path confirmation system according to the present invention.

As shown in FIGS. 3 to 4, when the mobile device 100 in which the shooting module 170 is embedded is moved during shooting, the output module 160 reproduces and outputs the image image being photographed according to the movement. do.

FIG. 3A shows that one of four lotus flowers currently being photographed is set to the first reference value S1.

(b) shows the position of the first reference value S1 to be recognized as a digital value by the image information data movement path confirmation system according to the present invention. As described above, the imaging module 170 has different digital values for each of a number of pixels arranged regularly. On the other hand, if a change occurs in the image being photographed by the movement of the imaging module 170, the digital value of the pixel also changes. At this time, since the shape and color of the subject having a certain shape is always constant regardless of whether the photographing module 170 is moved, the digital value of the subject will almost match, and only the position of the pixel having the digital value will be consistent. Will change.

The image movement path tracking unit 112 searches a digital value within a range set as the first reference value S1 among all digital values to identify the position of the pixel having the digital value of the first reference value S1.

4 illustrates a state in which the first reference value S1 of FIG. 3 is moved upward while the photographing module 170 moves downward.

Meanwhile, a second reference value S2, which is a new reference value for enabling the image information data movement path checking system according to the present invention to detect the movement of the photographing module 170, is further set.

In order to track the image movement path, one reference value may be used. However, when the reference value is out of the photographing range, the image movement path tracking means 112 may perform an abnormal operation. Therefore, the reference value setting module 111 sets a second reference value S2 that can replace the first reference value S1, which is a previous reference value, when it is likely to move out toward the edge of the shooting range, thereby leaving the shooting range. Done.

FIG. 5 illustrates a state in which the first reference value S1 and the second reference value S2 of FIG. 4 are moved to the left while the photographing module 170 moves to the right.

In this case, the third reference value S3 is also set in preparation for the possibility of loss of the first reference value S1 and the second reference value S2.

6 illustrates that the first reference value S1 of FIG. 5 moves upward while the photographing module 170 moves downward, and the second reference value S2 is out of the photographing range.

As described above, the image information data movement path confirmation system according to the present invention may have one or more reference values. However, at least one reference value may be used for the image movement path tracking means 112 when a plurality of reference values are set. Since the image movement path tracking means 112 for tracking the image movement path even if any one reference value is lost in the state where two or more are set, it is necessary to track the remaining one reference value, thereby affecting the operation for finding the movement path. Does not have

In the tracking method of the image movement path tracking means 112 described above, the electric signals or digital values of the pixels within the range set as reference values are stored in the entire image photographed by the photographing module 170, and then The moving path is tracked by searching a range having the electric signals or digital values previously stored in the entire captured image, and comparing the relative change of the position of the reference value thus retrieved with the previous reference value position.

Second embodiment

On the other hand, in addition to the tracking method, the tracking means 112 can track the movement path of the image using the following algorithm.

When a predetermined range of the light quantity registered pixel is determined as a reference value, an electric signal output from a pixel within the determined reference value range, or a digital value of the pixel converted by the A / D converter 173 by the electric signal, As shown in Fig. 1, brightness is adjusted to adjust the average illumination of the reference value to an intermediate value, and the maximum value of the 5 * 5 correlation matrix is above the threshold. This is done through Contrast Matching.

<Picture 1>

→

→

→

→

   1. Original Image 2. Brightness Adjustment 3. Contrast Adjustment

In this case, the reference value set in the present algorithm is different from the above-described method, and any one region is fixedly fixed, so that the change of the electric signal or digital value of the pixel in the corresponding region is checked, and thus the movement path of the image is tracked. do.

Therefore, as shown in <Figure 2>, the change of the electric signal or digital value of the pixel according to the movement of the mobile device is confirmed within the reference value range of the fixed position.

<Picture 2>

    (a) Reference value (b) Changed signal in reference value (dx = -2, dy = -2)

(A) of <Figure 2> shows that the signal of the pixel in a certain area is adjusted through the above-mentioned process, and (b) shows that the signal of the pixel in the reference value changes due to the movement of the mobile device (2 to the left and 2 to the top). will be.

The image movement path tracking unit 112 confirms the movement path of the mobile device by calculating a correlation between the changed signal and the original signal having the reference value.

Confirmation of the movement route proceeds as follows.

In one embodiment of the image movement path confirmation method and the data movement path confirmation system according to the present invention, the correlation calculation is adapted to a table of 5 * 5, and for this purpose, within the range of -2 to +2 in the up, down, left, and right directions of the reference value. The changed signal is compared with the signal of the reference value.

That is, when the current position of the reference value is (0, 0), the range of -2 to +2 is (-2, -2), (-1, -2), (0, -2), (1, -2), (2, -2), (-2, -1), (-1, -1), (0, -1), (1, -1), (2, -1) , (-2, 0), (-1, 0), (0, 0), (1, 0), (2, 0), (-2, 1), (-1, 1), (0, 25 types including 1), (1, 1), (2, 1), (-2, 2), (-1, 2), (0, 2), (1, 2), (2, 2) The correlation table as shown in Fig. 3 can be completed by calculating the correlation between the original signal and the changed signal with the reference value.

<Figure 3>

0.04 0.12 0.20 0.32 0.48 0.12 0.24 0.40 0.56 0.68 0.20 0.40 0.60 0.76 0.84 0.32 0.56 0.76 0.88 0.96 0.48 0.68 0.84 0.96 1.00

The correlation table shown in <Figure 3> calculates the correlation between the original signal of the reference value and the changed signal centering on the (0, 0) position, and records the result at the corresponding position.

Here, the closer the result of the correlation is to 1, the smaller the difference between the original signal and the changed signal. In Fig. 3, the position of (2, 2) is 1.00, which allows the mobile device to (-2, -2). Direction, that is, moved 2 by the left and 2 by the upward.

As described above, even if the image movement path tracking means 1120 uses one of the algorithms for tracking the movement path of the image, the reference value setting should be performed first.

As described above, one or more reference values may be set, and the position of the reference values to be set may be any or designated positions.

That is, the reference value setting means 111 may set one or more arbitrary objects among the images photographed by the photographing module 170 regardless of the size of the region, or use pixels of designated positions as reference values regardless of the contents of the image. Can be set.

On the other hand, since the movement path confirmation method and the data movement path confirmation system of the image according to the present invention is to check the movement of the mobile device using the image information of the image taken by the shooting module 170, the monotonous background is the shooting module ( If it is captured by 170, even if the background image is taken while the mobile device is moving, the reference value may be insignificant, so that it is difficult to accurately track the movement path.

Therefore, in setting the reference value, the reference value setting means 111 according to the present invention may search for an image position having a relatively complicated background and set the corresponding position as the reference value. To this end, the reference value setting means 111 reads the pixels of the image photographed by the photographing module 170 in a predetermined area unit, searches for a range where the signal difference between the pixels is largest, and sets the corresponding range as the reference value.

As a result, the reference value setting means 111 according to the present invention can more accurately grasp the movement path of the mobile device by setting the reference value in an area for easily grasping the movement path of the image even in a monotonous background.

Subsequently, in the case of the algorithm presented in the second embodiment, since a relatively large number of signals have to be read and a correlation calculated, the confirmation time of the image path according to the movement of the mobile device increases. Of course, the increase in the confirmation time means a delay in the processing time, resulting in inconvenience that the image information data movement path confirmation system according to the present invention misses the movement of the mobile device or delays the user's information input.

This can be solved by the following two methods.

<Navigation according to comparison priority>

In the navigation method according to the comparison priority, after determining the appropriate comparison priority by analyzing the use pattern in the image information photographed by the photographing module 170, the search for the comparison priority pixels is sequentially performed, and the lower priority is also obtained. This method compares the pixels by reducing the number of pixels to be compared.

Specifically, as shown in Figure 4, the present invention changes the order of comparison, so that (-1, -1) (-1,0), (-1,1), (0,0), ( An internal 3X3 table of 0, -1), (0,1), (1, -1), (1,0), (1,1) was created first, and if the correlation was above the threshold, it was moved in that direction. If it is less than the threshold value, it compares the remaining cells of 5X5 other than the internal 3X3 table that has already obtained the value, and determines that the 5X5 correlation table is completed and moved to the value closest to 1.

<Figure 4>

<Navigation using Prediction Based Searching Method>

On the other hand, if the movement of the captured image is known at a certain point in time, it is possible to predict which direction the camera will move at the next moment.

When using an arbitrary algorithm (such as a third-party method or the method previously proposed) to search for the movement of the image being captured by the camera, the motion between the captured image obtained at a certain time t-1 and the captured image obtained at a time t ( In order to extract motion, the process of calculating similarity such as correlation for n * m region should be compared for the whole range of motion estimation. Depending on the setting, speed can be several times higher.

<Figure 5>

For example, in order to calculate the movement at the time t of the cursor at the (0,0) coordinate at any time t-1, as shown in Figure 5, the existing algorithm has to search all over the A area. Therefore, it is necessary to repeat the correlation calculation for n * m pixels 25 times, but in the algorithm according to the present invention, the area B is preferentially searched in the right direction and the average correlation is not generated above the threshold. If not, the rest of the area A is also searched. In the direction to the upper right, the area B is 3 X 3 in the upper right.

In order to apply such a prediction-based method, it is possible only if the camera movement does not turn rapidly in the opposite direction as previously assumed, but since the number of shots per second of the CCD photographing element is generally about 1500 to 6000 times, Considering that the time from capturing the image to the next image is very short, and that the size and layout of the search area can be optimized and used properly, the camera can sufficiently cope with the fast movement of the camera.

Meanwhile, the range of the table for calculating the correlation is not limited to 5 * 5 or 3 * 3, and may be changed to various ranges as needed.

S50; Stored data retrieval step by movement path

7 is a view sequentially illustrating a process of confirming a movement path of a photographing module as shown in FIGS. 3 to 6 to identify symbols such as letters or shapes for document data creation, which will be described with reference to the drawing.

(a) shows the movement path of the reference value in the image image output through the output module 160. The image movement path tracking means 112 tracks the movement path as shown in the drawing (a) and transmits the corresponding information to the movement path confirmation means 113. The movement path checking means 113 receives the information and analyzes it. Meanwhile, as described above, the image image output to the output module 160 is opposite to the moving direction of the photographing module 170. Therefore, the information is redefined by the movement route of (b), which is the opposite of the movement route of (a), and the respective movement information is merged to derive the final value as shown in (c).

(c) As shown in the figure, the symbol intended by the user is a stepped symbol, and the image information data movement path confirmation system according to the present invention recognizes that the stepped symbol is information that the user intends to input.

On the other hand, the data storage means 115 that interlocks with the movement path confirming means 113 stores data on symbols such as various characters and shapes, and each character and shape is retrieved through a promised search symbol.

That is, when the input symbol of the user identified through the movement path checking unit 113 is found to be "a", the character "a" is searched for using the "a" as a search symbol. In the same manner, if the user's input symbol is a star, the star is retrieved from the data storage means 115 using the star as a search signal.

In the above-described example, the search symbol and the searched symbol are the same or relate to each other, but besides, the search symbol and the searched symbol may be promised to have completely different meanings.

For example, the stepped symbol, which is a user's input symbol identified through FIGS. 3 to 6, may be a search signal for searching for a triangle in the data storage unit 115.

When the stored data according to the moving path of the image is retrieved, the document data creating means 114 creates document data such as a text message based on this. The created document data may be transmitted by SMS or e-mail via the wireless Internet.

FIG. 8 is a diagram illustrating another process of confirming a movement path of the photographing module as shown in FIGS. 3 to 6 to confirm a symbol such as a character or a shape for creating document data.

On the other hand, characters such as Korean and English, as well as various symbols can be written in a single brush such as a, b, c, d, ㅁ, etc., but as ,, ㅈ, ㅊ, ㅋ, ㅌ, ッ, ㅎ There is also something to be cut off. Therefore, the image information data movement path confirmation system according to the present invention temporarily implements the movement path confirmation method of the above-described image in order to utilize a symbol such as a character or a shape to be cut off like the latter character or a symbol. We need a way to stop it.

To this end, the image information data movement path confirmation system according to the present invention further includes an ON / OFF control means 116, and the ON / OFF control means are operated by the input modules 150 and 150 '. That is, when the photographing module 170 is moved while the input modules 150 and 150 'are pressed, the process of tracking the movement path of the image being photographed is performed, and the input module 150 and 150' is moved. In this state, the moving path of the image being photographed is not tracked even when the photographing module 170 moves. On the contrary, of course, the movement path of the image may be tracked only when the input modules 150 and 150 'are not pressed.

The input module operation point indicated by the arrow in FIG. 8 is a point at which the movement path tracking of the image is temporarily stopped through the manipulation of the input modules 150 and 150.

Thus, the movement path of the image is tracked in the same manner as the process shown in FIG. 7, but the result is different.

An embodiment of a data input method for inputting a symbol such as a character or a shape into a mobile device as a method of confirming a movement path of a moving image photographed image according to the present invention described above will be described.

10 is a flowchart illustrating a process of inputting a symbol according to a method of confirming a movement path of an image according to the present invention, which will be described with reference to the drawing.

As described above, the movement path of the confirmed captured image is connected with specific data, and when the movement path is confirmed, the corresponding data is input to the mobile device. Such data may be data that can control the operation of the mobile device or symbols such as letters and shapes that are recorded on the wireless Internet through SMS or the mobile device.

For example, after driving a digital camera mounted on a mobile device to direct a lens to an arbitrary background, when the mobile device moves, the digital camera captures a video of the background changing according to the movement of the mobile device. The movement path checking means 113 recognizes the change of the background to be photographed, and searches for data corresponding to the recognized movement path. In this case, the data may be a signal for instructing the mechanical operation of the mobile device, such as making a phone call, connecting to the wireless Internet, turning off the power, or the like, such as letters and shapes for recording on SMS or wireless Internet. Can be.

Hereinafter, a method of inputting symbol data by using a moving path checking method of a moving image captured image according to the present invention will be described.

In general, SMS or email is used to send a message or a letter from a mobile device to another mobile device or the wired / wireless internet. The SMS or e-mail transmits a short message or e-mail composed of a combination of symbols such as letters or shapes to a text file or an HTML file.

However, regardless of the file format described above, a short message or an e-mail should be preceded by a symbol input. To this end, the data input method according to the present invention proceeds with the input of the symbol to check the moving path of the captured image.

S2; Symbol input board forming step

The symbol input board is a shape representation of a means for outputting a symbol input when creating a short message or an e-mail through a display device of a mobile device. The display board displays a symbol corresponding to an input signal generated by a user pressing a keypad of the mobile device. Is a concept that includes software and hardware for outputting from.

In general, the sign input board formation means all operations of software and hardware for outputting a sign inputted by a user by pressing a keypad for sending an SMS or mail through the Internet.

S4; Symbol input by moving path confirmation

As described above, in the related art, SMS or mail using a mobile device has been inputted with a symbol through a keypad. However, in the data input method according to the present invention, the user can input a symbol by tracking the moving path of the video image photographed through the digital camera, so the user can input the symbol through the keypad or the data input according to the present invention. The method allows you to decide whether to enter a symbol.

Determination of the symbol input method can be made by software or hardware. In the former case, the image button displayed on the display screen is pressed. In the latter case, a specific button is additionally installed on the mobile device itself. Will be

In this step, when the user selects the symbol input method as a conventional keypad, the data input method according to the present invention does not proceed any further. Of course, even if the data input method of the present invention is terminated, since the symbol input is possible through the keypad, it will be possible to send an SMS or an e-mail in a conventional manner.

S6; Input symbol confirmation board forming step

Like the symbol input board, the input symbol confirmation board includes software and hardware for outputting the path to the screen of the display while tracking the moving path of the moving image image. If a moving path of the moving image is selected, a new output screen is displayed while the screen of the input symbol confirmation board overlaps or is replaced on the display screen of the symbol input board.

As described above, the screen of the input symbol confirmation board outputs the moving path of the moving image.

S8; Camera Drive Step

The digital camera mounted on the mobile device is driven after the step S4. A driving digital camera shoots the background while providing video.

S10 to S40 have been described above and thus will be omitted here.

S45; Symbol input completed

The moving path of the moving image is output on the screen of the input symbol confirmation board through the above-described process. By the way, it is preferable that the movement path of the image is as much as possible as the shape of the symbol corresponding to the movement path. That is, when the 'b' is to be displayed, the moving path of the image is also 'a', and when the 'b' is to be displayed, the moving path of the image is 'b'.

However, in addition to the illustrated symbols, in order to display continuously Korean characters such as 'ㅂ', 'ㅅ', 'ㅈ', etc., or to display Korean characters consisting of initial, neutral, and final characters at one time, the movement path of the image is cut off. You need to enter it.

Therefore, in the data input method according to the present invention, the movement path to be input to the mobile device may be cut off while the user presses any button so that the movement path output on the screen of the input symbol confirmation board is cut off. If the button is not pressed, the movement path of the image is not input to the mobile device.

For example, when the mobile device is horizontally moved while pressing the call button, a horizontal line is drawn on the input symbol confirmation board. On the other hand, when the pressure applied to the call button is temporarily stopped and the mobile device is horizontally moved, a broken horizontal line is drawn on the input symbol confirmation board.

On this principle it is possible to enter discontinuous symbols.

On the other hand, as described above, the input symbol confirmation board displays the movement path of the image through the movement of the mobile device, the input symbol confirmation board so that the user can visually easily determine and determine the starting point of the movement path A cursor such as a mouse cursor may be displayed on the screen.

When the input symbol confirmation board is completed, a symbol is sent to the symbol input board to prepare a sentence. That is, in order to display the English word 'GOOD' on the symbol input board, 'G', 'O', 'O', and 'D' are input to the input symbol confirmation board one at a time. In more detail, in the state where the input symbol confirmation board is formed, first input the movement path of the image in the shape of 'G' and press the symbol input completion button, the input symbol confirmation board is removed (S46), and the image of the corresponding movement path is removed. By analyzing, the symbol having the closest shape is searched by the data storing means 115. (S50)

If the relevant symbol is found after the search result, display it on the symbol input board and input one letter. After the corresponding letter is input, if the next letter 'O' is inputted, the process returns to step S6 again and repeats the above process.

On the other hand, in the case of a symbol that forms a single letter by combining a consonant, a neutral, and a consonant as in Korean, after completing all of the consonant, a neutral, and a consonant, the symbol input is completed (S45). You will be able to type. However, the present invention is not limited thereto, and the symbols may be individually input to the symbol input board by separately inputting the initial, neutral, and final properties.

Through the above-described process, the operation of the mobile device may be controlled or a symbol may be input by the movement of the mobile device. Therefore, when the data input method according to the present invention is applied, the mobile device selects whether a symbol to be input is a letter or a shape for writing an SMS or an e-mail or an operation command for controlling the operation of the mobile device. You will have to go through. In addition, in the case of a letter or a shape for writing an SMS or an e-mail, it is necessary to go through a process of selecting whether the corresponding symbol is a letter or a shape. If the letter is selected as a letter, whether the letter is Korean, English, or Chinese. You will have to go through the process of selecting a language.

On the other hand, the drawings shown to show an embodiment of the technical idea according to the present invention is a mobile device in the shape of a mobile phone, the present invention is not limited to this, the mobile device is to any portable device equipped with a digital camera Applicable.

Such processes and the like may be modified in various ways without departing from the scope of the following claims through the practice of the present invention.

According to the present invention as described above, by detecting the moving path of the image taken by the digital camera can determine the moving path of the digital camera, by applying this through a digital camera mounted on the mobile device without a key device It is possible to input information into the furnace, so that it is possible to smoothly perform the user's information input, which is inconvenient button operation.

Claims (10)

A first storage step of converting an electric signal according to the amount of light individually registered in units of pixels of the image sensor into a digital value by an A / D converter and storing it in a memory; A reference value setting step of storing a corresponding digital value and a position of pixels within a predetermined range from a digital value stored in the memory and setting the reference value as a reference value; A second storage step of converting an electric signal according to a newly registered light amount after the first storage step into a digital value and storing the converted digital signal in the memory; A retrieval step of reading a digital value stored in the second storage step to retrieve a closest value or the same value as the digital value of the reference value (hereinafter, referred to as an approximation value), and confirming a position of a pixel having the approximation value; And A movement route checking step of tracking the movement route by comparing the pixel position of the reference value and the pixel position of the approximation value; Moving path confirmation method of the video shooting image, characterized in that it comprises a. The method of claim 1, The first and second storage steps are performed in a mobile device including the image sensor and an A / D converter; The searching step, the moving path confirmation method for detecting a moving path of the moving image photographing image, characterized in that the reference value is set in the unit of the reference value set in the reference value setting step. A first storage step of converting an electric signal according to an amount of light individually registered in units of pixels of an image sensor included in the mobile device into a digital value by an A / D converter and storing it in a memory; A reference value setting step of storing a corresponding digital value and a position of pixels within a predetermined range from a digital value stored in the memory and setting the reference value as a reference value; A second storage step of converting an electric signal according to a newly registered light amount after the first storage step into a digital value and storing the converted digital signal in the memory; The digital value stored in the second storage step is read in the range of the reference value set in the reference value setting step and the number of pixels, and the nearest value or the same value (hereinafter referred to as an approximation value) with the digital value of the reference value is located, and the approximation value is located. A search step of checking the position of the pixel; A movement route checking step of tracking the movement route by comparing the pixel position of the reference value and the pixel position of the approximation value; And A data retrieval step of retrieving data corresponding to the movement route tracked in the movement route checking step; Data input method according to the moving path of the video shooting image, characterized in that it comprises a. The method of claim 3, wherein And the data searched in the data search step is a symbol. The method according to claim 3 or 4, In the searching step, the digital value of the pixels within a predetermined range is searched based on the pixel position of the reference value set in the reference value setting step, and then the approximation value is found by checking the similarity with the digital value of the reference value. How to input data according to the moving path of video recording image. The method of claim 5, The retrieving step may include: obtaining a correlation within −1 to +1 displacements around the pixel position of the reference value, and approximating a value showing the threshold above when there is a value above the threshold in the correlation; If there is no value greater than or equal to a threshold value among the correlation values, a correlation value within -2 to +2 displacements is obtained and a value closest to one of the correlation values is approximated. . The method of claim 5, In the searching step, the correlation of the prediction part is first obtained by predicting which direction the mobile device will move among -2 to +2 displacements based on the pixel position of the reference value. Make this an approximation; If the correlation does not show more than a threshold value, the correlation for the remaining portion of the -2 to +2 displacement is obtained, and the value closest to 1 of the correlation is approximated according to the moving path of the moving image photographed image. How to enter data. The method of claim 3, wherein The reference value setting step, the data input method according to the moving path of the moving image captured image, characterized in that for setting the range in which the distribution of the digital value per pixel is complex. The method according to any one of claims 3, 4 or 8, Forming a sign input board which is a means for outputting a sign input by a user for transmitting a message such as SMS or mail; Forming an input symbol confirmation report which is operated separately from the symbol input board while displaying an image of the movement path so that the user can see the movement path of the photographed image; Displaying a movement route tracked through the movement route checking step on the sign input board; And Searching for data corresponding to the movement path through the data searching step and outputting the data on the preference input board; Data input method according to the moving path of the video shooting image, further comprising a. The method of claim 9, In the data retrieval step, a search is performed based on the shape of the completed moving path according to a user's input signal that the display of the moving path is completed on the screen of the input symbol confirmation board. Data input method accordingly.

Images