KR20150028687A - note having a marker with a identification information and digital image data processing method - Google Patents

Abstract

The present invention relates to a note including a recording area forming a recordable space, and a marker part formed of multiple markers indicated on each corner of the recording area and, more specifically, to a note including a functional marker, in which the marker part includes at least one functional marker including identification information to be identified by a predetermined application as a command in a photographed image state.

Description

TECHNICAL FIELD [0001] The present invention relates to a digital image data processing method,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a notebook and digital image data processing method having a functional marker, and more particularly, to a notebook having a functional marker and a method for processing digital image data according to the functional marker.

In general, the function of a note is to store the content that the user has written. In order for the user to re-read the notes, the following conditions must be met.

First, remember what you wrote in the note.

Second, the record of the note should be complete.

However, there are the following problems in order to satisfy such a condition. That is, in order to find a specific content among the contents described in the note, it is inconvenient to store the description position of the note in which the content is written. In addition, it is very difficult to find the location where the information is written when the description is vast. Further, the contents described in the note may be damaged due to elapse of time or due to external factors. As a result, there is a problem in that the function of storing information can not be implemented by simply writing in a note.

It is an object of the present invention to provide a note having a function marker including identification information and a data processing method using the same.

It is another object of the present invention to provide a digital image data processing method capable of performing a corresponding command according to identification information identified through a function marker.

In order to accomplish these objects, a note having a function marker according to the present invention includes a recording area forming a recordable space and a marker part composed of a plurality of markers marked at each corner of the recording area, And at least one functional marker having identification information that can be identified by an instruction in a predetermined application in the captured image state.

A detailed feature of a note having a function marker according to the present invention is that the instruction word is extracted by the identification information identified by a combination of at least one or more characters included in the function marker.

Another detailed feature of the note having a functional marker according to the present invention is that the character comprises at least one of Arabic numerals, Korean and / or alphabets.

Another detail feature of the note having the function marker according to the present invention is that the instruction is extracted by the identification information identified by the color included in the function marker.

Another feature of the note having the function marker according to the present invention is that the function marker is formed of a plurality of blocks and at least one of the blocks is different from the other blocks and the identification information identified by the application The corresponding instruction is extracted.

Another aspect of the note having a functional marker according to the present invention is that the command includes a category classification that can be implemented by the application, automatic tag definition, automatic image correction, display of paper output information, link insertion, And a link.

A method of processing digital image data according to the present invention comprises the steps of: receiving digital image data on which at least one functional marker representing identification information has taken a note displayed at an edge; Identifying identification information included in the digital image data; Extracting a command corresponding to the identification information; And performing the instruction.

A detailed feature of the digital image data processing method according to the present invention is that the step of identifying the identification information includes an OCR (Optical Character Reader) processing step of recognizing a character included in the functional marker; And identifying identification information corresponding to a combination of recognized characters.

A detailed feature of the digital image data processing method according to the present invention is that the step of executing the command includes a category classification that can be implemented by the application, automatic tag definition, automatic image correction, display of paper output information, link insertion, , And an advertisement link.

The method of processing notes and digital image data with function markers according to the present invention can have the following effects.

First, the application can recognize the function marker and execute the corresponding command.

Second, commands that can be set by the user can be set through the function marker.

1 is a block diagram of a data processing system using a note having a function marker according to an embodiment of the present invention.
2A to 2C are diagrams illustrating an example of a note having a marker portion according to the present invention.
FIG. 3 is a diagram illustrating an example of a method of displaying a number in the case where each of the markers is composed of nine rectangular blocks.
4 is an exemplary view showing an embodiment of a note having a function marker according to another embodiment of the present invention.
Figures 5A-5C illustrate various embodiments of a note having a functional marker according to another embodiment of the present invention.
6 is an exemplary view showing an embodiment of a note having a function marker according to another embodiment of the present invention.
7 is a flowchart illustrating a process of a digital image data processing method according to the present invention.
8A to 8E are views showing an embodiment of a note having a function marker according to another embodiment of the present invention.
9A to 9E are illustrations showing an embodiment of a note having a function marker according to another embodiment of the present invention.
10A to 10E are views showing an embodiment of a note having a function marker according to another embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings.

The terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary meanings and the inventor is not limited to the meaning of the terms in order to describe his invention in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible.

1 is a configuration diagram of an image data processing system according to an embodiment of the present invention. As shown in FIG. 1, a personal computer (PC) 320 capable of being connected to the Internet, a terminal 310 capable of wired / wireless connection with the personal computer 320, A cloud server 210 providing a storage function and a database 211 connected thereto, an image data providing server 220 for implementing a service for providing image data via the Internet, And a database (DB) 221.

As mentioned above, this configuration is a preferred embodiment according to the present invention, and some components may be added and deleted depending on the implementation of the function.

Hereinafter, a terminal according to an exemplary embodiment of the present invention will be described as a representative example of a mobile communication terminal, but may be applied to various terminals such as a digital camera capable of photographing and a terminal capable of using an Internet protocol. In addition, the image data processing method according to the present invention may be implemented through the terminal 310 or the personal computer 320.

The terminal 310 implements a note taking function and an image data processing function. The note image data photographed using the terminal 310 may be stored in a memory configured in the terminal itself or may be transmitted to a personal computer 320 of a user connected by wire or wirelessly. At this time, the wireless connection can be implemented by any one of various types of short-range wireless communication methods such as bluetooth, Zigbee, wi-fi.

1 shows the Internet as an example of a communication network. However, it can be any one of a communication network implementing a function of providing a channel for data transmission and a series of data transmission / reception for information exchange such as an in-house computer network or a large- have.

The Internet connection method between the personal computer 320 and the terminal 310 may be a wired communication network, a mobile communication network, a Wibro (Wireless Broadband) network, a HSDPA (High Speed Downlink Packet Access) And a network.

Hereinafter, the operation of each component for implementing the image data processing method according to the present invention will be described.

First, the terminal 310 is used to take a handwritten content created by a user using a note to be described later. At this time, the photographed image data may include memo contents entered by the user such as technical field, lecture professor and the like including photographing date in the form of index information. At this time, the input data may be input through a keypad or a touch screen configured in the terminal 310.

As mentioned above, the terminal 310 provides image data processing functions.

The cloud server 210 provides a function of allowing a user to upload and download his / her data to a virtual space via the Internet in accordance with the spread of cloud computing technology will be. A user can access the cloud server 210 via the Internet using the personal computer 320 or the terminal 310 and can access the database 211. [

The image data providing server 220 may store image data received from a plurality of users in the database 221, for example, image data obtained by shooting lecture notes, or education image content data.

Figs. 2A to 2C are diagrams illustrating examples of a note having a function marker according to the present invention. 2A, the note 100 includes markers 111a, 112a, 113a, and 114a formed on upper, lower, left, and right corners of the substrate area 120, (110). The description area 120 refers to an area in which a user writes a handwriting using a writing instrument or a text or an image can be printed and displayed in various forms.

2B, each of the markers 111b, 112b, 113b and 114b constituting the marker unit 110 is constituted by four rectangular blocks, and each of the markers 111c , 112c, 113c, and 114c may be constituted by square blocks divided into nine blocks, respectively, and the embodiment of the present invention is shown.

The most significant feature of the present invention is that the identification information is displayed through a plurality of markers constituting the marker unit 110, the identification information is recognized by using an application, the corresponding command is extracted, and the command is executed . At this time, the method of displaying the identification information through the plurality of markers may be various forms. When the number of the marker at each corner is recognized, it can be used as various types of application commands according to the identification information. The term " command " is used to denote commands such as category classification, automatic tag definition, and image automatic correction in an application. For example, you can derive the number of each corner and let it execute various types of instructions through a combination of the numbers.

The identification information displayed through the marker is basically displayable in a form recognizable by the application.

For example, as shown in FIG. 2C, a method of displaying a number in the case where each marker is composed of nine rectangular blocks is shown in FIG. As shown in the figure, any one of the nine blocks may be deleted, and Arabic numerals "1" to "9" In this way, a combination of markers at each corner allows for a variety of 9X9X9X9 numeric representations.

For example, as shown in Fig. 4, "4" in Fig. 3 is displayed on the first marker 111c on the upper left, and "3" in Fig. 3 is displayed on the second marker 112c on the upper right. The application recognizes "43" as the identification information, reads the corresponding command from the memory, and executes the corresponding command. As described above, it is possible to express various identification information through the combination of the markers constituting the marker part.

In addition to this representation method, at least one block may be represented by a different symbol from the other blocks, or may be displayed in a different color to indicate identification information. In this way, various functions can be provided without displaying the other parts of the note separately.

Meanwhile, characters may be included in the marker constituting the identification information, and the characters may be Arabic numerals, Korean characters, and alphabetic characters. For example, as shown in FIG. 4, the identification information "43" may be displayed as shown in FIG. 5A. In this case, as shown in FIG. 5B, there may be a case where a plurality of Arabic numerals or alphabetic characters are included in one block. Further, as shown in Fig. 5C, Arabic numerals and alphabets may be used in combination to represent "A4 ". It will be appreciated that such an identification information forming method can be applied to both the case where the marker portion is composed of four blocks or the case where the marker portion is composed of nine blocks.

On the other hand, as shown in Fig. 6, in addition to the display of the identification information, the marker 114d on the lower right side has a function of indicating the limit of the right area and a function of displaying the logo of the application providing company processing the image of the note. Although this example of the mark 114d is shown at the lower right end, it should be noted that the position may be formed at any one of the remaining markers 111d, 112d, and 113d constituting the marker portion.

The progress of the method of processing the digital image data obtained by photographing the note having the function marker will be described with reference to the flowchart of FIG. It is assumed that a program or an application for implementing the digital image data process according to the present invention is installed in the personal computer 320 or the terminal 310 of the user. Therefore, in the following description, the main operation of each operation may be the central processing unit of the personal computer 320 or the terminal 310 according to which the program or the application is implemented.

First, a user receives digital image data through various paths. That is, a number of cases may occur depending on the position where the digital image data is stored. E.g,

I) When the digital image data stored in the terminal is read from the built-in memory after taking a note using the terminal,

Ii) When the digital image data stored in the user's personal computer is read,

Iii) When the digital image data stored in the database 211 is received after accessing the cloud server 210 providing upload and download services for the user's personal data using a personal computer or a terminal capable of accessing the Internet,

Iv) When receiving digital image data stored in the database 221 by accessing an image data providing server 220 for providing digital image data using a personal computer or a terminal connectable to the Internet,

And v) receiving digital image data from another user in a wired or wireless communication manner.

Since the server providing the digital contents often provides the paid content, the image data providing server 220 may allow the user to listen to or view the advertisement through the advertisement server according to the cooperation with the advertisement server providing the advertisement information. A variety of educational digital image data can be provided.

For example, digital image data obtained by taking a note of a student who has a good record of a predetermined course is provided to the image data providing server 220, and a general user provides the digital image A digital data communication method in which data is received and displayed is possible. Hereinafter, a case where a mobile communication terminal capable of wirelessly connecting to the Internet is used will be described as an example (S701).

Then, the received digital image data is analyzed to identify the identification information (S702).

Ensure that the identified identification information contains characters. That is, whether the marker is divided into a plurality of blocks and at least one block displays identification information in a form different from the other blocks, symbols, or colors, or characters such as Arabic numerals, Korean or alphabets are displayed (S703).

If it is the identification information including the character, the character is recognized through the OCR (Optical Character Reader) function (S704).

And a command corresponding to the identification information by the recognized character is extracted from the memory. The instruction corresponding to the identification information is stored in the form of a table in the memory (S705).

The application then executes the instruction corresponding to the identification information. For example, when image data is output through the display device or the printer, information is displayed to the user according to the identification information on the size of the display screen or the size information of the output sheet. For example, in the case of outputting image data obtained by scanning an English midterm exam English issue of "ABC" high school received in 2013 via an Internet lecture data providing server named "Ganada", if the English question paper is printed using the "A3" In the case of the issued image, when the user desires to output the image data, the user performs an operation to inform the user that the scanned data is the "A3" paper according to the execution of the printing operation. At this time, if the user uses the printer using the "A4" paper, the digital image data can be automatically reduced in size to fit the "A4" paper. When outputting the image to the printer, it is possible to provide the user with the information that the user has photographed the "A4" note. This identification information has the effect of providing information so that the user can determine whether to output the reduced image using the A4 paper or enlarge to fit the A4 paper in a state where the user recognizes the identification information.

If the identified information does not include the paper size information or the image output is completed, when the user confirms the digital image data through the display device using the terminal or the computer and then stores the digital image data in the terminal or the computer, It is confirmed whether the image data includes category information. If the category information is included, the digital image data is stored in the category set according to the identified category, and if the category information is not included, the digital image data is stored in the default category.

On the other hand, notes producers may print out and provide them to consumers, but users can also enter numbers or alphabets in blank spaces to execute commands. That is, you can put specific characters or numbers in each corner marker and let the application extract the range, as well as use OCR to perform the command. For example, if the user designates the number "3" in the application as "category classification operation" and the alphabet "M" as "mathematics", input "3" to the left marker and " M "is automatically entered into the category of mathematics. Through the instruction set of the functional marker, it is possible to execute a specific command with a few arbitrary combinations such as old DOS (MS-DOS).

The application installed in the terminal extracts what kind of markers are formed on the marker part and stores the image in the corresponding category. That is, when recognizing that any one of the nine divided areas has a different form from the other areas, it recognizes it as a number and executes a specific command according to the recognized number. As described above, if it is recognized as the paper size information of the note, it is used as the identification information of the size selection of the paper to be outputted. If the category identification information of the data written in the note is used, You can perform functions that can be stored in category folders.

Alternatively, a color may be displayed on the marker in a manner different from the above embodiment, so that the image data processing application can use it as identification information. That is, when the color of the marker is "Red" color, for example, if the application recognizes it as identification information indicating paper size information, it is recognized as "A3" If so, it may be recognized as a "national language" category. In the same embodiment, when the color of the marker is "Yellow" color, when the application recognizes it as identification information indicating the paper size information, it is recognized as "A4" paper, If so, it can be recognized as a "mathematics" category. At this time, if the cover and markers of the notebook are the same color, and they are photographed, they can be automatically stored in the same color folder as the product cover.

In the above embodiment, the information of the paper size or the category information has been described as an example, but it may be performed in various forms according to the implementation of the application for identifying the function marker.

That is, when a note producer wishes to perform a specific function, a command by a plurality of numbers can be implemented through the function marker. For example, if a producer produces a functional marker by printing a special marker on a notebook for a specific purpose, the producer may automatically perform a producer-based command to automatically upload the specific marker or expose the advertisement have.

As another embodiment, it is possible to set a method in which the user can directly execute a specific command. For example, when uploading directly to the personal SNS after shooting, the category (friend, family, Etc.), or perform a function of uploading to a folder of a cloud server such as a drop box. That is, after the user sets various commands that can be implemented in the application, the user may arbitrarily generate and use the function marker. For example, a user may enter a variety of commands, such as splitting categories, typing tags automatically, or uploading them to a specific site or his own cloud service, by configuring a specific number or alphabet directly in at least one of the divided blocks And it is possible to execute a command corresponding to the function marker every time the page is photographed.

It is also possible to implement a function of reading image data obtained by photographing a note in which a specific marker is combined, extracting a predetermined Internet URL from the identification information, and accessing the Internet through a link operation.

On the other hand, in order to clarify the identification according to the OCR function, the character recognition rate should be improved. In the implementation method, if the functional marker is divided into a plurality of blocks and the user forms a character using the block, the identification speed and the discrimination ability by the OCR can be improved. Such an embodiment will be described below.

"와 같다. 8A to 8E are views showing an embodiment of a note having a function marker according to another embodiment of the present invention. FIG. 8A is a side view of a note having a function marker according to another embodiment of the present invention, and shows the most preferred embodiment. The upper, lower, left, and right markers 111a, 112a, 113a, and 114a on the upper, lower, left, and right corners of the base material region 120 constituting the marker unit 110,

"

That is, it is divided into a plurality of blocks, and some blocks are displayed in black beforehand so that the user can easily create numbers and alphabets. For example, using these markers, the Arabic numeral "1" can be displayed as shown in FIG. 8C and the alphabet letter "A " FIG. 8E is an example of a case where the user desires to perform a function according to the code "1A ". In other words, when the upper and lower markers 111a and 112a are created as in the embodiment of Figs. 8C and 8D, the application can OCR process the photographed image and judge that it matches the code "1A " And implements an operation corresponding to "1A " for the image.

"와 같다. 위의 도 8a 내지 도 8e에서 나타난 바와 같이, 즉, 다수의 블록으로 나누되, 사용자가 각 블록의 경계선을 이용하여 숫자 및 알파벳을 쉽게 작성할 수 있도록 나타낸다. 예를 들어, 이러한 마커를 이용하여 아라비아 숫자 "1"는 도 9c에서와 같이 표시할 수 있고, 알파벳 문자 "A"는 도 9d에서와 같이 만들 수 있다. 도 9e는 사용자가 "1A"라는 코드에 따른 기능을 수행하기 원하는 경우를 나타낸 예시도이다. 즉, 도 9c 및 도 9d의 실시 예와 같이 상·하 마커(111a, 112a)를 작성한 경우, 어플리케이션은 촬영된 이미지를 OCR 처리하여 이로부터 "1A"라는 코드에 일치하는 것으로 판단할 수 있고, 이미지에 대하여 "1A"에 상응하는 동작을 구현한다.9A to 9E are illustrations showing an embodiment of a note having a function marker according to another embodiment of the present invention. FIG. 9A shows one side of a note having a function marker according to another embodiment of the present invention. The upper, lower, left, and right markers 111a, 112a, 113a, and 114a on the upper, lower, left, and right corners of the base material region 120 constituting the marker portion 110,

As shown in FIGS. 8A to 8E, that is, divided into a plurality of blocks, so that the user can easily create numbers and alphabets by using the boundary line of each block. For example, 9A, the alphabet letter " A "can be made as shown in FIG. 9D. FIG. 9E shows that the user performs the function according to the code" 1A & When the upper and lower markers 111a and 112a are formed as in the embodiment of FIGS. 9C and 9D, the application performs an OCR process on the photographed image, and from this, , And implements an operation corresponding to "1A " for the image.

"와 같다.10A to 10E are views showing an embodiment of a note having a function marker according to another embodiment of the present invention. FIG. 10A shows one side of a note having a function marker according to another embodiment of the present invention. The upper, lower, left, and right markers 111a, 112a, 113a, and 114a on the upper, lower, left, and right corners of the substrate area 120 constituting the marker unit 110,

"

That is, a plurality of dots (.) Are arranged in a boundary area constituting a marker so that the user can connect these dots and easily create numbers and alphabets. For example, using these markers, the Arabic numeral "1" can be displayed as shown in Fig. 10C and the alphabet letter "A " as shown in Fig. 10D. FIG. 10E is an example of a case where the user desires to perform a function according to the code "1A ". In other words, when the upper and lower markers 111a and 112a are created as in the embodiment of FIGS. 10C and 10D, the application can OCR-process the photographed image and judge that it matches the code "1A" And implements an operation corresponding to "1A " for the image.

100: note 110: marker part
111, 112, 113, 114: marker 120: recording area
210: Cloud server 220: Image data providing server
211, 212: DB 310: terminal
320: PC 410, 420, 430: Notes

Claims (14)

A recording area for forming a recordable space and a marker part composed of a plurality of markers marked on each corner of the recording area,
The marker portion,
And at least one functional marker having identification information that can be identified by a predetermined application in an image in the captured image state. The note having a function marker according to claim 1, wherein the command is extracted by identification information identified by a combination of at least one character included in the function marker. The note with a functional marker according to claim 2, wherein the character comprises at least one of Arabic numerals, Korean and / or alphabets. 2. The functional marker of claim 1, wherein the instruction is extracted by identification information identified by a color included in the functional marker. The information processing apparatus according to claim 1, wherein the functional marker is formed of a plurality of blocks, at least one of the blocks is different from the other blocks, and a corresponding command is extracted by the identification information identified by the application With functional markers. 2. The apparatus of claim 1, wherein the functional marker is formed of a plurality of divided blocks and is identified by the application according to the type of the block indicated by the user, and is extracted by the corresponding instruction by the identified identification information With functional markers. 7. The functional marker of claim 6, wherein the functional marker comprises a plurality of white blocks on a black background, and a central portion of the white blocks is black. The system of claim 1, wherein the functional marker comprises a pattern in which a plurality of points are formed in a square, wherein a glyph linked by a user is identified by the application as an Arabic numeric and / or alphabetical character, Wherein the functional marker is extracted by a command. 9. A method as claimed in any one of claims 1 to 8, wherein the instructions comprise at least one of a category classification that can be implemented by the application, automatic tag definition, automatic image correction, display of paper output information, link insertion, Wherein the at least one functional marker comprises at least one of functional markers. Receiving digital image data in which at least one functional marker representing identification information has photographed a note displayed at an edge;
Identifying identification information included in the digital image data;
Extracting a command corresponding to the identification information;
And performing the instructions. ≪ Desc / Clms Page number 22 > 11. The method of claim 10, wherein identifying the identification information comprises:
An OCR (Optical Character Reader) processing step of recognizing a character included in the functional marker;
And identifying identification information corresponding to a combination of recognized characters. 12. The method of claim 11, wherein the character comprises at least one Arabic numeric and / or alphabetic character. 11. The digital image data processing method according to claim 10, wherein the functional marker is composed of a plurality of blocks divided into equal sizes, and at least one of the blocks is different from the other blocks. 14. The method of any one of claims 10 to 13, wherein the instructions further comprise at least one of a category classification that can be implemented by the application, automatic tag definition, automatic image correction, display of output information of paper, link insertion, The digital image data processing method comprising the steps of:

Images