KR101348371B1 - A mobile device with aplane scanner and scanning method thereof - Google Patents

Abstract

The present invention relates to a mobile terminal device and a scanning method using the same, which scans a predetermined region of a scan target object at a time, records additional information directly on the displayed scan image, and displays or stores the scanned image and the additional information together. The present invention relates to a portable terminal device having a plane scanner and a scanning method using the same. According to this, it is possible to scan a two-dimensional area having a predetermined area at a time, and additionally input user memos, annotations, etc. into the scanned image, so that a large amount of information can be efficiently input and managed anytime and anywhere. There is an advantage.

Mobile terminal, scanning, scanning, touch screen, scanned image, image combination, image rotation

Description

A mobile terminal device equipped with a plane scanner and a scanning method {A MOBILE DEVICE WITH APLANE SCANNER AND SCANNING METHOD THEREOF}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable terminal device, and more particularly, to a portable terminal device equipped with a scanner and a scanning method.

The portable terminal device generally refers to a digital device that can be connected to other communication devices such as a mobile phone, a PMP, an MP3, a PDA, and is easy to carry. Such portable terminal devices are gradually evolving in the direction of miniaturization, high performance, and functional complexity due to the development of digital technology, and have been widely distributed to general users such that a large number of users possessing one or more portable terminal devices.

In addition, due to digital convergence, portable terminal devices have various additional functions in addition to their original functions, and consumers can satisfy various needs with a single device by utilizing the added functions.

In particular, recent users have tended to utilize such portable terminal devices as input / storage means for information in addition to their original purpose. For example, in the case of a mobile phone, which is a typical mobile terminal device, its original purpose is to make a call with another person, but a mobile phone user frequently uses a mobile phone to create various memos and manage main schedules.

As a method of inputting information desired by a user to a portable terminal device, the most conventional method is to use a keypad (for example, a keyboard that is mounted on a mobile phone) provided in the portable terminal device. As another method, there is a method of directly photographing a document to be input through a camera built in the portable terminal device and processing the photographed image.

However, inputting a large amount of information using a keypad provided in the portable terminal device has limitations, and in particular, it is impossible to input image information such as a picture. In addition, in the case of a camera, the camera mounted on the portable terminal has a limitation of macro shooting because its performance is not good, and thus it is not suitable for inputting a document having a lot of character information.

Accordingly, there is a demand for a portable terminal apparatus capable of efficiently inputting a large amount of information.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems, and an object thereof is to provide a portable terminal device capable of easily and efficiently inputting information and a scanning method using the same.

In order to achieve the above object, the present invention proposes a portable terminal device having a scanner so that information can be input simply and efficiently, and in particular, a plane scanner for scanning a two-dimensional area having a predetermined area at one time. The present invention provides a portable terminal apparatus and a scan method including a plane scanner that acquires a scanned image of a certain area of a scan target object at a time and allows a user to directly record and manage additional information.

More specifically, the portable terminal device equipped with the plane scanner according to the present invention, irradiates light to a predetermined area of the scan target object at the same time and detects the light reflected therefrom to scan the image corresponding to the predetermined area of the scan target object. A scanning unit to acquire at a time; A display unit which displays the scanned image and receives additional information about the scanned image; And a controller which combines the scanned image and the input additional information to be displayed on the display unit.

The scan unit may further include an image combiner configured to connect each obtained scan image to one image when the scan state is a continuous scan state.

The apparatus may further include an image rotating unit configured to calculate a rotation angle of the scan target object and to reverse the scan image by the rotation angle when the direction of the scan target object and the direction of the scan image do not match.

In this case, the scanning unit, a light source unit for irradiating light simultaneously to a predetermined area of the scan target object; A plurality of light detectors disposed on the same plane and detecting light reflected from the scan target object; And a light blocking unit formed at a periphery of the light detecting unit to prevent the detection of light other than the light reflected from the scan target object.

The scanning unit may further include a mask unit which is converted into transparent or opaque according to the peripheral illumination of the scan target object.

In addition, the scanning unit is preferably embedded in the transparent touch screen and integrally formed with the display unit.

On the other hand, the scanning method using a mobile terminal device equipped with a plane scanner according to the present invention, (a) generating a scan image by simultaneously irradiating light to a predetermined area of the object to be scanned; (b) displaying the scanned image on a display unit provided in the portable terminal device; (c) receiving additional information about the scanned image from the display unit; And (d) combining the scanned image with the additional information.

The method may further include displaying or storing the scanned image and the additional information in a combined state.

Hereinafter, a portable terminal device equipped with a plane scanner and a scanning method using the same according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a portable terminal device having a plane scanner according to an exemplary embodiment of the present invention, which includes a scanning unit 101, a display unit 103, and a control unit 102, and includes a storage unit 104, The image combiner 105 and the image rotater 106 may be further included.

The scanning unit 101 simultaneously irradiates light to a predetermined region of the scan target object and detects light reflected therefrom to acquire a scan image corresponding to a predetermined region of the scan target object at once.

The object to be scanned refers to an object containing information that a user wants to input / store in the portable terminal device, and generally refers to a document on which text, pictures, and the like are displayed. In addition, the predetermined area of the scan object refers to a two-dimensional area having a predetermined area, unlike the existing line scan area.

That is, the scanning unit 101 irradiates light to the object to be scanned, but simultaneously irradiates light to the two-dimensional area having a predetermined area. Some of the irradiated light is reflected from the object to be scanned and input back to the scanning unit 101, and the scanning unit 101 detects the reflected light to generate scan information. For example, the scan information may be generated in digital form, in which the reflected light is detected as 1 and the non-reflected light is designated as 0.

Since the scan information includes information on a portion to which light is irradiated, that is, a two-dimensional area having a predetermined area, imaging a part or all of the scan information may acquire a scan image corresponding to a certain area of the scan target object at once. It will be possible.

The display unit 103 displays a scan image acquired by the scanning unit 101. In addition, the display unit 103 performs a function of receiving additional information on the scan image from a user. In this case, the additional information about the scanned image refers to various memos, annotations, etc. that a user additionally records on the displayed scanned image.

As such, the display unit 103 serves as both a display unit for displaying a scanned image and an input unit for receiving additional information. The display unit 103 includes a touch screen having an integrated input / output function on the portable terminal device. It is possible to implement the display unit 103 by mounting.

In addition, the scanning unit 101 and the display unit 103 may be integrally formed on a transparent touch screen, which will be described later.

The control unit 102 displays the scan image acquired by the scanning unit 101 on the display unit 103. In this case, when the user inputs additional information with respect to the scanned image displayed through the display unit 103, the controller 102 generates a composite scan image by combining the displayed scan image and the received additional information, and generates the synthesized scan image. To be displayed on the display unit 103 again.

In addition, the synthesized scanned image may be stored in the storage unit 104 and subsequently displayed on the display unit 103 in response to a user's request or transmitted to another portable terminal device in association with a predetermined communication unit (not shown). .

In the present exemplary embodiment, the scanning unit 101 is basically responsible for acquiring the scanned image, but the image combiner 105 and the image rotating unit 106 also play an auxiliary role in generating a scan image that is easy to read.

The image combiner 105 performs a function of connecting each acquired scan image to one image when the scan state is a continuous scan state. The continuous scan state refers to scanning continuously while the scanning unit 101 moves in an arbitrary direction on the scan target object, and is a concept that is contrasted to a stationary scan state fixed to the scan target object and scanning once.

The image rotating unit 107 performs a function of matching the direction of the scan image with the direction of the scan object when the direction of the scan object and the direction of the scan image do not match.

Detailed operations of the image combiner 106 and the image rotater 107 will be described later.

2 to 4, the scanning unit 101 will be described in more detail.

2 is a cross-sectional view of a portion of a scanning unit according to an embodiment of the present invention.

Referring to FIG. 2, the scanning unit 101 according to the exemplary embodiment of the present invention includes a light source unit 301, a light detector 302, and a light blocking unit 303.

The light source unit 301 simultaneously irradiates light to a predetermined area of the scan target object 400. In order to simultaneously irradiate light to a predetermined region, the light source unit 301 may be configured of a plurality of light emitting elements arranged on a lower surface of the main body unit 201. The main body 201 may be a main body of the mobile terminal device.

The photo detector 302 detects light reflected from the scan target object 400. To this end, the photodetector 302 may be formed of photo sensors disposed under the light source 301 and disposed in the same plane.

The light blocking unit 303 is formed at the periphery of the light detector 302 to prevent the detection of light other than the light reflected from the scan target object 400. For example, as shown, it is formed on the upper side of the photodetector 302 to prevent the light of the light source unit 301 from being directly incident to the photodetector 302. As the light blocking unit 303, a thin film or a light guide that blocks light may be used.

In addition, although not specifically illustrated in FIG. 2, the scanning unit 101 is connected to the photodetector 302 to create scan information using the detected light, and an image acquisition unit (not shown) for imaging the created scan information. Of course, it may be included). Furthermore, the image acquisition unit (not shown) may be built in the main body 201.

3 is a cross-sectional view of a portion of a scanning unit according to another embodiment of the present invention.

Referring to FIG. 3, the scanning unit 101 includes a light source unit 301, a light detection unit 302, and a light blocking unit 303, and the light source unit 301 is the same plane as the plane on which the light detection unit 302 is disposed. It is arranged in multiple phases. In addition, the light blocking unit 303 is formed between the light source unit 301 and the light detection unit 302 and is a structure that separates it spatially. Each function and configuration thereof are the same as those described with reference to FIG. 2, and thus a detailed description thereof will be omitted.

4 is a view illustrating a structure of a scanning unit according to another embodiment of the present invention, which is an example of a method in which the scanning unit is embedded in a transparent touch screen together with the display unit.

Referring to FIG. 4, the scanning unit 101 includes a light source unit 301, a light detection unit 302, a light blocking unit 303, and a mask unit 304 and 305, which are embedded in the transparent touch screen 501. It is formed.

The touch screen 501 refers to a transparent display device capable of touch input. The touch screen 501 is generally formed in a structure in which a pixel 502 for displaying information and a pixel 503 for receiving information are two-dimensionally arranged in one unit. For example, the touch screen 501 may be a touch embedded display or a transparent OLED display equipped with an optical sensor or a pressure sensor.

Since the light source unit 301, the light detection unit 302, and the light blocking unit 303 are the same as those described with reference to FIG. 2 or 3, detailed descriptions thereof will be omitted.

The mask units 304 and 305 are converted into transparent or opaque according to the peripheral illumination of the object to be scanned. The mask portions 304 and 305 may be made of a material that does not pass light in an opaque state, and a transparent mask may be used in which transparency is changed depending on whether power is applied.

By using the mask portions 304 and 305, it is possible to perform scanning using an external light source without using an internal light source, that is, a light source 301 if necessary. This will be described in detail as follows.

As an example, the mask portions 304 and 305 are normally kept in a transparent state. When the scan command is input, the second mask 305 formed on the photodetector 302 is opaquely switched. In this case, the transparency of the first mask 304 formed on the light source unit 301 is changed according to peripheral illumination. If the peripheral illuminance of the scan target object is greater than or equal to a preset reference value, the first mask 304 is transparently switched to allow external light to be irradiated to the scan target object. In addition, when the peripheral illuminance of the scan target object is less than the set reference value, the first mask 304 is opaquely switched so that the light of the internal light source, that is, the light source unit 301 is irradiated to the scan target object. The detection of the peripheral illumination may use a sensor provided separately, and the control unit 102 may control the transparency by adjusting the power applied to the mask units 304 and 305 by comparing the detected peripheral illumination with the set reference value. .

In addition, the scanning unit 101 may be formed of a transparent element, in which case the user may directly view the scan target object through the touch screen 501.

5 illustrates the overall appearance of a mobile terminal device equipped with a plane scanner according to an embodiment of the present invention.

In FIG. 5, the portable terminal device includes a main body 201, a scanning unit 101, and a display unit 202.

The main body 201 is a main body of the portable terminal device, and the control unit 102, the storage unit 104, the image combining unit 105, the image rotating unit 106, and the like may be embedded.

The scanning unit 101 is coupled to the lower portion of the main body 201. The scanning unit 201 may be configured as shown in FIG. 2 or 3. In addition, the scanning unit 201 may be formed to have the same size as the display unit 202 to acquire a scan image of an area corresponding to the same size as the display unit 202 at one time.

The display unit 202 is coupled to the upper portion of the main body unit 201 and displays a scan image obtained by the scanning unit 101. In this case, the user may record an additional memo or input an annotation on the displayed scanned image. For example, the display unit 202 is configured as a touch screen capable of inputting and outputting information at the same time, thereby displaying a scan image and receiving additional information from a user.

6 illustrates the overall appearance of a portable terminal device equipped with a plane scanner according to another embodiment of the present invention. This is an example of how the scanning unit is embedded in the transparent touch screen.

Referring to FIG. 6, in the portable terminal device according to the present exemplary embodiment, the center of the main body 201 is open and a transparent touch screen 501 is mounted thereon. In addition, the scanning unit 101 is built in the transparent touch screen 501, and the scanning unit 101 illustrated in FIG. 4 may be used.

Accordingly, the user may directly view the scan target object 400 through the transparent touch screen 501, and the scanning unit 101 may scan the user through a predetermined region (eg, the transparent touch screen 501). It is possible to scan at a time). The scanned image is displayed through the touch screen 501 and the user can input additional information therein.

Next, a scan method of a mobile terminal device equipped with a plane scanner according to an embodiment of the present invention will be described with reference to FIG. 7.

In FIG. 7, when a scan command by a user is input, the scanning unit 101 simultaneously irradiates light to a predetermined area of the scan target object. Subsequently, scan information is generated by detecting the light reflected from the scan target object, and the scanned scan information is imaged to generate a scan image of a predetermined region of the scan target object (S101).

For example, the scan information of the digital form designated as 1 for the reflected light is detected and 0 for the non-reflected light is created, and image information for visually viewing some or all of the scan information including 0 or 1 By converting, it is possible to generate a two-dimensional scan image having a predetermined area.

In addition, when generating a scan image, if the scan image is in a continuous scan state or the direction of the scan image does not coincide with the direction of the scan target object, the scan image may be corrected in an easily readable form. For example, in step S101, a continuous scan image generation step of connecting each scan image to a single image when the scan state is a continuous scan state, or a rotation angle for the scan object when the direction of the scan object and the direction of the scan image are inconsistent. And it may be possible to include a rotation correction step of rotating the scan image by the rotation angle in reverse.

The continuous scan image generation process and rotation correction process will be described with reference to FIGS. 8 and 9.

Referring to FIG. 8, when the image combiner 106 connects the scanned images, the image combiner 106 initializes the coordinates I (x, y, t) of the original scanned image and coordinates the new scanned image. Obtain I (x, y, tn). Then, the translation amount P = [tx ty] `and the rotation movement amount Ψ for the new coordinate are detected based on the original coordinates. After that, the position x and y of I (x, y, tn) are changed based on the I (x, y, t) coordinate system and a new image I (u, v, t) is calculated using Equation 1 below.

It is possible to combine the images by repeatedly updating the calculated new image and reflecting the initial scanned image.

Information about the movement and rotation relationship may be obtained by the control unit 102 or may use a separate speed sensor. The process of acquiring information on the relationship between the movement and the rotation may be obtained by, for example, solving a differential equation of Equation 2 below.

Where Pn = [Pnx Pny] `is the position of the scanning device in the reference coordinate system, Vn = [Vnx Vny]` is the speed of the scanning device in the reference coordinate system, Ab = [AbxAby] `is the measured value of the acceleration sensor, [omega] is defined as the angular velocity sensor measurement and C is the rotation matrix as follows.

In addition to the above method, the information about the movement and the rotation relationship may use an optical flow or a motion flow of the acquired scan image.

Next, FIG. 9 illustrates a case in which the direction of the scan target object and the scan image do not coincide with each other as a result of the continuous scan. As illustrated, the direction of the scan target object 400 is the A direction and the direction of the scan image 601 is If they do not coincide with each other in the B direction, the image rotating unit 106 calculates a degree of mismatch between the direction A of the scan target object and the direction B of the scan image, that is, the rotation angle Θ, and reverses the scanned image by the Θ. By rotating the scan image to match the direction of the scan target object. Here, each direction may be calculated through a method of recognizing a character included in the scan target object 400 and analyzing the arrangement structure of sentences.

7 again, after step S101, the controller 102 displays the scanned image on the display unit 103 provided in the portable terminal device (S102), and receives additional information about the scanned image from the display unit 103 ( S103). As described above, since the display unit 103 on which the scan image is displayed is configured as a device (eg, a touch screen) capable of simultaneously inputting / outputting information, the user can directly input additional information into the displayed scan image.

When the user records or inputs additional information on the displayed scan image, the control unit 102 generates a composite scan image by combining the scan image and the additional information (S104).

Subsequently, the composite scan image is displayed on the display unit 103 in a combined state or stored in the storage unit 104 (S105).

As a result, according to the portable terminal device having the play scanner and the scanning method using the same according to an embodiment of the present invention, since the light is simultaneously irradiated to a predetermined area of the object to be scanned and a scanned image thereof is obtained at a time, the mobile terminal device has a predetermined area. It becomes possible to scan two-dimensional areas at once. In addition, since the scanned image is displayed on a display device capable of simultaneously inputting and outputting, additional information may be added to the scanned image, and further, the scanning unit may be embedded in a transparent touch screen to obtain the scanned image by the live action.

Although the preferred embodiments of the present invention have been described, the present invention is not limited to the specific embodiments described above. That is, those skilled in the art to which the present invention pertains can make many changes and modifications to the present invention without departing from the spirit and scope of the appended claims, and all such appropriate changes and modifications are possible. Equivalents should be considered to be within the scope of the present invention.

1 is a view showing a schematic configuration of a portable terminal device equipped with a plane scanner according to an embodiment of the present invention,

2 is a view showing the configuration of a scanning unit according to an embodiment of the present invention;

3 is a view showing the configuration of a scanning unit according to another embodiment of the present invention;

4 is a view showing the configuration of a scanning unit according to another embodiment of the present invention;

5 is a view showing the appearance of a portable terminal device equipped with a plane scanner according to an embodiment of the present invention;

6 is a view showing the appearance of a portable terminal device equipped with a plane scanner according to another embodiment of the present invention;

7 is a flowchart illustrating a scanning method of a portable terminal device equipped with a plane scanner according to an embodiment of the present invention;

8 is a view illustrating a process of combining an image by an image combiner according to an embodiment of the present invention;

9 is a view for explaining a process of the image rotating unit to match the direction of the scan image and the scan object in accordance with an embodiment of the present invention.

DESCRIPTION OF THE RELATED ART [0002]

101: scanning unit 102: control unit

103: display unit 104: storage unit

105: image combining unit 106: image rotating unit

201: main body portion 301: light source portion

302: light detection unit 303: light blocking unit

400: object to be scanned 501: transparent touch screen

Claims (12)

A scanning unit which simultaneously irradiates light to a predetermined area of the scan target object corresponding to the same size as the display unit and detects the light reflected therefrom to acquire a scan image corresponding to the predetermined area of the scan target object at one time; A display unit which displays the scanned image and receives additional information about the scanned image; And And a controller which combines the scanned image and the input additional information to be displayed on the display unit. The method of claim 1, And a video combiner configured to connect each scanned image to one image when the scan state is a continuous scan state. 3. The method according to claim 1 or 2, The scanning unit, A light source unit irradiating light to a predetermined area of the scan target object at the same time; A plurality of light detectors disposed on the same plane and detecting light reflected from the scan target object; And And a light blocking unit formed at a periphery of the light detecting unit so as to prevent the detection of light other than the light reflected from the scanning target object. The method of claim 3, wherein And a plurality of the light source parts disposed on the same plane as the plane on which the light detection part is disposed, and the light blocking part is formed between the light source part and the light detection part. The method of claim 3, wherein The scanning unit further comprises a mask unit which is converted into a transparent or opaque according to the peripheral illuminance of the object to be scanned, characterized in that it further comprises a plane scanner with a plane scanner. 6. The method of claim 5, And the mask unit is transparently switched when the peripheral illumination of the scan target object is greater than or equal to a set reference value and opaquely when the peripheral illumination of the scan target object is less than a set reference value. 3. The method according to claim 1 or 2, And the scanning unit is built in a transparent touch screen and is formed integrally with the display unit. 3. The method according to claim 1 or 2, If the direction of the scan object and the direction of the scan image is inconsistent, the image rotation unit for calculating a rotation angle for this and reversely rotates the scan image by the rotation angle; further comprises a plane scanner, characterized in that Portable terminal device. (a) generating a scan image by simultaneously irradiating light to a predetermined area of a scan target object, which corresponds to the same size as a display unit provided in the portable terminal device; (b) displaying the scanned image on the display unit; (c) receiving additional information about the scanned image from the display unit; (d) combining the scan image with the additional information; and a method of scanning a portable terminal device having a plane scanner. The method of claim 9, (e) displaying or storing the scanned image and the additional information in a combined state; and scanning the portable terminal device with a plane scanner. The method of claim 9, Wherein the step (a) comprises the step of connecting each scan image obtained when the scan state is a continuous scan state into a single image; characterized in that it comprises a plane scanner. The method of claim 9, And the step (a) includes calculating a rotation angle of the scan object when the direction of the scan object is inconsistent with the direction of the scan image, and rotating the scan image by the rotation angle. Scanning method of a portable terminal device equipped with a scanner.

Images