KR20160028169A - Apparatus for outputting image of virtual keyboard and method for controlling the apparatus - Google Patents

Abstract

The present invention discloses an apparatus for outputting an image of a virtual keyboard. According to one embodiment of the present invention, the apparatus includes: a light source outputting an incident laser beam in a constant direction; a diffractive optical element divided into a plurality of groups; a shutter designed to cover at least one of the groups; and a controller controlling the shutter to be turned on/off when a preset condition occurs.

Description

TECHNICAL FIELD [0001] The present invention relates to an apparatus for outputting an image of a virtual keyboard and a control method thereof. [0002]

The present invention relates to a technique for outputting an image of a virtual keyboard. For example, it is applicable to a projection keyboard or a portable projection keyboard.

Projection Keyboard is a device that illuminates a keyboard shape to light on a desk or floor, and when the user types it like a real keyboard, the sensor recognizes its position and inputs it as if it were pressed. It has been developed as an alternative means to solve the inconvenience of a physical keyboard or mouse of a mobile device such as a desk top computer, a personal digital assistant (PDA), a notebook computer, a laptop, and an electronic notebook. Instead of the term projection keyboard, terms such as a virtual electronic recognition keyboard, a laser keyboard, and a virtual keyboard may be used.

However, currently introduced projection keyboards only provide keyboard layouts for only one language due to the limitations of the physical structure. For example, only the Korean or English version of the virtual keyboard is displayed.

Of course, there are virtual keyboards including both English and Korean as well as physical keyboards, but there is a problem that the user has to press the shift key and the character key button at the same time each time.

Furthermore, even if two languages are simultaneously displayed in a predetermined area, there is a problem that it is difficult for a user to distinguish characters of respective languages easily due to the limit of clarity of a virtual keyboard.

The present invention has been proposed in order to solve the above-mentioned problems, and it is an object of the present invention to provide a technology for implementing a plurality of languages using a single projection keyboard.

Another object of the present invention is to improve the switching speed between a virtual keyboard configured as a first language and a virtual keyboard configured as a second language.

It is another object of the present invention to provide a technique in which a user using a projection keyboard can promptly recognize a character (character) in each area by placing a minimum of characters in each area of the virtual keyboard.

According to an aspect of the present invention, there is provided an apparatus for outputting an image of a virtual keyboard, comprising: a light source for outputting an incident laser beam in a predetermined direction; An optical element, a shutter designed to cover at least one group of the plurality of groups, and a controller for controlling the shutter to be turned on / off when a preset condition occurs.

According to another embodiment of the present invention, there is provided a method of manufacturing a diffractive optical element, comprising the steps of: outputting an incident laser beam in a predetermined direction to a diffractive optical element divided into a plurality of groups; And controlling to turn on / off a shutter designed to cover at least one group of the plurality of groups when the preset condition occurs.

An apparatus for outputting an image of a virtual keyboard according to at least one of the embodiments of the present invention and the effect of the control method thereof will be described below.

According to at least one of the embodiments of the present invention, a technique for implementing a plurality of languages with one projection keyboard is provided.

In addition, according to at least one embodiment of the present invention, there is a technical effect that a switching speed between a virtual keyboard configured in a first language and a virtual keyboard configured in a second language can be improved.

According to at least one of the embodiments of the present invention, there is an advantage that a user using the projection keyboard can quickly recognize a character (character) in each area by placing a minimum of characters in each area in the virtual keyboard .

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a diagram showing a general projection keyboard.
2 is a diagram showing an appearance of a projection keyboard according to an embodiment of the present invention.
Fig. 3 is a view showing the projection module shown in Fig. 2 in more detail.
Fig. 4 is a view showing the light source shown in Fig. 3 in more detail.
Fig. 5 is a front view of the projection module shown in Fig. 2 in more detail.
6 is a view for explaining the operation principle of the shutter shown in Fig.
FIG. 7 is a diagram illustrating an image output through a first group in a DOE (Diffractive Optical Element).
8 is a diagram showing images output through the first group and the second group in the DOE (Diffractive Optical Element).
9 is a diagram showing images output through the first group and the third group in the DOE (Diffractive Optical Element).
10 is a diagram illustrating a state in which a projection keyboard and a display device are connected according to an embodiment of the present invention.
11 is a view for explaining a process in which a connected display device outputs a first language when a projection keyboard according to an embodiment of the present invention is set to a specific mode.
12 is a diagram for explaining a process in which a connected display device outputs a second language when the projection keyboard according to an embodiment of the present invention is set to a specific mode.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

1 is a diagram showing a general projection keyboard. In the present specification, the term projection keyboard is used for convenience, but it is meant to correspond to all devices that output an image of a virtual keyboard.

As shown in FIG. 1, a general laser projection keyboard includes a light source 110 and a DOE (Diffractive Optical Element) 120. The DOE, which is a diffraction optical element, is a special optical element designed for passing a laser beam in the 405-830 nm range, for example, to produce a desired pattern. It is an optical element that has a diffraction efficiency of 99% or more and a uniformity of 60% or more and can produce a desired shape within a range of 120 degrees or less. Of course, the present invention may adopt a DOE or use another optical element, which is another embodiment of the present invention.

However, according to the prior art, the DOE 120 forms only one pattern, so that when a laser beam from the light source 110 passes through the DOE 120, There is a problem in that it can not be displayed. Hereinafter, a solution of the present invention for solving such problems and disadvantages of the conventional projection keyboard will be described in detail with reference to FIG. 2 to FIG. 12 below.

2 is a diagram showing an appearance of a projection keyboard according to an embodiment of the present invention. The projection keyboard shown in Fig. 2 forms a keyboard template (or keyboard pattern) with visible light, determines a position where a user's hand is placed when a user's hand is located in a specific area of the keyboard template, The user determines a character to be input and finally displays the determined character.

Like the SQK shown in FIG. 2, the projection keyboard is composed of a projection module, an IR module, a sensor module, and a controller. Of course, the scope of the present invention should be determined in accordance with the matters set forth in the claims, and it is also within the scope of the present invention to delete or change some modules according to the needs of those skilled in the art.

First, the projection module projects a pre-designed keyboard template on a bend-free surface. At this time, the projection module projects a keyboard template designed for each application by using a low-output red laser light source with high light efficiency.

In addition, the IR module) horizontally scans the surface of the keyboard template that is projected by the IR (Infra-Red) light interface and filters the reflected IR light through an IF filter. IR light is not visible to the human eye, but is scanned 2-3 mm above the surface at short intervals.

In addition, the sensor module is equipped with a CMOS camera that photographs a keyboard template and images it. The controller analyzes the sensing signal and image input from the sensor module, recognizes the key input, and transmits it to a display device (e.g., a TV, a mobile phone, a tablet PC, a desktop, and the like).

In particular, according to one embodiment of the present invention, the above-described projection module is different from the conventional art in that it can generate an image of a virtual keyboard corresponding to a plurality of languages. A more detailed description of the projection module shown in FIG. 2 will be described later with reference to FIG.

Fig. 3 is a view showing the projection module shown in Fig. 2 in more detail. As shown in FIG. 3, the projection module according to an embodiment of the present invention includes a light source 310, an optical element 320, a shutter 330, and the like. Of course, the projection module shown in Fig. 3 is designed to be controlled by the controller shown in Fig.

The light source 310 outputs an incident laser beam in a predetermined direction. The light source 310 will be described in more detail with reference to FIG.

The optical element 320 differs from the prior art in that it is divided into a plurality of groups. The projection keyboard of the prior art contained only optical elements for only one keyboard. The optical element 320 may be implemented by a diffractive optical element, for example.

The shutter 330 is designed to cover at least one group of the plurality of groups, and the controller controls the shutter 330 to be turned on / off when a preset condition occurs.

According to another embodiment of the present invention, the Diffractive Optical Element (DOE) 320, which is divided into the plurality of groups, includes a first group for displaying a pattern of a first language and a second group for displaying a pattern of a second language And a third group that displays a pattern corresponding to the keyboard outer edge of the keyboard.

According to another embodiment of the present invention, the shutter 330 is designed to cover the first group and the second group, and in the image of the output virtual keyboard, Module. The sensing module is shown in FIG.

More specifically, for example, when the user's touch is recognized at a specific one of the patterns of the first language by the sensing module, the controller closes the DOE corresponding to the first group, And controls the shutter 330 to open the DOE corresponding to the group.

On the other hand, when the user's touch is recognized at a specific one of the patterns of the second language by the sensing module, the controller closes the DOE corresponding to the second group, and the DOE To control the shutter 330 to open.

The light source 3100 corresponds to, for example, a laser diode, and the shutter 330 corresponds to, for example, an LC (Liquid Crystal) shutter. It is obvious that the scope of the claims should be determined according to the matters described in the claims.

On the other hand, the LC shutter includes an LC cell, which may be designed to include an LC gel that can be switched between a light transmitting state and an opaque state.

An integral LC shutter that transmits / scatters or absorbs light may be fabricated using conventional methods. To this end, the glass plate is covered with a transparent electrode. The glass plate is coated with a thin polyamide or other film for liquid crystal alignment. Optionally, the glass plate may be provided with a color filter, a black matrix, planarization layers, a passivation layer, and the like.

Furthermore, a brief description of a method for improving the response time of the LC shutter can be made by changing the LC cell optical structure and changing the driving signal, thereby shortening the rise and fall times of the LC shutters.

For example, setting a condition that the LC residual phase difference when an LC shutter drive voltage of an arbitrary level is applied to the LC cell is greater than 0, as a minimum luminance condition of the LC shutter, and a step of setting the set minimum luminance condition again as an LC residual phase difference The phase difference compensation film is added so that the condition of the LC shutter is 0 and the operation speed of the LC shutter is increased through the process of shortening the response time by applying overdriving to the rise and fall times of the LC shutter drive voltage respectively Do.

Fig. 4 is a view showing the light source shown in Fig. 3 in more detail. FIG. 4 illustrates a case where the light source 310 shown in FIG. 3 is a laser diode, but the scope of the present invention is not limited thereto.

The laser diode shown in FIG. 4 is the smallest and lightest among all kinds of lasers, and can be mass-produced at a low cost through a semiconductor process. The laser diode has an oscillation wavelength range of 300 nm to 20 μm, a maximum optical output of about 50 W, a minimum oscillation starting current of several μA, a minimum frequency line width of 50 kHz, a maximum wavelength tunable range of 30 nm, .

The semiconductor laser diode shown in Fig. 4 is a pn junction diode. The diagram shown in Fig. 4 shows a cross-sectional structure of an LD (Laser Diode). An anode and a cathode are provided on the upper surface and the lower surface of the semiconductor, respectively, and current is injected into the active layer region indicated by the i-layer. At this time, there is a current blocking layer at the edge of the electrode to effectively use the injected current to maximize the induced emission.

Although not shown in FIG. 4, when a longitudinal section of an LD (Laser Diode) is analyzed, a light wave is amplified by induced emission while reciprocating in a resonator axial direction between resonator end faces. In a resonator cross section of a Fabry-Perot (FP) type LD, a cut surface of a crystal is generally used, and a structure in which distributed reflectors having an oscillation frequency control function are integrated is also used.

In the active layer of LD, there is interaction between three important photons and electrons: (1) spontaneous emission, (2) induced emission, and (3) induced absorption. In the spontaneous emission, the number of carriers becomes higher than the thermal equilibrium state, and the light emitted from the light emitting diode is mostly generated through the spontaneous emission process. On the other hand, since the induced emission and the light absorption are opposite to each other, they are governed by either of two processes depending on the inversion distribution of the carriers. When the induced emittance becomes larger than the light absorption rate, the net gain (gnet) becomes positive and the light wave is amplified while traveling in the resonator. The inverse emf distribution is called a state in which the induced emittance is larger than the absorptivity. In order to obtain the inversion distribution, the forward voltage applied to the pn junction should generally be larger than the band gap energy.

Even if an inversion distribution is formed, the laser oscillation is not necessarily obtained. As the light wave travels inside the resonator, many photons are lost due to scattering of the optical waveguide, energy absorption by the free carriers inside the semiconductor, and emission through the laser section. Therefore, it is necessary to note that the optical gain and the optical loss obtained when the optical wave oscillates once in the resonator should be almost equal in order to oscillate the laser.

Fig. 5 is a front view of the projection module shown in Fig. 2 in more detail. Figure 3 shows the projection module on a side-by-side basis, while Figure 5 shows the projection module on a front-side basis.

5A, a shutter (e.g., LC shutter) 530 is located at a distance closest to the displayed virtual keyboard, and then an optical element (e.g., DOE) 520 ), And a light source (e.g., a laser beam generated from the LD) 510 is located at a farthest distance. Therefore, it can be understood that the light incident from the light source 510 passes through the optical element 520 and forms a virtual keyboard having a certain shape. In addition, according to the operation of the shutter 530, a pattern according to a partial area (group) in the optical element 520 is designed to be outputted or not outputted.

More specifically, for ease of understanding, FIG. 5 (b) is a separate view of FIG. 5 (a). Of course, the respective components listed in FIG. 5B are arranged in a predetermined order as described above with reference to FIG. 5A and can also be designed as one module.

5 (b) means the light source 511, and the middle portion of FIG. 5 (b) means the optical element 521, and the portion at the uppermost portion of FIG. 5 And the shutter 531 at the lowermost position. In particular, the optical element 521 of FIG. 5 (b) will be described in more detail as follows.

The optical element 521 shown in FIG. 5 (b) may be called a segmented DOE unlike the prior art. Since the DOE used in the projection keyboard of the prior art can form only one pattern.

The segmented DOE 521 is divided into three regions (groups) as shown in Fig. 5 (b). The first group 522 is formed in a pattern representing key contours and the second group 523 is formed in a pattern representing a first language (e.g., English letters) And the third group 524 is formed in a pattern representing a second language (e.g., Korean letters).

Particularly, the shutters 531 are disposed in front of the second group 523 and the third group 524, and the second group 523 or the third group 524 Can be selectively covered. Therefore, the projection keyboard according to one embodiment of the present invention has a technical effect that can be quickly switched and displayed in each language.

Further, although the description and the drawings mainly describe two language conversions, the present invention is not limited thereto, and the present invention can be sufficiently applied to three or more language conversions.

6 is a view for explaining the operation principle of the shutter shown in Fig. Referring to FIG. 6, the LC (Liquid Crystal) shutters 530 and 531 shown in FIG. 5 will be described in more detail as follows.

First, as described above, since the shutter is designed to turn on / off only a part of the DOE forming the language pattern, the first area 522 shown in FIG. 5, that is, the pattern representing the outline of the keyboard It is designed to always output. It is assumed that the outlines of the keyboard layout corresponding to the first language (English) and the second language (Korean) are the same. In such a design, it is not necessary to repeatedly design a pattern corresponding to the outline of the keyboard of the keyboard even if the language to be served increases.

The shutter shown in Fig. 6 corresponds to the shutter 531 shown in Fig. 5 (b). That is, the second group 523 and the third group 524 of the optical elements 521, respectively.

6 (a) shows the first state (state 1) of the shutter. That is, the right area is closed and the left area is opened. 5, the language (English) corresponding to the pattern formed in the second area 523 is displayed on the virtual keyboard. On the other hand, the language (Korean) corresponding to the pattern formed in the third area 524 is not output.

6 (a) shows the second state (state 2) of the shutter. That is, the left area is closed and the right area is opened. 5, the language (Korean) corresponding to the pattern formed in the third area 524 is displayed on the virtual keyboard. On the other hand, the language (English) corresponding to the pattern formed in the second area 523 is not output.

FIG. 7 is a diagram illustrating an image output through a first group in a DOE (Diffractive Optical Element). As described above, since a pattern representing each language is selectively displayed, only the keyboard outline pattern shown in Fig. 7 is actually displayed. In addition, a virtual keyboard of this type is unnecessary for the user, and Fig. 7 is merely an explanation for facilitating understanding of the present invention.

The numbers, sizes, patterns, and the like of the outside of the keyboard shown in FIG. 7 are merely one example, and it is naturally also within the scope of the present invention to make some modifications according to needs of those skilled in the art.

Keyboard layout is a character sequence of a keyboard, such as a typewriter, a physical imprinter, or a computer. The key arrangement is categorized into a "physical array" in which position the keys are to be placed on the keyboard, and a "logical array" in which order the characters (function keys, etc.) are arranged in the set physical array.

It is also possible to design the keyboard outline form shown in Fig. 7 such that, for example, a QWERTY keyboard is the same. Since the physical keyboard for normal English and Korean is also based on this, the present invention also follows this. Of course, it is also possible to employ other keyboard layouts.

On the other hand, in relation to European languages, there are various arrangements such as German, French, Spanish, Italian, and Swedish, but the shapes of the keyboard itself are all the same.

For example, in German keyboards, the first line is QWERTY, not QWERTY. By arranging the accent characters (A, O, U, and ß), the character area has grown more than the QWERTY keyboard. French keyboards are called AZERTY keyboards. They start with AZERTY instead of QWERTY and accent characters are arranged in the first column (number column) and the numbers are replaced by the superscript. The French keyboard uniquely defines CapsLock as ShiftLock and locks it up. This makes it easier to hit the number in the first column.

European Latino characters do not switch to English mode and fully implement English. Non-Latino characters often have the inconvenience of switching to English mode. However, as described above, most of the keyboards have the same outer shape, so there is no problem in applying the present invention.

Of course, if the outer shape of the keyboard needs to be changed for each language, the DOE shown in FIG. 5B is not divided into three areas (keyboard keyboard outline, first language pattern, and second language pattern) By designing to include the outline of the keyboard layout, problems related to the keyboard layout can be solved.

8 is a diagram showing images output through the first group and the second group in the DOE (Diffractive Optical Element).

As shown in FIG. 8, it is assumed that a pattern representing a specific language (Hangul) and an arrangement of keyboards (outline) (FIG. 7) is displayed together with a virtual keyboard. At this time, the pattern for another language (English) is not displayed because it is covered by the shutter.

The Hangul keyboard is basically the same as the American standard array 101 key, which has 103 keys added with one / zero and one Chinese character. Recently, a 106-key Korean keyboard has been standardized with three additional Windows keys. Refer to the Hangul dialect for the alphabet array.

Two types of keyboards are composed of two consonants and vowels. It is a Korean keyboard type that is used as a standard. The number of keys is smaller than that of the three-piece formula. There are three types of three-vowel keyboards: first, neutral, and lasting.

9 is a diagram showing images output through the first group and the third group in the DOE (Diffractive Optical Element).

As shown in FIG. 9, it is assumed that a pattern representing a specific language (English) and an arrangement of keyboards (outline) (FIG. 7) is displayed together with a virtual keyboard. At this time, the pattern for the other language (Hangul) is not displayed because it is covered by the shutter.

There are two types of English keyboards: Dvorak keyboard, Kolmak keyboard and Quepi keyboard. Dvorak keyboard is a keyboard made by analyzing English words and studying the appearance frequency and structure that can be inputted quickly.

The ColeMark keyboard has been developed to compensate for the disadvantages of the Dvorak keyboard, and some key arrangements are the same as existing keyboard keys.

However, at present, the most widely used keyboard is a quasi-keyboard, and since the Korean and the keyboard are the same, the present invention also assumes that a QWERTY keyboard is used. Of course, this is only an example, and the present invention can be applied to other keyboards such as a Coleopic keyboard and a Dvorak keyboard.

10 is a diagram illustrating a state in which a projection keyboard and a display device are connected according to an embodiment of the present invention. 10, it is assumed that the projection keyboard 1010 and the display device 1020 according to an embodiment of the present invention are connected by wireless WiFi.

However, the projection keyboard 1010 can be connected to the display device 1020 through other wired and wireless communication means. For example, IRDA (Infrared Data Association), RF (Radio Frequency), Bluetooth, HomeRF (Home Radio Frequence), etc. may be borrowed.

11 is a view for explaining a process in which a connected display device outputs a first language when a projection keyboard according to an embodiment of the present invention is set to a specific mode.

11, it is assumed that the projection keyboard 1110 and the display device 1120 are connected by wire or wireless communication, as shown in FIG.

The virtual keyboard 1111 shown in Fig. 11 corresponds to the image shown in Fig. 9, and the virtual keyboard 1111 displays the specific character on the screen of the display device 1120 according to the user's touch recognized in the virtual keyboard 1111 1121).

12 is a diagram for explaining a process in which a connected display device outputs a second language when a projection keyboard according to an embodiment of the present invention is set to a specific mode.

12, it is assumed that the projection keyboard 1110 and the display device 1120 are connected by wire or wireless communication, as shown in FIG.

The virtual keyboard 1211 shown in Fig. 12 corresponds to the image shown in Fig. 8, and the virtual keyboard 1211 displays the specific character on the screen (not shown) of the display device 1220 1221.

Further, in the present specification, it is assumed that the object communicating with the projection keyboard of the present invention is a simple display device. However, instead of the display device, a wearable device (e.g., a smartwatch, a glass- smart glass, and HMD (head mounted display)).

The present invention described above can be implemented as computer readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

310: Laser Diode
320: optical element (segmented DOE)
330: Shutter (LC shutter)

Claims (13)

An apparatus for outputting an image of a virtual keyboard,
A light source for outputting the incident laser beam in a predetermined direction;
A diffractive optical element divided into a plurality of groups;
A shutter designed to cover at least one group of the plurality of groups; And
A controller for controlling the shutter to be turned on / off when a preset condition occurs,
And outputting an image of the virtual keyboard. The method according to claim 1,
The Diffractive Optical Element (DOE), which is divided into the plurality of groups,
A first group for displaying a pattern of a first language,
A second group for displaying a pattern of a second language, and
And a third group that displays a pattern corresponding to a keyboard outer edge of the keyboard. 3. The method of claim 2,
The shutter
And outputting an image of a virtual keyboard designed to cover the first group and the second group. The method of claim 3,
In the output virtual keyboard image, a sensing module
And outputting an image of the virtual keyboard. 5. The method of claim 4,
When the touch of the user is recognized at a specific position in the pattern of the first language by the sensing module,
The controller comprising:
And closes the DOE corresponding to the first group and controls the shutter to open the DOE corresponding to the second group. 6. The method of claim 5,
When the touch of the user is recognized at a specific position in the pattern of the second language by the sensing module,
The controller comprising:
Closes the DOE corresponding to the second group, and controls the shutter to open the DOE corresponding to the first group. The method according to claim 1,
The light source corresponds to a laser diode,
Wherein the shutter outputs an image of a virtual keyboard corresponding to an LC (Liquid Crystal) shutter. A method of controlling an apparatus for outputting an image of a virtual keyboard,
Outputting an incident laser beam in a predetermined direction to a diffractive optical element divided into a plurality of groups;
Determining whether a predetermined condition has occurred; And
Controlling to turn on / off a shutter designed to cover at least one group of the plurality of groups when the preset condition occurs
And outputting an image of the virtual keyboard. 9. The method of claim 8,
The Diffractive Optical Element (DOE), which is divided into the plurality of groups,
A first group for displaying a pattern of a first language,
A second group for displaying a pattern of a second language, and
And a third group that displays a pattern corresponding to the keyboard outer edge of the keyboard. 10. The method of claim 9,
The shutter
And outputting an image of a virtual keyboard designed to cover the first group and the second group. 11. The method of claim 10,
Wherein the determining step comprises:
In the output virtual keyboard image, sensing the touch of the user
And outputting an image of the virtual keyboard. 12. The method of claim 11,
When a touch of a user is recognized at a specific position in the pattern of the first language,
Wherein the controlling comprises:
And to control the shutter to open the DOE corresponding to the first group and open the DOE corresponding to the second group. 13. The method of claim 12,
When a touch of a user is recognized at a specific position in the pattern of the second language,
Wherein the controlling comprises:
And closes the DOE corresponding to the second group and controls the shutter to open the DOE corresponding to the first group.

Images