KR101434173B1 - Apparatus for virtual user interface of wall pad and method thereof - Google Patents

Abstract

The present invention relates to a virtual input device and an input method of a home network terminal, and more particularly, to a virtual input device and an input method of a home network terminal that output an image having a virtual key to a monitor, photographs and analyzes a user's hand- And a method for inputting a command by changing a video at a virtual key position with a virtual hand.
A virtual input device of a home network terminal according to an embodiment of the present invention includes a monitor for outputting an image of a home network terminal, a camera module for photographing an operation performed by a user at a predetermined distance from the monitor in real time, , The virtual hand is displayed on the image by analysis of the manipulation behavior photographed by the camera module, the change amount of the image information at the virtual key position is obtained, and the instruction through the virtual key And a control unit for performing a function of the corresponding virtual key when it is judged as an input of a command. And a control unit for performing a function.

Description

TECHNICAL FIELD [0001] The present invention relates to a virtual input apparatus and an input method for a home network terminal,

The present invention relates to a virtual input device and an input method of a home network terminal, and more particularly, to a virtual input device and an input method of a home network terminal that output an image having a virtual key to a monitor, photographs and analyzes a user's hand- And a method for inputting a command by changing a video at a virtual key position with a virtual hand.

The home network system is a technology that can control home appliances such as TV, audio, video, computer, refrigerator, washing machine and the like installed in the home using wired / wireless communication and can share contents among devices.

When the home network is provided, the user can access the home network system through the communication network even at a long distance to control the home electronics.

In addition, home appliances can enable Internet access, video transmission, e-mail transmission and reception from inside and outside the home, thus realizing a cyber home.

Meanwhile, in an apartment or the like, home network terminals are installed in a home, and a user and a manager at a remote location control and monitor a home network terminal by interworking with an internet network through a data server and a gateway installed in the home.

These home network terminals perform various functions such as home security functions such as crime prevention and gas, home control functions such as gas valves, lighting, heating and ventilation, communication such as telephone calls, visitor video, household calls, There are functions to provide daily information such as functions, announcements, remuneration application, referendum, management fee inquiry, elevator call, CCTV screen, password, SMS / MMS, ARS setting and wireless phone registration.

The setting and control of the function and the execution result of the function are outputted to the motor of the touch screen function. In order to set and control the function through the user input, the user moves to the place where the monitor is installed, There is a problem that the monitor is dirty.

In addition, as described above, the functions are diversified and the monitors provided in the home network terminal are becoming larger and larger according to the demand of the consumers. However, there is a limit in increasing the size of the monitor and the occupancy occupied by the wall There is a problem that it is difficult to utilize the space on the wall surface.

In addition, the home network terminal included in the conventional home network system is fixedly installed at a predetermined height on the house wall surface, so that a disabled person, infant or child who is uncomfortable to a patient or a patient who is dependent on a wheelchair due to uncomfortable legs is output to a monitor of a predetermined height The screen can not be viewed properly and the home network terminal can not be used smoothly.

Registration No. 10-099941 (Date of Publication: December 08, 2010)

SUMMARY OF THE INVENTION The present invention has been conceived to solve the above-described problems, and it is an object of the present invention to provide an image display apparatus and a method for displaying an image having a virtual key on a monitor of a home network terminal, The image information output to the monitor is read and the input of the command is judged through the virtual key by the RGB color value change at the virtual key position so that the user can move to the installation position of the monitor, And an object of the present invention is to provide a virtual input device and an input method of a home network terminal that can use the monitor clearly.

It is another object of the present invention to provide an image display apparatus and an image display method in which when a user outputs an image of a home network terminal equipped with a virtual key on a screen and changes a video at a virtual key position by a hand operation, It is possible to judge the input of the command through the virtual key by the change of the RGB color value at the key position, so that it is convenient to use. In particular, the elderly, child, And to provide a virtual input device and an input method of a home network terminal that enable smooth use of a network terminal.

According to an aspect of the present invention, there is provided a virtual input apparatus for a home network terminal, including: a monitor for outputting an image of a home network terminal;

A camera module for photographing an operation performed by a user at a predetermined distance from the monitor in real time; And

When a virtual key for inputting a command to perform a specific function is provided in the image, the virtual hand is displayed on the image by analyzing the manipulation action taken by the camera module, and the amount of change of the image information at the virtual key position is obtained A control unit for determining whether or not to input an instruction through the virtual key and performing a function of the virtual key when it is determined that the instruction is input;

.

According to another aspect of the present invention, there is provided a virtual input method for a home network terminal, including: a first step of registering virtual key information for inputting a command to a control unit to perform a specific function for each image output to a monitor;

A second step of the control unit outputting an image of a home network terminal to a monitor;

A third step of the camera module photographing the operation of the user at a predetermined distance in real time in the monitor;

When the virtual key is provided in the image outputted to the monitor, the control unit displays the virtual hand on the image by analyzing the manipulation action taken by the camera module, and acquires the RGB color value change amount at the virtual key position by the virtual hand Step 4;

A fifth step of the control unit comparing the RGB color value change amount with a pre-stored reference amount to determine whether a command is inputted through the virtual key; And

A sixth step of performing a function of the corresponding virtual key when the control unit determines that the command is input and outputting an image of the result of the execution to the monitor;

.

According to the means for solving the above problem, when outputting an image having a virtual key on the monitor of the home network terminal and changing the image at the virtual key position with a virtual hand by a hand operation of the user at a predetermined distance from the monitor, So that the user can move to the installation position of the monitor and judge the input of the command through the virtual key by the change of the RGB color value at the virtual key position. .

In addition, in the case of outputting an image having a virtual key having virtual coordinates on the screen, when the user approaches the virtual key outputted on the screen or performs a hand movement to access the virtual key, the camera reads the image information, The user can view images output from the home network terminal. In addition, the user can view the images output from the home network terminal, Can be used smoothly.

In addition, a situation (scene) to be input is stored in the processor, so that power consumption can be reduced by operating the camera only when an image equipped with a virtual key is output, and the erroneous recognition of a hand gesture can be prevented in advance.

1 is a schematic diagram for explaining a concept of a virtual input method according to a first embodiment of the present invention.
2 is an exemplary view of an image output to the monitor of FIG.
3 is a block diagram of a virtual input device according to a first embodiment of the present invention.
4 is a flowchart of a virtual input method according to the first embodiment of the present invention.
5 is a schematic diagram for explaining a concept of a virtual input method according to a second embodiment of the present invention.
FIGS. 6A and 6B are views showing examples of images output to the screen of FIG. 5. FIG.
7 is a block diagram of a virtual input device according to a second embodiment of the present invention.
8 is a flowchart of a virtual input method according to the second embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

It is to be noted that the same components of the drawings are denoted by the same reference numerals and symbols as possible even if they are shown in different drawings.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

Also, when a part is referred to as "including " an element, it does not exclude other elements unless specifically stated otherwise.

FIG. 1 is a schematic view for explaining the concept of a virtual input method according to a first embodiment of the present invention, and FIG. 2 is an exemplary screen of an image output to the monitor of FIG.

As shown in the figure, a monitor 1, a camera module 2, and a control unit (not shown) are provided, and the image of the home network terminal is output to the monitor 1.

The image outputted to the monitor 1 is provided with a virtual key (including a button or a joystick) 3 for inputting a command to perform a specific function. When the user is away from the monitor 1 by a predetermined distance, A user who performs a hand operation in the camera module 2 installed in the terminal main body 5 in the upper part of the monitor 1 and its surroundings are photographed in real time when the virtual key 3 operation for inputting a command, To the control unit.

In the control unit, it is determined that there is a hand movement in an area where the amount of information change is significant, and the photographed image is output to the monitor 1 And the virtual hand 6 is positioned in a region where the amount of information change is severe, and the virtual hand 6 is displayed on the monitor 1.

Accordingly, the virtual hand 6 is displayed on the image of the home network terminal output to the monitor 1 as shown in FIG.

When the virtual hand 6 is displayed at the position of the virtual key 3 of the image of the home network terminal outputted to the monitor 1, the image of the position of the virtual key 3 is displayed by the virtual hand 6, And so on.

The control unit judges whether or not an instruction is inputted by the virtual key 3 due to the change of the image information and executes the function of the virtual key 3 when judging that the instruction is input, And outputs the resulting image to the monitor 1 again.

For example, when a visitor presses a bell provided on a door phone, a visitor is photographed from a camera provided on the door phone, and the image (visitor's face) 7 of the home network terminal is displayed on the monitor 1 A plurality of virtual keys 3 including call buttons on both sides thereof are output together with the face of the visitor.

At this time, the user in the room is operated by the virtual key operation, that is, by the hand operation at a predetermined distance from the monitor 1. The camera module 2 provided in the terminal main body 5 photographs the virtual key, And the virtual hand 6 corresponding to the hand operation is displayed on the monitor 1 on which the face 7 of the visitor is outputted.

When the user moves the hand to talk with the visitor and the virtual hand 6 is displayed for a predetermined time at the position of the virtual key (call button) 3, it is determined that the call button 3 is pressed and the call can be made do.

In order to know whether the virtual key 3 has changed in the virtual key 3, the position of the virtual key 3 must be known. To this end, And is registered in detail.

3 is a block diagram of a virtual input device according to a first embodiment of the present invention.

In the first embodiment, the configuration of the home network terminal is used as the configuration of the virtual input device 100, and commands can be input without touching the monitor 1 through the virtual hand and virtual key recognition algorithm.

3, the virtual input apparatus 100 mainly includes a monitor 1, a camera module, a control unit 8, and a power source control unit 9. [

In this virtual input device 100, a general function of a home network terminal, for example, a speaker and a microphone, a call DSP connected to a public telephone network, a wireless transceiver, and an Ethernet controller connected to a gateway of the Internet are omitted.

The monitor 1 is installed on a wall surface of a living room integrally with the main body 5 and the camera module 2 is installed on the main body 5 of the monitor 1.

The monitor 1 outputs an image of a home network terminal, and the camera module 2 photographs a user operation in front of the monitor, that is, a hand movement, and transmits the image to the control unit 8.

The camera module 2 includes an imaging device 21, an image recognition processor 22, a video encoder 23, and a video decoder 24.

The image pickup element 21 converts light incident from the front of the monitor 1 into an electrical signal so as to form an image.

The image recognition processor 22 converts the electrical signal into a video signal and outputs the video signal to the control unit 8. The video encoder 23 encodes the video signal so that the analog value can be handled as a digital value.

The video decoder 24 is connected to the door phone camera 110 and decodes the encoded video signal into an original signal.

In the present invention, the camera module 2 may be a CCD camera module that is stored in a CCD semiconductor device and can be displayed when necessary.

The CCD (Charge Coupled Device) camera is a camera having a built-in semiconductor device that varies light to electrical charge, stores the charges, and then reads the accumulated charges to generate a video signal.

The control unit 8 analyzes the image information change amount at the position of the virtual key 3 by the virtual hand 6 among the image information outputted to the monitor 1 and judges whether or not to input the image information. Perform the appropriate settings or controls.

The control unit 8 includes a processor 81, a flash memory 83 as a storage unit, and an SDRAM 82. [

It is assumed that the processor 81 judges that there is a hand gesture in an area of the image captured in real time in the camera module 2, particularly in a region where the amount of change of image information is severe, and outputs the photographed image in accordance with the size of the monitor 1 The virtual hand 6 is displayed in the image of the home network terminal outputted to the monitor by placing the virtual hand 6 in the region where the amount of change of information is severe and outputting only the virtual hand 6 to the monitor 1. [

The processor 81 extracts RGB color values of the position of the corresponding virtual key 3 by the virtual hand 6 according to the hand operation of the user among the image information outputted to the monitor 1 and analyzes the changed RGB color values, The movement direction and the change range of the virtual coordinates (image coordinates of the virtual hand position) in which the color value changes with time are determined and compared with the predetermined reference amount to determine whether or not the input is performed. do.

As described above, the processor 81 analyzes the image information of the photographed hand gesture and displays it on the monitor 1 as a virtual hand 6, and the image information at the position of the virtual key 3 by the virtual hand 6 Analyze the change trend to judge whether or not it is an instruction.

Since the RGB color values are influenced by ambient light, it is desirable to average the RGB color values before recognition, store the average value of the RGB color values in the current condition, and analyze the change of the RGB color values based on the average.

In addition, the coordinate (position) of each virtual key for each screen is registered in various sections in the storage means in detail, whereby the processor is informed in advance of the situation of being input through the virtual key.

In this case, the camera module 2 is operated by supplying power to the camera module 2 only when it is necessary to recognize the situation to be input in advance, so that the power consumption can be reduced and misidentification of inputting can be reduced.

The SDRAM 82, which is a storage unit, stores data stored without power supply and deletes data when the power is turned off, is used as a main storage device of the virtual input device 100.

The power supply control unit 9 supplies power required for each configuration of the virtual input device 10, that is, the monitor 1, the camera module 2, and the control unit 8.

The power control unit 9 may include, for example, an unillustrated AC input unit, a rectifier, and a battery.

The AC input section receives an AC current from the outside, and the rectifier converts the AC current into a DC current and outputs the converted DC current.

The battery accumulates a predetermined amount of charge from the current input through the rectifier, and may be a pre-charged detachable battery.

4 is a flowchart of a virtual input method according to the first embodiment of the present invention.

First, the virtual key 3 is registered for each image output to the monitor 1 in the storage unit of the control unit 8, and the function of the virtual key and the virtual key position are finely divided into several zones and registered (S402).

That is, the position and function of the function key may be programmed for each image to make a change.

In this state, the processor 81 confirms whether the virtual key 3 is provided in the image (output standby image) to be output to the monitor 1 (S404) through the virtual key information registered in the storage means.

If the output standby image has a virtual key, the processor 81 supplies power to the camera module 2 (S406).

If the virtual key is not provided, the processor 81 outputs the output standby image to the monitor 1 without operating the camera module 2 (S432).

If the virtual key is provided, the processor 81 outputs the output standby image to the monitor 1 while the camera module is operating (S408).

The camera module 2 photographs the user's hand operation (operation for virtual input) a predetermined distance ahead of the monitor 1 in real time, reads the image information, and sends the captured image to the processor 81 of the control unit 8 Output information.

The processor 81 firstly extracts the RGB color values at the position where the virtual key is present in the image output to the monitor 1 and calculates the average value of the color values for a predetermined time at step S412. It is the basis for analyzing the changing trend of the color value.

This reduces the influence of RGB color values that change due to ambient light.

The next processor 81 analyzes the photographed image information of the hand gesture and displays the virtual hand 6 on the monitor 1 (S413).

The processor 81 secondly extracts the RGB color values at the position of the virtual key 3 and analyzes the transition of the RGB color values by the virtual hand 6 along the passage of time (S414) The actual movement amount and the variation amount of the virtual coordinates (image coordinates of the virtual hand position) that are changed along with the actual movement amount and the variation amount are obtained (S416). Then, it is determined whether the virtual key is pressed by the actual movement amount and the variation amount (S418).

For example, if the movement amount or the change amount of the virtual coordinates is compared with the reference movement amount or the variation amount stored in the storage means and the movement amount or the variation amount of the virtual coordinates is larger than the reference movement amount or the variation amount, It is determined that the command is inputted through the virtual key.

The processor 81 controls the virtual input device 100 to perform the function of the corresponding virtual key in operation S420 and displays the next image to be displayed on the monitor 1 (S422).

If it is determined that the command is not input, or if the output waiting image is output to the monitor in step S432, the next image is queued as an image to be output to the monitor (S434), and then step S404 is performed again.

FIG. 5 is a schematic diagram for explaining the concept of a virtual input method according to a second embodiment of the present invention, and FIGS. 6A and 6B are exemplary diagrams of images output to the screen of FIG. 5. FIG.

The projector module 203 and the unillustrated control unit are provided so that the image 204 is projected on the screen 201 from the projector module 203. As a result, The camera module 202 reads image information output in real time.

The image 204 output to the screen 202 includes a plurality of virtual keys 205 including a button or a joystick for inputting a command to perform a specific function as shown in FIGS. 6A and 6B, When the hand 206 is approached to the virtual key 205 of the image 204 or when the virtual key 205 is approached to move the virtual key 205 to the camera module 202, The color or brightness of the image of the position of the virtual key 205 among the image information read in real time is changed.

The control unit judges whether or not an instruction is inputted by the virtual key due to the change of the image information. When it is determined that the instruction is input, the control unit performs the function of the virtual key 205 and performs the function of the corresponding virtual key 205 And outputs the resultant image to the screen 201 through the projector module 203 again.

For example, as shown in FIG. 6A, a virtual key 205 for inputting a command to perform home security, home control, communication, life information, and environment setting functions is provided on the main image 204 screen.

Here, when the user approaches the virtual key 205 for inputting a command to perform the home security function among the weather keys, the image information acquired by the camera module 202 is changed to the image information in the vicinity of the home security virtual key And the control unit determines that the home security virtual key has been pressed, thereby performing the home security function.

As a result, the sub-home security image 204 as shown in FIG. 6B is outputted to the screen 201 through the projector module 203, and the screen of the sub-home security image 204 is displayed with crime prevention 1, crime prevention 2, And a virtual key 205 for stopping an alarm, returning an alarm, and performing a test function.

In order to know whether there is a change in image information in the virtual key 205, it is necessary to know the position of the virtual key. To this end, the position of the virtual key for each image is delimited and registered in various sections in the control unit .

7 is a block diagram of a virtual input device according to a second embodiment of the present invention.

As shown, the virtual input device 200 mainly includes a screen 201, a camera module 202, a projector module 203, a control unit 207, and a power control unit 208.

For example, a speaker and a microphone, a call DSP connected to a public telephone network, a wireless transceiver, and an Ethernet controller connected to a gateway of the Internet are omitted from the virtual input device 200.

The projector module 203 is installed at a position higher than the screen 201 such as a ceiling or the like and outputs an image of the home network terminal while inclining downward toward the screen 201. The camera module 202 reads the image information To the control unit (207).

The camera module 202 includes an image pickup device 221, an image recognition processor 222, a video encoder 223, and a video decoder 224.

The image pickup device 221 converts light incident from an image output to the screen 201 into an electrical signal so as to form an image.

The image recognition processor 222 converts the electrical signal into an image signal and outputs the image signal to the control unit 207. The image encoder 223 encodes the image signal so that the analog value can be handled as a digital value.

The video decoder 224 is connected to the door phone camera 310 and decodes the encoded video signal into an original signal.

In the present invention, the camera module 202 may be a CCD camera module that is stored in a CCD semiconductor device and can be displayed if necessary.

The CCD (Charge Coupled Device) camera is a camera having a built-in semiconductor device that varies light to electrical charge, stores the charges, and then reads the accumulated charges to generate a video signal.

The projector module 203 converts the video signal of the home network terminal into an output signal under the control of the control unit 207 and outputs an optical image corresponding to the output signal to the screen 201. [

The projector module 203 includes a light source unit 234, a polarization filter 233, a light source processing unit 232, and a lens unit 231.

The light source unit 234 generates a predetermined light.

The polarizing filter 233 polarizes the incident light from the light source part 234 in one direction and splits the incident light into red (R), green (G) and blue (B)

The light source processing unit 232 forms a color image by the R, G, and B tricolor beams sequentially incident through the polarizing filter 233.

The lens unit 231 adjusts the focus so that the optical image by the light source processing unit 232 can be clearly output to the external screen 1. [

Particularly, in the present invention, the light source processing unit 232 can use a DLP (Digital Light Processing) chip. The light source processing unit 232 converts the light inputted from the light source unit 234 into an appropriate video signal and transmits the converted video signal, , And the lens unit 231 outputs a part of the reflected signal to the screen 201.

The control unit 207 analyzes the image information change amount at the virtual key position among the image information captured by the camera module 202 to determine whether or not to input the image information, and controls the virtual input device 200 when judged as an input.

The control unit 207 includes a processor 271, a flash memory 273, and an SDRAM 272, which are storage means.

The processor 271 extracts the RGB color values of the corresponding virtual key position from the image information captured by the camera module 202 and analyzes the changed color transition values. The processor 271 calculates virtual coordinates in which RGB color values are changed with time The image coordinate of the position to be masked) and the change range, and judges whether or not the input is compared with the predetermined reference amount. When judged as the input, the command is executed according to the input.

As described above, the processor 271 analyzes the image information captured by the camera module 202 and recognizes the virtual key.

That is, the processor 271 analyzes the position of the virtual key 205 (the position of the virtual key is registered in advance) in the photographed image, and stores the key corresponding to the position (i.e., the area in which the hand is located in the photographed image) .

 For example, when the corresponding region (position) of the captured image is 'home control', the processor analyzes the captured image and recognizes the corresponding virtual key 'home control'.

Since the RGB color values are influenced by ambient light, it is desirable to average the RGB color values before recognition, store the average value of the RGB color values in the current condition, and analyze the change of the RGB color values based on the average.

In addition, the coordinate (position) of each virtual key for each screen is registered in various sections in the storage means in detail, and the processor 271 is informed in advance of the situation of receiving the input via the virtual key 205.

In this case, the camera module 202 is operated by supplying power to the camera module 202 only when it is necessary to recognize and input the situation to be input in advance, so that the power consumption can be reduced and the misjudgment of inputting can be reduced.

The flash memory 273, which is a storage unit, stores the data stored in the flash memory 273 without power supply. When the power is turned off, the SDRAM 272 is used as the main memory unit of the virtual input device 200.

The power supply control unit 208 supplies power required for each configuration of the virtual input device 200, that is, the camera module 202, the projector module 203, and the control unit 207.

The power control unit 207 may include, for example, an unillustrated AC input unit, a rectifier, and a battery.

The AC input section receives an AC current from the outside, and the rectifier converts the AC current into a DC current and outputs the converted DC current.

The battery accumulates a predetermined amount of charge from the current input through the rectifier, and may be a pre-charged detachable battery.

8 is a flowchart of a virtual input method according to the second embodiment of the present invention.

The virtual key 205 is registered for each of the images 204 output to the screen 201 to the storage means of the control unit 207 and the function of the virtual key 205 and the virtual key position are finely divided into several zones (S802).

That is, the position and function of the function key may be programmed for each image to make a change.

In this state, the processor 271 determines whether the virtual key 205 is included in the image (output standby image) to be output to the screen 201 through the projector module 203, (S804).

If a virtual key is provided in the output standby image, the processor 271 supplies power to the camera module 202 and operates (S806).

If the virtual key is not provided, the processor 271 outputs the output standby image to the screen 201 through the projector module 203 without operating the camera module (S832).

If the virtual key 205 is provided, the processor 271 outputs the output standby image to the screen 201 through the projector module 203 while the camera module 202 is operating (S808).

The camera module 202 photographs the image 204 output on the screen 201 in real time, reads the image information, and outputs the image information to the processor 271 of the control unit 207 (S810).

The processor 271 senses a change in the image information input in real time and determines whether or not a command is input through the virtual key 205 according to the change amount. The RGB color value at the position where the virtual key is located in the captured image is set to 1 And the average value of the color values is calculated for a predetermined time (S812). The average value of the RGB color values is used as a criterion for analyzing the change of the RGB color values in the future.

This reduces the influence of RGB color values that change due to ambient light.

The processor 271 secondarily extracts the RGB color values at the virtual key position and analyzes the transition of the RGB color values according to the passage of time (S814). The processor 271 calculates virtual coordinates (hand motion by hand operation) (S816). Then, it is determined whether the virtual key has been pressed or the hand has been moved up and down (S818) based on the actual movement amount and the variation amount.

For example, if the movement amount or the change amount of the virtual coordinates is compared with the reference movement amount or the variation amount stored in the storage means and the movement amount or the variation amount of the virtual coordinates is larger than the reference movement amount or the variation amount, It is judged that the command is inputted through the boa virtual key.

The processor 271 controls the virtual input device 200 to perform the function of the corresponding virtual key 205 in operation S820 and outputs an image representing the execution result to the screen 201 And waits for the next video (S822).

In the case where it is determined that the command is not inputted or the image waiting for output through the projector module 203 is output to the screen 201 in step S832, the next image is queued as an image output on the screen (S834 ), And performs step S804 again.

Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims. In addition, it is a matter of course that various modifications and variations are possible without departing from the scope of the technical idea of the present invention by anyone having ordinary skill in the art.

1: Monitor 2: Camera module
3: Mapping Key 4: Hands
5: terminal body 6: virtual hand
7: image 8: control unit
9: Power control unit 100: Virtual input device

Claims (13)

A monitor for outputting an image of the home network terminal;
A camera module for photographing an operation performed by a user at a predetermined distance from the monitor in real time; And
When a virtual key for inputting a command to perform a specific function is provided in the image, the virtual hand is displayed on the image by analyzing the manipulation action taken by the camera module, and the amount of change of the image information at the virtual key position is obtained A control unit for determining whether or not to input an instruction through the virtual key and performing a function of the virtual key when it is determined that the instruction is input; / RTI >
Wherein the control unit does not operate the camera module when a plurality of virtual keys are registered for each image output to the monitor and the virtual key is not provided in the next image to be output to the monitor. screen;
A projector module for outputting a video of the home network terminal to the screen;
A camera module for reading image information output on the screen in real time; And
When a virtual key for inputting a command to perform a specific function is provided in the image, it is determined whether to input a command through the virtual key by acquiring a variation amount of the image information at the virtual key position by a user operation, A control unit that performs a function of the corresponding virtual key when it is determined that the virtual key is a virtual key; / RTI >
Wherein the control unit does not operate the camera module when a plurality of virtual keys are registered for each image output to the screen and the virtual key is not provided in the next image to be output to the screen. 3. The method according to claim 1 or 2,
Wherein the change amount of the image information is an RGB color value variation amount. The method of claim 3,
Wherein the operation of the user is a manual operation for displaying a virtual hand at a virtual key position provided in an image output to a monitor and changing a RGB color value at a virtual key position. The method of claim 3,
Wherein the user operation is a manual operation for changing a RGB color value at a virtual key position by shadowing a virtual key provided in an image output to a screen. The method of claim 3,
The control unit extracts the RGB color values at the virtual key positions, analyzes the transition of the RGB color values according to the passage of time, acquires the movement amounts and the variation amounts of the virtual coordinates at which the RGB color values change with time, Wherein the virtual input device determines whether or not to input the virtual input data. delete A first step of registering virtual key information for inputting a command to the control unit to perform a specific function for each image output to the monitor;
A second step of the control unit outputting an image of a home network terminal to a monitor;
A third step of the camera module photographing the operation of the user at a predetermined distance in real time in the monitor;
When the virtual key is provided in the image outputted to the monitor, the control unit displays the virtual hand on the image by analyzing the manipulation action taken by the camera module, and acquires the RGB color value change amount at the virtual key position by the virtual hand Step 4;
A fifth step of the control unit comparing the RGB color value change amount with a pre-stored reference amount to determine whether a command is inputted through the virtual key; And
A sixth step of performing a function of the corresponding virtual key when the control unit determines that the command is input and outputting an image of the result of the execution to the monitor; Lt; / RTI >
Wherein the control unit does not supply power to prevent the camera module from operating in the third step when the virtual key is not provided in the image output to the monitor in the second step. A first step of registering virtual key information for inputting a command to the control unit to perform a specific function for each image output to the screen;
A second step of the control unit outputting an image of the home network terminal to the screen through the projector module;
A third step of the camera module photographing the image outputted on the screen in real time and reading the image information;
A fourth step of, when the virtual key is provided in the image outputted to the screen, the control unit acquiring the RGB color value change amount at the virtual key position by the user's hand motion;
A fifth step of the control unit comparing the RGB color value change amount with a pre-stored reference amount to determine whether a command is inputted through the virtual key; And
A sixth step of performing a function of the corresponding virtual key when the control unit determines that the command is input and outputting an image of the result of the execution to the screen through a projector module; Lt; / RTI >
Wherein the control unit does not supply power to the camera module when the virtual key is not provided in the image output on the screen in the second step so that the camera module does not operate in the third step. 10. The method according to claim 8 or 9,
Wherein the virtual key information is a function of a virtual key and a virtual key position in a monitor or an image output to a screen. delete 10. The method according to claim 8 or 9,
The RGB color values at the position where the virtual key exists are firstly extracted and the average value of the color values is calculated for a predetermined time,
Wherein the RGB color value at the virtual key position is secondarily extracted and used as a reference for analyzing a change in the RGB color value. 13. The method of claim 12,
Wherein the moving amount and the variation amount of virtual coordinates in which the RGB color values are changed with time are acquired as the RGB color value variation amount in the fourth step.

Images