KR20160013501A - Holography touch method and Projector touch method - Google Patents

Abstract

The present invention provides a holography touch method. According to one embodiment of the present invention, an electronic device outputs a holography image in a set space and senses a location of a fingertip of a user by using one or more cameras prepared in the electronic device, thereby enabling the user to control the electronic device by touching the holography image realized in the set space. According to the other embodiment of the present invention, an electronic device outputs a holography image in a space set in a three dimensional space and senses a location of a fingertip of a user by using one or more cameras prepared in the electronic device and the three dimensional space, thereby enabling the user to control the electronic device by touching the holography image realized in the set space. In addition, the present invention can relate to a projector touch method. According to one embodiment of the present invention, an electronic device outputs a projector image in a set space from a projector module, and senses a location of a fingertip of a user by using one or more cameras prepared in the electronic device, thereby enabling the user to control the electronic device by touching the projector image realized in the set space. According to another embodiment of the present invention, an electronic device outputs a projector image in a space set in a three dimensional space from a projector module and senses a location of a fingertip of a user by using one or more cameras prepared in the electronic device and the three dimensional space, thereby enabling the user to control the electronic device by touching the projector image realized in the set space.

Description

[0001] The present invention relates to a holographic touch method and a projector touch method,

The present invention relates to a holographic touch method.

The present invention relates to a holographic touch method implemented in a two-dimensional or three-dimensional space set from an electronic device.

The present invention relates to a holographic touch method embodied in a three-dimensional space from an electronic device.

The present invention relates to a projector touch method implemented in a two-dimensional or three-dimensional space set from an electronic device.

Conventional display electronic devices tend to be developed into more vivid, colorful and stereoscopic displays.

A representative example is a mobile terminal. The mobile terminal is implemented in the form of a multimedia player. However, it is difficult to raise the size of the display indefinitely so that there is no inconvenience to move. Under such circumstances, there is a trend toward a mobile terminal equipped with a holographic module and a holography control system using a holographic image as one of the changes and improvements of a mobile terminal.

In addition, although the user can view the holographic image in the three-dimensional space, the control system for controlling the holographic image has been studied.

Conventional holography, however, was concentrated solely on viewing images.

For this reason, it has been a reality that the user has difficulty in controlling the holography accurately in the three-dimensional space.

Therefore, the present invention relates to a holographic touch method.

The present invention also relates to a touch method for holography implemented in a two-dimensional or three-dimensional space set from an electronic device.

The present invention also relates to a touch method for holography implemented in a three-dimensional space from an electronic device.

The present invention also relates to a touch method for a projector image implemented in a two-dimensional or three-dimensional space set from an electronic device.

A holographic touch method according to the present invention for outputting a holographic image to a space in which an electronic device is set up and sensing a position of a user's finger by one or more cameras provided in the electronic device, And a holographic touch method for controlling an electronic device by touching the holographic image.

According to the holographic touch method of the present invention, an electronic device outputs a holographic image in a space set in a three-dimensional space, and detects the position of a user's fingertip with one or more cameras provided on the electronic device and the three- A holographic touch method for controlling an electronic device by touching a holographic image implemented in the set space.

In one embodiment of the present invention, the camera basically comprises a holographic image and a camera added with a device that can be set or set to be able to sense the position of the user's fingertip.

In an embodiment of the present invention, at least one camera may be provided to sufficiently detect the position of the user's finger touching the holographic image, or may be provided to detect the position of the user's fingertip As shown in FIG.

In one embodiment of the present invention, the position of a user's fingertips can refer to the position of one or more fingertips, and can be reduced by conventionally collecting one or more fingertips, expanding one or more fingertips, touching , ≪ / RTI >

In one embodiment of the present invention, a projector touch method is a method in which an electronic device outputs a projector image to a space set from a projector module, detects the position of a user's fingertip with one or more cameras provided in the electronic device, And a touch method of controlling an electronic device by touching an image implemented in the touch panel.

In one embodiment of the present invention, a projector touch method is a method in which an electronic device outputs a projector image to a space set in a three-dimensional space from a projector module, and the electronic device and one or more cameras provided on the three- And a touch method of controlling the electronic device by sensing a position and touching an image implemented by the user in the set space.

In the present invention, a holographic image is output to a space in which an electronic device is set, a position of a user's finger is detected by one or more cameras provided in the electronic device, and a user touches a holographic image implemented in the preset space, And a holographic touch method.

In addition, the present invention provides a holographic stereoscopic image display system in which an electronic device outputs a holographic image in a space set in a three-dimensional space, and detects the position of a user's fingertip with one or more cameras provided on an electronic device and a three- The present invention provides a holographic touch method for controlling an electronic device by touching a holographic image implemented in the holographic touch device.

According to another aspect of the present invention, an electronic device outputs a projector image to a space defined by a projector module, detects the position of a user's fingertip with one or more cameras provided in the electronic device, A projector touch method for controlling an electronic device by touching a touch screen.

In addition, the present invention provides a method and an apparatus for displaying an image of a projector in a space set in a three-dimensional space from an electronic device by a projector module, detecting a position of a user's fingertip by one or more cameras provided on an electronic device and a three- And controlling the electronic device by touching an image implemented in the set space.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a front view of a mobile terminal having a holographic touch method and a projector touch method. FIG.
2 is a rear schematic view of a mobile terminal having a holographic touch method and a projector touch method.
3 is a front view of a mobile terminal having a holographic image.
4 is a rear schematic view of a mobile terminal having a holographic image.
5 is a front view of a front view of a user and a mobile terminal using a holographic touch method. Here, the one-dot chain line means that the position of the user's fingertip is detected by the camera.
6 is a rear schematic view of a user and a mobile terminal using a holographic touch method; Here, the one-dot chain line means that the position of the user's fingertip is detected by the camera.
7 is a front view of a front view of a user and a mobile terminal using a projector touch method. Here, the one-dot chain line means that the position of the user's fingertip is detected by the camera.
8 is a simplified view of a three-dimensional space having a holographic touch method; One or more cameras are provided in the three-dimensional space. In one embodiment of the present invention, the electronic device of the drawing may be provided with a plurality of electronic devices on a three-dimensional space. Here, the one-dot chain line means that the position of the user's fingertip is detected by the camera. For simplicity of illustration, the user is not depicted separately.

In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.

A holographic touch method according to the present invention is a holographic touch method in which an electronic device outputs a holographic image in a set space and detects the position of a user's fingertip with one or more cameras provided in the electronic device, And a holographic touch method for controlling the electronic device by touching the touch screen.

According to the holographic touch method of the present invention, an electronic device outputs a holographic image in a space set in a three-dimensional space, and detects the position of a user's fingertip with one or more cameras provided on the electronic device and the three- And a holography touch method for controlling the electronic device by touching a holographic image implemented in the set space. In one embodiment of the present invention, the three-dimensional spatial image means a two-dimensional to three-dimensional spatial image.

In one embodiment of the present invention, the camera basically comprises a holographic image and a camera added with a device that can be set or set to be able to sense the position of the user's fingertip.

In an embodiment of the present invention, at least one camera may be provided to sufficiently detect the position of the user's finger touching the holographic image, or may be provided to detect the position of the user's fingertip As shown in FIG.

In one embodiment of the present invention, the position of a user's fingertips can refer to the position of one or more fingertips, and can be reduced by conventionally collecting one or more fingertips, expanding one or more fingertips, touching , ≪ / RTI >

In one embodiment of the present invention, a holographic touch method includes the steps of: a camera sensing a position of a user's fingertip and transmitting data to a determination unit of the electronic device; Analyzing the transmitted data; Based on the analyzed data, the determination unit may include a step of outputting a holographic image in a predetermined space of the electronic device.

In one embodiment of the present invention, a holographic touch method includes the steps of: a camera sensing a position of a holographic image and a user's fingertip and transmitting data to a determination unit of the electronic device; Analyzing the transmitted data; Based on the analyzed data, the determination unit may include a step of outputting a holographic image in a predetermined space of the electronic device.

In one embodiment of the present invention, the holographic touch method outputs a holographic image to a space in which an electronic device is set, and even if the user is away from the holographic shape beyond a predetermined interval, the position of the user's fingertip And recognizing that the user has touched the holographic image implemented in the set space, thereby controlling the electronic device.

In one embodiment of the present invention, a holographic touch method is a method in which an electronic device outputs a holographic image in a space set in a three-dimensional space and is provided on an electronic device and a three-dimensional space And a holography touch method capable of controlling the electronic device by recognizing the position of the user's fingertip with one or more cameras and recognizing that the user has touched the holographic image implemented in the set space.

In one embodiment of the invention, the electronic device may be a mobile phone, a smart phone, a laptop computer, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), an e-book, A TV, a digital TV, a wearable device, and the like, but is not limited to the above embodiment in terms of an electronic device to be a display.

In one embodiment of the present invention, a wearable device refers to a device in a form that can be worn, such as a watch, a garment, and the like.

In one embodiment of the present invention, the electronic device may include a display unit in addition to the holographic image output unit, and the display unit refers to an electronic device to which a touch technology used in a conventional manner . In one embodiment of the present invention, the touch technology may refer to a touch technology having a touch screen. The touch screen may be a touch screen having a touch sensor implemented in the form of a touch film, a touch sheet, or a touch pad.

In an embodiment of the present invention, the electronic device described in the present invention may not sufficiently describe a conventional display using a touch screen, but it may be applied to a display using a touch screen May refer to an electronic device that includes a technology.

In one embodiment of the present invention, the electronic device

cellphone;

Smart phone;

A laptop computer;

PDAs (Personal Digital Assistants);

PMP (Portable Multimedia Player);

E-book;

Smart TV;

Digital TV;

A wearable device;

, ≪ / RTI > .

In an embodiment of the present invention, the present invention may be applied to a mobile phone, a mobile phone, a smart phone, a laptop computer, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) ), A smart TV, a digital TV, and a wearable device, when outputting an image in a space set in a three-dimensional space, one or more cameras provided in a three-dimensional space, A mobile phone, a smart phone, a laptop computer, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), an e-book, a smart phone, A user can select one of a TV, a digital TV, a wearable device, and one or more cameras provided on a three-dimensional space, And a holographic touch method for controlling an electronic device by touching an image.

In one embodiment of the present invention, a projector touch method is a method in which an electronic device outputs an image to a space set from a projector module, not a holography, and detects the position of a user's fingertip with one or more cameras provided in the electronic device, And a projector touch method of controlling an electronic device by touching an image implemented in a set space.

In one embodiment of the present invention, a projector touch method is a method in which an electronic device outputs an image to a space set in a three-dimensional space from a projector module, not a holography, A projector touch method in which a user senses a position of a fingertip and controls an electronic device by touching an image implemented in the set space. In one embodiment of the present invention, the three-dimensional spatial image means a two-dimensional to three-dimensional spatial image.

In an embodiment of the present invention, the present invention may be applied to a mobile phone, a mobile phone, a smart phone, a laptop computer, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) ), A smart TV, a digital TV, and a wearable device, when outputting an image in a space set in a three-dimensional space, one or more cameras provided in a three-dimensional space, A mobile phone, a smart phone, a laptop computer, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), an e-book, a smart phone, A user can select one of a TV, a digital TV, a wearable device, and one or more cameras provided on a three-dimensional space, And a projector touch method of controlling an electronic device by touching a video image.

In one embodiment of the present invention, the electronic device and the one or more cameras provided on the three-dimensional space may also be in the form of a camera in which the camera is not provided in the electronic device and one or more cameras are provided only in the three-dimensional space .

In one embodiment of the present invention, a projector touch method includes the steps of: a camera sensing a position of a user's fingertip and transmitting data to a determination unit of the electronic device; Analyzing the transmitted data; Based on the analyzed data, the determination unit may include a step of outputting a projector image in a predetermined space of the electronic device.

In one embodiment of the present invention, a projector touch method includes the steps of: a camera sensing a position of a projector image and a user's fingertip and transmitting data to a determination unit of the electronic device; Analyzing the transmitted data; Based on the analyzed data, the determination unit may include a step of outputting a projector image in a predetermined space of the electronic device.

In one embodiment of the present invention, a projector module includes a light source (for example, laser light) for outputting an image to the outside, an image generating means for generating an image, and an image enlarging / For example. Further, the projector module can control the lens or the module to adjust the image projection direction.

In one embodiment of the present invention, the projector module can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module, a DLP (Digital Light Processing) module, and the like. In one embodiment of the present invention, a DLP (Digital Light Processing) module can be usefully applied to miniaturize a projector module.

In one embodiment of the present invention, the holographic module and the projector module may be provided at selected positions among the side, front, and back of the electronic device, but are not limited thereto.

In one embodiment of the present invention, a projector touch method includes a projector module provided on a side surface of an electronic device to output and display an image on a table when the electronic device is placed on a table, A projector touch method in which a user senses a position of a fingertip of a user and controls the electronic device by touching a projector image implemented in the table by a user.

In an embodiment of the present invention, a technique for outputting a holographic image in the holographic touch method may include a technique for outputting a holographic image that is conventionally used.

In an embodiment of the present invention, a technique for outputting a projector image in a projector touch method may include a technique for outputting a projector image that is conventionally used.

In one embodiment of the present invention, a holography module is installed in the electronic device. In an embodiment of the present invention, the holography module is provided to output a holographic image to a space on a display part which is a front surface of the electronic device, or / and to output a holographic image to a rear surface of the electronic device.

In one embodiment of the present invention, a projector module is installed in the electronic device. In one embodiment of the present invention, the projector module is provided to output a projector image at a selected position on the front, rear, or side of the electronic device.

In one embodiment of the present invention, a method of mechanically controlling at least one of a camera, a projector module, a holographic module, and a component of the at least one selected may be provided with a piezoactuator or a piezo motor, It does not.

In one embodiment of the present invention, selecting one or more of a camera, a projector module, and a holography module can be implemented to be selected among rotation, up / down / left / right movement, and desorption in an electronic device.

In an embodiment of the present invention, in the holographic touch method, outputting a holographic image to a space in which an electronic device is set may include both a two-dimensional (2D) plane image and a three-dimensional (3D) stereoscopic image.

In an embodiment of the present invention, in the holographic touch method, the outputting of the holographic image to the space in which the electronic device is set can be controlled by mechanically controlling the holography module to output the position of the holographic image.

In one embodiment of the present invention, holography can refer to a technique of displaying on a two-dimensional plane set from an electronic device.

In one embodiment of the present invention, the set two-dimensional plane may mean a three-dimensional plane.

In one embodiment of the present invention, holography can mean that one or more of two-dimensional, three-dimensional, selected from the electronic device can be displayed as selected.

In one embodiment of the present invention, holography can refer to a technique of describing a three-dimensional solid on a two-dimensional plane with a laser beam.

In one embodiment of the present invention, the holography touch method detects the position of a user's fingertip with a camera provided in the electronic device, in a state in which one or more of two-dimensional, three-dimensional, Refers to a technique of controlling an electronic device by touching an image displayed by selecting one of two-dimensional, three-dimensional, or the like, without touching the display of the electronic device directly.

In one embodiment of the present invention, the holographic touch method is used to add the accuracy of the holographic touch method

a. A method of detecting the position of the user's fingertip and the user's fingertip with the camera,

b. A method of detecting the position of the user's fingertip with the camera,

c. A method of detecting the location of a user's iris and a user's fingertip with a camera,

d. A method of detecting the direction of the user's face and the position of the user's fingertip with the camera,

e. The camera senses the position of the user's fingertip and a specific portion of the user's face direction (e.g., a region where one or more of the nose, lips, eyebrows, etc. are selected) How to,

A, b, c, d, e, and e can be used.

In one embodiment of the present invention, sensing the user's fingertip is performed in order to have the accuracy of information,

a. One or more fingertips of the user,

b. One or more palms of the user,

c. One or more hands of the user,

d. One or more of the user's hands and wrists,

e. One or more arms of the user,

, &Quot; a ", " a ", and " a "

According to an embodiment of the present invention, a method of sensing the position of a user's fingertip with a camera is characterized in that the position of a user's fingertip positioned in a rectilinear portion of the camera is calculated as an angle value and is converted into a data value on the three- can do.

In an embodiment of the present invention, a method of sensing the position of a user's fingertip with a camera is that one or more cameras may be provided in more than one direction to add accuracy. The method may be a method of reducing the error by converting the position of the user's fingertip into various data values on the three-dimensional map. In one embodiment of the present invention, one or more cameras sense the position of the user's fingertip and the holographic image together. In one embodiment of the present invention, one or more cameras sense the position of the user's fingertip and the projector image together.

In one embodiment of the present invention, holography means photographed with a holography technique. Holography is to record, reproduce and create stereoscopic information using the coherence of light. Holography refers to 2D or 3D stereoscopic images.

In an embodiment of the present invention, the camera of the electronic device can be applied to any electronic device capable of sensing the position of the user's fingertip.

In one embodiment of the present invention, the camera of the electronic device can be applied to any electronic device capable of detecting the image and the position of the fingertip of the user.

In one embodiment of the present invention, the holographic touch method is a method in which a user freely touches a hologram in a three-dimensional space with one or more cameras in a three-dimensional space to change a holographic image (controlling an electronic device) It can mean technology.

In one embodiment of the present invention, the position of the user's fingertip may refer to the position of one or more fingertips,

a. Shrinking to gather more than one fingertip,

b. One or more fingertips expand,

c. A touch that moves along the position of the fingertip,

d. The touch that the screen changes according to the position of the fingertip,

e. A touch that recognizes the position of the fingertip as a pointer,

f. Touch to recognize the position of the fingertip by clicking,

g. A touch which recognizes the position of the fingertip as a pointer and has an acceleration / deceleration function,

h. A touch that recognizes the position of the fingertip as a drag,

g. Touch pattern recognition to recognize the position of the fingertip as a pattern

, But the present invention is not limited thereto.

In one embodiment of the present invention, the touch method may mean a multi-touch method.

In one embodiment of the present invention, a method of sensing the position of a user's fingertip with a camera

a. Detects the movement of the position of the user's fingertip and detects it by the camera

b. To maximize detection, the camera is zoomed in to the maximum size (for example, by zooming in)

, And a to b, each of which is made up of:

In one embodiment of the present invention, the holographic touch method and the projector touch method detect the position of a user's fingertip with a camera, recognize the data by the determination unit, compare the stored data with previously stored mapping data, Method, but is not limited thereto.

In an embodiment of the present invention, a holographic touch method and a projector touch method detect a position of a video and a user's fingertip by a camera, recognize the data by the judgment unit, compare the stored data with previously stored mapping data, But it is not limited thereto.

In one embodiment of the present invention, the camera may be configured as a device capable of taking an image at 300 megapixels or more.

In one embodiment of the present invention, it is preferable that the camera is constituted by a CCD, a CMOS, or the like capable of taking an image of 300 or more pixels.

In one embodiment of the present invention, the holographic touch method can be implemented with a robust holographic touch method when the electronic device / holographic image / user is basically positioned straight from the camera of the electronic device. In one embodiment of the present invention, the holographic touch method detects the position of a user's fingertip in a three-dimensional space, even if the electronic device / holographic image / user is not located straight from the camera of the electronic device, Can be implemented.

In one embodiment of the present invention, the projector touch method includes a secure projector touch method when the camera of the electronic device / projector image / user basically selects one or more of the electronic device, three-dimensional space, Can be implemented.

In an embodiment of the present invention, the detection of the user's eyes and eyes by the camera is based on the direction of the user's eyes (in which direction the face is directed) and the position where the pupil is located in the user's eyes Where it is located).

In one embodiment of the present invention, the holographic touch method is a holographic touch method in which an electronic device / holographic image / holography of a position that is difficult to detect, for example, a touch, from a user, when the user is positioned in a straight line from the camera of the electronic device, The electronic device or the user can rotate the holographic image to enable the image to be touched.

In one embodiment of the present invention, a holographic touch method is a method in which an electronic device outputs a holographic image in a space set in a three-dimensional space, and when a user touches all portions of the holographic image, The position of the user's fingertip is sensed by the camera, and the user can control the electronic device by touching the holographic image implemented in the preset space.

In one embodiment of the present invention, a holographic touch method is a method in which an electronic device outputs a holographic image in a space set in a three-dimensional space, wherein one or more electronic devices are provided on a three- One or more electronic devices may change the holographic image. In an embodiment of the present invention, when the user touches the holographic image to drag the holographic image and moves the holographic image to another arbitrary three-dimensional space, the camera senses the position of the user's fingertip and turns on the other electronic device And the electronic device turned on outputs a holographic image to the arbitrary three-dimensional space. In this case, a plurality of holographic images may be provided by a user's touch. In one embodiment of the invention, the electronic device comprises one or more cameras.

In one embodiment of the present invention, a projector touch method is a method in which an electronic device outputs a projector image in a space set in a three-dimensional space, wherein one or more electronic devices are provided on a three- One or more electronic devices may change the projector image. In an embodiment of the present invention, when the user touches the projector image to drag the projector image to move the projector image to another arbitrary three-dimensional space, the camera senses the position of the user's fingertip and turns on the other electronic device , And the electronic device turned on may output the projector image to the arbitrary three-dimensional space. In this case, a plurality of projector images may be provided in such a manner that the images are controlled by a user's touch. In one embodiment of the invention, the electronic device comprises one or more cameras. In one embodiment of the present invention, one or more of the holographic touch method and the projector touch method are provided and can be used in connection with each other.

In one embodiment of the present invention, the holographic touch method and the projector touch method can be used in connection with an electronic device having another display portion.

In an embodiment of the present invention, the expression 'the position of the user's fingertip is detected' by the camera can be interpreted as the expression 'detecting the position of the image and the fingertip of the user'.

In one embodiment of the present invention, the electronic device and the camera, which is provided on one or more of the three-dimensional space, performs a sufficient sensing function if the camera is not provided in the electronic device and one or more of the cameras are provided in the three- .

In one embodiment of the present invention, the holographic touch method includes:

The electronic device outputs a holographic image in a set space,

Controlling the electronic device by sensing the position of the user's fingertip with one or more cameras provided in the electronic device and allowing a user to touch the holographic image implemented in the preset space; And a holographic touch method.

In one embodiment of the present invention, the holographic touch method includes:

The electronic device outputs a holographic image in a space set on the three-dimensional space,

Controlling the electronic device by sensing the position of the user's fingertip with one or more cameras provided on the electronic device and the three-dimensional space and touching the holographic image implemented in the set space by the user; And a holographic touch method.

In one embodiment of the present invention, a method of sensing a position of a user's fingertip comprises:

a. A method of detecting the position of the user's fingertip and the user's fingertip,

b. A method of detecting the position of a user's fingertip,

c. A method of detecting the position of a user's iris and a user's fingertip,

d. A method of detecting a direction of a user's face and a position of a user's fingertip,

e. A method of detecting a specific part of a user's face direction and a position of a user's fingertip,

, ≪ / RTI > which comprises the steps of: .

In one embodiment of the invention, the position of the user's fingertip is

May refer to the location of one or more fingertips,

a. Shrinking to gather more than one fingertip,

b. One or more fingertips expand,

c. A touch that moves along the position of the fingertip,

d. The touch that the screen changes according to the position of the fingertip,

e. A touch that recognizes the position of the fingertip as a pointer,

f. Touch to recognize the position of the fingertip by clicking,

g. A touch which recognizes the position of the fingertip as a pointer and has an acceleration / deceleration function,

h. A touch that recognizes the position of the fingertip as a drag,

g. Touch pattern recognition to recognize the position of the fingertip as a pattern

, And a to g selected from the group consisting of: .

In one embodiment of the present invention, sensing the position of the user's fingertip

a. One or more fingertips of the user,

b. One or more palms of the user,

c. One or more hands of the user,

d. One or more of the user's hands and wrists,

e. One or more arms of the user,

, ≪ / RTI > and " e " .

In one embodiment of the present invention, the holographic touch method

Having a holographic multi-touch method; .

In one embodiment of the invention, controlling an electronic device

Controlling the electronic device to provide a changed holographic image; .

In one embodiment of the present invention, sensing the position of the user's fingertip

Sensing the position of the pupil in the direction of the user's eye and the user's eyes and sensing the position of the user's fingertip; .

In one embodiment of the present invention, the three-

An office, a living room, a room, a space in which a user can reside, or a space selected from among; .

In one embodiment of the present invention, sensing the position of the user's fingertip

Detecting a position of the user's fingertip in a state where the position of the fingertip of the user is separated from the holographic image by a predetermined distance or more; .

In one embodiment of the present invention, sensing the position of the user's fingertip

Detecting a position of the user's fingertip in a state where the position of the fingertip of the user is separated from the projector image by a predetermined distance or more; .

In one embodiment of the present invention,

The electronic device outputs the projector image to the space set from the projector module,

Controlling the electronic device by sensing the position of the user's fingertip with one or more cameras provided in the electronic device and allowing a user to touch a projector image implemented in the set space; And a projector touch method.

In one embodiment of the present invention,

The electronic device outputs the projector image to the space set in the three-dimensional space from the projector module,

Controlling the electronic device by sensing a position of a user's fingertip with one or more cameras provided on the electronic device and the three-dimensional space and touching a projector image implemented by the user in the set space; And a projector touch method.

In one embodiment of the present invention,

Having a projector multi-touch method; .

In one embodiment of the invention, controlling an electronic device

Controlling an electronic device to provide a changed projector image; It is characterized by .......

In one embodiment of the present invention, the holographic touch method and the projector touch method detect the position of a user's fingertip with a camera, recognize the data by the determination unit, compare the stored data with previously stored mapping data, A method of comparing and reviewing with the mapping data includes a method of comparing and reviewing based on data that can be obtained from images such as contrast, perspective, color, eye-to-eye boundary, and the like.

In one embodiment of the present invention, the method of comparing and reviewing with the mapping data can be obtained from images such as contrast, perspective, color, eye-to-eye boundary, etc. by sensing two or more pictures, images, panoramas, And a method of comparing and reviewing data based on the data.

In one embodiment of the present invention, the holographic touch method includes one or more cameras, and the camera may have a function of detecting a holographic image.

In one embodiment of the present invention, the projector touch method has one or more cameras, and the camera may have a function of detecting a projector image.

In one embodiment of the present invention, the camera basically comprises a projector image and a camera added with a device capable of being set to be able to detect the position of the user's fingertip or to be set.

In one embodiment of the present invention, the holographic touch method and the projector touch method together detect image data at the time of detecting the position of a user's fingertip with one or more cameras, and the determination unit may determine the image data.

In one embodiment of the present invention, the determination unit may use a programming language such as Visual C, C ++, C #, and the like, but is not limited thereto.

In one embodiment of the present invention, the determination unit may be provided as an app of a smart phone or a tablet PC.

In one embodiment of the present invention, the camera

Sensing the location of the user's fingertip and the holographic image; .

In one embodiment of the present invention, the camera

Sensing the position of the user's fingertip and the image of the projector; .

In one embodiment of the present invention, the mapping data means data for three-dimensionally interpreting two-dimensional information in three dimensions.

In one embodiment of the present invention, the camera senses the location of the user's fingertip and the holographic image, but is not limited to, analyzing the position of the user's fingertip and the holographic image as three-dimensional stereoscopic information.

In one embodiment of the present invention, the camera senses the position of the user's fingertip and the image of the projector, but is not limited thereto, by analyzing the position of the user's fingertip and the projector image as three-dimensional stereoscopic information.

In one embodiment of the present invention, the position of the user's fingertip is determined such that the judgment unit stores a specific hand shape of the user, for example, only one finger is spread and the other is a clicked shape, A method of detecting the position of the fingertip may be provided, but the present invention is not limited thereto. Incidentally, the method includes a method in which the judgment unit recognizes and stores a hand pattern of a certain pattern so as to minimize the occurrence of errors, and recognizes the judgment as a judgment unit command when the user has a hand pattern matching the pattern . With this method, for example, when the thumb and the finger are folded and the other fingers are folded, the finger can be recognized as a zoom-in or a zoom-out. In one embodiment of the present invention, the method is referred to as 'pattern recognition'. The 'pattern recognition' is not limited to the above embodiment, and various patterns may be used as long as the pattern can be divided into specific patterns such as a finger shape, a finger direction, a position, a palm direction, a hand direction, The 'pattern recognition' can be arbitrarily set by the user in the electronic device.

In one embodiment of the present invention, sensing the position of the user's fingertip with the camera further comprises sensing the position of the user's fingertip and further a holographic image with the camera; .

In one embodiment of the present invention, sensing the location of the user's fingertip with the camera further includes sensing the position of the user's fingertip and further the projector image with the camera; .

In one embodiment of the present invention, the holographic touch method includes the steps of outputting a holographic image to a space in which the electronic device is set, detecting the position of the user's fingertip with one or more cameras provided in the electronic device, Controlling the electronic device by touching the holographic image; And a holographic touch method.

In one embodiment of the present invention, a holographic touch method is a method in which an electronic device outputs a holographic image in a space set in a three-dimensional space, and the position of a user's fingertip is detected by one or more cameras provided on the electronic device and the three- And controlling the electronic device by touching a holographic image implemented by the user in the set space; And a holographic touch method.

In one embodiment of the present invention, a method of sensing a position of a user's fingertip comprises:

a. A method of detecting the position of the user's fingertip and the user's fingertip,

b. A method of detecting the position of a user's fingertip,

c. A method of detecting the position of a user's iris and a user's fingertip,

d. A method of detecting a direction of a user's face and a position of a user's fingertip,

e. A method of detecting a specific part of a user's face direction and a position of a user's fingertip,

, ≪ / RTI > which comprises the steps of: .

In one embodiment of the invention, the position of the user's fingertip is

May refer to the location of one or more fingertips,

a. Shrinking to gather more than one fingertip,

b. One or more fingertips expand,

c. A touch that moves along the position of the fingertip,

d. The touch that the screen changes according to the position of the fingertip,

e. A touch that recognizes the position of the fingertip as a pointer,

f. Touch to recognize the position of the fingertip by clicking,

g. A touch which recognizes the position of the fingertip as a pointer and has an acceleration / deceleration function,

h. A touch that recognizes the position of the fingertip as a drag,

g. Touch pattern recognition to recognize the position of the fingertip as a pattern

, And a to g selected from the group consisting of: .

In one embodiment of the present invention, sensing the position of the user's fingertip

a. One or more fingertips of the user,

b. One or more palms of the user,

c. One or more hands of the user,

d. One or more of the user's hands and wrists,

e. One or more arms of the user,

, ≪ / RTI > and " e " .

In one embodiment of the present invention, the holographic touch method includes a holographic multi-touch method; .

In one embodiment of the invention, controlling the electronic device comprises controlling the electronic device to provide a changed holographic image; .

In one embodiment of the present invention, sensing the position of a user's fingertip includes sensing a position of the user's eye and a position of the user's eye in the user's eye and sensing a position of the user's fingertip; .

In one embodiment of the present invention, the three-dimensional space image means a space selected from an office, a living room, a room, and a user-occupied space; .

In one embodiment of the present invention, sensing the position of the fingertip of the user includes sensing the position of the fingertip of the user while the position of the fingertip of the user is separated from the holographic image by a predetermined distance or more; .

In one embodiment of the present invention, sensing the position of the user's fingertip with the camera further comprises sensing the position of the user's fingertip and further a holographic image with the camera; .

In one embodiment of the present invention, a projector touch method is a method in which an electronic device outputs a projector image to a space set from a projector module, detects the position of a user's fingertip with one or more cameras provided in the electronic device, Controlling an electronic device by touching a projector image implemented in a space; And a projector touch method.

In one embodiment of the present invention, a projector touch method is a method in which an electronic device outputs a projector image in a space set in a three-dimensional space from a projector module, and the electronic device and one or more cameras provided in a three- And controlling the electronic device by touching a projector image implemented by the user in the set space; And a projector touch method.

In one embodiment of the present invention, a method of sensing a position of a user's fingertip comprises:

a. A method of detecting the position of the user's fingertip and the user's fingertip,

b. A method of detecting the position of a user's fingertip,

c. A method of detecting the position of a user's iris and a user's fingertip,

d. A method of detecting a direction of a user's face and a position of a user's fingertip,

e. A method of detecting a specific part of a user's face direction and a position of a user's fingertip,

, ≪ / RTI > which comprises the steps of: .

In one embodiment of the invention, the position of the user's fingertip is

May refer to the location of one or more fingertips,

a. Shrinking to gather more than one fingertip,

b. One or more fingertips expand,

c. A touch that moves along the position of the fingertip,

d. The touch that the screen changes according to the position of the fingertip,

e. A touch that recognizes the position of the fingertip as a pointer,

f. Touch to recognize the position of the fingertip by clicking,

g. A touch which recognizes the position of the fingertip as a pointer and has an acceleration / deceleration function,

h. A touch that recognizes the position of the fingertip as a drag,

g. Touch pattern recognition to recognize the position of the fingertip as a pattern

, And a to g selected from the group consisting of: .

In one embodiment of the present invention, a projector touch method includes a projector multi-touch method; .

In one embodiment of the invention, controlling the electronic device comprises controlling the electronic device to provide a changed projector image; .

In one embodiment of the present invention, sensing the position of a user's fingertip includes sensing a position of the user's eye and a position of the user's eye in the user's eye and sensing a position of the user's fingertip; .

In one embodiment of the present invention, the three-dimensional space image means a space selected from an office, a living room, a room, and a user-occupied space; .

In one embodiment of the present invention, sensing the position of the fingertip of the user includes sensing a position of the fingertip of the user in a state where the position of the fingertip of the user is separated from the projector image by a predetermined distance or more; .

In an embodiment of the present invention, sensing the position of the user's fingertip with the camera further comprises sensing the position of the user's fingertip with the camera and further detecting the projector's image; .

In one embodiment of the present invention, sensing the position of the user's fingertip with the camera further comprises sensing the position of the user's fingertip and further a holographic image with the camera; .

In one embodiment of the present invention, sensing the location of the user's fingertip with the camera further includes sensing the position of the user's fingertip and further the projector image with the camera; .

In one embodiment of the invention, one or more cameras may refer to one or more three-dimensional cameras (3D cameras).

In one embodiment of the invention, one or more cameras may mean one or more cameras and one or more three-dimensional cameras (3D cameras).

In an embodiment of the present invention, a three-dimensional camera (3D camera) may mean that two cameras shoot like a human eye. In one embodiment of the present invention, each camera of a three-dimensional camera (3D camera) may be mechanically controlled with a piezo actuator or piezo motor, but is not limited thereto.

In one embodiment of the present invention, one or more cameras may refer to one or more motion tracking cameras.

In one embodiment of the invention, one or more cameras may mean one or more cameras and one or more motion tracking cameras.

In one embodiment of the invention, one or more cameras may refer to one or more cameras and motion tracking cameras.

In one embodiment of the present invention, sensing the position of a user's fingertip may be sensed by one or more cameras and a motion tracking camera.

In one embodiment of the present invention, sensing the position of a user's fingertip may be sensed by one or more cameras, a motion tracking camera, and a distance sensor. Here, the distance sensor may be selected from among an infrared sensor, a laser sensor, and an ultrasonic sensor, but the present invention is not limited thereto. Here, the distance sensor receives digital data values from one or more cameras and motion tracking cameras and is mechanically position-adjustable. By implementing the above method, the position of the user's fingertips can be photographed in three dimensions.

In one embodiment of the present invention, the holography touch method and the projector touch method further include a distance sensor capable of sensing a position of a user's fingertip; .

In one embodiment of the present invention, the holography touch method and the projector touch method compare the shape or pattern of the user's hand with data stored in advance from one or more cameras to confirm the shape of the user's fingertip, Dimensional data or a three-dimensional data change value according to a change of position, measures a three-dimensional distance of a position of a user's fingertip with an ultrasonic sensor, determines a data value of the camera and the ultrasonic sensor by a determination unit, Can be determined as the three-dimensional position information. Here, the ultrasonic sensor may be selected from an infrared sensor, a laser sensor, and an ultrasonic sensor, but it is not limited to the sensor (distance sensor) capable of measuring the distance.

In one embodiment of the present invention, the distance sensor included in the holographic touch method and the projector touch method may be provided on an electronic device or an electronic device and a three-dimensional space.

In one embodiment of the present invention, the one or more cameras include those selected from one or more 3D cameras, motion tracking cameras, .

In one embodiment of the present invention, when motion is captured within a set space, the motion tracking camera automatically displays a fixed image on the moving object, expands the moving object, and tracks and detects the moving object according to the movement of the object it means. In one embodiment of the present invention, the motion tracking camera can sense the position of the user's fingertip.

In one embodiment of the present invention, a motion-tracking camera is basically a CCD (Charge-Coupled Device) which receives an image and converts the light into electric charge to obtain an image. And the object is detected and sensed according to the change of the digital output value.

In one embodiment of the present invention, if a motion-tracking camera has a motion-tracking function and a motionless motion-free image is designated as '100' by itself, if the motion is captured by the lens, ', And at this time, the motion tracking camera is a technology that causes the lens to be rotated to the point where the calculated change value is generated. It is easy to explain that when the camera that only memorized the calculation value without any movement of the image has changed its output value by a certain movement, the lens of the camera is automatically turned to the changed point.

In one embodiment of the present invention, if a motion-tracking camera has a motion-tracking function and a motionless motion-free image is designated as '100' by itself, if the motion is captured by the lens, ', And the motion tracking camera detects the change of the two-dimensional or three-dimensional coordinate value at the point where the calculated change value is generated.

In one embodiment of the present invention, sensing the position of a user's fingertip with one or more cameras converts the position of a user's fingertip detected by one or more cameras into two-dimensional or three-dimensional coordinate values, But is not limited to, sensing where it is located.

In one embodiment of the present invention, sensing the position of the image and the fingertip of the user with one or more cameras converts the position of the fingertip detected by one or more cameras into a two-dimensional or three-dimensional coordinate value, But is not limited to, sensing where the position of the user's fingertip is located.

In one embodiment of the present invention, the method of detecting the position of the user's eyes and the pupil with one or more cameras includes first determining the position of the user's eye, and then determining the position of the pupil from the position of the eye can do.

Here, "to be described" means "to be enumerated or described and described as it is with the contents and features of the object or process".

The present invention has been described as an upper group, a group, a range of a group, a lower range of a group, and an inclusion range of a group.

Advantages and features of the present invention and methods for accomplishing the same will become apparent with reference to the embodiments described in detail in the foregoing. However, the present invention is not limited to the embodiments disclosed in the above embodiments, but may be embodied in various forms.

The terms and expressions which have been employed herein are used as terms of the detailed description of the invention but are not intended to be limiting and are not intended to limit the terms or expressions of the described or illustrated features. However, various modifications are possible within the scope of the present invention. It is therefore to be understood that, although the present invention has been described by means of some preferred embodiments, it is to be understood that the exemplary embodiments and optional features, modifications and variations of the concepts described herein may be reclassified by conventional techniques and the like, May be considered within the scope of the invention as defined by the appended claims.

It is apparent that the specific embodiments provided herein are illustrative of useful embodiments of the present invention and that the present invention may be practiced using many variations of the devices, components, and method steps.

Useful embodiments of the invention presented herein may include various optional configurations and methods and steps.

Here, when a higher group is described, individual members that can be included in the higher group and combinations of lower groups that can be included in the higher group are feasible within the described range of the higher group. Thus, when a parent group is described herein, it should be understood that it includes the possible subgroup combinations and individual members of the group. Also, when a parent group is described, it should be understood that the individual members that can be included in the parent group and the combination of the child groups that can be included in the parent group are included in the described range of the parent group.

When substituted components are disclosed herein, it should be understood that all subgroups and all individual members of the group are disclosed herein.

Combinations of groups described or described herein may be used to practice the invention, although not otherwise mentioned.

Combinations of groups described or described herein that may be included within an upper group may be used to practice the invention, if not otherwise stated.

In one embodiment of the present invention, individual values that may be included in the ranges of the groups described or described, as well as when the ranges of the groups described or illustrated herein are given in detail, are included in the scope of the groups described or described It is intended.

In one embodiment of the present invention, combinations of groups that can be included in the ranges of the groups described or described above as well as when the ranges of the groups described or illustrated herein are given in detail are included within the scope of the above described or described group .

The specific names of the components disclosed or described herein may be referred to as arbitrary examples insofar as those of ordinary skill in the art to which the invention pertain may denote different names of the same components.

It will be appreciated that the scope of the description of the groups described herein may not appear in the claims herein.

It will be understood that the groups described herein may not appear in the claimed claims herein.

In one embodiment of the present invention, the contents of the present invention have been described at the level of those skilled in the art.

In one embodiment of the present invention, the present invention, which is described in terms of groups, ranges of groups, sub-ranges of groups, and ranges of groups, can be realized within the scope of the description of a possible higher group of the present invention.

Those skilled in the art will appreciate that the various ways of practicing the invention may be employed in the practice of the invention without undue experimentation.

In addition, those skilled in the art will recognize that the description set forth herein as the group, the scope of the group, the subranges of the group, and the scope of the group may well be employed in the practice of the upper group of the present invention You can see that it is.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention.

The invention also suitably illustrated schematically can be realized in the absence of any elements or components, restrictions or limitations not described in detail.

All known functional equivalents of any of the methods may be applied to embodiments of the present invention.

100:
110A: holography module
110AA: holographic image of 110A
110B: Holography module
110BB: Holographic image of 110B
120: Projector module
120A: Projector video
200A: camera
200B: camera
200C: camera
300: LED flash
400: Hands
500: face
1000: electronic device
1100: Camera
1200: holographic image

Claims (27)

In a holographic touch method,
The electronic device outputs a holographic image in a set space,
Controlling the electronic device by sensing the position of the user's fingertip with one or more cameras provided in the electronic device and allowing a user to touch the holographic image implemented in the preset space; of
Wherein the holographic touch method comprises: In a holographic touch method,
The electronic device outputs a holographic image in a space set on the three-dimensional space,
Controlling the electronic device by sensing the position of the user's fingertip with one or more cameras provided on the electronic device and the three-dimensional space and touching the holographic image implemented in the set space by the user; of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
A method of detecting a position of a fingertip of a user,
a. A method of detecting the position of the user's fingertip and the user's fingertip,
b. A method of detecting the position of a user's fingertip,
c. A method of detecting the position of a user's iris and a user's fingertip,
d. A method of detecting a direction of a user's face and a position of a user's fingertip,
e. A method of detecting a specific part of a user's face direction and a position of a user's fingertip,
, ≪ / RTI > which comprises the steps of: of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
The position of the user's fingertip
May refer to the location of one or more fingertips,
a. Shrinking to gather more than one fingertip,
b. One or more fingertips expand,
c. A touch that moves along the position of the fingertip,
d. The touch that the screen changes according to the position of the fingertip,
e. A touch that recognizes the position of the fingertip as a pointer,
f. Touch to recognize the position of the fingertip by clicking,
g. A touch which recognizes the position of the fingertip as a pointer and has an acceleration / deceleration function,
h. A touch that recognizes the position of the fingertip as a drag,
g. Touch pattern recognition to recognize the position of the fingertip as a pattern
, And a to g selected from the group consisting of: of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
Detecting the position of the user's fingertip
a. One or more fingertips of the user,
b. One or more palms of the user,
c. One or more hands of the user,
d. One or more of the user's hands and wrists,
e. One or more arms of the user,
, ≪ / RTI > and " e " of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
The holographic touch method
Having a holographic multi-touch method; of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
Controlling the electronic device
Controlling the electronic device to provide a changed holographic image; of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
Detecting the position of the user's fingertip
Sensing the position of the pupil in the direction of the user's eye and the user's eyes and sensing the position of the user's fingertip; of
Wherein the holographic touch method comprises: The method according to claim 2,
The three-
An office, a living room, a room, a space in which a user can reside, or a space selected from among; of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
Detecting the position of the user's fingertip
Detecting a position of the user's fingertip in a state where the position of the fingertip of the user is separated from the holographic image by a predetermined distance or more; of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
Detecting the position of the user's fingertip with the camera
Further sensing the position of the user's fingertip with the camera and additionally a holographic image; of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
The one or more cameras
Including those selected from one or more 3D cameras, motion tracking cameras; of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
Further comprising a distance sensor capable of sensing a position of a user's fingertip; of
Wherein the holographic touch method comprises: The method according to any one of claims 1 to 2,
The electronic device
cellphone;
Smart phone;
A laptop computer;
PDAs (Personal Digital Assistants);
PMP (Portable Multimedia Player);
E-book;
Smart TV;
Digital TV;
A wearable device;
, ≪ / RTI > of
Wherein the holographic touch method comprises:
In a projector touch method,
The electronic device outputs the projector image to the space set from the projector module,
Controlling the electronic device by sensing the position of the user's fingertip with one or more cameras provided in the electronic device and allowing a user to touch a projector image implemented in the set space; of
The method comprising the steps of: In a projector touch method,
The electronic device outputs the projector image to the space set in the three-dimensional space from the projector module,
Controlling the electronic device by sensing a position of a user's fingertip with one or more cameras provided on the electronic device and the three-dimensional space and touching a projector image implemented by the user in the set space; of
The method comprising the steps of:
The method according to any one of claims 15 to 16,
A method of detecting a position of a fingertip of a user,
a. A method of detecting the position of the user's fingertip and the user's fingertip,
b. A method of detecting the position of a user's fingertip,
c. A method of detecting the position of a user's iris and a user's fingertip,
d. A method of detecting a direction of a user's face and a position of a user's fingertip,
e. A method of detecting a specific part of a user's face direction and a position of a user's fingertip,
, ≪ / RTI > which comprises the steps of: of
The method comprising the steps of: The method according to any one of claims 15 to 16,
The position of the user's fingertip
May refer to the location of one or more fingertips,
a. Shrinking to gather more than one fingertip,
b. One or more fingertips expand,
c. A touch that moves along the position of the fingertip,
d. The touch that the screen changes according to the position of the fingertip,
e. A touch that recognizes the position of the fingertip as a pointer,
f. Touch to recognize the position of the fingertip by clicking,
g. A touch which recognizes the position of the fingertip as a pointer and has an acceleration / deceleration function,
h. A touch that recognizes the position of the fingertip as a drag,
g. Touch pattern recognition to recognize the position of the fingertip as a pattern
, And a to g selected from the group consisting of: of
The method comprising the steps of: The method according to any one of claims 15 to 16,
The projector touch method
Having a projector multi-touch method; of
The method comprising the steps of: The method according to any one of claims 15 to 16,
Controlling the electronic device
Controlling an electronic device to provide a changed projector image; of
The method comprising the steps of: The method according to any one of claims 15 to 16,
Detecting the position of the user's fingertip
Sensing the position of the pupil in the direction of the user's eye and the user's eyes and sensing the position of the user's fingertip; of
The method comprising the steps of: The method of claim 16,
The three-
An office, a living room, a room, a space in which a user can reside, or a space selected from among; of
The method comprising the steps of: The method according to any one of claims 15 to 16,
Detecting the position of the user's fingertip
Detecting a position of the user's fingertip in a state where the position of the fingertip of the user is separated from the projector image by a predetermined distance or more; of
The method comprising the steps of: The method according to any one of claims 15 to 16,
Detecting the position of the user's fingertip with the camera
Further sensing the location of the user's fingertip with the camera and additionally the projector image; of
The method comprising the steps of: The method according to any one of claims 15 to 16,
The one or more cameras
Including those selected from one or more 3D cameras, motion tracking cameras; of
The method comprising the steps of:
The method according to any one of claims 15 to 16,
Further comprising a distance sensor capable of sensing a position of a user's fingertip; of
The method comprising the steps of: The method according to any one of claims 15 to 16,
The electronic device
cellphone;
Smart phone;
A laptop computer;
PDAs (Personal Digital Assistants);
PMP (Portable Multimedia Player);
E-book;
Smart TV;
Digital TV;
A wearable device;
, ≪ / RTI > of
The method comprising the steps of:

Images