KR100944027B1 - Augmented reality providing system of the table top structure - Google Patents

Augmented reality providing system of the table top structure Download PDF

Info

Publication number
KR100944027B1
KR100944027B1 KR1020080056371A KR20080056371A KR100944027B1 KR 100944027 B1 KR100944027 B1 KR 100944027B1 KR 1020080056371 A KR1020080056371 A KR 1020080056371A KR 20080056371 A KR20080056371 A KR 20080056371A KR 100944027 B1 KR100944027 B1 KR 100944027B1
Authority
KR
South Korea
Prior art keywords
augmented reality
means
haptic means
table top
information
Prior art date
Application number
KR1020080056371A
Other languages
Korean (ko)
Other versions
KR20090130651A (en
Inventor
양형정
오진식
정종문
Original Assignee
전남대학교산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 전남대학교산학협력단 filed Critical 전남대학교산학협력단
Priority to KR1020080056371A priority Critical patent/KR100944027B1/en
Publication of KR20090130651A publication Critical patent/KR20090130651A/en
Application granted granted Critical
Publication of KR100944027B1 publication Critical patent/KR100944027B1/en

Links

Images

Abstract

The present invention relates to a system for providing augmented reality having a table top structure, including a housing having a predetermined shape wound from a user, radiating an optical signal for position detection from the bottom of the housing, and augmented reality based on a displacement vector amount of the optical signal. Haptic means consisting of a vibration member for implementing the haptic means and a haptic means is mounted, including a display panel for displaying arbitrary image information, to generate mutual collision information between the vector information and the image information on the amount of displacement vector of the optical signal And an image control means for calculating the collision vector amount of the haptic means based on the collision information and transmitting the collision vector amount data to the vibration member.
According to the present invention, there is a unique effect that allows the user on the offline to feel the sensory information in the augmented reality.
There are also unique effects that can be used to extend the range of applications for table top display systems using a variety of physical input devices.
Table Top Displayer, FTIR, Haptic, Augmented Reality, Touch Screen, Wireless Communication

Description

Augmented reality providing system of the table top structure

The present invention relates to a system for providing augmented reality of a table top structure, and in particular, to allow a user on the offline to sense sensory information in an augmented reality, and to use a variety of physical input devices to expand the scope of application of a table top display system. It relates to an augmented reality providing system of the table top structure.

Table top display technology is a technology that allows users to feel augmented reality through the interaction of the user and the computer by using a hand on the virtual screen.

Augmented reality is one of virtual reality that combines the real world that the user sees with the virtual world having additional information in one image. It is a hybrid VR system that fuses real and virtual environments. Augmented reality, a concept that complements the real world with the virtual world, uses a virtual environment made of computer graphics, but the main role is the real environment. Computer graphics play a role in providing additional information necessary for the real environment. By overlapping the three-dimensional virtual image on the live image that the user sees, the distinction between the real environment and the virtual screen is blurred.

Virtual reality technology immerses the user in the virtual environment and cannot see the real environment, while augmented reality technology in which the real environment and the virtual object are mixed provides the user with a better sense of reality. It is used for remote medical diagnosis, broadcasting, architectural design, and manufacturing process management.

Meanwhile, as a technology related to such augmented reality, Korean Patent Application Publication No. 2007-0024969 entitled 'Wall-type display device having an infrared sensing user interface and a method of operating the same' (hereinafter referred to as 'prior art') has been filed. As follows.

The wall-type display device having an infrared sensing user interface and a method of operating the same according to the prior art are related to a wall-type display device having an infrared sensing user interface and a method of operating the same. A projector having an infrared cut filter (IR-cut filter) connected to a reproducing medium on a wall, a ceiling, or a bottom of the rear surface; And infrared ray generating devices (IR-LEDs); A camera equipped with an IR-Filter; And a computer system to which the camera is attached.

Therefore, the user can naturally select graphic objects as if pointing on the touch screen by using hands, fingers, etc. on the front of the wall display device, and the IR-LEDs installed on the back of the display device. Cameras with an IR-Filter can be used to determine the user's contact and contact location. The graphic object is selectively displayed according to the position of the determined contact, thereby identifying the graphic object by highlighting one of the plurality of display objects or displaying a cursor representing one of the plurality of displayed graphic objects.

However, the related art has a problem in that the sensory information of the augmented reality cannot be provided to the user through offline, so that the user's sense is limited to the visual sense.

In addition, since only the user's hand is used as an input means of the conventional table top display, there is a problem in that the application range of the applicable table top display is limited.

The present invention has been made to solve the above problems, and an object of the present invention is to provide an augmented reality providing system having a table top structure for providing a user with a sense other than the visual sense in the augmented reality to the user on the offline.

Another object of the present invention is to input a plurality of touch information using an actual physical device as an input means of a table top display, and to generate a variety of event messages using the position conversion information of the input device, for augmented reality implementation It also provides a table top structured augmented reality providing system that can expand the range of applications.

In order to achieve the technical problem, the present invention, including a housing of a predetermined shape that can be wound from the user, to emit an optical signal for position detection on the bottom of the housing, and to implement augmented reality based on the displacement vector amount of the optical signal Haptic means consisting of a vibration member and a haptic means for seating, including a display panel for displaying arbitrary image information, generating mutual collision information between the vector information and the image information on the displacement vector amount of the optical signal, collision information After calculating the collision vector amount of the haptic means based on the image control means for transmitting the collision vector amount data to the vibration member.

In addition, a haptic means consisting of a vibration member for implementing augmented reality, including a housing of a predetermined shape that can be wound from the user and has a planar shape for mounting the haptic means, and displays predetermined image information, Including a display panel for detecting the position of the haptic means from the total reflection by the light source of the side, generating mutual collision information between the image information based on the position detection of the haptic means, and based on the collision information the amount of collision vector of the haptic means After the calculation, characterized in that the image control means for transmitting the collision vector amount to the vibration member.

According to the present invention as described above, there is a unique effect that allows the user on the offline to feel the sensory information in the augmented reality.

There are also unique effects that can be used to extend the range of applications for table top display systems using a variety of physical input devices.

As described above and described with reference to a preferred embodiment for illustrating the technical idea of the present invention, the present invention is not limited to the configuration and operation as shown and described as described above, it is a deviation from the scope of the technical idea It will be understood by those skilled in the art that many modifications and variations can be made to the invention without departing from the scope of the invention. Accordingly, all such suitable changes and modifications and equivalents should be considered to be within the scope of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

First, FIG. 1 is a flowchart of a system for providing augmented reality of a table top structure according to the present invention, and FIG. 2 is a schematic diagram of a system for providing augmented reality of a table top structure according to the present invention. As shown, the augmented reality providing system of the table top structure includes a housing of a predetermined shape that can be wound from a user, radiating a position detecting optical signal from the bottom of the housing, and based on the displacement vector amount of the optical signal The haptic means 100 made of a vibration member for implementing augmented reality and the haptic means is mounted, and including a display panel for displaying arbitrary image information, the vector information and the image of the displacement vector amount of the optical signal The image control means 200 generates mutual collision information between the information, calculates the collision vector amount of the haptic means based on the collision information, and then transmits the collision vector amount data to the vibration member.

The image control means 200 and the haptic means 100 further include near field communication means or wired communication means, and transmits the collision vector amount data by the communication means.

The short range wireless communication may be ZigBee or Bluetooth.

3 to 5, the haptic means 100 according to the present invention, the haptic means 100 is a vibration member 110 and the haptic means for providing augmented reality to the user based on the received collision information Infrared LED light source 120 is formed on the bottom surface of the haptic means for detecting the amount of displacement vector of the strong straightness to emit an optical signal vertically.

The vibration member is characterized in that any one of the vibration method of the motor vibration, low frequency vibration or ultrasonic vibration is applied.

The infrared LED light source 120 applied in the present invention uses EL-1KL3 among the infrared LEDs having strong straightness, but it will not depart from the gist of the present invention even if an acceptable infrared LED device is used.

And, the image control means 200 is a displacement vector amount detection unit for reading the displacement vector amount information of the haptic means based on the display panel 210 and the optical signal for displaying arbitrary image information as shown in FIG. Based on the 220 and the image size displacement vector of the image information and the displacement vector quantity information, it is determined whether or not each object is collided based on the distance between the center positions of each object, and a velocity vector corresponding to the determination result is calculated to The augmented reality control unit 240 for calculating the collision information and the augmented reality value is set based on the vector amount information corresponding to the collision of the calculation unit, to the augmented reality controller 240 for transmitting the numerical information of the augmented reality to the vibration member It is characterized in that the configuration.

The display panel 210 is made of an acrylic material that can transmit light, so that the output image is provided to a user by using a rear projection method.

In addition, the displacement vector amount detection unit 220 is provided with a plurality of light receiving sensors for detecting the haptic means 100 through the amount of light in different directions inside the image control means 200, and then detected by each of the light receiving sensors A function of reading the position and the direction of the haptic means 100 based on the amount of light of the laser, the laser rangefinder system is applied, the light receiving sensor identifies the infrared sensor module of the haptic means 100, and the identified light receiving sensor A distance from the haptic means 100 by detecting a direction in which the haptic means 100 is located by reading a light receiving range of the light, and adjusting the laser of the laser rangefinder to a radiation position in a direction where the detected haptic means 100 is located. A function of reading the position and direction of the haptic means 100 using an infrared sensor for measuring the heat or heat in different directions inside the image control means 200 At least one infrared camera for detecting an image, wherein the infrared cameras detect a thermal image of the infrared radiation emitted from the haptic means 100 and identify the thermal image detected by each infrared camera to determine the haptic means 100 The position and direction of the haptic means 100 is read by any one of the functions of reading the position and the direction.

The augmented reality providing system of the table top structure according to another embodiment of the present invention will be described with reference to FIG.

Augmented reality providing system of the table top structure according to another embodiment of the present invention as shown in Figure 7, the augmented reality providing system of the table top structure includes a housing of a predetermined shape wound from the user, the augmented reality Haptic means consisting of a vibration member for realizing and having a planar structure for mounting the haptic means, and displays predetermined image information, the position detection of the haptic means from the total reflection by the light source side And a display panel to generate mutual collision information between the image information based on the position detection of the haptic means, calculate the collision vector amount of the haptic means based on the collision information, and then calculate the collision vector amount. Characterized in that the image control means for transmitting to the vibration member.

The display panel is formed with a blocker made of a material capable of reflecting light at the boundary of the display panel to prevent the optical signal from the light source leaks directly to the displacement vector amount detection unit, and helps the total reflection of the optical signal and The optical signal perpendicular to the panel is characterized in that a diffusion agent for transmitting the function is formed on the upper and lower ends of the display panel.

Referring to the principle of providing augmented reality according to an embodiment of the present invention.

In order to feel augmented reality about the motion of an object in virtual space, it must be calculated by applying the laws of physics of reality, so each object must have physical quantities such as position vector, velocity vector, and mass.

The collision determination is to calculate the distance between the centers of objects and determine that two objects collide if they are smaller than the sum of the radius of two objects. By calculating the velocity vector after collision and assigning it to the object, the object moves to the position after the collision.

The unit vector of the axis connecting the center of the object for calculating the velocity vector after the collision is given by Equation 1.

Figure 112008042862903-pat00001

The velocity vector before the collision is divided based on.

If the line connecting the center of the object is called the x-axis, the magnitude of the velocity vector U1 in the direction of the x-axis of the object is given by Equation 2.

Figure 112008042862903-pat00002

When the size is calculated by Equation 2 and multiplied by the x-axis unit vector, U1x is obtained, and U1y is obtained by calculating the difference between U1 and U1x.

The velocity vector after the collision using the divided velocity vector and the mass of the object is given by Equation 3.

Figure 112008042862903-pat00003

(e: collision coefficient; M1, M2: mass)

Since the divided velocity vectors and have collided with each other, they are calculated by Equation 3 according to the law of conservation of energy and the law of momentum, and since they do not change the force from the outside, the velocity is the same after the collision. Becomes.

In the following figure, the collision amount calculation of the object controlled by the user assumes that P2 is the haptic means 100 and considers the relationship between the force vector influenced by P1 on P2 and the force vector influenced on P1 by P2. To calculate the amount of impact P2 receives. In Equation 3, the size of V2x becomes the collision amount of P2.

Figure 112008042862903-pat00004

As described above, the calculation unit 230 calculates the amount of impact received by the haptic means 100, and the augmented reality controller 240 sets a value of the augmented reality corresponding to the amount of impact through the following method. You will adjust the steps.

Figure 112008042862903-pat00005

As described above and described with reference to a preferred embodiment for illustrating the technical idea of the present invention, the present invention is not limited to the configuration and operation as shown and described as described above, it is a deviation from the scope of the technical idea It will be understood by those skilled in the art that many modifications and variations can be made to the invention without departing from the scope of the invention. Accordingly, all such suitable changes and modifications and equivalents should be considered to be within the scope of the present invention.

1 is a flow chart of a system for providing augmented reality of a table top structure according to an embodiment of the present invention.

Figure 2 is a schematic diagram of a system for providing augmented reality of a table top structure according to an embodiment of the present invention.

Figure 3 is an exploded view of the haptic means according to an embodiment of the present invention.

Figure 4 is a rear view of the haptic means according to an embodiment of the present invention.

5 is a perspective view of a haptic means according to an embodiment of the present invention.

Figure 6 is an exploded view of the image control means according to an embodiment of the present invention.

FIG. 7 is a schematic diagram illustrating an optical signal refraction of an image control means display panel according to another embodiment of the present invention. FIG.

** Description of symbols for the main parts of the drawing **

100: haptic means 110: vibration member

120: Infrared LED Light Source

200: image control means 210: display panel

220: displacement vector amount detection unit 230: arithmetic unit

240: augmented reality control unit

Claims (21)

  1. In the augmented reality providing system of the table top structure,
    Haptic means including a housing having a predetermined shape that can be wound from a user, and a vibration member for emitting a position detection optical signal on the bottom surface of the housing, and for implementing the augmented reality based on the displacement vector amount of the optical signal; And
    The haptic means is seated, including a display panel for displaying arbitrary image information, generating mutual collision information between the vector information and the image information on the amount of displacement vector of the optical signal, and based on the collision information And a video control means for transmitting the collision vector amount data to the vibration member after calculating the collision vector amount of the haptic means.
  2. The method of claim 1,
    The image control means and the haptic means further comprises a near field wireless communication means, the augmented reality providing system of the table top structure, characterized in that for transmitting the collision vector amount data by the near field wireless communication means.
  3. The method of claim 2,
    The short range wireless communication is a ZigBee or Bluetooth augmented reality providing system characterized in that the table top structure.
  4. The method of claim 1,
    And said image control means and haptic means transmit said collision vector quantity data by wired communication.
  5. The method of claim 1,
    The display panel is made of an acrylic material that can transmit light, augmented reality providing system of the table top structure, characterized in that to provide an output image to the user using a rear projection method.
  6. The method of claim 1,
    The vibration member is a table top structure augmented reality providing system, characterized in that any one of the vibration method of the motor vibration, low frequency vibration or ultrasonic vibration is applied.
  7. The method of claim 1,
    The optical signal is a table top structure, augmented reality providing system, characterized in that the use of a strong infrared LED in the light source radiation.
  8. The method of claim 1,
    The image control means may include: a displacement vector amount detection unit reading the displacement vector amount information of the haptic means based on the optical signal;
    Based on the image size displacement vector of the image information and the displacement vector amount information, it is determined whether each object is collided based on the distance between the center positions of the objects, and the collision information between the objects is calculated by calculating a velocity vector corresponding to the determination result. A calculating unit; And
    An augmented reality controller configured to set a numerical value of the augmented reality based on the vector amount information corresponding to the collision of the operation unit, and transmit the numerical information of the augmented reality to the vibration member; Augmented reality providing system of the table top structure, characterized in that consisting of.
  9. The method of claim 8,
    The displacement vector amount detecting unit installs a plurality of light receiving sensors for detecting the haptic means through the amount of light in different directions inside the image control means, and then the position of the haptic means based on the respective light amounts detected from the light receiving sensors. Augmented reality providing system of the table top structure, characterized in that for reading the direction.
  10. The method of claim 8,
    The displacement vector amount detection unit is applied to a laser rangefinder system, the light receiving sensor detects the infrared sensor module of the haptic means, detects the light receiving range of the identified light receiving sensor to detect the direction in which the haptic means is located, the detected haptic means And a position of the haptic means using an infrared sensor for measuring a distance from the haptic means by adjusting the laser of the laser rangefinder in a radial position in a direction in which the laser rangefinder is positioned.
  11. The method of claim 8,
    The displacement vector amount detecting unit has one or more infrared cameras for detecting thermal images in different directions inside the image control means, and the infrared cameras detect infrared thermal images emitted from the haptic means and detected by each infrared camera. Recognizing a thermal image and reading the position and direction of the haptic means a table top structure, augmented reality providing system.
  12. In the augmented reality providing system of the table top structure,
    Haptic means comprising a vibration member for implementing the augmented reality, including a housing of a predetermined shape wound from a user; And
    A display panel having an arbitrary shape having a planar structure for seating the haptic means and displaying preset image information, and performing a position detection of the haptic means from total reflection by a light source on a side of the haptic means, And image control means for generating mutual collision information between the image information based on position detection, calculating the collision vector amount of the haptic means based on the collision information, and transmitting the collision vector amount to the vibration member. Augmented reality providing system of the table top structure.
  13. The method of claim 12,
    The display panel is formed with a blocker made of a material capable of reflecting light at the boundary of the display panel to prevent the optical signal from the light source leaks directly to the displacement vector amount detection unit, and helps the total reflection of the optical signal and And a diffuser which transmits an optical signal perpendicular to the panel, is formed at upper and lower ends of the display panel.
  14. The method of claim 12,
    The image control means and the haptic means further comprises a near field wireless communication means, the augmented reality providing system of the table top structure, characterized in that for transmitting the collision vector amount data by the near field wireless communication means.
  15. The method of claim 14,
    The short range wireless communication is a Zigbee or Bluetooth augmented reality providing system of the table top structure.
  16. The method of claim 12,
    And said image control means and haptic means transmit said collision vector quantity data by wired communication.
  17. The method of claim 12,
    The vibration member is a table top structure augmented reality providing system, characterized in that any one of the vibration method of the motor vibration, low frequency vibration or ultrasonic vibration is applied.
  18. The method of claim 12,
    The image control means may include: a displacement vector amount detection unit configured to read displacement vector amount information of the haptic means based on the optical signal from the light source;
    Based on the image size displacement vector of the image information and the displacement vector amount information, it is determined whether each object is collided based on the distance between the center positions of the objects, and the collision information between the objects is calculated by calculating a velocity vector corresponding to the determination result. A calculating unit; And
    An augmented reality controller configured to set a numerical value of the augmented reality based on the vector amount information corresponding to the collision of the operation unit, and transmit the numerical information of the augmented reality to the vibration member; Augmented reality providing system of the table top structure, characterized in that consisting of.
  19. The method of claim 18,
    The displacement vector amount detecting unit installs a plurality of light receiving sensors for detecting the haptic means through the amount of light in different directions inside the image control means, and then the position of the haptic means based on the respective light amounts detected from the light receiving sensors. Augmented reality providing system of the table top structure, characterized in that for reading the direction.
  20. The method of claim 18,
    The displacement vector amount detection unit is applied to a laser rangefinder system, the light receiving sensor detects the infrared sensor module of the haptic means, detects the light receiving range of the identified light receiving sensor to detect the direction in which the haptic means is located, the detected haptic means And a position of the haptic means using an infrared sensor for measuring a distance from the haptic means by adjusting the laser of the laser rangefinder in a radial position in a direction in which the laser rangefinder is positioned.
  21. The method of claim 18,
    The displacement vector amount detecting unit has one or more infrared cameras for detecting thermal images in different directions in the image control means, and the infrared cameras detect infrared thermal images emitted from the haptic means and detected by each infrared camera. Recognizing a thermal image and reading the position and direction of the haptic means a table top structure, augmented reality providing system.
KR1020080056371A 2008-06-16 2008-06-16 Augmented reality providing system of the table top structure KR100944027B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020080056371A KR100944027B1 (en) 2008-06-16 2008-06-16 Augmented reality providing system of the table top structure

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020080056371A KR100944027B1 (en) 2008-06-16 2008-06-16 Augmented reality providing system of the table top structure

Publications (2)

Publication Number Publication Date
KR20090130651A KR20090130651A (en) 2009-12-24
KR100944027B1 true KR100944027B1 (en) 2010-02-24

Family

ID=41690069

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020080056371A KR100944027B1 (en) 2008-06-16 2008-06-16 Augmented reality providing system of the table top structure

Country Status (1)

Country Link
KR (1) KR100944027B1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060081176A (en) * 2005-01-07 2006-07-12 한국과학기술원 Apparatus for console game
US20070035511A1 (en) 2005-01-25 2007-02-15 The Board Of Trustees Of The University Of Illinois. Compact haptic and augmented virtual reality system
KR20070090730A (en) * 2006-03-02 2007-09-06 강원대학교산학협력단 Stereovision-based virtual reality device
US7376903B2 (en) 2004-06-29 2008-05-20 Ge Medical Systems Information Technologies 3D display system and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7376903B2 (en) 2004-06-29 2008-05-20 Ge Medical Systems Information Technologies 3D display system and method
KR20060081176A (en) * 2005-01-07 2006-07-12 한국과학기술원 Apparatus for console game
US20070035511A1 (en) 2005-01-25 2007-02-15 The Board Of Trustees Of The University Of Illinois. Compact haptic and augmented virtual reality system
KR20070090730A (en) * 2006-03-02 2007-09-06 강원대학교산학협력단 Stereovision-based virtual reality device

Also Published As

Publication number Publication date
KR20090130651A (en) 2009-12-24

Similar Documents

Publication Publication Date Title
EP2144448B1 (en) Floating Image Interaction Device
JP5346081B2 (en) Multi-touch touch screen with pen tracking
JP5524417B2 (en) 3D user interface effect on display by using motion characteristics
US5319387A (en) Apparatus for specifying coordinates of a body in three-dimensional space
US6803928B2 (en) Extended virtual table: an optical extension for table-like projection systems
US10354449B2 (en) Augmented reality lighting effects
JP2015515688A (en) Touch-sensitive user interface
US9389779B2 (en) Depth-based user interface gesture control
JP3772137B2 (en) Pointing device
US20150169173A1 (en) Three-Dimensional Tracking of a User Control Device in a Volume
JP4442877B2 (en) Coordinate input apparatus and its control method
US20110267264A1 (en) Display system with multiple optical sensors
US20120229377A1 (en) Display device and method for controlling the same
KR20100027976A (en) Gesture and motion-based navigation and interaction with three-dimensional virtual content on a mobile device
DE102009032637B4 (en) image magnification system for a computer interface
JP2015518199A (en) Light guide display and field of view
US5686942A (en) Remote computer input system which detects point source on operator
US10318017B2 (en) Viewing images with tilt control on a hand-held device
KR20110104096A (en) User interface for mobile devices
US20140184589A1 (en) Detection of Partially Obscured Objects in Three Dimensional Stereoscopic Scenes
EP3008567B1 (en) User focus controlled graphical user interface using an head mounted device
CN105900041B (en) It is positioned using the target that eye tracking carries out
TW201220159A (en) Apparatus and method for user input for controlling displayed information
Biocca et al. Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms
US20160239080A1 (en) Systems and methods of creating a realistic grab experience in virtual reality/augmented reality environments

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20130213

Year of fee payment: 4

FPAY Annual fee payment

Payment date: 20140203

Year of fee payment: 5

FPAY Annual fee payment

Payment date: 20150130

Year of fee payment: 6

FPAY Annual fee payment

Payment date: 20160816

Year of fee payment: 7