KR20180036205A - Smart table apparatus for simulation - Google Patents

Abstract

The present invention provides a smart table device comprising: a first display unit installed on the lateral surface of a table; a second display unit installed on an upper surface of the table and having a touchscreen interface for a model house advertisement; a camera unit installed between the first and second display units and capturing a gesture image corresponding to a user gesture; a first control unit providing a model type list corresponding to a touch input through the touchscreen interface for a model house advertisement to at least one of the first and second display units, and providing a plan view according to a model item of the model type list to the first display unit, or performing viewpoint conversion of the plan view into a viewpoint-converted plan view and providing the viewpoint-converted plan view to the first display unit, when the model item is received from a user; and a second control unit converting the plan view into a 3D image on the basis of the gesture image captured by the camera unit according to the plan view provided to the first display unit and providing the 3D image to the second display unit. The present invention is able to enhance cognitive ability of a user.

Description

[0001] SMART TABLE APPARATUS FOR SIMULATION [0002]

The present invention relates to a smart table apparatus for simulation, and more particularly, to a smart table apparatus for a simulation for recognizing a user gesture according to a model house advertisement such as an apartment to provide a 3D image.

The trend of international technological development is developing toward the convenience of human life and the richness of culture, and the demand for recognition technology, utilization technology and service technology for this is increasing.

However, according to the related art described up to now, the satisfaction of the 2D images is not high due to the lack of actual sensibility and the restriction of the information transmission means.

That is, the present technology feels difficult for a user to confirm an actual space for 2D images of a model house of an apartment or the like.

2. Description of the Related Art In recent years, research is being conducted to display 3D images according to a user's touch and a gesture with respect to 2D images provided in a model house.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a smart table device for simulation that recognizes a user gesture according to a model house advertisement of an apartment or the like to provide a 3D image.

A smart table device for simulation according to the present invention comprises a first display portion provided on a side surface of a table, a second display portion provided on an upper surface of the table and having a touch screen interface to a model house advertisement, A camera unit installed between the two displays for photographing a gesture image corresponding to the user gesture, a model type list corresponding to a touch input of the touch screen interface to the model house advertisement, A first control unit for performing a viewpoint conversion of the plan view or the plan view according to the model item to the viewpoint conversion plane and providing the same to the first display unit when receiving a model item from the model type list from a user, In accordance with the above-described plan view provided in the camera unit And a second controller for converting the plan view into a 3D image based on the photographed gesture image and providing the converted 3D image to the second display unit.

The second control unit may control the first control unit to turn off the providing of the plan view or the viewpoint conversion plan when providing the 3D image to the second display unit.

The second control unit may provide an interface for allowing a physical object having a pattern tag attached to the first display unit to output a 3D image of the corresponding position when the physical object is moved or moved.

The second control unit may detect at least one of the finger shape and the finger movement of the user gesture to generate the 3D image or the viewpoint conversion plan view.

The viewpoint conversion plan view may be a plan view in which the plan view is viewpoint-converted by at least one of the finger shape and the movement of the finger.

The smart table device for simulation according to the present invention is advantageous in that the user can feel the bird's-eye view of the model house and various internal views at various points of time without visiting the model house of an apartment or the like.

In addition, the smart table device for simulation according to the present invention has an advantage that the user's cognitive ability can be improved by recognizing the user gesture and displaying the 3D image corresponding to the user gesture.

In addition, the smart table device for simulation according to the present invention can utilize various types of data easily by sharing real-time moving images, images, texts, sounds, etc. to enable effective mutual communication and maximize human sensory cognition system It is advantageous to increase the efficiency of information transmission by constructing realistic remote collaboration environment.

1 is a perspective view showing a smart table apparatus for simulation according to the present invention.
2 is a control block diagram showing a control configuration of a smart table device for simulation according to the present invention.
3 is a top plan view of a table of a smart table apparatus for simulation according to the present invention.
4 is an operation diagram briefly showing the operation of the smart table device for simulation according to the present invention.
FIG. 5 is a diagram briefly illustrating operations according to a user gesture of a smart table apparatus for simulation according to the present invention.
6 is a flowchart illustrating an operation method of a smart table device for simulation according to the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between. Also, the fact that the first component and the second component on the network are connected or connected means that data can be exchanged between the first component and the second component by wire or wirelessly.

In addition, suffixes "module" and " part "for the components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary. The same reference numerals are given to the same or similar components throughout the drawings, and detailed descriptions of components having the same reference numerals can be omitted and replaced with descriptions of the above-described components.

1 is a perspective view showing a smart table apparatus for simulation according to the present invention.

Referring to FIG. 1, the smart table device for simulation may include a table 10, a frame 20, a camera unit 30, a first display unit 40, and a second display unit 50. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The table 10 supports the frame 20, the camera unit 30, the first display unit 40, and the second display unit 50, and a wheel can be installed at a lower portion thereof to enable movement of the place.

The frame 20 is connected to the first frame 21 on which the camera unit 30 and the second display unit 50 are installed and the second frame 22 ).

The camera unit 30 may be a web camera and may be a motion recognition camera for recognizing a user gesture and may transmit a gesture image zm corresponding to the user gesture to an internal control unit (not shown).

The camera unit 30 may be installed in the first frame 21 or the second frame 22, but is not limited thereto.

The camera unit 30 processes an image frame such as a still image or a moving image obtained by the image sensor. The processed image frame can be displayed on at least one of the first and second display units 40 and 50. [

The camera unit 30 can acquire the gesture image zm by photographing the upper surface of the table 10. [

The first display unit 40 may include a touch screen capable of inputting a user's touch, and may include a touch screen panel and a touch screen panel controller. In this case, the touch screen panel is a transparent panel that is attached to the outside, and can watch the result of the touch, and can send the corresponding signals to the touch screen panel controller when there is a touch input. The touch screen panel controller processes the signals and then transmits corresponding data to the control unit so that the controller can know whether or not touch input has occurred and which area of the touch screen is touched.

The first display unit 40 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, And a display (2D display).

The first display unit 40 includes a model type list and a model type list so that a user touch input can be performed through a touch screen interface for a model house advertisement such as an apartment, The user's touch input may provide a top view according to the model item corresponding to the user touch input.

The plan view is a 2D image, which may represent an entire plan view of the model house, and may be a viewpoint conversion plan view, but is not limited thereto.

The second display unit 50 may be controlled by the controller, and may provide a 3D shape of the user gesture after the first display unit 40 inputs the user's touch.

The second display unit 50 may be a curved display device, and a three-dimensional display device, but is not limited thereto.

2 is a control block diagram showing a control configuration of a smart table device for simulation according to the present invention.

Referring to FIG. 2, the smart table device for simulation may include a camera unit 30, first and second display units 40 and 50, and a control unit 60.

In an embodiment, the smart table device for simulation may include, but is not limited to, a communication unit, a speaker, a memory, and an interface.

The camera unit 30 may capture the gesture image zm corresponding to the user gesture and transmit the captured image to the controller 60 as described above with reference to FIG.

The camera unit 30 simply transmits the gesture image zm to the control unit 60. The user can recognize the user gesture in the gesture image zm and transmit the recognized result to the control unit 60, It is not limited to this.

The camera unit 30 may include at least one camera, but is not limited thereto.

The first display unit 40 includes a model type list and a model type list so that a user touch input can be performed through a touch screen interface for a model house advertisement such as an apartment, The user's touch input may provide a top view according to the model item corresponding to the user touch input.

At this time, the first display unit 40 may provide the 2D view corresponding to the user touch input under the control of the controller 60. [

The second display unit 50 may provide a 3D image corresponding to the user gesture in the plan view provided on the first display unit 40 under the control of the control unit 60. [

The control unit 60 may include first and second control units 62 and 64.

The first control unit 62 can control the first display unit 40 to provide the model type list for the list list and the plan view corresponding to the model item corresponding to the user touch input among the model type list.

The first control unit 62 may provide a viewpoint conversion plan view in which at least one of the enlargement, reduction and the time axis is transformed according to the touch input of the user, for example, the finger shape and the finger movement of the user gesture There is no limitation.

The second control unit 64 recognizes the user gesture in the gesture image zm when the gesture image zm is inputted from the camera unit 30 after the first display unit 40 provides the plan view, It is possible to control the 3D image set corresponding to the gesture to be provided to the second display unit 50.

In the embodiment, the second control unit 64 may be a physical object to which a pattern tag is attached, for example, a human model, a camera model, etc. in addition to a user, and when a physical object is moved or moved, It is possible to provide an intuitive interface according to the present invention.

The second control unit 64 may provide the 3D image to the second display unit 50 so that the first control unit 62 may turn off the provision of the plan view or the viewpoint conversion plan provided to the first display unit 40 .

In this way, the control unit 60 can convert the plan view into the viewpoint conversion plan view according to the user's touch input inputted from the first display unit 40, and can display the plan view corresponding to the user's gesture on the second display unit 50 The converted 3D image can be provided.

The smart table device for simulation according to the embodiment provides a 2D image and a 3D image to the first and second display sections 40 and 50, respectively, so that the user can simulate the structure of the apartment, There is an advantage that it can be increased.

3 is a top plan view of a table of a smart table apparatus for simulation according to the present invention.

Referring to FIG. 3, the model house advertisement may be placed in the advertisement placement unit 12 disposed on the upper surface of the table 10.

The advertisement placement unit 12 may be disposed on the upper surface of the table in a space separate from the first display unit 40 or may be implemented as a part of the first display unit 40. [ The advertisement placement unit 12 may include an RF tag recognition module of a sensing unit (not shown). In this case, the advertisement placement unit 12 can recognize the RF tag disposed in the model house advertisement or the separate RF tag, and transmit the data of the RF tag to the control unit 60. The control unit 60 can extract the apartment identifier from the RE tag data.

The control unit 60 may extract the apartment identifier from the image of the camera unit 30 taken by the model house advertisement and output the gesture image zm corresponding to the user gesture.

4 is an operation diagram briefly showing the operation of the smart table device for simulation according to the present invention.

4 (a), the second control unit 64 receives a touch input of a model item in the model type list from the user by the first display unit 40, A gesture image (zm) can be input.

At this time, the first controller 62 may control the second controller 62 so that the top view according to the model item selected by the user is displayed on the first display 40.

Referring to FIG. 4B, when the first display unit 40 provides a top view according to the model item, the second control unit 64 displays the 3D image associated with the top view according to the model item on the second display unit 50 To be provided to the user.

When the smart table device is used for model house simulation, the bird's-eye view of the model house can be obtained by scanning the actual model of the remote location from another smart table device at the remote site. At this time, it is possible to acquire the three-dimensional bird's-eye view data from the model of the remote place using the remote smart table apparatus, or to acquire the data through the separate three-dimensional scanning apparatus.

FIG. 5 is a diagram briefly illustrating operations according to a user gesture of a smart table apparatus for simulation according to the present invention.

Referring to FIG. 5, the smart table device for simulation represents a 2D image provided from the first display unit 40 according to a user's touch input with respect to the 2D image displayed on the first display unit 40.

In other words, if the 2D image provided on the first display unit 40 moves to the left and the right after touching and moves away from the 2D image provided on the first display unit 40 in FIG. 5, the enlarged 2D image can be provided.

At this time, the camera unit 30 captures the movement of the user's hand after inputting the user's touch, transfers the captured image to the control unit 60, and the controller 60 operates in accordance with the corresponding operation, (40).

5 shows the 2D image of FIG. 5 when the movement of the user's hand moves left or right after the user's touch input by moving in the opposite direction of FIG. 5 (1).

5 may provide a 2D image for the menu when the user moves to the center after the user touches the menu included in the 2D image provided on the first display unit 40. [

5, the ④ of FIG. 5 may represent a 2D image that returns to the previous page from the current page of the book when the book for the model house is provided on the first display unit 40, Lt; / RTI >

6 is a flowchart illustrating an operation method of a smart table device for simulation according to the present invention.

Referring to FIG. 6, the smart table device for simulation may provide a model house advertisement such as an apartment to the first display unit 40 (S110).

In an embodiment, the model house advertisement may be an advertisement book of a 2D image, and may be a model type list for the model house advertisement, but is not limited thereto.

Thereafter, the smart table device for simulation can determine the presence or absence of a user touch input of the model house advertisement provided in the first display unit 40. If the user touch input does not exist, the process returns to step S110 (S120 ).

If there is a user touch input, the smart table device for simulation may provide the 2D image corresponding to the user touch input to the first display unit 40 (S130).

When the gesture image (zm) corresponding to the user gesture is transmitted through the camera unit 30 after the user's touch input, the 3D table corresponding to the user gesture is displayed on the second display unit 50 (S140).

That is, the operation method described above will be described in detail as follows.

The first control unit 62 of the smart table device for simulation provides the first display unit 40 with a model type list for the list list and the top view according to model items corresponding to the user touch input among the model type list .

The first controller 62 may provide a viewpoint transformation plan view in which at least one of enlargement, reduction, and a time axis of the plan view is transformed according to a touch input of the user, but the present invention is not limited thereto.

The second control unit 64 recognizes the user gesture in the gesture image zm when the gesture image zm is inputted from the camera unit 30 after the first display unit 40 provides the plan view, It is possible to control the 3D image set corresponding to the gesture to be provided to the second display unit 50.

When the second control unit 64 provides the 3D image to the second display unit 50, the second control unit 64 provides the 3D image to the first display unit 40 by the first control unit 62, Can be controlled to be turned off.

In this way, the control unit 60 can convert the plan view into the viewpoint conversion plan view according to the user's touch input inputted from the first display unit 40, and can display the plan view corresponding to the user's gesture on the second display unit 50 The converted 3D image can be provided.

The smart table device for simulation according to the embodiment provides a 2D image and a 3D image to the first and second display units 40 and 50, respectively, so that the user simulates the structure of the apartment, There is an advantage that convenience can be increased.

The present invention can be implemented in hardware or software. The present invention can also be embodied as computer readable code on a computer readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may be implemented in the form of a carrier wave (for example, transmission via the Internet) . The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

Claims (5)

A first display unit installed on a side surface of the table;
A second display unit installed on the upper surface of the table and having a touch screen interface with the model house advertisement;
A camera unit installed between the first and second displays for photographing a gesture image corresponding to the user gesture;
Providing a model type list corresponding to a touch input of the touch screen interface to the model house advertisement to at least one of the first and second display units and receiving a model item of the model type list from a user, A first control unit for performing a viewpoint conversion of the plan view or the plan view according to the viewpoint conversion plan view and providing the viewpoint to the first display unit; And
And a second controller for converting the planar view into a 3D image based on the gesture image photographed from the camera unit according to the plan view provided on the first display unit and providing the converted 3D image to the second display unit. The method according to claim 1,
Wherein the second control unit controls the first control unit to turn off the providing of the plan view or the viewpoint conversion plan when providing the 3D image to the second display unit. The method according to claim 1,
Wherein the second control unit provides an interface for causing a physical object having a pattern tag attached to the first display unit to output a 3D image of a corresponding position when the physical object is moved or moved. The method according to claim 1,
Wherein the second control unit detects at least one of a finger shape and a movement of a finger among the user gesture to generate the 3D image or the viewpoint conversion floor plan. 5. The method of claim 4,
Wherein the viewpoint conversion plan view is a plan view in which the plan view is viewpoint-converted by at least one of enlarging, reducing, and rotating according to the finger shape and the movement of the finger.

Images