KR101012081B1 - Method and system for providing contents using a table-top interface - Google Patents

Abstract

Existing computer-based contents are basically personal and they are not easy to use, so users who lack computer knowledge such as children and the elderly have a lot of restrictions to easily use contents that can be shared by multiple users, such as edutainment contents. There is. Accordingly, the present invention makes it easy to use even users who are not used to handling computers by using intuitive operation and visual effects in using edutainment contents, and share the contents among users in using edutainment contents. We want to provide a tabletop interface environment.

Tabletop Interface, Ubiquitous, Table-Based, Hand Recognition

Description

System and method for providing content using tabletop interface {METHOD AND SYSTEM FOR PROVIDING CONTENTS USING A TABLE-TOP INTERFACE}

The present invention relates to a content providing technology using a table-top interface, and more particularly, to providing content using a tabletop interface suitable for highlighting an intuitive operation and a visual effect in using edutainment content. System and method.

Due to the rapid development of computer technology, researches have been conducted in various ways to find ways to improve sociality for people of all ages playing computer games, and combine educational elements with education to provide educational functions and entertainment. There is also a lot of research on edutainment content that has the function of (Entertainment) to improve the learning effect of users.

However, when users of various ages enjoy a game using a computer interface consisting of a conventional mouse and keyboard, another problem arises. In other words, young children, especially the elderly who do not have a computer experience using the existing interface presents a number of difficulties. As the elderly generally progress, aging, visual parts such as vision, vision, and pattern recognition, physical parts such as reaction speed, muscle strength, balance, and other cognitive abilities decrease. Also, as the society changes rapidly due to rapid development, the change of values caused by the change of generation also makes the use of computer by the elderly as a barrier.

The storytelling system, which enables young children to use the computer, not only to pursue game fun, but also to enjoy educational and educational effects through interactive manipulation. A lot of research is being done, and a lot of researches have been made on systems that can achieve enjoyment and educational effects through contents such as broadcasting dramas and fairy tales.

However, these studies mainly use the existing computer interface environment and thus require a system with a more natural interface.

Meanwhile, in the ubiquitous computing environment, all living environments are organically connected to provide users with intelligent services that are independent. Among them, the table is the most used space in real life, and the tabletop interface using it will be one of the important components of the ubiquitous computing environment.

The tabletop interface is a user interface that complements the shortcomings of the existing computer interface environment based on the table. The tabletop interface is used as a space for placing physical objects or handling digital information. That is, the table consists of one image output and a user input device.

DigitalDesk [P. Wellner: The Digital Desk Calculator: Tangible Manipulation on a Desk Top Display. UIST (1991)] installs a camera and a projector on the table top to receive user input.

Yasuto Nakanishi, Yoichi Sato and Hideki Koike: EnhancedDesk and Enhanced-Wall: Augmented Desk and Wall Interfaces with Real-Time Tracking of Users Motion. UbiComp Workshop (2002)] can quickly receive multiple finger inputs simultaneously. It uses a high-performance infrared camera instead of a normal camera to accurately distinguish the user's hand.

HoloWall [Jun Rekimoto and Nobuyuki Matsushita: Perceptual Surfaces: Towards a Human and Object Sensitive Interactive Display. PUI (1997)] installed a camera on the back of the screen and used the method of recognizing the touch of the user input from the opposite side by the infrared illumination.

Existing computer-based content is basically personal and can be used through manipulation devices such as keyboards and mice. Therefore, content that can be shared by multiple users, such as edutainment content, is available to people who lack computer knowledge such as children and the elderly. The problem is that there are many limitations to using it easily.

Accordingly, the present invention intends to provide a content providing method using a tabletop interface that can be easily used by users who are not used to handling a computer by emphasizing intuitive operation and visual effects in using edutainment content.

In addition, the present invention, to use the edutainment content to provide a content providing method using a tabletop interface that can be shared by multiple users.

According to an embodiment of the present invention, a process of activating a tabletop interface and driving a game content application, and when user operation information is input to the game content application, is input to the user operation information. It provides a content providing method using a tabletop interface comprising the step of generating corresponding data processing language information, and analyzing the operation information from the data processing language information information and outputting the audiovisual information through the tabletop interface. .

According to another exemplary embodiment of the present invention, a process of activating a tabletop interface and driving a storytelling content application, and data processing language information corresponding to selection of 3D character information of the storytelling content application are provided. Generating 3D character information and outputting 3D character information and generating data processing language information corresponding to the drag manipulation information when user drag manipulation information for changing the angle of the 3D character information is input. A content providing method using a tabletop interface including a process of changing an angle is provided.

According to another aspect of the present invention, an operation information detection block for detecting user operation information input through a content application, and data processing language information corresponding to user operation information detected through the operation information detection block. And a control block for changing an angle of 3D content according to user manipulation information detected through the manipulation information sensing block.

According to the present invention, users who are unfamiliar with the computer using the tabletop interface can easily use it, and the content can be shared by multiple users, while the existing content is concentrated on the content for one person. .

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

1 is a configuration diagram of a tabletop interface device for implementing a content providing method according to the present invention, Figure 2 is a schematic diagram showing an arrangement of some of the components shown in FIG.

As shown in FIGS. 1 and 2, the tabletop interface device includes a rear projection screen 102 that is utilized as an input / output space on an upper surface of a structure 100 having a table shape, and a beam projector on a side of the structure 100. The control unit 108 for controlling the 104 and the camera 106 and the beam projector is installed, and a lower reflecting mirror 110 is installed below the structure 100 to reflect the image of the beam projector 104. In addition to providing a beam projection path for projecting onto the rear projection screen 102, a photographing path is provided so that the camera 106 can capture an image of the rear projection screen 102. The top reflecting mirror 112 is installed on the beam projection path between the bottom reflecting mirror 110 and the beam projector 104 to ensure the ease of installation of the beam projector 104 by allowing the angle of the beam projection path to be adjusted. The light source 114 installed on the upper side of the structure 100 allows the camera 106 to take a projection image by causing an object movement in the upper portion of the rear projection screen 102 to be projected onto the rear projection screen 102 as a back light image. Make sure

In this tabletop interface device of the present invention, the rear projection of the rear projection screen 102 is used as the output, and the rear recognition of the rear projection screen 102 is used as the input. The user interacts with the table using gestures and the like, and the table recognizes the user's hand gestures and physical objects in the real world to conveniently view, share, and manipulate information.

The beam projector 104 is positioned on the side of the rear projection screen 102 to project an image onto the rear projection screen 102 through the beam projection path provided by the upper and lower reflecting mirrors 112 and 110. , Camera 106 positioned at or near the same position as the beam projector 104, photographs the rear of the rear projection screen 102 through the photographing path provided by the upper reflecting mirror 112 and the lower reflecting mirror 110. Recognize your behavior. The beam projection path of the beam projector 104 and the imaging path of the camera 106 are preferably designed so that the system does not significantly deviate from the original table size.

The image projected by the beam projector 104 is reflected by the upper reflecting mirror 112 and the lower reflecting mirror 110 to produce an image of a large area on the rear projection screen 102. Reference numeral 102a in FIG. 2 denotes the screen projection size of the rear projection screen 102.

When the user interaction image on the rear projection screen 102 is obtained through the camera 106, the acquired image is transmitted to an image reading apparatus (not shown), and the image reading apparatus recognizes the meaning of the acquired image. It then creates a suitable event for this and passes it on to a graphical user interface (GUI) system (not shown). The GUI created by the user's input is then projected back to the rear projection screen 102 via the beam projector 104.

On the other hand, the input method using the vision needs a suitable lighting environment to improve the quality of the recognition. When the light source 114 is installed and the backlight is used as shown in FIG. 1, the difference in brightness between the object on the rear projection screen 102 and the background is very large, and thus a clearer image can be obtained than the illumination installed in the same direction. Through this, the user's hand gestures can be obtained in detail. In order to produce uniform illumination, it is preferable to use a surface light source so that uniform brightness is displayed throughout the rear projection screen 102 as shown in FIG. 1.

In addition, the camera 106 distinguishes a beam projector image from a user input image by using an infrared channel. By separating the channel, the output image of the beam projector can be excluded from the recognition process, and the image projected on the rear projection screen 102 solves the problem of the user being blurred due to the reflection of the illumination. Infrared uses a wavelength of more than 830nm in the near infrared band, it is preferable to use a monochrome camera with an infrared filter in the band. In addition, since the visible light only passes through the beam projector 104, an infrared cut filter (not shown) is attached.

3 is a schematic block diagram of a content providing system using a tabletop interface according to an aspect of the present invention, and includes a tabletop interface 200 and a content application 300.

As shown in FIG. 3, the tabletop interface 200 includes an operation information sensing block 202 and a control block 204.

The manipulation information detection block 202 detects manipulation information of a user input through the content application 300, for example, user's hand touch information, tool touch information, and the like.

The control block 204 generates a data processing language, for example, eXtensible Markup Language (XML) information corresponding to the user manipulation information sensed through the manipulation information sensing block 202. In addition, the control block 204 may change the angle of the 3D content according to the user operation information detected through the operation information detection block 202.

The content application 300 transmits user manipulation information to the tabletop interface 200, and analyzes the manipulation information in the XML information provided from the tabletop interface 200 and outputs the audiovisual information as audiovisual information. In this case, for example, edutainment audiovisual information about game content, storytelling content, and the like may be applied, and each content may be produced based on Flash, DirectX, OpenGL, and the like. There will be. In addition, the edutainment audiovisual information applied to the present embodiment is fully implemented in a tabletop interface environment, so that users who are not used to handling a computer can easily see the intuitive operation and visual effects in using edutainment contents. It can be used and is suitable for sharing the edutainment content among multiple users.

Hereinafter, the content providing method using the tabletop interface according to the preferred embodiment of the present invention will be described in detail with reference to the flowcharts of FIGS. 4 and 5.

First, FIG. 4 is a flowchart illustrating a content providing method, for example, a game content providing method according to the present embodiment, and illustrates a content providing method when the content application 300 of FIG. 3 is a game content application.

As illustrated in FIG. 4, when the tabletop interface 200 is activated in step S400, any game content application selected by the user is driven (S402).

Thereafter, the operation information detection block 202 of the tabletop interface 200 determines whether user operation information is input through the game content application (S404). In this case, the user manipulation information may be, for example, user hand touch information and tool touch information. That is, the hand touch information may be a content application that directly inputs operation information through a user's hand, for example, a puzzle game application that matches words or pictures through a tabletop interface. A content application for inputting operation information through a tool, for example, a fishing game application for acquiring fishing trajectory points through a tabletop interface may be applied.

When such user manipulation information is input to the manipulation information detection block 202 through the game content application, the control block 204 of the tabletop interface 200 generates a data processing language corresponding to the manipulation information, for example, XML information. To the game content application (S406).

Accordingly, the game content application analyzes the operation information from the XML information provided from the tabletop interface 200 and outputs audiovisual information such as puzzle game audiovisual information or fishing game audiovisual information (S408).

5 is a flowchart illustrating a content providing method, for example, a storytelling content providing method according to the present embodiment, and illustrates a content providing method when the content application 300 of FIG. 3 is a storytelling content application.

As illustrated in FIG. 5, when the tabletop interface 200 is activated at step S500, an arbitrary storytelling content application selected by the user is driven at step S502.

The storytelling content application is a content produced by using a 3D animation as a fairy tale content, in the present embodiment outputs the 3D character information of the storytelling content application selected by the user through the tabletop interface 200 (S504) .

More specifically, the control block 204 of the tabletop interface 200 generates a data processing language corresponding to the 3D character information of the storytelling content selected by the user, for example, XML information, and delivers it to the storytelling content application. Accordingly, the storytelling content application outputs 3D character information from the XML information provided from the tabletop interface 200.

In operation S506, a moving image fingerprint, a moving image voice, and the like for the corresponding 3D character information are output through the tabletop interface 200. For example, while displaying a 3D character, a moving image may be displayed at the bottom thereof in the form of a fingerprint and at the same time, the fingerprint may be output as voice information.

Thereafter, the manipulation information detection block 202 of the tabletop interface 200 determines whether user drag manipulation information for changing the angle of the 3D character is input through the storytelling content application (S508). In this case, the user manipulation information may include a 3D character dragging operation using, for example, user hand touch information or tool touch information. That is, in the case of hand touch information, the 3D character of the storytelling content is directly dragged by the user's hand, and in the case of tool touch information, the 3D character is dragged using a separate tool.

When such user drag manipulation information is input to the manipulation information sensing block 202 through the storytelling content application, the control block 204 of the tabletop interface 200 may correspond to a data processing language corresponding to the drag manipulation information, for example, XML. Generates information and delivers it to storytelling content applications.

Accordingly, the storytelling content application analyzes the drag manipulation information from the XML information provided from the tabletop interface 200 and changes the 3D angle of the corresponding 3D character (S510).

As described above, the present invention can provide the edutainment content using the tabletop interface, and even users who are not familiar with the computer by emphasizing the intuitive operation and visual effects in using the edutainment content Edutainment content can be shared or manipulated by various users through the tabletop interface.

It has been described so far limited to one embodiment of the present invention, it is obvious that the technology of the present invention can be easily modified by those skilled in the art. Such modified embodiments should be included in the technical spirit described in the claims of the present invention.

1 is a configuration diagram of a tabletop interface device for implementing a content providing method according to the present invention;

FIG. 2 is a schematic view showing an arrangement of some of the components shown in FIG. 1;

3 is a schematic block diagram of a content providing system using a tabletop interface according to an aspect of the present invention;

4 is a flowchart illustrating a content providing method using a tabletop interface according to another aspect of the present invention.

5 is a flowchart illustrating a content providing method using a tabletop interface according to another aspect of the present invention, and a process of providing a storytelling content application.

<Description of the symbols for the main parts of the drawings>

200: tabletop interface 202: operation information detection block

204: control block 300: content application

Claims (12)

A rear projection screen installed on an upper surface of a table-shaped structure and used as an input / output space, a beam projector for projecting an image on the rear projection screen, and an object movement on an upper portion of the rear projection screen to project the rear surface into a backlight image A content providing method using a tabletop interface including a light source to be projected onto a screen, and a camera to photograph a projection image of the rear projection screen. Determining whether a user's hand touch information or a tool touch information for the game content application is input through the rear projection screen when a game content application is driven through the tabletop interface; Generating eXtensible Markup Language (XML) information corresponding to the hand touch information or the tool touch information through the rear projection screen when the hand touch information or the tool touch information is input; Analyzing the generated XML information and outputting the audiovisual information of the game content application corresponding to the analyzed XML information through the rear projection screen. How to provide content using the tabletop interface. delete delete A rear projection screen installed on an upper surface of a table-shaped structure and used as an input / output space, a beam projector for projecting an image on the rear projection screen, and an object movement on an upper portion of the rear projection screen to project the rear surface into a backlight image A content providing method using a tabletop interface including a light source to be projected onto a screen, and a camera to photograph a projection image of the rear projection screen. Determining whether 3D character information included in the storytelling content application is selected through the rear projection screen when the storytelling content application is driven through the tabletop interface; Generating XML information corresponding to the selected 3D character information when the 3D character information is selected and outputting the generated XML information through the rear projection screen; Determining whether drag manipulation information according to input of the user's hand touch information or tool touch information to the 3D character information is input through the rear projection screen; Generating the XML information corresponding to the drag manipulation information and changing a position angle of the 3D character information corresponding to the generated XML information when the drag manipulation information is input. How to provide content using the tabletop interface. delete delete The method of claim 4, wherein The content providing method, And outputting a fingerprint and a voice while outputting the 3D character information through the rear projection screen. A rear projection screen installed on an upper surface of a table-shaped structure and used as an input / output space, a beam projector for projecting an image on the rear projection screen, and an object movement on an upper portion of the rear projection screen to project the rear surface into a backlight image A content providing system using a tabletop interface including a light source to be projected onto a screen, and a camera for photographing a projection image of the rear projection screen. An operation information detection block for detecting a user's hand touch information or a tool touch information on the content application input through the rear projection screen when the content application is driven through the tabletop interface; And a control block for changing information of the content application according to an input value corresponding to the hand touch information or the tool touch information detected through the manipulation information sensing block. Content provision system using a tabletop interface. delete delete The method of claim 8, The content application is a content providing system using a tabletop interface including the edutainment audio-visual information that is output by analyzing the operation information from the input value. The method of claim 11, The edutainment audiovisual information is a content providing system using a tabletop interface that includes game content or story-telling content.

Images