KR20230142193A - Providing system of total media for interactive exhibition environment - Google Patents

Abstract

The present invention relates to an integrated media provision system for an interactive exhibition environment, which includes a sensor device input unit that provides a sensor platform for connection with various sensor devices and converts data input from the sensor devices into an integrated message and transmits it to a network; a graphic display unit that provides a graphic platform for connection to various display devices and converts the integrated message input through the network into unique data of the display device and outputs it; and a media server connected to the network and transmitting the integrated message transmitted from the sensor device input unit to the graphic display unit.
According to the present invention, the functions for building an interactive exhibition environment are modularized based on communication to provide a distributed computing environment so that they can be flexibly added and combined, enabling exhibitions to reflect various requirements and modifications through reusability and expandability. The environment can be easily established.

Description

Integrated media provision system for interactive exhibition environment {PROVIDING SYSTEM OF TOTAL MEDIA FOR INTERACTIVE EXHIBITION ENVIRONMENT}

The present invention relates to an integrated media provision system for an interactive exhibition environment. More specifically, the functions for building an interactive exhibition environment are modularized based on communication to provide a distributed computing environment so that they can be flexibly added and combined for reuse. This is about an integrated media provision system for an interactive exhibition environment that allows easy construction of an exhibition environment by reflecting various requirements and modifications through flexibility and scalability.

In general, in order to develop an interactive media system in an exhibition environment, design and manufacture an appropriate hardware system by combining various devices according to the exhibition space and planning intention, and build digital content expressed in 2D and 3D graphics that respond to various input interfaces. It is developed to fit the existing system.

Because interactive exhibition applications developed in this way only operate on systems composed of specific hardware and platforms, it is not easy to modify or develop them when adding or changing input devices and display devices.

In addition, when developing new interactive media exhibition contents, previously developed modules are limited to specific systems, so they are not easy to reuse, which reduces development efficiency, making integrated development using various devices and platforms difficult. .

Since the interactive exhibition industry mainly relies on these customized production systems, there is a need for an efficient development frame provider that can be built flexibly and quickly to meet various requirements.

A similar example of an exhibition authoring solution for interactive content development is the show controller presentation system used for performances, events, etc.

This is a GUI (Graphic User Interface)-based authoring tool that allows video presentations using resources such as basic sensor input and images and videos. However, because it was produced as a GUI-based player rather than a frame providing device in the form of an SDK (Software Development Kit), there are many technical implementation limitations to suit various content scenarios and various hardware systems, and there are limits to application development.

In addition, in the field of video solutions for multi-displays, there is a movement to introduce interface input from external devices, but it is limited to transmitting simple trigger input signals through networks, etc., and is mainly used for the purpose of specific hardware configuration called multi-display.

This exhibition authoring solution is produced in the form of a GUI-based player, so in terms of usability, there is no platform integration, so there is a limit to the application to external devices, or it is not based on an SDK (Software Development Kit), so it has various formats and functions. There is a problem of low utilization because it is not easy to use in accordance with the requirements.

Republic of Korea Patent Publication No. 10-12202316

The present invention was developed in consideration of and to solve the above-mentioned conventional problems, and provides a distributed computing environment by modularizing the functions for building an interactive exhibition environment based on communication, allowing them to be flexibly added and combined, thereby improving reusability and The purpose is to provide an integrated media provision system for an interactive exhibition environment that can easily build an exhibition environment by reflecting various requirements and modifications through expandability.

To achieve the above object, the integrated media provision system for an interactive exhibition environment according to the present invention provides a sensor platform for connection with various sensor devices, converts data input from the sensor devices into an integrated message, and transmits it to the network. A sensor device input unit; a graphic display unit that provides a graphic platform for connection to various display devices and converts the integrated message input through the network into unique data of the display device and outputs it; and a media server connected to the network and transmitting the integrated message transmitted from the sensor device input unit to the graphic display unit.

According to one type, the sensor platform is a gesture recognition platform for recognizing gestures based on data input from a vision sensor, a NUI (Natural User Interface) platform for natural user recognition using a NUI sensor, and a mobile device including a smartphone. It includes a mobile platform that processes and receives media input from the device, and the graphics platform includes a 2D graphics platform for providing 2D graphics, a visual effect platform for providing complex 3D effects, and a physics-based engine for reproducing physical interactions. The platform is characterized by including a 3D graphics platform for 3D content production.

According to one type, the graphic display unit and the sensor device input unit are connected in a P2P manner to transmit and receive the integrated message, and the network includes one or more of a wired local network, a Wi-Fi wireless network, and Bluetooth, The sensor platform and the graphic platform are characterized by supporting a plug-and-play format.

According to the present invention, the functions for building an interactive exhibition environment are modularized based on communication to provide a distributed computing environment so that they can be flexibly added and combined, enabling exhibitions to reflect various requirements and modifications through reusability and expandability. It is possible to provide an integrated media provision system for an interactive exhibition environment that can be easily constructed.

Figure 1 is a configuration diagram showing an integrated media provision system for an interactive exhibition environment according to an embodiment of the present invention.
Figure 2 is a detailed configuration diagram showing an integrated media provision system for an interactive exhibition environment according to an embodiment of the present invention.
Figure 3 is an example diagram showing an exhibition environment through an integrated media provision system for an interactive exhibition environment according to an embodiment of the present invention.

Preferred embodiments of the present invention will be described with reference to the accompanying drawings as follows. Through this detailed description, the purpose and configuration of the present invention and its characteristics will be better understood.

The integrated media provision system for an interactive exhibition environment according to an embodiment of the present invention includes a sensor device input unit 10, a graphic display unit 30, and a media server 20, as shown in FIGS. 1 to 3. It consists of:

The sensor device input unit 10 provides a sensor platform 11 for connection with various sensor devices 50 and converts data input from the sensor device 50 into an integrated message and transmits it to the network 40.

The sensor platform 11 includes a gesture recognition platform 12 for recognizing gestures based on data input from the vision sensor 51, multi-touch, voice recognition, etc. from the NUI sensor 52 using various sensors. Processes sensor information such as touch information and acceleration input from mobile devices, including the NUI (Natural User Interface) platform 14 and smartphone 53 for natural user recognition, as well as media such as events, text, and photos. It includes a mobile platform that receives input (16), etc.

Various sensor devices 50 do not have their own communication protocols or follow wired data transmission protocols such as USB, but the data input from the sensor device 50 is processed through the sensor platform 11 at the sensor device input unit 10. It is converted into an integrated message and transmitted according to a unified structure. At this time, the sensor device input unit 10 can be built based on a PC, one sensor platform 11 can be built on one sensor device input unit 10, and multiple sensor platforms 11 can be built. It can be configured in various ways to perform distributed computing depending on the data processing load and the complexity of the exhibition environment.

The graphic display unit 30 provides a graphic platform 31 for connection with various display devices 60 and converts the integrated message input through the network 40 into unique data of the display device 60 and outputs it. .

At this time, the integrated message is a message such as UI manipulation, navigation, or multi-display synchronization. If this is converted into a unique message suitable for a specific graphics platform (31) such as Flash, Unity3D, OpenGL, etc. or a standalone platform, the desired action in the application is performed. will be performed.

The graphics platform 31 includes a 2D graphics platform 32 for providing 2D graphics such as flash, a visual effect platform 34 for providing complex 3D effects, and a physics-based engine platform for reproducing physical interactions (36). ), 3D graphics platform (38) for producing various 3D contents such as character control and 3D navigation.

At this time, the sensor platform 11 and the graphics platform 31 are configured to be expandable in a plug-and-play format even when new sensor devices 50 and various display devices 60 are added.

For example, assuming a car simulation game, basically the user can automatically

Although you can control a car, you can also enjoy the same game remotely using a mobile device in a different way. Furthermore, it becomes possible to control the same game based on a vision sensor by recognizing user gestures.

Therefore, the sensor device input unit 10 and the graphic display unit 30 not only provide modules based on various sensor platforms 11 and graphic platforms 31 such as Windows, iOS, Android, and Flash, but are also used in each. Includes available communication modules.

In this way, the graphic display unit 30 receives integrated messages from the media server 20 or the sensor device input unit 10 and reproduces various effects, a two-dimensional user interface, and a three-dimensional virtual space.

In the case of information provision or a traditional two-dimensional user interface such as a kiosk, it can be implemented through a 2D graphics platform (32).

Additionally, for 3D virtual space, examples include Unity3D or OpenGL-based real-time graphics software. At this time, commercial game engines are used to create complex scenes that require high realism or combine two-dimensional and three-dimensional interfaces. However, existing commercial software is not designed to suit various communication environments, and existing engines cannot express anything. There are many limitations to graphic effects, especially in terms of performance and realism of expression when it comes to reproducing physical phenomena. To solve this problem, the visual effect platform 34, physics-based engine platform 36, and 3D graphics platform 38 of the graphic display unit 30 can be configured independently, or they can be installed in the form of a plug-in or script to existing software. It can also be configured by inserting .

The media server 20 is connected to the network 40 and sends the integrated message transmitted from the sensor device input unit 10 to the graphic display unit 30 for interworking with the sensor device input unit 10 and the graphic display unit 30. It acts as a relay for transmission.

The network 40 for linking the media server 20, the sensor device input unit 10, and the graphic display unit 30 includes a wired local network and a Wi-Fi wireless network.

In addition, the integrated message is relayed through the media server 20, but if the complexity of the exhibition environment is low or high-speed data transmission is required, the media server 20, which relays the integrated message, is unnecessary or may reduce the speed. In the case of data exchange between mobile devices or transmission of high-capacity messages such as video or human body data, not only is direct communication between the mobile platforms (16) possible without going through the media server (20), but also the sensor platform (11) and the graphics platform (31). ) to enable direct communication between

At this time, an integrated message is transmitted and received between the sensor platform 11 and the graphic platform 31 through a wired local network and a Wi-Fi wireless network, as well as a P2P (Peer to Peer) Bluetooth protocol.

In addition, distributed processing can be performed through the media server 20 for operations with a large computational load, such as gesture recognition or graphic rendering.

As such, integrated message communication in the integrated media frame providing device for an interactive exhibition environment according to the present invention is performed as follows.

The categories of integrated messages that can be exchanged in an interactive media exhibition environment can be divided into three categories.

(1) When an interaction is made on any device, using a traditional I/O device or imitating it, coordinates on the display or spatial coordinates in three-dimensional space can be considered.

(2) There may be cases where the user transmits a message with some meaning, that is, a symbol, through an input module, for example, selection of a specific element on the interface, navigation in space, etc. This means that the original (RAW) data output from each sensor device can be processed and used in the graphic display unit 30, but each sensor device 50 directly converts it into a meaningful value and transmits it through the network 40. By designing the structure, even if an arbitrary sensor device 50 is added, the graphic display unit 30 receives only a unified integrated message, enabling higher scalability.

(3) Messages that are variable and have low module independence, such as images, sounds, texts, or user body information, can be further defined so that the original data itself can be transmitted.

Summarizing the three above, the categories of integrated messages can be divided into 1) interaction occurrence coordinate type, 2) pre-processed symbol type, and 3) original data type.

At this time, when the symbol type can be defined in more detail, 1) a key input symbol that imitates a specific button or key input, 2) a click symbol that expresses a traditional mouse gesture such as selection or drag, and 3) a direction symbol for navigation. It can be defined.

In addition, the original data type can be subdivided into several predictable types, which can be defined as 1) text data type, 2) image data type, and 3) user body data type, and other data that does not belong to these types can be defined as It can be classified into other data types and used for very special situations.

By using the integrated message type defined above, it is possible to build an independently expandable frame provision device.

In addition, it can be assumed that filtering is required for certain devices in a specific module. For example, in a game that requires 3D navigation, control is limited to vision sensing and messages input from mobile devices must be ignored. You can add category tags for module hardware or operating system.

Therefore, it can be broadly classified into 1) standard input devices, 2) vision input devices, 3) mobile input devices, and 4) other devices. Standard input devices can be further divided into keyboard and mouse input, and vision input devices include cameras. and Kinect compatible devices, and mobile devices can be subdivided into Android, iOS, Windows Phone, etc.

Figure 3 is an example diagram showing an exhibition environment through an integrated media provision system for an interactive exhibition environment according to an embodiment of the present invention. Referring to Figure 3, a transparent display 61 is used as a display device 60 as an interactive exhibition environment. ), LCD display 62, hologram 63, multi-display 65, projector 64, and projection screen 66.

They are equipped with a graphic platform (31) and display digital content for exhibition.

The sensor devices 50 include a motion camera (vision sensor) 51, a smartphone 53, and a NUI sensor 52, which are sent as an integrated message by the sensor platform 11 mounted on a PC or dedicated board. It is converted and transmitted through the network 40.

In addition, kiosks (55), media tables (56), tablet PCs (54), and smartphones (53) are exhibition hardware that combines input devices and displays, and various sensor platforms (11) and graphic platforms depending on the device. (31) is mounted.

Therefore, each sensor device 50 and graphic device 60 exchanges various input and output information through the media server 20 by the integrated message passing method, thereby enabling heterogeneous combination according to exhibition planning in an interactive media exhibition environment. designed and developed in the form

The integrated media provision system for an interactive exhibition environment according to the present invention provides new elements as modules for sensor devices 50 and graphic devices 60 that can be added in various ways depending on the exhibition environment without the need to redesign the entire structure. It is very easy to expand by adding.

For example, when a new high-performance vision sensor 51 is added, the corresponding sensor device 50 is packaged into a module to enable communication according to a set standard and communicated with a defined integrated message, without changing the frame providing device. This can have the effect of improving sensing performance.

As another example, when implementing the multi-display 65, the multi-display technique that outputs the same screen to multiple displays includes various technical issues such as screen synchronization and camera division, and generally requires a dedicated method depending on the system design. Although a new application must be developed and modified development is not easy, a multi-display (65) can be easily implemented by combining and controlling a plurality of graphic platforms (31) in the media server (20) through an integrated media framework, thereby increasing development efficiency. You can.

In this way, the integrated media frame providing device for an interactive exhibition environment according to the present invention can help in the continuous development of exhibition technology and content, and based on this frame providing device, virtual media can be provided to stores promoting specific products. It can be applied to develop content services to experience products, and can be used to create interactive content that combines storytelling with fun and interesting elements in events, performances, and events.

In addition, it can be used to develop virtual reality content to be installed in media systems such as museums, exhibition halls, and promotional centers.

And, due to the low-cost, high-efficiency development method, it is possible to change the existing exhibition media environment, including commercial facilities, education, and exhibition environments.

Accordingly, through the integrated media provision system for an interactive exhibition environment according to the present invention having the above-described configuration, functions for building an interactive exhibition environment can be flexibly added and combined by providing a distributed computing environment by modularizing the functions for building an interactive exhibition environment based on communication. This provides the advantage of being able to easily build an exhibition environment by reflecting various requirements and modifications through reusability and expandability.

The embodiments described above merely describe preferred embodiments of the present invention and are not extremely limited to these embodiments, and various modifications and variations may be made by those skilled in the art within the technical spirit and scope of the claims of the present invention. It will be said that this can be achieved, and it will be said that it falls within the scope of the technical rights of the present invention.

10: Sensor device input unit 11: Sensor platform
12: Gesture recognition platform 14: NUI platform
16: Mobile platform 20: Media server
30: graphic display unit 31: graphic platform
32: 2D graphics platform 34: Visual effect platform
36: Physics-based engine platform 38: 3D graphics platform
40: Network 50: Sensor device
60: display device

Claims (3)

A sensor device input unit that provides a sensor platform for connection with various sensor devices and converts data input from the sensor devices into an integrated message and transmits it to the network;
a graphic display unit that provides a graphic platform for connection to various display devices and converts the integrated message input through the network into unique data of the display device and outputs it;
a media server connected to the network and delivering the integrated message transmitted from the sensor device input unit to the graphic display unit; An integrated media provision system for an interactive exhibition environment comprising: According to clause 1,
The sensor platform is a gesture recognition platform for recognizing gestures based on data input from a vision sensor, a NUI (Natural User Interface) platform for natural user recognition using a NUI sensor, and media input from mobile devices including smartphones. Includes a mobile platform that processes and receives input,
The graphics platform includes a 2D graphics platform for providing 2D graphics, a visual effects platform for providing complex 3D effects, a physics-based engine platform for reproducing physical interactions, and a 3D graphics platform for producing 3D content. An integrated media provision system for an interactive exhibition environment. According to clause 1,
The graphic display unit and the sensor device input unit are connected in a P2P manner to transmit and receive the integrated message,
The network includes one or more of a wired local network, Wi-Fi wireless network, and Bluetooth,
An integrated media provision system for an interactive exhibition environment, wherein the sensor platform and the graphic platform support a plug-and-play format.