KR20160078925A

KR20160078925A - System for providing interactive multi-view image of contents

Info

Publication number: KR20160078925A
Application number: KR1020150186542A
Authority: KR
Inventors: 조홍래; 문치우; 최승호; 유연우; 고희윤
Original assignee: 주식회사 바이널아이
Priority date: 2014-12-24
Filing date: 2015-12-24
Publication date: 2016-07-05
Also published as: KR101690218B1

Abstract

The present invention relates to a multi-viewpoint display system, which is installed on one side wall of a specific space and displays a multi-view 3D content image, and is installed at a predetermined interval from the multi-viewpoint display and displays a plurality of digital colors, A digital palette device connected to the digital pallet device and adapted to touch or bring a brush provided at one end thereof to a digital color of the digital pallet device, At least one digital brush device that receives a specific color signal corresponding to a digital color output from the device and displays the corresponding digital color on the brush, and a motion detection device that detects a brush movement of each digital brush device and outputs a specific position signal Device, and pre-stored multi-view 3D Viewpoint 3D content image selected by the user from among the content images is displayed on the multi-view display, a specific position signal of each of the brushes outputted from the motion sensing device, and a specific color signal transmitted from each digital brush device And a controller for controlling the operation of the multi-view display so that the digital color of each brush is displayed on the selected multi-view 3D content image according to the movement of each brush based on the received signal.

Description

SYSTEM FOR PROVIDING INTERACTIVE MULTI-VIEW IMAGE OF CONTENTS

The present invention relates to an interactive multi-view image content providing system that can increase the sense of realism and liveliness while inducing a user's interest and immersion.

In general, a kiosk device is also referred to as an unmanned information terminal, and is installed in a public place such as a government agency, a local government, a bank, a department store, or an exhibition hall, and displays information about various administrative procedures, product information, .

That is, the kiosk device is an unmanned information terminal. The kiosk device includes a display unit having a touch device function, a sound card, a graphic card, and a communication card to provide a kind of unmanned general information Guidance system.

In the system using the kiosk device, when the user operates the terminal and requests the central information service device through the transmission network to provide the required information, the central information service device transmits the information requested by the user to the corresponding terminal through the transmission network And the information transmitted is outputted through the corresponding terminal so that the user can recognize the information. In order to provide information related to various kinds of guidance, education, advertisement, and the like, a public office, a shopping center, a hotel, Hospitals, and financial institutions.

Such a system using a kiosk is generally configured so that it can be easily searched in an interactive manner between an observer and a system by using an input button or a touch device so that users can easily obtain desired information, Institutions can save the guidance workforce.

However, since the conventional kiosk provides only a two-dimensional image in a planar view, the viewing of the contents provided by the kiosk deteriorates the reality and can not cause interest.

Korean Patent Laid-Open No. 10-2012-0010007

DISCLOSURE Technical Problem Accordingly, the present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a digital palette device and a digital brush device, View image content providing system that provides a stereoscopic image, not a planar image, to induce a user's interest and mobility, and to increase the sense of reality and liveliness.

According to an aspect of the present invention, there is provided a multi-view display system including: a multi-view display installed on one side wall of a specific space for displaying a multi-view 3D content image; A digital pallet device installed at a predetermined distance from the multi-view display and displaying a plurality of digital colors and outputting a specific color signal corresponding to each digital color according to an external touch or proximity; The digital pallet device is connected to the digital pallet device and touches or brings a brush provided at one end thereof into digital color of the digital pallet device. The digital pallet device receives a specific color signal corresponding to the digital color output from the digital pallet device, At least one digital brush device for displaying on a brush; A motion sensing device for sensing a brush movement of each digital brush device and outputting a specific position signal; Point 3D content image selected by the user from among the previously stored multi-view 3D content images, and displaying the specific position signal of each of the brushes output from the motion sensing device and each of the digital brushes And a controller for receiving the specific color signal transmitted from the device and controlling the operation of the multi-view display so that the digital color of each brush is displayed on the selected multi-view 3D content image according to the movement of each brush on the basis of the specific color signal transmitted from the device. View image content providing system.

Here, the multi-view display may be a non-panoramic multi-view display device capable of displaying a 3D content image of the eighth viewpoint (36 viewpoint).

Preferably, the multi-view 3D content image may be a 3D content image including at least one of a 3D still image and a moving image content.

Preferably, each digital brush device may transmit a specific control signal corresponding to the digital color to the control device according to a user's input signal.

Preferably, the control device separates the multi-view 3D content image selected by the user into a plurality of coloring areas and controls the multi-view 3D content image to be displayed on the multi-view display, The operation of the point-of-view display can be controlled.

Preferably, the controller receives a specific position signal of each brush outputted from the motion sensing device, and controls the virtual brush image to be displayed on the multi-view display according to the motion of each brush.

Preferably, the controller receives the color completion signal of the user transmitted from the digital pallet device or each digital brush device so that the multi-view 3D content image is displayed so as to move according to a predetermined movement pattern. The operation of the point-of-view display can be controlled.

Preferably, the display device further includes a plurality of display devices for displaying 2D content images related to the multi-view 3D content image displayed on the multi-view display on a portion of one side wall of the specific space and all the remaining wall surfaces under the control of the controller .

Preferably, the controller receives the color completion signal of the user transmitted from the digital pallet device or each digital brush device so that the multi-view 3D content image is displayed so as to move according to a predetermined movement pattern. The operation of each display device can be controlled so as to control the operation of the point-of-view display and display a predetermined color on the 2D content images displayed on a part of one side wall of the specific space and all the remaining wall surfaces.

Advantageously, the plurality of display devices may include at least one projector module for projecting 2D content images on a portion of one side wall of the specific space and all the other wall surfaces.

Preferably, at least one speaker device installed in the specific space and outputting at least one sound source of predetermined guide voice, sound effect sound and background music under the control of the control device may be further included.

Preferably, the control device controls to output predetermined sound effect sounds and background music through each speaker device when receiving a color completion signal of a user transmitted from the digital pallet device or each digital brush device.

Preferably, the digital pallet device or each digital brush device is provided with a multi-view 3D content image, which is color-completed according to the control of the control device, A kiosk device may be further included.

Preferably, the kiosk device may provide a service such that the multi-view 3D content image data, which has been painted according to the control of the controller, is transmitted to an e-mail or a preset user terminal of the corresponding user.

According to the interactive multi-view image content providing system of the present invention as described above, the multi-view 3D content image displayed on the multi-view display installed in the specific space can be viewed and displayed on a digital palette device and a digital brush device, Thereby providing a stereoscopic image, not a planar image, thereby generating a user's interest and immersion, and also enhancing the sense of realism and liveliness.

1 is a block diagram illustrating an interactive multi-view video content providing system according to an exemplary embodiment of the present invention. Referring to FIG.
2 is a plan view for explaining an arrangement state of components of an interactive multi-view image content providing system according to an embodiment of the present invention.
3 is a conceptual diagram illustrating an operation of an interactive multi-view image content providing system according to an exemplary embodiment of the present invention.
4 to 8 are views for explaining a data transfer process between a kiosk device and a user terminal applied to the interactive multi-view image content providing system according to an embodiment of the present invention.
FIGS. 9 to 15 are views for explaining an operation procedure of the interactive multi-view image content providing system according to an embodiment of the present invention.

The above and other objects, features, and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings, which are not intended to limit the scope of the present invention. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements as well, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the following embodiments of the present invention may be modified into various other forms, and the scope of the present invention is not limited to the embodiments described below. The embodiments of the present invention are provided to enable those skilled in the art to more fully understand the present invention.

FIG. 1 is a block diagram illustrating an interactive multi-view image content providing system according to an exemplary embodiment of the present invention. FIG. 2 is a block diagram illustrating an interactive multi-view image content providing system according to an exemplary embodiment of the present invention. As shown in Fig.

Referring to FIGS. 1 and 2, an interactive multi-view image content providing system according to an embodiment of the present invention includes a multi-view display 100, a digital pallet device 200, at least one digital brush device 300- 1 to 300-N, a motion sensing device 400, a control device 500, and a power supply device 600. In addition, the interactive multi-view image content providing system according to an embodiment of the present invention includes a plurality of display devices 700-1 to 700-N, at least one speaker device 800-1 to 800-N, and a kiosk device 900), and the like. Meanwhile, the components shown in FIG. 1 and FIG. 2 are not essential, so that the interactive multi-view image content providing system may have more or fewer components.

Here, the multi-view display 100 is installed on one side wall in a specific space, and displays a multi-view 3D content image.

The multi-view display 100 includes a non-eye-taking multi-view / multi-view display device (not shown) provided to display a 3D content image of a multi-viewpoint or a super-multi view (preferably, .

At this time, the no-viewing type multi-viewpoint / multi-viewpoint display device is generally referred to as an autostereoscopy device. The multi-viewpoint / hyper-viewpoint display apparatus of non-averaged type displays images of different viewpoints on the left and right eyes of a viewer using a Parallax Barrier technique or a Lenticular lens while displaying spatially shifted multi- So that the user can feel the stereoscopic effect.

As described above, in the case of the no-viewing type multi-viewpoint / ultra-wide-point display device, the number of viewpoints is increased in one screen and the interval between viewpoints is made smaller than the pupil size of one eye, In this way, it is natural to recognize stereoscopic visuals in the display, and it is possible to view 3D contents images without using 3D glasses separately.

The multi-viewpoint or the pseudo-viewpoint 3D content image may be a multi-viewpoint or a pseudo-viewpoint 3D content image including at least one of three-dimensional still image and moving image content, for example.

The digital pallet apparatus 200 is installed to be spaced apart from the multi-view display 100 at a predetermined interval (preferably about 1 to 1.5 m), and the entire body is formed in a normal table shape. A display module 210 for displaying a color is provided.

The display module 210 may be a liquid crystal display (LCD), a light emitting diode (LED), a thin film transistor-liquid crystal display (TFT LCD) (OLED), a flexible display, a plasma display panel (PDP), a surface alternating light (ALiS), a digital light source processing (DLP), a silicon liquid crystal (LCoS) (FDD), interferometric modulator display (iMoD), thick film dielectric electrical (TDEL), and so on. , A quantum dot display (QD-LED), a telescopic pixel display (TPD), an organic light emitting transistor (OLET), a laser fluorescent display (LPD) May comprise at least one, not limited to this may include if the module that can display (Display) The various digital color, any module.

In addition, the digital pallet apparatus 200 performs a function of outputting a specific color signal corresponding to each digital color according to an external touch or proximity. At this time, the external touch or proximity can be determined using, for example, a pressure sensor, a proximity sensor, a magnet, a Hall sensor, a polarity and a Gaussian value.

Each of the digital brush devices 300-1 to 300-N is connected to the digital pallet 200 in a wired or wireless manner, and the brush 310 provided at one end of the brush is connected to the digital pallet 200 Touch or proximity to the digital palette 200, and receives the specific color signal corresponding to the digital color output from the digital palette 200 and displays the corresponding digital color on the corresponding brush 310.

Each of the digital brush devices 300-1 to 300-N outputs a specific control signal corresponding to the digital color in accordance with a user's input signal output from a separate input device (for example, an input switch or the like) To the control device 500.

That is, when a user presses an input device provided in each of the digital brush devices 300-1 through 300-N, the input signal of the corresponding user is output through the input device, and the input signal of the corresponding user And transmits a specific control signal corresponding to the digital color displayed on the brush 310 to the controller 500. [

Each of the digital brush devices 300-1 to 300-N is preferably a haptic paint brush having a function of sensing tactile force, force, and sense of movement.

The motion sensing device 400 senses the brush motion of each digital brush device 300-1 to 300-N and outputs a specific position signal.

It is preferable that the motion sensing device 400 is installed in the vicinity of the direction in which the brush 310 of each digital brush device 300-1 to 300-N is directed, that is, the position where the multi-view display 100 is installed. At least one camera for sensing movement of a subject, a sensor, and an image analysis module. However, the present invention is not limited thereto, and it is natural that it may be implemented in various forms using an infrared ray, a laser, and an electric field sensor.

In addition, the controller 500 is an apparatus for controlling the operation of the interactive multi-view image content providing system as a whole. In particular, any one of multi-view 3D content images selected by the user among the previously stored multi- To be displayed on the display unit (100).

The controller 500 receives the specific position signal of each brush 310 output from the motion sensing device 400 and the specific color signal transmitted from each of the digital brush devices 300-1 to 300- And controls the operation of the multi-view display 100 so that the digital colors of the brushes 310 are displayed on the selected multi-view 3D content image according to the movement of each brush 310. [

In addition, the controller 500 separates the multi-view 3D content image selected by the user into a plurality of coloring regions and controls the multi-viewpoints to be displayed on the multi-view display 100, so that different numbers or symbols are displayed in the respective coloring regions The display of the multi-view display 100 can be controlled.

The controller 500 receives a specific position signal of each brush 310 output from the motion sensing device 400 and generates a virtual position signal based on the specific position signal of the brush 310, The brush image can be controlled to be displayed.

In addition, when the controller 500 receives a user's coloring completion signal transmitted from the digital pallet 200 or each of the digital brushes 300-1 to 300-N, the multi-view 3D content image And the operation of the multi-view display 100 can be controlled such that the multi-view display 100 is displayed to be moved by a predetermined movement pattern.

The power supply 600 includes components such as a multi-view display 100, a digital pallet device 200, respective digital brush devices 300-1 to 300-N, a motion sensing device 400, And supplies power to the display devices 700-1 to 700-N, the speaker devices 800-1 to 800-N, and the kiosk device 900, (AC) power source (e.g., AC 220V) to a direct current (DC) power source for supply.

In addition, a plurality of display devices (not shown) for displaying 2D content images related to the multi-view 3D content image displayed on the multi-view display 100 on a portion of one side wall of the specific space and all the remaining wall surfaces under the control of the control device 500 700-1 to 700-N) may be further included.

At this time, when the controller 500 receives the color completion signal of the user transmitted from the digital pallet 200 or each of the digital brushes 300-1 to 300-N, the multi-view 3D content image And controls the operation of the multi-view display 100 so as to move in accordance with a predetermined movement pattern. In addition, the 2D content images displayed on a part of one side wall of the specific space and all the remaining wall surfaces are displayed So that the operation of each of the display devices 700-1 to 700-N can be controlled.

The plurality of display devices 700-1 to 700-N include at least one projector module (not shown) for projecting 2D content images on a part of one side wall of the specific space and all the other wall surfaces, And the projector module may be a conventional beam projector that processes light from a light source when the image signal is transmitted from the controller 500. [

Furthermore, at least one speaker device 800-1 to 800-N for outputting a sound source of at least any one of predetermined guidance voice, sound effect sound and background music under the control of the control device 500, -N) may be further included.

At this time, when the controller 500 is provided with the color completion signal of the user transmitted from the digital pallet 200 or each of the digital brushes 300-1 to 300-N, each of the speaker devices 800-1 to 800- -N) so that the predetermined sound effect sound and background music are outputted.

When the coloring completion signal of the user transmitted from the digital pallet apparatus 200 or each of the digital brush apparatuses 300-1 to 300-N is received, the control unit 500 controls the multi-viewpoint 3D The kiosk device 900 may be further provided so that the content image can be output in the form of a printed matter (e.g., color photograph, etc.).

The kiosk device 900 may be configured to transmit the multi-view 3D content image data, which has been painted according to the control of the control device 500, to a service (for example, e-mail) MMS text message, etc.).

FIG. 3 conceptually explains the operation of the interactive multi-view image content providing system according to an embodiment of the present invention. First, after entering the virtual space, the digital brush devices 300-1 to 300- N, Figs. 1 and 2).

1 and 2), and then displays the painted description on a printer, that is, a kiosk device 900 (see FIGS. 1 and 2) (See FIG. 2), or transmits a description painted with the corresponding user terminal 1000 (see FIGS. 1 and 2) to a file.

4 to 8 illustrate a data transfer process between a kiosk device and a user terminal applied to an interactive multi-view image content providing system according to an embodiment of the present invention. For example, a kiosk (kiosk) 1 and 2) through the device 900 (see FIGS. 1 and 2) to the user terminal 1000 (see FIGS. 1 and 2) by using the e-mail or telephone number of the corresponding user .

FIGS. 9 to 15 are views for explaining an operation procedure of the interactive multi-view image content providing system according to an embodiment of the present invention.

9 to 15, an operation of the interactive multi-view image content providing system according to an exemplary embodiment of the present invention begins with a user entering a virtual room capable of entering a new virtual space.

A multi-view display 100 (see Figs. 1 and 2) is hung on the front wall of the virtual room, in which a part of the picture that fills the wall is seen three-dimensionally. 1 and 2) and a digital paint, that is, a digital pallet device 200 (see FIGS. 1 and 2), at a point about 1 m away from the multi-view display 100. The digital brush devices 300-1 to 300- ).

Thereafter, a guide instruction to color the picture using the two digital brush devices 300-1 to 300-N and the digital pallet device 200 placed in front of the multi-view display 100 together with the welcome message, That is, through the speaker devices 800-1 to 800-N (see Figs. 1 and 2).

Next, the color selection process is performed. When the digital brush devices 300-1 to 300-N are brought to a desired color, that is, the digital pallet device 200, At the end of the selected color is shown. Inside the picture, different numbers are written in each area to be painted. At this time, when the digital brush devices 300-1 to 300-N are shot in the picture area to be painted in the air, the number of the picture area is activated and the color point to be painted is presented.

When the digital brush devices 300-1 to 300-N are brought into contact with the drawing, the position values of the digital brush devices 300-1 to 300-N are displayed as pointers in the screen. Loses.

Next, the coloring completion process is performed. After painting all the pictures in the multi-view display 100, the digital brush devices 300-1 to 300-N are put back to their original positions, and coloring is completed.

And, when coloring is completed, another 2D picture of 4 sides which is not painted is colored as if the paints spread. In other words, a new experience that seems to come into the real space of my painting through the interaction sound of the 2D picture of the wall, and the vivid sound effect sound and background music of the movement.

Finally, the process of receiving a souvenir is performed. After the viewing of the moving painting, the user goes out to the entrance again and prints a picture painted with a friend in the kiosk device 900 (see FIGS. 1 and 2) I will. That is, a picture is output from the entrance kiosk device 900 while the live speech is reproduced.

As described above, according to the system for providing interactive multi-view image contents according to the embodiment of the present invention, the multi-view 3D content image displayed on the multi-view display in the specific space can be viewed by using the digital palette device and the digital brush device, It is possible to provide a variety of coloring games suitable for the user's taste, and it is possible to provide advantages such as a feeling of immersion and a sense of realism as well as a sense of realism and lifestyle through stereoscopic images rather than a flat image.

Although the preferred embodiments of the system for providing interactive multi-view video content according to the present invention have been described above, the present invention is not limited to such a configuration, function, and operation, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the appended claims.

100: Multi-view display,
200: Digital pallet device,
300-1 to 300-N: Digital brush device,
400: motion detection device,
500: control device,
600: Power supply,
700-1 to 700-N: Display device,
800-1 to 800-N: Speaker device,
900: kiosk device,
1000: User terminal

Claims

A multi-view display installed on one side wall in a specific space and displaying a multi-view 3D content image;
A digital pallet device installed at a predetermined distance from the multi-view display and displaying a plurality of digital colors and outputting a specific color signal corresponding to each digital color according to an external touch or proximity;
The digital pallet device is connected to the digital pallet device and touches or brings a brush provided at one end thereof into digital color of the digital pallet device. The digital pallet device receives a specific color signal corresponding to the digital color output from the digital pallet device, At least one digital brush device for displaying on a brush;
A motion sensing device for sensing a brush movement of each digital brush device and outputting a specific position signal; And
Point 3D content image selected by the user among the previously stored multi-view 3D content images is displayed on the multi-view display, the specific position signal of each brush outputted from the motion sensing device, And a control unit for controlling the operation of the multi-view display so that the digital color of each brush is displayed on the selected multi-view 3D content image according to the movement of each brush based on the received specific color signal. Viewpoint video content providing system.

The method according to claim 1,
Wherein the multi-view display is a non-panoramic multi-view display device capable of displaying a 3D content image of a super-viewpoint (36 viewpoint).

The method according to claim 1,
Wherein the multi-view 3D content image is composed of a 3D content image including at least one of a 3D still image and a moving image content.

The method according to claim 1,
Wherein each digital brush device transmits a specific control signal corresponding to the digital color to the control device according to a user's input signal.

The method according to claim 1,
Viewpoint 3D content image selected by the user is divided into a plurality of coloring areas to be displayed on the multi-view display, and a different number or symbol is displayed in each of the coloring areas, Wherein the interactive multi-view image content providing system controls the operation of the interactive multi-view image content.

The method according to claim 1,
Wherein the control device receives a specific position signal of each brush outputted from the motion sensing device, and controls the virtual brush image to be displayed on the multi-view display according to the movement of each brush based on the specific position signal. Viewpoint video content providing system.

The method according to claim 1,
Wherein the controller is configured to display the multi-view 3D content image so that the multi-view 3D content image is displayed in a predetermined motion pattern when the coloring completion signal of the user transmitted from the digital pallet device or each digital brush device is provided, Wherein the interactive multi-view image content providing system controls the operation of the interactive multi-view image content.

The method according to claim 1,
And a plurality of display devices for displaying 2D content images related to a multi-view 3D content image displayed on the multi-view display on a part of one side wall of the specific space and all the remaining wall surfaces under the control of the controller View video content providing system.

9. The method of claim 8,
Wherein the controller is configured to display the multi-view 3D content image so that the multi-view 3D content image is displayed in a predetermined motion pattern when the coloring completion signal of the user transmitted from the digital pallet device or each digital brush device is provided, And controls the operation of each display device so that a predetermined color is displayed on the 2D content images displayed on a part of one side wall of the specific space and all the remaining wall surfaces, Image contents providing system.

9. The method of claim 8,
Wherein the plurality of display devices include at least one projector module for projecting 2D content images on a portion of one side wall of the specific space and all the other wall surfaces.

The method according to claim 1,
And at least one speaker device installed in the specific space for outputting at least one sound source of a predetermined guide voice, sound effect sound and background music under the control of the control device. Viewpoint video content providing system.

12. The method of claim 11,
Wherein the control unit controls the sound output unit to output predetermined sound effect sounds and background music through each speaker unit when receiving a color completion signal of a user transmitted from the digital pallet unit or each digital brush unit. Viewpoint video content providing system.

The method according to claim 1,
A pointing device for outputting a multi-view 3D content image, which has been painted according to the control of the control device, in the form of a printed material when the user receives a color completion signal of the user transmitted from the digital pallet device or each digital brush device Wherein the interactive multi-view image content providing system further comprises:

14. The method of claim 13,
Wherein the kiosk device provides a service such that multi-view 3D content image data, which has been painted according to the control of the controller, is transmitted to an e-mail of a corresponding user or a predetermined user terminal Image contents providing system.