KR102529170B1 - Art wall system - Google Patents

Abstract

The present invention relates to an art wall system, and more particularly, to an art wall system capable of efficiently providing customized images converted according to the type of art wall of an exhibition hall. To this end, the art wall system includes an input unit for receiving exhibition hall information from a manager, an extraction unit for extracting at least one open source video from a plurality of pre-collected open source videos based on the exhibition hall information, and the at least one open source video. A content creation unit that generates a media file for art wall output using a source image, and conversion that converts the media file for art wall output into projector content through a projection mapping program based on the art wall size identified from the exhibition hall information. and an output control unit that separates and outputs projector content into audio and video data through a plurality of output means arranged according to the type of art wall of the exhibition hall identified from the exhibition hall information.

Description

Art Wall System {ART WALL SYSTEM}

The present invention relates to an art wall system, and more particularly, to an art wall system capable of efficiently providing customized images converted according to the type of art wall of an exhibition hall.

In general, an art museum where famous paintings can be appreciated is a space where paintings are framed and hung on a wall to be displayed so that visitors can appreciate the displayed paintings. Ordinary art museums provide an environment optimized for art appreciation to visitors by providing intensive lighting to paintings or providing a quiet environment as much as possible.

Furthermore, recently, media art exhibition halls that provide media art images are being used instead of art frames. Media art such as video is created in the form of creating various graphic elements generated in real time by a program through real-time rendering. It goes through a process of converting various types of graphic elements such as particles, images, and 3D models into new types of graphics through mathematical calculations.

However, since a considerable amount of calculation is required to create such media art, the media art creation program has a complicated coding method, and users other than experts cannot easily access the media art because it is difficult to use it.

In addition, existing media art exhibition halls have disadvantages such as dark and limited space, environment and time constraints, expensive systems, expensive exhibition experience prices, difficult accessibility, heterogeneity of transformed works, weak popularity, and limited marketability.

Korea Patent Registration 10-1460794

The present invention is to solve the above problems, and an object of the present invention is to provide an art wall system capable of efficiently outputting customized images converted according to the type and size of the art wall of an exhibition hall.

In addition, it is to provide an art wall system that can quickly replace projector contents with interesting sound and image according to visitor information.

In addition, based on a change in the average separation distance between a plurality of visitors and the art wall of the exhibition hall, it is to provide an art wall system capable of automatically adjusting the enlargement and reduction ratios for projector contents output on the art wall.

The above and other objects and advantages of the present invention will become apparent from the following description of preferred embodiments.

In order to achieve the above object, the art wall system according to an embodiment of the present invention includes an input unit for receiving exhibition hall information from a manager, and at least one open source image from a plurality of pre-collected open source images based on the exhibition hall information. An extraction unit that extracts a source image, a content generator that generates a media file for art wall output using the at least one open source image, and a media file for art wall output based on the art wall size checked from the exhibition hall information. Output that separates and outputs the contents for the projector into audio and video data through a conversion unit that converts the contents for the projector through a projection mapping program and a plurality of output means arranged according to the type of the art wall of the exhibition hall identified from the exhibition hall information. includes a control unit.

In an embodiment, a camera unit connected to the output control unit and disposed in an exhibition hall, and providing a visitor image obtained by periodically photographing a visitor viewing the contents for the projector to the output control unit, wherein the output control unit outputs pre-registered interest-inducing sound and image corresponding to object information of a certain ratio or more through the output means while the contents for the projector are stopped for a certain period of time according to the preset number of visitors detected from the visitor image.

In an embodiment, the output control unit according to the preset number of visitors detected from the visitor image, pre-registered interest-inducing sound corresponding to object information of a certain ratio or more while stopping the output of the contents for the projector for a certain period of time, and output the video.

In an embodiment, the output control unit allocates and outputs a feedback effect sound corresponding to the specific motion to projector contents based on a specific motion of a specific object located in a certain area confirmed from the viewer image.

In an embodiment, the output control unit automatically adjusts the enlargement and reduction ratio of the contents for the projector based on the change in the average separation distance between the plurality of visitors identified from the visitor image and the art wall of the exhibition hall.

In the embodiment, the first plurality of sensors are communicatively connected to the output control unit, are disposed at regular distances in the exhibition hall, and measure the bio-signals of visitors located in a predetermined area, and are disposed at regular distances in the exhibition hall. Further comprising a second plurality of sensors for sensing the environmental state of each zone, wherein the output control unit automatically adjusts parameters of the content for the projector based on bio signals measured through the first plurality of sensors, The above parameters include content volume, pitch, playback speed, richness of sound, depth, resonance, thickness, vibration, immersive effect, surround effect, sense of space, chord, chord and accompaniment, display area on the display, color of the display, and saturation. , Contrast, transparency, focus, power, power consumption, and at least one of the type of content.

In an embodiment, when the generating unit generates the media file for outputting the art wall, an output order of the at least one open source video is based on a parameter analyzed in a specific output screen area of the at least one open source video. sort sequentially.

In an embodiment, the output control unit outputs the responsive content assigned to the content for the projector when the biosignal of the viewer is less than a preset value, and based on response information obtained through the microphone, the atmosphere state for each stage. and, when the atmospheric condition for each level is less than a predetermined level, the contents for the projector are temporarily paused and a healing content image for inducing psychological stability is replaced and output, and when the atmospheric condition for each level is greater than or equal to a predetermined level, the camera unit The image of the viewer captured through the camera and the voice recognized through the microphone are synthesized and output in the form of an overlay on the contents for the projector.

In an embodiment, a frame collection unit that classifies and collects diagnostic frames randomly extracted from copyrighted image content and harmful content, and learns the diagnostic frames through machine learning to learn an artificial intelligence-based diagnostic model for removed images. a learning unit that determines whether or not to remove each open-source image based on output values derived by applying the frames for each open-source image sequentially detected from the contents for the projector to the removed image diagnostic model; and When it is determined that any one open source image among the source images is to be removed, a pre-processing unit is included to remove the one open source image from the projector content and at the same time insert the healing content image into the projector content.

According to an embodiment of the present invention, it is possible to easily implement digital art images in various exhibition halls by efficiently outputting customized images converted according to the type and size of the art wall of the exhibition hall.

In addition, interest in digital art images can be heightened by promptly replacing projector contents with interest-inducing sound and image according to visitor information.

In addition, by automatically adjusting the enlargement and reduction ratios of the contents for the projector, it is possible to provide an environment in which users can view more easily.

1 is a diagram schematically illustrating an art wall system 1000 according to an embodiment of the present invention.
2(A) and 2(B) show an example in which the art wall system 1000 of FIG. 1 is implemented in an exhibition hall.
3 is a diagram schematically illustrating an art wall system 1000_1 according to another embodiment of the present invention.
4 is a diagram schematically illustrating an art wall system 1000_2 according to another embodiment of the present invention.
FIG. 5 is a block diagram showing the output controller 500 of FIG. 3 in detail.

Hereinafter, the present invention will be described in detail with reference to embodiments and drawings of the present invention. These examples are only presented as examples to explain the present invention in more detail, and it will be apparent to those skilled in the art that the scope of the present invention is not limited by these examples. .

In addition, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of skill in the art to which this invention belongs, and in case of conflict, this specification including definitions of will take precedence.

In order to clearly explain the proposed invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification. And, when a certain component is said to "include", this means that it may further include other components without excluding other components unless otherwise stated. Also, a “unit” described in the specification means one unit or block that performs a specific function.

In each step, the identification code (first, second, etc.) is used for convenience of description, and the identification code does not describe the order of each step, and each step does not clearly describe a specific order in context. It may be performed differently from the order specified above. That is, each step may be performed in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order.

1 is a diagram schematically showing an art wall system 1000 according to an embodiment of the present invention, and FIGS. 2(A) and 2(B) show the art wall system 1000 of FIG. 1 implemented in an exhibition hall. indicate an example.

1 to 2(B), the art wall system 1000 includes an input unit 100, an extraction unit 200, a generation unit 300, a conversion unit 400, and an output control unit 500. can include

First, the input unit 100 may receive exhibition hall information from a manager.

Here, the exhibition hall information may include operation information including a demonstration place and demonstration time, and facility information including an art wall size or shape.

According to the embodiment, the input unit 100 may further include an image-text recognition module for recognizing text in an image when receiving exhibition hall information as an image from the manager terminal 10 through the manager service. For example, the manager service may be an app or program provided and installed in the previously registered manager terminal 10 .

Next, the extractor 200 may extract at least one open source image from a plurality of pre-collected open source images based on the exhibition hall information received through the input unit 100 .

When collecting a plurality of open source images, the extraction unit 200 may classify them in advance by category according to exhibition hall information and store and register them in a storage device.

Next, the generation unit 300 may generate a media file for art wall output using at least one open source video extracted through the extraction unit 200 .

Here, the media file for art wall output may be video content in which at least one open source video is edited at a preset resolution and converted into a file format supported by a preset project.

Depending on the embodiment, when generating a media file for art wall output, the generation unit 300 generates at least one open source video extracted through the extraction unit 200 based on a parameter analyzed in a specific output screen area. The output order of one open source video can be arranged sequentially.

Here, the parameters include content volume, pitch, playback speed, richness of sound, depth, echo, thickness, vibration, realistic effect, surround effect, sense of space, chord, chord and accompaniment, display area on the display, display color, It may include at least one of saturation, brightness, contrast, transparency, focus, power, power consumption, and type of content.

For example, the generation unit 300 outputs at least one open source image according to the size of the contrast value analyzed in a specific output screen area analyzed in the at least one open source image extracted through the extraction unit 200. The order can be sorted sequentially.

Next, the conversion unit 400 may convert the media file for art wall output generated by the generation unit 300 into contents for a projector through a projection mapping program, based on the size of the art wall confirmed from the exhibition hall information.

Here, the content for the projector may have a different resolution and an image format different from the media file for art wall output. In this case, the projection mapping program may be Mad Mapper.

For example, as shown in FIG. 2(A) and FIG. It means a wall, digital picture frame or screen provided in, and the size of the art wall can be formed in different sizes and shapes for each exhibition hall.

Next, the output control unit 500 may separate and output projector content into audio and video through a plurality of output means 50_1 to 50_N arranged according to the type of art wall of the exhibition hall identified from the exhibition hall information.

For example, the output means (50_1 to 50_N) include projectors for image output, speakers for sound output, and lights for auxiliary image output, and are disposed in the corresponding exhibition hall and wired to the art wall system 1000. Or it can be connected wirelessly.

Depending on the embodiment, the output control unit 500 receives a video shared on a video sharing platform such as YouTube, Dailymotion, Twitch, Afreeca TV, TikTok, Kinolights, etc. based on the number of contents for the projector, and outputs a plurality of It can be output through means (50_1 to 50_N).

3 is a diagram schematically illustrating an art wall system 1000_1 according to another embodiment of the present invention.

Referring to FIG. 3, the art wall system 1000 includes an input unit 100, an extraction unit 200, a generation unit 300, a conversion unit 400, an output control unit 500, and a camera unit 600. can include Hereinafter, redundant descriptions of the input unit 100, the extraction unit 200, the generation unit 300, the conversion unit 400, and the output control unit 500 of the same member number described in FIG. 1 will be omitted below. .

First, the camera unit 600 is communicatively connected to the output control unit 500 and is spaced apart in the exhibition hall, and provides the viewer image obtained by periodically photographing the viewer watching the contents for the projector to the output control unit 500. can do.

The camera unit 600 may include a PTZ camera whose shooting direction is adjusted according to a control signal transmitted through the output control unit 500 .

Depending on the embodiment, the output control unit 500, according to the preset number of visitors detected from the visitor image captured through the camera unit 600, while the contents for the projector are stopped for a certain period of time, the output control unit 500 provides a function corresponding to object information of a certain ratio or more. Registered interest-inducing sounds and images may be output through the output means 50_1 to 50_N.

For example, if the object information of a certain percentage or more is a man in his twenties, the output control unit 500 outputs images and popular songs preferred by men in their twenties while the projector contents are stopped for a certain period of time. ), the contents for the projector can be re-outputted after being output for a certain period of time.

According to an embodiment, the output control unit 500 outputs a feedback effect sound corresponding to a specific motion to the projector based on a specific motion of a specific object located in a certain area identified from the viewer image captured through the camera unit 600. It can be output by assigning it to the content.

According to another embodiment, the output control unit 500 is based on a change in the average separation distance between the plurality of visitors and the art wall 20 of the exhibition hall identified from the visitor image captured through the camera unit 600, You can automatically adjust the magnification and reduction ratio for the content.

For example, when the average separation distance decreases, the output control unit 500 may enlarge the content for the projector in proportion to the rate at which the average separation distance decreases. In addition, when the average separation distance increases, the output control unit 500 may decrease the content for the projector in proportion to the rate at which the average separation distance increases.

According to another embodiment, when the output control unit 500 separates the contents for the projector into audio data and video data and outputs them, the captured image taken toward the art wall for a certain period of time through the camera unit 600 and the conversion unit ( 400), it is possible to adjust the sync between audio and video data by comparing the difference in audio sync between the contents for the projector converted.

According to another embodiment, the output control unit 500 may output English translation subtitles for audio provided from contents for a projector based on a foreign visitor object detected from a visitor image captured through the camera unit 600. there is.

4 is a diagram schematically illustrating an art wall system 1000_2 according to another embodiment of the present invention.

Referring to FIG. 4, the art wall system 1000_2 includes an input unit 100, an extraction unit 200, a generation unit 300, a conversion unit 400, an output control unit 500, a camera unit 600, and A plurality of first and second sensors 710_1 to 710_N and 720_1 to 720_N may be included. Hereinafter, for the input unit 100, the extraction unit 200, the generation unit 300, the conversion unit 400, the output control unit 500 and the camera unit 600 having the same reference numbers described in FIGS. 1 to 3 Redundant descriptions will be omitted below.

First, the plurality of first sensors 710_1 to 710_N are communicatively connected to the output control unit 500, are spaced apart from each other at predetermined distances in the exhibition hall, and may measure bio signals of visitors located in a predetermined area. For example, the first plurality of sensors 710_1 to 710_N include a laser sensor, an optical sensor, and an ultrasonic sensor, and may measure bio-signals of a visitor located in a certain area.

Next, the second plurality of sensors 720_1 to 720_N may be spaced apart from each other at predetermined distances in the exhibition hall to sense the environmental state of the exhibition hall. For example, the second plurality of sensors 720_1 to 720_N may include a smoke detection sensor, a carbon monoxide detection sensor, a temperature detection sensor, a motion detection sensor, a magnetic sensor, a measurement detection module, and a damping module.

Depending on the embodiment, the output control unit 500 may automatically adjust the parameters of the content for the projector based on the biological signals of the viewer measured through the first plurality of sensors 710_1 to 710_N.

According to an embodiment, the output control unit 500 outputs responsive content assigned to projector content when the biosignal of the viewer is less than a predetermined value, based on response information obtained through a microphone (not shown). Thus, it is possible to determine the atmospheric state for each stage.

At this time, when the atmosphere state by step is less than the predetermined level, the output control unit 500 may temporarily stop the contents for the projector and output a healing content image that induces psychological stability as a substitute.

On the other hand, when the atmospheric condition for each stage is equal to or greater than the predetermined level, the output control unit 500 overlays the video of the visitor captured through the camera unit 600 and the voice recognized through a microphone (not shown) provided in the exhibition hall to the contents for the projector. It can be synthesized and output.

In addition, when the environmental state of the exhibition hall sensed through the second plurality of sensors 720_1 to 720_N is a predetermined environmental state such as an earthquake or fire, the output control unit 500 stops outputting contents for the projector and at the same time Through the output means 10_1 to 10_N, it is possible to output an alert broadcast along with guidance on an evacuation route.

FIG. 5 is a block diagram showing the output controller 500 of FIG. 3 in detail.

Referring to FIGS. 3 and 5 , the output control unit 500 may include a frame collection unit 510 , a learning unit 520 , a determination unit 530 and a pre-processing unit 540 .

First, the frame collection unit 510 may classify frames for diagnosis randomly extracted from copyrighted image content and harmful content and collect them in advance.

Next, the learning unit 520 may learn an artificial intelligence-based ablation image diagnosis model by learning diagnostic frames through machine learning.

Here, the artificial intelligence-based removal image diagnosis model takes diagnostic frames as inputs, and outputs values corresponding to copyrighted image contents and harmful contents as outputs. An artificial neural network (ANN) learned through machine learning can be

That is, the artificial intelligence-based transform factor derivation algorithm may be any one of an artificial neural network, a support vector machine (SVM), a decision tree, and a random forest. there is.

For example, an artificial neural network is a statistical learning algorithm that is mainly used in deep learning and is inspired by neural networks in machine learning and biology, and may be a convolutional neural network including a feature extraction neural network and a classification neural network. At this time, the convolutional neural network is a type of deep feed-forward artificial neural network used to analyze visual images, and can be divided into processes of extracting features of images and classifying them, and extracting and extracting features of specific images. Images can be recognized based on their features.

Specifically, the feature extraction neural network proceeds by sequentially stacking the convolution layer and the pooling layer on the input signal. The convolution layer contains convolution operations, convolution filters, and activation functions. The calculation of the convolution filter is adjusted according to the matrix size of the target input, but a 9X9 matrix is generally used. The activation function may generally use a ReLU function, a sigmoid function, a tanh function, and the like, but is not limited thereto. The pooling layer is a layer that reduces the matrix size of the input, and uses a method of extracting a representative value by grouping pixels in a specific area. In general, the average value or the maximum value is often used for the calculation of the pooling layer, but is not limited thereto. The operation is performed using a square matrix, and a 9X9 matrix is generally used. The convolutional layer and the pooling layer are alternately repeated until the corresponding input is sufficiently small while maintaining the difference.

Also, a classification neural network has a hidden layer and an output layer. Such a classification neural network generally includes 5 or more hidden layers, and the number of nodes in each hidden layer can be designated as 80, but it is possible to set more than 80 in some cases. The activation function of the hidden layer uses a ReLU function, a sigmoid function, a tanh function, and the like, but is not limited thereto.

Next, the determination unit 530 determines each off-source image based on the output value derived by applying the frames for each open-source image sequentially detected from the contents for projector converted through the conversion unit 400 to the removed image diagnosis model. It is possible to determine whether to remove the source image.

Next, the pre-processing unit 540 determines which one of the open source images from the projector content before outputting the projector content through the output means 50_1 to 50_N when it is determined that any one of the open source images is removed. It is possible to remove one open source video and at the same time insert a healing content video into the contents for the projector.

In this specification, only a few examples of various embodiments performed by the present inventors are described, but the technical spirit of the present invention is not limited or limited thereto, and can be modified and implemented in various ways by those skilled in the art, of course.

100: input unit
200: extraction unit
300: generating unit
400: conversion unit
500: output control unit
1000: art wall system

Claims (9)

an input unit for receiving exhibition hall information from a manager;
an extractor extracting at least one open source image from a plurality of pre-collected open source images based on the exhibition hall information;
a content creation unit generating a media file for art wall output using the at least one open source video;
a conversion unit that converts the media file for outputting the art wall into contents for a projector through a projection mapping program, based on the size of the art wall identified from the exhibition hall information; and
An output control unit that separates and outputs projector content into audio and video data through a plurality of output means arranged according to the type of art wall of the exhibition hall identified from the exhibition hall information,
A camera unit connected to the output control unit and disposed in the exhibition hall, and providing a visitor image obtained by periodically photographing a visitor viewing the contents for the projector to the output control unit,
The output control unit outputs, through the output means, pre-registered interest-inducing sound and image corresponding to object information of a predetermined ratio or more while the contents for the projector are stopped for a predetermined period of time according to the predetermined number of visitors detected from the visitor image. make it,
The output control unit allocates and outputs a feedback effect sound corresponding to the specific operation to projector content based on a specific operation of a specific object located in a certain area identified from the viewer image,
The output control unit automatically adjusts the enlargement and reduction ratio of the contents for the projector based on the change in the average separation distance between the plurality of visitors identified from the visitor image and the art wall of the exhibition hall,
a first plurality of sensors communicatively connected to the output control unit, disposed at predetermined distances in the exhibition hall, and measuring bio-signals of visitors located in a predetermined area; and
Further comprising a second plurality of sensors disposed at predetermined distances in the exhibition hall to sense the environmental state of the exhibition hall for each zone;
The output control unit automatically adjusts parameters of the contents for the projector based on the biosignals measured through the first plurality of sensors,
The above parameters include content volume, pitch, playback speed, richness of sound, depth, resonance, thickness, vibration, immersive effect, surround effect, sense of space, chord, chord and accompaniment, display area on the display, color of the display, and saturation. , At least one of contrast, contrast, transparency, focus, power, power consumption, and type of content,
When the generating unit generates the media file for outputting the art wall, based on parameters analyzed in a specific output screen area of the at least one open source video, the output order of the at least one open source video is sequentially arranged, ,
The output control unit, when the bio-signal of the viewer is less than a predetermined value, outputs the responsive content assigned to the projector content, based on response information obtained through a microphone, determines the atmospheric state for each step,
When the atmospheric condition for each step is less than the preset level, the contents for the projector are paused and a healing content image for inducing psychological stability is replaced and output,
When the staged atmosphere is equal to or higher than the preset stage, the visitor image captured through the camera unit and the voice recognized through the microphone are synthesized and output in the form of an overlay to the content for the projector,
The output control unit includes a frame collection unit that classifies and collects frames for diagnosis randomly extracted from copyrighted image content and harmful content;
a learning unit that learns an artificial intelligence-based removal image diagnosis model by learning the diagnostic frames through machine learning;
a determination unit that determines whether to remove each open-source image based on an output value derived by applying frames of each open-source image sequentially detected from the contents for the projector to a removed image diagnosis model; and
When it is determined that any one open source image among the open source images is removed, a pre-processing unit for removing the one open source image from the projector content and at the same time inserting the healing content image into the projector content, ,
When the output control unit separates the contents for the projector into audio data and video data and outputs them, the audio sync difference between the captured image taken toward the art wall through the camera unit for a certain period of time and the contents for the projector converted through the conversion unit is determined. Compare and adjust the sync between audio and video data,
The output control unit outputs English translation subtitles for audio provided from the contents for the projector based on the foreign visitor object detected from the visitor image,
When the environmental state of the exhibition hall sensed through the second plurality of sensors is a preset environmental state such as an earthquake or fire, the output control unit stops outputting the content for the projector and simultaneously guides an evacuation route through the output means. and outputs an alarm broadcast,
The art wall system, wherein the output control unit receives an image shared on a video sharing platform based on the number of contents for the projector and outputs it through the plurality of output means.



delete delete delete delete delete delete delete delete

Images