KR20200121458A - Multi-Complex Multi-recognition Signage System - Google Patents

Abstract

The present invention relates to a convergence type and a multi-recognition signage system, and more specifically, to the convergence type and the multi-recognition signage system, which includes: a server; a recognition device for generating recognition information by photographing a user skeleton and face; an image output device which receives information from the server and outputs the information; at least one panel on which information output from the image output device is projected; and a moving device for fixing and moving the position of the panel, wherein the panel is formed with one of a screen, a sculpture, a VR (virtual reality) display, and an AR (augmented reality) display, thereby recognizing and analyzing users to provide customized contents for various types of users.

Description

Convergence type multi-recognition signage system {Multi-Complex Multi-recognition Signage System}

The present invention relates to a convergence-type multi-recognition signage system, and more specifically, provides customized content for various types of users by recognizing and analyzing users, and allowing users to directly participate in desired content. It relates to the recognition signage system.

Recently, the installation of digital signage, which is a display installed in public and commercial spaces, which is called the fourth screen after TV, PC, and mobile, is increasing.

Digital signage is an outdoor advertisement using a digital information display (DID) and is commonly found in places with a large floating population such as subway stations, bus stops, apartment elevators, and banks.

Most of these digital signages are controlled through a communication network of a control center of a service provider, and in this regard, “Korean Patent No. 10-0987653 Digital Signage System” has been disclosed.

However, most signages are only capable of one-way communication, or simple content selected by a small number of people at a fixed coordinate is output, so not only is it impossible to interact with the advertiser and the customer, but also a problem that the interest and interest of the user decreases. Are doing.

The present invention is invented to solve the above problems, and provides customized content for various types of users by recognizing and analyzing users, and a converged multi-recognition signage system that allows users to directly participate in desired content. Its purpose is to provide.

In order to solve the above problems, the convergence type multiple recognition signage system of the present invention includes a server; A recognition device for generating recognition information by photographing a user's skeleton and face; An image output device that receives information from the server and outputs it; At least one panel on which information output from the image output device is projected and a moving device for fixing and moving the position of the panel, wherein the panel includes a screen, a sculpture, a VR (virtual reality) display, and an AR (augmented reality) It may be characterized in that it is formed as one of the displays.

In addition, the server, a recognition information analysis module for generating analysis information by analyzing the characteristics of the recognition information; A cluster module for generating cluster information by clustering the analysis information according to characteristics; A content providing module for generating customized content information according to the cluster information, and a matching module for generating matching information by matching the identification information and the content information, wherein the matching module transmits the matching information to the image output device. It can be characterized by that.

In addition, the recognition information analysis module includes a type analysis module for generating type analysis information by analyzing a user's type, and a gaze analysis module for generating gaze analysis information by analyzing the user's gaze, and the cluster module, It may be characterized in that the analyzed recognition information is clustered according to the type analysis information and the gaze analysis information.

In addition, the recognition information analysis module further comprises a gesture analysis module for generating gesture analysis information by analyzing the user's gesture, and transmitting the gesture analysis information to a matching module, wherein the matching module includes: , Using the gesture analysis information, matching information in which the location of the content information is controlled may be generated.

In addition, the server further comprises a position control module for controlling the moving device by generating a position movement signal of the panel according to the customized content, the panel is moved up, down, left and right by the position movement signal. You can do it.

In addition, the fusion-type multi-recognition signage system further includes a lighting device for outputting lighting and a hydraulic device for spraying water, and the server includes an environment control module that controls lighting and water pressure according to the customized content. It may be characterized in that it further includes.

In addition, the fusion-type multi-recognition signage system may further include a fragrance implementation device in which a fragrance is implemented, and the server may further include a fragrance implementation module that implements a customized fragrance according to the content. .

In addition, the recognition device may generate memo information by recognizing the memo attached to the panel, and the server may further include a memo analysis module for generating memo analysis information by analyzing the memo information. have.

In addition, the memo analysis module may include an answer generation module for generating answer information by searching for an answer to a corresponding question when the memo analysis information is in question.

In addition, the panel may be formed of a plurality of screens, and in this case, customized content may be projected on the panel according to the cluster information, respectively.

In addition, the fusion-type multiple recognition signage system may further include one or more terminals that receive a control signal from a user and provide the received control signal to the server in real time.

According to the fusion-type multiple recognition signage system according to the present invention configured as described above, it is possible to provide customized content for various types of users.

In addition, the position of the panel for each content can be adjusted, and the user's interest and interest can be induced by using lighting and sound effects.

In addition, since the memo information is recognized, the memo content can be input by attaching the memo to the panel without the user inputting the memo content to a separate terminal or panel.

In addition, it is possible to provide a user-participating signage that allows users to directly participate in desired content.

1 is a block diagram of a fusion type multiple recognition signage system according to an embodiment of the present invention.
2 is a block diagram showing a server of a fusion type multiple recognition signage system according to an embodiment of the present invention.
3 is a block diagram showing a recognition information analysis module of a fusion-type multiple recognition signage system according to an embodiment of the present invention.
4 is a block diagram showing a memo analysis module of a fusion type multiple recognition signage system according to an embodiment of the present invention.
5A and 5B are exemplary diagrams showing panel movement of a fusion-type multi-recognition signage system according to an embodiment of the present invention.

Hereinafter, the description of the present invention with reference to the drawings is not limited to a specific embodiment, and various transformations may be applied and various embodiments may be provided. In addition, the content described below should be understood to include all conversions, equivalents, and substitutes included in the spirit and scope of the present invention.

In the following description, terms such as first and second are terms used to describe various elements, and their meanings are not limited thereto, and are used only for the purpose of distinguishing one element from other elements.

The same reference numbers used throughout this specification denote the same elements.

Singular expressions used in the present invention include plural expressions unless the context clearly indicates otherwise. In addition, terms such as "include", "include" or "have" described below are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification. It is to be construed and not to preclude the possibility of the presence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

Hereinafter, a fusion-type multi-recognition signage system according to a preferred embodiment of the present invention will be described in detail with reference to FIGS. 1 to 5.

1 is a block diagram of a fusion-type multi-recognition signage system according to an embodiment of the present invention, and FIG. 2 is a block diagram showing a server of a fusion-type multi-recognition signage system according to an embodiment of the present invention. Is a block diagram showing a recognition information analysis module of a fusion type multiple recognition signage system according to an embodiment of the present invention, and FIG. 4 is a memo analysis module of a fusion type multiple recognition signage system according to an embodiment of the present invention. 5A and 5B are exemplary diagrams illustrating panel movement of a fusion-type multiple recognition signage system according to an embodiment of the present invention.

As shown in Fig. 1, the fusion type multiple recognition signage system according to the embodiment of the present invention includes a server 10, a recognition device 20, an image output device 21, a panel 22, and a mobile device ( 23) may be included.

Recently, the installation of signage, which is a display installed in public and commercial spaces, which is called the fourth screen after TV, PC, and mobile is increasing. This signage is controlled through the communication network of the control center. Accordingly, only one-way communication is possible, resulting in a problem that the user's interest and interest are lowered.

Accordingly, in order to improve this, the present invention has been developed because there is a need for a fusion-type multi-recognition signage system capable of maximizing an advertisement effect by enabling two-way communication, that is, interaction with the user, and inducing interest of the user.

First, the server 10 may include a recognition information analysis module 100, a cluster module 101, a content providing module 102, and a matching module 103.

The recognition information analysis module 100 may generate analysis information by analyzing characteristics of the recognition information received from the recognition device 20.

In addition, the recognition information analysis module 100 may transmit the generated analysis information to the cluster module 101.

In addition, the recognition information analysis module 100 may include a type analysis module 1000 and a gaze analysis module 1001.

The type analysis module 1000 generates type analysis information by analyzing a user's type among the recognition information received from the recognition device 20, and in more detail, may analyze the user's age and gender.

In addition, the type analysis module 1000 may transmit the generated type analysis information to the cluster module 101.

The gaze analysis module 1001 analyzes the user's gaze among the recognition information received from the recognition device 20 to generate gaze analysis information, and in more detail, it is possible to analyze whether the user is watching the signage. .

Accordingly, users who are interested in signage can be identified.

In addition, the gaze analysis module 1001 may transmit the generated gaze analysis information to the cluster module 101.

In addition, the gaze analysis module 1001 may transmit the generated gaze analysis information to the matching module 103 in order to control the output position of the content information according to the gaze of the user. This will be described in more detail below.

In addition, the recognition information analysis module 100 may further include a gesture analysis module 1002.

The gesture analysis module 1002 may generate gesture analysis information by analyzing a user's gesture among recognition information received from the recognition device 20.

In addition, the gesture analysis module 1002 may transmit the generated gesture analysis information to the matching module 103.

In more detail, matching information is controlled according to a user's gesture, which will be described in more detail below.

The clustering module 101 selects user information that is watching the signage among the gaze analysis information received from the gaze analysis module 1001, and then clusters it based on the type analysis information received from the type analysis module 1000. Cluster information for each characteristic can be created.

In more detail, for example, according to the user's age and gender, group information for each type group, such as a family unit (adult male and female + child), a friend unit (multiple males and females of the same age group), and a couple unit, may be generated.

The content providing module 102 generates content information according to the cluster information received from the cluster module 101, and accordingly, can provide customized content according to the cluster information.

In addition, the content providing module 102 includes a content information database, and more specifically, may include family content, infant content, youth content, historical content, natural environment content, board game content, and augmented reality content information. have.

However, since this is only an embodiment of the present invention, various types of content information applicable to signage may be included in addition to the above-described content.

In this case, it is preferable that the content information database is updated in real time to reflect the latest content.

In addition, the content providing module 102 may transmit content information to the matching module 103, the location control module 104, the environment control module 105, and the flavor implementation module 106.

The matching module 103 may receive recognition information from the recognition device 20, gaze analysis information from the gaze analysis module 1001, content information from the content providing module 102, and gesture analysis information from the gesture analysis module 1002. have.

At this time, the matching module 103 may generate matching information by matching the provided recognition information and content information, and may transmit the generated matching information to the image output device 21.

In addition, when generating the matching information, the matching module 103 may generate matching information in which the location of the content information is controlled using the received gaze information and gesture analysis information.

For example, face recognition information may be received from the recognition device 20, and mother and child content information may be received from the content providing module 102, matched to generate matching information, and transmitted to the image output device 21.

Thereafter, when receiving the gesture analysis information for removing the hat from the gesture analysis module 1002, matching information from which the hat content information matched with the face recognition information is removed may be generated and transmitted to the image output device 21.

Accordingly, it is possible to provide customized content information according to a user's gesture.

As another example, gaze analysis information may be received from the gaze analysis module 1001, and accordingly, matching information in which the location of content information is controlled may be transmitted to the image output device 21.

In addition, the matching module 103 may receive memo analysis information from the memo analysis module 107 and answer information from the answer generation module 1070.

Accordingly, the memo analysis information and the answer information may be matched with the previously generated matching information and transmitted to the image output device 21.

In addition, the server 10 may further include a position control module 104.

The location control module 104 may receive content information from the content providing module 102.

In addition, the position control module 104 may generate a position movement signal of the panel 22 according to the content information.

For example, when the content information is historical content, a position movement signal may be generated so that the upper and lower panels are moved left and right, respectively, as shown in FIG. 4A.

As another example, when the content information is natural environment content, a position movement signal may be generated so that the upper and lower panels are respectively moved up and down, as shown in FIG. 4B.

In addition, the position control module 104 transmits the generated position movement signal to the moving device 23, and accordingly, controls the position movement of the moving device 23 to move the panel 22 up, down, left and right. .

In addition, the server 10 may further include an environment control module 105.

The environment control module 105 may generate an environment control signal for controlling the lighting device 24 and the hydraulic device 25 according to the content information.

For example, when the content information is for children, an environment control signal may be generated so that colorful lights are output and water pressure in the form of a fountain is sprayed.

Accordingly, not only can the user be immersed in the content, but also has an effect of increasing interest.

Further, the environment control module 105 may transmit the generated environment control signal to the lighting device 24 and the hydraulic device 25.

In addition, the server 10 may further include a flavor implementation module 106.

The fragrance implementation module 106 may generate a fragrance implementation signal that implements a customized fragrance according to the content information.

For example, when the content information is a natural environment (mountain) content, a scent realization signal may be generated so that a mountain sound is realized.

Accordingly, not only can the user be immersed in the content, but also has an effect of increasing interest.

In addition, the fragrance implementation module 106 may transmit the generated fragrance implementation signal to the fragrance implementation device 26.

In addition, the server 10 may further include a memo analysis module 107.

The memo analysis module 107 may receive memo information from the recognition device 20.

In addition, the memo analysis module 107 may analyze memo information to generate memo analysis information.

For example, the memo analysis information may be generated by recognizing a memo that the user wrote during a call. Accordingly, the user may not input the memo content to a separate terminal or the panel 22, but the memo content may be input by attaching the memo to the panel.

In addition, the memo analysis module 107 may be transferred to the memo analysis information matching module 103.

In addition, the memo analysis module 107 may include an answer generation module 1070.

When the answer generation module 1070 is connected to the Internet and the memo analysis information is of a question type, it may search for an answer to a corresponding question and generate answer information.

For example, when the content of the memo written in the memo information is “What is the capital of our country?”, “Seoul”, an answer to the question, may be generated as the answer information.

Accordingly, the user can solve the curiosity by attaching a memo to the panel without searching after entering a question in a separate terminal.

In addition, the answer generation module 1070 may transmit the answer information to the matching module 103.

Next, the recognition device 20 may generate recognition information by photographing the user's skeleton and face.

At this time, the recognition device 20 may transmit the generated recognition information to the recognition information analysis module 100 and the matching module 103.

Also, the recognition device 20 may generate memo information by recognizing the memo attached to the panel 22.

At this time, the recognition device 20 may transmit the generated memo information to the memo analysis module 107.

Accordingly, the memo attached by the user may be automatically input into the panel 22.

Next, the image output device 21 may receive matching information from the matching module 103.

In addition, the image output device 21 may output matching information and project it onto the panel 22.

In addition, the image output device 21 may project matching information onto a tactile element in order to stimulate the user's five senses.

For example, the content information may be projected onto the surface of a sculpture formed of a transparent acrylic box provided on the front surface of the panel 22 to exhibit a three-dimensional effect.

However, since this is only an embodiment of the present invention, content information can be projected onto various elements such as milk, oil, and flour.

Next, the panel 22 projects information output from the image output device 21, and may be formed of one of a screen, a touch screen, a sculpture, a VR (virtual reality) display, and an AR (augmented reality) display.

For example, the panel 22 is formed of a plurality of touch screens, and customized matching information may be projected on the panel 22 according to the cluster information, respectively.

Accordingly, it is possible to simultaneously satisfy various groups by simultaneously providing customized content to various groups of users.

In this case, in order to stimulate the user's sense of touch, the touch screen may be formed of a material having various tactile senses.

In addition, the moving device 23 may move and fix the position of the panel 22 by the position moving signal transmitted from the position control module 104.

In more detail, the moving device 23 may be formed in the form of a rail or a rope in order to move the position of the panel 22 up, down, left and right.

In addition, the fusion type multiple recognition signage system according to the embodiment of the present invention may further include a lighting device 24 and a hydraulic device 25.

The lighting device 24 receives an environment control signal from the environment control module 105, and accordingly, can output customized lighting for each content and spray water.

In addition, the fusion type multi-recognition signage system according to an embodiment of the present invention may further include a fragrance implementation device 26.

The fragrance realization device 26 receives a fragrance realization signal from the fragrance realization module 106, and accordingly, can implement a customized fragrance for each content.

In addition, the fusion type multiple recognition signage system according to an embodiment of the present invention may further include one or more terminals 30.

The terminal 30 may be formed of one of a mobile type (mobile phone, pad, tablet, etc.) and a desktop capable of connecting to a WIFI or a communication network (3G/4G).

In addition, the terminal 30 may receive a control signal from a user, and provide the received control signal to the server 10 in real time to control the fusion type multiple recognition signage system of the present invention.

For example, by controlling the content providing module 102, the user can select the desired content, and the user can directly participate in the desired content such as augmented reality content and board game content.

Accordingly, user participation type signage can be provided.

As another example, by controlling the content providing module 102, the user's desired content may be projected onto the panel 22.

In more detail, from among various types of content applicable to the signage of the content providing module 102, the user may select a desired content and transmit the corresponding content information to the matching module 103.

In addition, image effects such as distortion, mirror, and wave effects may be added to the content desired by the user of the content providing module 102.

In addition, the matching module 103 may be controlled so that the image effect desired by the user is reproduced at a specific position of the panel 22.

In more detail, when the matching module 103 generates matching information, the matching information in which the location of the content information is controlled may be generated by using the position control signal of the video effect received from the terminal 30.

As another example, the recognition device 20 may be controlled to project a screen desired by the user on the panel 22.

In more detail, it is possible to control the zoom, direction, and resolution of the recognition device 20 to generate customized recognition information desired by the user, and transmit the generated customized recognition information to the content providing module 102.

Thereafter, the content providing module 102 may generate customized content information according to the received personalized recognition information, and may transmit it to the matching module 103.

Accordingly, the user can control information matched by the matching module 103, that is, information output from the image output device 21 and projected onto the panel 22.

However, since this is only an embodiment of the present invention, the fusion type multiple recognition signage system of the present invention can be controlled in various ways, such as controlling the movement of the panel 22 by controlling the position control module 104.

Although the embodiments of the present invention have been described above with reference to the accompanying drawings, it will be understood that the present invention can be implemented in other specific forms by those of ordinary skill in the art. Therefore, the embodiments described above are illustrative and non-limiting in all respects.

10: server
100: recognition information analysis module
1000: type analysis module
1001: gaze analysis module
1002: gesture analysis module
101: cluster module
102: content providing module
103: matching module
104: position control module
105: environment control module
106: fragrance implementation module
107: memo analysis module
1070: answer generation module
20: recognition device
21: image output device
22: panel
23: moving device
24: lighting device
25: hydraulic device
26: fragrance implementation device
30: terminal

Claims (11)

In the convergence type multiple recognition signage system,
server;
A recognition device for generating recognition information by photographing a user's skeleton and face;
An image output device that receives information from the server and outputs it;
At least one panel on which information output from the image output device is projected, and
Including a moving device for fixing and moving the position of the panel,
The panel,
Convergence type multi-recognition signage system, characterized in that it is formed of one of a screen, a touch screen, a sculpture, a VR (virtual reality) display, and an AR (augmented reality) display.
The method of claim 1,
The server,
A recognition information analysis module for generating analysis information by analyzing characteristics of the recognition information;
A cluster module for generating cluster information by clustering the analysis information according to characteristics;
A content providing module that generates customized content information according to the cluster information, and
Further comprising a matching module for generating matching information by matching the recognition information and content information,
The matching module,
Convergence type multiple recognition signage system, characterized in that transmitting the matching information to an image output device.
The method of claim 2,
The recognition information analysis module,
A type analysis module that analyzes the user's type and generates type analysis information, and
And a gaze analysis module for generating gaze analysis information by analyzing the gaze of the user,
The cluster module,
Convergence type multiple recognition signage system, characterized in that clustering the analyzed recognition information according to the type analysis information and gaze analysis information.
The method of claim 2,
The recognition information analysis module,
Further comprising a gesture analysis module for analyzing the user's gesture to generate gesture analysis information, and transmitting the gesture analysis information to a matching module,
The matching module,
When generating the matching information, the convergence type multiple recognition signage system, characterized in that generating matching information in which the location of the content information is controlled using the gesture analysis information.
The method of claim 2,
The server,
Further comprising a position control module for controlling the moving device by generating a position movement signal of the panel according to the content information,
Convergence type multiple recognition signage system, characterized in that the panel is moved up, down, left and right by the position movement signal.
The method of claim 2,
The convergence type multiple recognition signage system,
A lighting device that outputs lighting, and
Further comprising a hydraulic device to which water is sprayed,
The server,
Convergence type multi-recognition signage system further comprising an environment control module for controlling lighting and water pressure according to the content information.
The method of claim 2,
The convergence type multiple recognition signage system,
Further comprising a fragrance implementation device in which fragrance is implemented,
The server,
Convergence type multi-recognition signage system further comprising a fragrance realization module that implements a customized fragrance according to the content information.
The method of claim 1,
The recognition device,
Recognizes the memo attached to the panel to generate memo information,
The server,
Convergence type multiple recognition signage system further comprising a memo analysis module for analyzing the memo information to generate memo analysis information.
The method of claim 8,
The memo analysis module,
Convergence type multi-recognition signage system comprising an answer generation module for generating answer information by searching for an answer to a corresponding question when the memo analysis information is questionable.
The method of claim 2,
The panel,
It is formed by multiple screens,
At this time, the convergence type multiple recognition signage system, characterized in that the customized content is projected on the panel according to the cluster information, respectively.
The method of claim 1,
Convergence type multiple recognition signage system,
Convergence type multiple recognition signage system further comprising at least one terminal receiving a control signal of a user and providing the received control signal to the server in real time.

Images