KR102316733B1 - Intelligent led nameplate display board with voice recognition function - Google Patents

Abstract

The present invention relates to a nameplate electronic display board which includes: a nameplate case; a microphone which receives a user's command; a command processing unit which extracts information related to the user's personal information as text information from the command received by the microphone; and a display unit which constitutes one surface of the nameplate case and outputs the text information extracted from the command processing unit. The user's personal information is directly expressed without an external input means.

Description

Intelligent LED nameplate signage with voice recognition function {INTELLIGENT LED NAMEPLATE DISPLAY BOARD WITH VOICE RECOGNITION FUNCTION}

The present invention relates to a nameplate electric sign, and more particularly, to a nameplate electric sign capable of visually expressing the recognized voice by recognizing a user's voice.

Nameplates or nameplates have long been used as a means to inform others about me. Conventional nameplates are made using various materials such as wood and acrylic, and are used as a means of publicity or to indicate one's title in business and company organizations. Existing nameplates or nameplates have problems that it is impossible to change the engraved content or require cumbersome work, and thus an electronic nameplate that can easily change the contents of the nameplate or nameplate has been proposed.

In a conventional electronic nameplate, a text desired by a user is displayed on a display using a smart device or a PC connected to a wired or wireless network. However, the conventional electronic nameplate requires a process of installing an application on a smart device or PC, a process of connecting a wired or wireless network, etc. there was

As a prior patent related to electronic nameplates, Korean Patent Registration No. 10-1132653 discloses a monitoring system for nameplates for meetings and a control method thereof so that several electronic nameplates can be controlled by a central server. The above-mentioned prior patent documents can change text by receiving information from a central server connected to an electronic nameplate, and by interworking a display and a microphone to indicate whether the microphone is in use through the display, it is possible to distinguish the current presenter.

In the conventional case, it can be seen that an electronic nameplate in which a microphone is linked is disclosed, but in the prior patent, the microphone is a means for a user to use during a meeting, and the microphone is not disclosed as an input means of the electronic nameplate. Therefore, in the conventional electronic nameplate, text change is performed through a central server, so a process of accessing the terminal for text output is still required. Accordingly, the present applicant has devised a nameplate electric sign that can directly input the output information on the nameplate without going through a smart device or PC.

Korean Patent No. 10-1132653

An object of the present invention is to provide a nameplate electric signboard that enables the user's personal information to be written by voice recognition in a nameplate electric signboard, thereby simply expressing the user's personal information on a display without cumbersome work.

The present invention makes it possible to utilize a nameplate, which had no additional function other than the expression of a title, as a terminal for providing additional information such as contents, and furthermore, performs the function of interior lighting that can create an aesthetic feeling in a work environment, so that it can be utilized from various angles. We would like to provide a nameplate electric signboard.

In order to achieve the above object, the present invention provides a nameplate electric sign, comprising: a nameplate case; a microphone for receiving user commands; a command processing unit for extracting information related to the user's personal information as text information from the command input from the microphone; and a display unit that constitutes one side of the nameplate case and outputs the text information extracted from the command processing unit; including, characterized in that it directly expresses the user's personal information without an external input means.

Preferably, the command processing unit includes a keyword recognition module for classifying and recognizing sentences of commands input from the microphone into preset keyword phrases, and as the keyword phrases, personal information keywords, content keywords, message keywords, lighting keywords , or a category of the execution keyword may be set.

Preferably, the display unit, the output means is provided with an LED element, and the command processing unit, but classifies the sentence of the command input from the microphone into a preset keyword phrase and processes it, when the classified keyword phrase is a lighting keyword, By including an interior lighting control module that controls the display unit with variations in brightness, color, or light emission order of the LED elements, it can function as aesthetic lighting.

Preferably, the nameplate signboard according to the present invention may further include an application unit that is compatible with an application installed to receive a user's manipulation input to the user's mobile terminal or computer, and controls the display unit by the user's remote manipulation.

Preferably, it may further include a user voice identification unit that analyzes the voice of the command input from the microphone to extract voice features and compares the extracted voice features with the encrypted and stored voice features of the user.

According to the present invention, since the command processing unit extracts information related to the user's personal information from the user's voice as text information and displays it on the display, it is possible to simply express the user's personal information on the display without cumbersome work.

In addition, the present invention has an advantage in that the various control modules of the application unit or the command processing unit implement the function of content or interior lighting beyond the means of displaying the user's personal information, thereby increasing the utility of the nameplate.

1 shows a usage form and configuration diagram of a nameplate electric signage according to an embodiment of the present invention.
2 is a block diagram of an instruction processing unit according to an embodiment of the present invention.
3 is a conceptual diagram for explaining a function of a keyword recognition module according to an embodiment of the present invention.
4 shows a processing process of the personal information information control module according to an embodiment of the present invention.
5 shows a processing process of the content information control module according to an embodiment of the present invention.
6 shows a processing process of a message information control module according to an embodiment of the present invention.
7 shows an example in which a nameplate electric signboard according to an embodiment of the present invention is used as interior lighting.
8 shows an application for controlling an interior lighting control module according to an embodiment of the present invention.
9 is an embodiment of the user voice identification unit. FIG. 9 (a) shows a process of encrypting the user's voice characteristics, and FIG. 9 (b) shows a process of identifying the user's voice.

Hereinafter, the present invention will be described in detail with reference to the contents described in the accompanying drawings. However, the present invention is not limited or limited by the exemplary embodiments. The same reference numerals provided in the respective drawings indicate members that perform substantially the same functions.

Objects and effects of the present invention can be naturally understood or made clearer by the following description, and the objects and effects of the present invention are not limited only by the following description. In addition, in describing the present invention, when it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

1 shows a usage form and configuration diagram of a nameplate electric sign 10 according to an embodiment of the present invention. Referring to FIG. 1 , the nameplate billboard 10 includes a nameplate case 100 , a microphone 200 , a command processing unit 300 , a display unit 400 , an application unit 500 , a network connection unit 600 , and user voice identification. may include a portion 700 . The nameplate electric sign 10 according to the present embodiment can directly express the user's personal information without going through an external input means.

The nameplate electric sign 10 according to the present embodiment may be connected to a server, a user's computer, or a user's mobile terminal by wire or wirelessly. The server may be understood as an Internet environment for receiving information such as content, which will be described later, and when connected to a network environment on the user's computer, the user's computer environment may be used as a server without going through a separate server. The nameplate electric sign 10 may be network-connected to a user's mobile terminal, a smartphone, in a communication environment of Bluetooth or Wi-Fi or 4/5G, and the network environment with the mobile terminal is to implement a remote control function, which will be described later.

In FIG. 1, although the nameplate electric sign 10 according to the present embodiment is connected to various terminals/devices, it is not necessarily limited thereto, and even if it is not connected to any terminal/device illustrated in FIG. 1, the user's personal information is expressed and It may be implemented to enable control. This is because the user's voice is processed as an input means of the nameplate electric sign 10, which will be described later. The nameplate electric sign 10 according to this embodiment does not need to go through a management program such as a separate application for controlling the nameplate electric sign 10 on the user's smartphone or computer, etc. Since it can be displayed directly, it is possible to reduce the hassle of using the nameplate. Hereinafter, the components of the nameplate electric sign 10 will be described in detail.

The nameplate case 100 refers to the appearance of the nameplate electric sign 10 according to the present embodiment. The nameplate case 100 may be a case or a frame in which components of the nameplate electric sign 10 to be described later are mounted. The nameplate case 100 may have an extended length in one direction for expressing the user's personal information and may have an exterior shape so that it can be mounted on the floor. The nameplate case 100 is configured with a display unit 400 on one surface, and may have a prismatic shape or a semicircular pillar shape, which is a general model of an existing nameplate. The nameplate case 100 according to the present embodiment is provided in the shape of a column extending in the horizontal direction, and both side surfaces are formed to be flat so that it can be mounted in the vertical direction. This is to give an aesthetic effect to the user's work environment by standing vertically when the nameplate electric sign 10 functions as an interior lighting mode, which will be described later.

The microphone 200 may receive a user's command. The microphone 200 may be configured to be built in the nameplate case 100 . Alternatively, the microphone 200 may be provided in a form connected to the nameplate case 100 as an external device. The microphone 200 may include a well-known configuration for amplifying a user's voice and removing noise.

The display unit 400 may constitute one surface of the nameplate case 100 and may output text information extracted from the command processing unit 300 .

The network connection unit 600 may allow the command processing unit 300 or the application unit 500 to connect to the Internet or a network by wire or wirelessly. The network connection unit 600 may use 4/5G or WiFi to wirelessly connect to the Internet or a network.

When connecting to the Internet or a network wirelessly using WiFi, the network connection unit 600 may automatically connect the Internet or a network in an environment with WiFi. The network connection unit 600 may search for an SSID by scanning a WiFi signal in order to automatically connect to the Internet or a network in an environment with WiFi. The network connection unit 600 may classify the SSID according to the signal strength of the searched SSID signal. The network connection unit 600 may classify SSIDs having excellent signal strength in order and then classify them according to a security method. The network connection unit 600 may list and store a location value, an SSID, or a signal strength value when WiFi is connected at least once. The network connection unit 600 may connect first if the data of the listed WiFi connection information and the data value of the searched WiFi connection information are the same.

The command processing unit 300 may extract information related to the user's personal information as text information from the command input from the microphone 200 . 2 is a block diagram of a command processing unit 300 according to an embodiment of the present invention. Referring to FIG. 2 , the command processing unit 300 includes a keyword recognition module 310 , a personal information control module 330 , a content information control module 350 , a message information control module 370 , and an interior lighting control module 390 . ) may be included. The command processing unit 300 according to an embodiment of the present invention includes modules of four different control modes. Among them, the personal information information control module 330 displays personal information of titles and names without interworking with a separate external device in consideration of the inconvenience of nameplates that must be operated through separate management applications and management programs. It becomes a processing means to directly express to the unit 400 .

Unlike the personal information control module 330 , the content information control module 350 , the message information control module 370 , and the interior lighting control module 390 do not necessarily have to be mounted under the configuration of the command processing unit 300 , The embodiment of FIG. 2 may be understood as an embodiment for indicating that additional functions such as content, message, and interior mode other than personal information can also be performed through voice recognition.

The command processing unit 300 is largely divided into a recognition step of recognizing the user's voice as a command, and a control step of analyzing and controlling the recognized command. The recognition step may be performed through the keyword recognition module 310 , and the control step may be performed by a control module configured for each function provided by the nameplate electric sign 10 .

3 is a conceptual diagram for explaining the function of the keyword recognition module 310 according to an embodiment of the present invention. Referring to FIG. 3 , the keyword recognition module 310 may classify and recognize a sentence of a command input from the microphone 200 into a preset keyword phrase.

The keyword recognition module 310 may classify and recognize a sentence of a command input from the microphone 200 into a preset keyword phrase using an artificial intelligence algorithm. The artificial intelligence algorithm may be used as a supplementary means to solve the problem that the keyword recognition rate is lowered according to the pronunciation or sentence structure of the user. (10) can be applied to accurately infer the user's intention corresponding to the function provided.

The keyword recognition module 310 is a keyword phrase for classifying sentences of commands input from the microphone 200, and categories of personal information keywords, content keywords, message keywords, lighting keywords, or execution keywords may be set. The keyword recognition module 310 applies an artificial neural network-based neural network algorithm (DNN, CNN) to classify the command sentence into T1 and T2 divisions, and whether the keyword in each division is a keyword corresponding to personal information, You can determine whether it is a keyword or the like. The embodiment of FIG. 3 is an example of a simple sentence “Mark as Director Hong Gil-dong”, and is an embodiment consisting of two keyword phrases classified as T1 and T2. It is free even if it is classified by division.

In this embodiment, four keyword phrases are largely presented. Personal information keywords are categories of keywords that are a combination of name and position. The artificial intelligence applied to the keyword recognition module 310 may classify keywords of similar positions as personal information keywords when keywords of similar positions are included in the T1 or T2 classification through a pre-established database.

In the present embodiment, the keyword recognition module 310 may select a control mode by combining information of at least two keyword phrases in the keyword phrase classified in the user's command. The keyword recognition module 310 may transmit keyword information to the personal information information control module 330 only when there is an execution keyword corresponding to the personal information keyword of a name or job title and the condition in the case of the personal information keyword. Executable keyword phrases suitable for personal information keywords may include keywords of “display, expression, change”. The keyword recognition module 310 combines at least two syntax keywords so that the keyword recognition module 310 can accurately estimate the user's intention.

In this embodiment, when the keyword syntax is classified into personal information keywords, when the keyword recognition module 310 classifies the user command into the syntax of T1, T2, T3, T4, at least two T1 and T2 are 'names or titles' A case in which name and position keywords such as ' and the execution keyword of 'display, expression, or change' are combined can be classified as personal information keyword phrases.

In this embodiment, when the keyword phrase is classified into content keywords, when the keyword recognition module 310 classifies the user command into the phrases of T1, T2, T3, and T4, at least two T1 and T2 are 'weather, fine dust' A case in which keyword phrases related to ', temperature, humidity, date, or time' and execution keyword phrases of 'what time, what time, what time' are combined may be classified as content keyword phrases.

In this embodiment, when the keyword syntax is classified into message keywords, when the keyword recognition module 310 classifies the user command into the syntax of T1, T2, T3, T4, at least two T1 and T2 are 'Away, Out of Office' A case in which keyword phrases related to 'and execution keyword phrases of 'message, input, display, expression, change' are combined can be classified as message keyword phrases.

In this embodiment, when classifying keyword phrases into lighting keywords, when the keyword recognition module 310 classifies the user commands into phrases of T1, T2, T3, T4, at least two T1, T2 are 'interior, lighting, A case in which keyword phrases related to 'fire or light' and execution keyword phrases of 'mode, on, off, on, off' are combined can be classified as lighting keyword phrases.

4 shows a processing process of the personal information information control module 330 according to an embodiment of the present invention. Referring to FIG. 4 , the personal information information control module 330 categorizes and processes the sentences of the commands input from the microphone 200 by the command processing unit 300 into preset keyword phrases, but the classified keyword phrases are personal information keywords. In the case of , it is possible to control the personal information keyword to be converted into text and output to the display unit 400 .

When the keyword phrase T1 classified by the command processing unit 300 is a personal information keyword, the personal information information control module 330 receives the personal information related keyword T1 from the keyword recognition module 310 .

The personal information information control module 330 may analyze the personal information keyword to convert STT (Speech to Text). The personal information information control module 330 may store the STT converted TEXT and extract the stored TEXT. The personal information information control module 330 may control to output the extracted TEXT to the display unit 400 .

In this embodiment, when the user inputs a command "Mark as director Hong Gil-dong", the personal information information control module 330 converts the personal information keywords T1, 'Director' and 'Hong Gil-dong', to STT and stores it as TEXT. do. The personal information information control module 330 may extract the stored TEXT and control so that the TEXT called 'Move Hong Gil-dong' is output to the display unit 400 .

The personal information information control module 330 may control the user to include the color, spacing, or line break of text in the command, and reflect this so that the TEXT is output to the display unit 400 . In this embodiment, the personal information information control module 330 can control so that when the user inputs "Change the moving line and display it as Hong Gil-dong", the text is output to the display unit 400 as Hong Gil-dong in the first line and Hong Gil-dong in the next line. .

5 shows a processing process of the content information control module 350 according to an embodiment of the present invention. Referring to FIG. 5 , the content information control module 350 classifies and processes the sentence of the command input from the microphone 200 by the command processing unit 300 into a preset keyword phrase, but the classified keyword phrase T1 is the content In the case of a keyword, information of the corresponding content may be loaded from a server or a user's computer and controlled to be output on the display unit 400 .

The content information control module 350 may control to output the input content information to the display unit 400 when a content keyword T1 such as 'weather, fine dust, temperature, humidity, date, or time' is input. have. The content information control module 350 may output the content information to the display unit 400 alone or together with the user's personal information.

In the present embodiment, when the user inputs a command "display the current time", the content information control module 350 loads the 'current time' from the server or the user's computer and controls it to be output on the display unit 400 . can

6 shows a processing process of the message information control module 370 according to an embodiment of the present invention. Referring to FIG. 6 , the message information control module 370 classifies and processes the sentence of the command input from the microphone 200 by the command processing unit 300 into a preset keyword phrase, but when the classified keyword phrase is a message keyword , it is possible to control the message keyword to be converted into text and output to the display unit 400 .

The message information control module 370 may analyze the message keyword T1 classified by the command processing unit 300 to convert STT (Speech to Text). The message information control module 370 may store the STT converted TEXT and extract the stored TEXT. The message information control module 370 may control to output the extracted TEXT to the display unit 400 .

In the present embodiment, when the user inputs a command to "mark that you are away for a while", the message information control module 370 converts the message keyword T1, 'Away for a while' to STT, and stores it as TEXT. The message information control module 370 may extract the stored TEXT and control so that the TEXT 'off for a while' is output to the display unit 400 .

The interior lighting control module 390 classifies and processes the sentence of the command input from the microphone 200 by the command processing unit 300 into a preset keyword phrase, but when the classified keyword phrase is a lighting keyword, the display unit 400 can be controlled as the mode of interior lighting. In this embodiment, it is preferable that the output means of the display unit 400 is composed of an LED element.

When the classified keyword phrase is a lighting keyword, the interior lighting control module 390 may control the display unit 400 with variations in brightness, color, or light emission order of LED elements.

7 shows an example in which the nameplate electric sign 10 according to an embodiment of the present invention is used as interior lighting. Referring to FIG. 7 , the interior lighting control module 390 may be positioned around the monitor 13 on the desk to control the display unit 400 to function as interior lighting. The interior lighting control module 390 can extend the use range of the nameplate electric sign 10 to interior lighting beyond the simple information transfer function of the nameplate electric sign 10 .

In this embodiment, when the user inputs a command "turn on the light", the interior information control module 350 changes the brightness, color, or light emitting order of the LED element preset to function as an interior lighting mode. to control the display unit 400 . Here, the brightness, color, or light emission order of the LED element may be a mode set by the user through a separate management application 391 of FIG. 8 to be described later.

The interior lighting control module 390 may control the display unit 400 to have different brightness or color for each LED element according to a user's setting so that various types of lighting are created. The interior lighting control module 390 may control the display unit 400 to provide various esthetics by changing the light emission order for each LED element. The interior lighting control module 390 may control the display unit 400 by changing the brightness, color, or order of light emission of LED elements in accordance with the music rhythm generated by itself on the nameplate signboard 10 or externally generated.

In the interior lighting mode, the user may vertically erect the nameplate case 100 and mount it around the work environment. In the interior lighting mode, the display unit 400 may emit light to the LED element in the lighting environment instead of displaying the output of personal information, or may display a volume bar corresponding to the volume of the music of the work computer.

8 shows an application for controlling the interior lighting control module 390 according to an embodiment of the present invention. Referring to FIG. 8 , the application unit 500 may operate an application 391 installed in a user's mobile terminal or computer to manipulate brightness, color, or variation of light emission order.

The application unit 500 is compatible with the application 391 installed to receive a user's manipulation input to the user's mobile terminal or computer, and can control the display unit 400 by the user's remote manipulation.

The application unit 500 may store personal information information input by a user into an application installed on a mobile terminal or a computer as TEXT and extract the stored TEXT. The application unit 500 may control the extracted TEXT to be output to the display unit 400 .

When the user manipulates an application installed in a mobile terminal or computer to output content information, the application unit 500 may control the content information to be loaded from the server or the user's computer and output to the display unit 400 . When the user manipulates the device configured in the nameplate case 100 to output the content information, the application unit 500 may control the content information to be loaded from the server or the user's computer and output to the display unit 400 . have.

The application unit 500 may store the message content input by the user into the application installed on the mobile terminal or the computer as TEXT and extract the stored TEXT. The application unit 500 may control the extracted TEXT to be output to the display unit 400 .

The application unit 500 may allow a user to operate the nameplate electric sign 10 as an interior lighting by using an application installed on a mobile terminal or a computer. The application unit 500 may control the display unit 400 by changing the brightness, color, or light emission order of the LED element when an application installed in the user's mobile terminal or computer is operated. When the user operates the device configured in the nameplate case 100 so that the nameplate electric sign 10 operates as an interior lighting, the application unit 500 displays the brightness, color, or variation of the light emitting order of the LED element as a variation of the display unit 400 can control

The application unit 500 may function as the aforementioned personal information information control module 330 , the content information control module 350 , the message information control module 370 , and the interior lighting control module 390 . However, the application unit 500 recognizes a command input from the microphone 200 to control the display unit 400 by a personal information information control module 330 , a content information control module 350 , and a message information control module 370 . ), and unlike the interior lighting control module 390 , it is possible to control the display unit 400 by operating the user's mobile terminal or an application installed on the computer, or by operating the device configured in the nameplate case 100 .

9 is an embodiment of the user voice identification unit. FIG. 9 (a) shows a process of encrypting the user's voice characteristics, and FIG. 9 (b) shows a process of identifying the user's voice.

Referring to FIG. 9A , the user's voice identification unit 700 may receive the user's voice, analyze the voice, and extract voice features. The user voice identification unit 700 may analyze the frequency of the user's voice using a Mel-frequency cepstral coefficient (MFCC) technique and extract frequency characteristics. The user's voice identification unit 700 may use a recurrent neural network (RNN) to analyze and extract the user's voice. The user voice identification unit 700 may encrypt and store the extracted user's frequency voice characteristics.

Referring to FIG. 9 (b), the user voice identification unit 700 analyzes the voice of the command input from the microphone to extract voice features, and compares the extracted voice features with the encrypted and stored voice features of the user. have. The user voice identification unit 700 allows the input command to be transmitted to the command processing unit 300 as it is deemed authenticated as a user when the voice characteristic of the command input from the microphone 200 matches the voice characteristic of the user. The user voice identification unit 700 prevents the input command from being transmitted to the command processing unit 300 as it is deemed that the user has not been authenticated when the voice characteristics of the command input from the microphone 200 and the voice characteristics of the user do not match. .

The user voice identification unit 700 may prevent an unintended operation from occurring by recognizing only the user's command when an unspecified number of commands are input. The user's voice identification unit 700 encrypts the user's voice characteristics so that other people cannot operate the nameplate electric sign 10, thereby enhancing security.

Although the present invention has been described in detail through representative embodiments above, those of ordinary skill in the art to which the present invention pertains will understand that various modifications are possible within the limits without departing from the scope of the present invention with respect to the above-described embodiments. will be. Therefore, the scope of the present invention should not be limited to the described embodiments and should be defined by all changes or modifications derived from the claims and equivalent concepts as well as the claims to be described later.

10: nameplate electric sign
13: monitor
100: nameplate case
200: microphone
300: command processing unit
310: keyword recognition module
330: personal information information control module
350: content information control module
370: message information control module
390: interior lighting control module
391 : application
400: display unit
500: application part
600: network connection
700: user voice identification unit
T1 : keyword phrase 1
T2: keyword phrase 2

Claims (5)

nameplate case;
a microphone for receiving user commands;
a command processing unit for extracting information related to the user's personal information as text information from the command input from the microphone; and
Constructing one side of the nameplate case, and a display unit for outputting the text information extracted from the command processing unit;
The command processing unit,
and a keyword recognition module for classifying and recognizing sentences of commands input from the microphone into preset keyword phrases,
As the keyword phrase, categories of personal information keywords, content keywords, message keywords, lighting keywords, or execution keywords are set,
The command processing unit,
By combining at least two keyword categories including the execution keyword and classifying the user's command, text conversion is performed by classifying personal information [name][position] among commands uttered by the user,
Nameplate electric signage, characterized in that the degree of freedom of keyword processing is expanded so that personal information can be expressed based on the user's voice without using an external input means.
delete The method of claim 1,
The display unit,
The output means is provided with an LED element,
The command processing unit,
Classify and process the sentences of the commands input from the microphone into preset keyword phrases,
When the classified keyword phrase is a lighting keyword, including an interior lighting control module for controlling the display unit with variations in brightness, color, or light emission order of the LED elements,
Nameplate electric sign, characterized in that it functions as an aesthetic lighting.
The method of claim 1,
Compatible with the application installed to receive the user's operation input to the user's mobile terminal or computer,
The nameplate signboard further comprising an application unit for controlling the display unit by a user's remote operation.
The method of claim 1,
The nameplate signboard further comprising a user voice identification unit that analyzes the voice of the command input from the microphone to extract voice features and compares the extracted voice features with the encrypted and stored voice features of the user.

Images