KR102142034B1 - Authentication and security system for the disabled - Google Patents

Abstract

According to an embodiment of the present invention, an authentication and security system in consideration of a disabled person comprises a call bell, a user terminal, a host terminal, and a server. The call bell is installed at an entrance of a place blocking access of a visitor for security setting, and transmits a beacon signal to the user terminal existing within a preset distance. The user terminal receives the beacon signal from the call bell and thus, automatically executes a pre-installed security application and transmits a call request signal for the host terminal and member information on a user to the server through the security application. The server transmits the call signal to a host device corresponding to a call signal when receiving the call signal from the user terminal, supports a communication connection of the host terminal, determines whether a user is a disabled person required for a sign language interpretation on the basis of the member information on the user, and can perform a three-party call function by including the user terminal, the host terminal, and a sign language interpretation center when it is determined that the sign language interpretation is required. The present invention solves inconvenience of disabled visitors using sign language and supports good communication.

Description

Authentication and security system for the disabled

The present invention relates to an authentication and security system considering a disabled person.

Common entrances such as apartments and officetels are normally closed, and in order for outsiders to enter the building, certain households must be called through the lobby phone to connect calls and request door opening.

In addition, a blocking bar is installed at the entrance that controls the entry of external vehicles, and visitors must request the opening of the blocking bar by talking to the control room by pressing the call bell provided near the blocking bar. When arriving at the doorway using a vehicle, there is also the inconvenience of having to get out of the vehicle to press the call bell or to approach the vehicle very close to the call bell. As such, most buildings are often equipped with a security system so that they can enter the building without permission from the host.

However, in the case of persons with disabilities, including people with speech impairments, even if they try to get approval from the administrator to enter the building for good reason, communication with the host is difficult, which causes a lot of inconvenience. In order to solve such a problem, a security system considering a disabled person is required.

An object of the present invention is to provide a call system that enables a call with each generation or manager using a call bell that transmits a beacon signal and a smart device carried by a visitor.

In addition, the present invention is intended to solve the inconvenience of visitors with disabilities using sign language and to support smooth communication in using a security system that blocks outsiders from entering and allows visitors to enter the host after checking. .

In addition, the present invention is to use the security system that blocks the entry of outsiders and allows the host to enter the host after confirming it, identifies the visitor (from the administrator), receives authentication acceptance information, and authenticates the user's smart device. The purpose is to control access control, such as opening and closing the door.

An authentication and security system considering a disabled person according to an embodiment of the present invention includes a call bell, a user terminal, a host terminal, and a server, and the call bell is installed at a doorway of a place that blocks outsiders from entering for security settings. , Transmit a beacon signal to a user terminal existing within a predetermined distance, and the user terminal automatically executes a pre-installed security application upon receiving the beacon signal from the call bell, and the host to the server through the security application The call request signal for the terminal and the user's member information are transmitted, and when the server receives the call signal from the user terminal, the server transmits the call signal to the host device corresponding to the call signal and supports communication connection of the host terminal. However, based on the user's member information, it is determined whether a sign language interpreter is required by determining whether a sign language interpreter is required, and a third party call function including a sign language interpretation center in the user terminal and the host terminal You can do

The present invention can provide a call system that enables a call with each household or manager using a call bell that transmits a beacon signal and a smart device carried by a visitor.

In addition, the present invention has an effect of resolving the inconvenience of visitors with disabilities using sign language and supporting smooth communication in using a security system that blocks outsiders from entering and allows visitors to enter the host after checking.

1 is a view showing the configuration of a security system considering a disabled person according to an embodiment of the present invention.
2 is a view showing the configuration of a user terminal according to an embodiment of the present invention.
3 is a view showing the configuration of a server according to an embodiment of the present invention.
4 is a diagram showing the configuration of a personalized expression generating unit according to an embodiment of the present invention.
5 is a diagram illustrating an example of a personalized expression registration operation according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating a process for disability authentication and customized service support according to an embodiment of the present invention.

Advantages and features of the present invention, and methods for achieving them will be clarified with reference to embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present invention to be complete, and are common in the technical field to which the present invention pertains. It is provided to fully inform the skilled person of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terminology used herein is for describing the embodiments and is not intended to limit the present invention. In the present specification, the singular form also includes the plural form unless otherwise specified in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components other than the components mentioned. Throughout the specification, the same reference numerals refer to the same components, and “and/or” includes each and every combination of one or more of the components mentioned. Although "first", "second", etc. are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used in a sense that can be commonly understood by those skilled in the art to which the present invention pertains. In addition, terms that are defined in a commonly used dictionary are not ideally or excessively interpreted unless specifically defined.

The term "part" or "module" as used in the specification means a hardware component such as software, FPGA or ASIC, and "part" or "module" performs certain roles. However, "part" or "module" is not meant to be limited to software or hardware. The "unit" or "module" may be configured to be in an addressable storage medium or may be configured to reproduce one or more processors. Thus, as an example, “part” or “module” means components such as software components, object-oriented software components, class components and task components, processes, functions, attributes, Includes procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays and variables. The functionality provided within components and "parts" or "modules" can be combined into a smaller number of components and "parts" or "modules" or into additional components and "parts" or "modules" Can be further separated.

The spatially relative terms “below”, “beneath”, “lower”, “above”, “upper”, etc., are as shown in the figure. It can be used to easily describe a correlation between a component and other components. The spatially relative terms should be understood as terms including different directions of components in use or operation in addition to the directions shown in the drawings. For example, if a component shown in the drawing is turned over, a component described as "below" or "beneath" of another component will be placed "above" of the other component. Can. Thus, the exemplary term “below” can include both the directions below and above. The component can also be oriented in other directions, so that spatially relative terms can be interpreted according to the orientation.

In the present specification, the user equipment refers to all kinds of personalized hardware devices including at least one processor, and may be understood as a meaning encompassing software configurations operating in the corresponding hardware devices according to embodiments. For example, a user device may be understood as meaning including, but not limited to, a smartphone, a tablet PC, a wearable device, and a user client and an application running on each device.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing the configuration of a security system considering a disabled person according to an embodiment of the present invention.

The security system considering the disabled according to an embodiment of the present invention may include a user terminal 100, an app server (hereinafter referred to as a server) 200, a call bell 300, a host terminal 400, and a sign language interpretation center 500.

A security system considering a disabled person according to an embodiment of the present invention may be used to perform an outsider's call function, security function, etc. in an apartment house, such as an apartment, and the call bell is a conventional doorbell function used in existing residential facilities. It can be done.

The security system according to an embodiment of the present invention transmits a beacon signal to a server 200 controlling a call function, a user terminal 100 approaching within a predetermined distance, or a user terminal 100 within a predetermined distance as one button input is detected. Install a call function 300 and a call function related application supported by the server 200 to transmit a beacon signal, and as a beacon signal is received from the call bell 300, display a call request screen corresponding to the call bell 300 from the server 200. When a call signal is inputted from the user terminal 100 and the user terminal 100 to be displayed, the host terminal 400 may receive the call signal through the server 200. The host terminal 400 may include a smart phone registered with a host account, a wall pad in a building, and the like.

The server 200 transmits a call signal to the host terminal 400 according to a user's call signal, and when the host terminal 400 transmits a response signal to the call signal, the server 100 makes a call between the host terminal 400 and the user terminal 100 It is possible to establish a connection or a corresponding communication connection.

According to various embodiments, the security system according to an embodiment of the present invention may be used in places and environments other than residential areas.

In addition, according to various embodiments, the security system may be designed to register a host account and a user account on the server 200. The server 200 may request a user to join the server 200 for use of the security system, and may also register the user terminal 100 as a device to authenticate the identity of the user. According to various embodiments, the user may register his/her job and belonging information when registering as a member in case of frequent jobs such as a delivery person, a courier driver, a gas meter reader, and a domestic helper. . The registered job and affiliation information of the user can be automatically displayed on the screen of the host terminal 400 even if the user does not speak his information when calling through an application in the future.

According to an embodiment, the user terminal 100 may automatically execute a security application installed in the user terminal 100 when a beacon signal is received from a call bell 300 installed at a doorway such as a residence or a company to restrict outside access. In addition, the user terminal 100 may perform a member login to the server 200 through user information (eg, ID, biometric information, etc.) held by the user terminal 100.

Also, the server 200 may receive information related to a failure from a user. The present invention may automatically perform a sign language interpretation function or a volume setting value change operation when the user is a disabled person requiring sign language interpretation. To this end, the server 200 may request to register information on whether a person is disabled or disabled when registering a member of a user.

2 is a view showing the configuration of a user terminal according to an embodiment of the present invention.

As illustrated in FIG. 2, the user terminal 100 according to an embodiment of the present invention may include a communication unit 110, a storage unit 120, a display unit 130, a sensor unit 140, a camera unit 150, an audio processing unit 160, and a control unit 170 have.

The communication unit 110 may use a network for data transmission and reception between the server 200 and the call bell 300, and the type of the network is not particularly limited. The network may be, for example, an Internet Protocol (IP) network that provides a large data transmission/reception service through an Internet Protocol (IP) or an All IP network that integrates different IP networks. In addition, the network is a wired network, a Wibro (Wireless Broadband) network, a mobile communication network including WCDMA, a High Speed Downlink Packet Access (HSDPA) network and a mobile communication network including a Long Term Evolution (LTE) network, LTE advanced (LTE-A) ), a mobile communication network including 5G (Five Generation), a satellite communication network and a Wi-Fi network, or at least one or more of them.

The communication unit 110 according to an embodiment of the present invention may receive a beacon signal transmitted by the call bell 300 when a predetermined condition is satisfied. In addition, the communication unit 110 may transmit and receive a radio signal to the server 200. Specifically, the communication unit 110 is information for notifying the user when the user (eg, a visitor who wants to access the entrance of the apartment) calls the host terminal 400 through the user terminal 100 after the call bell is input (eg, the user's front image, voice, etc.) Can be sent to the server 200 side.

In addition, the communication unit 110 may receive interpretation result information from the server 200. Specifically, when a voice message is input from the host terminal 400, the communication unit 110 may receive an interpretation result interpreted in sign language from the server 200.

The storage unit 120 according to an embodiment of the present invention may store a security support application provided by the server 200. The storage unit 120 may store programs and commands related to a user's sign language input upon visitor authentication and entry request. According to various embodiments of the present disclosure, the storage unit 120 may store authentication information for authenticating that the visitor is disabled. Also, the storage unit 120 may store call request history information.

The display unit 130 according to an embodiment of the present invention may display a call request screen received from the server 200, and display information related to a call signal input by the user (eg, information about a lake to be called, lake information). . In addition, the display unit 130 may display a setting screen of an application that supports a call function, and when a communication connection with the host terminal 400 is established by a call operation, a screen related to a user's sign language operation input may be displayed. For example, the display unit 130 may display shooting information of a video to be transmitted to the host terminal 400.

For example, the sensor unit 140 may measure a physical quantity or sense an operating state of a watch, and convert the measured or sensed information into an electrical signal. The sensor unit 140 includes, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor (eg, a red (green, blue) sensor), a living body It may include at least one of a sensor, a temperature/humidity sensor, an illuminance sensor, or an ultra violet (UV) sensor. Additionally or alternatively, the sensor unit 140 may include, for example, an E-nose sensor, an EMG sensor (electromyography sensor), an EEG sensor (electroencephalogram sensor), an ECG sensor (electrocardiogram sensor), IR (infrared) sensor, iris sensor and/or fingerprint sensor. The sensor unit may further include a control circuit for controlling at least one sensor included therein.

The sensor unit 140 according to an embodiment of the present invention may include a biometric sensor for personal authentication. For example, the sensor unit 140 may include a fingerprint sensor, an iris sensor, and the like, and perform a user authentication operation for authentication of the disabled. In general, the host on the host terminal 400 side may request to speak information such as name, job, business, etc., in order to confirm the identity of the visitor (user). However, the deaf person cannot respond to the request. In preparation for such a case, an embodiment of the present invention may help the user perform authentication through an application when it is difficult for the user to authenticate himself/herself through training. In addition, the present invention can support to transmit information proving that the user is an authenticated user through the server 200 to the host terminal 400 side. In order to prove the authentication operation and the pre-authenticated user, the sensor unit 140 may sense the user's biometric information and perform the user authentication operation.

The camera unit 150 is, for example, a device capable of photographing still images and videos. According to an embodiment, one or more image sensors (eg, front sensors or rear sensors), lenses, and an image signal processor (ISP), Or a flash (eg, LED or xenon lamp, etc.).

The camera unit 150 according to an embodiment of the present invention may support a user to take a picture of a user signing when performing a three-way call (user terminal, host terminal, sign language interpretation center) through an application.

The audio processing unit 160 may convert, for example, a sound and an electric signal in both directions. At least some components of the audio processing unit may be included in the input/output interface. The audio processing unit may process sound information input or output through, for example, a speaker, a receiver, an earphone, or a microphone.

The audio processing unit 160 according to an embodiment of the present invention can be controlled to output various sounds including a call voice provided to the user terminal 100 through the server 200 from the host terminal 400 side, and also the user's voice data (including non-verbal voice) ). The audio processing unit 150 may control whether or not sound is output or a sound volume value in response to a user's type and degree of failure.

The controller 170 may also be referred to as a processor, a controller, a microcontroller, a microprocessor, or a microcomputer. Meanwhile, the control unit may be implemented by hardware or firmware, software, or a combination thereof.

In the case of implementation by firmware or software, an embodiment of the present invention may be implemented in the form of a module, procedure, function, etc. that performs the functions or operations described above. The software code can be stored in the memory and driven by the control unit. The memory may be located inside or outside the user terminal and the server, and may exchange data with the control unit by various means already known.

The control unit 170 according to an embodiment of the present invention may include a failure information management unit 171 and a language conversion support unit 172.

The failure information management unit 171 may acquire the user's failure information and store and manage the failure information. In addition, the failure information management unit 171 may acquire information about the type or degree of the user's failure. In addition, the failure information management unit 171 may determine whether there is a possibility that the degree of failure of the corresponding user is deteriorated based on the acquired information on the type of failure or the degree of failure of the user. The failure information management unit 171 provides a notification to periodically update the user's failure information when it is determined that the user's failure degree may deteriorate and it is necessary to change the setting value of one function in response to the degree of deterioration. And can support vision or hearing test functions. Thereafter, the failure information management unit 171 may update the user's failure information with a test result value.

According to an embodiment, the failure information management unit 171 stores the issued ID when the ID is issued as a result of performing the failure authentication from the server 200, and when the member authentication at the server 200 is required later, the issued ID information You can perform the member authentication operation by passing.

The language conversion support unit 172 may automatically select a form (at least one of text input, voice input, and sign language input) of receiving a doctor's input from the user based on the user's disability information.

According to an embodiment, the language conversion support unit 172 may drive a text to sound (TST) and sound to text (STT) program when the other party is not disabled to convert and display the intention of the disabled user to a non-disabled user. have.

In addition, according to various embodiments of the present disclosure, when the user (visitor) inputs sign language and transfers the intention to the host terminal 400 side, the language conversion support unit 172 interprets through the sign language interpretation center 500 and transmits the voice data to the host terminal 400. It can also be delivered to the terminal 100 side, which can be displayed as text by the STT operation. Through this, the user can confirm whether or not the intended content is properly delivered to the host terminal 400 side.

In addition, the language conversion support unit 172 determines whether or not a language conversion is required (eg, when a language conversion is not required using sign language at a host terminal), and whether a language conversion operation is in progress, and prompts the user I can guide you.

3 is a view showing the configuration of a server according to an embodiment of the present invention.

The server 200 according to an embodiment of the present invention may include a communication unit 210, a storage unit 220, a member characteristic management unit 230, a sign language interpretation service connection unit 240, an auxiliary information providing unit 250, and a personalized expression generation unit 260.

In addition, the personalized expression generation unit 260 may include an expression registration unit 261 and a sharing support unit 262.

The configuration of the server 200 will be described in more detail below.

The communication unit 210 of the server 200 may use a network to transmit and receive data between a user device and a server, and the type of the network is not particularly limited. The network may be, for example, an Internet Protocol (IP) network that provides a large data transmission/reception service through an Internet Protocol (IP) or an All IP network that integrates different IP networks. In addition, the network is a wired network, a Wibro (Wireless Broadband) network, a mobile communication network including WCDMA, a High Speed Downlink Packet Access (HSDPA) network and a mobile communication network including a Long Term Evolution (LTE) network, LTE advanced (LTE-A) ), a mobile communication network including 5G (Five Generation), a satellite communication network and a Wi-Fi network, or at least one or more of them.

The communication unit 210 of the present invention can perform wireless communication for a three-way call with a user terminal, a host terminal, and a pre-registered sign language interpretation center. In addition, the communication unit 210 may download emoticons, images, and the like related to sign language interpretation assistance through the web. The communication unit 210 may periodically receive and update member information (disability characteristic information and job information) transmitted from the user terminal 100.

The storage unit 220 of the present invention may store the user's member information (disability characteristic information, job information, etc.). The storage unit 220 may also store additional programs and commands required to perform a three-way call function. In addition, the storage unit 220 may store additional programs and commands required for inquiring member information of an external access person and authenticating an identity. In addition, the storage unit 220 may store programs and commands required to generate command signals for controlling one function of the user terminal for each type of failure.

In addition, the storage unit 220 of the present invention may store interpreting assistance function information (eg, whether to include subtitles, whether to adjust subtitle size, etc.) required for each individual user, personalized expression information registered by the user, and the like.

The member characteristic management unit 230 may perform an operation of managing characteristic information of users registered as members on the server 200 through an application. Specifically, the member characteristic management unit 230 may generate and manage main history information and pattern information of users registered as members.

According to an embodiment, the member characteristic management unit 230 may collect and manage a user's main visit history, host terminal call request history, interpretation assistance function usage history, personalized expression registration history, and the like. Specifically, the member characteristic management unit 230 may determine a user's calling function usage pattern based on the user's history. For example, the member characteristic management unit may calculate that a user has a pattern of visiting a specific building on a specific day of the week based on the user's history information. Based on the user's calling function usage pattern, the server 200 can automatically execute the security application on the user terminal without a call bell when the user calls the host terminal.

In addition, the member characteristic management unit 230 may generate the user's disability authentication information. For example, the member characteristic management unit 230 may perform a disability authentication procedure (eg, validation of an authorized disability authentication number, etc.) when a user requests to be registered as a member through an application. The member characteristics management unit 230 may perform an operation for registering a corresponding user as a member when the initial disabled authentication process is completed. The member characteristics management unit 230, when a user registered as a member uses the application, information on the characteristics of the obstacle, such as the degree of failure and type of failure, and the main utilization functions (eg, sign language interpretation function, subtitle setting function, etc.) Related member information can be retrieved. In response to this, the following components of the server 200 (Conversation Interpretation Service Connection, Auxiliary Information Provision, and Personalized Expression Generation) are three-way conversations based on pre-registered user characteristic information (conversation between user terminal, host terminal, and sign language interpretation center). Function, sign language interpretation service connection function, auxiliary information provision function, and personalized expression generation function.

The sign language interpretation service connection unit 240 may determine whether sign language interpretation is required in response to the user's disability information (degree of disability, type of disability). The sign language interpretation service connection unit 240 may extract failure information of the host based on the host account information of the host terminal 400 as well as the user, and the sign language interpretation service connection unit 240 includes at least one account of the user (visitor) and the host. If it is judged that the person with a disability is requested, sign language interpretation service may be requested from the sign language interpretation center.

According to various embodiments of the present disclosure, the sign language interpretation service connection unit 240 may perform a three-party call function including a user terminal 100 and a host terminal 400 and a sign language interpretation center 500.

The auxiliary information providing unit 250 may provide auxiliary information related to sign language interpretation. The auxiliary information providing unit 250 may, for example, download a result of searching for a specific sign language word specified by a user from a web server and provide it to the host terminal 400 side. Through this, the host terminal 400 may receive auxiliary information (eg, an image, a dictionary meaning, etc.) requested by the user from the server 200 and transmit it to the host so that the intention of the disabled user can be more clearly understood. At this time, the sign language word input by the user for the search may also be performed after being interpreted through the sign language interpretation center.

The personalized expression generation unit 260 may generate a sign language expression directly designated by a user as a shortcut according to the user's convenience. For example, a user may generate a personalized expression to load a corresponding sentence with only a shortened sign language operation for a frequently used sentence expression. Accordingly, the personalized expression generation unit 260 may support a user to recall a pre-registered sentence expression in response to inputting some shortened sign language operations.

In addition, the personalized expression generation unit 260 may generate sign language that did not exist as a personalized expression according to a user's personal definition. For example, the user may generate sign language related to the new word as a personalized expression. In order to register the personalized expression, the user may register the video data recording the sign language operation and the text data recording the meaning corresponding thereto.

4 is a diagram showing the configuration of a personalized expression generating unit according to an embodiment of the present invention.

The personalized expression generation unit 260 is a component that directly registers and shares the personally used expression of the user. As illustrated in FIG. 4, the personalized expression generation unit 260 may include an expression registration unit 261 and a sharing support unit 262.

The expression registration unit 261 may support expressions that are mainly used by individual users in a favorite form. In order to register the personalized expression, the expression registration unit 261 may register, from the user, video data that records the sign language operation and text data that records the meaning corresponding thereto.

In addition, according to various embodiments, the expression registration unit 261 may support the registration of sign language expressions created by individuals for new words. In addition, the expression registration unit 261 may support registering a sentence expression with shortened sign language information when an operation is inconvenient according to a user's body function.

The expression registration unit 261 may determine whether a personalized expression requested by a user satisfies a standard requirement by an automatic screening system according to various embodiments, and may determine whether to register the personalized expression according to the result of the review.

The expression registration unit 261 may extract a sign language expression frequently used by a user according to an embodiment, and query the user whether to register it as a personalized expression. In response to this, the expression registration unit 261 may register a sign language expression in which the frequency of use of the user is greater than or equal to a reference value as a kind of personal expression of the user (eg, a favorite expression) with the approval of the user.

The sharing support unit 262 may support sharing in the space in the app, such as a separate bulletin board, when the personalized expression registered through the expression registration unit 261 satisfies a reference condition or when a user requests. The sharing support unit 262 may be classified according to a user's occupation, a semantic field of registered personalized expression (eg, complaint expression, identification, affection expression, etc.). When the personalized expression is registered, as the sign language video recording data and text data indicating the meaning of the sign language video can be registered, the sharing support unit 262 classifies similar items based on the registered personalized expression video recording data Or you can classify similar items based on text data.

The sharing support unit 262 may share a corresponding expression among a plurality of members when a predetermined specific condition is satisfied according to an examination of the personalized expression registered by a user according to an embodiment.

5 is a diagram illustrating an example of a personalized expression registration operation according to an embodiment of the present invention.

As shown in FIG. 5, the server 200 according to an embodiment of the present invention may register a personalized expression that is an expression created by a user and use the registered personalized expression later.

As illustrated in 501 of FIG. 5, the user may select a one button for registering a personalized expression in the screen after application execution. In response to this, the user terminal 100 may display a screen for recording a sign language operation from a user and a screen for receiving the meaning of the sign language operation, as illustrated at 502. In addition, the expression registration unit 261 may receive a sign language operation corresponding to a personalized expression input by a user and a meaning of the sign language operation on the personalized expression registration screen, and register it with the server, as illustrated in 502.

As illustrated in 502 of FIG. 5, the personalized expression registration screen may include an operation input window displaying an image captured by using the camera provided in the user terminal 100. The user may select a recording button displayed on one side of the operation input window and record a sign language operation. In addition, the personalized expression registration screen may include a meaning input window for inputting the meaning of the recorded sign language operation.

The expression registration unit 261 may determine whether a personalized expression requested by a user satisfies a standard requirement by an automatic screening system according to various embodiments, and may determine whether to register the personalized expression according to the result of the review. In addition, according to various embodiments, the sharing support unit 262 may share the expression to a plurality of members when the registered personalized expression satisfies a predetermined specific condition.

Although not shown in the drawings, the security system considering the disabled according to an embodiment of the present invention collects at least one video information of impression wear, motion, and clothing of the disabled user (visitor) and determines whether the person is a evasion person based on this can do. The evasion of the evaded person may be performed according to the correspondence with a picture of a specific person previously registered by the host.

In addition, the security system may determine whether the user is in an emergency state based on non-verbal information such as facial expressions and actions other than sign language input by the user. When it is determined that it is an emergency, the server 200 may change the setting value of the interpretation result data of the sign language message input by the user. For example, when it is determined that the user is in an emergency situation, the server 200 may control to increase the sound volume to be provided to the host terminal when the sign language interpretation result data is output in the form of voice data. Alternatively, when it is determined that the user is in an emergency, the server 200 may control the text size sign language interpretation result data to be displayed on the host terminal by increasing the text size and thickness.

In addition, according to various embodiments of the present disclosure, in case a host other than a user (visitor) is deaf, the present invention may control one set value of an input function on the host terminal 400 side and an output function on the host terminal 300 side. For example, the host terminal 400 may operate functions such as a notification lamp and vibration in place of a notification bell indicating that a call signal has been received from a server.

In addition, when the user terminal 100 and the host terminal 400 according to the present invention perform a three-way call via the sign language interpretation center 500 under the support of the server 200, it is preferable to perform a text-based conversation in a chat form instead of a video call format. It is possible. To this end, the subtitles, which are the interpretation result data delivered from the sign language interpretation center 500, may be provided to the user and the host in the form of a message in a chat window. And according to various embodiments, the user terminal 100 or the host terminal 100 detects the input direction when a voice or a non-deaf-talkable user or host inputs a voice through a microphone installed in a multi-directional direction and displays the direction along with a message. It might be. Accordingly, when there are multiple speakers, a message is displayed along with the direction in which the voice is input. For example, a host with a hearing impairment may have multiple visitors even if the general visitor seen through the screen of the host terminal 400 looks like one. You can catch the fact that you have visited through voice input direction information.

According to various embodiments of the present disclosure, the server of the present invention may automatically perform a user's failure authentication when a disabled user logs in. When the user terminal 100 accesses the server 200 through a security application, the user terminal 100 is used for authentication of a failure, such as a serial number issued when the user registered for the disabled through the server 200 or a disabled registration number of a previously stored user. Information can be retrieved and delivered to the server 200. Accordingly, the server 200 may perform a failure authentication operation to check the validity based on the information for failure authentication obtained from the user terminal 200.

In this case, the server 200 may further determine detailed information such as the degree of failure and the type of failure as well as whether or not the failure occurs through the information for authentication of the failure. Accordingly, the server 200 may generate a custom command signal to be performed by changing the set value or work function in response to the user's degree of failure and the type of failure and transmit it to at least one of the host terminal 400 and the user terminal 100.

In addition, in order for the system of the present invention to provide a customized service in response to the user's failure information, it is necessary that the driving information for the user terminal 100 or the host terminal 400 is transmitted to the server 200. In addition, the server 200 may calculate a custom command signal from the user account and host account information in response to the failure information including the presence or absence of the failure, the degree of failure, and the type of failure.

According to an embodiment, the user terminal 100 or the host terminal 400 may receive a custom command signal from the server 200, and the user terminal 100 or the host terminal 400 may control at least one function in response to the custom command signal. For example, when it is confirmed that the server 200 is a deaf person and a user with a visual impairment, when the user performs a connection to the host terminal 400 through the user terminal 100, the font size displayed on the screen of the user terminal 100 It can be displayed by increasing.

First, the user terminal 100 or the host terminal 400 attempts to deliver a warning message to the user from the server 200, but when delivery is not properly performed due to a user's failure, the user terminal 100 or the host terminal 400 senses the user to recognize the notification. Can be converted to form. For example, the user terminal 100 or the host terminal 400 may control to perform a warning notification in a vibration or lamp flashing operation according to a custom command signal.

According to various embodiments, the user terminal 100 may be maintained in a standby mode for receiving a sound in the form of a warning sound while the application is in operation. Accordingly, when the user terminal 100 outputs a warning sound, the sound of the warning sound may be converted into vibration. Accordingly, the user terminal 100 may transmit the fact that a warning sound has been generated to the hearing impaired.

The user terminal 100 may convert 400 data on the host terminal input as sound into text or convert it into a sign language image to display on the screen.

The server 200 according to an embodiment of the present invention may process a series of operations related to performing a user's failure authentication.

First, the server 200 may support a disabled user to be registered as a member of the server 200 through an application. The server 200 may support a user to execute an application through the user terminal 100 and perform fault authentication through the application. The server 200 may request to input user information to confirm that the user is disabled. When a user registers for membership, the server 200 may obtain and manage information on the type of failure and the degree of failure of the user.

In addition to user registration, the server 200 may perform a procedure of authenticating that any user is a member with a disability. The server 200 may verify whether authentication information transmitted from the user terminal 100 is valid. Furthermore, the server 200 may extract detailed information about the degree of failure, the type of failure, and the like of the user who has completed the failure authentication, and reflect it to determine a customized service item.

The server 200 according to an embodiment of the present invention may manage a customized service item that is an item whose content is variable in response to a user's degree of failure and a type of failure. The personalized service item may include, for example, the size of text displayed on the screen, the volume of the output guide message, and the volume of the warning sound.

According to an embodiment, the server 200 may generate a custom command signal corresponding to the user's failure level and type of failure. The server 200 may transmit the generated custom command signal to the user terminal 100 or the host terminal 400.

The custom command signal generated by the surfer 200 includes a signal for changing the displayed text size, a volume for outputting a guide message, or a signal for changing the volume of a warning sound, a signal for converting text into sound (TTS), and a sound May include a signal for converting (STT) to text, a signal for converting sound into a lamp flashing operation, and the like.

For example, when the server 200 confirms that the user is a hearing impaired person and the degree of hearing impairment is 3 out of 5, the voiced text is displayed along with the text that is texted on the screen. A custom command signal for increasing the volume of 3 levels can be generated and transmitted to the user terminal 100 side. The custom command signal may be variously calculated according to the type of the disorder and the degree of the disorder.

In addition, the server 200 may generate a custom command signal reflecting the user's selection, in order to provide a service in a user-preferred information delivery method. For example, when a specific user with a hearing impairment wants to receive service contents in text without increasing the output sound volume, the volume change item can be turned off directly in the preferred service method item and only the STT item can be selected. And accordingly, when providing a service to the user, the server 200 may generate a signal requesting to display additional text data on the screen of the user terminal 100 or the screen of the host terminal 400 while maintaining the volume. When generating a custom command signal in the server 200, it can be generated by referring to the custom command signal table corresponding to the failure type as shown in Table 1 below.

division Contents Blind Voice guidance function, voice speed/volume/pitch control function, section repeat function, re-listening/continuous listening function, text-to-speech output depending on the situation through TTS for visually impaired Low vision Text enlargement function, color inversion function Hearing impaired Video sign language interpretation service, converts voice information to text Hearing impaired Provides hearing aid output by automatically adjusting the volume or audio band of the audio processor according to the hearing loss level Deaf Relay call function Provides 3-way relay service with automatic interpretation service function Blind and deaf Control of unmanned devices through Bluetooth connection with existing disability assistive devices

In addition, according to various embodiments, when performing a three-way call function including a sign language interpretation center, the security system may check and verify whether or not the sign language interpretation center is properly interpreted.

When the user's gesture (including facial expressions and gestures) of a preset user is detected, the server 200 may determine that the user raises an abnormality in the interpretation result.

Specifically, the server 200 may set an objection event, which is a gesture for objecting to an interpretation result, in response to a user request. For example, a user may set the objection event to perform the action of opening and closing the fist twice. Accordingly, when the preset objection event is detected from the sign language image transmitted from the user terminal 100, the server 200 may provide a notification to the sign language interpretation center 400 to request correction. Alternatively, when the objection event is detected, the server 200 provides a subtitle modification screen that allows a user to directly modify the subtitle (text information generated based on the content converted by speech interpreter) displayed on the user screen. Can. Then, the user can directly type some of the subtitle content to correct the error. The server 200 may convert the modified subtitle back to voice through a TTS operation and provide it to the host terminal 400 side.

The server 200 may perform a series of operations to verify the interpretation. According to an embodiment, the server 200 may generate a plurality of classification operations from a sign language motion image input by a user and a sign language interpreter through a camera. The server 200 may perform a sampling test for extracting some of the sign language operations generated by the classification operation and performing an error determination based on pre-registered sign language data.

The server 200 may store sign language-speech (text) matching information that matches a sign language operation and a voice (or text) for some words so as to perform a pre-sampling test. Accordingly, the server 200 may perform a verification operation based on matching information. For example, the interpreter verification unit 253 compares pre-interpretation data with post-interpretation data, and determines whether there is a voice (text) or sign language operation that is present in the pre-interpretation data but missing in the post-interpretation data based on the matching information. I can judge. The server 200 may determine that an error occurs when data (eg, a voice interpreting the user's sign language (subtitle text) or a sign language interpreting the voice of the contact center) is found after interpretation.

The server 200 may perform an improvement on an interpreter result in which an error has occurred. According to an embodiment of the present disclosure, when it is determined that an error has occurred, the server 200 may collect data before and after the interpretation of the corresponding expression as separate request data for improvement, and provide it to the administrator to request collective improvement.

The server 200 may post the collected improvement request data on a bulletin board that can be checked by the user and request the user to write a review, and obtain an improvement from a review registered by the user and correct the error expression by reflecting it.

FIG. 6 is a diagram illustrating a process for disability authentication and customized service support according to an embodiment of the present invention.

As shown in Figure 6, the present invention, in accordance with various embodiments, in the state of storing the disabled profile information generated as a result of the authentication in the service authentication server 200 in the user terminal 100, the user's failure authentication and customized service requests from time to time You can perform the operation.

In the above embodiment, the'disabled authorization and personalized information update procedure' for storing and updating the profile information of the disabled in the user terminal 100 and the disabled user's profile information are authenticated to use the unattended device and customized services are provided from the unmanned device. It can be composed of'provision of unmanned service for people with disabilities' provided.

Specifically, the user terminal 100 may perform operation 601 to detect a user authentication attempt, such as clicking an authentication button on the screen within the app of the user terminal. Correspondingly, the user terminal 100 may perform operation 602 to access the service authentication server 200 through the ARS under the driving of the corresponding app, and at the same time, authenticate the service of the user's phone number through the SSL encrypted data channel. The operation 604 of transmitting to the server (the ARS server granting the handicapped) 200 may be performed.

Thereafter, the service authentication server 200 doubles the calling information of the user terminal 100 collected in steps 605 and 602 and 604 to search for the disabled profile information by querying the public DB 400 for the disabled based on the call number of the incoming call. Operation 606 may be performed to check whether the disabled match. At this time, the public DB 400 for the disabled may refer to a device in which detailed information of a disabled person is encrypted and stored using the phone number of the user terminal 100 of the disabled as a key value.

When it is confirmed that the user requesting authentication through the public DB 400 for the disabled is a registered disabled person, the service authentication server (disabled authorization ARS server) 200 finds a data channel that matches the calling number among the connected SSL encrypted data channels and displays the disabled profile information. The operation 607 of transmitting the data to the user terminal 100 may be performed.

Accordingly, the user terminal 100 performs operation 608 of storing the received profile information for the disabled as data in the app. As such, profile information for the disabled stored as data in the app of the user terminal 100 can serve as a welfare card for the disabled. In addition, the profile information for the disabled can be viewed in the user's personal terminal without going through a separate ARS authentication process each time it is used in the future, and it is possible to easily prove that the disabled person is disabled in the case of using an unmanned device.

In this way, in the case of the method of storing the profile information of the disabled as data in the app, the authentication is performed in two stages through the phone number of the user terminal 100 and the call number received by the actual service authentication server 200. It is possible to more reliably prevent the problem of stealing the profile information of the disabled by the number manipulation and the non-disabled persons. In addition, the above method can prevent the leakage of personal information by utilizing the SSL encrypted data channel, and it is possible to improve the simplification and accessibility of the procedure by granting the handicapped authority by clicking a button in the app.

After operation 608, the user terminal 100 may update the stored disabled profile information through interaction with the service authentication server 200. Specifically, the user terminal 100 may perform operation 609 of registering personalized information for the disabled with the service authentication server 200. In response, the service authentication server 200 may perform operation 610 to perform an update in response to the received customized information and operation 611 to inform the user terminal 100 that the registration of the customized service is completed. Then, according to the user terminal 100, operation 612 in which personalized information for the disabled is updated may be performed.

Thereafter, when the user terminal 100 intends to use the unattended device 300, the user terminal 100 may be authenticated as a disabled person based on the disabled profile information stored in the app, and may be provided with a personalized benefit or a service customized for the disabled.

Specifically, the user terminal 100 may perform an operation 613 of receiving an ID of the unmanned device through wireless communication for authentication of the disabled in the unmanned device 300. At this time, the unattended device 300 may broadcast the ID information of the unattended device to a user terminal 100 within a short distance through a method such as beacon, Zigbee, and the like, and the user terminal 100 may receive the unattended device ID based on this. According to various embodiments, it is possible to receive an unattended device ID to the user terminal 100 by an NFC method rather than a beacon. In this case, the unmanned device 300 may request to perform a procedure related to authentication of the disabled in the unmanned device through a signal transmitted by a broadcast or NFC contact method transmitted to the user terminal 100 side.

Accordingly, the user terminal 100 may perform a series of processes of interpreting the authentication attempt procedure received in the app, checking the disabled profile information stored in the app, and transmitting it to the unmanned device 300. Specifically, the user terminal 100 may perform operation 616 of performing authentication of the user with a disability on the unattended device 300 and transmitting service profile information to request a customized service corresponding to the type of failure and the degree of failure. In response, the unmanned device 300 may perform operation 617 of providing a customized service UI display and a customized function.

In addition, the service profile information may be generated by operation 614 that performs service provisioning based on the disabled profile and unattended device ID information stored in the app of the user terminal 100 in conjunction with the user terminal 100 and the service authentication server 200, and the provisioning is performed. The operation may be performed based on the information confirmed through interaction with the unmanned device provisioning DB 615 of the service authentication server 200.

Accordingly, since the unattended device 300 receives the disabled profile information stored in the app of the user terminal 100, it is not necessary to perform an authentication procedure every time, so it is easy to use, and furthermore, this is a separate network ( WIFI/LTE) Even if the environment is not created, the service response environment can be improved by enabling the exchange of profile information for the disabled in the app with unmanned devices. In addition, in the case of the authentication procedure using the existing welfare card for the disabled, it was necessary to directly check by the human eye, but this method can be automated through the verification procedure between devices, and it is not possible to give artificially disabled persons. In addition, it is possible to utilize the disabled profile information stored in the app even during late night hours and holidays, and when the disabled profile is changed (e.g., the degree of disability, etc.), the authentication process for the disabled is performed again and the changed situation is immediately reflected. .

Although the present invention has been described in detail with reference to the above-mentioned examples, those skilled in the art can make modifications, alterations, and modifications to the examples without departing from the scope of the present invention. In short, in order to achieve the intended effect of the present invention, it is not necessary to separately include all the functional blocks shown in the drawings or to follow all the orders shown in the drawings in the order shown, and even if not, the technical features of the present invention described in the claims Note that it can fall within the scope.

100: user terminal
171: Disability Information Management Department
172: Language conversion support
200: server
230: Member Characteristics Management Department
240: Sign language interpretation service connection
250: auxiliary information providing unit
260: personalized expression generation unit
300: call bell
400: host terminal
500: Sign Language Interpretation Center

Claims (6)

In the security system comprising a call bell, a user terminal, a host terminal and a server,
The call bell is installed at the entrance of a place that blocks outsiders from entering for security settings, and transmits a beacon signal to a user terminal existing within a predetermined distance.
As the user terminal receives the beacon signal from the call bell, it automatically executes a pre-installed security application, and transmits a call request signal for the host terminal and user information to the server through the security application,
When the server receives the paging signal from the user terminal, the server transmits the paging signal to the host device corresponding to the paging signal, supports the communication connection of the host terminal, and requires a sign language interpretation based on the user's member information. If it is determined whether or not the user is a sign language interpreter, it is necessary to perform a three-way call function including a sign language interpretation center at the user terminal and the host terminal.
The server
A sign language interpretation service connection unit that determines whether sign language interpretation is required in response to the user's disability information, and performs a three-way call function including a sign language interpretation center when sign language interpretation is required;
An auxiliary information providing unit that provides auxiliary information related to sign language interpretation, and downloads information obtained by searching for a specific sign language word specified by a user from a web server and transmits the information to the host terminal; And
Includes a personalized expression generation unit to support the user to recall the pre-registered sentence expression in response to input of some of the shortened sign language operation;
The personalized expression generation unit
An expression registration unit that receives video data recording a corresponding sign language operation from a user and text data recording a meaning corresponding thereto and registers it as a personalized expression; And
A sharing support unit for sharing the expression to a plurality of members when a screening result for a personalized expression registered by a user satisfies a predetermined specific condition; Authentication and security system for the disabled, characterized in that it comprises a. According to claim 1,
The user terminal
A communication unit transmitting a call request signal to a host terminal to the server, and receiving data related to performing a three-way call from the server;
A display unit that displays interpretation result information transmitted from a host terminal and a sign language interpretation center based on the three-way call data received from the server;
A camera unit for photographing a sign language operation of a user to be transmitted to a server during a three-way call;
Obtaining and storing and managing the user's failure information, wherein the failure information includes information on the degree of failure and type of failure, and there is a possibility that the degree of failure of the user may deteriorate, and the set value of one function in response to the degree of deterioration When it is determined that it is necessary to change, the obstacle information management unit performs a vision and hearing test function, and updates the user's failure information with a result value of the performed examination;
Automatically selects at least one of text input, voice input, and sign language input based on the user's disability information, and receives the voice data generated by the sign language interpretation center to convert it into text by STT operation. Language conversion support; Authentication and security system for the disabled, characterized in that it comprises a. According to claim 1,
The server
Collects the user's main visit history, host terminal call history, interpreter assist function usage history and personalized expression registration history, determines the user's calling function usage pattern based on the user history, and the user based on the calling function usage pattern When the main call time of the terminal arrives, a member characteristic management unit that controls a user terminal to automatically execute a security application; An authentication and security system considering a disabled person. delete delete According to claim 1,
The expression register is
An authentication and security system that considers a person with a disability to judge whether the personalized expression requested by the user to be registered satisfies the criteria by the automatic screening system, and to determine whether to register the personalized expression according to the result of the review.

Images