KR102134146B1 - Smart speaker system for health and life management of the elderly - Google Patents

Abstract

The present invention provides a smart speaker system using a mobile terminal of a user and an operation server. More specifically, the present invention relates to a smart speaker system for health and life management of an aged person, which comprises: a hardware part including a microphone module receiving voice signals of the user, a speaker module outputting sound to the user in providing a service, a camera module taking a picture of the user, a display module displaying an image to the user, a housing module housing the microphone module, the speaker module, the camera module and the display module, and a healthcare module for checking health of a user provided on one surface of the housing module; a wireless communication part wirelessly connecting the hardware part, the mobile terminal of the user and the operation server to one another; a main control part controlling operation of at least one among the microphone module, the speaker module, the camera module and the display module, the housing module and the healthcare module, and making communications with the wireless communication part; an electromagnetic wave generation part controlled by the main control part to generate electromagnetic waves to a hearing aid of the user; and a user emotion input unit enabling the user to select and input an emotion of the user.

Description

Smart speaker system for health and life management of the elderly}

The present invention relates to a smart speaker system for health and life management of the elderly, and more specifically, the use environment is controlled according to the body of the elderly to reduce fatigue due to use, and the setting value is adjusted according to individual operation capability It relates to a smart speaker system for the health and life management of the elderly who can be customized operation.

As the fertility rate and mortality rate decrease and the elderly population increases, various changes occur in the elderly (age) society. The main characteristics can be explained by the decrease in the production population due to the decrease in the fertility rate, the increase in the support ratio and the aging index for the elderly, the increase in the median age, and the rapid increase in the elderly population over the age of 80.

As the aging population accelerates, the problem of increasing the number of elderly people and the shortage of dependent workers has become a serious problem in society. Various attempts have been made to supplement the gap between human resources through digital technology grafting. Of these, AI speakers that incorporate AI technology into speakers are attracting attention due to their ease of use and high penetration rate.

In particular, interactive voice interaction is valuable in that it can support emotional aspects such as resolving the sense of isolation of the elderly. However, the voice interaction method of the currently commercialized AI speaker does not clearly reflect the conversation characteristics of the elderly, and is insufficient to solve the emotional problem of the elderly. Accordingly, various studies have been conducted to reflect the characteristics of aging targeting the elderly and apply it to smart devices.

(Prior patent) Korea Utility Model Publication No. 20-2006-0000076

An object of the present invention is to provide a smart speaker system for health and life management of an elderly person with improved ease of use by reflecting the aging characteristics of the elderly person.

In addition, another object of the present invention is to provide a smart speaker system for the health and life management of the elderly that can effectively manage the health and life of the elderly by easy communication with areas, institutions, organizations, etc. protecting the elderly. to be.

According to an aspect of the present invention, embodiments of the present invention are in a smart speaker system using a user mobile terminal and an operating server, a microphone module that receives a user's voice signal, and a speaker module that outputs sound to a user in service provision And a camera module for photographing a user, a display module for displaying an image to the user, a housing module accommodating the microphone module, speaker module, camera module and display module, and a user health check provided on one surface of the housing module Hardware unit having a health care module; A wireless communication unit configured to wirelessly connect the hardware unit, the user mobile terminal, and the operation server; A main control unit controlling at least one operation of the microphone module, speaker module, camera module, display module, housing module, and healthcare module, and communicating with the wireless communication unit; An electromagnetic wave generator controlled by the main control unit to generate electromagnetic waves with a user's hearing aid; And a user's emotion input unit for a user to select and input the user's emotions.

In one embodiment, further comprising an administrator mobile terminal to communicate with the operation server, the main control unit at least one of the user's voice signal received through the microphone module and the user's video received through the camera module Delivered to the operation server, the operation server automatically generates an information message according to the user's voice signal or the user's video, transmits the information message to the administrator mobile terminal, and the administrator mobile terminal is the operation server In response, the operation server may transmit a response message transmitted from the manager mobile terminal to the speaker module or the display module through the main control unit.

In one embodiment, the electromagnetic wave generation unit is provided to output the sound output from the speaker module as electromagnetic waves by the user's selection, a sound processing unit, sound conversion unit, sound buffer unit, sound stabilization unit, auxiliary coil and acoustic coil It may include.

In one embodiment, the sound processing unit converts a digital signal received from the speaker module into a digital-to-analog converter (DAC) and a digital-to-analog converter to convert the analog signal into an analog signal. And an amplifier that amplifies the analog signal to a signal of a certain size to transmit the analog signal through the electromagnetic wave generator, and the sound conversion unit changes the bandwidth of the digital signal to generate electromagnetic waves to be received by the user's hearing aid. Transmitting to a coil, including that implemented in software to modulate the pulse band, the sound buffer unit comprises temporarily storing a signal output from the sound conversion unit and outputting it to the auxiliary coil, and stabilizing the sound The unit may be connected to the auxiliary coil to remove noise included in the signal output from the sound conversion unit, and may include a capacitor or a coil.

In one embodiment, the user emotion input unit is composed of a normal button, a happy button, an angry button, a fear button, a sad button, and a surprise button, through which the user selects and inputs the user's emotion and outputs emotion information. An emotion selection button provided in the form of a button for the user to press on the outer surface of the housing module; And an emotion communication unit for transmitting the emotion information of the user transmitted by the emotion selection button selected and pressed by the user to the main control unit, wherein the main control unit comprises the speaker according to the emotion information of the user received from the emotion communication unit. The type of sound output through the module and the type of image displayed on the display module may be determined, and the main control unit may transmit the emotion information to the operation server.

In one embodiment, the emotional communication unit is the user's emotional information determined by at least one of the user's emotional selection buttons, the normal button, the happy button, the angry button, the fear button, the sad button and the surprise button, happy, Anger, fear, sadness and surprise are delivered to the main control unit, and the main control unit extracts location values from sound files and video files corresponding to the emotion information of normal, happy, angry, fear, sadness, and surprise, respectively. The type of sound and the type of image corresponding to the position value are determined, and the determined type of sound and image are transmitted to the speaker module and the display module, respectively, and the main control unit corresponds to anger, fear, sadness and surprise When the emotion information to be duplicated occurs for more than 3 days, it can be transmitted to the operation server.

In one embodiment, the microphone module is made of a main microphone mounted on the housing module and used as a main and a submicron detachably provided on the housing module, and the housing module includes a first microphone fastened with the submicrophone. A fastening part is provided, and the sub-microphone is a second microphone fastening part fastened to the first microphone fastening part, a variable extension part extending in a bellows shape so as to be deformable in the second microphone fastening part, and one end of the variable extension part It is made of a microphone unit provided in, the sub-microphone can be wirelessly connected to the wireless communication unit by Bluetooth.

In one embodiment, each of the main microphone and the sub microphone includes a main sound sensor and a sub sound sensor that communicate with the main control unit, and the main control unit is transmitted from each of the main sound sensor and the sub sound sensor. Receiving a first sound signal and the second sound signal of the user's sound signal, and further comprising correcting the user's sound signal by the first sound signal and the second sound signal, correcting the sound signal of the user In doing so, in the state in which the sub-microphone is mounted on the housing module, the main control unit receives the initial sound speed and initial reception of each of the first sound signal and the second sound signal input through the main sound sensor and the sub-sound sensor. Determine the reference data consisting of the signal time difference, and the sub-microphone is separated from the housing module, the main control unit is the first sound signal and the second sound signal input through the main sound sensor and the sub-sound sensor, respectively Determines the measurement data consisting of the sound velocity, the received signal time difference, the main control unit determines the location of the user by the difference between the reference data and the measurement data, the main control unit according to the user's location speaker module You can control the size of the speed of sound output from.

In one embodiment, the display module may be provided with one or more displays connected in a block form, and the one or more displays may be provided to display different images, respectively, by the main control unit.

In one embodiment, the housing module, a housing having an internal space to accommodate at least one of a microphone module, speaker module, camera module and display module; A battery unit provided in the interior space of the housing to supply power; A hearing aid charging unit electrically connected to the battery unit to charge a user's hearing aid; And a medicine supply unit provided on an outer surface of the housing module to supply medicine to a user.

In one embodiment, the battery unit includes at least one lithium secondary battery, a BMS for controlling the lithium secondary battery, and a charge amount display unit indicating a charging state of the lithium secondary battery, wherein the hearing aid charging unit is a user's hearing aid And a hearing aid charger electrically connected to the battery unit and provided with the hearing aid charger to sense the presence or absence of the hearing aid, the hearing aid sensor receiving information about the presence or absence of the hearing aid, the main controller And the main control unit to the user mobile terminal, the operation server and the display module.

In one embodiment, the medicine supply unit, one or more medicine storage unit having a space for storing the user's medicine; A weight sensor provided in the weak storage unit to sense the weight of the weak storage unit; And a medicine supply control unit receiving the weight of the medicine storage unit from the weight sensor and transferring the user's medication use to the main control unit according to a previously input medicine supply program. The medicine to be taken is received, and the weight sensor transmits the measurement weight obtained by measuring the weight of the medicine provided in the medicine storage unit at regular time intervals to the medicine supply control unit, and the medicine supply control unit measures the weight of the medicine specified at the specified time. The resultant weight is compared to the specified weight of the drug supply program including the designated weight, and the measured weight is transferred to the main control unit, and the main control unit has an abnormality based on the result value received through the medicine supply control unit. In this case, it can be delivered to the user's mobile terminal, operation server and display module.

In one embodiment, the wireless communication unit is wirelessly connected to receive the user's status signal, and further includes a smart band for transmitting the user's status signal to the user's main control unit, the user's status signal is the user's heart rate, the user It may include one or more of the number of steps, the user's blood pressure, the user's current location information and the user's voice signal.

In one embodiment, the smart band, a heart rate sensor for measuring the heart rate of the user and outputting it as a detection signal; A pedometer sensor which measures the number of steps of the user and outputs it as a detection signal; A blood pressure sensor measuring the blood pressure of the user and outputting it as a detection signal; GPS outputting the current location information of the user as a detection signal; A band microphone provided to input the user's voice signal; A band speaker provided to output audio; A band input unit provided for operation selection and information input; A band display unit provided for display of an operation state and information; A band communication unit to perform communication with the wireless communication unit; It controls to perform the operation selected by the band input unit, provides the heart rate sensor, the pedometer sensor, the blood pressure sensor, and the respective detection signals of the GPS to the main control unit by communication by the wireless communication unit, the band By providing a user's voice signal input through a microphone through the main control unit to the speaker module or an electromagnetic wave generator, and by providing a user's voice signal provided from the microphone module through the main control unit through the band speaker, A band control unit controlling to perform a 1:1 conversation with the smart speaker system at a location spaced apart from the smart speaker system, or controlling to provide voice to the smart speaker system; A band memory unit for storing information and programs obtained from the operation or necessary for the operation; And a band battery that supplies power required for operation.

In one embodiment, the healthcare module is a sheet member provided to surround a portion of the upper surface of the housing module; A signal sensing member provided on the seat member and made of a conductive material that senses a human body signal formed in contact with the human body of the user; And a socket connected to the signal sensing member and transmitting a human body signal sensed by the signal sensing member to the main control unit, wherein the signal sensing member is provided in the form of a wire formed by coating copper on carbon fiber yarns. , The health care module is provided to be removably detachable from the housing module, and the main control unit may transmit the human body signal transmitted through the socket to the user mobile terminal and the operation server.

In one embodiment, the housing module is provided in the form of a cylindrical column, and the health care module is provided in an empty donut shape on the upper surface of the housing module to surround the edge of the upper surface of the housing module. , One or more sensing sensors communicating with the main control unit 300 may be provided on the inner periphery of the healthcare module.

In one embodiment, the detection sensor detects the concentration of fine dust in the air and transmits a fine dust concentration value to the main control unit, detects the concentration of carbon monoxide in the air and delivers the carbon monoxide concentration value to the main control unit A second detection sensor is included, and the main control unit may transmit the fine dust concentration value and the carbon monoxide concentration value transmitted through the first detection sensor and the second detection sensor to be displayed on the display module, respectively.

According to the present invention as described above, it is possible to provide a smart speaker system for health and life management of the elderly with a low barrier to entry of the elderly in terms of accessibility, which can solve the isolation of middle-aged elderly people with reduced contact points for social activities and exchanges. Can.

In addition, according to the present invention, the aging characteristics and communication methods of the elderly are investigated, and the main conversation characteristics are derived by reflecting them in a universal situation, and the health and life of the elderly are managed more efficiently, and with the elderly It is possible to provide a smart speaker system for health and life management of the elderly who can effectively function not only in the physical but also psychological aspects of the elderly by interactive conversation interaction.

1 is a view schematically showing a smart speaker system according to an embodiment of the present invention.
FIG. 2 is a view for explaining the electromagnetic wave generator of FIG. 1.
3 is a view for explaining the user emotion input unit of FIG. 1.
4 is a schematic perspective view of hardware of the smart speaker system of FIG. 1.
5 is an exploded perspective view of the hardware of the smart speaker system of FIG. 4.
FIG. 6 is a view for explaining the housing module of FIG. 4.
7 is a view schematically showing the drug supply module of FIG. 4.
8 is a view for explaining a process of operating the drug supply program in the drug supply module of FIG.
9 is a view for explaining a configuration including a smart band according to another embodiment of the present invention.
10 is a block diagram illustrating the internal configuration of the smart band of FIG. 9.
11 is a view for explaining a configuration including a healthcare module according to another embodiment of the present invention.
12A is a cross-sectional view of the healthcare module of FIG. 11.
12B is a cross-sectional view of the seat member of FIG. 11.
13 to 15 are views for explaining the health care module of FIG. 11.

Specific details of the other embodiments are included in the detailed description and drawings.

Advantages and features of the present invention, and methods for achieving them will be clarified with reference to embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms. In the following description, when a part is connected to another part, it is only directly connected. It also includes cases where other media are connected in the middle. In addition, in the drawings, parts not related to the present invention have been omitted to clarify the description of the present invention, and like reference numerals are assigned to similar parts throughout the specification.

Hereinafter, the present invention will be described with reference to the accompanying drawings.

1 is a view schematically showing a smart speaker system according to an embodiment of the present invention. FIG. 2 is a view for explaining the electromagnetic wave generator of FIG. 1. 3 is a view for explaining the user emotion input unit of FIG. 1.

The smart speaker system 10 according to an embodiment of the present invention relates to a smart speaker system 10 using a user mobile terminal 20 and an operation server 30 for health and life management of an elderly person, a hardware unit ( 100), a wireless communication unit 200, a main control unit 300, an electromagnetic wave generator 400, and a user emotion input unit 500 may be included.

The hardware unit 100 includes a microphone module 110 that receives a user's voice signal, a speaker module 120 that outputs sound to a user in service provision, a camera module 130 that photographs the user, and a video to the user. The display module 140 for displaying, the microphone module 110, the speaker module 120, the camera module 130 and the housing module 150 for receiving the display module 140, and the housing module 150 It may include a health module 160 for user health check provided on one side of the.

The smart speaker system 10 further includes a wireless communication unit 200, a main control unit 300, an electromagnetic wave generator 400, and a user emotion input unit 500 that are connected to the hardware unit 100 by wire or wirelessly. The wireless communication unit 200 may be wirelessly connected to the hardware unit 100, the user mobile terminal 20, and the operation server 30, such as a web-based server. The main control unit controls at least one operation of the microphone module 110, speaker module 120, camera module 130, display module 140, housing module 150 and healthcare module 160, It is possible to communicate with the wireless communication unit 200, the electromagnetic wave generator 400 is controlled by the main control unit 300, it is possible to generate electromagnetic waves to the user's hearing aid 40, the user emotion input unit 500 ) May be input by the user by selecting the user's emotion.

The microphone module 110 processes a user's voice signal into electrical voice data. In addition, various noise reduction algorithms for removing noise generated in the process of receiving the user's voice signal may be implemented in the microphone module 110.

The speaker module 120 outputs a user's voice signal and is connected to the main control unit 300 to output a calculation result corresponding to sound output among various calculation results of the main control unit 300 through the speaker module 120 Output.

The camera module 130 may capture and store an image of the user. The camera module 130 may be connected to the main control unit 300 through the wireless communication unit 200, and controlled by the main control unit 300. The camera module 130 processes a video frame such as a still image or video obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display module 140 or stored in the main control unit 300.

The display module 140 may form a mutual layer structure with the touch sensor or may be integrally formed to implement a touch screen. Such a touch screen may function as an input unit that provides an input interface to a user and may also provide an output interface.

The main control unit 300 is a plurality of application programs (application programs or applications) driven by the hardware unit 100, the electromagnetic wave generator 400 and the user emotion input unit 500 (application program), the hardware unit 100 ), data and commands for the operation of the electromagnetic wave generator 400 and the user emotion input unit 500 may be stored. At least some of these application programs may be downloaded from the operation server 30 or an external server through the wireless communication unit 200.

In addition to the operations related to the application program, the main control unit 300 generally controls the overall operation of the hardware unit 100, the electromagnetic wave generation unit 400, and the user emotion input unit 500. The main control unit 300 may provide or process appropriate information or functions to a user by processing signals, data, information, etc. input or output through the above-described components or by driving the application program.

An application provided by the smart speaker system 10 may be installed in the user mobile terminal 20, and on/off of the hardware unit 100 may be controlled.

The smart speaker system 10 may further include an administrator mobile terminal 40 communicating with the operation server 30. For example, the smart speaker system 10 includes a user mobile terminal 20 of the user of the smart speaker system 10 and an administrator mobile terminal 40 of an administrator who manages the user, the elderly through the operation server 30. You can communicate with each other. In addition, the smart speaker system 10 is connected to the main control unit 300 through the wireless communication unit 200, the hardware unit 100, the electromagnetic wave generation unit 400 and the user emotion input unit through the main control unit 300 500 can be controlled.

The main control unit 300 transmits at least one of a user's voice signal received through the microphone module 110 and a user's image received through the camera module 130 to the operation server 30, and The operation server 30 may automatically generate an information message according to the user's voice signal or the user's video, and transmit the information message to the manager mobile terminal 40. The manager mobile terminal 40 transmits a response message to the operation server 30, the operation server 30 to the speaker module 120 or the display module 140 through the main control unit 300 A response message transmitted from the manager mobile terminal 40 may be delivered.

The smart speaker system 10 according to the present embodiment may be provided in the home of each elderly person for health and life management of the elderly person, and may be connected to the manager mobile terminal 40 through the operation server 30. For example, when a problem occurs in the health and life of the elderly, the state of the elderly is transmitted through the microphone module 110 as an audio signal, or the video is transmitted to the main control unit 300 through the camera module 130 as an image. Then, the main control unit 300 automatically generates an information message through the user's voice signal and the user's video, and then transmits the information message to the manager's mobile terminal 40 through the operation server 30. have.

In one embodiment of the present invention, the user mobile terminal 20 or the administrator mobile terminal 940 includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, and a personal digital assistant (PDA). assistants), portable multimedia players (PMPs), navigation, slate PCs, tablet PCs, ultrabooks, wearable devices (e.g., smartwatches, glass) Type terminals (smart glass), HMD (head mounted display), and the like.

The wireless communication unit 200 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module.

The broadcast receiving module may receive a broadcast signal or broadcast related information from an external broadcast management server through a broadcast channel. do. The broadcast channel may include a satellite channel and a terrestrial channel, and a broadcast channel may be provided to the speaker module 120 and the display module 140 of the hardware unit 100 through the broadcast receiving module.

The mobile communication module may include technical standards or communication methods for mobile communication (eg, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), and Enhanced EVDO). Voice-Data Optimized or Enhanced Voice-Data Only, WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution) -Advanced), etc.) to transmit and receive radio signals with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module refers to a module for wireless Internet access, and is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies. Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World) Interoperability for Microwave Access (HSDPA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), and Long Term Evolution-Advanced (LTE-A). When viewed from the viewpoint that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A is made through a mobile communication network, the wireless Internet module performing wireless Internet access through the mobile communication network is the It may be understood as a kind of mobile communication module.

The short-range communication module is for short-range communication, Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC (Near Field communication (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technology may be used to support short-range communication. The short-range mobile communication module may support wireless communication between networks through wireless area networks. The short-range wireless communication network may be wireless personal area networks (Wireless Personal Area Networks).

The location information module is a module for acquiring the location (or current location) of the hardware unit 100 together with the user's mobile terminal 20 and the manager's hair terminal 40, a typical example of which is a GPS (Global Positioning System) ) Module or WiFi (Wireless Fidelity) module. For example, when the user mobile terminal 20, the manager's hair terminal 40, and the hardware unit 100 utilize the GPS module, the user's mobile terminal 20 and the manager's hair terminal using signals transmitted from the GPS satellites (40), it is possible to obtain the location of the hardware unit 100. As another example, when the user mobile terminal 20, the manager hair work terminal 40, and the hardware unit 100 utilize the Wi-Fi module, a wireless AP (Wireless Access) that transmits or receives a Wi-Fi module and a radio signal is used. Based on the information of the Point), the location of the user mobile terminal 20, the manager hair work terminal 40, and the hardware unit 100 may be obtained.

Referring to FIG. 2, the electromagnetic wave generator 400 is provided to output sound output from the speaker module 120 as electromagnetic waves by a user's selection, a sound processing unit 410, a sound conversion unit 420, It may include a sound buffer unit 430, a sound stabilization unit 440, the auxiliary coil 450 and the acoustic coil 460.

The smart speaker system 10 according to an embodiment of the present invention may include an electromagnetic wave generator 400 that transmits electromagnetic waves to an elderly person as a main user and to a hearing aid 50 for the elderly person. For example, the user may output the sound from the smart speaker system 10 as sound through the speaker module 120 or as an electromagnetic wave through the electromagnetic wave generation unit 400 as necessary. If necessary, the user may receive through the electromagnetic wave generator 400 when the distance from the smart speaker system 10 is far.

The hearing aid 50 may be made of a hearing aid microphone 51 which is a microphone, an amplifying part (amplifier) 52 and a hearing aid speaker 52 that is a receiver (receiver). The hearing aid microphone 51 converts an analog signal into a digital signal, sends it to an amplifying unit 52, and the amplifying unit 52 converts the amplified sound back into an analog signal and transmits it to the hearing aid speaker 52, resulting in poor hearing. Providing voice signals to people.

The sound processing unit 410 includes a digital-to-analog converter (DAC) 411 for converting a digital signal received from the speaker module 120 into an analog signal, and the digital-to-analog converter It may include an amplifier 412 to amplify the analog signal converted by (411) to a signal of a predetermined size to transmit through the electromagnetic wave generator.

The sound conversion unit 420, by changing the bandwidth of the digital signal to generate electromagnetic waves to be received by the user's hearing aid 50, is transmitted to the auxiliary coil 450, implemented in software to modulate the pulse band It can include. The sound conversion unit 420 converts the bandwidth of the digital voice signal to convert it into a pulse-width modulation (PWM) signal with low noise. The pulse band modulation is one of the pulse modulation methods, and can be performed by maintaining the voltage constant and adjusting the time step by step by modulating the pulse width according to the duty ratio of the digital audio signal. have. The pulse band modulation may be provided with voltage output and output time by the following (Expression 1) and (Expression 2).

(Equation 1) V _output = V _unit

V _output is the output voltage of the pulse-band modulated signal, V _unit is the unit voltage of the digital signal, and the output voltage remains constant even when converted to the band-modulated signal.

(Equation 2) T _output = T _unit /2 ^nx (2 ^n-1 x D _n + 2 ^n-2 x D _n-1 + ?? +2 ¹ x D ₂ + 2 ⁰ x D ₁ )

In Equation 2, the output time of the pulse band modulation signal can be obtained, T _output is the output time of the pulse band modulation, T _unit is the unit time of the digital signal, n is the number of bits of the digital signal, and D _n is n- It means a digital signal corresponding to a bit. For example, an 8-bit digital audio signal 11001100 having a unit voltage of 3V and a unit time of the digital signal of 256usec may be represented by the sound converter 420 as follows.

V _output = 256usec / 2 ⁸ x (2 ⁷ x 1 + 2 ⁶ x 1 + 2 ⁵ x 0 + 2 ⁴ x 0 + 2 ³ x 1 + 2 ² x 1 + 2 ¹ x 0 + 2 ⁰ x 0) = 204usec

That is, the sound conversion unit 420 outputs a signal whose pulse width is converted by the output time (204usec) obtained from the above equation.

The sound conversion unit 420 has an advantage in that product development is easy because it can be implemented in hardware or software. In addition, it is possible to increase the user's convenience (for example, by lowering the volume of a specific frequency band or selecting a noise filter so that the lowest noise is heard) by configuring the software so that it can be adjusted by the user.

The sound buffer unit 430 may include temporarily storing a signal output from the sound conversion unit 420 and outputting the signal to the auxiliary coil 450. The sound buffer unit 430 outputs a pulse band modulation signal to the auxiliary coil 450 when the auxiliary coil 450 is available depending on whether the auxiliary coil 450 is available, and outputs the auxiliary coil 450. If not available, the pulse band modulation signal input to the sound conversion unit 420 is temporarily stored.

The sound stabilization unit 440 may be connected to the auxiliary coil 450 to remove noise included in the signal output from the sound conversion unit 420, and may include a capacitor or a coil.

The acoustic coil 460 is a coil for generating a voice signal and is configured to be separated from the auxiliary coil 450 for generating electromagnetic waves. In addition, the acoustic coil 450 is connected in series with the sound processing unit 410 through an auxiliary coil connection line, and outputs a digital audio signal output from the sound processing unit 410 as an acoustic signal.

The auxiliary coil 450 is a coil that generates electromagnetic waves so that the user's hearing aid 50 can hear the reception sound, and is connected in parallel to the acoustic coil 460 and the acoustic coil connecting line through the auxiliary coil connecting line, Connected to the sound conversion unit 420 for converting a digital voice signal applied through the acoustic coil connection line to the pulse band signal on the auxiliary coil connection line according to a signal output from the sound conversion unit 420 Control the generation of electromagnetic waves. For example, an electromagnetic wave of a signal converted by the sound conversion unit 420 is generated, and the electromagnetic wave waveform can be changed in the auxiliary coil 450.

In the hearing aid 50, the hearing aid microphone 51 senses electromagnetic waves generated from the auxiliary coil 450 and outputs it to the amplifying unit 52 of the hearing aid 50, and the amplifying unit 52 is the hearing aid A voice signal is provided by the user through the speaker 53.

Referring to FIG. 3, the smart speaker system 10 according to the present embodiment may include a user emotion input unit 500. The user emotion input unit 500 is composed of a normal button, a happiness button, an angry button, a fear button, a sadness button and a surprise button for the user to select and input the user's emotion and output emotion information, and the housing module ( Emotion selection button 510 provided in the form of a button so that the user can press on the outer surface of 150); And an emotion communication unit 520 that transmits emotion information of the user transmitted by the emotion selection button 510 selected and pressed by the user to the main control unit 300.

The emotion selection button 510 is provided on the outer surface of the housing module 150 may be provided in an analog form to be pressed in the form of a button. In the case of the elderly, when the emotion is severe, the digital touch input may make the emotional state of the elderly more confusing, thereby making the user's state worse.

Therefore, in the smart speaker system 10 according to the present embodiment, the user who selects the user's emotion and inputs the user interface input to the smart speaker system 10 with analog sensitivity is provided, so that the elderly user is more friendly. Can be approached.

The sound and image implemented in the smart speaker system 10 may be controlled by the user's emotion information transmitted to the smart speaker system 10 through the user emotion input unit 500. For example, the main control unit 300 is a kind of sound output through the speaker module 120 according to the emotion information of the user received from the emotion communication unit 520 and the type of the image displayed on the display module 140. And the main control unit 300 may transmit the emotion information to the operation server 30.

The emotion communication unit 520 is the user's emotional information, normal, happy, determined by at least one of a normal button, a happy button, an angry button, a fear button, a sad button and a surprise button, which are the emotion selection buttons 510 pressed by the user, Anger, fear, sadness, and surprise may be transmitted to the main control unit 300. The main control unit 300 extracts the location values from the sound files and image files corresponding to the emotion information of normal, happiness, anger, fear, sadness, and surprise, respectively, and displays the types and images of sounds corresponding to the location values. The type may be determined, and the determined type of sound and image may be transmitted to the speaker module 120 and the display module 140, respectively. When the emotion information corresponding to anger, fear, sadness and surprise overlaps for 3 days or more, the main control unit 300 may transmit it to the operation server 30.

Recently, with the aging population, the number of elderly people living alone is increasing, and one of their main problems is feeling emotional loneliness. This leads to emotional illness in the elderly, and in severe cases, to physical illness, it can also be a problem.

The user emotion input unit 500 primarily selects a sound type and a video type corresponding to the user's emotion through the main control unit 300, and reflects this to reflect the speaker module 120 and the display module By being reflected in (140), it is possible to give emotional empathy and comfort to the user, so that the emotional stability of the elderly user can be maintained.

On the other hand, the smart speaker system 10 according to the present embodiment can reduce the loneliness of the elderly by providing sound and images to the elderly, and additionally, the sound through the user emotion input unit 500 reflects the feeling of the user's current state Since it can provide the type of video and the type of video, it can help the emotional stability of the user.

In addition, the user emotion input unit 500 secondarily, when the emotion information corresponding to anger, fear, sadness and surprise overlaps for 3 days or more, it is transmitted to the operation server 30, and the operation server ( 30) can be delivered to the manager mobile terminal 40. Accordingly, the manager mobile terminal 40 transmits negative emotion information such as anger, fear, sadness, and surprise to the manager, and allows the manager to proceed to the user's psychological state, such as visiting the user offline, to emotionalize the user. Even the phosphorus portion can be managed with minimal care. The user emotion input unit 500 may be provided on an outer surface well visible to the user in the housing module 150.

4 is a schematic perspective view of hardware of the smart speaker system of FIG. 1. 5 is an exploded perspective view of the hardware of the smart speaker system of FIG. 4. FIG. 6 is a view for explaining the housing module of FIG. 4. 7 is a view schematically showing the drug supply module of FIG. 4. 8 is a view for explaining a process of operating the drug supply program in the drug supply module of FIG. 9 is a view for explaining a configuration including a smart band according to another embodiment of the present invention. 10 is a block diagram illustrating the internal configuration of the smart band of FIG. 9. 11 is a view for explaining a configuration including a healthcare module according to another embodiment of the present invention. 12A is a cross-sectional view of the healthcare module of FIG. 11. 12B is a cross-sectional view of the seat member of FIG. 11. 13 to 15 are views for explaining the health care module of FIG. 11.

4 and 5, the hardware unit 100 includes a housing module 150 and a microphone module 110, a speaker module 120, and a camera module 130 mounted inside or outside the housing module 150. ), a display module 140, a hearing aid charging unit 152, a medicine supply unit 155, and a healthcare module 160. In addition, the housing module 150 may be provided as a housing 151 having an internal space and a battery unit provided inside the housing 151 to supply power.

The microphone module 110 may be formed of a main microphone 110a mounted on the housing module 150 and used as a main and a sub microphone 110b provided detachably from the housing module 150. The housing module 150 is provided with a first microphone fastening portion 114 that is fastened to the submicrophone 110b, and the submicrophone 110b is a second microphone fastened to the first microphone fastening portion 114. A fastening part 111, a variable extension part 112 extending in a bellows shape so as to be deformable in the second microphone fastening part 111, and a microphone part 113 provided at one end of the variable extension part 112 It can be made of. The sub-microphone 110b may be wirelessly connected to the wireless communication unit 200 by Bluetooth. The first microphone fastening part 114 and the second microphone fastening part 111 are formed in a threaded shape on the outer surface and can be reversibly fastened by screwing.

The smart speaker system may include a microphone module 110 that receives a user's voice signal, and the microphone module 110 is a main microphone 110a fixedly mounted on the housing module 150 of the smart speaker system. And, it may be made of a sub-microphone (110b) provided to be detachable from the housing module 150. The housing module 150 may be provided with a first microphone fastening part 114 in the form of a recessed groove, and may be fastened with a second microphone fastening part 111 provided in the sub-microphone 110b. The sub-microphone 110b may be sequentially formed of a microphone unit 113, a variable extension unit 112, and a second microphone fastening unit 111.

The microphone unit 113 is a portion in which a user's voice signal is directly input, and the variable extension unit 112 may be provided to reversibly change the position of the microphone unit 113. The variable extension portion 112 may be provided in a bellows shape and be deformed to have various lengths and positions, and accordingly, the position of the microphone portion 113 may be variously deformed.

In the smart speaker system according to the present embodiment, the microphone module 150 receiving a user's voice signal includes a sub-microphone 110b, and the sub-microphone 110b can be moved to various positions and detached depending on whether or not it is used. It may be provided to enable. In addition, the sub-microphone 110b may be wirelessly connected by Bluetooth. Therefore, the user may use the sub-microphone 110b mounted on the housing module to complement the function of the main microphone 110a, or when the smart speaker system is separated from the Bluetooth connection of the sub-microphone 110b. By this, the user's voice signal can be input to the smart speaker system.

The main microphone 110a and the sub microphone 110b each include a main sound sensor and a sub sound sensor communicating with the main control unit 300, and the main control unit 300 includes the main sound sensor and the sub The method may further include receiving a first acoustic signal and a second acoustic signal, which are the user's acoustic signals transmitted from each of the acoustic sensors, and correcting the user's acoustic signal by the first acoustic signal and the second acoustic signal. .

Correcting the acoustic signal of the user, the sub-microphone (110b) is mounted on the housing module 150, the main control unit 300 is input through the main sound sensor and the sub-sound sensor The reference data consisting of the initial sound velocity of each of the first sound signal and the second sound signal and the initial received signal time difference are determined, and the main control unit 300 in the state in which the sub microphone 110b is separated from the housing module 150 ) May determine measurement data consisting of a sound velocity and a received signal time difference between the first sound signal and the second sound signal input through the main sound sensor and the sub-sound sensor. The main sound sensor and the sub sound sensor may include a beacon.

The main control unit 300 determines the location of the user by the difference between the reference data and the measurement data, and the main control unit 300 determines the speed of sound output from the speaker module 120 according to the user's location You can control the size of.

In general, when moving away from a sound source to an arbitrary position, acoustically, the sound exhibits two attenuations. First, it is the attenuation of the sound pressure level, which is said to be often reduced. Second, the frequency component of the sound decreases with distance. For this reason, compensating for the attenuated sound is to compensate the sound pressure level for each attenuated frequency. In other words, first, the sound is classified into sound pressure levels for each frequency, and the attenuated sound is compensated as the original sound by the signal processing method by using the result obtained by comparing the sound pressure level by reference frequency and the reference sound pressure level measured at a reference distance for each frequency through a comparator can do.

Specifically, correcting the acoustic signal of the user may be performed in the following manner.

Each of the main sound sensor and the sub sound sensor transmits a signal of a set frequency (for example, an ultrasonic signal). Each of the main microphone 110a and the sub microphone 110b receives a user's voice signal and outputs an electrical signal corresponding thereto.

The sound velocity is measured according to the main microphone 110a and the sub microphone 110b using a sound velocity sensor, and is stored in the main control unit 300 as an initial sound velocity. Subsequently, the sub-microphone 110b is separated from the housing module 150 and then moved using a odometer, the distance between the main microphone 110a and the sub-microphone 110b is changed, and the main microphone ( The sound velocity according to 110a) and the sub-microphone 110b is measured and stored in the main control unit 300 as a changing sound velocity.

In addition, when a signal is received from the main sound sensor and the sub sound sensor to the main control unit 300, the main control unit 300 detects the time received from the main sound sensor and the sub sound sensor, respectively. Based on the time difference of the stored in the main control unit 300.

In this way, the value pre-stored in the main control unit 300 becomes reference data, and the value measured in the process of using the smart speaker system becomes measurement data, and the main control unit 300 compares with the reference data. The user's location may be determined according to the location of the user's voice signal based on the measurement data. Accordingly, the main control unit 300 may control the level of sound output from the speaker module 120 according to the user's location, so that the user can more effectively hear the sound.

In addition, in the case of an elderly person, when sound or pronunciation is not clear and information is directed through the microphone, errors frequently occur, and particularly when the voice signal is far from the microphone, such errors occur more frequently.

On the other hand, the smart speaker system according to the present embodiment can effectively reduce errors due to inaccurate pronunciation by correcting the user's sound signal, thereby removing noise for the user's sound signal input to the smart speaker system. .

The display module 140 is provided with one or more displays 140a, 140b, 140c connected in a block form, and the one or more displays 140a, 140b, 140c have different images by the main control unit 300. It may be provided to indicate. The one or more displays 140a, 140b, and 140c are controlled through the main control unit 300, but may be controlled to display separate images. For example, the one or more displays 140a, 140b, 140c may be composed of first to third displays 140a, 140b, 140c, wherein the first display 140a is an image that a user wants to see by user input. , And the second display 140b may display the state of each component constituting the smart speaker system, and the third display 140c is urgently transmitted through the operation server 30. Images and the like can be displayed.

Referring to FIG. 6, the housing module 150 is provided with an internal space to accommodate at least one of the microphone module 110, speaker module 120, camera module 130, and display module 140. Housing 151; A battery unit provided in an inner space of the housing 151 to supply power; A hearing aid charging unit 152 electrically connected to the battery unit to charge a user's hearing aid; And a medicine supply unit 155 provided on an outer surface of the housing module 150 to supply medicine to a user.

The battery unit may include at least one lithium secondary battery, a BMS controlling the lithium secondary battery, and a charge amount display unit indicating a charging state of the lithium secondary battery. A USB port or the like is provided on the outer surface of the housing 151 to charge the lithium secondary battery of the battery unit. The BMS may include a charging/discharging state of the lithium secondary battery, and a PTC or the like that instantly disconnects the current when an overvoltage is applied.

In addition, the battery unit may include a charge amount display unit indicating the state of charge of the lithium secondary battery, the charge amount display unit is connected to the main control unit 300, the display module 140 through the main control unit 300 ), the user can easily check the state of charge of the lithium secondary battery.

The hearing aid charging unit 152 charges the user's hearing aid 50 and is provided with a hearing aid charger 153 electrically connected to the battery unit and the hearing aid charger 153 to sense the presence or absence of the hearing aid. It may include a sensor 154.

The hearing aid sensor 154 transmits information about the presence or absence of the hearing aid to the main control unit 300, and the main control unit 300 is the user mobile terminal 20, the operation server 30 and the display module 140 ).

In the case of the elderly, the hearing aid is easily lost in location, and the smart speaker system according to the present embodiment is connected to the hearing aid charger 152 and the hearing aid charger 153 capable of charging the hearing aid. A hearing aid sensor 154 capable of confirming whether there is a hearing aid in 153 may be provided. Accordingly, the user can charge the hearing aid in the hearing aid charging unit 152 when the user is adjacent to the smart speaker system. If the user is away from the smart speaker system, whether the hearing aid is in the hearing aid charging unit 152 You can check immediately and use the hearing aid more conveniently.

7 and 8, the medicine supply unit 155 includes: one or more medicine storage units 156 having a space 156a for storing medicines of a user; A weight sensor 157 provided in the weak storage unit 156 to sense the weight of the weak storage unit 156; And a medicine supply control unit 158 receiving the weight of the medicine storage unit 156 from the weight sensor 157 and transferring the user's medication use to the main control unit 300 according to a previously input medicine supply program. It may include.

In the space 156a of the medicine storage unit 156, medicines to be taken by the user are stored, and the weight sensor 157 measures the weight of medicines provided in the medicine storage unit 156 at regular intervals. Is delivered to the drug supply control unit 158, and the drug supply control unit 158 compares the measured weight with the designated weight of the drug supply program including the designated weight that is the weight of the drug specified at the specified time and compares the measured weight with the result value. Transfer to the main control unit 300. The main control unit 300 may be transmitted to the user mobile terminal 20, the operation server 30 and the display module 140 when there is an abnormality based on the result value received through the drug supply control unit 158. have.

In the case of the elderly, most of them frequently take a large number of medicines, but the number of medicines is high and it is frequently forgotten to take medicines. On the other hand, in the smart speaker system according to the present embodiment, by providing the medicine supply unit 155, the elderly user can take the medicine more easily, and if the user is not taking the medicine, the user mobile terminal 20, It can be recalled by being transmitted to the operation server 30 and the display module 140.

The user can separate the medicines in the unit of approximately one week into one batch, and individually provide them in the space 156a of the medicine storage unit 156. Each of the weak storage unit 156 is provided with a weight sensor 157, and the weight sensor 157 may be connected to the main control unit 300.

The main control unit 300 compares the measurement weight transmitted by the weight sensor 157 with the specified weight, and when there is no abnormality in the result value, for example, when the user has consumed one dose, the main control unit 300 ) Does not send any signal to the mobile terminal 20, operation server 30 and display module 140. On the other hand, when there is an abnormality in the result value by comparing the measured weight with the specified weight, for example, if the weight of the medicine storage unit 156 has not changed even after a certain time because the user does not take one dose of the medicine, the main control unit ( 300) may send an alarm to the mobile terminal 20, the operation server 30 and the display module 140 so that the user can recognize that they have not taken medicine.

In addition, the main control unit 300 allows such an alarm to be transmitted to the manager mobile terminal 40 through the operation server 30 when the alarm is continuously repeated for a predetermined period of time, and through this, the manager determines whether the user who is an elderly user is abnormal. Can be aware of.

9 and 10, a smart speaker system according to an embodiment of the present invention

The wireless communication unit 200 is wirelessly connected to receive a user's status signal, and further includes a smart band 600 for transmitting the user's status signal to the user's main control unit 300, wherein the user's status signal is It may include one or more of a heart rate, a user's steps, a user's blood pressure, a user's current location information, and a user's voice signal.

The smart band 600 includes a heart rate sensor 610, pedometer sensor 620, blood pressure sensor 630, GPS 640, band microphone 650, band speaker 660, band input unit 670, and band It may include a display unit 680, a band communication unit 692, a band control unit 690, a band memory unit 691 and a band battery 693.

The heart rate sensor 610 measures the heart rate of the user and outputs it as a detection signal, and the pedometer sensor 620 measures the number of steps of the user and outputs it as a detection signal, and the blood pressure sensor 630 is the The user's blood pressure can be measured and output as a detection signal. The GPS 640 outputs the current location information of the user as a detection signal, the band microphone 650 is provided to input the user's voice signal, and the band speaker 660 can be provided to output voice. have. The band input unit 670 is provided for operation selection and information input, the band display unit 680 is provided for display of the operation status and information, and the band communication unit 692 is provided with the wireless communication unit 200 Communication can be performed.

The band control unit 690 controls to perform the operation selected by the band input unit 670, the heart rate sensor 610, the pedometer sensor 620, the blood pressure sensor 630, and the GPS 640 Each detection signal is provided to the main control unit 300 by communication by the wireless communication unit 200, and the user's voice signal input through the band microphone 650 is transmitted through the main control unit 300. Provided to the speaker module 120 or the electromagnetic wave generator 400, and by providing the user's voice signal provided through the main control unit 300 from the microphone module 110 through the band speaker 660, the It may be controlled to perform a 1:1 conversation with the smart speaker system at a place remote from the smart speaker system, or to provide voice to the smart speaker system. The band memory unit 691 stores information and programs obtained or obtained from the operation, and the band battery 693 may supply power required for the operation.

The smart band 600 may transmit status signals of various users to the main control unit 300 by being adopted by the user on the wrist. In the main control unit 300, a basic status signal for an elderly person is pre-input, and when the user's status signal transmitted through the smart band 600 differs from the pre-input basic status signal, the main control unit ( 300) can be delivered to the administrator's mobile terminal through the operation server, it is possible to more easily manage the health and life of the elderly.

11 to 15, the healthcare module 160 includes a sheet member 161 provided to surround a part of the upper surface of the housing module; A signal sensing member 162 made of a conductive material provided on the sheet member 161 to sense a human body signal formed in contact with the user's human body; A socket 163 connected to the signal detecting member 162 and transmitting a human body signal sensed by the signal detecting member 162 to the main control unit 300; And it may include a signal processing unit 164 for receiving a signal transmitted through the socket 163.

The signal detecting member 162 is provided in the form of a wire formed by coating copper on the carbon fiber yarn, and the healthcare module 160 may be provided to be removably detachable from the housing module. The main control unit 300 may transmit the human body signal transmitted through the socket 163 to the user mobile terminal 20 and the operation server 30.

The housing module 150 is provided in the form of a cylindrical pillar, and the healthcare module 160 is provided in an empty donut shape on the upper surface of the housing module 160, so that the upper surface of the housing module 150 is provided. It is provided to surround the edge, the seat member 161 of the healthcare module 160 may include a polyurethane material having an elastic force. Preferably, the seat member 161 is provided with a cover leather 161a, a polyurethane material sheet 161b, and a cover leather 161a sequentially stacked, and the inside is a polyurethane material 161b, The outer surfaces of both sides may be provided in a form in which three layers are laminated with a cover leather 161a. The seat member 161 may be attached to the cover leather 161a, a polyurethane sheet 161b, or a cover leather 161a using a rod material and an adhesive. For example, the signal sensing member 162 may be sewn and fixed only to the cover leather 161a provided on the outer surface of the two cover leathers 161a. Since the signal sensing member 162 is provided on the cover leather 161a provided on the outer surface of the cover leather 161a, the user's human body signal can be effectively measured by directly contacting the user's hand.

The seat member 161 is provided to have an elastic force, so that the health care module 160 is provided to surround the edge of the upper surface of the housing module 150, thereby protecting the housing module 150 with external force, At the same time, the sharp part of the edge of the housing module 150 is protected to prevent a user from being injured. In addition, the seat member 161 can be implemented in various colors by the cover leather 161a, so that the appearance of the smart speaker system can be more beautiful.

The signal detecting member 162 may be sewn along the outer periphery of the seat member 161, and protrude to the outside to be connected to the socket 163. The socket 163 is electrically connected to the housing module 150 to transmit a human body signal to the main control unit 300. In the signal detecting member 162, two independent sensors protruding outward of the seat member 161 may be connected to the socket 163, and the two independent sensors may each independently transmit a signal. In addition, the signal sensing member 162 may be provided to surround the two independent sensors exposed to the outside between the seat member 161 and the socket 163 with an insulating material for insulation.

The socket 163 transmits the human body signal detected by the signal sensing member 162 to the main control unit 300, and the main control unit 300 is electrically connected to the user mobile terminal 20 or the operation server 30. It is connected to transmit the human body signal sensed from the signal sensing member 162. The socket 163 is provided with a connector (not shown), and by allowing an external wire or the like to be connected to the connector, the housing module 150 is thrown to be connected to the main control unit 300.

The signal detection member 162 is composed of two independent sensors, the user's hand touches the first signal (s1) and the second signal (s2) can be transmitted to the signal processing unit 164, for example, the user's left hand The first signal s1 formed by touching and the second signal s2 formed by touching the user's right hand may be independently transmitted. The signal processing unit 164 receives the first signal s1 and the second signal s2 having different waveforms from the signal detection sensor unit 110, and the received first signal and the second signal s1, s2 ) Is synthesized to generate a new signal S. The signal processing unit 164 generates and outputs a signal S of an electrocardiogram waveform as a new signal, and transmits the signal S of the output electrocardiogram waveform to the main controller 300.

The main control unit 300 performs a pulse rate check and a stress check of the driver using the signal S of the ECG waveform received from the signal processing unit 164. The main control beam 300 processes the signal S of the ECG waveform received from the signal processing unit 164 as a signal that changes over time, and checks the user's pulse rate and stress using the processed signal.

The main control unit 300 may process and express the signal S of the ECG waveform as a processing signal S-1 having a waveform change over time, and the processing signal S-1 peaks at a specific interval. It has a point (p1 to p4 with pulses soaring to its highest value). The main control unit 300 is provided with a counter to count the number of peak points at which the processing signal S-1 exceeds a reference value. For example, as shown in FIG. 15, since the peak points exceeding the reference value of the processing signal S-1 are p1, p2, p3, and p4, the pulse rate counted by the counter of the main controller 310 is four. When the unit time is set to 60 seconds or longer, the pulse rate counted by the counter is about 60 to 100 times when the processed signal S-1 indicates normal.

Alternatively, the pulse rate can be checked using the time interval at which the peak point occurs. For example, the pulse rate is calculated by dividing 1 minute (60 seconds) by the time interval at which the peak point occurs. For example, when the peak point generation time interval t1 is 0.5 seconds, the pulse rate is 120 times divided by 60 seconds divided by 0.5 seconds. The main control unit 300 determines the stress level of the user (driver) by comparing the time intervals at which peaks occur. For example, if the electrocardiogram waveform processing signal (S-1) has a constant peak point generation time interval, that is, if the peak point occurs at regular intervals in the electrocardiogram waveform processing signal (S-1), the main control unit 300 Determines that the stress received by the user having the signal S of the corresponding ECG waveform is relatively severe (high). On the other hand, if the peak point generation time interval of the processing signal S-1 is not constant and different from each other, the main control unit 300 has a relatively low (low) stress under the stress of the user having the corresponding ECG waveform S I judge that.

One or more detection sensors communicating with the main control unit 300 may be further provided on the inner periphery of the healthcare module 160. The detection sensor detects the concentration of fine dust in the air and transmits a fine dust concentration value to the main control unit 300, detects the concentration of carbon monoxide (CO) in the air and detects the concentration of carbon monoxide in the air to the main control unit 300 It may include a second sensor for detecting the carbon monoxide concentration (165b). The main control unit 300 may transmit the fine dust concentration value and the carbon monoxide concentration value transmitted through the first detection sensor 165a and the second detection sensor 165b to be displayed on the display module 140, respectively.

The healthcare module 160 according to an embodiment of the present invention may further include first and second detection sensors 165a and 165b capable of measuring carbon monoxide concentration and fine dust concentration, respectively. The first and second detection sensors 165a and 165b allow the user to control the indoor environment, so that a user can live in a healthier environment.

Those of ordinary skill in the art to which the present invention pertains will appreciate that the present invention may be implemented in other specific forms without changing its technical spirit or essential features. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. The scope of the present invention is indicated by the scope of the claims, which will be described later, rather than the detailed description, and all the changed or modified forms derived from the meaning and scope of the claims and their equivalent concepts are included in the scope of the present invention. Should be interpreted.

10: smart speaker system
20: user mobile terminal
30: Operation server
100: hardware part
110: microphone module
120: speaker module
130: camera module
140: display module
150: housing module
160: health care module
200: wireless communication unit
300: main control unit
400: electromagnetic wave generator
500: emotion input unit

Claims (13)

In the smart speaker system using the user mobile terminal and the operating server,
A microphone module 110 that receives a user's voice signal, a speaker module 120 that outputs sound to a user in service provision, a camera module 130 that photographs the user, and a display module 140 that displays an image to the user ), the housing module 150 for storing the microphone module 110, speaker module 120, camera module 130 and display module 140, and user health provided on one surface of the housing module 150 A hardware unit 100 having a check health care module 160;
A wireless communication unit 200 for wirelessly connecting the hardware unit 100, the user mobile terminal 20, and the operation server 30;
Control the operation of at least one of the microphone module 110, speaker module 120, camera module 130, display module 140, housing module 150 and healthcare module 160, and the wireless communication unit ( 200) to communicate with the main control unit 300;
An electromagnetic wave generator 400 controlled by the main control unit 300 to generate electromagnetic waves to the user's hearing aid 40; And
Includes a user emotion input unit 500 for the user to select and input the user's emotions,
The user emotion input unit 500,
The user selects the user's emotions and consists of a normal button, a happiness button, an angry button, a fear button, a sadness button, and a surprise button to output emotion information, and the user can press it on the outer surface of the housing module 150 Emotion selection button 510 provided in the form of a button so that; And
It includes; emotional communication unit 520 for transmitting the user's emotion information transmitted by the user's emotion selection button 510 selected and pressed to the main control unit 300;
The main control unit 300 determines the type of sound output through the speaker module 120 and the type of the image displayed on the display module 140 according to the emotion information of the user received from the emotion communication unit 520. and,
The main control unit 300 transmits the emotion information to the operation server 30,
The emotion communication unit 520 is the user's emotional information, normal, happy, determined by at least one of the normal button, the happy button, the angry button, the fear button, the sad button and the surprise button, which are the user's emotion selection button 510. Deliver anger, fear, sadness and surprise to the main control unit 300,
The main control unit 300 extracts the location values from the sound files and image files corresponding to the emotion information of normal, happiness, anger, fear, sadness, and surprise, respectively, and displays the types and images of sounds corresponding to the location values. Determine the type, and transmits the determined type of sound and video to the speaker module 120 and the display module 140, respectively.
The main control unit 300 is a smart speaker system for the health and life management of the elderly to deliver to the operation server 30 when the emotion information corresponding to anger, fear, sadness and surprise overlaps for 3 days or more. According to claim 1,
Further comprising a manager mobile terminal 40 to communicate with the operation server 30,
The main control unit 300 transmits at least one of the user's voice signal received through the microphone module 110 and the user's video received through the camera module 130 to the operation server 30,
The operation server 30 automatically generates an information message according to the user's voice signal or the user's video, and transmits the information message to the manager mobile terminal 40,
The manager mobile terminal 40 transmits a response message to the operation server 30,
The operation server 30 manages the health and life of the elderly who delivers a response message transmitted from the manager mobile terminal 40 to the speaker module 120 or the display module 140 through the main control unit 300. Smart speaker system for. According to claim 1,
The electromagnetic wave generator 400 is provided to output the sound output from the speaker module 120 as electromagnetic waves at the user's choice, a sound processing unit 410, a sound conversion unit 420, a sound buffer unit 430 , Includes a sound stabilization unit 440, auxiliary coil 450 and acoustic coil 460,
The sound processing unit 410,
A digital-to-analog converter (DAC) 411 for converting the digital signal received from the speaker module 120 into an analog signal, and the analog converted by the digital-analog converter 411 It includes an amplifier 412 for amplifying a signal of a certain size to transmit a signal through the electromagnetic wave generating unit,
The sound conversion unit 420,
In order to generate an electromagnetic wave to be received by the user's hearing aid 50, the bandwidth of a digital signal is changed and transmitted to the auxiliary coil 450, but is implemented in software to modulate a pulse band.
The sound buffer unit 430,
And temporarily outputting the signal output from the sound conversion unit 420 to the auxiliary coil 450,
The sound stabilization unit 440,
Smart speaker system for health and life management of the elderly, which is connected to the auxiliary coil 450 to remove the noise included in the signal output from the sound conversion unit 420, including a capacitor or a coil. delete delete According to claim 1,
The microphone module 110 is composed of a main microphone 110a mounted on the housing module 150 and used as a main, and a sub microphone 110b provided detachably from the housing module 150,
The housing module 150 is provided with a first microphone fastening portion 114 that is fastened to the submicrophone 110b, and the submicrophone 110b is a second microphone fastened to the first microphone fastening portion 114. A fastening part 111, a variable extension part 112 extending in a bellows shape so as to be deformable in the second microphone fastening part 111, and a microphone part 113 provided at one end of the variable extension part 112 Is made of,
The sub-microphone 110b is a smart speaker system for health and life management of the elderly who is wirelessly connected to the wireless communication unit 200 by Bluetooth. The method of claim 6,
The main microphone 110a and the sub microphone 110b each include a main sound sensor and a sub sound sensor communicating with the main control unit 300, and the main control unit 300 includes the main sound sensor and the sub Further comprising receiving the first acoustic signal and the second acoustic signal of the user's acoustic signal transmitted from each of the acoustic sensors, and correcting the user's acoustic signal by the first acoustic signal and the second acoustic signal, the Correcting the user's sound signal,
In the state in which the sub-microphone 110b is mounted on the housing module 150, the main control unit 300 is a first acoustic signal and a second acoustic signal input through the main acoustic sensor and the sub-acoustic sensor, respectively. Determine the reference data consisting of the initial sound velocity and the time difference between the initial received signals,
In the state in which the sub-microphone 110b is separated from the housing module 150, the main control unit 300 is configured to sense each of the first sound signal and the second sound signal input through the main sound sensor and the sub-sound sensor. Determine measurement data consisting of sound velocity and time difference between received signals,
The main control unit determines the location of the user by the difference between the reference data and the measurement data,
The main control unit 300 is a smart speaker system for health and life management of the elderly to control the size of the speed of sound output from the speaker module 120 according to the user's location. According to claim 1,
The display module 140 is provided with one or more displays 140a, 140b, 140c connected in a block form, and the one or more displays 140a, 140b, 140c have different images by the main control unit 300. Smart speaker system for health and life management of the elderly provided to display. According to claim 1,
The housing module 150,
A housing 151 having an internal space to accommodate at least one of the microphone module 110, speaker module 120, camera module 130, and display module 140;
A battery unit provided in an inner space of the housing 151 to supply power;
A hearing aid charging unit 152 electrically connected to the battery unit to charge a user's hearing aid; And
Included on the outer surface of the housing module 150, the medicine supply unit 155 for supplying medicine to the user;
The battery unit includes at least one lithium secondary battery, a BMS for controlling the lithium secondary battery, and a charge amount display unit indicating a charging state of the lithium secondary battery,
The hearing aid charging unit 152 charges the user's hearing aid 50 and is provided with a hearing aid charger 153 electrically connected to the battery unit and the hearing aid charger 153 to sense the presence or absence of the hearing aid. It includes a sensor 154,
The hearing aid sensor 154 transmits information about the presence or absence of the hearing aid to the main control unit 300, and the main control unit 300 is the user mobile terminal 20, the operation server 30 and the display module 140 Smart speaker system for health and life management of the elderly. The method of claim 9,
The medicine supply unit 155,
One or more medicine storage unit 156 having a space for storing the user's medicine (156a);
A weight sensor 157 provided in the weak storage unit 156 to sense the weight of the weak storage unit 156; And
A medicine supply control unit 158 receiving the weight of the medicine storage unit 156 from the weight sensor 157 and transferring the user's medication use to the main control unit 300 according to a previously input medicine supply program; Including,
In the space 156a of the medicine storage unit 156, medicines to be taken by the user are stored,
The weight sensor 157 transmits the measurement weight obtained by measuring the weight of the medicine provided in the medicine storage unit 156 at regular time intervals to the medicine supply control unit 158,
The drug supply control unit 158 compares the measurement weight with the designated weight of the drug supply program including the designated weight, which is the weight of the drug specified at the specified time, and delivers the result value to the main control unit 300,
The main control unit 300 transmits to the user mobile terminal 20, the operation server 30 and the display module 140 when there is an abnormality based on the result value received through the drug supply control unit 158 Smart speaker system for elderly people's health and life management. According to claim 2,
The wireless communication unit 200 is wirelessly connected to receive a user's status signal, and further includes a smart band for transmitting the user's status signal to the user's main control unit 300,
The user's status signal includes one or more of a user's heart rate, a user's steps, a user's blood pressure, a user's current location information, and a user's voice signal,
The smart band 600,
A heart rate sensor 610 that measures the user's heart rate and outputs it as a detection signal;
A pedometer sensor measuring the number of steps of the user and outputting it as a detection signal;
A blood pressure sensor 630 that measures the user's blood pressure and outputs it as a detection signal;
A GPS 640 for outputting the current location information of the user as a detection signal;
A band microphone 650 provided to input the user's voice signal;
A band speaker 660 provided to output voice;
A band input unit 670 provided for operation selection and information input;
A band display unit 680 provided for the display of the operating status and information;
A band communication unit 692 to perform communication with the wireless communication unit 200;
Control to perform the operation selected by the band input unit 670, the heart rate sensor 610, the pedometer sensor 620, the blood pressure sensor 630 and the GPS 640, respectively, the detection signal of the wireless Provided to the main control unit 300 by communication by the communication unit 200, the user's voice signal input through the band microphone 650 through the main control unit 300, the speaker module 120 or electromagnetic waves Provided to the generating unit 400, and by providing the user's voice signal provided through the main control unit 300 from the microphone module 110 through the band speaker 660, from the smart speaker system 10 A band control unit 690 that controls to perform a 1:1 conversation with the smart speaker system 10 at a spaced apart location, or controls to provide voice to the smart speaker system 10;
A band memory unit 691 for storing information and programs obtained from the operation or necessary for the operation; And
Band battery (693) for supplying the power required for operation; Smart speaker system for health and life management of the elderly. According to claim 1,
The health care module 160 includes a sheet member 161 provided to surround a part of the upper surface of the housing module 150;
A signal sensing member 162 made of a conductive material provided on the sheet member 161 to sense a human body signal formed in contact with the user's human body;
A socket 163 connected to the signal detecting member 162 and transmitting a human body signal sensed by the signal detecting member 162 to the main control unit 300; And
It includes a signal processing unit 164 for receiving a signal transmitted through the socket 163,
The seat member 161 is in the form of a cover leather 161a, a polyurethane material sheet 161b, and a cover leather 161a sequentially stacked, inside of which is a polyurethane material sheet and the polyurethane material sheet. The outer surfaces of both sides are each made of cover leather, and three layers are provided in a laminated form.
The signal detecting member 162 is provided in the form of a wire formed by coating copper on the carbon fiber yarn,
The health care module 160 is provided to be removably detachable from the housing module,
The main control unit 300 is a smart speaker system for health and life management of the elderly who delivers the human body signal transmitted through the socket 163 to the user mobile terminal 20 and the operation server 30. The method of claim 12,
The housing module 150 is provided in the form of a cylindrical column, and the health care module 160 is provided in an empty donut shape on the upper surface of the housing module 150 so that the upper surface of the housing module 150 is provided. It is provided to surround the corner,
At least one detection sensor 164 communicating with the main control unit 300 is further provided on the inner periphery of the healthcare module 160,
The detection sensor 164 detects the concentration of fine dust in the air and transmits a fine dust concentration value to the main control unit 300, the first detection sensor 164a, detects the concentration of carbon monoxide (CO) in the air, and the main control unit ( 300) includes a second detection sensor (164b) for transmitting the carbon monoxide concentration value,
The main control unit 300 is for the elderly to deliver the fine dust concentration value and the carbon monoxide concentration value transmitted through the first detection sensor 164a and the second detection sensor 164b to be displayed on the display module 140, respectively. Smart speaker system for health and life management.

Images