KR102307880B1 - Massage apparatus for providing mental massage using facial recognition and operation thereof - Google Patents

Abstract

The present disclosure relates to a method of operating a massage device for providing a mental massage and a massage device, comprising: acquiring a first image of a face of a user sitting in a massage device using a photographing unit; and a first based on a facial expression analysis algorithm obtaining intensity information on a plurality of emotions exposed on the face by analyzing the image, first emotion information corresponding to the largest value among the intensity information on the plurality of emotions, and second emotion corresponding to the second largest value to information
and selecting massage mode information to be provided to the user based on the massage mode information and providing a massage to the user based on the selected massage mode information.

Description

{MASSAGE APPARATUS FOR PROVIDING MENTAL MASSAGE USING FACIAL RECOGNITION AND OPERATION THEREOF}

The present disclosure relates to a method of operating a massage device for providing a mental massage and a massage device. More specifically, the present invention relates to a method of operating a massage device for recognizing a facial expression through a photographing unit and selecting a massage mode based on the recognized facial expression, and to the massage device.

In general, when there is a wound in the human body, pain is felt and the system for wound healing is activated, so the pain subsides over time, leaving a scar on the wound. Unlike these physical wounds, mental wounds leave psychological trauma.

In 1980, when the diagnosis of 'Post Traumatic Stress Disorder (PTSD)' was included in the official diagnosis system, research on psychological trauma began in earnest.

Since then, advances in brain science and technology have revealed how trauma disrupts the brain's nervous system and causes symptoms. After trauma, the human body enters a defensive posture for survival. As the stress hormone 'cortisol' secretion and the activity of the autonomic nervous system are maximized, irritability, concentration problems, insomnia, and impulsive behavior appear even to minor stimuli.

Providing safety and providing a supportive environment is the first step in trauma recovery. Treatments to restore limbic system and cerebral function to help return to daily life include eye movement desensitization (EMDR), hypnosis therapy, and cognition. There are behavioral therapy and neurofeedback therapy, and depending on the symptoms, drug therapy to stabilize the unstable nervous system can be combined. Healing trauma can prevent the direction of life from being twisted or devastation due to aftereffects, and the quicker and more continuous the period, the better the effect.

Laid-Open Patent Publication No. 10-2018-0120564 (2018.11.06.) Registered Patent Publication No. 10-1986956 (2019.06.07.) Registered Patent Publication No. 10-1781953 (2017.09.26.) Laid-open Patent Publication No. 10-2018-0044685 (2018.05.03.)

A method of operating a massage device for providing a mental massage according to the present disclosure includes acquiring a first image of a user's face sitting on the massage device using a photographing unit, analyzing the first image based on a facial expression analysis algorithm, and applying the image to the face. Obtaining intensity information for a plurality of revealed emotions, and providing the user with first emotion information corresponding to the largest value among the intensity information for the plurality of emotions and second emotion information corresponding to the second largest value. It characterized in that it comprises the steps of selecting the massage mode information to be provided and providing a massage to the user based on the selected massage mode information.

The step of selecting a massage mode of the method of operating a massage device for providing a mental massage according to the present disclosure includes performing at least three massages based on the first emotion information and the second emotion information among a plurality of massage modes stored in the massage device. A method comprising: selecting a mode as a massage mode candidate set; and selecting one massage mode from among three massage modes based on a user input; and providing a massage to the user based on the selected one massage mode.

The method of operating a massage device for providing a mental massage according to the present disclosure further includes displaying a plurality of questionnaires on a display, receiving response information to the plurality of questionnaires from a user, and selecting a massage mode includes: , and modifying the massage mode candidate set further based on the response information.

A method of operating a massage device for providing a mental massage according to the present disclosure includes the steps of receiving HRV information from a user based on a heart rate variability (HRV) sensor, comparing the HRV information with a first reference value, the HRV information is a first If it is less than the reference value, determining whether at least three massage modes included in the massage mode candidate set are included in the first group, and at least three massage modes included in the massage mode candidate set are not included in the first group and removing the massage mode.

A method of operating a massage device for providing mental massage according to the present disclosure includes the steps of determining whether at least three massage modes included in a massage mode candidate set are included in a second group when HRV information is equal to or greater than a first reference value; and removing a massage mode not included in the second group among at least three massage modes included in the mode candidate set.

The step of obtaining the user's body information in the method of operating a massage device for providing a mental massage according to the present disclosure includes estimating the user's age from a first image, and a first reference value based on the user's body information The determining may include determining the first reference value based on the age of the user.

The plurality of massage modes of the method of operating a massage device for providing a mental massage according to the present disclosure include a first mode, a second mode, a third mode, a fourth mode, a fifth mode, and a sixth mode, and the first mode The to sixth modes correspond to different music information, and the step of providing the massage to the user may include outputting music corresponding to one selected massage mode based on the user's input.

The first mode of the operating method of the massage device for providing a mental massage according to the present disclosure corresponds to music having a waltz rhythm of 6/8 time, and the second mode is a rhythm of 4/4 time and a low range of C4 or less. The third mode corresponds to the music having a swing rhythm and a fast tempo greater than or equal to allegretto, the fourth mode corresponds to music in 6/8 time and the andantino or moderato tempo, and the fifth mode is It corresponds to music having a slow tempo of andante or less played by the orchestra, and the sixth mode is characterized in that it corresponds to music of a slow swing rhythm of 6/8 time.

The step of providing a massage to the user of the operating method of the massage device for providing a mental massage according to the present disclosure includes the steps of obtaining a second image of the face of the user sitting on the massage device using a photographing unit, based on a facial expression analysis algorithm to analyze the second image to obtain intensity information for pain or intensity information for drowsiness exposed on the user's face, changing selected massage mode information based on intensity information for pain or intensity information for sleepiness It is characterized in that it includes.

In the method of operating a massage device for providing mental massage according to the present disclosure, when the intensity information on pain is greater than the second reference value, lowering the massage intensity-related information among the selected massage mode information and the intensity information on drowsiness is the third When it is greater than the reference value, it characterized in that it comprises the step of lowering the information related to the massage intensity from among the selected massage mode information over time.

The method of operating a massage device for providing a mental massage according to the present disclosure includes changing information related to the inclination of the massage device among selected massage mode information in parallel with the ground over time when the intensity information on drowsiness is greater than a third reference value. It is characterized in that it comprises a step.

In addition, the program for implementing the method of operation of the massage device as described above may be recorded in a computer-readable recording medium.

Bilateral Stimulation is a treatment technique used when daily life is difficult due to past thoughts and emotions. Bilateral stimulation gives rhythmic stimulation to the left and right sides of the body and has the effect of converting negative emotions staying in the user into positive ones.

The massage device to help heal anxiety and depression according to an embodiment of the present disclosure configured as described above provides physical and direct bilateral stimulation to at least a part of the body according to the bilateral stimulation theory, thereby stabilizing the user's mental state There is an effect that can be done.

In addition, the massage device for helping to heal anxiety and depression according to an embodiment of the present disclosure measures the mental state as a user response to the mental massage and reflects it, by providing a feedback massage that matches the change in the user's mental state. , can provide a more precise customized mental massage.

1 is a view for explaining a massage device according to an embodiment of the present disclosure.
2 is a view for explaining a main frame according to an embodiment of the present disclosure.
3 is a view showing a massage device according to an embodiment of the present disclosure.
4 is a view showing an external device that can communicate with the massage device according to an embodiment of the present disclosure.
5 is a flowchart illustrating an operation of a massage device according to an embodiment of the present disclosure.
6 is a diagram illustrating intensity information for emotion according to an embodiment of the present disclosure.
7 is a diagram illustrating a table for acquiring massage mode information based on first emotion information and second emotion information.
8 is a flowchart illustrating a process of determining a user's emotional state using a questionnaire according to an embodiment of the present disclosure.
9 is a flowchart of determining a massage mode based on heart rate variability (HRV) information according to an embodiment of the present disclosure.
10 is a flowchart illustrating a process of changing a massage mode while a user is receiving a massage according to an embodiment of the present disclosure.

Advantages and features of the disclosed embodiments, and methods of achieving them, will become apparent with reference to the embodiments described below in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the present disclosure to be complete, and those of ordinary skill in the art to which the present disclosure pertains. It is only provided to fully inform the person of the scope of the invention.

Terms used in this specification will be briefly described, and the disclosed embodiments will be described in detail.

The terms used in this specification are selected as currently widely used general terms as possible while considering the functions in the present disclosure, but may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, and the like. In addition, in a specific case, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present disclosure should be defined based on the meaning of the term and the contents of the present disclosure, rather than the simple name of the term.

References in the singular herein include plural expressions unless the context clearly dictates that the singular is singular. Also, the plural expression includes the singular expression unless the context clearly dictates the plural.

When a part "includes" a certain element throughout the specification, this means that other elements may be further included, rather than excluding other elements, unless otherwise stated.

Also, as used herein, the term “unit” refers to a software or hardware component, and “unit” performs certain roles. However, "part" is not meant to be limited to software or hardware. A “unit” may be configured to reside on an addressable storage medium and may be configured to refresh one or more processors. Thus, by way of example, “part” includes components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables. The functionality provided within components and “parts” may be combined into a smaller number of components and “parts” or further divided into additional components and “parts”.

According to an embodiment of the present disclosure, “unit” may be implemented with a processor and a memory. The term “processor” should be interpreted broadly to include general purpose processors, central processing units (CPUs), microprocessors, digital signal processors (DSPs), controllers, microcontrollers, state machines, and the like. In some circumstances, a “processor” may refer to an application specific semiconductor (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), or the like. The term "processor" refers to a combination of processing devices, such as, for example, a combination of a DSP and a microprocessor, a combination of a plurality of microprocessors, a combination of one or more microprocessors in combination with a DSP core, or any other such configurations. may refer to.

The term “memory” should be interpreted broadly to include any electronic component capable of storing electronic information. The term memory includes random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erase-programmable read-only memory (EPROM), electrical may refer to various types of processor-readable media, such as erasable PROM (EEPROM), flash memory, magnetic or optical data storage, registers, and the like. A memory is said to be in electronic communication with the processor if the processor is capable of reading information from and/or writing information to the memory. A memory integrated in the processor is in electronic communication with the processor.

Hereinafter, with reference to the accompanying drawings, embodiments will be described in detail so that those of ordinary skill in the art to which the present disclosure pertains can easily implement them. And in order to clearly describe the present disclosure in the drawings, parts irrelevant to the description will be omitted.

1 is a view for explaining a massage device according to an embodiment of the present disclosure.

The massage device 100 according to an embodiment of the present disclosure forms an area for accommodating at least a portion of the user's body, and massages the body massage unit 2100 for massaging the user's body, and the user's legs It may include a leg massage unit 2300.

The body massage unit 2100 may provide a massage to at least a part of the user's body. The body massage unit 2100 includes a massage module 2170 that provides a massage function to at least a part of the user's body, an audio output module 2160 that provides an audio output of any type to the user, and the body massage unit 2100. It may include a main frame 2110 constituting the framework of , and a user input unit 2180 for receiving an input of any type from a user.

The components included in the above-described body massage unit 2100 are merely exemplary embodiments, and the body massage unit 2100 may include various components in addition to the above-described components.

In addition, the shape and structure of the massage device 100 shown in FIG. 1 are merely exemplary, and unless departing from the scope of rights defined by the claims of the present disclosure, the massage device 100 of various types is also disclosed in the present disclosure. It may be included within the scope of the content.

The body massage unit 2100 may form a space of any shape for accommodating the user. The body massage unit 2100 may have a space having a shape corresponding to the shape of the user's body. For example, as shown in FIG. 1 , the body massage unit 2100 may be implemented as a sitting type that can accommodate the user's whole body or a part of the body.

The portion in contact with the ground in the body massage unit 2100 may include an arbitrary material for increasing frictional force or an arbitrary member (eg, an anti-slip pad, etc.) for increasing frictional force, and the massage device 100 It may include wheels for enhancing the mobility of the.

At least a portion of the body massage unit 2100 may slide. For example, when the body massage unit 2100 starts a massage, at least a portion of the body massage unit 2100 may slide forward. In addition, the body massage unit 2100 may be inclined to the rear. As a result, the body massage unit 2100 may provide an air massage in a backward tilted state.

According to an embodiment of the present disclosure, the massage device 100 may include at least one air cell (not shown). The air cell may be located in the user's shoulder part, pelvis part, arm massage part, leg massage part 2300, etc., but is not limited thereto, and may be disposed in various parts of the massage device 100 .

The massage device 100 may include an air supply unit, and the air supply unit may inflate the air cell by supplying air to the air cell. The air supply unit may be located inside the body massage unit 2100 and may be located in the leg massage unit 2300 . In addition, the air supply unit may be located outside the massage device (100).

The leg massage unit 2300 may provide a leg massage to the user. For example, the leg massage unit 2300 may include a calf massage unit that massages the user's calf and/or a foot massage unit that massages the user's feet.

The leg massage unit 2300 may be adjustable in length according to the user's body characteristics. For example, when a tall user uses the massage device 100 , the length of the leg massage unit 2300 needs to be increased because the length of the calf is long. In addition, when a short user uses the massage device 100 , the length of the calf is short and the leg massage unit 2300 needs to be shortened. Accordingly, the leg massage unit 2300 may provide a leg massage customized to the user's height.

The massage module 2170 may be provided inside the body massage unit 2100 to provide any type of mechanical stimulation to the user accommodated in the body massage unit 2100 . As shown in FIG. 1 , the massage module 2170 may move along the main frame 2110 provided in the body massage unit 2100 .

For example, the main frame 2110 of the body massage unit 2100 may be provided with a rack gear, and the massage module 2170 moves along the rack gear, and mechanically provides various parts of the user's body. may provide stimulation. The massage module 2170 may include a ball massage unit or a roller massage unit, but is not limited thereto.

The main frame 2110 constitutes a skeleton of the internal configuration of the body massage unit 2100 and may be implemented with a metal material or a plastic material. For example, the main frame 2110 may be implemented with iron, alloy, steel, etc., but is not limited thereto and may be implemented with various hard materials.

According to an embodiment of the present disclosure, the massage device 100 may include an audio output module 2160 . The audio output module 2160 may be provided in various locations. For example, the audio output module 2160 may include an upper audio output unit disposed on the upper end of the seat unit in contact with the user, a front audio output unit attached to the front end of the left and right arm massage unit of the seat unit, and/or attached to the rear end of the arm massage unit. It may include a plurality of output units, such as a rear audio output unit, but is not limited thereto. In this case, the audio output module 2160 may provide a stereophonic sound such as 5.1 channel, but is not limited thereto.

According to an embodiment of the present disclosure, the user may control the massage apparatus 100 by using the massage apparatus control device 2200 . The massage device control device 2200 may be connected to the massage device 100 through wired communication and/or wireless communication.

The massage device control device 2200 may include a remote controller, a cell phone, a personal digital assistant (PDA), etc., but is not limited thereto, and the massage device 100 and the wired or wireless communication through It may include various connectable electronic devices.

2 is a view for explaining a main frame according to an embodiment of the present disclosure.

According to an embodiment of the present disclosure, the main frame 2110 may include an upper frame 2250 provided with a massage module 2170 and a base frame 2210 supporting the upper frame 2250 .

At least a portion of the upper frame 2250 may be provided with a rack gear 2251 . The rack gear 2251 is a member for guiding the vertical movement of the body massage module 2170 , and may include a plurality of valleys and a plurality of peaks.

According to an embodiment of the present disclosure, the rack gear 2251 may be provided in a form facing both sides of the upper frame 2250 , and the body massage module 2170 may move along the rack gear 2251 . .

In FIG. 2 , the rack gear 2251 is formed in the vertical direction, but is not limited thereto. The rack gear 2251 may include a rack gear in a front-rear direction and a rack gear in a vertical direction. In the present disclosure, the front-rear direction means a direction from the body massage module 2170 to the user or from the user to the body massage module 2170 , and may also be referred to as a Z-axis direction.

The body massage module 2170 may include a gear meshed with the rack gear 2251 . More specifically, the body massage module 2170 may include gears meshed with the front-rear-direction leg gear and the vertical-direction leg gear, respectively. As the gear rotates by the actuator provided in the body massage module 2170, the body massage module 2170 may move forward, backward, upward or downward.

As the body massage module 2170 moves forward, the intensity of the massage may increase. In addition, as the body massage module 2170 moves backward, the strength of the massage may be weakened.

The rack gear 2251 may be implemented with a metal material or a plastic material. For example, the rack gear 2251 may be implemented with iron, steel, alloy, reinforced plastic, melamine resin, phenol resin, etc., but is not limited thereto.

The upper frame 2250 may be implemented in various shapes. For example, the upper frame 2250 may be divided into an S frame, an L frame, an S&L frame, and a double S&L frame according to a shape, but is not limited thereto.

The S frame means a frame in which at least a portion of the upper frame 2250 includes a curved shape like “S”. The L frame means a frame in which at least a portion of the upper frame 2250 includes a curved shape like “L”, and the S&L frame includes both a curved shape like “S” and a curved shape like “L”. and double S&L frame means a frame that includes a curved shape like “L” and a curved shape like “S” of two parts.

The base frame 2210 supports the upper frame 2250 of the main frame 2110 and refers to a portion in contact with the ground. The base frame 2210 may include a base upper frame 2211 and a base lower frame 2212 .

The base upper frame 2211 may support the upper frame 2250 , and the base lower frame 2212 may be in contact with the ground. In addition, the base upper frame 2211 may be positioned in contact with the base lower frame 212 .

According to an embodiment of the present disclosure, the base upper frame 2211 may move along the base lower frame 2212 . For example, the base upper frame 2211 may slide forward or backward along the base lower frame 2212 . In this case, the upper frame 2250 may be connected to the base upper frame 2211 and move according to the movement of the base upper frame 2211 .

For example, when the base upper frame 2211 moves forward, the upper frame 2250 may also move forward together, and when the base upper frame 2211 moves rearward, the upper frame 2250 also moves backward together. can move Due to this, sliding movement of the body massage unit 2100 may be allowed.

Specifically, in order to allow movement of the base upper frame 2211 , a moving wheel may be provided at a lower portion of the base upper frame 2211 . In addition, a guide member capable of guiding the moving wheel may be provided at an upper portion of the base lower frame 2212 . By moving the moving wheel provided in the base upper frame 2211 along the guide member provided in the base lower frame 2212 , a forward movement or a rearward movement of the base upper frame 2211 may be allowed.

According to another embodiment of the present disclosure, the massage device 100 may not provide a sliding function, and in this case, the base frame 2210 may not be separated into upper and lower frames.

3 is a view showing a massage device according to an embodiment of the present disclosure.

The massage device 100 may include a processor 110 and a memory 120 . The processor 110 may execute instructions stored in the memory 120 .

The processor 110 may control the operation of the massage device 100 . The massage device 100 may include one processor and may include a plurality of processors. When the massage device 100 includes a plurality of processors, at least some of the plurality of processors may be located at physically separated distances. Also, the massage device 100 is not limited thereto and may be implemented in various ways.

According to an embodiment of the present disclosure, the processor 110 may control the operation of the massage device 100 . For example, the massage apparatus 100 may include a plurality of actuators, and the massage apparatus 100 may control the operation of the massage apparatus 100 by controlling the operation of the plurality of actuators. For example, the massage device 100 includes at least one of a massage module 2170 movement actuator, at least one actuator included in the massage module, a back angle actuator, a leg angle actuator, a foot massage actuator, a leg length adjustment actuator, and a sliding actuator. may include, and the processor 110 may control the operation of the massage device 100 by controlling them.

The massage module movement actuator is an actuator that enables vertical movement of the massage module 2170, and the massage module 2170 may move along the leg gear by the operation of the massage module 2170 movement actuator.

The back angle actuator is an actuator that adjusts the angle of the portion where the user's back contacts in the massage device 100 , and the isometric angle of the massage device 100 may be adjusted by the operation of the isometric actuator.

The leg angle actuator is an actuator for adjusting the angle of the leg massage unit 2300 of the massage device 100. The angle between the leg massage unit 2300 and the body massage unit 2100 can be adjusted by the operation of the leg angle actuator. have.

The foot massage actuator represents an actuator that operates the foot massage module included in the leg massage unit 2300 . By utilizing the foot massage actuator, the massage device 100 may provide a foot massage to the user.

At least one actuator may be included in the massage module 2170 , and the processor 110 may provide various massage operations by operating the at least one actuator. For example, the processor 110 may provide a tapping massage, a kneading massage, etc. by operating at least one actuator included in the massage module 2170, but is not limited thereto, and may provide various massage operations.

The leg length adjustment actuator refers to an actuator that adjusts the length of the leg massage unit 2300 . For example, the processor 110 may adjust the length of the leg massage unit 2300 to fit the user by using the leg length adjusting actuator, and as a result, the user may be provided with a massage suitable for the body type.

The sliding actuator enables the sliding operation of the massage device 100 . For example, the horizontal base upper frame may move forward or backward by the operation of the sliding actuator, and as a result, the upper frame connected to the horizontal base upper frame may also move forward or backward.

The memory 120 may store various information related to the massage device 100 . For example, the memory 120 may include massage control information and may include personal authentication information, but is not limited thereto.

The memory 120 may be implemented through a non-volatile storage medium capable of continuously storing arbitrary data. For example, memory 120 may include, but is not limited to, disk, optical disk, and magneto-optical storage devices, as well as storage devices based on flash memory and/or battery-backed memory. does not

The massage device 100 may include a sensor unit. The sensor unit may acquire various information by using at least one sensor. The sensor unit may be provided as a sensor using measuring means such as pressure, potential, and optics. For example, the sensor may include a pressure sensor, an infrared sensor, an LED sensor, a touch sensor, and the like, but is not limited thereto.

Also, the sensor unit may include a biometric information acquisition sensor. The biometric information acquisition sensor may acquire fingerprint information, face information, voice information, iris information, weight information, electrocardiogram, body composition information, etc., but is not limited thereto, and may include various biometric information.

According to another embodiment of the present disclosure, the massage device 100 may sense a contact area and/or a contact position with the user through sensors. Also, the massage device 100 may provide a customized massage based on information acquired through sensors. Also, the massage device 100 may include a communication unit. The communication unit of the massage device 100 may receive a signal to an external device. The processor 110 may obtain a result signal by processing the received signal. The communication unit may output a result signal to an external device.

The communication unit may communicate with a module inside the massage device 100, an external massage device, and/or the user terminal 2200 through any type of network. The communication unit may include a wired/wireless connection module for network connection. As the wireless access technology, for example, Wireless LAN (WLAN) (Wi-Fi), Wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink PacketAccess (HSDPA), etc. may be used. As the wired connection technology, for example, Digital Subscriber Line (XDSL), Fibers to the Home (FTTH), Power Line Communication (PLC), or the like may be used. In addition, the network connection unit may include a short-range communication module to transmit/receive data to/from any device/terminal located in a short distance. For example, as short range communication technology, Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra-Wideband), ZigBee, etc. may be used, However, the present invention is not limited thereto.

Also, the massage device 100 may further include an input unit or an output unit. The massage device 100 may receive an input from the user using the input unit. Also, the massage device 100 may output the processing result of the processor 110 to the output unit.

Specifically, the input unit may receive a command related to operation control of the massage device 100 from the user, and the input unit 2180 may be implemented in various forms. For example, the input unit 2180 may be provided in the body massage unit 2100 and may be provided in the leg massage unit 2300 , but is not limited thereto.

The massage apparatus 100 may obtain various commands from the user through the input unit 2180 . For example, the massage device 100 may include selection of a massage module, selection of a massage type, selection of massage intensity, selection of a massage time, selection of a massage site, selection of a position and operation of the body massage unit 2100, and massage. Arbitrary commands for selection of on-off power of the device 100 , selection of whether to operate a heating function, selection related to sound source reproduction, etc. may be received, but is not limited thereto.

The massage apparatus 100 may provide an interface for selecting a massage mode. For example, the input unit 2180 or the output unit may include the massage device control device 2200 . The medical massage list of various modes related to body improvement may be listed through the massage apparatus control device 2200 .

The medical massage mode may include at least one of a concentration mode, a meditation mode, a recovery mode, a stretching mode, a sleep mode, a vitality mode, a golf mode, a hip-up mode, an examinee mode, a weightlessness mode, and a growth mode.

According to another embodiment of the present disclosure, the input unit 2180 may select, cancel, or input buttons and/or directions in the form of hot keys according to a preset user setting function or a function preset by itself, etc. It may be provided with a selection button for the.

The input unit 2180 may be implemented as a keypad, a dome switch, a touch pad (static pressure/capacitive), a jog wheel, a jog switch, and the like, but is not limited thereto. Also, the input unit 2180 may acquire a command through the user's utterance based on the voice recognition technology.

According to an embodiment of the present disclosure, the output unit may include a display for displaying the operation status of the massage device 100 or the current status of the user. In this case, the display is a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display (flexible display). ), and at least one of a three-dimensional display (3D display), but is not limited thereto.

The output unit may include an audio output module 2160 . The audio output module 2160 may provide audio output in any form to the user. For example, the audio output module 2160 may provide brain stimulation to the user by outputting a sound source and/or binaural beat optimized for the massage pattern provided by the massage device 100 to the user. The audio output module 2160 may output an acoustic signal received through a network (not shown) or stored in an internal/external storage medium (not shown). For example, the audio output module 2160 may output a sound source according to the control of the user terminal 2200 through a network connection (eg, Bluetooth connection, etc.) with the user terminal 2200 . In addition, the audio output module 1600 may output any type of sound signal generated in connection with the operation of the massage device 100 .

Those skilled in the art will appreciate that the present invention may be implemented in combination with other program modules and/or as a combination of hardware and software. For example, the present invention may be embodied by a computer-readable medium.

Any medium accessible by a computer can be a computer readable medium, and such computer readable media includes volatile and nonvolatile media, transitory and non-transitory media, removable and non-transitory media. including removable media. By way of example, and not limitation, computer-readable media may include computer-readable storage media and computer-readable transmission media.

Computer readable storage media includes volatile and nonvolatile media, temporary and non-transitory media, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. includes media. A computer-readable storage medium may be RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital video disk (DVD) or other optical disk storage device, magnetic cassette, magnetic tape, magnetic disk storage device, or other magnetic storage device. device, or any other medium that can be accessed by a computer and used to store the desired information.

4 is a diagram illustrating an external device capable of communicating with the massage device 100 according to an embodiment of the present disclosure.

The massage device 100 may communicate with an external device by wire or wirelessly, and may transmit/receive various data.

The external device may include an AI speaker, a portable electronic device 410 such as a tablet or a smartphone. The portable electronic device 410 may be dedicated to the massage device 100 or a general-purpose portable electronic device. Also, the external device may include a wearable device 420 such as a smart watch or a smart band. The external device may include a massage device 430 other than the massage device 100 currently used by the user. The external device may include a hospital server 440 . The external device may include a personal health record (PHR) server. Also, the external device may include the cloud server 450 . The external device may include a medical measurement device such as an electronic scale, a blood glucose meter, or a blood pressure meter.

Although some examples of external devices have been described in the present disclosure, it should be understood that all electronic devices capable of acquiring the user's biometric information may be included in the external device.

5 is a flowchart illustrating an operation of a massage device according to an embodiment of the present disclosure.

The massage apparatus 100 may perform an operation 510 of acquiring a first image of the face of the user sitting on the massage apparatus using the photographing unit. The massage apparatus 100 may acquire the first image before providing a massage to the user. The massage apparatus 100 may acquire the first image before the user selects a massage mode. The massage apparatus 100 may acquire the first image to suggest at least one massage mode to the user.

The first image may be obtained from a photographing unit included in the massage device 100 . However, the present invention is not limited thereto. As the first image, the first image of the user may be obtained from an external device connected to the massage device 100 by wire or wireless. The external device may include a photographing unit. Referring to FIG. 4 , the massage device 100 is a portable electronic device 410 , a wearable device 420 , another massage device 430 , a hospital server 440 , and a cloud server 450 . 1 image can be acquired.

The massage apparatus 100 may analyze the first image based on the facial expression analysis algorithm to obtain intensity information on a plurality of emotions displayed on the face ( 520 ). As the facial expression analysis algorithm, Microsoft's Azure API (Application Programming Interface) or Google's Cloud Vision API may be used.

The massage apparatus 100 may use a voice analysis algorithm instead of the facial expression analysis algorithm. For example, the massage device 100 may ask the user at least one question based on the audio output module 2160 . Alternatively, the massage device 100 may request the user to say at least one sentence based on the audio output module 2160 .

The massage device 100 may receive an answer from the user as voice data. The massage device 100 may receive voice data based on a microphone included in the massage device 100 or an external device connected by wire or wireless. The massage apparatus 100 may obtain information on the intensity of the user's emotion based on the physical characteristics of the voice data. For example, the massage device 100 provides information on the user's emotion based on at least one of the volume of the user's voice, the pitch of the voice, the user's intonation, the user's speech speed, or the tremor of the user's voice indicated in the voice data. can be obtained. The massage device 100 may determine the user's emotion contained in the user's voice as one of anger, fear, happiness, neutrality, sadness, surprise, or disgust based on the user's voice data.

The massage device 100 may acquire information on the user's emotion based on the content of the user's answer as well as the physical characteristics of the user's voice indicated in the voice data. For example, when the user says "depressed", the massage apparatus 100 may determine the intensity information about sadness to be high.

The massage apparatus 100 may analyze the first image based on a facial expression analysis algorithm in order to suggest a massage mode to the user. The massage apparatus 100 may acquire intensity information for a plurality of emotions revealed in the first image. The plurality of emotions may include at least one of anger, fear, happiness, neutrality, sadness, surprise or disgust. The massage apparatus 100 may numerically represent the intensity of emotion revealed on the face of the first image. This will be described together with FIG. 6 .

6 is a diagram illustrating intensity information for emotion according to an embodiment of the present disclosure.

As shown in table 610 of FIG. 6 , the massage apparatus 100 may numerically represent the intensity of emotion displayed on the face of the first image. The unit of the intensity of the emotion may be a percentage. However, the present invention is not limited thereto. The intensity of the target emotion may be expressed as a ratio of the target emotion to the reference emotion.

The massage apparatus 100 may determine the intensity of anger shown in the first image as 50. The massage apparatus 100 may determine the intensity of fear shown in the first image as 30. The massage apparatus 100 may represent the intensity of happiness shown in the first image as 10. The massage device 100 may represent the intensity of the neutral shown in the first image as 5. The massage apparatus 100 may represent the intensity of sadness shown in the first image as 5. The massage apparatus 100 may store the intensity of emotion displayed in the first image in a memory.

Referring back to FIG. 5 , the massage apparatus 100 provides the user based on the first emotion information corresponding to the largest value and the second emotion information corresponding to the second largest value among the intensity information for a plurality of emotions. A step 530 of selecting massage mode information to be performed may be performed. Also, the massage apparatus 100 may perform an operation 540 of providing a massage to the user based on the selected massage mode information.

When the first emotion information and the second emotion information are the same, the massage apparatus 100 may re-capture the first image of the user's face to obtain the first emotion information and the second emotion information from the first image again. .

Referring to FIG. 6 , since the intensity information of anger is the highest at 50, the massage apparatus 100 may determine the first emotion information as 'anger'. Also, since the intensity information of fear is the second highest at 30, the massage apparatus 100 may determine the second emotion information as 'fear'.

The massage apparatus 100 may select massage mode information to be provided to the user based on the first emotion information and the second emotion information. The massage apparatus 100 may store massage mode information corresponding to the emotion information including the first emotion information and the second emotion information as a table. The massage apparatus 100 may select massage mode information by applying the first emotion information and the second emotion information to the table. A process of selecting massage mode information will be described with reference to FIG. 7 .

7 is a diagram illustrating a table for acquiring massage mode information based on first emotion information and second emotion information.

Tables 710 to 750 are examples for describing an embodiment of the present disclosure, and at least some of the tables 710 to 750 may be modified. The massage apparatus 100 may select one of the plurality of tables 710 , 720 , 730 , 740 , 750 , and 760 based on the first emotion. The tables 710 , 720 , 730 , 740 , 750 , and 760 may be stored in a database of the massage device 100 or an external device.

The table 710 is a table showing massage mode information that can be suggested to the user when 'anger' is dominant among the user's emotional information. The massage apparatus 100 may select the table 710 based on the first emotion information. The massage apparatus 100 may determine the first emotional information as anger. Also, the massage apparatus 100 may determine the second emotional information as fear, happiness, neutrality, or sadness. The massage apparatus 100 may determine the recommended mode based on the table 710 , the first emotion information, and the second emotion information. The recommendation mode may be at least one of the first mode of comfort, the second mode of hope, the third mode of gratitude, the fourth mode of self-esteem, the fifth mode of forgiveness, or the sixth mode of trauma. Heartfelt, Hope, Gratitude, Self-Esteem, Forgiveness, Trauma can name the mod.

The table 720 is a table showing massage mode information that can be suggested to the user when 'neutral' is dominant among the user's emotional information. The massage apparatus 100 may select the table 720 based on the first emotion information. The massage apparatus 100 may determine the first emotion information to be neutral. Also, the massage apparatus 100 may determine the second emotional information as anger, fear, happiness, or sadness. The massage apparatus 100 may determine the recommended mode based on the table 720 , the first emotion information, and the second emotion information.

The table 730 is a table showing massage mode information that can be suggested to the user when 'happiness' is dominant among the user's emotional information. The massage apparatus 100 may select the table 730 based on the first emotion information. The massage apparatus 100 may determine the first emotion information as happiness. Also, the massage apparatus 100 may determine the second emotional information as anger, fear, neutrality, or sadness. The massage apparatus 100 may determine the recommended mode based on the table 730, the first emotion information, and the second emotion information.

The table 740 is a table showing massage mode information that can be suggested to the user when 'sadness' is dominant among the user's emotional information. The massage apparatus 100 may select the table 740 based on the first emotion information. The massage apparatus 100 may determine the first emotion information as sadness. Also, the massage device 100 may determine the second emotional information as anger, fear, happiness, or neutrality. The massage apparatus 100 may determine the recommended mode based on the table 740, the first emotion information, and the second emotion information.

The table 750 is a table showing massage mode information that can be suggested to the user when 'fear' is dominant among the user's emotional information. The massage apparatus 100 may select the table 710 based on the first emotion information. The massage apparatus 100 may determine the first emotion information as fear. Also, the massage device 100 may determine the second emotional information as anger, happiness, neutrality, or sadness. The massage apparatus 100 may determine the recommended mode based on the table 750 , the first emotion information, and the second emotion information.

5 and 6 , the massage apparatus 100 selects massage mode information using two pieces of emotion information, but is not limited thereto. The massage apparatus 100 may select a massage mode based on one piece of emotion information or three or more pieces of emotion information.

The recommended mode may mean a massage mode suitable for the user's current emotional state. The massage device 100 performs a step of selecting at least three massage modes as a massage mode candidate set based on the first emotion information and the second emotion information among a plurality of massage modes stored in the massage device 100 . can Also, the massage apparatus 100 may perform a step of selecting one massage mode based on a user's input from among the three massage modes. Also, the massage apparatus 100 may perform a step of providing a massage to the user based on one massage mode selected based on the user's input.

Since the massage device 100 automatically recommends a mode of mental massage, the user can minimize the effort to select a massage that suits him or her. Also, the massage apparatus 100 of the present disclosure may reduce the number of inputs that the user needs to input to the massage apparatus 100 until the user receives a massage.

The plurality of massage modes may include a first mode, a second mode, a third mode, a fourth mode, a fifth mode, and a sixth mode. The recommended mode may be determined as at least one of a first mode, a second mode, a third mode, a fourth mode, a fifth mode, and a sixth mode.

Modes 1 to 6 may be named as Heartfelt, Hope, Gratitude, Self-Esteem, Forgiveness, and Trauma Mode, respectively. The massage apparatus 100 may select three massage modes based on the first emotion information and the second emotion information. A priority may be determined between the three massage modes. Referring to FIG. 7 , the massage apparatus 100 may determine that the first emotional information is anger. The massage apparatus 100 may select the table 710 based on the first emotion information. Also, the massage apparatus 100 may determine that the second emotional information is fear. The massage apparatus 100 may select the first column 711 based on the second emotion information. The massage apparatus 100 may determine the forgiveness mode, which is the fifth mode, as the first priority. In addition, the massage apparatus 100 may determine the first mode, mind-witness mode, as the second priority. Also, the massage apparatus 100 may determine the trauma mode, which is the sixth mode, as the third priority.

The user may select at least one of the first to third priority modes. For example, the user may select the fifth mode, which is the first priority. The massage apparatus 100 may provide a massage based on a user's selection. Also, the massage device 100 may provide music corresponding to the fifth mode to the user. For example, the music corresponding to the fifth mode may be music having a slow tempo of andante or less played by the orchestra. Users can overcome their feelings of anger by listening to music in slow tembo.

The massage mode including the first to sixth modes may represent a combination of information on a massage sequence, a type of massage, a massage time, a massage intensity, a massage location, a temperature of a massage device, music provided with the massage, or a massage posture. have.

The information on the massage location may indicate a body part of the user massaged by the massage device 100 . The massage apparatus 100 may determine a body part to be massaged based on the medical data. The massage device 100 may provide a massage to the user's body part by controlling the actuator in the corresponding part to move.

In the present disclosure, the actuator means a configuration that can provide a driving force. For example, the actuator may include, but is not limited to, an actuator, a linear actuator, an electronic actuator, a DC actuator, an AC actuator, a linear actuator, an electric actuator, and the like.

The type of massage may indicate a motion in which the massage device 100 taps the user, a kneading motion, or a complex motion. The massage apparatus 100 may control the actuator to move based on the information on the type of massage.

The massage time represents a time during which the massage device 100 provides a massage to the user. The massage apparatus 100 may determine a time to provide a massage to the user based on information about the massage time.

The massage intensity indicates the intensity of pressing, kneading, or tapping the user by the massage device 100 . The massage device 100 may control the actuator to adjust the intensity of pressing, kneading, or tapping the user. For example, the massage apparatus 100 may move the body massage module 2170 in the Z-axis direction (front-rear) to adjust the intensity of the massage. The intensity of the massage may vary depending on the body part of the user, whether pressing, kneading, or tapping.

Based on the temperature information of the massage device of the massage device 100 , when providing a massage to the user, the temperature of the massage device may be adjusted. The temperature of the massage device 100 may vary according to body parts. The massage device 100 may lower or increase the temperature of the massage device than room temperature. The massage device 100 may cool or warm the user's body part based on the medical data.

The massage posture may indicate a posture taken when a user receives a massage while sitting on the massage device 100 . The massage device 100 may be deformed in shape by a driving unit or an actuator, and based on the shape of the massage device, the user may lie down, stand up, bend the user's leg, or spread the user's leg have.

The massage sequence represents a change with time of information about a massage intensity, a massage position, a temperature of a massage device, or a massage posture. The massage apparatus 100 may provide various massages according to time based on the massage sequence. For example, the user's legs may be intensively massaged during the first time period, and the user's back may be intensively massaged during the second time period.

The first to sixth modes may correspond to different pieces of music information. The massage device 100 may output music from the audio output module 2160 while the user is receiving a massage. The output music may be determined according to the first to sixth modes.

The massage apparatus 100 may perform an operation of outputting music corresponding to a selected one massage mode among at least one mode proposed by the massage apparatus 100 based on a user's input.

The first mode may correspond to music having a waltz rhythm of 6/8 time. Also, the second mode may correspond to music having a rhythm of 4/4 time and a low range of C4 or less. Also, the third mode may correspond to music having a swing rhythm and a fast tempo greater than or equal to an allegretto. Also, the fourth mode may correspond to music having a tempo of Andantino or Moderato with a time of 6/8. The fifth mode may correspond to music having a slow tempo of andante or less played by the orchestra. Also, the sixth mode may correspond to music of a slow swing rhythm of 6/8 time.

The massage apparatus 100 may provide a massage based on a massage mode selected based on a user's selection or an automatically selected massage mode. Also, music corresponding to the selected massage mode may be output.

So far, a process in which the massage device 100 proposes a massage mode to the user based on the emotion displayed on the user's face has been described. The massage apparatus 100 may determine the user's emotional state in various ways in addition to the emotion displayed on the user's face.

8 is a flowchart illustrating a process of determining a user's emotional state using a questionnaire according to an embodiment of the present disclosure.

The massage apparatus 100 may perform an operation 810 of displaying a plurality of questionnaires on the display. The massage apparatus 100 may perform an operation of outputting a plurality of questionnaires using the audio output module 2160 . There may be a plurality of questionnaires output by the massage device 100 . The massage device 100 may output a questionnaire that can be answered with “yes” or “no”.

The questionnaire provided by the massage device 100 may be a question asking whether it corresponds to the first to sixth modes.

For example, the massage apparatus 100 may output "1. Do you often regret today?" in order to ask whether the user's emotional state corresponds to the first mode. As already explained, the first mode may be named "from the heart".

In addition, the massage apparatus 100 may output "2. Were you worried a lot today?" in order to ask whether the user's emotional state corresponds to the second mode. As already explained, the second mode may be named "hope".

In addition, the massage apparatus 100 may output "3. Were you depressed due to the surrounding situation today?" in order to ask whether the user's emotional state corresponds to the third mode. As already explained, the third mode may be named "thanks".

In addition, the massage apparatus 100 may output "4. Are you often annoyed today?" in order to ask whether the user's emotional state corresponds to the fourth mode. As already explained, the fourth mode may be named “self-esteem”.

In addition, the massage apparatus 100 may output "5. Are you often angry today?" in order to ask whether the user's emotional state corresponds to the fifth mode. As already explained, the fifth mode may be named “forgiveness”.

In addition, the massage apparatus 100 may output "6. Was it difficult because you remembered the past today?" in order to ask whether the user's emotional state corresponds to the sixth mode. As already explained, the sixth mode may be named “trauma”.

The user may view or listen to the questionnaire and input a response using the input unit 2180 or an external device. The massage apparatus 100 may perform an operation 820 of receiving response information to a plurality of questionnaires from the user. The user may answer “yes” or “no” to the plurality of questions by using the input unit 2180 or an external device.

Also, the massage apparatus 100 may perform an operation 830 of modifying the massage mode candidate set further based on the response information. The massage apparatus 100 may modify at least one of at least three massage modes included in the massage mode candidate set already obtained by the tables 710 , 720 , 730 , 740 , 750 , and 760 of FIG. 7 .

The massage apparatus 100 may determine a massage mode corresponding to the user's response information. The massage apparatus 100 may determine whether a massage mode corresponding to response information is included among the massage mode candidate sets selected by the tables 710 , 720 , 730 , 740 , 750 , and 760 . If the massage mode corresponding to the response information is not included among the massage mode candidate sets selected by the tables 710 , 720 , 730 , 740 , 750 , and 760 , the massage apparatus 100 includes the selected massage mode candidate set. At least 3 massage modes can be changed. For example, the massage apparatus 100 may change the massage mode of the second priority or the third priority among the massage mode candidate sets selected by the tables 710 , 720 , 730 , 740 , 750 , and 760 .

For example, the massage apparatus 100 may output "1. Do you often regret today?" in order to ask whether the user's emotional state corresponds to the first mode. The user can answer "yes". The massage apparatus 100 may determine to propose the first mode to the user based on the response information. The massage apparatus 100 may determine whether the first mode is included in the selected massage mode candidate set based on the tables of FIG. 7 . If the first mode is not included among the massage mode candidate sets selected based on the tables of FIG. 7 , the massage apparatus 100 sets the second or third priority massage mode among at least three massage modes as the first mode. can be changed

The massage apparatus 100 may acquire the number of "yes" in response information of the user to a plurality of questionnaires. When the number of response information of “yes” exceeds the threshold value, the massage apparatus 100 may determine that it is difficult to determine the user's psychological state through a questionnaire because the user's psychological state is complex. Accordingly, the massage apparatus 100 may change the massage mode of the second priority or the third priority among the massage mode candidate sets only when the number of response information of "yes" is less than or equal to the threshold value. The massage device 100 may acquire the threshold value from the memory 120 .

For example, the threshold may be two. The massage apparatus 100 may not change the selected massage mode candidate set when the number of "yes" in the user's response information is three. Conversely, when the number of "yes" in the user's response information is two, the massage apparatus 100 may change the selected massage mode candidate set. For example, the user may input “yes” to the questionnaire corresponding to the first mode and the questionnaire corresponding to the third mode. The massage apparatus 100 may change the massage mode of the second priority or the third priority among at least three massage modes included in the massage mode candidate set to the first mode or the third mode based on the user's response information.

The process of changing the massage mode included in the already obtained massage mode candidate set based on the user's response information has been described. However, the present invention is not limited thereto. The massage device 100 may not have already acquired massage modes. The massage apparatus 100 may determine a new massage mode based on the user's response information.

Also, although the massage apparatus 100 has changed the second or third priority among at least three massage modes included in the massage mode candidate set so far, the present invention is not limited thereto. The massage device 100 may change the first priority or the fourth priority or less.

9 is a flowchart of determining a massage mode based on heart rate variability (HRV) information according to an embodiment of the present disclosure.

The massage apparatus 100 may perform an operation 910 of receiving HRV information from the user based on a heart rate variability (HRV) sensor. The HRV sensor may be included in an external device or the massage device 100 . As already described, the external device may include a tablet, a wearable device, or a portable terminal included in the massage device 100 . The massage device 100 may receive HRV information from an HRV sensor included in the massage device 100 or may receive HRV information from an external device via wire or wireless.

The massage apparatus 100 may perform an operation 920 of comparing the HRV information with the first reference value. When the HRV information is less than the first reference value, the massage apparatus 100 may perform an operation 930 of determining whether at least three massage modes included in the massage mode candidate set are included in the first group. The first group may include a first mode representing a comforting mode, a second mode representing a hopeful mode, a fifth mode representing a forgiveness mode, and a sixth mode representing trauma.

The first reference value may be a value stored in the memory of the massage device 100 . The massage device 100 may compare the first reference value stored in the memory with the HRV information. However, the present invention is not limited thereto, and the massage device 100 may dynamically determine the first reference value.

The massage apparatus 100 may perform a step of acquiring the user's body information. Also, the massage apparatus 100 may perform the step of determining the first reference value based on the user's body information. For example, the massage apparatus 100 may determine a first reference value corresponding to the user's body information based on a table stored in the memory. The user's body information may include at least one of age, weight, obesity, blood sugar, cholesterol, blood pressure, and activity information of the user.

The massage device 100 may acquire the user's body information from an external device or a memory of the massage device 100 . For example, the massage device 100 may receive user identification information. The massage device 100 may acquire the user's body information corresponding to the user's identification information from an external device or memory.

The massage device 100 may acquire body information of the user based on the sensor. The massage device 100 may periodically acquire body information of the user. The period may be predetermined and may be changed according to a user's setting.

When the user sits on the massage device 100 , the massage device 100 may measure the user's weight using a weight sensor. The massage device 100 may track the user's weight. However, the present invention is not limited thereto, and the weight information may be received from an external device. In addition, the weight information can be directly input by the user. The massage device 100 may determine obesity degree information based on the user's weight information.

The massage device 100 may track the change amount of the user's weight. The massage apparatus 100 may output a danger signal when the user's weight is excessively increased or decreased during a predetermined period.

The massage device 100 may measure blood pressure from a body part of the user using a sensor. Also, the blood pressure information may be received from an external device. Also, the blood pressure information may be directly input by the user.

Cholesterol or blood sugar level information is information indicating a user's blood sugar level. The massage device 100 may measure cholesterol or blood sugar level information by collecting a small amount of blood from the user's hand while the user is giving the massage. Also, the massage device 100 may receive cholesterol or blood sugar level information from an external device or an input from a user.

The activity information is information indicating an activity amount of a user. For example, the activity information may include information on the number of steps taken by the user per day. In addition, the activity information may include information on the type of exercise performed by the user and information on the amount of exercise. For example, the activity information may include information on the type of exercise such as swimming, walking, running, or cycling. In addition, the activity information may include information on a specific exercise time, distance, calories consumed, and the like. Also, the activity information may include information related to a heart rate while the user performs an exercise. The massage device 100 may receive activity information from an external device or from a user.

Also, the massage apparatus 100 may acquire heart rate information. The massage apparatus 100 may obtain heart rate information from the user's body or may receive heart rate information from an external device. The heart rate information may be displayed as a waveform according to the time of the heartbeat. The heart rate information may include information on whether a heartbeat is regular. The massage apparatus 100 may determine the first reference value based on the heart rate information. In addition, the massage device 100 may determine the first reference value based on the blood color level, the electrolyte level, and the urine protein level, in addition to the information described above.

The massage device 100 may receive information about the user's age from a memory or an external device, but is not limited thereto. The massage apparatus 100 may perform the step of estimating the age of the user from the first image. Also, the step of determining the first reference value based on the age of the user may be performed. The massage apparatus 100 may use an API for estimating an age based on the first image. For example, the massage device 100 may use Amazon Recognition API, Clova Face Recognition API, IBM's Visual Recognition API, MS's Visual Recognition API, and the like.

The massage apparatus 100 may perform an operation 940 of removing a massage mode not included in the first group among at least three massage modes included in the massage mode candidate set. The massage apparatus 100 may include a new massage mode to replace the removed massage mode in the massage mode candidate set. Also, the massage apparatus 100 may add a massage mode based on a questionnaire instead of the massage mode removed based on FIG. 8 . Also, the massage apparatus 100 may add the massage mode included in the first group as a new massage mode to the massage mode candidate set. For example, the massage apparatus 100 removes a massage mode not included in the first group from the massage mode candidate set, and then selects a massage mode included in the first group but not included in the massage mode candidate set as a massage mode. Can be added to the candidate set.

The massage apparatus 100 may output the changed massage mode candidate set. The user may select one of at least three massage modes included in the changed massage mode candidate set. The massage apparatus 100 may provide a massage based on the selected massage mode.

The massage apparatus 100 may perform an operation 960 of removing a massage mode not included in the second group among at least three massage modes included in the massage mode candidate set. The massage apparatus 100 may include a new massage mode to replace the removed massage mode in the massage mode candidate set. Also, the massage apparatus 100 may add a massage mode based on a questionnaire instead of the massage mode removed based on FIG. 8 . Also, the massage apparatus 100 may add the massage mode included in the second group as a new massage mode to the massage mode candidate set. For example, the massage apparatus 100 removes a massage mode not included in the second group from the massage mode candidate set, and then selects a massage mode included in the second group but not included in the massage mode candidate set as a massage mode. Can be added to the candidate set.

The massage apparatus 100 may output the changed massage mode candidate set. The user may select one of at least three massage modes included in the changed massage mode candidate set. The massage apparatus 100 may provide a massage based on the selected massage mode.

10 is a flowchart illustrating a process of changing a massage mode while a user is receiving a massage according to an embodiment of the present disclosure.

The massage apparatus 100 may perform an operation 1010 of obtaining a second image of the face of the user sitting on the massage apparatus using the photographing unit. Also, the massage apparatus 100 may analyze the second image based on the facial expression analysis algorithm to obtain intensity information on pain or sleepiness on the user's face ( 1020 ). In order to obtain intensity information for pain or sleepiness, the massage device 100 may use Microsoft's Azure API (Application Programming Interface) or Google's Cloud Vision API.

The massage device 100 may obtain information on whether the user snored by using a microphone built into the massage device 100 . In addition, the massage apparatus 100 may determine intensity information on drowsiness corresponding to snoring by the user based on the database stored in the memory. Also, the massage apparatus 100 may obtain an electrocardiogram signal of the user by using a sensor, and may acquire intensity information about the user's drowsiness based on the electrocardiogram signal.

The massage apparatus 100 may perform an operation of changing the selected massage mode information based on intensity information on pain or intensity information on drowsiness. For example, the massage device 100 may adjust music volume information, massage intensity information, lighting intensity information, or massage posture information, etc. based on intensity information on pain or intensity information on sleepiness.

The massage apparatus 100 may move the body massage module 2170 forward-backward or adjust the strength of tapping or kneading of the body massage module 2170 based on the massage intensity information. The massage device 100 may acquire the second reference value or the third reference value from the memory 120 .

When the intensity information on pain is greater than the second reference value, the massage apparatus 100 may perform a step of lowering the massage intensity-related information among the selected massage mode information. Also, when the intensity information on drowsiness is greater than the third reference value, the massage apparatus 100 may perform a step of gradually lowering the information related to the massage intensity among the selected massage mode information over time. The massage device 100 may acquire the second reference value or the third reference value from the memory.

In addition, when the intensity information on drowsiness is greater than the third reference value, the massage apparatus 100 may perform a step of changing information related to the inclination of the massage apparatus among selected massage mode information to be parallel to the ground over time. The information related to the inclination of the massage device may mean information about the user's posture. Information on the user's posture has already been described. The massage device 100 may change the information related to the inclination of the massage device to be in parallel with the ground gradually over time, so that the user gradually becomes a lying position.

For example, when the massage apparatus 100 determines that the intensity information on pain is greater than the second reference value, the massage intensity information may be reduced. For example, the massage device 100 may move the body massage module 2170 to the rear to weaken the strength of the massage. Back refers to the direction away from the person on the Z axis. The Z-axis is an axis including a direction closer to and a direction away from the person with respect to the body massage module 2170 . In addition, the massage apparatus 100 may reduce the intensity of tapping or kneading of the body massage module 2170 .

Also, when the massage apparatus 100 determines that the intensity information for drowsiness is greater than the third reference value, the massage intensity information may be reduced. For example, the massage device 100 may gradually move the body massage module 2170 to the rear to gradually weaken the strength of the massage. Also, the massage apparatus 100 may gradually decrease the intensity of tapping or kneading of the body massage module 2170 . Also, the massage apparatus 100 may gradually correct the information on the massage posture to the posture in which the user lies down. In addition, the massage device 100 may gradually reduce the intensity of lighting and the volume of music.

So far, various embodiments have been mainly looked at. Those of ordinary skill in the art to which the present invention pertains will understand that the present invention can be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments are to be considered in an illustrative rather than a restrictive sense. The scope of the present invention is indicated in the claims rather than the foregoing description, and all differences within the scope equivalent thereto should be construed as being included in the present invention.

Meanwhile, the above-described embodiments of the present invention can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable recording medium. The computer-readable recording medium includes a storage medium such as a magnetic storage medium (eg, a ROM, a floppy disk, a hard disk, etc.) and an optically readable medium (eg, a CD-ROM, a DVD, etc.).

Claims (12)

acquiring a first image of a face of a user sitting on a massage device by using a photographing unit;
analyzing the first image based on a facial expression analysis algorithm to obtain intensity information on a plurality of emotions exposed on the face;
At least three massages among a plurality of massage modes stored in the massage device based on the first emotion information corresponding to the largest value among the intensity information for the plurality of emotions and the second emotion information corresponding to the second largest value selecting a mode as a massage mode candidate set;
receiving HRV information from the user based on a Heart Rate Variability (HRV) sensor;
changing the massage mode candidate set based on the comparison of the HRV information with a first reference value;
selecting one massage mode information from among the massage mode candidate sets based on a user input; and
and providing a massage to the user based on the selected one massage mode information based on the user's input.
delete The method of claim 1,
displaying a plurality of questionnaires on a display;
Further comprising the step of receiving response information to the plurality of questionnaires from the user,
The step of selecting the massage mode comprises:
and modifying the massage mode candidate set further based on the response information.
The method of claim 1,
Changing the massage mode candidate set includes:
determining whether the at least three massage modes included in the massage mode candidate set are included in the first group when the HRV information is less than the first reference value; and
and removing a massage mode not included in the first group among the at least three massage modes included in the massage mode candidate set.
The method of claim 1,
Changing the massage mode candidate set includes:
determining whether at least three massage modes included in the massage mode candidate set are included in the second group when the HRV information is equal to or greater than the first reference value; and
and removing a massage mode not included in the second group among at least three massage modes included in the massage mode candidate set.
The method of claim 1,
acquiring user's body information;
and determining a first reference value based on the user's body information.
7. The method of claim 6,
The step of obtaining the user's body information includes:
Including the step of estimating the age of the user from the first image,
The step of determining a first reference value based on the user's body information,
and determining the first reference value based on the age of the user.
The method of claim 1,
The plurality of massage modes include a first mode, a second mode, a third mode, a fourth mode, a fifth mode and a sixth mode,
The first to sixth modes correspond to different music information,
The step of providing a massage to the user,
and outputting music corresponding to one selected massage mode based on the user's input.
9. The method of claim 8,
The first mode corresponds to music having a waltz rhythm in 6/8 time,
The second mode corresponds to music having a rhythm of 4/4 time and a low range of C4 or less,
The third mode corresponds to music having a swing rhythm and a fast tempo of allegretto or higher,
The fourth mode corresponds to music having a tempo of Andantino or Moderato with a time of 6/8,
The fifth mode corresponds to music having a slow tempo of andante or less played by the orchestra,
The sixth mode is a method of operating a massage device, characterized in that it corresponds to music of a slow swing rhythm of 6/8 time.
The method of claim 1,
The step of providing a massage to the user,
obtaining a second image of the face of the user sitting on the massage device by using the photographing unit;
analyzing the second image based on a facial expression analysis algorithm to obtain intensity information on pain or sleepiness on the user's face;
and changing the selected one massage mode information based on the intensity information on the pain or the intensity information on the sleepiness.
11. The method of claim 10,
lowering the massage intensity-related information among the selected one massage mode information when the intensity information on the pain is greater than a second reference value; and
and when the intensity information on the sleepiness is greater than a third reference value, lowering information related to the massage intensity among the selected one massage mode information over time.
12. The method of claim 11,
and when the intensity information on the sleepiness is greater than a third reference value, changing information related to the inclination of the massage device from among the selected one massage mode information to be parallel to the ground over time. how it works.

Images