JP6995275B1 - Business support methods, systems and programs - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a business support method, a system and a program capable of executing a plurality of types of processing by voice. SOLUTION: The business support method includes an acquisition process for acquiring voice information of a voice spoken by a worker, a wake word detection process for detecting a wake word from the voice information, and a text of the voice information when the wake word is detected. Text conversion processing to convert to information, target identification processing to identify the worker based on the name of the worker included in the text information, the content of the work estimated from the text information, and information indicating the worker Includes, and includes a record-making process that creates a record, including. [Selection diagram] FIG. 11

Description

The present invention relates to a business support method system and a program.

Conventionally, a system that supports business by using voice is known. As such a system, a voice acquisition means for acquiring voice data related to the care work of the care recipient issued by the caregiver and a voice recognition for recognizing the voice data acquired by the voice acquisition means and converting the voice data into text data. The text conversion means, the care record creating means for creating a care record based on the text data converted from the voice data by the voice recognition / text conversion means, and the care record created by the care record creating means are displayed. A display means that enables confirmation by the caregiver, a correction means that allows the caregiver to correct the care record displayed on the display means as needed, and confirmation by the caregiver and as necessary. The confirmation means for finally confirming the care record in the state where the correction has been completed, the voice data, the text data converted from the voice data, and the care record finally confirmed by the confirmation means. A care record creation support system characterized by comprising a voice data learning means for learning a text conversion function in the voice recognition / text conversion means based on the text data adopted in the above has been proposed. ..

Japanese Unexamined Patent Publication No. 202-140620

Since the above-mentioned conventional system can only create long-term care records, it cannot be said that it can sufficiently support the work.

The present invention has been made in view of the above problems, and an object of the present invention is to enable a plurality of types of processing to be executed by voice.

The business support method according to one embodiment includes an acquisition process for acquiring voice information of a voice spoken by a user, a wake word detection process for detecting a wake word from the voice information, and a voice word when the wake word is detected. It includes a text conversion process for converting information into text information, a target identification process for specifying a target based on the text information, and a wake word process for executing the type of the wake word and the process according to the target.

According to one embodiment, it is possible to execute a plurality of types of processing by voice.

It is a figure which shows an example of the structure of a long-term care work support system. It is a figure which shows an example of the hardware composition of an information processing apparatus. It is a figure which shows an example of the functional structure of a user terminal. It is a flowchart which shows an example of the processing of a user terminal. It is a figure which shows an example of the functional structure of a care work support device. It is a figure which shows an example of the received information. It is a figure which shows an example of the target information. It is a figure which shows an example of the target information. It is a figure which shows an example of the target information. It is a figure which shows an example of the alternative word information. It is a flowchart which shows an example of the processing of a care business support device. It is a flowchart which shows an example of the method of creating a long-term care record. It is a flowchart which shows an example of the notification method of a long-term care record.

Hereinafter, each embodiment of the present invention will be described with reference to the accompanying drawings. Regarding the description of the specification and the drawings according to each embodiment, the components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

<System configuration>
First, the outline of the business support system (hereinafter referred to as "support system") according to this embodiment will be described. The business support system according to the present embodiment is an information processing system that supports the business of the worker who carries out the work. The work of the worker includes not only the work itself but also peripheral work such as recording the work performed and exchanging messages with related parties. The support system mainly supports this peripheral work.

Specifically, the support system acquires voice information of the voice spoken by the worker, detects a wake word from the acquired voice information, and processes according to the detected wake word (hereinafter referred to as "wake word processing"). ) Is executed. As wake word processing, the support system, for example, creates a record of the work performed by the worker, notifies the worker of the record, sends a message from the worker to another person, registers the matters to be sent about the worker, and the like. I do. As a result, the worker can perform various tasks only by uttering a voice including a wake word.

In the following, a case where the support system is a long-term care work support system that supports the long-term care work will be described as an example, but the support system according to the present embodiment can be used in any industry.

FIG. 1 is a diagram showing an example of the configuration of the support system according to the present embodiment. The support system of FIG. 1 includes an income (intercom) 1, a user terminal 2, and a long-term care work support device 3 (hereinafter referred to as “support device 3”), which are connected to each other so as to be able to communicate with each other via a network N. , The long-term care system 4. The network N is, for example, a wired LAN (Local Area Network), a wireless LAN, the Internet, a public line network, a mobile data communication network, or a combination thereof. In the example of FIG. 1, the support system includes one income, one user terminal 2, one support device 3, and one nursing care system 4, but a plurality of each may be provided.

The income 1 is an information processing device that acquires voice information of voice spoken by a user. Income 1 is, for example, income, but is not limited thereto. The income 1 can be any device capable of communicating with the user terminal 2 and having a microphone and a speaker.

The user is an arbitrary worker who wears and uses the income 1, and is, for example, a caregiver who is an employee of a care facility, but the user is not limited to this. The user carries out the nursing care work with the income 1 attached. When the user wearing the income 1 speaks, the income 1 collects the voice spoken by the user with a microphone, acquires the voice information of the collected voice, and transmits the acquired voice information to the user terminal 2.

The user terminal 2 is an information processing device that detects a wake word from the voice information of the voice spoken by the user. The user terminal 2 is, for example, a PC (Personal Computer), a smartphone, a tablet terminal, or a smart speaker, but is not limited thereto. The user terminal 2 may be carried by the user or may be installed in a nursing care facility. Hereinafter, the case where the user terminal 2 is a smartphone carried by the user will be described as an example.

The user terminal 2 receives voice information from the income 1 and detects a wake word from the voice information. A wake word is a preset voice command for initiating subsequent processing. In this embodiment, four types of wake words are set in the support system. Hereinafter, each wake word will be referred to as a first wake word, a second wake word, a third wake word, and a fourth wake word, respectively. It is assumed that the first wake word is "completed", the second wake word is "confirmation", the third wake word is "send", and the fourth wake word is "send". When the user terminal 2 detects any of the wake words, the user terminal 2 converts the voice information into text information and transmits the obtained text information and other information to the support device 3. The type of wake word and wake word set in the support system is arbitrary.

The support device 3 is an information processing device that executes wake word processing spoken by the user. The support device 3 is, for example, a PC, a smartphone, a tablet terminal, a server, or a combination thereof, but is not limited thereto.

The support device 3 receives text information or the like from the user terminal 2, identifies a target based on the received text information, and executes wake word processing corresponding to the specified target and text information. Further, the support device 3 cooperates with the long-term care system 4 to register the long-term care record in the long-term care system 4 and acquire the long-term care record from the long-term care system 4. The support device 3 will be described in detail later.

The long-term care system 4 is a system for managing long-term care work in a long-term care facility. The care system 4 is, for example, a PC, a smartphone, a tablet terminal, a server, or a combination thereof, but is not limited thereto. The long-term care system 4 manages information about long-term care facility users and employees, requests for long-term care fees, stores long-term care records, manages long-term care operations, manages attendance and departure of long-term care facility employees, manages care plans, and the like. It has a function.

The configuration of the long-term care work support system is not limited to the above example. For example, the user terminal 2 may function as an income 1. Further, the long-term care work support device 3 may be incorporated in the long-term care system 4.

<Hardware configuration>
Next, the hardware configuration of the information processing device will be described. FIG. 2 is a diagram showing an example of the hardware configuration of the information processing apparatus 100. As shown in FIG. 2, the information processing unit 100 inputs the processor 101, the memory 102, the storage 103, the communication I / F 104, the input / output I / F 105, and the input / output I / F 105, which are connected to each other via the bus B. A device 106, an output device 107, and a drive device 108 are provided.

The processor 101 controls each configuration of the information processing apparatus 100 and realizes the function of the information processing apparatus 100 by expanding the program stored in the storage 103 into the memory 102 and executing the program. When the processor 101 executes the program, the function of the information processing apparatus 100 is realized. The processor 101 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), or a combination thereof.

The memory 102 is, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), or a combination thereof. The ROM is, for example, a PROM (Programmable ROM), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), or a combination thereof. The RAM is, for example, DRAM (Dynamic RAM), SRAM (Static RAM), MRAM (Magnetoresistive RAM), or a combination thereof.

The storage 103 stores programs such as an OS and various data. The storage 103 is, for example, a flash memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), an SCM (Storage Class Memories), or a combination thereof.

The communication I / F 104 is an interface for connecting the information processing device 100 to an external device via the network N and controlling communication. The communication I / F 104 is, for example, an adapter compliant with Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), Ethernet (registered trademark), or optical communication (for example, Fiber Channel). , Not limited to this.

The input / output I / F 105 is an interface for connecting the input device 106 and the output device 107 to the information processing device 100.

The input device 106 is a device for accepting an operation of the user U and inputting information according to the accepted operation to the information processing apparatus 100. The input device 106 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, a camera, various sensors, operation buttons, or a combination thereof.

The output device 107 is a device that outputs various information held by the information processing device 100. The output device 107 is, for example, a display, a projector, a printer, a speaker, a vibrator, or a combination thereof.

The drive device 108 reads / writes data from the disk media 109. The drive device 108 is, for example, a magnetic disk drive, an optical disk drive, a magneto-optical disk drive, or a combination thereof.

The disc media 109 is a disc-shaped recording medium on which information is recorded. The disc media 109 is, for example, a CD (Compact Disc), a DVD (Digital Versatile Disc), an FD (Floppy Disk), an MO (Magneto-Optical disk), a BD (Blu-ray (registered trademark) Disc), or a combination thereof. Is.

The hardware configuration of the information processing device 100 is not limited to the above example. The information processing apparatus 100 may include a part of the above hardware function configuration, or may include a hardware configuration other than the above.

Further, various programs may be written in the memory 102 or the storage 103 at the manufacturing stage of the information processing apparatus 100, may be provided to the information processing apparatus 100 via the network N, or may be provided to the information processing apparatus 100, such as a disk media 109. It may be provided to the information processing apparatus 100 via a non-temporary, computer-readable recording medium.

<Functional configuration of user terminal 2>
Next, the functional configuration of the user terminal 2 will be described. FIG. 3 is a diagram showing an example of the functional configuration of the user terminal 2. As shown in FIG. 3, the user terminal 2 includes a communication unit 21, a storage unit 22, and a control unit 23.

The communication unit 21 is realized by the communication I / F. The communication unit 21 transmits / receives information to / from the income 1 and the support device 3 via the network N. Specifically, the communication unit 21 receives voice information from the income 1 and transmits text information and the like to the support device 3.

The storage unit 22 is realized by the memory 102 and the storage 103. The storage unit 22 stores the voice information 221 and the text information 222.

The voice information 221 is the voice information of the user received from the income 1. The voice information 221 is stored in association with the reception time from the income 1. The voice information 221 is stored only for a predetermined first period. The first period is a longer period than the second period described later.

The text information 222 is text information obtained by converting the voice information 221. The text information 222 is stored in association with the voice information 221 of the conversion source.

The control unit 23 is realized by the processor 101 reading a program from the memory 102, executing the program, and cooperating with other hardware configurations. The control unit 23 includes an acquisition unit 231, a wake word detection unit 232, and a text conversion unit 233.

The acquisition unit 231 acquires the voice information 221 from the income 1, and stores the acquired voice information 221 in the storage unit 22 in association with the reception time.

The wake word detection unit 232 detects the wake word from the voice information 221. The wake word detection unit 232 detects the wake word by using, for example, a detection model in which the voice information in the time domain or the frequency domain of the voice in which the wake word is uttered is machine-learned. The detection model is, for example, a neural network such as DNN (Deep Neural Network) or CNN (Convolutional Neural Network), SVM (Support Vector Machine), GMM (Gaussian Mixture Model), or a combination thereof, but is limited to this. do not have.

The wake word detection unit 232 may detect each of the four wake words by using the four detection models corresponding to each wake word, or use one detection model that can collectively detect the four wake words. Then, each of the four wake words may be detected. The wake word detection unit 232 constantly executes wake word detection while the user terminal 2 receives the voice information 221 from the income 1. The wake word detection method is not limited to the above example, and can be arbitrarily selected.

The text conversion unit 233 converts the voice information 221 into the text information 222 by the voice recognition process, and stores the obtained text information 222 in the storage unit 22 in association with the conversion source voice information 221. More specifically, when a wake word is detected from the voice information 221, the text conversion unit 233 converts the voice information 221 in a predetermined second period before the detected wake word into text information. The voice information 221 of the second period before the wake word is the voice information 221 whose corresponding reception time is included in the second period before the reception time of the wake word. For example, if the second period is 20 seconds and a wake word is detected at 15:10:30, the text conversion unit 233 will perform 20 seconds from 15:10:10 to 15:10:30. The voice information 221 is converted into text information. The second period is, for example, 20 seconds, but is not limited to this. The method of voice recognition processing can be arbitrarily selected.

The functional configuration of the user terminal 2 is not limited to the above example. The user terminal 2 may have a part of the above-mentioned functional configuration, or may have a functional configuration other than the above. For example, the user terminal 2 may be provided with a part of the above-mentioned functional configuration in the support device 3, or may be provided with a part of the functional configuration of the support device 3.

<Process executed by user terminal 2>
Next, the process executed by the user terminal 2 will be described. FIG. 4 is a flowchart showing an example of the process executed by the user terminal 2.

(Step S101)
The acquisition unit 231 acquires the voice information 221 received from the income 1 by the communication unit 21, and stores the acquired voice information 221 in the storage unit 22 in association with the reception time.

(Step S102)
The wake word detection unit 232 sequentially executes wake word detection for the newly stored voice information 221. If no wake word is detected from the voice information 221 (step S102: NO), the process ends. On the other hand, when any wake word is detected from the voice information 221 (step S102: YES), the process proceeds to step S103.

(Step S103)
When the wake word detection unit 232 detects the wake word, the wake word detection unit 232 notifies the user of the detection of the wake word. The wake word detection unit 232 may, for example, output a notification sound notifying the detection of the wake word from the speaker of the user terminal 2, or display an image notifying the detection of the wake word on the display device of the user terminal 2. You may let me. Further, the wake word detection unit 232 may transmit the voice information of the notification sound notifying the detection of the wake word to the income 1 and output the notification sound from the speaker of the income 1. It is preferable that the notification sound for notifying the detection of the wake word is different for each wake word. By notifying the user of the detection of the wake word in this way, the user can promptly confirm that the wake word spoken by the user has been detected.

(Step S104)
When the wake word detection unit 232 detects a wake word, the text conversion unit 233 reads out the voice information 221 for a predetermined period before the wake word detected by the wake word detection unit 232 from the storage unit 22.

(Step S105)
The text conversion unit 233 converts the read voice information 221 into text information 222 by voice recognition processing and stores it in the storage unit 22.

(Step S106)
The text conversion unit 233 includes the identification information of the user terminal 2, the type of wake word detected in step S102, the voice information 221 read in step S104, the reception time, and the text information 222 obtained in step S105. Is associated and transmitted to the support device 3. These information transmitted by the text conversion unit 233 is received by the support device 3 and stored as received information 321 (see FIG. 6).

<Summary>
By the above processing, when the user speaks a wake word, text information 222 or the like corresponding to the voice spoken by the user in a predetermined period before the wake word is transmitted to the support device 3, and the wake word process is executed by the support device 3. Will be done. That is, according to the present embodiment, the user can make the support system execute the desired wake word processing by speaking the wake word after uttering the content corresponding to the wake word processing.

In this way, by detecting the wake word after the content, the time from the utterance of the wake word to the execution of the wake word processing is set as compared with the case where the wake word is detected before the content. Can be shortened by the amount of time it takes to speak. The time from when the wake word is spoken until the wake word process is executed corresponds to the user's waiting time from when the user gives an instruction to the support system until a response is returned. That is, according to the present embodiment, it is possible to shorten the waiting time of the user after the user speaks the wake word. Further, by detecting the wake word after the content, it is possible to suppress the execution of the wake word process with the wrong content.

<Functional configuration of long-term care work support device 3>
Next, the functional configuration of the support device 3 will be described. FIG. 5 is a diagram showing an example of the functional configuration of the support device 3. As shown in FIG. 5, the support device 3 includes a communication unit 31, a storage unit 32, and a control unit 33.

The communication unit 31 is realized by the communication I / F. The communication unit 31 transmits / receives information to / from the user terminal 2 and the nursing care system 4 via the network N. Specifically, the communication unit 31 receives the text information 222 and the like from the user terminal 2 and transmits the long-term care record and the like to the long-term care system 4.

The storage unit 32 is realized by the memory 102 and the storage 103. The storage unit 32 stores the received information 321, the target information 322, and the alternative word information 323.

The received information 321 is information such as text information 222 received from the user terminal 2. FIG. 6 is a diagram showing an example of received information 321. The received information 321 of FIG. 6 includes "DID", "time", "wake word", "text", and "voice" as information items. The "DID" is an identifier that uniquely identifies the received information 321. The “time” is the earliest reception time associated with the voice information 221 included in the reception information 321 and corresponds to the start time of the voice information 221. The "wake word" is a type of wake word (wake word detected in step S102) that causes the reception information 321 to be transmitted. The "text" is the text information 222 obtained by converting the voice information 221 included in the received information 321. The "voice" is the voice information 221 included in the received information 321. In the example of FIG. 6, the voice information 221 is mp3, but the file format of the voice information 221 is arbitrary.

For example, in the received information 321 on the first line of FIG. 6, the "DID" is "D001", the "time" is "16:30:20", the "wake word" is "completed", and "done". "Text" is "Mr. Sato, I ate all the meal", and "Voice" is "M001.mp3". This is because the user said "Mr. Sato, I ate all the meals, completed" between 16:30:20 and the second period, and as a result, the wake word "completed (first wake word)" was detected. Then, information including voice information 221 (M001.mp3) saying "Mr. Sato, you have eaten all the meal" before "completion" and text information 222 corresponding to this is transmitted from the user terminal 2. , It is shown that the support device 3 has received these information and stored it as the received information D001.

The received information 321 is not limited to the above example. The received information 321 may include a part of the above information items, or may include information items other than the above.

The target information 322 is information indicating the target of the wake word processing designated by the user. In the present embodiment, the user specifies the target of the wake word processing by speaking the name as the content of the wake word processing. Wakeword processing targets include at least one of a care recipient (workee), a user (caregiver), and a group. The target information 322 is registered in advance by the user, for example. 7 to 9 are diagrams showing an example of the target information 322.

The target information 322 of FIG. 7 is the target information 322 of the care recipient, and includes "CID", "name", and "name" as information items. The "CID" is an identifier that uniquely identifies the care recipient. The "name" is the name of the care recipient. The "name" is the name of the care recipient and includes at least one of a surname, a first name, and a common name. For example, in the target information 322 of FIG. 7, the "CID" is "C001", the "name" is "Taro Sato", and the "name" is "Sato", "Taro", and "Sato-san". ..

The target information 322 of FIG. 8 is the target information 322 of the user, and includes "UID", "name", and "name" as information items. The "UID" is an identifier that uniquely identifies the user. The "name" is the user's name. The "name" is a user's name and includes at least one of a surname, a first name, and a common name. For example, in the target information 322 of FIG. 8, the "UID" is "U001", the "name" is "Jiro Suzuki", and the "name" is "Suzuki" and "Jiro".

The target information 322 of FIG. 9 is the target information 322 of the group, and includes "GID", "group", "name", and "member" as information items. "GID" is an identifier that uniquely identifies a group. "Group" is the name of the group. "Name" is the name of a group. A "member" is an identifier that uniquely identifies a person included in a group. For example, in the target information 322 in the first line of FIG. 9, "GID" is "G001", "group" is "third floor person in charge", "name" is "third floor person in charge", and " "Members" are "U001" and "U002". This indicates that the group G001 is a group named "person in charge on the third floor" including the users U001 and U002. Further, in the target information 322 in the second line of FIG. 9, the "GID" is "G002", the "group" is the "third floor user", and the "name" is the "third floor user". The "members" are "C001" and "C002". This indicates that the group G002 is a group named "3rd floor user" including the care recipients C001 and C002.

The target information 322 is not limited to the above example. The target information 322 may include a part of the above information items, or may include information items other than the above. In addition, a group including the user and the care recipient may be registered.

The alternative word information 323 is information indicating an alternative word corresponding to at least one of the type of care work and the amount related to the care work. In this embodiment, as will be described later, a long-term care record is created according to the content of the user's utterance. However, depending on the type of care work, it may not be appropriate to speak the recorded contents directly (it is not appropriate for the care recipient to hear the recorded contents). Therefore, alternative words are registered so that the recorded contents do not have to be spoken directly. The alternative word information 323 is registered in advance by the user, for example.

FIG. 10 is a diagram showing an example of alternative word information 323. The alternative word information 323 of FIG. 10 includes "WID", "alternative word", "nursing work", and "quantity" as information items. "WID" is an identifier that uniquely identifies an alternative word. The "alternative word" is a registered alternative word. "Long-term care work" is a type of alternative word (type of long-term care work). "Amount" is a type of alternative word (amount related to long-term care work). For example, in the alternative word information 323 in the first line of FIG. 10, "WID" is "W001", "alternative word" is "A", and "nursing work" is "excretion assistance (feces)". .. This indicates that when the user speaks "A" as the content of the wake word, a long-term care record is created in which the type of long-term care work is "excretion assistance (feces)". As in the example of FIG. 10, the alternative term is preferably a code that the care recipient does not understand when heard. Alternative words are, for example, but are not limited to alphabets, numbers, or combinations thereof.

The alternative word information 323 is not limited to the above example. The alternative word information 323 may include a part of the above information items, or may include information items other than the above.

The control unit 33 is realized by the processor 101 reading a program from the memory 102, executing the program, and cooperating with other hardware configurations. The control unit 33 includes an acquisition unit 331, a target identification unit 332, a wake word processing unit 333, and an alternative word detection unit 334.

The acquisition unit 331 acquires information such as text information 222 from the user terminal 2 and stores it in the storage unit 32 as reception information 321.

The target specifying unit 332 identifies the target of the wake word processing based on the text information 222 included in the received information 321. Specifically, the target specifying unit 322 detects the name included in the text information 222 with reference to the target information 322, and identifies the target corresponding to the detected name as the target of the wake word processing.

The wake word processing unit 333 executes wake word processing according to the wake word and the target of the wake word processing. The wake word processing unit 333 includes a record creation unit 3331, a record notification unit 3332, a message transmission unit 3331, and a transmission registration unit 3334.

When the first wake word (completion) is detected, the record creation unit 3331 estimates the content of the nursing care work from the text information 222, and the estimated content of the nursing care work and the information indicating the target of the wake word processing (user's information). Create a long-term care record that includes UIDs, names, etc.). The record creation unit 3331 can estimate the content of the long-term care work from the text information 222 by any method such as a method using a keyword, a method using a machine learning model, and a method using an alternative word. The contents of the long-term care work include the type of the long-term care work and the amount related to the long-term care work. The record creation unit 3331 registers the created care record in the care system 4 as a target care record.

When the second wake word (confirmation) is detected, the record notification unit 3332 estimates the content of the nursing care work from the text information 222, and the estimated content of the nursing care work and information indicating the target of the wake word processing (user's information). A long-term care record including UID, name, etc.) is acquired from the long-term care system 4, and the acquired long-term care record is notified to the user. The record notification unit 3332 can estimate the content of the nursing care work from the text information 222 by any method such as a method using a keyword, a method using a machine learning model, and a method using an alternative word. The record notification unit 3332 may notify the user by displaying the acquired nursing care record on the display device of the user terminal 2, or may notify the user by outputting the acquired nursing care record by voice from the income 1. good.

When the third wake word (transmission) is detected, the message transmission unit 3333 transmits at least one of the voice information 221 and the text information 222 to the target (other user) as a message from the user. The user terminal 2 of the target (other user) who received the message may display the received message on the display device, or may output the received message by voice from the income 1 of the target (other user). ..

When the fourth wake word (sending) is detected, the sending registration unit 3334 registers at least one of the voice information 221 and the text information 222 in the nursing care system 4 as a sending item regarding the target.

When the first wake word (completed) or the second wake word (confirmation) is detected, the substitute word detection unit 334 refers to the substitute word information 323 and detects the substitute word registered in advance from the text information 222. ..

The functional configuration of the support device 3 is not limited to the above example. The support device 3 may include a part of the above-mentioned functional configuration, or may have a functional configuration other than the above. For example, the support device 3 may be provided with a part of the above-mentioned functional configuration in the user terminal 2 or the nursing care system 4, or may be provided with a part of the functional configuration of the user terminal 2 or the nursing care system 4.

<Processes executed by the long-term care business support device 3>
Next, the process executed by the support device 3 will be described. FIG. 11 is a flowchart showing an example of the process executed by the support device 3.

(Step S201)
The acquisition unit 331 acquires the text information 222 and the like received from the user terminal 2 by the communication unit 31, and stores the acquired text information 222 and the like as the reception information 321 in the storage unit 32.

(Step S202)
The target identification unit 332 refers to the target information 322 and detects the name of the target from the text information 222 included in the received information 321. If the target designation is not detected (step S202: NO), the process ends. On the other hand, when the target designation is detected (step S202: YES), the process proceeds to step S203.

(Step S203)
The target specifying unit 332 identifies the target corresponding to the designation detected in step S202 as the target of the wake word processing.

(Step S204)
The wake word processing unit 333 executes wake word processing according to the type of wake word included in the received information 321. If the wake word is the first wake word (step S204: completion), the process proceeds to step S205. If the wake word is the second wake word (step S204: confirmation), the process proceeds to step S206. If the wake word is a third wake word (step S204: transmission), the process proceeds to step S207. If the wake word is the fourth wake word (step S204: transfer), the process proceeds to step S208.

(Step S205)
The record creation unit 3331 creates a long-term care record including the contents of the long-term care work and information indicating the target of the wake word processing specified in step S203, and registers the long-term care record in the long-term care system 4. The target of wake word processing corresponds to the target of long-term care work. The method of creating a long-term care record will be described in detail later.

(Step S206)
The record notification unit 3332 acquires a long-term care record including the contents of the long-term care work and the information indicating the target of the wake word processing specified in step S203 from the long-term care system 4, and notifies the user of the acquired long-term care record. The target of wake word processing corresponds to the target of long-term care work. The method of notifying the long-term care record will be described in detail later.

(Step S207)
The message transmission unit 3333 transmits at least one of the voice information 221 and the text information 222 included in the received information 321 to the user terminal 2 targeted for wake word processing specified in step S203 as a message from the user. The target of wake word processing corresponds to the destination of the message.

(Step S208)
The transmission registration unit 3334 registers at least one of the voice information 221 and the text information 222 included in the received information 321 in the nursing care system 4 as a transmission item regarding the target of the wake word processing specified in step S203. The target of wake word processing corresponds to the target of the matters to be sent.

It is preferable that the wake word processing unit 333 notifies the user to that effect after the wake word processing is completed. For example, the wake word processing unit 333 may output a notification sound notifying the completion of the wake word processing from the speaker of the user terminal 2, or an image notifying the display device of the user terminal 2 of the completion of the wake word processing. May be displayed. Further, the wake word processing unit 333 may transmit the voice information of the notification sound notifying the completion of the wake word processing to the income 1 and output the notification sound from the speaker of the income 1. It is preferable that the notification sound for notifying the completion of the wake word processing is different for each wake word processing. By notifying the user of the completion of the wake word processing in this way, the user can promptly confirm that the wake word processing corresponding to the wake word spoken by the user has been completed.

<Summary>
By the above processing, the support device 3 can execute the wake word processing according to the wake word spoken by the user, the name of the target of the wake word processing, and the content of the wake word processing. That is, the user simply speaks a wake word according to a desired wake word process, a name of a target of the wake word process, and the content of the wake word process, and the support device 3 can perform a plurality of types of wake word processes. Can be executed.

For example, when the user utters "Mr. Sato, you have eaten the whole meal, it is completed", the acquisition unit 331 acquires the received information D001 (see FIG. 6) (step S201). Next, the target identification unit 332 detects the name "Sato" from the text information 222 "Mr. Sato, have eaten all the meal" (step S202: YES), and the care recipient C001 is targeted for wake word processing. (See FIG. 7) is specified (step S203). After that, the record creation department 3331 estimated the content of the long-term care work (for example, type: meal assistance, amount: total amount) from the text information 222 that "Mr. Sato ate the whole meal", and the estimated content of the long-term care work. And a long-term care record including information indicating the care recipient C001 is created (step S205), and the created long-term care record is registered in the long-term care system 4. In this way, the user can create a desired long-term care record simply by speaking the name (name) of the long-term care recipient, the contents of the long-term care record, and the wake word "completed".

Further, when the user utters "confirm about Mr. Sato's medication", the acquisition unit 331 acquires the received information D002 (see FIG. 6) (step S201). Next, the target identification unit 332 detects the name "Sato" from the text information 222 "About Mr. Sato's medication" (step S202: YES), and the care recipient C001 (see FIG. 7) is targeted for wake word processing. (Step S203). After that, the record notification unit 3332 estimates the content of the long-term care work (for example, type: medication assistance) from the text information 222 "About Mr. Sato's medication", and provides the estimated content of the long-term care work and information indicating the care recipient C001. The including long-term care record is acquired from the long-term care system 4, and the acquired long-term care record is notified to the user (step S206). In this way, the user can confirm the desired long-term care record simply by speaking the name (name) of the long-term care recipient, the contents of the long-term care record, and the wake word "confirmation".

Further, when the user utters "Mr. Suzuki, please come to the cafeteria as soon as possible, send", the acquisition unit 331 acquires the received information D003 (see FIG. 6) (step S201). Next, the target identification unit 332 detects the name "Suzuki" from the text information 222 "Mr. Suzuki, please come to the cafeteria as soon as possible" (step S202: YES), and the user U001 (FIG. 8) is targeted for wake word processing. (See) is specified (step S203). After that, the message transmission unit 3333 transmits at least one of the text information 222 and the voice information 221 (M003.mp3) saying "Mr. Suzuki, please come to the cafeteria as soon as possible" to the user U001 (step S207). In this way, the user can send a message to another desired user simply by uttering the name (name) of another user, the content of the message, and the wake word "send".

Further, when the user utters "Mr. Sato has a cold, send it", the acquisition unit 331 acquires the received information D004 (see FIG. 6) (step S201). Next, the target identification unit 332 detects the name "Sato" from the text information 222 that "Mr. Sato has a cold" (step S202: YES), and the care recipient C001 (see FIG. 7) is targeted for wake word processing. ) Is specified (step S203). After that, the transfer registration unit 3334 registers at least one of the text information 222 and the voice information 221 (M004.mp3) that "Mr. Sato has a cold" in the care system 4 as a transfer item regarding the care recipient C001 (step S208). .. In this way, the user can register the desired long-term care system 4 by simply speaking the name (name) of the care recipient, the content of the long-term care, and the wake word "send-off".

When the wake word is detected, the voice information after the wake word is converted into text information and the wake word process is executed. Similarly, the support device 3 uses the wake word spoken by the user and the wake word. Wake word processing can be executed according to the name of the target of wake word processing and the content of wake word processing. That is, the user simply speaks the wake word corresponding to the desired wake word processing, the name of the target of the wake word processing, and the content of the wake word processing, and the user executes the desired wake word processing on the support device 3. Can be made to.

<How to create a long-term care record>
Next, the method of creating a long-term care record will be described in detail. FIG. 12 is a flowchart showing an example of a method of creating a long-term care record. The process of FIG. 12 corresponds to the internal process of step S205.

(Step S301)
The alternative word detection unit 334 detects the alternative word from the text information 222 with reference to the alternative word information 323. If an alternative word is detected (step S301: YES), the process proceeds to step S302. On the other hand, if the alternative word is not detected (step S301: NO), the process proceeds to step S303.

(Step S302)
The record creation unit 3331 refers to the alternative word information 323, and acquires the content of the long-term care work corresponding to the alternative word detected in step S301 as the estimation result of the content of the long-term care work corresponding to the text information 222.

(Step S303)
The record creation unit 3331 estimates the content of the long-term care work based on the text information 222. The estimation method can be arbitrarily selected.

(Step S304)
The recording creation unit 3331 includes information indicating the content of the long-term care work (at least one of the type and amount of the long-term care work) estimated in step S302 or step S303, and the target (care recipient) of the wake word processing specified in step S203. Create a long-term care record that includes.

(Step S305)
The record creation unit 3331 registers the long-term care record created in step S304 in the long-term care system 4, and notifies the user that the registration is completed.

<Summary>
By the above processing, the support device 3 can create a long-term care record including the name of the target (care recipient) of the wake word processing and the content of the long-term care work corresponding to the alternative word. That is, the user simply speaks a wake word of completion, a name of the target (care recipient) of the wake word process, and an alternative word corresponding to the content of the long-term care work, and the user simply speaks the desired long-term care record in the support device 3. Can be created.

For example, when the user utters "Mr. Sato, A1, completed", the acquisition unit 331 acquires the received information D005 (see FIG. 6) (step S201). Next, the target identification unit 332 detects the name "Sato" from the text information 222 "Mr. Sato, A1" (step S202: YES), and selects the care recipient C001 (see FIG. 7) as the target of wake word processing. Specify (step S203). After that, the alternative word detection unit 334 detects the alternative words "A" and "1" from the text information 222 "Mr. Sato, A1" (step S301: YES), and the record creation unit 3331 "" as the content of the nursing care work. Acquire "type: excretion assistance (stool), amount: small amount" (step S302), and create a long-term care record including information indicating "type: excretion assistance (stool), amount: small amount" and the care recipient C001 (step). S304), the created care record is registered in the care system 4 (step S305). In this way, the user simply speaks the name (name) of the care recipient, the alternative word corresponding to the content of the care record, and the wake word "completed", and the user directly in front of the care recipient or the like. It is possible to create a long-term care record in which it is not appropriate to utter the recorded contents (it is not appropriate for the care recipient to hear the recorded contents). That is, the user can create a long-term care record without directly speaking the recorded contents.

<Notification method of long-term care record>
Next, the method of notifying the long-term care record will be described in detail. FIG. 13 is a flowchart showing an example of a method for notifying a long-term care record. The process of FIG. 13 corresponds to the internal process of step S206.

(Step S401)
The alternative word detection unit 334 detects the alternative word from the text information 222 with reference to the alternative word information 323. If an alternative word is detected (step S401: YES), the process proceeds to step S402. On the other hand, if the alternative word is not detected (step S401: NO), the process proceeds to step S403.

(Step S402)
The record notification unit 3332 refers to the alternative word information 323 and acquires the content of the long-term care work corresponding to the alternative word detected in step S401 as the estimation result of the content of the long-term care work corresponding to the text information 222.

(Step S403)
The record notification unit 3332 estimates the content of the long-term care work based on the text information 222. The estimation method can be arbitrarily selected.

(Step S404)
The record notification unit 3332 includes information indicating the content of the long-term care work (at least one of the type and amount of the long-term care work) estimated in step S402 or step S403, and the target (care recipient) of the wake word processing specified in step S203. A long-term care record including, is acquired from the long-term care system 4.

(Step S405)
The record notification unit 3332 notifies the user by transmitting the care record acquired in step S404 to the user terminal 2.

<Summary>
By the above processing, the support device 3 can notify the user of the long-term care record including the name of the target (care recipient) of the wake word processing and the content of the long-term care work corresponding to the alternative word. That is, the user confirms the desired long-term care record simply by speaking the wake word of confirmation, the name of the target (care recipient) of the wake word processing, and the alternative word corresponding to the content of the long-term care work. Can be done.

For example, when the user utters "Mr. Sato, B, confirmation", the acquisition unit 331 acquires the received information D006 (see FIG. 6) (step S201). Next, the target identification unit 332 detects the name "Sato" from the text information 222 "Mr. Sato, B" (step S202: YES), and selects the care recipient C001 (see FIG. 7) as the target of wake word processing. Specify (step S203). After that, the alternative word detection unit 334 detects the alternative word "B" from the text information 222 "Mr. Sato, B" (step S401: YES), and the record notification unit 3332 "type: excretion assistance" as the content of the nursing care work. (Step S402) ”is acquired (step S402), a long-term care record including information indicating“ type: excretion assistance (urine) ”and the care recipient C001 is acquired from the long-term care system 4 (step S404), and the acquired long-term care record is obtained. Notify the user (step S405). In this way, the user directly speaks the recorded contents simply by speaking the name (name) of the care recipient, the alternative word corresponding to the contents of the long-term care record, and the wake word "confirmation". It is not appropriate (it is not appropriate for the care recipient to ask the recorded contents). It is possible to confirm the care record. That is, the user can confirm the long-term care record without directly speaking the recorded contents.

<Additional Notes>
The present embodiment includes the following disclosures.

(Appendix 1-1)
It is a business support method executed by an information processing system.
The acquisition process to acquire the voice information of the voice spoken by the user,
A storage process for storing the acquired voice information for a predetermined period, and
Wake word detection processing that detects wake words from the voice information,
When the wake word is detected, the text conversion process for converting the voice information before the wake word into text information, and
Business support methods including.

(Appendix 1-2)
The business support method according to Appendix 1-1, wherein the detection process detects the wake word by using a detection model obtained by machine learning the voice information of the wake word.

(Appendix 1-3)
The business support method according to Appendix 1-1 or Appendix 1-2, wherein the detection process detects each of a plurality of types of the wake words.

(Appendix 1-4)
An acquisition unit that acquires voice information of the voice spoken by the user,
A storage unit that stores the acquired voice information for a predetermined period,
A wake word detection unit that detects a wake word from the voice information,
When the wake word is detected, a text conversion unit that converts voice information before the wake word into text information, and a text conversion unit.
Business support system equipped with.

(Appendix 1-5)
For information processing equipment system
The acquisition process to acquire the voice information of the voice spoken by the user,
A storage process for storing the acquired voice information for a predetermined period, and
Wake word detection processing that detects wake words from the voice information,
When the wake word is detected, the text conversion process for converting the voice information before the wake word into text information, and
A program for executing business support methods including.

(Appendix 2-1)
It is a business support method executed by an information processing system.
The acquisition process to acquire the voice information of the voice spoken by the user,
Wake word detection processing that detects wake words from the voice information,
When the wake word is detected, the text conversion process for converting the voice information into text information and
Target identification processing that identifies the target based on the text information, and
The wake word process that executes the process according to the wake word and the target, and the wake word process.
Business support methods including.

(Appendix 2-2)
The business support method according to Appendix 2-1 is to create a record including the content of the work estimated from the text information and the information indicating the target when the first wake word is detected. ..

(Appendix 2-3)
When the second wake word is detected, the wake word process notifies the user of a record including the content of the work estimated from the text information and the information indicating the target, and the appendix 2-1 or the appendix 2. The business support method described in -2.

(Appendix 2-4)
In the wake word processing, when the third wake word is detected, at least one of the voice information and the text information is transmitted to the target. Method.

(Appendix 2-5)
The wake word processing is described in any one of Supplementary 2-1 to Supplementary Note 2-4 in which at least one of the voice information and the text information is registered as a notification item regarding the target when the fourth wake word is detected. Business support method.

(Appendix 2-6)
The business support method according to any one of Supplementary note 2-1 to Supplementary note 2-5, wherein the target includes at least one of the worker, the worker, and a preset group.

(Appendix 2-7)
An acquisition unit that acquires voice information of the voice spoken by the user,
A wake word detection unit that detects a wake word from the voice information,
When the wake word is detected, the text conversion unit that converts the voice information into text information, and
The target identification unit that identifies the target based on the text information,
A wake word processing unit that executes processing according to the wake word and the target, and
Business support system equipped with.

(Appendix 2-8)
For information processing systems
The acquisition process to acquire the voice information of the voice spoken by the user,
Wake word detection processing that detects wake words from the voice information,
When the wake word is detected, the text conversion process for converting the voice information into text information and
Target identification processing that identifies the target based on the text information, and
The wake word process that executes the process according to the wake word and the target, and the wake word process.
A program for executing business support methods including.

(Appendix 3-1)
It is a business support method executed by an information processing system.
Acquisition process to acquire voice information and
Wake word detection processing that detects wake words from the voice information,
When the wake word is detected, the text conversion process for converting the voice information into text information and
An alternative word detection process that detects an alternative word registered in advance from the text information,
A record creation process that creates a record that includes the content of the work corresponding to the alternative word,
Business support methods including.

(Appendix 3-2)
Further including a target identification process for specifying a target based on the text information,
The business support method according to Appendix 3-1, wherein the record further includes information indicating the specified target.

(Appendix 3-3)
The alternative term is the business support method according to Appendix 3-1 or Appendix 3-2, which corresponds to at least one of the type of work and the amount related to the work.

(Appendix 3-4)
The alternative word is the business support method described in any one of Supplementary note 3-1 to Supplementary note 3-3, which is an alphabet, a numerical value, or a combination thereof.

(Appendix 3-5)
The acquisition unit that acquires audio information,
A wake word detection unit that detects a wake word from the voice information,
When the wake word is detected, the text conversion unit that converts the voice information into text information, and
An alternative word detection unit that detects a pre-registered alternative word from the text information,
A record creation unit that creates a record that includes the content of the work corresponding to the alternative word,
Business support system equipped with.

(Appendix 3-6)
For information processing systems
Acquisition process to acquire voice information and
Wake word detection processing that detects wake words from the voice information,
When the wake word is detected, the text conversion process for converting the voice information into text information and
An alternative word detection process that detects an alternative word registered in advance from the text information,
A record creation process that creates a record that includes the content of the work corresponding to the alternative word,
A program for executing business support methods including.

The embodiments disclosed this time should be considered to be exemplary in all respects and not restrictive. The scope of the present invention is indicated by the scope of claims, not the above-mentioned meaning, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims. Further, the present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the present invention can be obtained by appropriately combining the technical means disclosed in the different embodiments. Embodiments are also included in the technical scope of the present invention.

1: Income 2: User terminal 3: Nursing work support device 4: Nursing system 21: Communication unit 22: Storage unit 23: Control unit 221: Voice information 222: Text information 231: Wake word detection unit 232: Text conversion unit 31: Communication unit 32: Storage unit 33: Control unit 321: Received information 322: Target information 323: Alternative word information 331: Acquisition unit 332: Target identification unit 333: Wake word processing unit 334: Alternative word detection unit 100: Information processing device 101 : Processor 102: Memory 103: Storage 104: Communication I / F
105: Input / output I / F
106: Input device 107: Output device 108: Drive device 109: Disk media

Claims (5)

It is a business support method executed by an information processing system.
Acquisition process to acquire the voice information of the voice spoken by the worker,
Wake word detection processing that detects wake words from the voice information,
When the wake word is detected, the text conversion process for converting the voice information into text information and
Target identification processing that identifies the group based on the name of the group included in the text information,
A record creation process for creating a record including the content of the work estimated from the text information and the information indicating the group .
Business support methods including. The business support method according to claim 1, further comprising a process of notifying the worker of the completion of the record creation process by sound. The business support method according to claim 1 or 2, wherein the content of the work includes at least one of the type and amount of the work. The acquisition unit that acquires the voice information of the voice spoken by the worker,
A wake word detection unit that detects a wake word from the voice information,
When the wake word is detected, the text conversion unit that converts the voice information into text information, and
A target identification unit that identifies the group based on the name of the group included in the text information, and
A record creation processing unit that creates a record including the content of the work estimated from the text information and the information indicating the group .
Business support system equipped with. For information processing systems
The acquisition process to acquire the voice information of the voice spoken by the worker,
Wake word detection processing that detects wake words from the voice information,
When the wake word is detected, the text conversion process for converting the voice information into text information and
Target identification processing that identifies the group based on the name of the group included in the text information,
A record creation process for creating a record including the content of the work estimated from the text information and the information indicating the group .
A program for executing business support methods including.

Images