JP6429295B2 - Phonetic transcription support system, server, phonetic transcription support method and program - Google Patents

Description

  The present invention relates to a system, a server, a support method, and a program to be executed by a computer for assisting a support recipient in converting a voice information into text.

  Summary writing support is one way to ensure information for people with hearing impairments. Summary writing support is a support method that guarantees information by displaying the utterances of a speaker in text or on a personal computer.

  Currently, support recipients need to make advance reservations with support organizations to receive summary written support. For this reason, the support recipient cannot receive summary writing support when it cannot be predicted that support will be required in advance, such as “going to the hospital due to sudden illness” or “asking for directions”.

  As in the above-described support method, the method in which a person performs support for converting speech into a character has a problem that a supporter cannot be secured immediately when support is required. In response to this problem, a method for securing a supporter whenever a support recipient needs support is being studied. An example of the method will be described below.

  Although it is not summary writing support, Non-Patent Document 1 discloses a remote interpretation service as an example of a remote support service. The method disclosed in Non-Patent Document 1 will be briefly described. A company providing an interpreting service secures translators in advance, and a tablet terminal is installed in advance at a window providing the interpreting service. When the support recipient wants to receive an interpreting service, the tablet terminal is connected to a remote translator's terminal so that the tablet terminal can communicate with the remote translator terminal, and can receive the interpreting service. However, since translators are not secured during the hours when no window is opened, such as at night, support recipients cannot receive translation services during those hours.

  In order to solve this problem, Patent Document 1 discloses a method and system for real-time language translation using a social networking service (SNS). The method disclosed in Patent Document 1 will be briefly described. When the support beneficiary needs to be transcribed, the support beneficiary uses the SNS to request a person from all over the world to transcribe it by a short message service (SMS) message. If there is a person who can support, the support recipient can receive support via the network even if the person is in a remote place. Since the target area of the support candidate is the world, the support recipient is more likely to receive support whenever assistance is needed.

Japanese Patent No. 5516981

“Trial introduction of remote sign language interpretation service”, [online], June 4, 2013, East Japan Railway Company, [February 2, 2015 search], Internet <URL: https: // www. jreast.co.jp/press/2013/20130601.pdf>

  In the method disclosed in Patent Literature 1, since SNS is used, complicated operations such as SNS account registration and support request message input are required. Therefore, depending on the degree of IT (Information Technology) literacy that the support recipient has, there is a possibility that the support cannot be received. In the future, as the number of elderly people increases, the number of elderly people whose hearing is weakening year by year may increase. Even such a person needs to be able to receive support.

  Further, in the method disclosed in Patent Document 1, there is a concern that even an uninformed person who has never met the conversation contents because of using SNS will be known. Even in the method disclosed in Non-Patent Document 1, since the supporter becomes an uninformed person, there is an anxiety that the conversation content is known to an uninformed person.

  An object of the present invention is to provide a phonetic transcription support system, a server, a phonetic transcription support method, and a computer that enable a user to receive support from a reliable person without requiring complicated operations. It is to provide a program to be executed.

One aspect voice character of support system of the present invention acquires the user terminal identifier is an identifier of the user terminal by communicating with the user terminal used by the user to be assisted for converting information by voice in the information by the character When the user terminal identifier is acquired from the user terminal through communication between the user terminal and the support organization terminal that includes the user terminal identifier and transmits the first relation information indicating that the user belongs to the support organization to the network, Used by a supporter who supports the user terminal identifier and the supporter terminal identifier that is the identifier of the own terminal, and transmits second relation information indicating that the user terminal and the own terminal have a support enjoyment relationship to the network. When receiving the first and second related information from the supporter terminal and the support organization terminal and the supporter terminal via the network, Beauty based on the second relationship information, anda server create and store a list that registered the assistance terminal identifier corresponding to the user terminal identifier associated with the each support groups, server, user terminal When the support request signal including the identifier is received from the user terminal via the network, the support organization in which the user terminal identifier included in the support request signal is registered from among the supporter terminals registered in the list for each support organization. When a plurality of supporter terminals associated with the device are identified, a support request signal is transferred to the plurality of identified supporter terminals, and a supportable notification is received indicating that support is possible, a supportable notification The support terminal of the transmission source is connected so as to be communicable with the user terminal via the network. After the support terminal is connected to be communicable with the user terminal, the voice data is transmitted from the user terminal. Upon receiving the outputs audio based on audio data, when a character to the output voice is input, it is configured to transmit to the user terminal in order to display the information of the character that is input to the user terminal.

The server according to one aspect of the present invention provides support used by a supporter who performs support corresponding to a user terminal identifier that is an identifier of a user terminal used by a user who wants to receive support for converting voice information into text information. A storage unit for storing a list in which a supporter terminal identifier, which is an identifier of a worker terminal, is registered, and first relation information including a user terminal identifier and indicating that the user belongs to a support organization And supporting the second relation information including the user terminal identifier and the supporter terminal identifier that is the identifier of the own terminal, and indicating that there is a support receiving relationship between the user terminal and the supporter terminal. who receives via the network from the terminal, based on the first and second relationship information, supporters end corresponding to the user terminal identifier associated with the each support group A control unit for storing in the storage unit created to a list that registers an identifier, the control unit, when the help request signal including the user terminal identifier received from the user terminal via a network, list for each support group Identify a plurality of supporter terminals associated with the support organization in which the user terminal identifier included in the support request signal is registered, and address to the specified supporter terminals The support request signal is transferred to the support terminal, and when a support enable notification is received indicating that support is possible, the support terminal of the support enable notification transmission source is communicably connected to the user terminal via the network. .

A phonetic characterizing support method according to an aspect of the present invention is a voice characterizing support method using a support organization terminal, a supporter terminal, and a server connected via a network. When a user terminal identifier, which is an identifier of a user terminal, is obtained by communication with a user terminal used by a user who wants to receive support for conversion into information, the user terminal identifier is included and indicates that the user belongs to a support organization 1, when the supporter terminal obtains the user terminal identifier through communication with the user terminal, the user terminal identifier and the supporter terminal identifier that is the identifier of the own terminal are included. The second relationship information indicating that the terminal and the terminal have a receiving / supporting relationship is transmitted to the server via the network. Upon receiving the first and second relation information from the support group terminal and support terminal via the workpiece, based on the first and second relationship information, corresponding to the user terminal identifier associated with the each support group A list of registered supporter terminal identifiers is created and stored, and when the server receives a support request signal including the user terminal identifier from the user terminal via the network, the supporter terminal registered in the list for each support group Identify a plurality of support terminals associated with a support organization in which the user terminal identifier included in the support request signal is registered , and transfer the support request signal to the specified plurality of support terminals, When the server receives a supportable notification that indicates that support is possible, the supporter terminal that sent the supportable notification can communicate with the user terminal via the network. After the support terminal is connected so as to be communicable with the user terminal, when voice data is received from the user terminal, voice based on the voice data is output. When characters are input to the output voice, input is performed. The character information is transmitted to the user terminal to be displayed on the user terminal.

A program according to one aspect of the present invention includes a user terminal identifier, which is an identifier of a user terminal used by a user who wants to receive assistance for converting voice information into character information, and the user belongs to a support organization. Including a procedure for receiving first relation information indicating that the user terminal is present from the support organization terminal via the network, a user terminal identifier and a supporter terminal identifier that is an identifier of the own terminal. For each support organization , based on the procedure for receiving the second related information indicating that there is, via the network, from the support terminal used by the support supporter, and the received first and second related information a step of assistance terminal identifier corresponding to the user terminal identifier create and store a list which is registered which is correlated, support includes a user terminal identifier Yi Upon receiving via the network a signal from the user terminal, from among the support terminal registered in the list for each support groups, associated with the support group to which the user terminal identifier included in the assistance request signal is registered When a support request signal is transmitted, a support request signal is transmitted to a plurality of specified supporter terminals, and a response indicating support is received is received. A procedure for connecting the supporter terminal so as to be communicable with the user terminal via the network is executed.

FIG. 1 is a block diagram for explaining the configuration of the phonetic transcription support system of this embodiment. FIG. 2 is a block diagram illustrating a configuration example of each device related to the phonetic transcription support system described with reference to FIG. FIG. 3 is a flowchart showing a procedure for registering a support organization in the server. FIG. 4 is a diagram illustrating an example of a data structure image when a support organization is registered in the related information registration unit. FIG. 5 is a flowchart showing a procedure for registering related information between a support recipient and a support organization in a server. FIG. 6 is a diagram illustrating an example of a data structure image when the related information between the support recipient and the support group is registered in the related information registration unit. FIG. 7 is a flowchart showing a procedure for registering related information between the supporter and the support beneficiary in the server. FIG. 8 is a diagram illustrating an example of a data structure image when the related information between the supporter and the support recipient is registered in the related information registration unit. FIG. 9 is a diagram illustrating an example of a data structure image when a support recipient and a supporter are associated with each other and stored in the related information storage unit. FIG. 10 is a flowchart showing the procedure of the support request. FIG. 11 is a diagram showing an example of an operation screen for support request displayed on the support beneficiary terminal. FIG. 12 is a flowchart showing a procedure from when a supporter terminal receives a support request until the supporter provides support.

  Embodiments of the present invention will be described with reference to the drawings.

  The configuration of the phonetic transcription support system of this embodiment will be described. FIG. 1 is a block diagram for explaining the configuration of the phonetic transcription support system of this embodiment.

  As shown in FIG. 1, the phonetic transcription support system includes a phonetic transcription support server (hereinafter simply referred to as “server”) 1, a support organization terminal 2, and a supporter terminal 4.

  The support beneficiary terminal 3 corresponds to a user terminal used by a user who receives support for converting voice information into text information. The supporter terminal 4 is a terminal used by a supporter who supports the support recipient. The support group terminal 2 is a terminal for registering related information for supporting the support recipient in the server 1, and is a terminal used by the administrator of the support group. The server 1 specifies a supporter who can support the support request from the support beneficiary, and even if the supporter is in a remote place far away from the support beneficiary, the terminal of each person is connected via the communication network 9. Connected so that support recipients can receive support in real time.

  The server 1, the support organization terminal 2, the support beneficiary terminal 3, and the supporter terminal 4 are connected to each other via a communication network 9 so that they can communicate with each other.

Each terminal of the support group terminal 2, the support beneficiary terminal 3, and the supporter terminal 4 is registered in advance with a unique terminal identifier for enabling the terminal to be distinguished from other terminals. Further, the identifier of the server 1 is registered in advance in each terminal. Each device communicates with each other using a predetermined communication protocol. In the present embodiment, it is assumed that the communication network 9 is the Internet and the communication protocol is TCP (Transmission Control Protocol) / IP (Internet Protocol).
The configuration of each device related to the phonetic transcription support system will be described in detail below.

  FIG. 2 is a block diagram illustrating a configuration example of each device related to the phonetic transcription support system described with reference to FIG.

  First, the configuration of the server 1 will be described. The server 1 includes a related information storage unit 14 that corresponds to a storage unit, and a control unit 15.

  The control unit 15 includes a related information registration unit 11, a support request unit 12, and a remote support unit 13. The control unit 15 includes a CPU (Central Processing Unit) (not shown) that executes processing according to a program, and a memory (not shown) that stores the program. When the CPU executes the program, the related information registration unit 11, the support request unit 12, and the remote support unit 13 are virtually configured in the server 1.

  The related information storage unit 14 holds related information indicating information indicating which support recipients and supporters are registered in which support organization, and information indicating which supporters support which support recipients.

  The related information registration unit 11 receives related information regarding the support receiving relationship from the support group terminal 2 and the supporter terminal 4, creates related information based on the related information, and stores the related information in the related information storage unit 14.

  When receiving the support request notification from the support beneficiary terminal 3, the support request unit 12 notifies the support request only to the supporter terminal 4 possessed by the related supporter.

  The remote support unit 13 connects the supporter terminal 4 and the support beneficiary terminal 3 used by a supporter capable of support via the communication network 9 so that they can communicate with each other.

  Next, the configuration of the support group terminal 2 will be described.

  The support group terminal 2 includes a support group registration unit 21, a support beneficiary registration unit 22, and a related information reception unit 23. The support group terminal 2 is an information processing apparatus such as a personal computer (PC) having a short-range wireless communication function. The support group terminal 2 is provided with a CPU (not shown) that executes processing according to a program and a memory (not shown) that stores the program. The support group registration unit 21 and the support beneficiary registration unit 22 are virtually configured in the support group terminal 2 by the CPU executing the program.

  The relationship information receiving unit 23 is a short-range communication unit that acquires the terminal identifier of the support beneficiary terminal 3 from the support beneficiary terminal 3 by short-range wireless communication.

  The support group registration unit 21 transmits information for registering the support group to the server 1 to the related information registration unit 11 of the server 1.

  When the support beneficiary registration unit 22 receives the terminal identifier of the support beneficiary terminal 3 from the relationship information receiving unit 23, the support beneficiary registration unit 22 registers the related information in the server 1 to register that the support beneficiary is related to the support beneficiary. 1 to the related information registration unit 11.

  In this embodiment, the short-range data exchanging means for exchanging identifiers between terminals will be described in the case of short-range wireless communication including NFC (Near Field Communication) and Bluetooth (registered trademark). It is not limited to means. As a short-distance data exchanging means, for example, the identifier of the own terminal is exchanged between the terminals by photographing the QR code (registered trademark) displayed on the display unit of one portable terminal with the camera provided on the other portable terminal. It may be a means to do. In the phonetic transcription support system, it is possible to use short-distance data exchange means such as NFC technology that allows data exchange by simply bringing the terminals close together from the viewpoint of simplifying the operation to the portable terminal by the support recipient. desirable.

  Next, the configuration of the support beneficiary terminal 3 will be described.

  The support beneficiary terminal 3 is configured to include a support request transmission unit 31, a remote support reception unit 32, and a related information transmission unit 33. The support beneficiary terminal 3 is, for example, a mobile terminal such as a smartphone or a PDA (Personal Digital Assistants).

  The support beneficiary terminal 3 is provided with a CPU (not shown) for executing processing according to a program and a memory (not shown) for storing the program. The remote support receiving unit 32 is virtually configured in the support beneficiary terminal 3 by the CPU executing the program. The memory for storing the program and the CPU for executing the program are included in the control unit of a general portable terminal, and are not shown in the figure. The support beneficiary terminal 3 includes a microphone, a display unit, and a storage unit that are provided in a general portable terminal, but illustration of these configurations in the drawing is omitted.

  The related information transmission unit 33 is a short-range communication unit that transmits a terminal identifier of the terminal itself to the support group terminal 2 and the supporter terminal 4 by short-range wireless communication.

  The support request transmission unit 31 is a terminal of its own terminal for notifying other devices that support is required when an input indicating that support is desired is received from the support recipient via an operation unit (not shown). A support request signal including the identifier is transmitted to the support request unit 12 of the server 1.

  The remote support receiving unit 32 collects sound around the support beneficiary terminal 3 and transmits the collected sound data to the remote support unit 43 of the supporter terminal 4 via the communication network 9. In addition, the remote support receiving unit 32 displays the result of the supporter characterizing the voice on a display unit (not shown).

  Note that the terminal identifier of the supporter terminal 4 may be registered in advance in the storage unit (not shown) corresponding to the names of a plurality of supporters. The storage unit may group a plurality of supporters into a plurality of types, and store a terminal identifier and a supporter name for each supporter terminal. In this case, when there is an input indicating that the support request is to be received, the support request transmitting unit 31 displays one type from a plurality of types on a display unit (not shown) so as to be able to select, and supports the information of the selected type. The request signal may be included and transmitted. Further, when transmitting the terminal identifier of the own terminal to the supporter terminal 4, the related information transmission unit 33 may receive the terminal identifier of the supporter terminal 4 by short-range wireless communication and store it in the storage unit. .

  Next, the configuration of the supporter terminal 4 will be described.

  The supporter terminal 4 includes a supporter registration unit 41, a support request reception unit 42, a remote support unit 43, and a relationship information reception unit 44. The supporter terminal 4 is a mobile terminal such as a smartphone and a PDA, for example.

  The supporter terminal 4 is provided with a CPU (not shown) that executes processing according to a program and a memory (not shown) that stores the program. When the CPU executes the program, the supporter registration unit 41 and the remote support unit 43 are virtually configured in the supporter terminal 4. Moreover, although the supporter terminal 4 has a display unit and a speaker provided in a general portable terminal, these configurations are not shown in the drawing.

  The relationship information receiving unit 44 is a short-range communication unit that acquires the terminal identifier of the support beneficiary terminal 3 from the support beneficiary terminal 3 by short-range wireless communication.

  When the supporter registration unit 41 receives the terminal identifier of the support beneficiary terminal 3 from the relationship information receiving unit 44, the supporter registration unit 41 registers the relationship information in the server 1 to register that the supporter is related to the support beneficiary. It transmits to the information registration part 11.

  When receiving the support request notification from the server 1, the support request receiving unit 42 displays on the display unit (not shown) that the support request has been received. Then, when the supporter inputs that support is possible via the operation unit (not shown), the support request receiving unit 42 provides support to notify the server 1 that support is possible. A support enable notification including information indicating the possibility and the identifier of the own terminal is transmitted to the support request unit 12 of the server 1.

  When the remote support unit 43 receives the peripheral sound of the support beneficiary terminal 3 from the support beneficiary terminal 3, the remote support unit 43 reproduces the peripheral sound with a speaker (not shown). And if a supporter converts the information by a voice into the information by a character, the remote support part 43 will transmit the result after conversion to the remote support enjoyment part 32 of the support beneficiary terminal 3.

  Next, the operation procedure of the phonetic transcription support system of this embodiment will be briefly described with reference to FIG.

  The support group terminal 2 and the supporter terminal 4 acquire information of the support beneficiary in advance through the short-distance wireless communication with the support beneficiary terminal 3 and information indicating the relationship between the support beneficiary, the supporter, and the own group is stored in the server 1. Notify The related information registration unit 11 of the server 1 registers the information notified from the support organization terminal 2 in the related information storage unit 14.

  When support is needed, the support beneficiary operates the support beneficiary terminal 3 and inputs to the support beneficiary terminal 3 that support is required. The support beneficiary terminal 3 transmits a support request signal to the server 1 via the communication network 9 when it is input that support is required.

  When receiving the support request signal from the support beneficiary terminal 3, the support request unit 12 of the server 1 specifies a plurality of supporter terminals 4 to which a support request should be sent based on the information stored in the related information storage unit 14. Subsequently, the support request unit 12 transmits a support request signal to the identified plurality of supporter terminals 4 via the communication network 9.

The supporter terminal 4 that has received the support request signal displays a request for support. When the support person who sees the display can support remotely, he / she operates the support person terminal 4 and inputs that support is possible. When there is an input indicating that support is possible, the supporter terminal 4 transmits a support support notification to the server 1 via the communication network 9.

  When the support request unit 12 of the server 1 receives the support available notification from the supporter terminal 4, the support request unit 12 notifies the remote support unit 13 of information on the supporter terminal 4 and the support beneficiary terminal 3 that have transmitted the support available notification. When the remote support unit 13 receives information on the supporter terminal 4 and the support beneficiary terminal 3 from the support request unit 12, the remote support unit 13 connects these terminals via the communication network 9 so that they can communicate with each other. In this way, the support recipient can receive support even if the supporter is in a remote location far from him.

  Next, the operation procedure of the phonetic transcription support system of this embodiment will be described in detail.

  First, a method for registering related information of a support organization, a support beneficiary, and a supporter in the related information storage unit 14 of the server 1 will be described. The related information is information indicating which support group is associated with which support recipient and which support recipient is associated with which supporter. Such related information needs to be registered in the server 1 in advance. The server 1 generates and updates related information as follows based on the relationship information indicating the relationship between the support group and the support beneficiary and the relationship information indicating the relationship between the supporter and the support beneficiary. And learn about the relationships between support groups, support recipients and supporters.

  A method for registering a support organization in the server 1 will be described.

  When the administrator of the support group operates the support group terminal 2 and inputs a support group name, the support group registration unit 21 transmits the input information to the related information registration unit 11 of the server 1. When the related information registration unit 11 of the server 1 receives the information on the support organization name from the support organization terminal 2, the related information registration unit 11 stores the support organization name in the table of the related information storage unit 14. Subsequently, the related information registration unit 11 issues a support organization identifier which is identification character string information for uniquely identifying the support organization and notifies the support organization identifier in order to notify that the registration has been accepted. Reply to terminal 2. The support organization terminal 2 stores the support organization identifier received from the server 1 in the terminal.

  Next, a method for registering the relationship information between the support organization and the support beneficiary in the server 1 will be described.

  The support beneficiary goes to the support group to register his / her terminal as a terminal that receives the provision of the phonetic support service, and brings the support beneficiary terminal 3 close to the support group terminal 2. The related information transmitting unit 33 of the support beneficiary terminal 3 transmits a user terminal identifier that is a terminal identifier of the support beneficiary terminal 3 to the related information receiving unit 23 of the support group terminal 2 by short-range wireless communication.

  When receiving the user terminal identifier from the related information receiving unit 23, the support beneficiary registration unit 22 of the support group terminal 2 transmits the related information including the user terminal identifier and the support group identifier to the server 1. Here, the case where the name of the support beneficiary is also included in the related information will be described. When the support beneficiary brings the support beneficiary terminal 3 close to the support group terminal 2, the support beneficiary tells the administrator of the support group his / her name, and the administrator inputs the name of the support beneficiary to the support group terminal 2 To do. The support beneficiary registration unit 22 of the support group terminal 2 transmits relation information including the user terminal identifier, the name of the support beneficiary, and the support group identifier to the server 1 via the communication network 9.

  When the related information registration unit 11 of the server 1 receives the related information from the support organization terminal 2, the related information registration unit 11 identifies the information stored in the table with the support organization identifier included in the received related information and includes the specified support organization identifier. Register and update the user terminal identifier in the information. Thereby, the server 1 learns the relationship between the support group and the support beneficiary.

  Next, a method for registering the relationship information between the support recipient and the supporter in the server 1 will be described.

  The support beneficiary meets with the supporter directly to bring the support beneficiary terminal 3 closer to the supporter terminal 4 in order to register the supporter who wants to receive support in the phonetic transcription support system. The relationship information transmitting unit 33 of the support beneficiary terminal 3 transmits the user terminal identifier to the relationship information receiving unit 44 of the supporter terminal 4 by short-range wireless communication.

  When the supporter registration unit 41 of the supporter terminal 4 receives the user terminal identifier from the relationship information receiving unit 44, the supporter registration unit 41 transmits the relationship information including the user terminal identifier and the supporter terminal identifier that is the identifier of the supporter terminal 4 to the server 1. To do. Here, the case where the name of the supporter is also included in the related information will be described. When the support beneficiary brings the support beneficiary terminal 3 close to the supporter terminal 4, the supporter inputs his name into the supporter terminal 4. The supporter registration unit 41 of the supporter terminal 4 transmits relation information including the user terminal identifier, the supporter name, and the supporter terminal identifier to the server 1 via the communication network 9.

  When the related information registration unit 11 of the server 1 receives the related information from the supporter terminal 4, the related information registration unit 11 identifies the related information stored in the table with the user terminal identifier included in the received related information, and supports the identified related information. Register and update the terminal identifier. Thereby, the server 1 learns the relationship between the supporter and the support beneficiary.

  The support recipient can manage the related information of himself / herself and the support organization and the supporter by the server 1 by performing the above operation. The support beneficiary can directly register a plurality of supporters in the server 1 by meeting with a plurality of supporters whom he can trust and performing the above operation. By registering a plurality of supporters in the server 1 in advance, the support recipient is more likely to find a person who supports someone when support is needed.

  The support beneficiary can use the short-distance data exchanging means to bring the support beneficiary terminal 3 close to the support group terminal 2 or the support terminal 4 and to obtain information related to him / her and the support group and the supporter 1 Can be registered. Therefore, it is considered that the operation is sufficiently possible regardless of the degree of IT literacy that the support recipient has.

  Next, a description will be given of an operation procedure until a support recipient finds a supporter and has the supporter start support from a remote place when he / she wants to receive phonetic support immediately.

  First, the operation of the support request unit 12 of the server 1 when the support recipient requests support from the supporter will be described.

  When the support beneficiary inputs a request to the support beneficiary terminal 3 to the support beneficiary terminal 3, the support beneficiary terminal 3 displays a plurality of pre-registered supporters on a display unit (not shown) in a selectable manner. A support recipient selects a person or a supporter type that he / she wants to support from among a plurality of supporters displayed on the display unit. As the supporter type, for example, “family” and “friend” can be considered. As a method of selection, there is a method in which a support recipient operates and operates an operation unit (not shown) so as to press a button displayed beside the name of the supporter or the supporter type. Here, it is assumed that the supporter type is selected. Subsequently, when the support beneficiary terminal 3 displays a support request button for confirming the support request on the display unit, the support beneficiary performs an operation of pressing the support request button via the operation unit. When the support request button is pressed, the support request transmission unit 31 of the support beneficiary terminal 3 transmits a support request signal including the selected supporter type and user terminal identifier to the server 1 via the communication network 9.

  When receiving the support request signal from the support beneficiary terminal 3, the support request unit 12 of the server 1 refers to the related information stored in the table with the user terminal identifier included in the received support request signal. Then, the support request unit 12 specifies a plurality of supporters that match the supporter type included in the support request signal by referring to the related information, and the support request signal is provided only to the terminals of the specified supporters. Forward.

  A support recipient can realize a support request by two simple operations of selecting a supporter type and pressing a support request button. Therefore, it is considered that the operation is sufficiently possible regardless of the degree of IT literacy that the support recipient has. If the registered supporters are not classified into a plurality of types, the support recipient needs only to press the support request button.

  Next, the operation of the remote support unit 13 of the server 1 when the support recipient receives support from the supporter will be described.

  When receiving a support request signal from the server 1, the support request receiving unit 42 of the supporter terminal 4 displays whether or not support is possible on a display unit (not shown). In response to the inquiry about whether support is possible or not displayed on the display unit, the supporter inputs that support is possible via the operation unit (not shown), and the support request reception unit 42 notifies support support Is transmitted to the server 1 via the communication network 9.

  When the support request unit 12 of the server 1 receives the support available notification from the supporter terminal 4, the terminal identifier of the supporter terminal 4, the user terminal identifier of the source of the support request signal, and information that the supporter has been found Is notified to the remote support unit 13. The remote support unit 13 connects the remote support receiving unit 32 of the support receiver terminal 3 specified by the user terminal identifier and the remote support unit 43 of the supporter terminal 4 specified by the support terminal identifier via the communication network 9. To connect.

  When the support beneficiary terminal 3 and the support beneficiary terminal 4 are connected via the communication network 9, the support beneficiary terminal 3 collects the surrounding sound with a microphone (not shown), and the collected sound data is transmitted to the communication network. 9 to the supporter terminal 4 at a remote location. The supporter listens to the sound output from the speaker (not shown) of the supporter terminal 4, converts the content into text, and inputs it to the supporter terminal 4. The remote support unit 43 of the supporter terminal 4 transmits the characterized information to the support beneficiary terminal 3 as a result of the voice conversion. When receiving the characterized information from the supporter terminal 4, the remote support receiving unit 32 of the support beneficiary terminal 3 displays the information on a display unit (not shown).

  The support beneficiary only needs to look at the display unit because the result of the phonetic transcription is displayed on the display unit of the support beneficiary terminal 3. Therefore, it does not depend on the degree of IT literacy possessed by the support beneficiary, and no special operation is required, and it can be used sufficiently.

  Further, even if the supporter of the supporter terminal 4 that has received the support request signal is not in a supportable state or does not notice that the support request has been received, the support request signal is distributed to a plurality of supporter terminals. Therefore, there is a high possibility that at least one supporter can support the situation.

  In addition, although this embodiment demonstrated the case where the audio | voice of the periphery of the support beneficiary terminal 3 was transmitted to the supporter terminal 4, not only the audio | voice but the image | video which image | photographed the periphery of the support beneficiary is also shown to the supporter terminal 4. You may make it transmit from the support beneficiary terminal 3. FIG. In this case, the supporter can easily understand the situation of the support recipient by not only listening to the voice but also watching the video, and can provide more complete support.

  Moreover, although this embodiment demonstrated the case where the one supporter terminal 4 was connected so that communication with the support beneficiary terminal 3 was carried out, several supporter terminals 4 were connected so that communication with the support beneficiary terminal 3 was possible. May be. In this case, in this case, the voice distributed from the support beneficiary terminal 3 to each supporter terminal 4 can be divided and transcribed by a plurality of supporters, which only reduces the burden on one supporter. Rather, it can provide more substantial support.

  Further, in this embodiment, the case where there are a plurality of support organizations has been described. However, when there is only one support organization, or when the support organization itself operates and manages the server 1, the server 1 provides support. There is no need to generate a group identifier. As an example when the support organization operates the server 1, a plurality of support organization terminals provided corresponding to a plurality of service reception windows, and the server 1 connected to the plurality of support organization terminals via the communication network 9, A system with Further, in this case, the support group may lend the supporter terminal 4 to the supporter who performs the summary writing.

  Examples of the present embodiment will be described.

  Based on actual cases, information related to support groups, support recipients, and supporters is registered in the server 1, and the support recipients send support requests from their mobile terminals to the server 1, and supporters in remote locations. Explain the case of receiving support from.

  First, a procedure for registering related information of a support group, a support beneficiary, and a supporter in the server 1 will be described. Among them, a method for registering support groups will be described with reference to FIGS. FIG. 3 is a flowchart showing a procedure for registering a support organization in the server. FIG. 4 is a diagram illustrating an example of a data structure image when a support organization is registered in the related information registration unit.

  When the administrator of the support group inputs a support group name to the support group registration unit 21 of the support group terminal 2 (step A1), the support group registration unit 21 transmits data to the related information registration unit 11 of the server 1 (step A1). A2). The data sent at this time is only the support organization name.

  When the related information registration unit 11 receives the information of the support organization name from the support organization terminal 2, the related information registration unit 11 creates a support organization identifier for identifying the support organization (step A3).

  Subsequently, the related information registration unit 11 stores and manages the received support group name and the created support group identifier information in the related information storage unit 14 (step A4). An example of a table stored in the related information storage unit 14 after support organization registration is shown in FIG.

  Subsequently, the related information registration unit 11 transmits a support group identifier to the support group registration unit 21 of the support group terminal 2 (step A5). The support organization registration unit 21 stores the support organization identifier received from the server 1 in the support organization terminal 2 (step A6).

  Next, a procedure for registering the related information between the support recipient and the support organization, which is the first relationship, in the server 1 will be described with reference to FIGS. 2, 5, and 6. FIG. 5 is a flowchart showing a procedure for registering related information between a support recipient and a support organization in a server. FIG. 6 is a diagram illustrating an example of a data structure image when the related information between the support recipient and the support group is registered in the related information registration unit.

  When the support beneficiary brings the support beneficiary terminal 3 close to the support group terminal 2, the support beneficiary terminal 3 transmits the terminal identifier of the support beneficiary terminal 3 to the support group terminal 2 by short-range wireless communication (step B1). The data transmitted / received here is transmitted / received by the relationship information receiving unit 23 of the support group terminal 2 and the relationship information transmitting unit 33 of the support beneficiary terminal 3.

  Subsequently, when the administrator of the support group inputs the name of the support beneficiary in the support beneficiary registration unit 22 of the support group terminal 2 (step B2), the support beneficiary registration unit 22 adds the name of the support beneficiary and the support. The terminal identifier of the beneficiary terminal 3 is transmitted to the related information registration unit 11 of the server 1 (step B3).

  Subsequently, the related information registration unit 11 stores the information received from the support organization terminal 2 in the related information storage unit 14 (step B4). An example of the table stored in the related information storage unit 14 at this time is shown in FIG.

  Subsequently, when the storage in the related information storage unit 14 is completed, the related information registration unit 11 notifies the support beneficiary registration unit 22 of the support group terminal 2 that registration has been completed (step B5). When the support group terminal 2 receives the notification from the server 1, the support group terminal 2 displays that the registration is completed on the screen of a display unit (not shown) (step B6).

  Next, a procedure for registering the relationship information between the support recipient and the supporter, which is the second relationship, in the server 1 will be described with reference to FIG. 2, FIG. 7, and FIG. FIG. 7 is a flowchart showing a procedure for registering related information between the supporter and the support beneficiary in the server. FIG. 8 is a diagram illustrating an example of a data structure image when the related information between the supporter and the support recipient is registered in the related information registration unit. FIG. 9 is a diagram illustrating an example of a data structure image when a support recipient and a supporter are associated with each other and stored in the related information storage unit.

  When the support beneficiary brings the support beneficiary terminal 3 close to the supporter terminal 4, the support beneficiary terminal 3 transmits the terminal identifier of the support beneficiary terminal 3 to the supporter terminal 4 by short-range wireless communication (step C1). The data transmitted / received here is transmitted / received by the relationship information receiving unit 44 of the supporter terminal 4 and the relationship information transmitting unit 33 of the support beneficiary terminal 3.

  Subsequently, when the supporter inputs the relationship between the name of the supporter and the support beneficiary into the supporter registration unit 41 of the supporter terminal 4 (step C2), the supporter registration unit 41 selects the name of the supporter and the support. The relationship with the beneficiary, the user terminal identifier, and the supporter terminal identifier are transmitted to the related information registration unit 11 of the server 1 (step C3).

  Subsequently, the related information registration unit 11 stores the information received from the supporter terminal 4 in the related information storage unit 14 (step C4). An example of the table stored in the related information storage unit 14 at this time is shown in FIG.

  Subsequently, when the storage in the related information storage unit 14 is completed, the related information registration unit 11 notifies the supporter registration unit 41 of the supporter terminal 4 that the registration is completed (step C5). When the supporter terminal 4 receives the notification from the server 1, the supporter terminal 4 displays that the registration is completed on the screen of a display unit (not shown) (step C6).

  As described above, the relationship between the support organization and the support beneficiary and the relationship between the support beneficiary and the supporter are registered in the server. FIG. 9 shows an example of a data structure in which support recipients and supporters are registered in the table of the related information storage unit 14 corresponding to a plurality of support organizations. In the example shown in FIG. 9, a list for each support organization is registered in one table.

  Next, a procedure when a support recipient makes a support request will be described with reference to FIGS. 10 and 11. FIG. 10 is a flowchart showing the procedure of the support request. FIG. 11 is a diagram illustrating an example of a support request operation screen displayed on the support beneficiary terminal.

  When the support beneficiary wants to request support, he / she operates the support beneficiary terminal 3, selects a supporter type, and presses a button for transmitting a support request (step D1). At this time, the information transmitted from the support beneficiary terminal 3 to the server 1 is information on the user terminal identifier and the selected supporter type. An example of the operation screen of the support beneficiary terminal 3 is shown in FIG.

  Subsequently, when the support beneficiary operates the support beneficiary terminal 3 and presses a button for transmitting a support request, the support request transmitting unit 31 transmits a support request signal to the support request unit 12 of the server 1. When receiving the support request signal from the support beneficiary terminal 3, the support request unit 12 uses the user terminal identifier and the support type included in the support request signal as search conditions and requests a support from a list registered in the related information storage unit 14. The supporter terminal 4 to which the signal is to be transferred is searched (step D2).

  Subsequently, when the support request unit 12 specifies the supporter terminal 4 to which the support request signal is to be transferred as a result of the search, the support request unit 12 transfers the support request signal to the support request receiving unit 42 of the specified supporter terminal 4 (step D3). ). The support request receiving unit 42 receives a support request signal from the server 1 (step D4).

  For example, it is assumed that the related information storage unit 14 stores the list illustrated in FIG. 9, and the support beneficiary operates the support beneficiary terminal 3 and selects “family” as the supporter. In this case, the support request transmission unit 31 transmits a support request signal including information on the user terminal identifier “t11” and the supporter type “family” to the support request unit 12. When receiving the support request signal from the support beneficiary terminal, the support request unit 12 refers to the list stored in the related information storage unit 14. In the list, the support request unit 12 includes “family” as the support request destination among the supporters “Mr. C”, “Mr. D”, and “Mr. K” with the related identifier “t11”. “Mr. C” and “Mr. K” are identified. Then, the support request unit 12 transfers a support request signal to the supporter terminals 4 of “Mr. C” and “Mr. K”.

  Next, a procedure until a supporter responds to a support request and provides support from a remote location will be described with reference to FIG. FIG. 12 is a flowchart showing a procedure from when a supporter terminal receives a support request until the supporter performs support.

  When the supporter of the supporter terminal 4 that has received the support request signal can support, the screen of the display unit (not shown) of the supporter terminal 4 is viewed and input to the supporter terminal 4 that support is possible ( Step E1). In response to an input from the supporter, the support request receiving unit 42 transmits a support enable notification to the support requesting unit 12 of the server 1 (step E2).

  Subsequently, when receiving the support enable notification from the supporter terminal 4, the support request unit 12 of the server 1 notifies the remote support unit 13 that the support enable notification has been received (step E3). At this time, the support request unit 12 passes the terminal identifier of the support beneficiary terminal 3 that has sent the support request signal and the terminal identifier of the supporter terminal 4 that has sent the support available notification to the remote support unit 13.

  Subsequently, the remote support unit 13 connects the two terminals specified by the terminal identifier received from the support request unit 12 so that they can communicate with each other via the communication network 9 (step E4). When the support beneficiary terminal 3 and the supporter terminal 4 are communicably connected, the remote support receiving unit 32 of the support beneficiary terminal 3 collects voice around the terminal, and the collected voice data is communicated with the own terminal and the communication network. 9 to the supporter terminal 4 connected via the terminal 9 (step E5). When the supporter terminal 4 receives the sound data from the support beneficiary terminal 3, the supporter terminal 4 reproduces the sound of the received sound data with a speaker (not shown) (step E6).

  Next, remote assistance will be described.

  The supporter converts the sound reproduced on the supporter terminal 4 into text and inputs it to the supporter terminal 4. The character information input to the supporter terminal 4 is transmitted to the remote support receiving unit 32 of the support beneficiary terminal 3 via the remote support unit 43 of the supporter terminal 4, and is displayed on the display unit (not shown) of the support beneficiary terminal 3. Is displayed on the screen.

  In the procedure described with reference to FIG. 10, when the support beneficiary performs an operation of pressing the support request button without selecting a type, the server 1 that has received the support request notification corresponds to the support beneficiary. Then, a support request signal is transferred to a plurality of supporter terminals registered in the list.

  Further, when the support beneficiary selects one supporter and presses the support request button without selecting a type, the server 1 sends a support request signal to the supporter terminal 4 of the specified supporter. Send. In this case, if the server 1 cannot receive the support available notification from the supporter terminal 4 of the designated supporter, the server 1 may transmit the support available notification to another supporter terminal. For example, the server 1 selects a supporter terminal in a predetermined order from the supporter terminals registered in the list, and transmits a supportable notification to the selected supporter terminal until the supportable notification can be received. Further, the server 1 may prompt the support beneficiary to designate the supporter again in order to have the support beneficiary select the next support candidate.

  According to the present embodiment, as described above, the support recipient can easily receive support without depending on the degree of IT literacy possessed by the user. The reason is that the support recipient can easily register the support enjoyment relationship indicating which supporter is associated with the system by using the short-distance data exchanging means of his portable terminal. In addition, if the support recipient operates to push the support request button displayed on the display unit of the mobile terminal at the time of the support request, the server automatically connects his mobile terminal and the support terminal. You can get support with simple operation.

  In addition, support recipients can receive support only from supporters who have actually met. The reason is that the support beneficiary uses the short-distance data exchange means of the mobile terminal to register only the support enjoyment relationship with the supporter who has actually met in the system, and the registered support at the time of the support request This is because only the support person is notified of the support request, and the support person who receives the notification supports. As a result, the support recipient can be prevented from receiving support from an unacquainted person or an unreliable person.

  A support recipient can receive support in real time when assistance is required, even if the supporter is in a remote place, with a reliable person as a supporter, without performing complicated operations on the terminal.

  Further, in the method disclosed in Non-Patent Document 1, since the company secures a supporter for a certain period of time, even if there is a period of time during which support is not provided, it is possible to respond according to the time period. The compensation must be paid to the supporter. On the other hand, when the company operates the system according to the present embodiment, the consideration may be paid to the supporter according to the time for the support. This is not a method of securing a supporter for a certain period of time in the company, but because the supporter provides support from a remote location when assistance is required, the company does not need to secure a supporter for a certain period of time. is there.

  Note that a program for causing a computer to execute the phonetic transcription support method described in the present embodiment may be stored in a computer-readable recording medium. In this case, by installing the program from the recording medium into another information processing apparatus, it is possible to cause the other information processing apparatus to execute the above information processing method.

  An example of the effect of the present invention will be described. According to the present invention, a support recipient can receive support in real time when assistance is required even if the supporter is in a remote place, with a reliable person as a supporter, without performing complicated operations on the terminal. Can do.

  While the present invention has been described with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

  The present invention is not limited to summary writing, and can be applied to an interpreting system that converts a foreigner's voice to a supporter at a remote place and converts it into a character when talking with a foreigner.

  This application incorporates all the contents of Japanese Patent Application No. 2015-023843 filed on February 10, 2015, and claims priority based on this Japanese application.

DESCRIPTION OF SYMBOLS 1 Phonetic transcription support server 2 Support group terminal 3 Support beneficiary terminal 4 Supporter terminal 9 Communication network 31 Support request transmission part 32 Remote support enjoyment part 33 Relation information transmission part

Claims (4)

When a user terminal identifier, which is an identifier of the user terminal, is acquired by communication with a user terminal used by a user who wants to receive support for converting voice information into text information, the user terminal identifier is included and the user is included in the support organization A support organization terminal that transmits first relation information indicating that the user belongs to a network;
When the user terminal identifier is acquired from the user terminal by communication with the user terminal, the user terminal and the own terminal include a supporter terminal identifier that is an identifier of the own terminal, and the user terminal and the own terminal have a support receiving relationship A supporter terminal used by a supporter who performs the support, and transmits second relation information indicating
When the first and second related information is received from the support group terminal and the supporter terminal via the network, the information is associated with each support group based on the first and second relationship information . A server that creates and stores a list in which the supporter terminal identifier corresponding to the user terminal identifier is registered, and
When the server receives a support request signal including the user terminal identifier from the user terminal via the network, the server receives the support request signal from the support terminal registered in the list for each support group. A plurality of supporter terminals associated with the support organization in which the user terminal identifier included is registered, the support request signal is transferred to the specified supporter terminals, and a reply indicating that support is possible When the supportable notification is received, the supporter terminal that is the transmission source of the supportable notification is connected to the user terminal via the network so that communication is possible.
When the supporter terminal is connected to the user terminal so as to be communicable and receives voice data from the user terminal, the supporter terminal outputs a voice based on the voice data, and a character is input to the output voice. A voice characterizing support system that transmits information on input characters to the user terminal for display on the user terminal. A supporter who is an identifier of a supporter terminal used by a supporter who performs the support corresponding to a user terminal identifier that is an identifier of a user terminal used by a user who wants to receive support for converting information by speech into information by character A storage unit for storing a list in which terminal identifiers are registered;
The first relation information including the user terminal identifier and indicating that the user belongs to a support organization is received from the support organization terminal via the network, and is the user terminal identifier and the identifier of the own terminal. When receiving second relationship information including a supporter terminal identifier and indicating that the user terminal and the supporter terminal have a support enjoyment relationship from the supporter terminal via the network, the first and second A control unit that creates the list in which the supporter terminal identifier corresponding to the user terminal identifier associated with each support organization is registered based on the relationship information and stores the list in the storage unit;
Have
When the control unit receives a support request signal including the user terminal identifier from the user terminal via the network , the support request signal is selected from the support terminal registered in the list for each support group. Identifies a plurality of supporter terminals associated with a support organization in which the user terminal identifier included in is registered , transfers the support request signal to the specified supporter terminals, and indicates that support is possible A server that, upon receiving a supportable notification that is a reply, connects a supporter terminal that is a transmission source of the supportable notification to be communicable with the user terminal via the network. A phonetic transcription support method by a support organization terminal, a supporter terminal and a server connected via a network,
When the support group terminal acquires a user terminal identifier, which is an identifier of the user terminal, by communication with a user terminal used by a user who wants to receive support for converting voice information into text information, the user terminal identifier is included. , Transmitting first relation information indicating that the user belongs to a support organization to the server via the network;
When the supporter terminal obtains the user terminal identifier through communication with the user terminal, the user terminal and the own terminal include a supporter terminal identifier that is an identifier of the user terminal identifier and the own terminal. Sending second relation information indicating the existence to the server via the network;
When the server receives the first and second relationship information from the support organization terminal and the supporter terminal via the network, for each support organization, based on the first and second relationship information and create and store a list of registering the assistance terminal identifier corresponding to the association was the user terminal identifier,
When the server receives a support request signal including the user terminal identifier from the user terminal via the network , the support request signal is selected from the support terminal registered in the list for each support group. Identifying a plurality of supporter terminals associated with a support organization in which the user terminal identifier included is registered , transferring the support request signal to the plurality of specified supporter terminals,
When the server receives a supportable notification that is a reply indicating that support is possible, the supporter terminal that is the transmission source of the supportable notification is connected to the user terminal via the network,
After the supporter terminal is connected to be communicable with the user terminal, when voice data is received from the user terminal, voice based on the voice data is output, and characters are input to the output voice. A voice characterizing support method for transmitting information on inputted characters to the user terminal for display on the user terminal. On the computer,
First relation information including a user terminal identifier, which is an identifier of a user terminal used by a user who wants to receive support for converting voice information into character information, and indicating that the user belongs to a support organization To receive from the support organization terminal via
Support that the supporter using the support uses the second relationship information including the user terminal identifier and the supporter terminal identifier that is the identifier of the terminal, and indicating that the user terminal and the terminal have a support receiving relationship Receiving from the user terminal via the network;
Creating and storing a list in which the supporter terminal identifier corresponding to the user terminal identifier associated with each support organization is registered based on the received first and second relationship information; and
When a support request signal including the user terminal identifier is received from the user terminal via the network, the user terminal included in the support request signal from among the supporter terminals registered in the list for each support organization A procedure for identifying a plurality of support terminals associated with support organizations with registered identifiers;
When the support request signal is transmitted to the identified plurality of supporter terminals and a supportable notification that is a reply indicating that support is possible is received, the supporter terminal that has transmitted the supportable notification is sent via the network. A program for executing a procedure for connecting to the user terminal in a communicable manner.

Images