WO2016114193A1 - Note-taking assistance system, terminal device, note-taking assistance method, and computer-readable recording medium - Google Patents

Note-taking assistance system, terminal device, note-taking assistance method, and computer-readable recording medium Download PDF

Info

Publication number
WO2016114193A1
WO2016114193A1 PCT/JP2016/050228 JP2016050228W WO2016114193A1 WO 2016114193 A1 WO2016114193 A1 WO 2016114193A1 JP 2016050228 W JP2016050228 W JP 2016050228W WO 2016114193 A1 WO2016114193 A1 WO 2016114193A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
terminal device
audio data
quality
reproduction
Prior art date
Application number
PCT/JP2016/050228
Other languages
French (fr)
Japanese (ja)
Inventor
久 坂本
Original Assignee
Ｎｅｃソリューションイノベータ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ｎｅｃソリューションイノベータ株式会社 filed Critical Ｎｅｃソリューションイノベータ株式会社
Priority to JP2016569319A priority Critical patent/JPWO2016114193A1/en
Publication of WO2016114193A1 publication Critical patent/WO2016114193A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G10L25/60—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for measuring the quality of voice signals

Definitions

  • the present invention relates to a summary writing support system for supporting a speaker's summary writing, a terminal device used therefor, a summary writing support method, and a computer-readable recording medium on which a program for realizing these is recorded.
  • Hearing impaired persons with hearing loss in both ears of minus 100 decibels (hereinafter simply referred to as “Hearing impaired persons”) can hardly receive language information in speech even with a hearing aid. For this reason, there have been cases where a hearing impaired person listens to lectures and classes at school, attaches a sign language interpreter, and attaches a writer who performs summary writing.
  • the systems disclosed in Patent Documents 1 and 2 distribute the voice and video of a speaker to a writer's terminal device at a remote location via a network such as the Internet by an information distribution device. Further, in this system, when the writer performs summary writing and creates text data, the text data is displayed on a screen of a display device installed in a classroom or the like via the Internet. According to the systems disclosed in Patent Documents 1 and 2, it can be considered that the system can contribute to solving the problem of lack of writer.
  • An example of an object of the present invention is to provide a summary writing support system and a terminal device that can solve the above-described problems and enable the side receiving the provision of summary writing to confirm the voice quality and the state of voice output on the summary writing side.
  • Another object is to provide a summary writing support method and a computer-readable recording medium.
  • a summary writing support system is a system for supporting summary writing performed by a writer, A terminal device used by the writer, and an information distribution device that transmits voice data to the terminal device,
  • the terminal device An audio reproduction unit for reproducing audio data transmitted from the information distribution device as audio;
  • a quality detector for detecting the quality of the audio data;
  • a playback status detector that detects the status of audio playback on the terminal device;
  • An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device; It is characterized by that.
  • a terminal device is a terminal device used by a writer who performs summary writing, An audio reproduction unit that reproduces audio data transmitted from an information distribution device that transmits audio data to the terminal device as audio; A quality detector for detecting the quality of the audio data; A playback status detector that detects the status of audio playback on the terminal device; An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device; It is characterized by that.
  • a summary writing support method is a method for supporting summary writing performed by a writer, (A) in the terminal device used by the writer, reproducing the voice data transmitted from the information distribution device that transmits the voice data as voice; (B) detecting the quality of the audio data in the terminal device; (C) in the terminal device, detecting the state of audio reproduction there; (D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device; When, It is characterized by having.
  • a computer-readable recording medium is a computer-readable recording medium storing a program for supporting summary writing performed by a writer by a computer used by the writer.
  • a possible recording medium In the computer, (A) reproducing the audio data transmitted from the information distribution apparatus that transmits the audio data as audio; and (B) detecting the quality of the audio data; (C) detecting a state of sound reproduction in the terminal device; and (D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device; When, A program including an instruction for executing is recorded.
  • FIG. 1 is a diagram showing a schematic configuration of a summary writing support system and a terminal device according to an embodiment of the present invention.
  • FIG. 2 is a block diagram showing a specific configuration of the summary writing support system and the terminal device according to the embodiment of the present invention.
  • FIG. 3 is a flowchart showing the operation of the terminal device constituting the abstract writing support system of the present invention.
  • FIG. 4 is a flowchart showing the operation of the information distribution apparatus constituting the summary writing support system of the present invention.
  • FIG. 5 is a block diagram illustrating an example of a computer that implements the information distribution device or the terminal device according to the embodiment of the present invention.
  • FIG. 1 is a diagram showing a schematic configuration of a summary writing support system and a terminal device according to an embodiment of the present invention.
  • a summary writing support system 100 in the present embodiment shown in FIG. 1 is a system for supporting summary writing performed by a writer 50.
  • the abstract writing support system 100 includes an information distribution device 10 and a terminal device 20 used by the writer 50.
  • two terminal devices 20 are used because summary writing is performed by two writers.
  • the information distribution device 10 is a device for transmitting voice data to the terminal device 20, and is connected to the terminal device 20 via the network 60.
  • the information distribution apparatus 10 is connected to a sound collection apparatus 11 for collecting voice and an information display apparatus 12 for presenting a summary writing result to the user 40.
  • a specific example of the sound collecting device 11 is a microphone.
  • a specific example of the information display device 12 is a display device such as a liquid crystal display.
  • the terminal device 20 includes an audio reproduction unit 21, a quality detection unit 22, a reproduction status inspection unit 23, and an information transmission unit 24.
  • the audio reproduction unit 21 reproduces the audio data transmitted from the information distribution device 10 as audio.
  • the quality detection part 22 detects the quality of audio
  • the playback status detection unit 23 detects the status of audio playback on the terminal device 20.
  • the information transmission unit 24 transmits to the information distribution apparatus 10 audio output information that specifies the quality of the detected audio data and the state of audio reproduction.
  • the information distribution apparatus 10 can receive the audio output information from the terminal apparatus 20 used by the writer 50, so that the audio quality and the audio reproduction status can be presented to the user 40. it can. Therefore, according to the summary writing support system 100, it is possible to check the quality of speech and the state of speech output on the summary writing side on the side receiving the provision of summary writing.
  • FIG. 2 is a block diagram showing a specific configuration of the summary writing support system and the terminal device according to the embodiment of the present invention.
  • illustration of the configuration of the network and one terminal device is omitted for the sake of explanation.
  • the information distribution apparatus 10 includes an audio data acquisition unit 13, a data transmission unit 14, a data reception unit 15, and a data display unit 16.
  • the audio data acquisition unit 13 acquires the audio data digitally processed by the sound collection device 11, further compresses the acquired audio data, and inputs the compressed audio data to the data transmission unit 14.
  • the data transmission unit 14 converts the input voice data into a transmittable format, and transmits the converted voice data to the terminal device 20 via the network 60 (not shown in FIG. 2). Specifically, the data transmission unit 14 generates packet data for transmission from the voice data.
  • the data receiving unit 15 receives audio output information transmitted from the terminal device 20 via the network 60.
  • the data receiving unit 15 since the terminal device 20 also transmits text data as a result of summary writing to the information distribution device 10, the data receiving unit 15 also receives this text data. Then, the data receiving unit 15 inputs the voice output information and the text data to the data display unit 16.
  • the data display unit 16 uses the input voice output information and text data to generate image data for a screen for displaying them, and inputs the generated image data to the information display device 12. Thereby, the information display device 12 displays the voice output information and the text data on the screen.
  • the terminal device 20 includes an audio data reception unit 25 in addition to the audio reproduction unit 21, the quality detection unit 22, the reproduction status inspection unit 23, and the information transmission unit 24. And a text data acquisition unit 26.
  • the terminal device 20 is connected to a speaker 27 and an input device 28 such as a keyboard.
  • the text data acquisition unit 26 receives the text data input from the input device 28 by the writer 50 and inputs the received text data to the information transmission unit 24.
  • the audio data receiving unit 25 receives the audio data transmitted from the data transmitting unit 14 of the information distribution apparatus 10 and restores the format. Specifically, the voice data receiving unit 25 receives packet data of voice data, connects them, and restores the original voice data. Then, the audio data receiving unit 25 inputs the audio data after format conversion to the audio reproducing unit 21.
  • the audio reproducing unit 21 since the audio data input from the audio data receiving unit 25 is a digital signal, the audio reproducing unit 21 converts the input audio data into an analog signal. Then, the sound reproducing unit 21 outputs the converted analog signal to the speaker 27. Thereby, the writer 50 can hear the audio
  • the quality detection unit 22 acquires audio data from the audio data reception unit 25, and continuously detects the level of the acquired audio data as the quality of the audio data. Further, the quality detection unit 22 inputs data (hereinafter referred to as “level detection data”) specifying the level of the detected audio data to the information transmission unit 24.
  • level detection data data specifying the level of the detected audio data
  • the playback status detection unit 23 is connected to the audio playback unit 21. As the status of audio playback, the presence / absence of electrical connection between the audio playback unit 21 and the speaker 27, and the terminal device The presence / absence of mute setting at 20 is detected. Further, the reproduction status detection unit 23 inputs data specifying the detection result (hereinafter referred to as “reproduction status detection data”) to the information transmission unit 24.
  • the information transmission unit 24 transmits the input data to the information distribution apparatus 10 when at least one of the level detection data, the reproduction state detection data, and the text data is input.
  • the level detection data and the reproduction status detection data correspond to the audio output information described above.
  • the information transmission unit 24 periodically receives the level detection data, the reproduction status detection data, and the text data without being affected by the transmission timing of the audio data from the information distribution device 10. Transmit to the distribution device 10. For this reason, for example, in a situation where no sound is being emitted, detection data indicating that the level is low, reproduction status detection data indicating that electrical connection is present and mute is not set, and blank text data are transmitted. Will come. Therefore, even if the user 40 is a person with hearing disabilities, the user 40 can know that such a situation is not generated.
  • FIGS. 1 and 2 are referred to as appropriate.
  • the summary writing support method is implemented by operating the summary writing support system 100. Therefore, the description of the summary writing support method in the present embodiment is replaced with the following description of the operation of the summary writing support system 100.
  • FIG. 3 is a flowchart showing the operation of the terminal device constituting the abstract writing support system of the present invention.
  • the audio data reception unit 25 receives the audio data and the audio reproduction unit 21 reproduces the audio data in parallel with the processing shown in FIG.
  • the quality detection unit 22 acquires audio data from the audio data reception unit 25, and detects the level of the acquired audio data as the quality of the audio data (step A1).
  • the quality detection unit 22 inputs level detection data for specifying the level of the detected audio data to the information transmission unit 24.
  • the reproduction status detection unit 23 detects the presence / absence of an electrical connection between the audio reproduction unit 21 and the speaker 27 (step A2). Furthermore, the reproduction status detection unit 23 also detects the presence / absence of mute setting in the terminal device 20 (step A3). Further, the playback status detection unit 23 inputs playback status detection data for specifying the detection results obtained in steps A2 and A3 to the information transmission unit 24.
  • the text data acquisition unit 26 receives the text data input by the writer 50 from the input device 28, and inputs the received text data to the information transmission unit 24 (step A4).
  • the information transmission unit 24 transmits the input data to the information distribution apparatus 10 (step A5).
  • Steps A1 to A5 are repeatedly executed, and the level detection data, reproduction status detection data, and text data are periodically transmitted to the information distribution apparatus 10. Further, the execution order of steps A1 to A4 is not limited, and the steps may be executed in parallel.
  • FIG. 4 is a flowchart showing the operation of the information distribution apparatus constituting the summary writing support system of the present invention.
  • the information distribution apparatus 10 it is assumed that acquisition of audio data by the audio data acquisition unit 13 and transmission of audio data by the data transmission unit 14 are executed in parallel with the processing illustrated in FIG. 4.
  • the data receiving unit 15 receives level detection data, reproduction status detection data, and text data transmitted from the terminal device 20 via the network 60 (step B1). In addition, the data receiving unit 15 inputs the received data to the data display unit 16.
  • the data display unit 16 uses the level detection data, the reproduction status detection data, and the text data input from the data reception unit 15 to generate image data for a screen for displaying them, and the generated image Data is input to the information display device 12 (step B2). Specifically, the data display unit 16 generates image data so that the time-series change in the level of the audio data, the presence / absence of electrical connection, the presence / absence of the mute setting, and the text input by the writer 50 are displayed. To do.
  • the data display unit 16 inputs image data to the information display device 12, and displays an image specified by the image data on the screen of the information display device 12 (step B3). Steps B1 to B3 are repeatedly executed every time data is transmitted from the terminal device 20.
  • level detection data, reproduction status detection data, and text data are transmitted from the terminal device 20 to the information distribution device 10. Therefore, according to this Embodiment, the user 40 can also confirm the audio
  • the first program in the present embodiment may be a program that causes a computer to execute steps A1 to A5 shown in FIG. By installing and executing this program on a computer, the terminal device 20 in the present embodiment can be realized.
  • a CPU Central Processing Unit
  • a CPU Central Processing Unit of the computer functions as an audio reproduction unit 21, a quality detection unit 22, a reproduction status detection unit 23, an information transmission unit 24, an audio data reception unit 25, and a text data acquisition unit 26, and performs processing.
  • the second program in the present embodiment may be a program that causes a computer to execute steps B1 to B3 shown in FIG.
  • a CPU Central Processing Unit
  • a CPU Central Processing Unit of the computer functions as a data acquisition unit 13, a data transmission unit 14, a data reception unit 15, and a data display unit 16 to perform processing.
  • FIG. 5 is a block diagram illustrating an example of a computer that implements the information distribution device or the terminal device according to the embodiment of the present invention.
  • the computer 110 includes a CPU 111, a main memory 112, a storage device 113, an input interface 114, a display controller 115, a data reader / writer 116, and a communication interface 117. These units are connected to each other via a bus 121 so that data communication is possible.
  • the CPU 111 performs various operations by developing the first or second program (code) in the present embodiment stored in the storage device 113 in the main memory 112 and executing them in a predetermined order.
  • the main memory 112 is typically a volatile storage device such as a DRAM (Dynamic Random Access Memory).
  • the program in the present embodiment is provided in a state of being stored in a computer-readable recording medium 120. Note that the program in the present embodiment may be distributed on the Internet connected via the communication interface 117.
  • the storage device 113 includes a hard disk drive and a semiconductor storage device such as a flash memory.
  • the input interface 114 mediates data transmission between the CPU 111 and an input device 118 such as a keyboard and a mouse.
  • the display controller 115 is connected to the display device 119 and controls display on the display device 119.
  • the data reader / writer 116 mediates data transmission between the CPU 111 and the recording medium 120, and reads a program from the recording medium 120 and writes a processing result in the computer 110 to the recording medium 120.
  • the communication interface 117 mediates data transmission between the CPU 111 and another computer.
  • the recording medium 120 include general-purpose semiconductor storage devices such as CF (Compact Flash (registered trademark)) and SD (Secure Digital), magnetic storage media such as a flexible disk, or CD- Optical storage media such as ROM (Compact Disk Read Only Memory) are listed.
  • CF Compact Flash
  • SD Secure Digital
  • magnetic storage media such as a flexible disk
  • CD- Optical storage media such as ROM (Compact Disk Read Only Memory) are listed.
  • Appendix 1 A system for supporting summary writing performed by a writer, A terminal device used by the writer, and an information distribution device that transmits voice data to the terminal device, The terminal device An audio reproduction unit for reproducing audio data transmitted from the information distribution device as audio; A quality detector for detecting the quality of the audio data; A playback status detector that detects the status of audio playback on the terminal device; An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device; This is a summary writing support system.
  • the quality detection unit continuously detects the level of the audio data as the quality of the audio data
  • the reproduction state detection unit detects the presence or absence of an electrical connection between the sound reproduction unit and a speaker and the presence or absence of a mute setting in the terminal device as the state of the audio reproduction;
  • the abstract writing support system according to appendix 1.
  • the information transmission unit periodically transmits information identifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
  • the abstract writing support system according to appendix 1.
  • a terminal device used by a writer who performs summary writing An audio reproduction unit that reproduces audio data transmitted from an information distribution device that transmits audio data to the terminal device as audio; A quality detector for detecting the quality of the audio data; A playback status detector that detects the status of audio playback on the terminal device; An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device; A terminal device characterized by that.
  • the quality detection unit continuously detects the level of the audio data as the quality of the audio data
  • the reproduction state detection unit detects the presence or absence of an electrical connection between the sound reproduction unit and a speaker and the presence or absence of a mute setting in the terminal device as the state of the audio reproduction;
  • the terminal device according to attachment 4.
  • the information transmission unit periodically transmits information identifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
  • the terminal device according to attachment 4.
  • (Appendix 7) A method for supporting summary writing performed by a writer, (A) in the terminal device used by the writer, reproducing the voice data transmitted from the information distribution device that transmits the voice data as voice; (B) detecting the quality of the audio data in the terminal device; (C) in the terminal device, detecting the state of audio reproduction there; (D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device;
  • An abstract writing support method characterized by comprising:
  • step (a) As the quality of the audio data, the level of the audio data is continuously detected, In the step (b), as the state of the audio reproduction, the presence / absence of an electrical connection with a speaker in the terminal device and the presence / absence of a mute setting in the terminal device are detected.
  • step (d) information for specifying the quality of the audio data detected in the step (b) and the status of the audio reproduction detected in the step (c) is periodically updated.
  • a computer-readable recording medium recording a program for supporting summary writing performed by the writer by a computer used by the writer, In the computer, (A) reproducing the audio data transmitted from the information distribution apparatus that transmits the audio data as audio; and (B) detecting the quality of the audio data; (C) detecting a state of sound reproduction in the terminal device; and (D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device; When, The computer-readable recording medium which recorded the program containing the instruction
  • step (a) As the quality of the audio data, the level of the audio data is continuously detected, In the step (b), as the state of the audio reproduction, the presence / absence of an electrical connection with a speaker in the terminal device and the presence / absence of a mute setting in the terminal device are detected.
  • the present invention it is possible to check the voice quality and the voice output status on the summary writing side on the side receiving the summary writing.
  • the present invention is useful in the field of abstract writing.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Telephonic Communication Services (AREA)

Abstract

This note-taking assistance system is a system for assisting with note-taking performed by a notetaker. The note-taking assistance system is provided with a terminal device 20 that is used by a notetaker and an information delivery device 10 that transmits audio data to the terminal device 20. The terminal device 20 is provided with: an audio playback unit 21 that plays back transmitted audio data as audio; a quality detection unit 22 that detects the quality of audio data; a playback state detection unit 23 that detects the state of audio playback at the terminal device 20; and an information transmission unit 24 that transmits information for identifying the quality of audio data and the state of audio playback to the information delivery device 10.

Description

要約筆記支援システム、端末装置、要約筆記支援方法、及びコンピュータ読み取り可能な記録媒体Abstract writing support system, terminal device, abstract writing support method, and computer-readable recording medium
　本発明は、話者の要約筆記を支援するための、要約筆記支援システム、それに用いられる端末装置、要約筆記支援方法、及びこれらを実現するためのプログラムを記録したコンピュータ読み取り可能な記録媒体に関する。 The present invention relates to a summary writing support system for supporting a speaker's summary writing, a terminal device used therefor, a summary writing support method, and a computer-readable recording medium on which a program for realizing these is recorded.
　両耳の聴力がマイナス１００デシベル以上の聴覚障がい者（以下、単に「聴覚障がい者」と記す）は、補聴器等を付けても、ほとんど音声中の言語情報を受けとることができない。このため従来から、聴覚障がい者が講演及び学校での授業等を聴講する場合、手話通訳者を付ける場合と、要約筆記を行なう筆記者を付ける場合とがあった。 聴 覚 Hearing impaired persons with hearing loss in both ears of minus 100 decibels (hereinafter simply referred to as “Hearing impaired persons”) can hardly receive language information in speech even with a hearing aid. For this reason, there have been cases where a hearing impaired person listens to lectures and classes at school, attaches a sign language interpreter, and attaches a writer who performs summary writing.
　このうち、筆記者を付ける場合には、通常、聴覚障がい者１人に対して、例えば学校での授業であれば、筆記者が２人以上付けられる。そして、これらの筆記者は、先生の話す内容などを、ＰＣ（Personal Computer）又は紙のノート等によって文字化し、これを聴覚障がい者に対して提示する。なお、筆記者が２人以上必要となるのは、要約筆記作業は負担が大きく、１人では要約精度が低下しやすいからである。 Of these, in the case of attaching a scribe, usually one or more hearing impaired persons will be assigned two or more scribes in the case of classes at school, for example. Then, these writers transcribe the teacher's spoken text etc. with a PC (Personal Computer) or a paper notebook and present it to the hearing impaired person. The reason why two or more writers are required is that the summarization writing work is heavy and the summarization accuracy tends to be lowered by one person.
　ところで、１８歳以下の聴覚障がい学生が平成２０年度の厚生労働省の調べでは全国で約２万人存在し、それに対し、正式に登録されている要約筆記通訳者は全国で約１万人である。その上で、聴覚障がい学生１人に対して２人以上の要約筆記通訳者が付くとすると、支援を受けることが可能な聴覚障がい学生は、単純に計算して１／４である。さらに、地域によって要約筆記者の数及び聴覚障がい学生の数には、ばらつきがある。これらの理由から、より少ない人数の聴覚障がい学生しか、学校において支援を受けることが出来ないのが現状であり、筆記者が不足しているという問題がある。 By the way, there are about 20,000 hearing-impaired students under 18 years old nationwide according to a survey conducted by the Ministry of Health, Labor and Welfare in 2008, whereas there are about 10,000 officially registered abstract writing interpreters nationwide. . On the other hand, if there are two or more abstract writing interpreters for one hearing impaired student, the number of hearing impaired students who can receive support is simply 1/4. Furthermore, the number of summary writers and the number of hearing impaired students vary by region. For these reasons, a smaller number of hearing-impaired students can only receive support at school, and there is a problem of lack of scribes.
　そこで、要約筆記を行う際に、筆記者が、聴覚障がい者の隣席まで行かなくても支援を行なえるようにするシステムが必要となる。例えば、特許文献１及び２に開示されたシステムは、情報配信装置によって、遠隔地にいる筆記者の端末装置に、インターネット等のネットワークを介して、話者の音声と映像とを配信する。また、このシステムは、筆記者が要約筆記を行なってテキストデータを作成すると、このテキストデータを、インターネットを介して、教室等に設置された表示装置の画面に表示する。特許文献１及び２に開示されたシステムによれば、筆記者が不足しているという問題の解消に貢献できると考えられる。 Therefore, when performing summary writing, a system is needed that allows the writer to provide assistance without going to the seat next to the hearing impaired. For example, the systems disclosed in Patent Documents 1 and 2 distribute the voice and video of a speaker to a writer's terminal device at a remote location via a network such as the Internet by an information distribution device. Further, in this system, when the writer performs summary writing and creates text data, the text data is displayed on a screen of a display device installed in a classroom or the like via the Internet. According to the systems disclosed in Patent Documents 1 and 2, it can be considered that the system can contribute to solving the problem of lack of writer.
特開２００２－０６４６３４号公報Japanese Patent Laid-Open No. 2002-064634 特開２０１２－２１５９６２号公報JP 2012-215862 A
　ところで、特許文献１及び２に開示されたシステムでは、話者の音声は、聴覚障がい者側にある装置から、要約筆記通訳者の端末装置へと送信されるが、ネットワークの障害等によって一部の音声の品質が低下する場合がある。また、端末装置における状態により、音声が出力されていない場合もある。このような場合が発生すると、要約筆記通訳者が作成するテキストデータが不十分なものとなってしまうの。このため、聴覚障がい者が、音声の品質、更には音声出力の状況を確認できる、仕組みが求められている。 By the way, in the systems disclosed in Patent Documents 1 and 2, the speaker's voice is transmitted from the device on the hearing impaired side to the terminal device of the summary writing interpreter. Voice quality may be degraded. In addition, depending on the state of the terminal device, audio may not be output. When such a case occurs, the text data created by the abstract writing interpreter becomes insufficient. For this reason, there is a need for a mechanism that enables a hearing impaired person to check the quality of sound and the state of sound output.
　本発明の目的の一例は、上記問題を解消し、要約筆記の提供を受ける側において、要約筆記側での音声の品質及び音声出力の状況を確認できるようにし得る、要約筆記支援システム、端末装置、要約筆記支援方法、及びコンピュータ読み取り可能な記録媒体を提供することにある。 An example of an object of the present invention is to provide a summary writing support system and a terminal device that can solve the above-described problems and enable the side receiving the provision of summary writing to confirm the voice quality and the state of voice output on the summary writing side. Another object is to provide a summary writing support method and a computer-readable recording medium.
　上記目的を達成するため、本発明の一側面における要約筆記支援システムは、筆記者によって行なわれる要約筆記を支援するためのシステムであって、
　前記筆記者が使用する端末装置と、前記端末装置に音声データを送信する情報配信装置と、を備え、
　前記端末装置は、
　前記情報配信装置から送信されてきた音声データを音声として再生する、音声再生部と、
　前記音声データの品質を検出する、品質検出部と、
　当該端末装置での音声再生の状況を検出する、再生状況検出部と、
　検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、情報送信部と、を備えている、
ことを特徴とする。 In order to achieve the above object, a summary writing support system according to one aspect of the present invention is a system for supporting summary writing performed by a writer,
A terminal device used by the writer, and an information distribution device that transmits voice data to the terminal device,
The terminal device
An audio reproduction unit for reproducing audio data transmitted from the information distribution device as audio;
A quality detector for detecting the quality of the audio data;
A playback status detector that detects the status of audio playback on the terminal device;
An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
It is characterized by that.
　上記目的を達成するため、本発明の一側面における端末装置は、要約筆記を行なう筆記者が使用する端末装置であって、
　当該端末装置に音声データを送信する情報配信装置から送信されてきた音声データを音声として再生する、音声再生部と、
　前記音声データの品質を検出する、品質検出部と、
　当該端末装置での音声再生の状況を検出する、再生状況検出部と、
　検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、情報送信部と、を備えている、
ことを特徴とする。 To achieve the above object, a terminal device according to one aspect of the present invention is a terminal device used by a writer who performs summary writing,
An audio reproduction unit that reproduces audio data transmitted from an information distribution device that transmits audio data to the terminal device as audio;
A quality detector for detecting the quality of the audio data;
A playback status detector that detects the status of audio playback on the terminal device;
An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
It is characterized by that.
　また、上記目的を達成するため、本発明の一側面における要約筆記支援方法は、筆記者によって行なわれる要約筆記を支援するための方法であって、
（ａ）前記筆記者が使用する端末装置において、音声データを送信する情報配信装置から送信されてきた音声データを音声として再生する、ステップと、
（ｂ）前記端末装置において、前記音声データの品質を検出する、ステップと、
（ｃ）前記端末装置において、そこでの音声再生の状況を検出する、ステップと、
（ｄ）前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、ステップと、
を有することを特徴とする。 In order to achieve the above object, a summary writing support method according to one aspect of the present invention is a method for supporting summary writing performed by a writer,
(A) in the terminal device used by the writer, reproducing the voice data transmitted from the information distribution device that transmits the voice data as voice;
(B) detecting the quality of the audio data in the terminal device;
(C) in the terminal device, detecting the state of audio reproduction there;
(D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device; When,
It is characterized by having.
　更に、上記目的を達成するため、本発明の一側面におけるコンピュータ読み取り可能な記録媒体は、筆記者が使用するコンピュータによって、前記筆記者によって行なわれる要約筆記を支援するためのプログラムを記録したコンピュータ読み取り可能な記録媒体であって、
前記コンピュータに、
（ａ）音声データを送信する情報配信装置から送信されてきた音声データを音声として再生する、ステップと、
（ｂ）前記音声データの品質を検出する、ステップと、
（ｃ）前記端末装置での音声再生の状況を検出する、ステップと、
（ｄ）前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、ステップと、
を実行させる命令を含む、プログラムを記録していることを特徴とする。 In order to achieve the above object, a computer-readable recording medium according to one aspect of the present invention is a computer-readable recording medium storing a program for supporting summary writing performed by a writer by a computer used by the writer. A possible recording medium,
In the computer,
(A) reproducing the audio data transmitted from the information distribution apparatus that transmits the audio data as audio; and
(B) detecting the quality of the audio data;
(C) detecting a state of sound reproduction in the terminal device; and
(D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device; When,
A program including an instruction for executing is recorded.
　以上のように本発明によれば、要約筆記の提供を受ける側において、要約筆記側での音声の品質及び音声出力の状況を確認できるようにすることができる。 As described above, according to the present invention, it is possible to check the voice quality and the voice output status on the summary writing side on the side receiving the summary writing.
図１は、本発明の実施の形態における要約筆記支援システム及び端末装置の概略構成を示す図である。FIG. 1 is a diagram showing a schematic configuration of a summary writing support system and a terminal device according to an embodiment of the present invention. 図２は、本発明の実施の形態における要約筆記支援システム及び端末装置の具体的構成を示すブロック図である。FIG. 2 is a block diagram showing a specific configuration of the summary writing support system and the terminal device according to the embodiment of the present invention. 図３は、本発明の要約筆記支援システムを構成する端末装置の動作を示すフロー図である。FIG. 3 is a flowchart showing the operation of the terminal device constituting the abstract writing support system of the present invention. 図４は、本発明の要約筆記支援システムを構成する情報配信装置の動作を示すフロー図である。FIG. 4 is a flowchart showing the operation of the information distribution apparatus constituting the summary writing support system of the present invention. 図５は、本発明の実施の形態における情報配信装置又は端末装置を実現するコンピュータの一例を示すブロック図である。FIG. 5 is a block diagram illustrating an example of a computer that implements the information distribution device or the terminal device according to the embodiment of the present invention.
（実施の形態）
　以下、本発明の実施の形態における、要約筆記支援システム、端末装置、要約筆記支援方法、及びプログラムについて、図１～図５を参照しながら説明する。 (Embodiment)
A summary writing support system, a terminal device, a summary writing support method, and a program according to an embodiment of the present invention will be described below with reference to FIGS.
［システム構成］
　最初に、図１を用いて、本発明の実施の形態における要約筆記支援システム及び端末装置の概略構成について説明する。図１は、本発明の実施の形態における要約筆記支援システム及び端末装置の概略構成を示す図である。  [System configuration]
First, the schematic configuration of the summary writing support system and the terminal device according to the embodiment of the present invention will be described with reference to FIG. FIG. 1 is a diagram showing a schematic configuration of a summary writing support system and a terminal device according to an embodiment of the present invention.
　図１に示す、本実施の形態における要約筆記支援システム１００は、筆記者５０によって行なわれる要約筆記を支援するためのシステムである。要約筆記支援システム１００は、情報配信装置１０と、筆記者５０が使用する端末装置２０とを備えている。なお、本実施の形態では、２人の筆記者によって要約筆記が行なわれるため、２つの端末装置２０が用いられている。 A summary writing support system 100 in the present embodiment shown in FIG. 1 is a system for supporting summary writing performed by a writer 50. The abstract writing support system 100 includes an information distribution device 10 and a terminal device 20 used by the writer 50. In the present embodiment, two terminal devices 20 are used because summary writing is performed by two writers.
　情報配信装置１０は、端末装置２０に音声データを送信するための装置であり、ネットワーク６０を介して、端末装置２０に接続されている。また、情報配信装置１０には、音声を収集するための集音装置１１と、ユーザ４０に要約筆記の結果を提示するための情報表示装置１２と接続されている。なお、集音装置１１の具体例としては、マイクが挙げられる。また、情報表示装置１２の具体例としては、液晶表示ディスプレイといったディスプレイ装置が挙げられる。 The information distribution device 10 is a device for transmitting voice data to the terminal device 20, and is connected to the terminal device 20 via the network 60. In addition, the information distribution apparatus 10 is connected to a sound collection apparatus 11 for collecting voice and an information display apparatus 12 for presenting a summary writing result to the user 40. A specific example of the sound collecting device 11 is a microphone. A specific example of the information display device 12 is a display device such as a liquid crystal display.
　端末装置２０は、音声再生部２１と、品質検出部２２と、再生状況検収部２３と、情報送信部２４とを備えている。このうち、音声再生部２１は、情報配信装置１０から送信されてきた音声データを音声として再生する。また、品質検出部２２は、音声データの品質を検出する。再生状況検出部２３は、端末装置２０での音声再生の状況を検出する。更に、情報送信部２４は、検出された音声データの品質と音声再生の状況とを特定する音声出力情報を、情報配信装置１０に送信する。 The terminal device 20 includes an audio reproduction unit 21, a quality detection unit 22, a reproduction status inspection unit 23, and an information transmission unit 24. Among these, the audio reproduction unit 21 reproduces the audio data transmitted from the information distribution device 10 as audio. Moreover, the quality detection part 22 detects the quality of audio | voice data. The playback status detection unit 23 detects the status of audio playback on the terminal device 20. Furthermore, the information transmission unit 24 transmits to the information distribution apparatus 10 audio output information that specifies the quality of the detected audio data and the state of audio reproduction.
　このような構成により、情報配信装置１０は、筆記者５０が使用する端末装置２０から、音声出力情報を受け取ることができるので、ユーザ４０に、音声の品質及び音声の再生状況を提示することができる。よって、要約筆記支援システム１００によれば、要約筆記の提供を受ける側において、要約筆記側での音声の品質及び音声出力の状況を確認することが可能となる。 With such a configuration, the information distribution apparatus 10 can receive the audio output information from the terminal apparatus 20 used by the writer 50, so that the audio quality and the audio reproduction status can be presented to the user 40. it can. Therefore, according to the summary writing support system 100, it is possible to check the quality of speech and the state of speech output on the summary writing side on the side receiving the provision of summary writing.
　ここで、図２を用いて、本実施の形態における要約筆記支援システム１００及び端末装置１０の構成を更に具体的に説明する。図２は、本発明の実施の形態における要約筆記支援システム及び端末装置の具体的構成を示すブロック図である。なお、図２の例では、説明のため、ネットワーク及び一方の端末装置の構成の図示については省略している。 Here, the configuration of the abstract writing support system 100 and the terminal device 10 in the present embodiment will be described more specifically with reference to FIG. FIG. 2 is a block diagram showing a specific configuration of the summary writing support system and the terminal device according to the embodiment of the present invention. In the example of FIG. 2, illustration of the configuration of the network and one terminal device is omitted for the sake of explanation.
　図２に示すように、本実施の形態では、情報配信装置１０は、音声データ取得部１３と、データ送信部１４と、データ受信部１５と、データ表示部１６とを備えている。 As shown in FIG. 2, in the present embodiment, the information distribution apparatus 10 includes an audio data acquisition unit 13, a data transmission unit 14, a data reception unit 15, and a data display unit 16.
　音声データ取得部１３は、集音装置１１によってデジタル処理された音声データを取得し、更に、取得した音声データを圧縮し、圧縮後の音声データをデータ送信部１４に入力する。データ送信部１４は、入力された音声データを、送信可能な形式に変換し、変換後の音声データを、ネットワーク６０（図２において図示せず）を介して端末装置２０に送信する。具体的には、データ送信部１４は、音声データから、送信用のパケットデータを生成する。 The audio data acquisition unit 13 acquires the audio data digitally processed by the sound collection device 11, further compresses the acquired audio data, and inputs the compressed audio data to the data transmission unit 14. The data transmission unit 14 converts the input voice data into a transmittable format, and transmits the converted voice data to the terminal device 20 via the network 60 (not shown in FIG. 2). Specifically, the data transmission unit 14 generates packet data for transmission from the voice data.
　データ受信部１５は、端末装置２０から、ネットワーク６０を介して送信されてくる音声出力情報を受信する。また、実施の形態では、後述するように、端末装置２０は、情報配信装置１０に対して、要約筆記の結果としてテキストデータも送信するため、データ受信部１５は、このテキストデータも受信する。そして、データ受信部１５は、音声出力情報とテキストデータとを、データ表示部１６に入力する。 The data receiving unit 15 receives audio output information transmitted from the terminal device 20 via the network 60. In the embodiment, as will be described later, since the terminal device 20 also transmits text data as a result of summary writing to the information distribution device 10, the data receiving unit 15 also receives this text data. Then, the data receiving unit 15 inputs the voice output information and the text data to the data display unit 16.
　データ表示部１６は、入力された音声出力情報とテキストデータとを用いて、これらを表示する画面用の画像データを生成し、生成した画像データを情報表示装置１２に入力する。これにより、情報表示装置１２は、画面上に、音声出力情報とテキストデータとを表示する。 The data display unit 16 uses the input voice output information and text data to generate image data for a screen for displaying them, and inputs the generated image data to the information display device 12. Thereby, the information display device 12 displays the voice output information and the text data on the screen.
　また、図２に示すように、端末装置２０は、本実施の形態では、音声再生部２１、品質検出部２２、再生状況検収部２３、及び情報送信部２４に加えて、音声データ受信部２５と、テキストデータ取得部２６とを備えている。また、端末装置２０には、スピーカ２７と、キーボード等の入力装置２８とが接続されている。テキストデータ取得部２６は、筆記者５０が入力装置２８から入力したテキストデータを受け取り、受け取ったテキストデータを情報送信部２４に入力する。 As shown in FIG. 2, in this embodiment, the terminal device 20 includes an audio data reception unit 25 in addition to the audio reproduction unit 21, the quality detection unit 22, the reproduction status inspection unit 23, and the information transmission unit 24. And a text data acquisition unit 26. The terminal device 20 is connected to a speaker 27 and an input device 28 such as a keyboard. The text data acquisition unit 26 receives the text data input from the input device 28 by the writer 50 and inputs the received text data to the information transmission unit 24.
　音声データ受信部２５は、情報配信装置１０のデータ送信部１４から送信されてくる音声データを受信し、その形式を元に戻す。具体的には、音声データ受信部２５は、音声データのパケットデータを受信し、これらをつなぎ合わせて元の音声データに復元する。そして、音声データ受信部２５は、形式変換後の音声データを音声再生部２１に入力する。 The audio data receiving unit 25 receives the audio data transmitted from the data transmitting unit 14 of the information distribution apparatus 10 and restores the format. Specifically, the voice data receiving unit 25 receives packet data of voice data, connects them, and restores the original voice data. Then, the audio data receiving unit 25 inputs the audio data after format conversion to the audio reproducing unit 21.
　音声再生部２１は、本実施の形態では、音声データ受信部２５から入力された音声データがデジタル信号であるため、入力された音声データをアナログ信号に変換する。そして、音声再生部２１は、変換後のアナログ信号をスピーカ２７に出力する。これにより、筆記者５０は、ユーザ４０側で収集された音声を聞くことができる。 In this embodiment, since the audio data input from the audio data receiving unit 25 is a digital signal, the audio reproducing unit 21 converts the input audio data into an analog signal. Then, the sound reproducing unit 21 outputs the converted analog signal to the speaker 27. Thereby, the writer 50 can hear the audio | voice collected by the user 40 side.
　品質検出部２２は、本実施の形態では、音声データ受信部２５から、音声データを取得し、音声データの品質として、取得した音声データのレベルを連続して検出する。また、品質検出部２２は、検出した音声データのレベルを特定するデータ（以下「レベル検出データ」と表記する。）を、情報送信部２４に入力する。 In the present embodiment, the quality detection unit 22 acquires audio data from the audio data reception unit 25, and continuously detects the level of the acquired audio data as the quality of the audio data. Further, the quality detection unit 22 inputs data (hereinafter referred to as “level detection data”) specifying the level of the detected audio data to the information transmission unit 24.
　再生状況検出部２３は、本実施の形態では、音声再生部２１に接続されており、音声再生の状況として、音声再生部２１とスピーカ２７との間での電気的接続の有無、及び端末装置２０における消音設定の有無を検出する。また、再生状況検出部２３は、検出結果を特定するデータ（以下「再生状況検出データ」と表記する。）を、情報送信部２４に入力する。 In the present embodiment, the playback status detection unit 23 is connected to the audio playback unit 21. As the status of audio playback, the presence / absence of electrical connection between the audio playback unit 21 and the speaker 27, and the terminal device The presence / absence of mute setting at 20 is detected. Further, the reproduction status detection unit 23 inputs data specifying the detection result (hereinafter referred to as “reproduction status detection data”) to the information transmission unit 24.
　情報送信部２４は、レベル検出データ、再生状況検出データ、及びテキストデータのうち少なくとも１つが入力されると、入力されたデータを情報配信装置１０に送信する。なお、本実施の形態では、レベル検出データ及び再生状況検出データが、上述した音声出力情報に該当する。 The information transmission unit 24 transmits the input data to the information distribution apparatus 10 when at least one of the level detection data, the reproduction state detection data, and the text data is input. In the present embodiment, the level detection data and the reproduction status detection data correspond to the audio output information described above.
　また、本実施の形態では、情報送信部２４は、情報配信装置１０からの音声データの送信タイミングに影響されることなく、レベル検出データ、再生状況検出データ、及びテキストデータを、定期的に情報配信装置１０に送信する。このため、例えば、単に音声が発せられていない状況では、レベルが小さいことを示す検出データと、電気的接続有及び消音設定無を示す再生状況検出データと、空白のテキストデータとが送信されてくることになる。よって、ユーザ４０は、例え、聴覚障がい者であっても、このような単に音声が発せられていない状況であることを知ることができる。 Further, in the present embodiment, the information transmission unit 24 periodically receives the level detection data, the reproduction status detection data, and the text data without being affected by the transmission timing of the audio data from the information distribution device 10. Transmit to the distribution device 10. For this reason, for example, in a situation where no sound is being emitted, detection data indicating that the level is low, reproduction status detection data indicating that electrical connection is present and mute is not set, and blank text data are transmitted. Will come. Therefore, even if the user 40 is a person with hearing disabilities, the user 40 can know that such a situation is not generated.
［システム動作］
　次に、本発明の実施の形態における要約筆記支援システムの動作について図３及び図４を用いて説明する。また、以下の説明においては、適宜図１及び図２を参酌する。更に、本実施の形態では、要約筆記支援システム１００を動作させることによって、要約筆記支援方法が実施される。よって、本実施の形態における要約筆記支援方法の説明は、以下の要約筆記支援システム１００の動作説明に代える。 [System operation]
Next, the operation of the abstract writing support system according to the embodiment of the present invention will be described with reference to FIGS. In the following description, FIGS. 1 and 2 are referred to as appropriate. Furthermore, in the present embodiment, the summary writing support method is implemented by operating the summary writing support system 100. Therefore, the description of the summary writing support method in the present embodiment is replaced with the following description of the operation of the summary writing support system 100.
　端末装置の動作：
　最初に、図３を用いて、本実施の形態における端末装置２０の動作について説明する。図３は、本発明の要約筆記支援システムを構成する端末装置の動作を示すフロー図である。なお、端末装置２０では、図３に示す処理と平行して、音声データ受信部２５による音声データの受信と、音声再生部２１による音声データの再生とが実行されているものとする。 Terminal device operation:
Initially, the operation | movement of the terminal device 20 in this Embodiment is demonstrated using FIG. FIG. 3 is a flowchart showing the operation of the terminal device constituting the abstract writing support system of the present invention. In the terminal device 20, it is assumed that the audio data reception unit 25 receives the audio data and the audio reproduction unit 21 reproduces the audio data in parallel with the processing shown in FIG.
　図４に示すように、品質検出部２２は、音声データ受信部２５から、音声データを取得し、音声データの品質として、取得した音声データのレベルを検出する（ステップＡ１）。また、ステップＡ１では、品質検出部２２は、検出した音声データのレベルを特定するレベル検出データを、情報送信部２４に入力する。 As shown in FIG. 4, the quality detection unit 22 acquires audio data from the audio data reception unit 25, and detects the level of the acquired audio data as the quality of the audio data (step A1). In step A <b> 1, the quality detection unit 22 inputs level detection data for specifying the level of the detected audio data to the information transmission unit 24.
　次に、再生状況検出部２３は、音声再生部２１とスピーカ２７との間での電気的接続の有無を検出する（ステップＡ２）。更に、再生状況検出部２３は、端末装置２０における消音設定の有無も検出する（ステップＡ３）。また、再生状況検出部２３は、ステップＡ２及びＡ３で得た検出結果を特定する再生状況検出データを、情報送信部２４に入力する。 Next, the reproduction status detection unit 23 detects the presence / absence of an electrical connection between the audio reproduction unit 21 and the speaker 27 (step A2). Furthermore, the reproduction status detection unit 23 also detects the presence / absence of mute setting in the terminal device 20 (step A3). Further, the playback status detection unit 23 inputs playback status detection data for specifying the detection results obtained in steps A2 and A3 to the information transmission unit 24.
　次に、テキストデータ取得部２６は、筆記者５０が入力装置２８から入力したテキストデータを受け取り、受け取ったテキストデータを情報送信部２４に入力する（ステップＡ４）。 Next, the text data acquisition unit 26 receives the text data input by the writer 50 from the input device 28, and inputs the received text data to the information transmission unit 24 (step A4).
　次に、情報送信部２４は、レベル検出データ、再生状況検出データ、及びテキストデータの少なくとも１つが入力されると、入力されたデータを情報配信装置１０に送信する（ステップＡ５）。 Next, when at least one of level detection data, reproduction status detection data, and text data is input, the information transmission unit 24 transmits the input data to the information distribution apparatus 10 (step A5).
　また、ステップＡ１～Ａ５は繰り返し実行され、レベル検出データ、再生状況検出データ、及びテキストデータは、定期的に情報配信装置１０に送信される。また、ステップＡ１～Ａ４の実行順序は限定されるものではなく、各ステップは平行して実行されていても良い。 Steps A1 to A5 are repeatedly executed, and the level detection data, reproduction status detection data, and text data are periodically transmitted to the information distribution apparatus 10. Further, the execution order of steps A1 to A4 is not limited, and the steps may be executed in parallel.
　情報配信装置の動作：
　続いて、図４を用いて、本実施の形態における情報配信装置１０の動作について説明する。図４は、本発明の要約筆記支援システムを構成する情報配信装置の動作を示すフロー図である。なお、情報配信装置１０では、図４に示す処理と平行して、音声データ取得部１３による音声データの取得と、データ送信部１４による音声データの送信とが実行されているものとする。 Information distribution device operation:
Next, the operation of the information distribution apparatus 10 in the present embodiment will be described using FIG. FIG. 4 is a flowchart showing the operation of the information distribution apparatus constituting the summary writing support system of the present invention. In the information distribution apparatus 10, it is assumed that acquisition of audio data by the audio data acquisition unit 13 and transmission of audio data by the data transmission unit 14 are executed in parallel with the processing illustrated in FIG. 4.
　図４に示すように、データ受信部１５は、端末装置２０から、ネットワーク６０を介して送信されてくる、レベル検出データ、再生状況検出データ、及びテキストデータを受信する（ステップＢ１）。また、データ受信部１５は、受信したデータを、データ表示部１６に入力する。 As shown in FIG. 4, the data receiving unit 15 receives level detection data, reproduction status detection data, and text data transmitted from the terminal device 20 via the network 60 (step B1). In addition, the data receiving unit 15 inputs the received data to the data display unit 16.
　次に、データ表示部１６は、データ受信部１５から入力された、レベル検出データ、再生状況検出データ、及びテキストデータを用いて、これらを表示する画面用の画像データを生成し、生成した画像データを情報表示装置１２に入力する（ステップＢ２）。具体的には、データ表示部１６は、音声データのレベルの時系列変化、電気的接続の有無、消音設定の有無、及び筆記者５０が入力したテキストが表示されるように、画像データを生成する。 Next, the data display unit 16 uses the level detection data, the reproduction status detection data, and the text data input from the data reception unit 15 to generate image data for a screen for displaying them, and the generated image Data is input to the information display device 12 (step B2). Specifically, the data display unit 16 generates image data so that the time-series change in the level of the audio data, the presence / absence of electrical connection, the presence / absence of the mute setting, and the text input by the writer 50 are displayed. To do.
　次に、データ表示部１６は、情報表示装置１２に画像データを入力して、情報表示装置１２の画面に、この画像データによって特定される画像を表示させる（ステップＢ３）。また、ステップＢ１～Ｂ３は、端末装置２０からデータが送信される度に、繰り返し実行される。 Next, the data display unit 16 inputs image data to the information display device 12, and displays an image specified by the image data on the screen of the information display device 12 (step B3). Steps B1 to B3 are repeatedly executed every time data is transmitted from the terminal device 20.
［実施の形態による効果］
　以上のように本実施の形態では、端末装置２０から情報配信装置１０へと、レベル検出データ、再生状況検出データ、及びテキストデータが送信される。よって、本実施の形態によれば、ユーザ４０は、要約筆記の結果を確認しつつ、要約筆記側での音声の品質及び音声出力の状況も確認できる。 [Effects of the embodiment]
As described above, in the present embodiment, level detection data, reproduction status detection data, and text data are transmitted from the terminal device 20 to the information distribution device 10. Therefore, according to this Embodiment, the user 40 can also confirm the audio | voice quality on the summary writing side and the condition of audio | voice output, confirming the result of summary writing.
［プログラム］
　本実施の形態における第１のプログラムは、コンピュータに、図３に示すステップＡ１～Ａ５を実行させるプログラムであれば良い。このプログラムをコンピュータにインストールし、実行することによって、本実施の形態における端末装置２０を実現することができる。コンピュータのＣＰＵ（Central Processing Unit）は、音声再生部２１、品質検出部２２、再生状況検収部２３、情報送信部２４、音声データ受信部２５及びテキストデータ取得部２６として機能し、処理を行なう。 [program]
The first program in the present embodiment may be a program that causes a computer to execute steps A1 to A5 shown in FIG. By installing and executing this program on a computer, the terminal device 20 in the present embodiment can be realized. A CPU (Central Processing Unit) of the computer functions as an audio reproduction unit 21, a quality detection unit 22, a reproduction status detection unit 23, an information transmission unit 24, an audio data reception unit 25, and a text data acquisition unit 26, and performs processing.
　また、本実施の形態における第２のプログラムは、コンピュータに、図４に示すステップＢ１～Ｂ３を実行させるプログラムであれば良い。このプログラムをコンピュータにインストールし、実行することによって、本実施の形態における情報配信装置１０を実現することができる。コンピュータのＣＰＵ（Central Processing Unit）は、データ取得部１３、データ送信部１４、データ受信部１５及びデータ表示部１６として機能し、処理を行なう。 Also, the second program in the present embodiment may be a program that causes a computer to execute steps B1 to B3 shown in FIG. By installing and executing this program on a computer, the information distribution apparatus 10 in the present embodiment can be realized. A CPU (Central Processing Unit) of the computer functions as a data acquisition unit 13, a data transmission unit 14, a data reception unit 15, and a data display unit 16 to perform processing.
　ここで、本実施の形態におけるプログラムを実行することによって、情報配信装置１０又は端末装置２０を実現するコンピュータについて図５を用いて説明する。図５は、本発明の実施の形態における情報配信装置又は端末装置を実現するコンピュータの一例を示すブロック図である。 Here, a computer that realizes the information distribution apparatus 10 or the terminal apparatus 20 by executing the program according to the present embodiment will be described with reference to FIG. FIG. 5 is a block diagram illustrating an example of a computer that implements the information distribution device or the terminal device according to the embodiment of the present invention.
　図５に示すように、コンピュータ１１０は、ＣＰＵ１１１と、メインメモリ１１２と、記憶装置１１３と、入力インターフェイス１１４と、表示コントローラ１１５と、データリーダ／ライタ１１６と、通信インターフェイス１１７とを備える。これらの各部は、バス１２１を介して、互いにデータ通信可能に接続される。 As shown in FIG. 5, the computer 110 includes a CPU 111, a main memory 112, a storage device 113, an input interface 114, a display controller 115, a data reader / writer 116, and a communication interface 117. These units are connected to each other via a bus 121 so that data communication is possible.
　ＣＰＵ１１１は、記憶装置１１３に格納された、本実施の形態における第１又は第２のプログラム（コード）をメインメモリ１１２に展開し、これらを所定順序で実行することにより、各種の演算を実施する。メインメモリ１１２は、典型的には、ＤＲＡＭ（Dynamic Random Access Memory）等の揮発性の記憶装置である。また、本実施の形態におけるプログラムは、コンピュータ読み取り可能な記録媒体１２０に格納された状態で提供される。なお、本実施の形態におけるプログラムは、通信インターフェイス１１７を介して接続されたインターネット上で流通するものであっても良い。 The CPU 111 performs various operations by developing the first or second program (code) in the present embodiment stored in the storage device 113 in the main memory 112 and executing them in a predetermined order. . The main memory 112 is typically a volatile storage device such as a DRAM (Dynamic Random Access Memory). Further, the program in the present embodiment is provided in a state of being stored in a computer-readable recording medium 120. Note that the program in the present embodiment may be distributed on the Internet connected via the communication interface 117.
　また、記憶装置１１３の具体例としては、ハードディスクドライブの他、フラッシュメモリ等の半導体記憶装置が挙げられる。入力インターフェイス１１４は、ＣＰＵ１１１と、キーボード及びマウスといった入力機器１１８との間のデータ伝送を仲介する。表示コントローラ１１５は、ディスプレイ装置１１９と接続され、ディスプレイ装置１１９での表示を制御する。 Further, specific examples of the storage device 113 include a hard disk drive and a semiconductor storage device such as a flash memory. The input interface 114 mediates data transmission between the CPU 111 and an input device 118 such as a keyboard and a mouse. The display controller 115 is connected to the display device 119 and controls display on the display device 119.
　データリーダ／ライタ１１６は、ＣＰＵ１１１と記録媒体１２０との間のデータ伝送を仲介し、記録媒体１２０からのプログラムの読み出し、及びコンピュータ１１０における処理結果の記録媒体１２０への書き込みを実行する。通信インターフェイス１１７は、ＣＰＵ１１１と、他のコンピュータとの間のデータ伝送を仲介する。 The data reader / writer 116 mediates data transmission between the CPU 111 and the recording medium 120, and reads a program from the recording medium 120 and writes a processing result in the computer 110 to the recording medium 120. The communication interface 117 mediates data transmission between the CPU 111 and another computer.
　また、記録媒体１２０の具体例としては、ＣＦ（Compact Flash（登録商標））及びＳＤ（Secure Digital）等の汎用的な半導体記憶デバイス、フレキシブルディスク（Flexible Disk）等の磁気記憶媒体、又はＣＤ－ＲＯＭ（Compact Disk Read Only Memory）などの光学記憶媒体が挙げられる。 Specific examples of the recording medium 120 include general-purpose semiconductor storage devices such as CF (Compact Flash (registered trademark)) and SD (Secure Digital), magnetic storage media such as a flexible disk, or CD- Optical storage media such as ROM (Compact Disk Read Only Memory) are listed.
　また、上述した実施の形態の一部又は全部は、以下に記載する（付記１）～（付記１２）によって表現することができるが、以下の記載に限定されるものではない。 Further, a part or all of the above-described embodiment can be expressed by the following (Appendix 1) to (Appendix 12), but is not limited to the following description.
（付記１）
　筆記者によって行なわれる要約筆記を支援するためのシステムであって、
　前記筆記者が使用する端末装置と、前記端末装置に音声データを送信する情報配信装置と、を備え、
　前記端末装置は、
　前記情報配信装置から送信されてきた音声データを音声として再生する、音声再生部と、
　前記音声データの品質を検出する、品質検出部と、
　当該端末装置での音声再生の状況を検出する、再生状況検出部と、
　検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、情報送信部と、を備えている、
ことを特徴とする要約筆記支援システム。 (Appendix 1)
A system for supporting summary writing performed by a writer,
A terminal device used by the writer, and an information distribution device that transmits voice data to the terminal device,
The terminal device
An audio reproduction unit for reproducing audio data transmitted from the information distribution device as audio;
A quality detector for detecting the quality of the audio data;
A playback status detector that detects the status of audio playback on the terminal device;
An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
This is a summary writing support system.
（付記２）
　前記端末装置において、
　前記品質検出部が、前記音声データの品質として、前記音声データのレベルを連続して検出し、
　前記再生状況検出部が、前記音声再生の状況として、前記音声再生部とスピーカとの間での電気的接続の有無、及び当該端末装置における消音設定の有無を検出する、
付記１に記載の要約筆記支援システム。 (Appendix 2)
In the terminal device,
The quality detection unit continuously detects the level of the audio data as the quality of the audio data,
The reproduction state detection unit detects the presence or absence of an electrical connection between the sound reproduction unit and a speaker and the presence or absence of a mute setting in the terminal device as the state of the audio reproduction;
The abstract writing support system according to appendix 1.
（付記３）
　前記情報送信部が、検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、定期的に前記情報配信装置に送信する、
付記１に記載の要約筆記支援システム。 (Appendix 3)
The information transmission unit periodically transmits information identifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
The abstract writing support system according to appendix 1.
（付記４）
　要約筆記を行なう筆記者が使用する端末装置であって、
　当該端末装置に音声データを送信する情報配信装置から送信されてきた音声データを音声として再生する、音声再生部と、
　前記音声データの品質を検出する、品質検出部と、
　当該端末装置での音声再生の状況を検出する、再生状況検出部と、
　検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、情報送信部と、を備えている、
ことを特徴とする端末装置。 (Appendix 4)
A terminal device used by a writer who performs summary writing,
An audio reproduction unit that reproduces audio data transmitted from an information distribution device that transmits audio data to the terminal device as audio;
A quality detector for detecting the quality of the audio data;
A playback status detector that detects the status of audio playback on the terminal device;
An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
A terminal device characterized by that.
（付記５）
　前記品質検出部が、前記音声データの品質として、前記音声データのレベルを連続して検出し、
　前記再生状況検出部が、前記音声再生の状況として、前記音声再生部とスピーカとの間での電気的接続の有無、及び当該端末装置における消音設定の有無を検出する、
付記４に記載の端末装置。 (Appendix 5)
The quality detection unit continuously detects the level of the audio data as the quality of the audio data,
The reproduction state detection unit detects the presence or absence of an electrical connection between the sound reproduction unit and a speaker and the presence or absence of a mute setting in the terminal device as the state of the audio reproduction;
The terminal device according to attachment 4.
（付記６）
　前記情報送信部が、検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、定期的に前記情報配信装置に送信する、
付記４に記載の端末装置。 (Appendix 6)
The information transmission unit periodically transmits information identifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
The terminal device according to attachment 4.
（付記７）
　筆記者によって行なわれる要約筆記を支援するための方法であって、
（ａ）前記筆記者が使用する端末装置において、音声データを送信する情報配信装置から送信されてきた音声データを音声として再生する、ステップと、
（ｂ）前記端末装置において、前記音声データの品質を検出する、ステップと、
（ｃ）前記端末装置において、そこでの音声再生の状況を検出する、ステップと、
（ｄ）前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、ステップと、
を有することを特徴とする要約筆記支援方法。 (Appendix 7)
A method for supporting summary writing performed by a writer,
(A) in the terminal device used by the writer, reproducing the voice data transmitted from the information distribution device that transmits the voice data as voice;
(B) detecting the quality of the audio data in the terminal device;
(C) in the terminal device, detecting the state of audio reproduction there;
(D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device; When,
An abstract writing support method characterized by comprising:
（付記８）
　前記（ａ）のステップにおいて、前記音声データの品質として、前記音声データのレベルを連続して検出し、
　前記（ｂ）のステップにおいて、前記音声再生の状況として、前記端末装置におけるスピーカとの間での電気的接続の有無、及び前記端末装置における消音設定の有無を検出する、
付記７に記載の要約筆記支援方法。 (Appendix 8)
In the step (a), as the quality of the audio data, the level of the audio data is continuously detected,
In the step (b), as the state of the audio reproduction, the presence / absence of an electrical connection with a speaker in the terminal device and the presence / absence of a mute setting in the terminal device are detected.
The abstract writing support method according to appendix 7.
（付記９）
　前記（ｄ）のステップにおいて、前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、定期的に前記情報配信装置に送信する、
付記７に記載の要約筆記支援方法。 (Appendix 9)
In the step (d), information for specifying the quality of the audio data detected in the step (b) and the status of the audio reproduction detected in the step (c) is periodically updated. Send to the information distribution device,
The abstract writing support method according to appendix 7.
（付記１０）
　筆記者が使用するコンピュータによって、前記筆記者によって行なわれる要約筆記を支援するためのプログラムを記録したコンピュータ読み取り可能な記録媒体であって、
前記コンピュータに、
（ａ）音声データを送信する情報配信装置から送信されてきた音声データを音声として再生する、ステップと、
（ｂ）前記音声データの品質を検出する、ステップと、
（ｃ）前記端末装置での音声再生の状況を検出する、ステップと、
（ｄ）前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、ステップと、
を実行させる命令を含む、プログラムを記録したコンピュータ読み取り可能な記録媒体。　　　 (Appendix 10)
A computer-readable recording medium recording a program for supporting summary writing performed by the writer by a computer used by the writer,
In the computer,
(A) reproducing the audio data transmitted from the information distribution apparatus that transmits the audio data as audio; and
(B) detecting the quality of the audio data;
(C) detecting a state of sound reproduction in the terminal device; and
(D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device; When,
The computer-readable recording medium which recorded the program containing the instruction | command which performs this.
（付記１１）
　前記（ａ）のステップにおいて、前記音声データの品質として、前記音声データのレベルを連続して検出し、
　前記（ｂ）のステップにおいて、前記音声再生の状況として、前記端末装置におけるスピーカとの間での電気的接続の有無、及び前記端末装置における消音設定の有無を検出する、
付記１０に記載のコンピュータ読み取り可能な記録媒体。 (Appendix 11)
In the step (a), as the quality of the audio data, the level of the audio data is continuously detected,
In the step (b), as the state of the audio reproduction, the presence / absence of an electrical connection with a speaker in the terminal device and the presence / absence of a mute setting in the terminal device are detected.
The computer-readable recording medium according to appendix 10.
（付記１２）
　前記（ｄ）のステップにおいて、前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、定期的に前記情報配信装置に送信する、
付記１０に記載のコンピュータ読み取り可能な記録媒体。 (Appendix 12)
In the step (d), information for specifying the quality of the audio data detected in the step (b) and the status of the audio reproduction detected in the step (c) is periodically updated. Send to the information distribution device,
The computer-readable recording medium according to appendix 10.
　以上、実施の形態を参照して本願発明を説明したが、本願発明は上記実施の形態に限定されるものではない。本願発明の構成や詳細には、本願発明のスコープ内で当業者が理解し得る様々な変更をすることができる。 The present invention has been described above with reference to the embodiments, but the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
　この出願は、２０１５年１月１６日に出願された日本出願特願２０１５－００６４１２を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2015-006412 filed on January 16, 2015, the entire disclosure of which is incorporated herein.
　以上のように本発明によれば、要約筆記の提供を受ける側において、要約筆記側での音声の品質及び音声出力の状況を確認できるようにすることができる。本発明は、要約筆記の分野において有用である。 As described above, according to the present invention, it is possible to check the voice quality and the voice output status on the summary writing side on the side receiving the summary writing. The present invention is useful in the field of abstract writing.
　１０　情報配信装置
　１１　集音装置
　１２　情報表示装置
　１３　音声データ取得部
　１４　データ送信部
　１５　データ受信部
　１６　データ表示部
　２０　端末装置
　２１　音声再生部
　２２　品質検出部
　２３　再生状況検出部
　２４　情報送信部
　２５　音声データ受信部
　２６　テキストデータ取得部
　２７　スピーカ
　２８　入力装置
　１００　要約筆記支援システム
　１１０　コンピュータ
　１１１　ＣＰＵ
　１１２　メインメモリ
　１１３　記憶装置
　１１４　入力インターフェイス
　１１５　表示コントローラ
　１１６　データリーダ／ライタ
　１１７　通信インターフェイス
　１１８　入力機器
　１１９　ディスプレイ装置
　１２０　記録媒体
　１２１　バス DESCRIPTION OF SYMBOLS 10 Information delivery apparatus 11 Sound collector 12 Information display apparatus 13 Audio | voice data acquisition part 14 Data transmission part 15 Data reception part 16 Data display part 20 Terminal device 21 Voice reproduction part 22 Quality detection part 23 Playback condition detection part 24 Information transmission part 25 Audio data reception unit 26 Text data acquisition unit 27 Speaker 28 Input device 100 Summary writing support system 110 Computer 111 CPU
112 Main Memory 113 Storage Device 114 Input Interface 115 Display Controller 116 Data Reader / Writer 117 Communication Interface 118 Input Device 119 Display Device 120 Recording Medium 121 Bus

Claims (12)

  1. 　筆記者によって行なわれる要約筆記を支援するためのシステムであって、
    　前記筆記者が使用する端末装置と、前記端末装置に音声データを送信する情報配信装置と、を備え、
    　前記端末装置は、
    　前記情報配信装置から送信されてきた音声データを音声として再生する、音声再生部と、
    　前記音声データの品質を検出する、品質検出部と、
    　当該端末装置での音声再生の状況を検出する、再生状況検出部と、
    　検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、情報送信部と、を備えている、
    ことを特徴とする要約筆記支援システム。     A system for supporting summary writing performed by a writer,
    A terminal device used by the writer, and an information distribution device that transmits voice data to the terminal device,
    The terminal device
    An audio reproduction unit for reproducing audio data transmitted from the information distribution device as audio;
    A quality detector for detecting the quality of the audio data;
    A playback status detector that detects the status of audio playback on the terminal device;
    An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
    This is a summary writing support system.
  2. 　前記端末装置において、
    　前記品質検出部が、前記音声データの品質として、前記音声データのレベルを連続して検出し、
    　前記再生状況検出部が、前記音声再生の状況として、前記音声再生部とスピーカとの間での電気的接続の有無、及び当該端末装置における消音設定の有無を検出する、
    請求項１に記載の要約筆記支援システム。     In the terminal device,
    The quality detection unit continuously detects the level of the audio data as the quality of the audio data,
    The reproduction state detection unit detects the presence or absence of an electrical connection between the sound reproduction unit and a speaker and the presence or absence of a mute setting in the terminal device as the state of the audio reproduction;
    The abstract writing support system according to claim 1.
  3. 　前記情報送信部が、検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、定期的に前記情報配信装置に送信する、
    請求項１または２に記載の要約筆記支援システム。     The information transmission unit periodically transmits information identifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
    The abstract writing support system according to claim 1 or 2.
  4. 　要約筆記を行なう筆記者が使用する端末装置であって、
    　当該端末装置に音声データを送信する情報配信装置から送信されてきた音声データを音声として再生する、音声再生部と、
    　前記音声データの品質を検出する、品質検出部と、
    　当該端末装置での音声再生の状況を検出する、再生状況検出部と、
    　検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、情報送信部と、を備えている、
    ことを特徴とする端末装置。     A terminal device used by a writer who performs summary writing,
    An audio reproduction unit that reproduces audio data transmitted from an information distribution device that transmits audio data to the terminal device as audio;
    A quality detector for detecting the quality of the audio data;
    A playback status detector that detects the status of audio playback on the terminal device;
    An information transmission unit configured to transmit information specifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
    A terminal device characterized by that.
  5. 　前記品質検出部が、前記音声データの品質として、前記音声データのレベルを連続して検出し、
    　前記再生状況検出部が、前記音声再生の状況として、前記音声再生部とスピーカとの間での電気的接続の有無、及び当該端末装置における消音設定の有無を検出する、
    請求項４に記載の端末装置。     The quality detection unit continuously detects the level of the audio data as the quality of the audio data,
    The reproduction state detection unit detects the presence or absence of an electrical connection between the sound reproduction unit and a speaker and the presence or absence of a mute setting in the terminal device as the state of the audio reproduction;
    The terminal device according to claim 4.
  6. 　前記情報送信部が、検出された前記音声データの品質と前記音声再生の状況とを特定する情報を、定期的に前記情報配信装置に送信する、
    請求項４または５に記載の端末装置。     The information transmission unit periodically transmits information identifying the quality of the detected audio data and the status of the audio reproduction to the information distribution device;
    The terminal device according to claim 4 or 5.
  7. 　筆記者によって行なわれる要約筆記を支援するための方法であって、
    （ａ）前記筆記者が使用する端末装置において、音声データを送信する情報配信装置から送信されてきた音声データを音声として再生する、ステップと、
    （ｂ）前記端末装置において、前記音声データの品質を検出する、ステップと、
    （ｃ）前記端末装置において、そこでの音声再生の状況を検出する、ステップと、
    （ｄ）前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、ステップと、
    を有することを特徴とする要約筆記支援方法。     A method for supporting summary writing performed by a writer,
    (A) in the terminal device used by the writer, reproducing the voice data transmitted from the information distribution device that transmits the voice data as voice;
    (B) detecting the quality of the audio data in the terminal device;
    (C) in the terminal device, detecting the state of audio reproduction there;
    (D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device; When,
    An abstract writing support method characterized by comprising:
  8. 　前記（ａ）のステップにおいて、前記音声データの品質として、前記音声データのレベルを連続して検出し、
    　前記（ｂ）のステップにおいて、前記音声再生の状況として、前記端末装置におけるスピーカとの間での電気的接続の有無、及び前記端末装置における消音設定の有無を検出する、
    請求項７に記載の要約筆記支援方法。     In the step (a), as the quality of the audio data, the level of the audio data is continuously detected,
    In the step (b), as the state of the audio reproduction, the presence / absence of an electrical connection with a speaker in the terminal device and the presence / absence of a mute setting in the terminal device are detected.
    The abstract writing support method according to claim 7.
  9. 　前記（ｄ）のステップにおいて、前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、定期的に前記情報配信装置に送信する、
    請求項７または８に記載の要約筆記支援方法。     In the step (d), information for specifying the quality of the audio data detected in the step (b) and the status of the audio reproduction detected in the step (c) is periodically updated. Send to the information distribution device,
    The summary writing support method according to claim 7 or 8.
  10. 　筆記者が使用するコンピュータによって、前記筆記者によって行なわれる要約筆記を支援するためのプログラムを記録したコンピュータ読み取り可能な記録媒体であって、
    前記コンピュータに、
    （ａ）音声データを送信する情報配信装置から送信されてきた音声データを音声として再生する、ステップと、
    （ｂ）前記音声データの品質を検出する、ステップと、
    （ｃ）前記端末装置での音声再生の状況を検出する、ステップと、
    （ｄ）前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、前記情報配信装置に送信する、ステップと、
    を実行させる命令を含む、プログラムを記録したコンピュータ読み取り可能な記録媒体。     A computer-readable recording medium recording a program for supporting summary writing performed by the writer by a computer used by the writer,
    In the computer,
    (A) reproducing the audio data transmitted from the information distribution apparatus that transmits the audio data as audio; and
    (B) detecting the quality of the audio data;
    (C) detecting a state of sound reproduction in the terminal device; and
    (D) transmitting information specifying the quality of the audio data detected in the step of (b) and the status of the audio reproduction detected in the step of (c) to the information distribution device; When,
    The computer-readable recording medium which recorded the program containing the instruction | indication which performs this.
  11. 　前記（ａ）のステップにおいて、前記音声データの品質として、前記音声データのレベルを連続して検出し、
    　前記（ｂ）のステップにおいて、前記音声再生の状況として、前記端末装置におけるスピーカとの間での電気的接続の有無、及び前記端末装置における消音設定の有無を検出する、
    請求項１０に記載のコンピュータ読み取り可能な記録媒体。     In the step (a), as the quality of the audio data, the level of the audio data is continuously detected,
    In the step (b), as the state of the audio reproduction, the presence / absence of an electrical connection with a speaker in the terminal device and the presence / absence of a mute setting in the terminal device are detected.
    The computer-readable recording medium according to claim 10.
  12. 　前記（ｄ）のステップにおいて、前記（ｂ）のステップで検出された前記音声データの品質と前記（ｃ）のステップで検出された前記音声再生の状況とを特定する情報を、定期的に前記情報配信装置に送信する、
    請求項１０または１１に記載のコンピュータ読み取り可能な記録媒体。     In the step (d), information for specifying the quality of the audio data detected in the step (b) and the status of the audio reproduction detected in the step (c) is periodically updated. Send to the information distribution device,
    The computer-readable recording medium according to claim 10 or 11.
PCT/JP2016/050228 2015-01-16 2016-01-06 Note-taking assistance system, terminal device, note-taking assistance method, and computer-readable recording medium WO2016114193A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2016569319A JPWO2016114193A1 (en) 2015-01-16 2016-01-06 Abstract writing support system, terminal device, abstract writing support method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015-006412 2015-01-16
JP2015006412 2015-01-16

Publications (1)

Publication Number Publication Date
WO2016114193A1 true WO2016114193A1 (en) 2016-07-21

Family

ID=56405740

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/050228 WO2016114193A1 (en) 2015-01-16 2016-01-06 Note-taking assistance system, terminal device, note-taking assistance method, and computer-readable recording medium

Country Status (2)

Country Link
JP (1) JPWO2016114193A1 (en)
WO (1) WO2016114193A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11331433A (en) * 1998-05-15 1999-11-30 Nissan Motor Co Ltd Communication system
JP2007267116A (en) * 2006-03-29 2007-10-11 Toshiba Corp Av apparatus and interface system
JP2012215962A (en) * 2011-03-31 2012-11-08 Nec System Technologies Ltd Dictation support device, dictation support method and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11331433A (en) * 1998-05-15 1999-11-30 Nissan Motor Co Ltd Communication system
JP2007267116A (en) * 2006-03-29 2007-10-11 Toshiba Corp Av apparatus and interface system
JP2012215962A (en) * 2011-03-31 2012-11-08 Nec System Technologies Ltd Dictation support device, dictation support method and program

Also Published As

Publication number Publication date
JPWO2016114193A1 (en) 2017-10-19

Similar Documents

Publication Publication Date Title
US10540994B2 (en) Personal device for hearing degradation monitoring
JP2006301223A (en) System and program for speech recognition
US7983921B2 (en) Information processing apparatus for speech recognition with user guidance, method and program
TW200500925A (en) Terminal device, display system, display method, program, and recording medium
JP6172770B2 (en) Abstract writing support system, information distribution apparatus, abstract writing support method, and program
JP2013201623A (en) Communication control device, communication system, method for controlling communication control device, program for making computer execute the control method, and communication device
WO2016114193A1 (en) Note-taking assistance system, terminal device, note-taking assistance method, and computer-readable recording medium
JP5892598B2 (en) Spoken character conversion work support device, phonetic character conversion system, phonetic character conversion work support method, and program
US20170314952A1 (en) Information provision system, information provision method, and management device
JP5846649B2 (en) Abstract writing support system, distribution device, abstract writing support method, and program
CN114648989A (en) Voice information processing method and device implemented in electronic equipment and storage medium
JP2014203324A (en) Summary writing support system, summary writing support server, support method and program for summary writing
JP6494002B2 (en) Abstract writing learning support system, abstract writing learning support device, abstract writing learning support method, and program
JP2020119043A (en) Voice translation system and voice translation method
KR20200053242A (en) Voice recognition system for vehicle and method of controlling the same
JP2019192229A5 (en)
JP6766981B2 (en) Broadcast system, terminal device, broadcasting method, terminal device operation method, and program
US11302344B2 (en) Information processing apparatus, information processing method, and program
US20230096430A1 (en) Speech recognition system for teaching assistance
CN117940993A (en) Speech signal processing device, speech signal reproduction system, and method for outputting a de-emotion speech signal
KR101982501B1 (en) Apparatus for converting jungganbo music into staff notation music, and system and method for managing jungganbo music
JP4465221B2 (en) Speech data summarization system and its program
CN114783440A (en) User interaction assisting method and device, electronic equipment and readable storage medium
US20080107277A1 (en) Classroom sound amplification system
JP2013015939A (en) Understanding support system, support terminal, understanding support method and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16737264

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2016569319

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16737264

Country of ref document: EP

Kind code of ref document: A1