JP2023046910A - earphone system - Google Patents

Abstract

To smoothly re-participate in an online conference temporarily away from the online conference when participating in the online conference, wearing an earphone.SOLUTION: An earphone system comprises: a terminal device that has a communication unit communicating information on an online conference including a voice, and a display unit displaying a content of the online conference; and an earphone that performs radio communication with the terminal device, and is capable of reproducing the voice of the online conference. The earphone is configured to detect whether the earphone is put in a wearing state or in a non-wearing state, and transmit the detection result to the terminal device. The terminal device is configured to, when detecting that the earphone switches from the wearing state to the non-wearing state during progression of the online conference, start recording the voice of the online conference, and when detecting that the earphone switches to the wearing state after starting the recording, overlap the recorded voice on a real-time voice of the online conference to cause the earphone to reproduce the overlapped voice, and causes the display unit to display character information on the recorded voice as the content of the online conference.SELECTED DRAWING: Figure 2

Description

The present invention relates to earphone systems.

A so-called online conference is known as a conference held by a plurality of people (see, for example, Patent Document 1). Unlike face-to-face conferences, online conferences are held by participants from remote locations via terminals and networks.

JP 2018-93315 A

For example, when a participant wears an earphone and participates in an online conference, there may be a case where the participant is asked to remove the earphone to deal with the situation such as being talked to by other people around the participant. In such a case, the contents of the online conference cannot be heard while the earphones are not worn, and when rejoining the conference, it takes time and effort to ask other participants to explain the contents again.

SUMMARY OF THE INVENTION The present invention has been made in view of the above, and provides an earphone system that enables smooth re-participation in a conference from which one has temporarily left, when participating in an online conference wearing earphones. intended to

An earphone system according to the present invention includes a terminal device having a communication unit for communicating information about an online conference including audio and a display unit for displaying content of the online conference, and wireless communication between the terminal device and the online conference. and an earphone capable of reproducing conference audio, wherein the earphone detects whether the earphone is worn or not worn and transmits the detection result to the terminal device, and the terminal device progresses the online conference. start recording the audio of the online conference when detecting that the earphones have switched from the wearing state to the non-wearing state during the recording, and detect that the earphones have switched to the wearing state after the recording is started. In this case, the recorded voice, which is the recorded voice, is superimposed on the real-time voice, which is the ongoing voice of the online conference, and played back on the earphone, and the character information related to the recorded voice is used as the content of the online conference. display on the display.

Advantageous Effects of Invention According to the present invention, when a user wears earphones to participate in an online conference, it is possible to smoothly rejoin the conference after temporarily leaving the conference.

FIG. 1 is a diagram schematically showing an example of an earphone system according to this embodiment. FIG. 2 is a functional block diagram showing an example of the earphone system according to this embodiment. FIG. 3 is a diagram showing an example of how the earphone system according to this embodiment is used. FIG. 4 is a diagram showing an example of how the earphone system according to this embodiment is used. FIG. 5 is a diagram showing an example of a display mode of the display section when using the earphone system according to the present embodiment. FIG. 6 is a flow chart showing an example of the operation flow of the earphone system according to this embodiment. FIG. 7 is a flowchart showing another example of the operation flow of the earphone system according to this embodiment.

An embodiment of an earphone system according to the present invention will be described below with reference to the drawings. In addition, this invention is not limited by this embodiment. In addition, components in the following embodiments include components that can be easily replaced by those skilled in the art, or components that are substantially the same.

FIG. 1 is a diagram schematically showing an example of an earphone system 100 according to this embodiment. FIG. 2 is a functional block diagram showing an example of the earphone system 100 according to this embodiment. As shown in FIGS. 1 and 2 , earphone system 100 includes earphone 10 and terminal device 20 .

The earphone 10 is, for example, a left and right separated wireless earphone, and has a left earphone and a right earphone. The left earphone and the right earphone can communicate with each other wirelessly. The earphone 10 may be used with both the left earphone and the right earphone attached, or may be used with only one of them attached. In this embodiment, the earphone 10 includes a configuration with both a left earphone and a right earphone, and a configuration with one of the left earphone and the right earphone. In this embodiment, descriptions of some configurations and operations, such as individual configurations of the left earphone and the right earphone, specific communication operations between the left earphone and the right earphone, etc., are omitted. At least one of the left earphone and the right earphone may have the configuration of the earphone 10 described below.

The earphone 10 has a speaker 11 , a microphone 12 , an operation section 13 , an attachment/detachment detection section 14 , a communication section 15 , a storage section 16 and a control section 17 . The earphone 10 has a power supply section (not shown) that supplies electric power to each section described above.

The speaker 11 outputs audio information received from the terminal device 20 . A speaker 11 is provided in each of the left earphone and the right earphone.

The microphone 12 collects surrounding sounds and generates sound information. A microphone 12 is provided on at least one of the left earphone and the right earphone.

The operation unit 13 allows the user to input an operation signal to the earphone 10 . The operation unit 13 has, for example, a touch sensor that detects a user's touch. The operation unit 13 can input predetermined operations such as turning on and off the power, reproducing and stopping audio, and the like.

The attachment/detachment detection unit 14 detects the attachment/detachment state of the earphone 10 by the user. The attachment/detachment detection unit 14 can automatically detect a wearing state in which the earphone 10 is worn by the user and a non-wearing state (or removed state) in which the earphone 10 is not worn by the user. The attachment/detachment detection unit 14 transmits the detection result to the control unit 17 . The attachment/detachment detection unit 14 performs the above detection and transmits the detection result, for example, at predetermined time intervals.

The communication unit 15 receives voice information transmitted from the terminal device 20 . The communication unit 15 transmits voice information generated by the microphone 12 to the terminal device 20 . The communication unit 15 transmits and receives authentication information required for authentication to and from the terminal device 20 . The communication unit 15 transmits various information such as the usage status of the earphone 10 to be described later to the terminal device 20 .

The storage unit 16 stores various information. The storage unit 16 has, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). Note that an external storage medium such as a removable medium may be used as the storage unit 16 . The storage unit 16 stores, for example, the authentication information described above.

The control unit 17 has a processing device such as a CPU (Central Processing Unit). The control unit 17 includes an authentication processing unit 31 and a communication control unit 32 .

The authentication processing unit 31 performs authentication processing such as pairing between the earphone 10 and the terminal device 20 . The authentication processing unit 31 stores in the storage unit 16 information on the terminal device 20 to be authenticated.

The communication control unit 32 causes the communication unit 15 to transmit and receive information. When an operation for turning on the power is input through the operation unit 13 , the communication control unit 32 ensures a state in which communication is connected with the terminal device 20 . The communication control unit 32 causes the communication unit 15 to transmit the detection result of the attachment/detachment detection unit 14 , that is, information about whether the earphone 10 is in the wearing state or the non-wearing state (removed state) to the terminal device 20 . The communication control unit 32 causes the terminal device 20 to transmit the detection result each time the attachment/detachment detection unit 14 outputs the detection result.

Examples of the terminal device 20 include various information terminals such as mobile phones, smart phones, tablets, notebook personal computers, and desktop personal computers. The terminal device 20 has an input unit 21 , a display unit 22 , a communication unit 23 , a storage unit 24 and a control unit 25 .

The input unit 21 is capable of a predetermined input operation for inputting information. The input unit 21 outputs an instruction signal to the control unit 25 according to the input operation. As the input unit 21, for example, an input device such as a keyboard or a touch panel is used. As the input unit 21, buttons, levers, dials, switches, or other input devices may be used in addition to or instead of these. The input unit 21 outputs an instruction signal according to a predetermined input operation.

The display unit 22 is, for example, a display panel such as a liquid crystal panel, and displays various information including characters and images.

The communication unit 23 communicates information with the communication unit 15 of the earphone 10 by, for example, short-range wireless communication.

The storage unit 24 stores various information. The storage unit 24 has storage such as a hard disk drive and a solid state drive. Note that an external storage medium such as a removable disk may be used as the storage unit 24 . The storage unit 24 stores the operating system of the terminal device 20, various programs and data for controlling the operations of the input unit 21, the display unit 22, and the communication unit 23, and the like. The storage unit 24 stores an attendance management program for managing the attendance of the user.

The control unit 25 controls each unit of the input unit 21 , the display unit 22 and the communication unit 23 . The control unit 25 has a processing device such as a CPU and a storage device such as RAM or ROM. The control unit 25 has a conference processing unit 51, an authentication processing unit 52, a state detection unit 53, a recording/playback control unit 54, and a display control unit 55, as shown in FIG.

The conference processing unit 51 performs processing related to an online conference using the terminal device 20 . The conference processing unit 51 can perform various processes from the start to the end of an online conference, for example, by executing a known application for conducting an online conference.

The authentication processing unit 52 performs authentication processing such as pairing between the earphone 10 and the terminal device 20 . The authentication processing unit 52 stores information on the earphone 10 to be authenticated in the storage unit 24 .

State detection unit 53 detects the use state of earphone 10 based on information transmitted from earphone 10 . The usage state of the earphone 10 includes a wearing state and a non-wearing state. The worn state is a state in which the earphone 10 and the terminal device 20 are communicably connected and worn by the user. On the other hand, the non-wearing state is a state different from the wearing state, in which the earphone 10 and the terminal device 20 are communicably connected, but the earphone 10 is not worn or removed.

When communication is established between the communication unit 15 and the terminal device 20, the state detection unit 53 detects the usage state (wearing state) of the earphone 10 based on the detection result of the attachment/detachment detection unit 14 received by the communication unit 23. or non-wearing state). The state detection unit 53 performs the above detection, for example, at regular intervals. A state detection unit 53 determines whether the non-wearing state is less than a predetermined time when the earphone 10 is switched to the non-wearing state while the online conference is in progress and then the earphone 10 is switched to the wearing state again. The predetermined time can be set in advance.

The recording/playback control unit 54 starts recording the voice of the online conference when the state detection unit 53 detects that the earphone 10 is switched from the wearing state to the non-wearing state during the online conference. When the state detection unit 53 detects that the earphone 10 has been switched to the worn state after the start of recording, the recording/playback control unit 54 converts the recorded voice to the voice during the online conference. The audio is superimposed on the real-time audio and reproduced by the earphone 10.例文帳に追加

The recording/playback control unit 54 continues recording the voice of the online conference while playing back the recorded voice at a playback speed faster than the progress speed of the real-time voice. The recording/playback control unit 54 can end the recording of the online conference voice when the playback of the recorded voice is completed, that is, when the playback of the recorded voice catches up with the real-time voice of the online conference. Also, the recording/playback control unit 54 can end the recording of the voice of the online meeting when the online meeting ends before the playback of the recorded voice is completed. The recording/playback control unit 54 can determine whether or not the online conference has ended (or is continuing) based on the processing content of the conference processing unit 51, for example.

The recording/playback control unit 54 can store the recorded voice as voice data in the storage unit 24 . The recording/playback control unit 54 may automatically reproduce the recorded voice when switching to the wearing state is detected, or may make a predetermined sound for the terminal device 20 after switching to the wearing state is detected. , the recorded voice may be reproduced based on the voice data stored in the storage unit 24 when the trigger is input. Further, when the earphone 10 switches from the wearing state to the non-wearing state during the online conference and then switches to the wearing state again, the recording/playback control unit 54 determines that the non-wearing state of the earphone 10 exceeds a predetermined time. If so, the recorded voice may not be played back and may be stored in the storage unit 24 as voice data.

The recording/playback control unit 54 converts, for example, recorded voices stored in the storage unit 24 into character information by distinguishing between the participants of the online conference. The recording/playback control unit 54 can use a known voice recognition program, voice-to-character conversion program, or the like when converting the recorded voice into characters. The recording/playback control unit 54 causes the storage unit 24 to store the converted data converted into character information. For example, when a participant speaks in an online conference, the recording/playback control unit 54 detects the time when the speech started, identifies the speaker, and converts the speech start time and the information of the speaker into The character information (utterance content) can be stored in the storage unit 24 in association with the character information (utterance content).

The display control section 55 controls the display operation of the display section 22 . When an online conference is held using the terminal device 20, the display control unit 55 causes the display unit 22 to display the content of the online conference.

The display control unit 55 causes the display unit 22 to display the character information regarding the recorded voice as the content of the online conference when the state detection unit 53 detects that the earphone 10 has been switched to the wearing state after the start of recording.

The display control unit 55 causes the display unit 22 to display a part of the recorded voice converted into text information as content of the online conference for each participant.

The display control unit 55 determines that the earphones 10 of the participants of the online conference are not worn, that the terminal devices 20 of the participants are recording the audio of the online conference, and that the terminal devices of the participants are online. At least one piece of information indicating that the audio of the conference is being reproduced is displayed on the display unit as the content of the online conference.

Next, the manner of use of earphone system 100 configured as described above will be described. Note that the connection between the earphone 10 and the terminal device 20 is in an authenticated state. 3 to 5 are diagrams showing an example of how the earphone system 100 is used. When an online conference is held using the terminal device 20, the display control unit 55 causes the display unit 22 to display the content of the online conference.

When the user inputs an operation to turn on the power to the operation unit 13 of the earphone 10 , the communication control unit 32 secures the short-range wireless communication connection state with the terminal device 20 . Moreover, when the earphone 10 is worn by the user, the attachment/detachment detection unit 14 detects that the earphone 10 is in the wearing state. The communication control unit 32 causes the communication unit 15 to transmit the detection result of the attachment/detachment detection unit 14 to the terminal device 20 .

In the terminal device 20 , the state detection unit 53 detects that the earphone 10 is in a connected state. Also, the communication unit 23 receives the detection result of the attachment/detachment detection unit 14 from the communication unit 15 of the earphone 10 . State detection unit 53 detects that earphone 10 is in the wearing state based on the detection result of attachment/detachment detection unit 14 .

Thereafter, for example, when the earphone 10 is removed by the user, the attachment/detachment detector 14 detects that the earphone 10 has been removed, ie, is in a non-wearing state. The communication control unit 32 causes the communication unit 15 to transmit the detection result of the attachment/detachment detection unit 14 to the terminal device 20 . In the terminal device 20 , the communication section 23 receives the detection result of the attachment/detachment detection section 14 from the communication section 15 of the earphone 10 . State detection unit 53 detects that earphone 10 is in the non-wear state based on the detection result of attachment/detachment detection unit 14 .

As shown in FIG. 3, the recording/playback control unit 54 starts recording the voice of the online conference when it is detected that the earphone 10 is switched from the wearing state to the non-wearing state during the online conference. The recording/playback control unit 54 causes the storage unit 24 to store the recorded voice. The recording/playback control unit 54 converts the voice stored in the storage unit 24 into character information, and causes the storage unit 24 to store the converted data. In addition, the display control unit 55 can cause the display unit 22 to display information 61 to the effect that recording of the voice of the online conference has started.

When the user puts on the earphone 10 again after the earphone 10 has been removed, the attachment/detachment detector 14 detects that the earphone 10 is put on. The communication control unit 32 causes the communication unit 15 to transmit the detection result of the attachment/detachment detection unit 14 to the terminal device 20 . In the terminal device 20 , the communication section 23 receives the detection result of the attachment/detachment detection section 14 from the communication section 15 of the earphone 10 . State detection unit 53 detects that earphone 10 is in the wearing state based on the detection result of attachment/detachment detection unit 14 .

As shown in FIG. 4, when it is detected that the earphone 10 has been switched to the wearing state after the start of recording, the recording/playback control unit 54 superimposes the recorded voice on the real-time voice of the online conference and causes the earphone 10 to play it. . The recording/playback control unit 54 can continue recording the voice of the online conference while playing back the recorded voice at a playback speed faster than the progress speed of the real-time voice. When playing back the recorded voice, the recording/playback control unit 54 may make the volume of the real-time voice lower than the normal volume when the recorded voice is not played so that the user of the earphone 10 can easily hear the recorded voice. .

In addition, the display control unit 55 causes the display unit to display the character information regarding the recorded voice as the contents of the online conference. In this case, the display control unit 55 can cause the display unit 22 to display part of the conversion data stored in the storage unit 24 as character information. For example, the display control unit 55 can cause the display unit 22 to display the character information 62 at the beginning of the recorded voice, as shown in FIG.

After the playback of the recorded voice is started, when the playback of the recorded voice is completed, the recording/playback control unit 54 ends the recording of the voice of the online conference. Further, when the online conference ends before the playback of the recorded voice is completed after the playback of the recorded voice is started, the recording/playback control unit 54 ends the recording of the voice of the online meeting. In this case, the recording/playback control unit 54 determines whether or not the online conference is continuing. When the recording of the voice is finished, the recording/playback control unit 54 generates the recorded voice as voice data and stores it in the storage unit 24 . When the recording of the online conference ends, the display control unit 55 may cause the display unit 22 to display a message to that effect and that the audio data will be stored.

FIG. 5 is a diagram showing another example of the display mode on the display section 22. As shown in FIG. As shown in FIG. 5, the display control unit 55 can cause the display unit 22 to display meeting information 70 regarding the online meeting. The conference information 70 includes user information 71 indicating the user of the terminal device 20, participant information 72 indicating information about participants in the online conference, and history information 73 indicating the speech history of the online conference. The conference information 70 is displayed, for example, on the terminal devices 20 of each participant participating in the online conference.

User information 71 indicates the user of the terminal device 20 . Participant information 72 includes information about participant name 72a and participation status 72b. As the participation state 72b, there is a state of participating in which the user can listen to the content of the online conference using the terminal device 20 and speak, a state of temporarily leaving the terminal device 20, and a state of playing a recorded voice. and a state of being played back. The participant information 72 may include progress information 72c, such as an indicator that visually indicates how far the playback of the recorded voice has progressed, for example, in a playback state. Also, when indicating that playback is in progress in the participation state 72b, information on the playback speed of the recorded voice may be displayed together, such as 2x playback, 1.5x playback, or the like. As a result, the other participants can, for example, know that it is unlikely that they will receive a response even if they talk to Mr. D who is currently playing, and how long it will take to finish playing the recorded voice and catch up with the meeting. It is possible to guess whether it is possible.

The history information 73 includes information about a speech start time 73a, a speaker 73b, and a speech content 73c when a speech is made in an online conference. The history information 73 is displayed based on information generated by the recording/playback control unit 54 and stored in the storage unit 24 when the audio of the online conference is recorded. The display control unit 55 can cause the display unit 22 to display the speech start time 73a, the speaker 73b, and the speech content 73c in chronological order in a state in which they are associated with each other. Further, the display control unit 55 can display, as the statement content 73c, a part of the beginning of the content uttered by each speaker at each time, for example. In this manner, the display control unit 55 can display a list in which the recorded voices are arranged in order of speech start time for each speaker.

In the terminal device 20, it is possible to individually select the content of each speaker's utterance, and reproduce only the selected utterance. In this case, the display control unit 55 may highlight and display the selected statement (shown by the highlight display unit 73d in FIG. 5).

FIG. 6 is a flowchart showing an example of the operation flow of the earphone system 100 according to this embodiment. In the following description, an online conference is held using the terminal device 20, a connection state is secured between the earphone 10 and the terminal device 20, and the earphone 10 is worn. As shown in FIG. 6, the state detection unit 53 detects whether or not the earphone 10 is in the non-wear state based on the detection result of the attachment/detachment detection unit 14 (step S101). When the state detection unit 53 detects that the earphone 10 is in the worn state (No in step S101), the state detection unit 53 repeats the process of step S101. When the state detection unit 53 detects that the earphone 10 is not worn (Yes in step S101), the recording/playback control unit 54 starts recording the voice of the online conference (step S102).

Thereafter, the state detection unit 53 detects whether or not the earphone 10 is again worn based on the detection result of the attachment/detachment detection unit 14 (step S103). When the state detection unit 53 detects that the earphone 10 is in the non-wearing state (No in step S103), the state detection unit 53 repeats the process of step S103. If the state detection unit 53 detects that the earphones 10 are worn (Yes in step S103), the recording/playback control unit 54 superimposes the recorded voice on the real-time voice of the online conference and causes the earphones 10 to play back (step S104). In addition, the display control unit 55 causes the display unit 22 to display the character information regarding the recorded voice as the contents of the online conference (step S105).

The recording/playback control unit 54 determines whether or not the online conference is continuing based on the processing contents of the conference processing unit 51 (step S106). If it is determined that the online conference is continuing (Yes in step S106), the recording/playback control unit 54 determines whether or not the playback of the recorded voice has caught up with the real-time voice of the online conference (step S107). If the recording/playback control unit 54 determines that the playback of the recorded voice has not caught up with the real-time voice of the online conference (No in step S107), it repeats the determination in step S107. If the recording/playback control unit 54 determines in step S106 that the online conference is not continuing (No in step S106), or if it determines in step S107 that the playback of the recorded voice has caught up with the real-time online conference (step S107 Yes), audio recording and playback of the recorded audio are terminated (step S108).

FIG. 7 is a flowchart showing another example of the operation flow of the earphone system 100 according to this embodiment. In this example, a case will be described in which, when recording the voice of an online conference, the recorded voice is stored as voice data. First, steps S101 and S102 are performed in the same manner as in the example shown in FIG. After performing step S102, the recording/playback control unit 54 starts the process of storing the recorded voice as voice data in the storage unit 24 (step S201).

The recording/playback control unit 54 determines whether or not the online conference is continuing (step S202). If it is determined that the online conference is continuing (Yes in step S202), the state detection unit 53 detects whether the earphones 10 are again worn based on the detection result of the attachment/detachment detection unit 14. (Step S203). If it is detected in step S203 that the earphone 10 is not worn (No in step S203), the processes after step S202 are repeated.

When the state detection unit 53 detects that the earphone 10 is in the wearing state (Yes in step S203), the state detection unit 53 determines whether the non-wearing state has been less than a predetermined time (step S204). When it is determined in step S204 that the non-wearing state was less than the predetermined time (Yes in step S204), the operations after step S104 (see FIG. 6) are performed.

On the other hand, when it is determined in step S202 that the online conference is not continuing (No in step S202) and when it is determined in step S204 that the non-wearing state is not less than the predetermined time (No in step S204), recording and reproduction are performed. The control unit 54 ends the storage of the voice data (step S205), and outputs the stored voice data to a file (step S206). As a result, since the audio of the online conference is generated as audio data, the audio of the online conference can be heard at desired timing.

As described above, the earphone system 100 according to the present embodiment includes a terminal device 20 having a communication unit 23 for communicating online conference information including audio and a display unit 22 for displaying the content of the online conference; and an earphone 10 capable of performing wireless communication between and playing back the audio of the online conference, the earphone 10 detects whether the earphone 10 is in a worn state or a non-weared state, and transmits the detection result to the terminal device 20, The terminal device 20 starts recording the voice of the online conference when it detects that the earphone 10 has switched from the wearing state to the non-wearing state during the online conference, and the earphone 10 switches to the wearing state after the start of recording. Real-time audio, which is the ongoing audio of the online conference, is superimposed on the recorded audio, which is the audio that is recorded when the event is detected, is played back on the earphone 10, and character information about the recorded audio is displayed as the contents of the online conference. display on the part 22.

According to this configuration, the voice of the online conference is recorded in the terminal device 20 while the participant wearing the earphone 10 and participating in the online conference is not wearing the earphone 10, and the participant wears the earphone 10 again. When worn, the recorded voice is superimposed on the real-time voice and reproduced by the earphone 10.例文帳に追加Therefore, the participants can easily confirm the content of the online conference. In addition, when the recorded voice is reproduced, the text information related to the recorded voice is displayed on the display unit 22 as the content of the online conference, so that the participants can appropriately understand the recorded voice. As a result, it is possible to smoothly rejoin the conference from which the user has temporarily left.

In the earphone system 100 according to the present embodiment, the terminal device 20 continues recording the audio of the online conference while reproducing the recorded audio at a playback speed faster than the progress speed of the real-time audio. Alternatively, if the online conference ends before the playback of the recorded voice is completed, the recording of the voice of the online meeting is terminated. According to this configuration, it is possible to end the audio recording of the online conference at an appropriate timing.

In the earphone system 100 according to the present embodiment, the terminal device 20 has a storage unit 24 that stores information, and stores recorded voice in the storage unit 24 as voice data. According to this configuration, by storing the recorded voice as voice data, the recorded voice can be listened to at a desired timing, such as after the end of the online conference.

In the earphone system 100 according to the present embodiment, the terminal device 20 can convert the recorded voice into character information separately for each participant of the online conference, and part of the recorded voice converted into the character information can be converted to character information for each participant. is displayed on the display unit 22 as the content of the online conference. According to this configuration, the participants of the online conference can appropriately grasp the content of the recorded voice by looking at the display unit 22 .

In the earphone system 100 according to the present embodiment, the terminal device 20 causes the display unit 22 to display information about the terminal device 20 that is playing the recorded voice among the terminal devices 20 used in the online conference. According to this configuration, other participants can easily grasp the situation of the participant who is listening to the recorded voice, so that the online conference can proceed smoothly.

The technical scope of the present invention is not limited to the above embodiments, and modifications can be made as appropriate without departing from the scope of the present invention. For example, in the above-described embodiment, when character information about recorded voice is displayed on the display unit 22, a configuration in which character information indicating a part of the recorded voice is displayed has been described as an example. The display unit 22 may be configured to display the entire voice as character information. In this case, for example, when the user of the terminal device 20 is temporarily absent, the speech recorded in the terminal device 20 may be emphasized and displayed. In addition, the terminal device 20 may be configured so that the highlighted statement can be selected, and when the earphone 10 is put on again during the online conference, the selected statement may be reproduced.

DESCRIPTION OF SYMBOLS 10... Earphone, 11... Speaker, 12... Microphone, 13... Operation part, 14... Attachment/detachment detection part, 15, 23... Communication part, 16, 24... Storage part, 17, 25... Control part, 20... Terminal device, 21 Input unit 22 Display unit 31, 52 Authentication processing unit 32 Communication control unit 51 Conference processing unit 53 State detection unit 54 Recording/playback control unit 55 Display control unit 61 Information, 62... Text information, 70... Conference information, 71... User information, 72... Participant information, 72a... Participant name, 72b... Participation status, 72c... Progress information, 73... History information, 73b... Speaker, 73c... Speech content, 100... Earphone system

Claims (4)

A terminal device having a communication unit for communicating information of an online conference including audio and a display unit for displaying the content of the online conference, and an earphone capable of reproducing the audio of the online conference by wirelessly communicating with the terminal device. and
the earphone detects whether the earphone is in a wearing state or a non-wearing state and transmits the detection result to the terminal device;
The terminal device starts recording audio of the online conference when it is detected that the earphone is switched from the wearing state to the non-wearing state while the online conference is in progress, and the earphone starts recording after the recording is started. detects that the is switched to the wearing state, the recorded audio is superimposed on the real-time audio that is the ongoing audio of the online conference and played back on the earphone, and the recorded audio An earphone system for displaying character information on the display unit as content of the online conference. The terminal device continues recording the audio of the online conference while reproducing the recorded audio at a reproduction speed faster than the progress speed of the real-time audio, and when the reproduction of the recorded audio is completed or the recorded audio is reproduced. 2. The earphone system according to claim 1, wherein the recording of the voice of the online meeting is ended if the online meeting ends before the completion of the. The terminal device is capable of converting the recorded voice into character information separately for each participant of the online conference, and part of the recorded voice converted into the character information is transferred to the online conference for each participant. 3. The earphone system according to claim 1, wherein the content is displayed on the display unit. 4. The terminal device according to any one of claims 1 to 3, wherein the terminal device causes the display unit to display information of the terminal device that is playing back the recorded voice among the terminal devices used in the online conference. The earphone system described in .

Images