JP2021125006A - Server device, terminal device, simultaneous interpretation voice transmission method, multiplexed voice receiving method, and program - Google Patents

Abstract

To solve a problem in a conventional method that information such as voices in simultaneous interpretation cannot be appropriately distributed to a lecture hall where a speaker and listeners are present and a remote hall where only listeners are present.SOLUTION: A server device comprises a simultaneous interpretation information acquisition unit which acquires simultaneous interpretation information containing voice in simultaneous interpretation generated by simultaneous interpretation, by an interpreter, for spoken voice spoken in a first hall, and a transmission unit which transmits the simultaneous interpretation information to two or more terminal devices 2. The transmission unit includes first communication means for transmitting at least the voice in simultaneous interpretation to terminal devices present in the first hall, and second communication means for transmitting the voice in simultaneous interpretation information to terminal devices present in each of one or more second halls different from the first hall. Consequently, the server device being communication means different from the first communication means and the second communication means can appropriately distribute the information of the voice in simultaneous interpretation and the like to the first hall where a speaker and listeners are present and the second hall where only listeners are present.SELECTED DRAWING: Figure 1

Description

The present invention relates to a server device or the like that transmits information regarding simultaneous interpretation to a terminal device.

Conventionally, the voice data to be interpreted is converted into text data and translated, and the pre-translation text and the post-translation text, which are the text data before and after the translation, are transmitted to the interpreter's terminal. There was a system that supported simultaneous interpretation by (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2016-148943

However, conventionally, information such as simultaneous interpretation voice by an interpreter is accurately provided to a lecture hall where a speaker and a listener are present and a remote venue where only the listener is present (that is, there is no speaker and there is a listener). There was no mechanism to deliver to.

The server device of the first invention has a simultaneous interpretation information acquisition unit that acquires simultaneous interpretation information including simultaneous interpretation voice that the interpreter simultaneously interprets the spoken voice spoken in the first venue, and two simultaneous interpretation information. The transmission unit includes a transmission unit for transmitting to the above terminal devices, and the transmission unit includes a first communication means for transmitting at least simultaneous interpretation voice to the terminal devices existing in the first venue, and one or more different from the first venue. A server device is provided with a second communication means for transmitting simultaneous interpretation information to the terminal devices existing in each of the second venues, and the first communication means and the second communication means are different communication means. be.

With such a configuration, information such as simultaneous interpretation voice can be accurately distributed to the first venue where the speaker and the listener are present and the second venue where only the listener is present.

Further, in the server device of the second invention, with respect to the first invention, the first communication means is a server device which is a communication means having a lower delay than the second communication means.

With such a configuration, at least the simultaneous interpretation voice can be delivered to the first venue where the speaker and the listener are present, with a low delay with respect to the spoken voice.

Further, the server device of the third invention is a server device which is a higher quality communication means than the first communication means with respect to the first or second invention.

With such a configuration, simultaneous interpretation information including information other than simultaneous interpretation audio, such as a video in the first venue, can be delivered to the second venue where only listeners are present, with high quality.

Further, the server device of the fourth invention is a server device that transmits different information from the first communication means and the second communication means to any one of the first to third inventions.

With such a configuration, at least simultaneous interpretation voice can be delivered to the first venue where the speaker and the listener are present, with a low delay with respect to the spoken voice, while information other than the simultaneous interpretation voice can be delivered to the second venue where only the listener is present. Simultaneous interpretation information including the above can be delivered with high quality.

Further, the server device of the fifth invention further includes a video acquisition unit for acquiring a video captured in the first venue for the fourth invention, and the simultaneous interpretation information includes the video, and the first The communication means is a server device that does not transmit video but transmits simultaneous interpretation audio, and the second communication means is a server device that transmits simultaneous interpretation audio and video.

With such a configuration, at least simultaneous interpretation voice can be delivered to the first venue where the speaker and the listener are present, with a low delay with respect to the spoken voice, while the video in the first venue can be delivered to the second venue where only the listener is present. Simultaneous interpretation information including the above can be delivered with high quality.

Further, the server device of the sixth invention has the simultaneous interpretation information acquired by the simultaneous interpretation information acquisition unit and the flag indicating either public or private for any one of the first to fifth inventions. When the simultaneous interpretation-related information storage unit that stores the simultaneous interpretation-related information, the inspection unit that inspects the flag, and the inspection result of the flag of the inspection unit are the inspection results that the simultaneous interpretation information is disclosed, the flag is displayed. It is a server device further provided with an upload unit that uploads information related to simultaneous interpretation to an external server.

With such a configuration, disclosure / non-disclosure of simultaneous interpretation information can be managed.

Further, in the server device of the seventh invention, for any one of the first to sixth inventions, the simultaneous interpretation information is the uttered voice or the uttered voice in one or more interpreters at the same time in different languages. A first communication means and a second communication means and a second communication unit are further provided with a multiplexing unit that includes two or more voices of one or two or more simultaneous translation voices that have been translated, multiplexes two or more voices, and acquires the multiplexed voices. One or more of the communication means is a server device that transmits the multiplexed voice to one or more terminal devices.

With such a configuration, simultaneous interpretation audio in multiple languages can be distributed.

Further, the server device of the eighth invention further includes an advertisement information storage unit for storing advertisement information which is advertisement information for any one of the first to seventh inventions, and the first communication. One or more of the means and the second communication means is a server device that transmits the advertisement information to one or more terminal devices.

With such a configuration, advertising information can be accurately delivered. In addition, the advertiser can obtain an advertising fee that is a source of rewards to the parties concerned.

Further, the server device of the ninth invention stores a reward calculation information for calculating a reward to two or more related parties involved in the transmission of simultaneous interpretation information for the eighth invention. It is a server device further including an information storage unit, a remuneration calculation unit that calculates remuneration for each of two or more related parties using remuneration calculation information, and a remuneration output unit that outputs remuneration information that specifies remuneration. ..

With this configuration, the rewards for each of two or more parties can be calculated automatically.

Further, in the server device of the tenth invention, for the ninth invention, two or more persons concerned include an interpreter, and the compensation calculation information is an interpreter compensation for calculating the compensation to the interpreter. The remuneration calculation unit, which includes calculation information, is a server device that calculates remuneration for the interpreter using the interpreter remuneration calculation information.

With such a configuration, the reward for the interpreter can be calculated automatically.

Further, in the server device of the eleventh invention, the interpreter provision time information for specifying the length of the period during which the simultaneous interpretation information is transmitted by the transmission unit and the simultaneous interpretation information by the transmission unit are used for the tenth invention. It is further equipped with an interpreter attribute value acquisition unit that acquires one or more interpreter attribute values from the number of interpreter beneficiary information that specifies the number of terminal devices to which the information is sent, and the reward calculation unit has one or more interpreter attribute values. It is a server device that calculates the compensation to the interpreter using.

With such a configuration, the reward for the interpreter can be calculated accurately.

In the above configuration, it is preferable that the remuneration calculation unit obtains a higher remuneration, for example, the longer the interpreter provision time information indicates and the larger the number of interpreter beneficiary information indicates.

Further, in the server device of the twelfth invention, for any one of the eighth to eleventh inventions, the advertisement information storage unit has two or more advertisement information associated with a language identifier that identifies a language. Corresponds to the language identifier acquisition unit that acquires the language identifier that identifies the language of the simultaneous interpretation voice transmitted by the transmission unit, and the language identifier acquired by the language identifier acquisition unit out of two or more advertising information. It further includes an advertisement information selection unit for selecting the advertisement information, and the transmission unit advertises to one or more terminal devices by using one or more communication means of the first communication means and the second communication means. This is a server device that transmits the advertisement information selected by the information selection unit.

With such a configuration, the effectiveness of the advertisement can be enhanced.

Further, the terminal device of the thirteenth invention demultiplexes the terminal receiving unit that receives the multiplexed voice transmitted from the server device of the seventh invention and the multiplexed voice received by the terminal receiving unit, 2 It is a terminal device including a demultiplexing unit that acquires the above-mentioned voice and a terminal output unit that outputs one or more voices out of two or more voices.

With such a configuration, it is possible to receive simultaneous interpretation audio in multiple languages and output simultaneous interpretation audio in one or more languages.

Further, the terminal device of the fourteenth invention further includes a voice selection unit for selecting one voice out of two or more voices with respect to the thirteenth invention, and the terminal output unit is one voice. It is a terminal device that outputs.

With such a configuration, it is possible to receive the simultaneous interpretation voice of multiple languages and selectively output the simultaneous interpretation voice of one language.

According to the present invention, information such as simultaneous interpretation voice can be accurately distributed to the first venue where the speaker and the listener are present and the second venue where only the listener is present.

Conceptual diagram of the information system in the embodiment Block diagram of the information system Block diagram of the server device Part of the flowchart explaining the operation of the server device Other parts of the flowchart explaining the operation of the server device Other parts of the flowchart explaining the operation of the server device Flow chart explaining the operation of the terminal device Data structure diagram of the same venue type information group Data structure diagram of the same user information group Diagram showing the contents of the advertisement information storage unit Data structure diagram of the remuneration calculation information Diagram showing an output example of the reward information Data structure diagram of information related to simultaneous interpretation External view of the computer system Diagram showing an example of the internal configuration of the computer system

Hereinafter, embodiments of the interpreting system will be described with reference to the drawings. In addition, since the components with the same reference numerals perform the same operation in the embodiment, the description may be omitted again.

The interpretation system in the present embodiment is a system that delivers simultaneous interpretation voice and the like to the first venue and one or more second venues.

The first venue is a venue where there are speakers and listeners. A speaker is a person who speaks. It can be said that a story is the transmission of information by utterance of a language. The talk in the present embodiment is usually a lecture by one speaker, but may be, for example, a discussion or dialogue by two or more speakers, and the mode is not limited. The speaker is, for example, a speaker, but may be a performer of a public program, a play, or the like, and the type is not limited.

A listener is a person who listens to what the speaker says. The listener is, for example, a visitor to the first venue, but may be a viewer who remotely watches the audio or video of the first venue by Internet distribution or the like.

The first venue is, for example, a lecture venue, but it may be a studio of a public program, a theater, or the like, and any type of venue may be used as long as there are speakers and listeners.

Listening to the speaker's story includes, for example, listening to the speaker's story through an interpreter. An interpreter is a person who interprets. Interpretation means translating into another language (hereinafter, "second language") while listening to the voice of one language (hereinafter, sometimes referred to as "first language"). The first language is the language spoken by the speaker and the language heard by the interpreter. A second language is a language translated by an interpreter and heard by a listener.

The interpreter is usually a simultaneous interpreter, but may be a sequential interpreter. Simultaneous interpretation is a method of interpreting at almost the same time as listening to the speaker. Sequential interpretation is a method in which the speaker's story is divided into appropriate lengths and translated in sequence.

The interpreter usually performs simultaneous interpretation, but may temporarily perform sequential interpretation. However, the only difference between the two is whether the interpreter's translation of the speaker's utterance is delayed by a few words or a few sentences, and sequential interpretation is considered to be a type of simultaneous interpretation. May be good.

Further, there may be two or more interpreters for one speaker, and each interpreter may simultaneously translate the story of one speaker into two or more different languages. The two or more different languages are, for example, two or more languages such as Japanese, English, Chinese, Korean, French, and German, but the types and combinations are not limited.

Each one or more interpreters may be, for example, in the first venue, in a dedicated room (eg, an interpreter room, etc.), or at home, wherever they are. It doesn't matter.

The second venue is a venue different from the first venue, where there are no speakers and only listeners. The second venue is, for example, a remote venue. A remote venue is a venue located away from the first venue. It is preferable that the remote venue is, for example, a venue having equipment (for example, communication equipment, audio equipment, etc.) that enables remote viewing of audio and video of the first venue. Alternatively, the second venue may be, for example, a conference hall, a public transportation such as a train, a home, a company, or the like, and the venue may be of any type or location as long as there are only listeners.

However, in the present embodiment, both the first and second venues need to be places where information such as simultaneous interpretation voice can be received by a terminal device such as a mobile terminal. The terminal device is, for example, a smartphone, a tablet terminal, a mobile phone, a notebook PC, or the like, but the type thereof does not matter. Each venue may be an outdoor venue as long as the information can be received by the terminal.

The simultaneous interpretation voice is data obtained by collecting the voice of the speaker's speech simultaneously translated by the interpreter with a microphone or the like. The simultaneous interpretation voice is, for example, a kind or a part of the simultaneous interpretation information. Simultaneous interpretation information is information related to simultaneous interpretation. The simultaneous interpretation information usually includes the simultaneous interpretation voice described above.

Alternatively, the simultaneous interpretation information may include, for example, multiplexed voice. The multiplexed voice is data obtained by multiplexing two or more voices. The two or more voices may be, for example, one simultaneous interpretation voice with the utterance voice, two or more simultaneous interpretation voices, or two or more simultaneous interpretation voices.

The uttered voice is data obtained by collecting the voice uttered by the speaker with a microphone or the like. The two or more simultaneous interpreting voices are data of two or more voices obtained by simultaneously interpreting the story of one speaker by two or more interpreters. Two or more simultaneous interpretation voices may be referred to as, for example, "multilingual simultaneous interpretation voices". The two or more simultaneous interpretation voices are usually simultaneous interpretation voices of different languages, but may include simultaneous interpretation voices of the same language.

Further, the simultaneous interpretation information may include, for example, an image of the inside of the first venue. The video is usually data of a video of a speaker talking in the first venue taken with a camera or the like. However, the image may be, for example, an image of the entire view including the speaker in the first venue, or an object other than the speaker (for example, a picture or character written on a board, a posted or displayed or projected material, etc. It may be a video of the audience seats, etc.), and the content does not matter.

The moving image is, for example, a moving image, but may be a still image, a frame-by-frame image, or the like, and the mode thereof is not limited. The video is usually accompanied by audio from the first venue, but it does not have to be. The utterance voice described above may be, for example, a voice accompanying a moving image taken in the first venue.

In the following, processing will be described in the case of delivering simultaneous interpretation voice and the like for lectures and solo performances in which only one speaker speaks.

FIG. 1 is a conceptual diagram of an information system according to the present embodiment. This information system includes server devices 1, 2 or more terminal devices 2, speaker devices 3, and 1 or 2 or more interpreter devices 4.

The server device 1 can communicate with each of two or more terminal devices 2, a speaker device 3, and one or more interpreter devices 4 via a network such as a LAN or the Internet, a wireless or wired communication line, or the like. Connected to.

The server device 1 is, for example, a server of an operator who operates an interpreting system. The server is, for example, a cloud server, an ASP server, or the like, but its type and location do not matter.

The terminal device 2 is, for example, a mobile terminal of a user who uses an interpreting system, and may exist in either the first or second venue. The user can be the listener or viewer described above. However, the terminal device 2 may be a stationary terminal, and its type does not matter. The stationary terminal is, for example, a podium in the venue, a tablet terminal installed in each seat, a desktop PC, or the like, but the type is not limited.

The speaker device 3 is a terminal device for a speaker who speaks at a lecture or the like, and exists in the first venue. The speaker device 3 is, for example, a mobile terminal, a microphone, or the like, but may be a stationary terminal, and the type thereof does not matter.

The interpreter device 4 is a terminal device for the interpreter. The interpreter device 4 is, for example, a mobile terminal, a headset, or the like, but may be a stationary terminal, and the type thereof does not matter.

The information system also usually includes one or more cameras 5 that capture the inside of the first venue. The camera 5 is, for example, a built-in camera of the speaker device 3, and mainly captures the speaker. Alternatively, the camera 5 is, for example, a Web camera connected to a network or the like, and may capture a part of the venue including a speaker or the whole including a listener and the like. The camera 5 may be of any type, location, shooting range, etc., as long as it can shoot the inside of the first venue.

In the following, among the two or more terminal devices 2 constituting the information system, one or more terminal devices 2 exist in the first venue, and the other one or more terminal devices 2 are any one of the one or more. (2) It shall exist in the venue. Further, a service in which the server device 1 transmits simultaneous interpretation information to two or more terminal devices 2 to support a user who has difficulty in listening to the language spoken by the speaker may be referred to as an "interpretation service".

FIG. 2 is a block diagram of an information system. As described above, the information system includes server devices 1, 2 or more terminal devices 2, speaker devices 3, and 1 or more interpreter devices 4.

FIG. 3 is a block diagram of the server device 1. The server device 1 includes a storage unit 11, a reception unit 12, a processing unit 13, a transmission unit 14, a reception unit 15, and an output unit 16. The storage unit 11 includes a user information group storage unit 111, a simultaneous interpretation-related information storage unit 112, an advertisement information storage unit 113, and a reward calculation information storage unit 114. The processing unit 13 includes a simultaneous interpretation information acquisition unit 131, a multiplexing unit 132, a video acquisition unit 133, a language identifier acquisition unit 134, an advertisement information selection unit 135, an interpretation attribute value acquisition unit 136, a reward calculation unit 137, and an inspection unit 138. And an upload unit 139. The transmission unit 14 includes a first communication means 141 and a second communication means 142. The output unit 16 includes a reward output unit 161.

The block diagram of the terminal device 2 is included in FIG. The terminal device 2 includes a terminal storage unit 21, a terminal reception unit 22, a terminal transmission unit 23, a terminal reception unit 24, a terminal processing unit 25, and a terminal output unit 26. The terminal storage unit 21 includes a user information storage unit 211. The terminal processing unit 25 includes a demultiplexing unit 251 and a voice selection unit 252.

The storage unit 11 constituting the server device 1 can store various types of information. The various types of information include, for example, a user information group described later, simultaneous interpretation-related information described later, advertising information described later, and reward calculation information described later.

Further, for example, the venue type information group may be stored in the storage unit 11. The venue type information group is a set of one or more venue type information. Venue type information is information indicating the type of venue. The venue type is either the first venue or the second venue.

The venue type information includes, for example, a venue identifier and type information. The venue identifier is information that identifies the venue. The venue is a place where the user is present and where the terminal device 2 is present. The venue identifier is, for example, a venue name, an address, a telephone number, an ID, or the like, but any information that can identify the venue may be used. The type information is information indicating the type of venue. The type information is, for example, a type name such as "first venue" or "second venue", but may be an ID or the like, and its structure does not matter.

In the storage unit 11, for example, one or more venue type information groups may be stored in association with the event identifier. The event identifier is information that identifies an event. An event is an event that is covered by the simultaneous interpretation service. The event is, for example, a lecture, a public program, a play, etc., but the type does not matter. The event identifier is, for example, an event name, an ID, or the like, but any information that can identify the event may be used.

Further, for example, an interpreter information group may be stored in the storage unit 11. The interpreter information group is a set of one or more interpreter information. Interpreter information is information about an interpreter. Interpreter information usually has an interpreter identifier. The interpreter identifier is information that identifies the interpreter. The interpreter identifier is, for example, an e-mail address, a mobile phone number, a name, an ID, or the like, but may be a terminal identifier that identifies the interpreter device 4, or any information that can identify the interpreter. The interpreter information also has, for example, a language identifier that identifies the first language described above and a language identifier that identifies the second language described above.

In the storage unit 11, for example, one or more interpreter information groups may be stored in association with the event identifier.

Further, the storage unit 11 may store, for example, simultaneous interpretation voice described later, simultaneous interpretation information described later, and the like. The storage of the simultaneous interpretation voice and the simultaneous interpretation information is usually temporary storage, and is deleted from the storage unit 11 when the transmission is completed, but it does not have to be deleted. Other information will be explained in a timely manner.

The user information group is stored in the user information group storage unit 111. A user information group is a set of one or more user information. User information is information about a user. The user referred to here is a user of the terminal device 2 and a user who enjoys the interpretation service provided by the interpretation system. The user may be said to be a viewer who views the simultaneous interpretation information distributed by the interpretation system.

The user information usually has a user identifier. The user identifier is information that identifies a user. The user identifier is, for example, a mobile phone number, an e-mail address, or the like, but may be an ID, an address, a name, or the like, and may be any information that can identify the user.

The user identifier may be, for example, a terminal identifier. The terminal identifier is information that identifies the terminal device 2. The terminal identifier is, for example, a MAC address, an IP address, an ID, or the like, but any information that can identify the terminal device 2 may be used.

Further, the user information may have, for example, a venue identifier. The venue referred to here is a place where the user is present and where the terminal device 2 is present.

Further, the user information may have, for example, a language identifier. A language identifier is information that identifies a language. The language referred to here is a language that the user listens to, and is usually a language that the user speaks. The language identifier is, for example, a language name, an ID, or the like, but any information that can identify the language may be used. However, the structure of user information does not matter.

Simultaneous interpretation-related information storage unit 112 stores one or more simultaneous interpretation-related information. Simultaneous interpretation-related information is information related to simultaneous interpretation. Simultaneous interpretation-related information includes, for example, simultaneous interpretation information and a flag. The flag here is information that identifies either public or private. Public means that the simultaneous interpretation information is disclosed, and non-disclosure means that the simultaneous interpretation information is not disclosed. Flags usually correspond to event identifiers. The flag is, for example, information indicating either public or private, and specifically, for example, it may be a numerical value such as "1" corresponding to public or "0" corresponding to private. Alternatively, the flag may be, for example, information attached to either one of the simultaneous interpretation information to be disclosed or the simultaneous interpretation information not to be disclosed, and may not be attached to the other, and the format thereof does not matter.

Publishing is, for example, uploading to an external server. The external server may be, for example, a server that broadcasts (that is, sends to an unspecified number of users). Specifically, the external server is, for example, a YouTube (registered trademark) server, but the type thereof does not matter.

Further, the simultaneous interpretation-related information may have, for example, an event identifier, and its structure does not matter.

In the simultaneous interpretation-related information storage unit 112, for example, one or more simultaneous interpretation-related information may be stored in association with the event identifier.

One or two or more advertisement information is stored in the advertisement information storage unit 113. Advertising information is information related to advertising. The advertisement referred to here is an advertisement for viewers such as simultaneous interpretation audio. The target of the promotion is, for example, a product or service, but it may be a company, a brand, or the like, and the type is not limited. Advertising information usually includes audio and video, but may include, for example, one of audio or video and not the other.

The advertisement information storage unit 113 stores, for example, two types of advertisement information, that is, first advertisement information for viewers in the first venue and second advertisement information for viewers in the second venue. It may have been. For example, the first advertisement information may not include video but may include audio, and the second advertisement information may include audio and video.

In the advertisement information storage unit 113, for example, two or more advertisement information may be stored in association with the language identifier.

The remuneration calculation information is stored in the remuneration calculation information storage unit 114. The remuneration calculation information is information for calculating the remuneration to one or more related parties. A person concerned is a person who is involved in the transmission of simultaneous interpretation information. The persons concerned are, for example, an operator and an interpreter, but any person involved in the transmission of simultaneous interpretation information, such as a staff member in each venue and an operator of the server device 1, may be used.

The remuneration calculation information includes, for example, interpreter remuneration calculation information. The interpreter remuneration calculation information is information for calculating the remuneration for the interpreter. The remuneration calculation information also includes, for example, operator remuneration calculation information. The operator remuneration calculation information is information for calculating the remuneration to the operator. The remuneration calculation information may include, for example, staff remuneration calculation information for calculating the remuneration to the staff, and the composition thereof does not matter.

The remuneration calculation information has, for example, a related party identifier and an increasing function having one or more interpreter attribute values as parameters. The related party identifier is information that identifies the related party. The related party identifier is, for example, the name of the related party such as "interpreter" or "operator", but it may be an ID or the like, and any information that can identify the related party may be used.

The interpreter attribute value is a value indicating the attribute of the interpreter. The interpreter attribute value is, for example, interpreter provision time information. The interpreter provision time information is information that specifies the length of the period during which the simultaneous interpretation information is transmitted by the transmission unit 14 (hereinafter, may be referred to as “interpretation provision time”). Alternatively, the interpreter attribute value may be, for example, information on the number of interpreter recipients. The interpretation beneficiary number information is information for specifying the number of terminal devices 2 (hereinafter, “interpretation beneficiary number”) to which the transmission unit 14 transmits the simultaneous interpretation information.

The increasing function is, for example, an increasing function whose parameters are one or more interpreter attribute values of the interpreter provision time information and the number of interpreter beneficiaries information. Specifically, the increasing function may be, for example, “α × interpreter provision time + β × number of interpreter beneficiaries”. Here, the coefficient α to be multiplied by the interpreter provision time information is, for example, "hourly wage", and the coefficient β to be multiplied by the number of interpreter enjoyers information is, for example, "additional amount per viewer". The attribute of is not limited.

And usually, one or more of the coefficient α and the coefficient β differs depending on the persons concerned. For example, the set of coefficients (α1, β1) corresponding to the operator is (0 yen, 100 yen), and the set of coefficients corresponding to the interpreter (α2, β2) is (2000 yen, 10 yen), which corresponds to the staff. The set of coefficients (α3, β3) may be (1000 yen, 0 yen) or the like. However, the numerical value of each coefficient does not matter.

Specifically, the operator fee calculation information is, for example, "(operator, α1 x interpreter provision time + β1 x number of interpreter recipients)", and the interpreter fee calculation information is, for example, "(interpreter, α2). × Interpreter provision time + β2 × Number of interpreter recipients) ”may be used. Then, for example, in the storage unit 11, the first coefficient information “(0 yen, 100 yen)” indicating the set of coefficients (α1, β1) corresponding to the operator and the set of coefficients (α2, corresponding to the interpreter) are stored. The second coefficient information (2000 yen, 10 yen) indicating β2) may be stored.

The increasing function constituting the reward calculation information may be replaced with, for example, a set of paired information (paired information group) which is a pair of a pair of the interpreter provision time information and the number of interpreter beneficiaries information and the reward. In this case, even in the same set of interpreter provision time information and the number of interpreter beneficiaries information, the reward paired with the set usually differs depending on the persons concerned.

Alternatively, the remuneration calculation information may be, for example, a set of a pair of a related party identifier and a ratio information. The ratio information is information that specifies the ratio of the remuneration to the relevant parties to the total remuneration to the two or more related parties. The total reward may be, for example, an advertising fee from an advertiser or a part thereof. The reward calculation information may be, for example, "(operator, X% of advertising fee), (interpreter, Y% of advertising fee), ...".

The ratio information may have, for example, a fixed amount portion and an additional portion. For example, the ratio information paired with the related party identifier "interpreter" may be "10,000 yen + Z% of the advertising fee" or the like.

Note that X, Y, and Z in the above example are, for example, 4, 5, 2, and so on, respectively, but the respective numerical values do not matter. Further, X is expressed in the form of a sufficiency rate and Y and Z are expressed in the form of a percentage, but for example, they may be expressed in a numerical value of 0 or more and 1 or less, and each form may be used. A numerical value expressed in a format such as a sufficiency rate is converted into a numerical value of 0 or more and 1 or less in order to multiply the advertising fee. For example, the numerical values 4, 5, and 2 in the above example are converted into 0.4, 0.05, and 0.02, respectively.

The reward calculation information may be, for example, a table in which two or more numerical ranges relating to one interpreter attribute value and two or more rewards corresponding to each of the two or more numerical ranges are registered. The table is, for example, a first table in which two or more numerical ranges relating to the interpreter provision time and two or more first rewards corresponding to each of the two or more numerical ranges are registered, and two or more tables relating to the number of interpreter beneficiaries. May include a second table in which two or more second rewards corresponding to each of the two or more numerical ranges are registered. The reward may be the sum of the first reward and the second reward.

In addition, the reward calculation information may be a learning device by machine learning, etc., regardless of the type. The learner may be constructed by a machine learning algorithm, for example, using a set of one or more sets of interpreter attribute values and rewards as teacher data. The machine learning algorithm is, for example, deep learning, random forest, decision tree, SVM, etc., but the type is not limited.

The receiving unit 12 receives various types of information. The various types of information include, for example, simultaneous interpretation voice, utterance voice, and video.

The receiving unit 12 receives the simultaneous interpretation voice from each of one or more interpreter devices 4. The receiving unit 12 receives the simultaneous interpretation voice from each of the one or more interpreter devices 4 in pairs with, for example, the interpreter identifier or the information of one or more of the language identifiers that identify the second language described above. You may.

The receiving unit 12 usually receives the uttered voice from the speaker device 3. The uttered voice may be transmitted / received as a pair with, for example, one or more information of the speaker identifier or the language identifier that identifies the first language described above.

The receiving unit 12 may also receive video from the speaker device 3, for example. However, the video may be received from a Web camera or the like installed at the first venue, and the source thereof does not matter.

The receiving unit 12 may receive user information from, for example, one or more terminal devices 2. The user information may be transmitted / received to / from the terminal identifier, for example. Alternatively, the user identifier included in the user information may be a terminal identifier.

The processing unit 13 performs various processes. The various processes include, for example, simultaneous interpretation information acquisition unit 131, multiplexing unit 132, video acquisition unit 133, language identifier acquisition unit 134, advertisement information selection unit 135, interpretation attribute value acquisition unit 136, reward calculation unit 137, and inspection. This is the processing of unit 138, upload unit 139, and the like.

The processing unit 13 also performs processing (for example, buffering) for accumulating information such as simultaneous interpretation voice received by the receiving unit 12 in the storage unit 11.

Further, the processing unit 13 also performs a process of accumulating the information acquired by the simultaneous interpretation information acquisition unit 131 in the storage unit 11 by using the information such as the simultaneous interpretation voice stored in the storage unit 11, for example.

Further, the processing unit 13 uses, for example, the simultaneous interpretation information acquired by the simultaneous interpretation information acquisition unit 131 or stored in the storage unit 11, and the flags and event identifiers received by the reception unit 15, and the simultaneous interpretation-related information. Is also configured, and processing for accumulating in the simultaneous interpretation-related information storage unit 112 is also performed.

Specifically, for example, when the transmission of the simultaneous interpretation voice or the like by the transmission unit 14 is completed, the processing unit 13 requests the input of the flag indicating either public or private and the event identifier via the output unit 16. The flag and the event identifier input in response to the request are received via the reception unit 15, and the simultaneous interpretation-related information having the acquired simultaneous interpretation information and the accepted flag is configured. The configured simultaneous interpretation-related information is stored in the simultaneous interpretation-related information storage unit 112 in association with the received event identifier.

The flags and event identifiers that make up the simultaneous interpretation-related information are input by the operator, for example, but may be received from the terminal device of the event organizer or the like. Alternatively, only the flag may be input by the operator or the like, and the event identifier may be automatically assigned by the processing unit 13. However, the method of acquiring the event identifier does not matter. Further, when only one event is targeted by the simultaneous interpretation service, the event identifier may be omitted.

Alternatively, the flag or the like may be accepted, for example, before the transmission of the simultaneous interpretation voice or the like is started. For example, the flag and the event identifier are input by the operator or the like before the transmission of the simultaneous interpretation voice or the like is started, and the processing unit 13 accepts the input flag and the event identifier via the reception unit 12 and stores the input unit. It may be accumulated in 11. Then, for example, after the transmission of the simultaneous interpretation voice or the like is completed, the processing unit 13 may configure the simultaneous interpretation-related information by using the simultaneous interpretation information, the flag, and the event identifier stored in the storage unit 11. good.

However, the flag or the like may be received, for example, during transmission of the simultaneous interpretation voice or the like, and the timing at which the reception unit 12 accepts the input of the flag or the like does not matter.

Further, the simultaneous interpretation-related information is configured in response to the reception of an instruction to configure the simultaneous interpretation-related information, for example, after the transmission of the simultaneous interpretation voice or the like is completed and the flag or the like is input. You may.

Alternatively, the simultaneous interpretation-related information may be configured according to the reception of a flag or the like during transmission of, for example, simultaneous interpretation voice or the like. Alternatively, for example, the storage unit 11 stores a flag or the like received before the start of transmission of the simultaneous interpretation voice or the like, and if the flag or the like is input, the timing of configuring the simultaneous interpretation-related information or The trigger does not matter.

Further, the processing unit 13 also performs processing such as various determinations described in the flowchart. Other processes will be described in a timely manner.

The simultaneous interpretation information acquisition unit 131 acquires simultaneous interpretation information. As mentioned above, the simultaneous interpretation information includes simultaneous interpretation voice or multiplexed voice. In addition, the simultaneous interpretation information usually includes a video. Further, the simultaneous interpretation information may include, for example, speaker voice.

For example, the processing unit 13 has one or more simultaneous interpretation voices received by the receiving unit 12, the multiplexed voice acquired by the multiplexing unit 132, the video acquired by the video acquisition unit 133, the speaker voice received by the receiving unit 12, and the like. The information is stored in the storage unit 11 (for example, buffering), and the simultaneous interpretation information acquisition unit 131 uses the information such as the simultaneous interpretation voice stored in the storage unit 11 to perform such processing. Acquire simultaneous interpretation information in real time.

The multiplexing unit 132 multiplexes two or more voices. As described above, the two or more voices are, for example, two or more simultaneous interpretation voices, but may be one simultaneous interpretation voice and a speaker voice, or two or more simultaneous interpretation voices and one speaker voice. ..

Multiplexing is a process of converting two or more voices into a mode in which they can be transmitted on one transmission line. The multiplexing includes, for example, frequency division multiplexing (FDM), time division multiplexing (TDM), code division multiplexing (CDM), spatial division multiplexing (SDM), and the like, but the method is not limited. The two or more voices to be multiplexed include, for example, an uttered voice and one or more simultaneous interpretation voices, but may include two or more simultaneous interpretation voices without including the utterance voice. Although each voice is usually a digital data stream, it may be an analog signal, and its mode does not matter.

The multiplexing unit 132 usually multiplexes two or more voices received by the receiving unit 12. For example, the receiving unit 12 may receive the speaker voice and one simultaneous interpretation voice, and the multiplexing unit 132 may multiplex the utterance voice and the one simultaneous interpretation voice. Alternatively, the receiving unit 12 may receive two or more simultaneous interpretation voices, and the multiplexing unit 132 may multiplex the two or more simultaneous interpretation voices. Alternatively, the receiving unit 12 may receive the utterance voice and two or more simultaneous interpretation voices, and the multiplexing unit 132 may multiplex the utterance voice and the two or more simultaneous interpretation voices.

However, for example, in the case of BGM played by a player (not shown), voices other than those received by the receiving unit 12 may be multiplexed, and the types and combinations of two or more voices to be multiplexed may be limited. ..

For example, the processing unit 13 is performing a process of accumulating (for example, buffering) two or more received voices in the storage unit 11, and the simultaneous interpretation information acquisition unit 131 is stored in the storage unit 11. Multiplexed voices are acquired in real time using two or more voices.

The image acquisition unit 133 acquires an image of the inside of the first venue via the camera 5. The image acquisition unit 133 may, for example, receive the image of the speaker taken by the built-in camera of the speaker device 3 together with the speaker sound from the speaker device 3. Alternatively, the video acquisition unit 133 may receive, for example, a part or the whole video of the venue from one or more Web cameras provided in the first venue.

The language identifier acquisition unit 134 acquires a language identifier that identifies the language of the simultaneous interpretation voice transmitted by the transmission unit 14. The language identifier acquisition unit 134 receives the language identifier in pairs with the simultaneous interpretation voice from the interpreter device 4, which is the terminal device of the interpreter, via, for example, the reception unit 12.

Alternatively, for example, the above-mentioned interpreter information group is stored in the storage unit 11, the receiving unit 12 receives the simultaneous interpretation voice from the interpreter device 4 in pairs with the interpreter identifier, and the language identifier acquisition unit 134 receives the simultaneous interpretation voice. , The language identifier corresponding to the received interpreter identifier may be obtained from the stored interpreter information.

Alternatively, for example, the storage unit 11 stores a set of pairs of one or more feature quantities (hereinafter, may be referred to as a feature quantity group) related to the utterance characteristics and the language identifier, and the processing unit 13 simultaneously stores the set. The feature quantity group is extracted from the simultaneous interpretation voice included in the simultaneous interpretation information acquired by the interpretation information acquisition unit 131. The language identifier acquisition unit 134 may acquire a language identifier paired with the feature quantity group that most closely resembles the extracted feature quantity group from the storage unit 11.

When the simultaneous interpretation information includes the utterance voice and one or more simultaneous interpretation voices, the language identifier acquisition unit 134 acquires the language identifier for each of the utterance voice and one or more simultaneous interpretation voices included in the simultaneous interpretation information. It is preferable to do so.

The advertisement information selection unit 135 selects the advertisement information corresponding to the language identifier acquired by the language identifier acquisition unit 134 from among the two or more advertisement information stored in the advertisement information storage unit 113.

For example, when the language identifier acquisition unit 134 acquires the language identifier "English", the advertisement information selection unit 135 corresponds to the acquired language identifier "English" among the two or more stored advertisement information. Get ads.

When the simultaneous interpretation information includes a spoken voice and one or more simultaneous interpretation voices, the advertisement information selection unit 135 is a language identifier acquisition unit for each of the spoken voices and one or more simultaneous interpretation voices included in the simultaneous interpretation information. It is preferable to acquire the advertisement information corresponding to the language identifier acquired by 134.

Specifically, for example, the simultaneous interpretation information includes a spoken voice and one simultaneous interpretation voice, and the language identifier acquisition unit 134 acquires the language identifier "Japanese" for the speaker voice, and one simultaneous interpretation. When the language identifier "English" was acquired for the interpreter voice, the advertisement information selection unit 135 acquired the advertisement information corresponding to the language identifier "Japanese" acquired for the speaker voice and one simultaneous interpreter voice. Select the advertising information corresponding to the language identifier "English".

The advertisement information selection unit 135 acquires, for example, one or more advertisement information selected as described above from the advertisement information storage unit 113 and delivers it to the transmission unit 14. Alternatively, information (for example, a file name, an ID, etc.) that identifies each of the selected one or more advertisement information may be passed to the transmission unit 14.

The interpreter attribute value acquisition unit 136 acquires one or more interpreter attribute values out of the interpreter provision time information and the number of interpreter enjoyers information. As described above, the interpretation provision time information is information that specifies the length of the period during which the simultaneous interpretation information is transmitted by the transmission unit 14, and the interpretation recipient number information is the simultaneous interpretation information by the transmission unit 14. This is information for specifying the number of terminal devices 2 to be transmitted to.

The interpreter attribute value acquisition unit 136 acquires, for example, the current time according to the start of transmission, acquires the current time according to the end of transmission, and calculates the difference between the two acquired current times. The current time is acquired from, for example, the built-in clock of the MPU, but it may be acquired from an NTP server or the like, and the acquisition destination does not matter.

For example, the interpreter provision time information may be stored in advance in the storage unit 11, and the interpreter attribute value acquisition unit 136 may acquire the interpreter provision time information from the storage unit 11. Information on the number of interpreter recipients may be obtained in the same manner.

Further, the interpreter attribute value acquisition unit 136 acquires the number of interpreter enjoyers information by counting the number of two or more user information stored in the user information group storage unit 111, for example.

The interpreter attribute value acquisition unit 136 may acquire, for example, information on the number of first interpreter beneficiaries and information on the number of second interpreter beneficiaries. The first interpreter beneficiary number information specifies the number of terminal devices 2 (hereinafter, may be referred to as "first interpreter beneficiary number") to which the simultaneous interpretation voice is transmitted by the first communication means 141. Information. The second interpreter beneficiary number information is information for specifying the number of terminal devices 2 (hereinafter, “second interpreter beneficiary number”) to which the simultaneous interpretation information is transmitted by the second communication means 142.

For example, the venue identifier is stored in the user information group storage unit 111 in association with each of two or more user information, and the storage unit 11 is a set of venue type information which is a set of the venue identifier and the type information (hereinafter,). (Sometimes referred to as "venue type information group") is stored. The interpreter attribute value acquisition unit 136 counts the number of user information corresponding to the venue identifier paired with the identification information indicating the first venue among the two or more stored user information, thereby performing the first interpreter. Obtain information on the number of beneficiaries. Further, the interpreter attribute value acquisition unit 136 counts the number of user information corresponding to the venue identifier that is paired with the identification information indicating the second venue among the two or more stored user information. (2) Obtain information on the number of interpreter recipients.

The second interpreter beneficiary number information may be obtained, for example, by subtracting the first interpreter beneficiary number information from the interpreter beneficiary number information acquired as described above.

It is preferable that the interpreter attribute value acquisition unit 136 acquires information on the number of interpreter recipients for each of one or more interpreters, for example.

Specifically, for example, the above-mentioned interpreter information group is stored in the storage unit 11, and the interpreter attribute value acquisition unit 136 stores one or two or more interpreter information constituting the interpreter information group. Perform the following processing. That is, the translation attribute value acquisition unit 136 acquires a language identifier that identifies the second language from the interpreter information, and acquires the language identifier among the two or more user information stored in the user information group storage unit 111. Count the number of user information that has a language identifier. Then, the interpreter attribute value acquisition unit 136 acquires an interpreter identifier from the interpreter information, and has information on the number of interpreter beneficiaries having the acquired interpreter identifier and the result of the count (hereinafter, "enjoyment by interpreter"). It may be described as "personal information").

As a result, information on the number of beneficiaries by one or more interpreters (hereinafter, may be referred to as "information group on the number of beneficiaries by interpreter") is acquired. The processing unit 13 stores the acquired information group on the number of beneficiaries by interpreter in the storage unit 11.

The remuneration calculation unit 137 calculates the remuneration for each of two or more related parties by using the remuneration calculation information stored in the remuneration calculation information storage unit 114.

The use of the remuneration calculation information includes, for example, the case where one or more interpreter attribute values of the interpreter provision time information or the number of interpreter beneficiaries information and the stored remuneration calculation information are used (reward calculation method 1).

In the case of the remuneration calculation method 1, the remuneration calculation unit 137 usually acquires the remuneration information indicating a higher remuneration as the time indicated by the interpreter provision time information is longer and the number indicated by the number of interpreter beneficiary information is larger. Specifically, the reward calculation information stored in the reward calculation information storage unit 114 is, for example, a set of pairs of a related party identifier and an increasing function as described above. This kind of reward calculation information is, for example, "(operator, α1 x interpreter provision time + β1 x number of interpreter recipients), (interpreter, α2 x interpreter provision time + β2 x number of interpreter recipients) ..." There may be.

The remuneration calculation unit 137 uses, for example, the remuneration calculation information and one or more information of the interpretation provision time information and the number of interpreter beneficiaries information acquired by the interpreter attribute value acquisition unit 136, and each of two or more relationships. Calculate the remuneration for each person. The remuneration for each party is calculated as follows, for example.

The remuneration calculation unit 137 uses the acquired interpreter provision time information, the acquired interpreter enjoyment number information, and the operator remuneration calculation information constituting the stored remuneration calculation information to reward the operator. Is calculated. For example, when the operator's remuneration calculation information is (operator, α1 × interpreter provision time + β1 × number of interpreter beneficiaries), the remuneration calculation unit 137 obtains the interpreter provision time information and the acquired interpreter beneficiary number information. Is substituted into the increasing function "α1 x interpreter provision time + β1 x number of interpreter beneficiaries" possessed by the operator's remuneration calculation information to calculate the remuneration to the operator.

In addition, the remuneration calculation unit 137 calculates the remuneration to the interpreter by using the acquired interpreter provision time information, the acquired interpreter enjoyment number information, and the interpreter remuneration calculation information constituting the remuneration calculation information. do. For example, when the interpreter fee calculation information is (interpreter, α2 × interpreter provision time + β2 × number of interpreter beneficiaries), the remuneration calculation unit 137 obtains the interpreter provision time information and the acquired interpreter beneficiary number information. Is substituted into the increasing function "α2 x interpreter provision time + β2 x number of interpreter beneficiaries" in the interpreter fee calculation information to calculate the interpreter's fee.

Specifically, for example, assuming that the acquired interpreter provision time information is "2 hours" and the acquired interpreter enjoyer number information is "2000 people", the first stored in the storage unit 11. Using the coefficient information "(α1 = 0 yen, β1 = 100 yen)" and the second coefficient information "(α2 = 2000 yen, β2 = 10 yen)", the reward to the operator is "0 yen x 2 hours". It is calculated as "+100 yen x 2000 people = 200,000 yen", and the reward for the interpreter is calculated as "2000 yen x 2 hours + 10 yen x 2000 people = 24,000 yen".

The portion of the above remuneration corresponding to the number of interpreter beneficiaries may be calculated using the number of first interpreter beneficiaries and the number of second interpreter beneficiaries. That is, for example, in the above-mentioned compensation calculation information "(operator, α1 x interpreter provision time + β1 x number of interpreter recipients), (interpreter, α2 x interpreter provision time + β2 x number of interpreter recipients) ...", "β1 The “number of interpreter beneficiaries” may be “β11 × number of first interpreter beneficiaries + β12 × number of second interpreter beneficiaries”. Similarly, "β2 x number of interpreter beneficiaries" may be "β21 x number of first interpreter beneficiaries + β22 x number of second interpreter beneficiaries". This makes it possible to calculate the reward even more accurately.

If the interpreter fee calculation information is a pair of information groups, which is a set of the interpreter provision time information, the number of interpreter enjoyers information, and the reward, as described above, the reward calculation unit 137 is acquired. The interpreter may be reimbursed by acquiring the remuneration paired with the pair of the interpreter provision time information and the acquired number of interpreter beneficiaries information from the information group. The paired reward is, for example, the same as or most similar to the pair of the acquired interpreter provision time information and the acquired interpreter beneficiary number information among one or more paired information constituting the paired information group. It is a reward corresponding to the paired information having a set of the interpreter provision time information and the interpreter provision time information.

Specifically, for example, the information group corresponding to the operator is "{(Null, 1000 people), 100,000 yen}, (Null, 2000 people), 200,000 yen}, ...", and an interpreter. Assuming that the provision time information "2 hours" and the number of interpreter enjoyers information "2000" are acquired, the reward to the interpreter is the group (2 hours, 2000 people) that matches the acquired group (2 hours, 2000 people). , 2000 people) is calculated as "200,000 yen".

In addition, the information group corresponding to the interpreter is "{(1 hour, 1000 people), 12,000 yen}, (1 hour, 2000 people), 22,000 yen}, ... (2 hours, 1000 people), 14,000 yen}, (2 hours, 2000 people), 24,000 yen} ... ”, and the interpreter provision time information“ 2 hours ”and the number of interpreter recipients“ 1800 people ” Assuming that is acquired, the reward for the interpreter will be "24,000 yen", which is paired with the group (2 hours, 2000 people) that is closest to the acquired group (2 hours, 1800 people). It is calculated.

When there are two or more interpreters, the remuneration calculation unit 137 calculates the remuneration for each of the two or more interpreters, for example, in the same manner as described above. However, it is preferable that the portion of the remuneration for each of the two or more interpreters corresponding to the number of interpreter beneficiaries is calculated using, for example, the above-mentioned group of information on the number of beneficiaries by interpreter.

Specifically, for example, the storage unit 11 stores the number of beneficiary information groups for each interpreter "(x, 1200 people), (y, 800 people) ...)", and the reward calculation unit 137 is an interpreter. The portion of the reward for the interpreter x that corresponds to the number of interpreter recipients is calculated as "β2 x 1200", and the portion of the reward for the interpreter y that corresponds to the number of interpreter recipients is "β2 x". It may be calculated as "800 people".

Further, the use of the reward calculation information may include, for example, the case of using the advertisement fee information and the reward calculation information (reward calculation method 2).

In the case of the reward calculation method 2, for example, the storage unit 11 includes an advertisement fee storage unit (not shown). The advertising fee storage unit stores advertising fee information regarding the advertising fee from the advertiser of the above advertisement. The advertising fee information is, for example, "500,000 yen", but the format does not matter. The remuneration calculation information stored in the remuneration calculation information storage unit 114 is, for example, a set of pairs of the related party identifier and the ratio information as described above. This type of reward calculation information may be, for example, "(operator, X% of advertising fee), (interpreter, 10,000 yen + Z% of advertising fee) ...".

The remuneration calculation unit 137 calculates the remuneration for each of two or more related parties by using the advertisement fee information and the remuneration calculation information. The remuneration for each party is calculated as follows, for example.

That is, the remuneration calculation unit 137 uses the operator remuneration calculation information "(operator, X% of advertising fee)" that constitutes the remuneration calculation information and the advertising fee information "500,000 yen" to the operator. The reward "500,000 yen x (X / 10)" may be calculated. In addition, the remuneration calculation department 137 uses the interpreter remuneration calculation information "(interpreter, 10,000 yen + Z% of advertising fee)" and the advertising fee information "500,000 yen" to reimburse the interpreter. You may calculate "10,000 yen + 500,000 yen x (Z / 100)".

Specifically, for example, if X = 4, Z = 2, the remuneration to the operator is calculated as "500,000 yen x 0.4 = 200,000 yen, and the remuneration to the interpreter is 10,000 yen. It is calculated as +500,000 yen x 0.02 = 20,000 yen.

The use of the reward calculation information may include, for example, the case where one or more interpreter attribute values, the advertisement fee information, and the reward calculation information of the interpreter provision time information or the number of interpreter enjoyers information are used. That is, the remuneration calculation unit 137 has one or more interpreter attribute values out of the interpreter provision time information or the number of interpreter beneficiaries information acquired by the interpreter attribute value acquisition unit 136, and the remuneration calculation stored in the remuneration calculation information storage unit 114. The reward may be calculated for one or more related parties by using the information and the advertising fee information stored in the advertising fee storage unit, and the method of calculating the reward does not matter.

The inspection unit 138 inspects the flags of each of the one or more simultaneous interpretation-related information stored in the simultaneous interpretation-related information storage unit 112, and acquires the inspection result. The inspection may be, for example, reading the value of the flag, determining whether the value of the flag indicates a public value or a private value, and whether the flag value is public or private based on the presence or absence of the flag. May be determined. The test result is, for example, "public" or "private", but the format does not matter.

When the result of the flag inspection by the inspection unit 138 is the inspection result of disclosing the simultaneous interpretation information, the upload unit 139 uploads the simultaneous interpretation-related information corresponding to the flag to an external server.

As a result, of the one or two or more simultaneous interpretation-related information stored in the simultaneous interpretation-related information storage unit 112, one or two or more simultaneous interpretation-related information corresponding to the flag indicating disclosure is sent to the external server. It will be uploaded. The uploaded simultaneous interpretation-related information does not have to be the same as the stored simultaneous interpretation-related information. For example, the simultaneous interpretation-related information uploaded may not include the flag. Further, for example, the event identifier included in the stored simultaneous interpretation-related information may be an ID, and the event identifier included in the uploaded simultaneous interpretation-related information may be an event name.

The above-mentioned inspection and upload may be executed, for example, at a predetermined timing. Specifically, for example, the storage unit 11 stores timing information regarding the upload timing. The processing unit 13 acquires the current time from, for example, the built-in clock of the MPU, the NTP server, or the like, and periodically or irregularly determines whether or not the acquired current time is the timing indicated by the timing information. Is going. For example, when it is determined that the current time is the timing indicated by the timing information, the inspection unit 138 sets a flag indicating disclosure to the simultaneous interpretation-related information for each of the stored one or more simultaneous interpretation-related information. After determining whether or not the information is supported, the uploading unit 139 uploads one or more simultaneous interpretation-related information that is determined to be supported by the flag indicating disclosure.

For example, the processing unit 13 attaches a flag indicating "uploaded" to the simultaneous interpretation-related information uploaded by the uploading unit 139, and the inspection unit 138 does not add a flag indicating uploaded 1 or 2. Only for each of the above-mentioned simultaneous interpretation-related information, the above determination may be made as to whether or not the flag indicating disclosure is supported.

Alternatively, the inspection and upload may be performed on the new simultaneous interpretation-related information in response to the accumulation of new simultaneous interpretation-related information in the simultaneous interpretation-related information storage unit 112, such as timing and triggering. Does not matter.

Here, the inspection and uploading in response to the accumulation of new simultaneous interpretation-related information in the simultaneous interpretation-related information storage unit 112 is not limited to the mode in which the inspection and upload are performed after the accumulation is completed, for example. It also includes a mode in which an inspection is performed at the start of accumulation and an upload is performed in parallel with the accumulation. The mode of uploading in parallel with the accumulation may be referred to as, for example, real-time uploading.

That is, for example, when the processing unit 13 completes the accumulation of the new simultaneous interpretation-related information in the simultaneous interpretation-related information storage unit 112, the new simultaneous interpretation stored in the simultaneous interpretation-related information storage unit 112. When the inspection unit 138 inspects the flag for the related information and the result of the inspection indicates disclosure, the uploading unit 139 may upload the new simultaneous interpretation-related information to an external server. ..

Alternatively, for example, before the transmission of the simultaneous interpretation voice or the like is started by the transmission unit 14, the flag or the like is received by the reception unit 12 and stored in the storage unit 11, and the transmission of the simultaneous interpretation voice or the like is started. Accordingly, the processing unit 13 constructs new simultaneous interpretation-related information by using the simultaneous interpretation voice and the like and flags and the like currently stored in the storage unit 11, and stores the new simultaneous interpretation-related information in the simultaneous interpretation-related information storage unit 112. Processing (for example, buffering) is started.

The inspection unit 138 inspects the flag in response to the start of accumulating new simultaneous interpretation-related information. While the processing unit 13 is accumulating, whether the data amount (for example, buffer amount) of the simultaneous interpretation-related information stored in the simultaneous interpretation-related information storage unit 112 exceeds the threshold value or exceeds the threshold value. Whether or not it is determined is performed regularly or irregularly. For example, when it is determined that the buffer amount exceeds the threshold value or exceeds the threshold value, the upload unit 139 may start uploading the new simultaneous interpretation-related information to an external server.

The transmission unit 14 transmits various types of information. The various types of information include, for example, simultaneous interpretation information, simultaneous interpretation audio, multiplexed audio, video, and advertising information.

The transmission unit 14 transmits the simultaneous interpretation information acquired by the simultaneous interpretation information acquisition unit 131 to two or more terminal devices 2.

The transmission unit 14 transmits, for example, the simultaneous interpretation voice received by the reception unit 12 or stored in the storage unit 11 to two or more terminal devices 2.

Alternatively, the transmitting unit 14 may transmit, for example, the multiplexed voice acquired by the multiplexing unit 132 or stored in the storage unit 11 to two or more terminal devices 2.

The transmission unit 14 may transmit, for example, the video acquired by the video acquisition unit 133 or stored in the storage unit 11 to two or more terminal devices 2.

For example, the transmission unit 14 may transmit the advertisement information stored in the advertisement information storage unit 113 to two or more terminal devices 2.

For example, the transmission unit 14 may transmit the advertisement information selected by the advertisement information selection unit 135 out of the one or more advertisement information stored in the advertisement information storage unit 113 to the two or more terminal devices 2. good.

The first communication means 141 constituting the transmission unit 14 transmits at least the simultaneous interpretation voice to the terminal device 2 existing in the first venue. The second communication means 142 transmits simultaneous interpretation information to the terminal devices 2 existing in each of the one or more second venues.

Normally, the transmission unit 14 transmits at least the simultaneous interpretation voice to the terminal device 2 existing in the first venue by the first communication means 141, and each one or more firsts located at a place away from the first venue. (2) Transmission is performed by the second communication means 142 to the terminal device 2 existing in the venue.

The first communication means 141 and the second communication means 142 are different communication means.

The first communication means 141 is usually a communication means having a lower delay than the second communication means 142. As the first communication means 141, for example, a communication means by a unicast method is preferable, but a communication means by a multicast method may also be used. In the latter case, for example, the delay may be suppressed by increasing the communication speed. Specifically, the first communication means 141 may be, for example, WebRTC (Web Real-Time Communication) or the like. WebRTC can perform peer-to-peer low-latency communication.

Further, the first communication means 141 is usually a communication means having a narrower range than the second communication means 142. Specifically, the first communication means 141 is, for example, short-range wireless communication such as Bluetooth (registered trademark), narrow area network such as wireless LAN, or the like, but the type thereof does not matter.

The second communication means 142 is usually a higher quality communication means than the first communication means 141. As the second communication means 142, for example, a communication means by a multicast method is preferable, but a communication means by a unicast method may also be used. In the latter case, for example, the quality may be improved by increasing the communication speed. Specifically, the second communication means 142 may be, for example, HLS (HTTP Live Streaming) or the like. HLS supports streaming distribution of moving images, and while it can transmit high-quality video, it is prone to delays.

Further, the second communication means 142 is usually a communication means having a wider area than the first communication means 141. Specifically, the first communication means 141 is, for example, a wide area network such as the Internet, a communication line such as a mobile phone line, or the like, but the type thereof does not matter.

It is preferable that the first communication means 141 and the second communication means 142 transmit different information, for example. That is, the transmission unit 14 usually transmits different information to two or more terminal devices 2 by using the first communication means 141 and the second communication means 142.

Different information is, for example, different types of information. The different types of information are, for example, audio and video, but the combination is not limited.

Alternatively, the different information may be, for example, information of the same type but different quality. Information of the same type but different quality is, for example, high-quality video and low-quality video, but the combination thereof does not matter. A high-quality image is, for example, an image having a high resolution or a large number of pixels, and a low-quality image is, for example, an image having a low resolution or a small number of pixels. Alternatively, for example, a high-quality image may be a moving image and a low-quality image may be a still image, and the combination thereof does not matter.

Alternatively, the different information may be, for example, all or part of one simultaneous interpretation information. Specifically, for example, regarding the simultaneous interpretation information having the simultaneous interpretation audio and the video, the different information may be the simultaneous interpretation audio and the video and the simultaneous interpretation audio.

Specifically, for example, the simultaneous interpretation information having the simultaneous interpretation audio and the video is acquired, and the transmission unit 14 transmits only the simultaneous interpretation audio by the first communication means 141 (that is, the video is not transmitted and the simultaneous interpretation audio is transmitted). It is preferable that the second communication means 142 transmits the simultaneous interpretation audio and video.

The different information may be, for example, information of the same type but different contents. The information of the same type but different contents may be, for example, a video of a wide area of the venue and a close-up image of the speaker in the venue, or an utterance voice and a simultaneous interpretation voice, and the combination thereof does not matter.

One or more of the first communication means 141 and the second communication means 142 may transmit the multiplexed voice to one or more terminal devices 2, for example. For example, it is preferable that each of the first communication means 141 and the second communication means 142 transmits the multiplexed voice to one or more terminal devices 2. However, one of the first communication means 141 or the second communication means 142 may transmit the multiplexed voice to one or more terminal devices 2, and the other may not transmit the multiplexed voice. It should be noted that transmitting the multiplexed voice includes the case of transmitting simultaneous interpretation information including the multiplexed voice.

That is, for example, the transmitting unit 14 uses the first communication means 141 and the second communication means 142 to transmit the multiplexed voice acquired by the multiplexing unit 132 in the first venue and one or more second venues. It transmits to two or more terminal devices 2 existing in the device. As described above, the two or more voices may be, for example, the utterance voice and one simultaneous interpretation voice, two or more simultaneous interpretation voices, or the utterance voice and two or more simultaneous interpretation voices.

Further, the transmission unit 14 transmits, for example, the advertisement information stored in the advertisement information storage unit 113 to one or more terminal devices 2. The destination of the advertisement information may be all or a part of the two or more terminal devices 2 constituting the interpreting system. A part is, for example, one or more terminal devices 2 existing in one or more second venues, but may be one or more terminal devices 2 existing in one or more first venues.

One or more of the first communication means 141 and the second communication means 142 may transmit advertisement information to one or more terminal devices 2, for example. That is, the transmission unit 14 transmits advertisement information to one or more terminal devices 2 by using, for example, one or more communication means of the first communication means 141 and the second communication means 142.

For example, it is preferable that each of the first communication means 141 and the second communication means 142 transmits the advertisement information to one or more terminal devices 2.

However, one of the first communication means 141 or the second communication means 142 may transmit the advertisement information to one or more terminal devices 2, and the other may not transmit the advertisement information. Specifically, the transmission unit 14 does not transmit the advertisement information to, for example, one or more terminal devices 2 existing in the first venue, and does not transmit the advertisement information by using the first communication means 141. , Simultaneous interpretation information may be transmitted, and simultaneous interpretation information and advertisement information may be transmitted to one or more terminal devices 2 existing in one or more second venues by using the second communication means 142.

It is preferable that the advertisement information to be transmitted is the advertisement information selected by the advertisement information selection unit 135.

Specifically, for example, two or more advertisement informations are stored in the advertisement information storage unit 113 in association with the language identifier, and the language identifier acquisition unit 134 determines the language of the simultaneous interpretation voice transmitted by the transmission unit 14. The language identifier to be identified is acquired, and the advertisement information selection unit 135 selects the advertisement information corresponding to the language identifier acquired by the language identifier acquisition unit 134 from the two or more stored advertisement information, and sends the transmission unit 14. At least one of the constituent first communication means 141 and second communication means 142 may transmit the selected advertising information.

The reception unit 15 receives various types of information. The various types of information include, for example, flags and event identifiers. The reception by the reception unit 15 is usually reception of information input from an input device such as a keyboard or a touch panel, but for example, reception of information transmitted via a network or the like, or reception from a recording medium such as a disk or a semiconductor memory. The read information may be accepted.

The reception unit 15 receives the flag, for example, after the transmission of the simultaneous interpretation information by the transmission unit 14 is completed. An event identifier may also be accepted in combination with the flag.

The output unit 16 outputs various information. The various types of information are, for example, reward information. Further, the output unit 16 may output an input request such as a flag, for example.

The output by the output unit 16 is usually displayed on a display, but for example, printout by a printer, sound output from a speaker, storage in a recording medium, delivery to another program, transmission to another device, etc. However, the mode does not matter. It should be noted that such a matter also applies to the reward output unit 161.

The reward output unit 161 outputs the reward information acquired by the reward calculation unit 137. The reward output unit 161 normally outputs the acquired reward information via an output device such as a display, but it may be stored in a recording medium or transmitted to another device.

The output reward information does not have to be the same as the acquired reward information. For example, the related party identifier included in the acquired reward information is an ID such as "1" or "2", and the related party identifier included in the output reward information is "operator", "interpreter", or the like. It may be the name of the person concerned. Further, for example, the acquired reward information may be in a text format such as CSV or TSV, and the output reward information may be in a table format.

The terminal storage unit 21 constituting the terminal device 2 can store various types of information. The various types of information are, for example, user information. The user information includes a user identifier as described above. The user information may also include a language identifier. Further, the terminal storage unit 21 may store, for example, a terminal identifier.

User information is stored in the user information storage unit 211. The user information has a user identifier. The user information may also have, for example, a language identifier. However, the structure of user information does not matter.

The terminal reception unit 22 receives various types of information. The various types of information are, for example, voice selection instructions. The voice selection instruction is an instruction for selecting one voice out of two or more voices. The voice selection instruction has, for example, one language identifier selected from two or more language identifiers corresponding to two or more voices acquired by the demultiplexing unit 251. However, the voice selection instruction may be, for example, an instruction for switching channels, and the structure thereof does not matter. Further, the voice selection instruction does not necessarily have to be accepted.

The reception by the terminal reception unit 22 is usually the reception of information input from an input device such as a keyboard or a touch panel, but for example, reception of information transmitted via a network or the like, or a recording medium such as a disk or a semiconductor memory. Information read from may be accepted.

The terminal transmission unit 23 transmits various types of information. The various types of information are, for example, user information. The terminal transmission unit 23 transmits, for example, the user information stored in the user information storage unit 211 to the server device 1. The transmitted user information does not have to be the same as the stored user information. For example, when the user information having the user identifier and the language identifier is stored, the user information having no language identifier and having the user identifier may be transmitted.

The terminal receiving unit 24 receives various types of information. The various types of information are, for example, simultaneous interpretation information.

The terminal processing unit 25 performs various processes. The various processes are, for example, the processes of the demultiplexing unit 251. In addition, the terminal processing unit 25 also performs processing such as various determinations described in the flowchart.

The demultiplexing unit 251 constituting the terminal processing unit 25 demultiplexes the multiplexed voice included in the simultaneous interpretation information received by the terminal receiving unit 24, and acquires two or more voices. Demultiplexing is a process opposite to multiplexing, and is a process of restoring the original two or more voices from the multiplexed voice.

The voice selection unit 252 selects one of the two or more voices acquired by the demultiplexing unit 251. The voice selection unit 252 selects, for example, one voice corresponding to the voice selection instruction received by the terminal reception unit 22 from the two or more acquired voices.

Alternatively, for example, the user information stored in the user information storage unit 211 has a language identifier, and the voice selection unit 252 may select the voice corresponding to the language identifier.

The language identifier of the user information may be, for example, information input in advance by the user or default information. Further, the language identifier of the user information may be changed according to, for example, a voice selection instruction.

Specifically, for example, the terminal output unit 26 outputs two or more language codes corresponding to the acquired two or more voices, and the terminal reception unit 22 is selected from the two or more output language codes. Receiving the voice selection instruction having the language code of the above, the terminal processing unit 25 changes the language code of the stored user information to the language code of the voice selection instruction.

In response to this, the voice corresponding to the changed language identifier is selected by the voice selection unit 252, and the selected voice is output by the terminal output unit 26.

The terminal output unit 26 outputs various information. The various types of information are, for example, simultaneous interpretation information. The terminal output unit 26 outputs, for example, the simultaneous interpretation information received by the terminal reception unit 24 via an output device such as a speaker or a display. The output simultaneous interpretation information does not have to be the same as the received simultaneous interpretation information.

The output by the terminal output unit 26 is usually a sound output from a speaker or a display on a display, but for example, it is printed out by a printer, stored in a recording medium, handed over to another program, or sent to an external device. It may be transmitted, and the mode is not limited.

For example, when the simultaneous interpretation information includes the multiplexed voice and the demultiplexing unit 251 acquires two or more voices, the terminal output unit 26 receives the voice selection unit 252 among the two or more acquired voices. Outputs the selected audio. This allows the user to hear the desired voice, for example, of the spoken voice and two or more voices including one or more simultaneous interpretation voices in different languages.

The speaker device 3 may include, for example, a speaker storage unit (not shown), a speaker reception unit (not shown), a speaker transmission unit (not shown), and the like. For example, a language identifier that identifies the first language described above is stored in the speaker storage unit, the speaker reception unit receives the speaker's uttered voice via a microphone, and the speaker transmission unit is concerned. The received speaker voice may be transmitted to the server device 1 in combination with the stored language identifier. Alternatively, the speaker storage unit stores the speaker identifier, and the speaker transmission unit may transmit the received utterance voice to the server device 1 in combination with the stored speaker identifier. ..

Further, the interpreter device 4 may include, for example, an interpreter storage unit (not shown), an interpreter reception unit (not shown), an interpreter transmission unit (not shown), and the like. For example, a language identifier that identifies the second language described above is stored in the interpreter storage unit, the interpreter reception unit receives the simultaneous interpretation voice of the interpreter via a microphone, and the interpreter transmission unit receives the simultaneous interpretation voice of the interpreter. The received simultaneous translation voice may be transmitted to the server device 1 in combination with the stored language identifier. Alternatively, the interpreter identifier is stored in the interpreter storage unit, and the interpreter transmission unit may transmit the received simultaneous interpretation voice to the server device 1 in pairs with the stored interpreter identifier. good.

In the server device 1, the transmission unit 14 may also transmit the speaker voice received from the speaker device 3 to the interpreter device 4. The interpreter device 4 also includes, for example, an interpreter receiving unit (not shown), the interpreter receiving unit receives the speaker voice from the server device 1, and the interpreter output unit speaks the received speaker voice. It may be output via. As a result, the interpreter can perform simultaneous interpretation while listening to the utterance voice output from the interpreter device 4 even if he / she is outside the first venue.

The storage unit 11, the user information group storage unit 111, the simultaneous interpretation-related information storage unit 112, the advertisement information storage unit 113, the reward calculation information storage unit 114, the terminal storage unit 21, and the user information storage unit 211 are, for example, a hard disk or a flash. A non-volatile recording medium such as a memory is suitable, but a volatile recording medium such as a RAM can also be realized.

The process in which information is stored in the storage unit 11 or the like does not matter. For example, information may be stored in the storage unit 11 or the like via a recording medium, or information transmitted via a network, a communication line, or the like may be stored in the storage unit 11 or the like. Well, or the information input via the input device may be stored in the storage unit 11 or the like. The input device may be, for example, a keyboard, a mouse, a touch panel, or the like.

The receiving unit 12 and the terminal receiving unit 24 are usually realized by a wired or wireless communication means (for example, a communication module such as a NIC (Network interface controller) or a modem), but a means for receiving a broadcast (for example, a broadcast). It may be realized by the receiving module).

Processing unit 13, simultaneous interpretation information acquisition unit 131, multiplexing unit 132, video acquisition unit 133, language identifier acquisition unit 134, advertisement information selection unit 135, interpreter attribute value acquisition unit 136, reward calculation unit 137, inspection unit 138, upload The unit 139, the terminal processing unit 25, the demultiplexing unit 251 and the voice selection unit 252 can usually be realized from an MPU, a memory, or the like. The processing procedure of the processing unit 13 and the like is usually realized by software, and the software is recorded on a recording medium such as ROM. However, the processing procedure may be realized by hardware (dedicated circuit).

The transmission unit 14, the first communication means 141, the second communication means 142, and the terminal transmission unit 23 are usually realized by a wired or wireless communication means, but are realized by a broadcasting means (for example, a broadcasting module). You may.

The reception unit 15 and the terminal reception unit 22 may or may not include an input device. The reception unit 15 and the like can be realized by the driver software of the input device or by the input device and its driver software.

The output unit 16, the reward output unit 161 and the terminal output unit 26 may or may not include an output device such as a display or a speaker. The output unit 16 and the like can be realized by the driver software of the output device, or by the output device and its driver software.

Next, the operation of the information system will be described with reference to the flowcharts of FIGS. 4 to 7. 4 to 6 are flowcharts illustrating the operation of the server device 1.

(Step S401) The processing unit 13 determines whether or not the receiving unit 12 has received information such as simultaneous interpretation voice. The receiving unit 12 may receive, for example, only one simultaneous interpretation voice, one simultaneous interpretation voice and a speaker voice, or talk with two or more simultaneous interpretation voices in different languages. The person's voice may be received. Further, the receiving unit 12 may receive video in addition to one or more voices including at least one simultaneous interpretation voice. In this flowchart, the receiving unit 12 usually also receives video.

If it is determined that the receiving unit 12 has received information such as simultaneous interpretation voice, the process proceeds to step S402, and if it is determined that the receiving unit 12 has not received the information, the process proceeds to step S406.

(Step S402) The processing unit 13 stores information such as simultaneous interpretation voice received in step S401 in the storage unit 11. Then, the process returns to step S401.

The area of the storage unit 11 in which the simultaneous interpretation voice is stored may be referred to as, for example, a "first buffer area". Further, for example, spoken voice may be stored in the first buffer area. Further, storing the simultaneous interpretation voice in the first buffer means, for example, when storing two or more simultaneous interpretation voices of different languages in the first buffer, or storing one or more simultaneous interpretation voices and spoken voices in the first buffer. Including the case of doing.

(Step S403) The processing unit 13 determines whether or not the information accumulated in step S402 includes two or more voices. If it is determined that the stored information contains two or more voices, the process proceeds to step S404, and if it is determined that the stored information contains only one voice, the process proceeds to step S405.

(Step S404) The multiplexing unit 132 multiplexes two or more voices included in the simultaneous interpretation information and acquires the multiplexed voices.

(Step S405) The simultaneous interpretation information acquisition unit 131 includes one simultaneous interpretation voice stored in the storage unit 11 or the simultaneous interpretation voice acquired in step S404 and the video stored in the storage unit 11. Get interpreter information.

(Step S406) The processing unit 13 stores the simultaneous interpretation information acquired in step S405 in the storage unit 11. Then, the process returns to step S401.

The area in the storage unit 11 in which the simultaneous interpretation information is stored may be referred to as, for example, a "second buffer area".

(Step S407) The processing unit 13 determines whether or not to deliver to the first venue. For example, the amount of data of the simultaneous interpretation voice stored in the first buffer area of the storage unit 11 (for example, it may be referred to as "first buffer amount") becomes equal to or larger than a predetermined threshold value or larger than the threshold value. In that case, it may be determined that the data will be delivered to the first venue, and if it is not yet above or greater than the predetermined threshold value, it may be determined that the data will not be delivered to the first venue. .. If it is determined that the distribution to the first venue is performed, the process proceeds to step S408, and if it is determined that the distribution is not performed, the process proceeds to step S409.

(Step S408) The transmission unit 14 transmits at least the simultaneous interpretation voice stored in the storage unit 11 to the terminal device 2 existing in the first venue via the first communication means 141. Then, the process returns to step S401.

It should be noted that at least the simultaneous interpretation voice is transmitted, for example, when only one simultaneous interpretation voice stored in the first buffer area is transmitted, or two or more different languages stored in the first buffer area are transmitted. This includes the case of transmitting the simultaneous interpretation voice and the case of transmitting the multiplexed voice included in the simultaneous interpretation information stored in the second buffer area.

(Step S409) The processing unit 13 determines whether or not to deliver to one or more second venues. For example, the amount of data of the simultaneous interpretation information stored in the second buffer area of the storage unit 11 (for example, it may be referred to as "second buffer amount") becomes equal to or larger than a predetermined threshold value or larger than the threshold value. In that case, it is judged that the data will be delivered to one or more second venues, and if the threshold value is not yet greater than or equal to the predetermined threshold value, the data will not be delivered to one or more second venues. You may judge that. If it is determined that the distribution is to one or more second venues, the process proceeds to step S408, and if it is determined that the distribution is not performed, the process proceeds to step S409.

(Step S410) The transmission unit 14 transmits the simultaneous interpretation information stored in the storage unit 11 to the terminal devices 2 existing in each of one or more first venues via the second communication means 142. Then, the process returns to step S401.

The transmitted simultaneous interpretation information does not have to be the same as the stored simultaneous interpretation information. That is, to transmit the simultaneous interpretation information is usually to transmit all the information included in the simultaneous interpretation information, but there may be some information that is not transmitted.

(Step S411) The processing unit 13 determines whether or not to transmit the advertisement information. For example, the storage unit 11 stores timing information regarding the timing of transmitting the advertisement information, and the processing unit 13 uses the timing information and the current time acquired from the built-in clock or the like to transmit the advertisement information. Make a decision as to whether or not to do so. Alternatively, for example, when the reception unit 15 receives an instruction to transmit the advertisement information, the processing unit 13 may determine that the advertisement information is transmitted, and a trigger for transmitting the advertisement information or The timing does not matter.

If it is determined that the advertisement information is to be transmitted, the process proceeds to step S412, and if it is determined that the advertisement information is not transmitted, the process proceeds to step S415.

(Step S412) The language identifier acquisition unit 134 acquires the language identifier of the simultaneous interpretation voice. Acquiring the language identifier of the simultaneous interpretation voice includes the case of acquiring the language identifier for each of two or more simultaneous interpretation voices.

(Step S413) The advertisement information selection unit 135 acquires the advertisement information corresponding to the language identifier acquired in step S412 from the advertisement information storage unit 113. The acquisition of the advertisement information corresponding to the acquired language identifier includes, for example, the acquisition of the advertisement information corresponding to each of the acquired two or more language identifiers.

(Step S414) The transmission unit 14 transmits advertisement information to one or more terminal devices 2 via at least one of the first and second communication means. The advertising information may be transmitted only to the terminal device 2 in each one or more second venues via, for example, the second communication means 142, or via the first and second communication means. , The terminal device 2 in the first venue and one or more terminal devices 2 in each second venue may be transmitted, or the terminal device in the first venue may be transmitted via the first communication means 141. It may be transmitted only to 2. Then, the process returns to step S401.

(Step S415) The processing unit 13 determines whether or not to calculate the reward. For example, the processing unit 13 determines that the reward is calculated when the transmission of the simultaneous interpretation information is completed, and determines that the reward is not calculated when the transmission of the simultaneous interpretation information is not completed. .. Alternatively, for example, when the reception unit 15 receives an instruction to calculate the reward, the processing unit 13 may determine that the reward is calculated, or timing information regarding the timing of calculating the reward. Judgment may be made using, etc., and the trigger or timing for calculating the reward does not matter.

If it is determined that the reward is to be calculated, the process proceeds to step S416, and if it is determined not to be performed, the process proceeds to step S419.

(Step S416) The interpreter attribute value acquisition unit 136 acquires one or more interpreter attribute values out of the interpreter provision time information or the number of interpreter enjoyers. The method of obtaining the interpreter provision time information and the number of interpreter recipients will not be repeated as described above.

(Step S417) The remuneration calculation unit 137 calculates the remuneration of the interpreter or the like using the remuneration calculation information stored in the remuneration calculation information storage unit 114 and one or more interpreter attribute values acquired in step S416. do. The method of calculating the remuneration for interpreters, etc. will not be repeated as described above.

(Step S418) The reward output unit 161 outputs the reward information acquired in step S417 via an output device such as a display. Then, the process returns to step S401.

(Step S419) The processing unit 13 determines whether or not the reception unit 15 has received a flag or the like indicating public or non-public. The reception unit 15 may also accept an event identifier in pair with the flag. If it is determined that the reception unit 15 has accepted the flag or the like, the process proceeds to step S420, and if it is determined that the flag or the like has not been accepted, the process proceeds to step S421.

(Step S420) The processing unit 13 configures the simultaneous interpretation information stored in the storage unit 11 and the simultaneous interpretation-related information including the flag received in step S419, and stores the simultaneous interpretation-related information in the simultaneous interpretation-related information storage unit 112. .. Then, the process returns to step S401.

(Step S421) The processing unit 13 determines whether or not to upload. For example, the storage unit 11 stores timing information regarding the upload timing, and the processing unit 13 determines whether or not to perform the upload using the timing information and the current time acquired from the built-in clock or the like. do. Alternatively, for example, when the reception unit 15 receives an instruction to perform upload, the processing unit 13 may determine that upload is performed, and the trigger or timing for uploading does not matter.

If it is determined that the upload is to be performed, the process proceeds to step S422, and if it is determined that the upload is not performed, the process returns to step S401.

(Step S422) The acquisition unit 131 sets the initial value 0 in the variable i. The variable i is a variable for sequentially selecting unselected simultaneous interpretation-related information from one or more simultaneous interpretation-related information stored in the simultaneous interpretation-related information storage unit 112.

(Step S423) The processing unit 13 determines whether or not there is the i-th simultaneous interpretation-related information. If it is determined that there is the i-th simultaneous interpretation related information, the process proceeds to step S424, and if it is determined that there is no information related to simultaneous interpretation, the process returns to step S401.

(Step S424) The inspection unit 138 inspects the flag of the i-th simultaneous interpretation-related information.

(Step S425) The processing unit 13 determines whether or not the result of the inspection in step S424 indicates disclosure. If it is determined that the inspection result indicates disclosure, the process proceeds to step S426, and if it is determined that the inspection result indicates non-disclosure, the process proceeds to step S427.

(Step S426) The upload unit 139 uploads the i-th simultaneous interpretation-related information to an external server.

(Step S427) The processing unit 13 increments the variable i. Then, the process returns to step S423.

In the flowcharts of FIGS. 4 to 6, the process starts when the power of the server device 1 is turned on or the program is started, and the process ends when the power is turned off or an interrupt for the end of the process occurs. However, the trigger for the start or end of processing does not matter.

FIG. 7 is a flowchart illustrating the operation of the terminal device 2.

(Step S701) The terminal processing unit 25 determines whether or not the terminal receiving unit 24 has received the simultaneous interpretation voice or the simultaneous interpretation information from the server device 1. If it is determined that the terminal receiving unit 24 has received the simultaneous interpretation voice or the simultaneous interpretation information from the server device 1, the process proceeds to step S702, and if it is determined that the terminal receiving unit 24 has not received the simultaneous interpretation voice, the process proceeds to step S707.

(Step S702) The terminal processing unit 25 determines whether or not the simultaneous interpretation voice or the simultaneous interpretation information received in step S701 includes the multiplexed voice. If it is determined that the received simultaneous interpretation voice or simultaneous interpretation information includes the multiplexed voice, the process proceeds to step S703, and if it is determined that the received simultaneous interpretation voice does not include the multiplexed voice, the process proceeds to step S706.

(Step S703) The demultiplexing unit 251 demultiplexes the multiplexed voice and acquires two or more voices.

(Step S704) The terminal processing unit 25 acquires the language identifier of each of the two or more voices acquired in step S703.

(Step S705) The terminal processing unit 25 selects the voice corresponding to the language identifier of the user information stored in the user information storage unit 211 from the two or more voices acquired in step S703.

(Step S706) The terminal output unit 26 outputs one voice selected in step S705 via the speaker. If the simultaneous interpretation information is received in step S701 and the simultaneous interpretation information includes a video, the video is further output via the display. Then, the process returns to step S701.

(Step S707) The terminal processing unit 25 determines whether or not the terminal reception unit 22 has received the voice selection instruction. If it is determined that the terminal reception unit 22 has accepted the voice selection instruction, the process proceeds to step S708, and if it is determined that the terminal reception unit 22 has not accepted the voice selection instruction, the process returns to step S701.

(Step S708) The terminal processing unit 25 updates the language identifier of the user information stored in the user information storage unit 211 to the language identifier corresponding to the voice selection instruction received in step S707. Then, the process returns to step S701.

In the flowchart of FIG. 7, the process starts when the power of the terminal device 2 is turned on or the program is started, and the process ends when the power is turned off or an interrupt for the end of the process occurs. However, the trigger for the start or end of processing does not matter.

Hereinafter, a specific operation example of the information system according to the present embodiment will be described. The following description can be changed in various ways and does not limit the scope of the present invention.

(Specific example 1)
Specific example 1 is for "A lecture", which is an event to listen to the lecture of speaker A, and the spoken voice of speaker A in Japanese and the spoken voice are transmitted by two interpreters x and y in English and. Two simultaneous interpretation voices simultaneously translated into two languages of Chinese and a video of speaker A are acquired, and the multiplexed voice obtained by multiplexing the three acquired voices is the first of the wireless LAN and the like. The communication means 141 of the above is distributed to the venue X, which is the first venue where the speaker A and two or more listeners including the user a and the user b are present, and the simultaneous interpretation information including the multiplexed audio and video is transmitted to the Internet, etc. In the second communication means 142 of the above, the venue Y, which is the second venue where only one or more listeners including the user c are present, and the venue Z, which is the other second venue where only one or more listeners including the user d are present. This is an example of delivering to.

In this example, it is assumed that the two interpreters x and y are at the interpreter booth in the venue X and can directly listen to the utterance of the speaker A.

The conceptual diagram of the information system is shown in FIG. The information system of this example includes server devices 1, 4 or more terminal devices 2, a speaker device 3, and two interpreter devices 4. The speaker device 3 exists in a podium (not shown) in the venue X, and the two interpreter devices 4 exist in an interpreter booth (not shown) in the venue X.

Of the four or more terminal devices 2, one terminal device 2 (hereinafter, terminal device 2a) is a mobile terminal of the user a and exists in the venue X. Of the four or more terminal devices 2, the other terminal device 2 (hereinafter, terminal device 2b) is a mobile terminal of the user b and exists in the venue X. Of the four or more terminal devices 2, the other terminal device 2 (hereinafter, terminal device 2c) is a mobile terminal of the user c and exists in the venue Y. Of the four or more terminal devices 2, the other terminal device 2 (hereinafter, terminal device 2d) is a mobile terminal of the user d and exists in the venue Z.

As shown in FIG. 8, for example, one or two or more venue type information groups are stored in the storage unit 11 constituting the server device 1 in association with the event identifier. FIG. 8 is a data structure diagram of the venue type information group. The venue type information includes a venue identifier and type information.

Before the start of the event, the venue type information group is received by the reception unit 15 in pairs with the event identifier that identifies the event, and is received by the processing unit 13 in association with the event identifier in the storage unit 11. Accumulate. However, a set of sets of the event identifier and the venue type information group may be stored in the storage unit 11 in advance.

The venue type information group corresponding to the event identifier "A lecture" is composed of three venue type information. IDs (for example, "1", "2", etc.) are associated with each of these three venue type information. For example, the venue type information associated with the ID "1" (hereinafter, may be referred to as venue type information 1) has a venue identifier "X" and a type information "first venue". Further, the venue type information 2 to which the ID “2” is associated has the venue identifier “Y” and the type information “second venue”. Similarly, the venue type information 3 has a venue identifier "Z" and a type information "second venue".

In the user information group storage unit 111, for example, a user information group as shown in FIG. 9 is stored in association with the event identifier “A lecture”. FIG. 9 is a data structure diagram of the user information group. This user information group is composed of four or more user information. The user information constituting the user information group has, for example, a user identifier, a venue identifier, and a language identifier. However, the user information constituting the user information group does not have to have a language identifier.

An ID (for example, "1", "2", etc.) is associated with each of the four or more user information constituting the user information group corresponding to the event identifier "A lecture". For example, the user information associated with the ID "1" (hereinafter, may be referred to as user information 1) has a user identifier "a", a venue identifier "X", and a language identifier "English".

Further, the user information 2 associated with the ID "2" has a user identifier "b", a venue identifier "X", and a language identifier "medium". Similarly, the user information 3 has a user identifier "c", a venue identifier "Y", and a language identifier "English", and the user information 4 has a user identifier "d", a venue identifier "Z", and a language identifier. Has "English".

The user information group as described above is, for example, received from two or more terminal devices 2 by the receiving unit 12 and stored in the user information group storage unit 111 by the processing unit 13 before the start of the event. It may be stored in the user information group storage unit 111. Further, for example, new user information may be received from another terminal device 2 and added to the user information group stored in the event between the start and the end of the event.

The user information "(a, X, English)" corresponding to the user information 1 is stored in the user information storage unit 211 of the terminal device 2a. The user information "(b, X, middle)" corresponding to the user information 2 is stored in the user information storage unit 211 of the terminal device 2b. The user information "(c, Y, English)" corresponding to the user information 3 is stored in the user information storage unit 211 of the terminal device 2c. The user information "(d, Z, English)" corresponding to the user information 4 is stored in the user information storage unit 211 of the terminal device 2d.

The user information as described above is received by the terminal reception unit 22 and stored in the user information storage unit 211 by the terminal processing unit 25 before the start of the event, but is stored in the user information storage unit 211 in advance. It may have been done. Further, for example, the language identifier of the stored user information may be changed according to the reception of the voice change operation by the terminal reception unit 22 from the start to the end of the event.

Now, it is assumed that the A lecture has started and the simultaneous interpretation voice and the like have started to be distributed by the simultaneous interpretation system. The processing unit 13 of the server device 1 acquires the current time from the built-in clock or the like in response to the start of transmission of the simultaneous interpretation voice or the like by the transmission unit 14, and the variable “transmission start” indicating the time when the transmission is started. Set the acquired current time in "Time".

The speaker device 3 receives the utterance voice of speaker A in Japanese via the built-in microphone, captures the image of speaker A with the built-in camera, and captures the received utterance voice and the captured image on a network or the like. The operation of transmitting to the server device 1 via the above is started.

The interpreter device 4x starts an operation of receiving the simultaneous interpretation voice of the interpreter x in English and transmitting it to the server device 1. The interpreter device 4y starts an operation of receiving the simultaneous interpretation voice of the interpreter y in Chinese and transmitting it to the server device 1.

In the server device 1, the receiving unit 12 receives information such as the simultaneous interpretation voice in English, the simultaneous interpretation voice in Chinese, the utterance voice in Japanese, and the video, and the processing unit 13 receives the information. The information is stored in the storage unit 11. Here, among the received information, three voices, a simultaneous translation voice in English, a simultaneous translation voice in Chinese, and a utterance voice in Japanese, are stored in the first buffer area. The multiplexing unit 132 multiplexes the three voices stored in the first buffer area and acquires the multiplexed voice. The processing unit 13 replaces the original three voices in the first buffer area with the acquired demultiplexed voice.

Of the received information, only two simultaneous interpretation voices, one in English and the other in Chinese, are stored in the first buffer area, and the spoken voice in Japanese is not stored. You may. In this case, the multiplexing unit 132 multiplexes the two simultaneous interpretation voices and acquires the multiplexed voice. Alternatively, the multiplexing unit 132 multiplexes the two simultaneous translation voices, acquires the first multiplexed voice, and multiplexes the three voices including the spoken voice in Japanese to obtain the second multiplexed voice. You may get it.

The simultaneous interpretation information acquisition unit 131 acquires simultaneous interpretation information including the multiplexed audio acquired by the multiplexing unit 132 and the video stored in the storage unit 11, and the processing unit 13 acquires the acquired simultaneous interpretation. The information is stored in the second buffer area of the storage unit 11.

The simultaneous interpretation information acquisition unit 131 acquires simultaneous interpretation information including the second multiplexed audio acquired by the multiplexing unit 132 and the video stored in the storage unit 11, and the processing unit 13 obtains the simultaneous interpretation information. The acquired simultaneous interpretation information may be stored in the second buffer area of the storage unit 11.

The processing unit 13 periodically determines whether or not the amount of the first buffer, which is the amount of data of one simultaneous interpreting voice or the multiplexed voice stored in the first buffer area, is equal to or greater than or greater than the threshold value. If the buffer amount is equal to or greater than the threshold value or exceeds the threshold value, it is determined that the data is delivered to the first venue.

Upon receiving such a determination result, the transmission unit 14 is stored in the first buffer area in two or more terminal devices 2a and 2b existing in the venue X, which is the first venue, via the first communication means 141. The first transmission process of transmitting one simultaneous interpretation voice or multiplexed voice is started.

The first transmission process ends when the lecture A ends and the untransmitted simultaneous translation voice or the multiplexed voice stored in the first buffer area disappears.

In the terminal device 2a, when the terminal receiving unit 24 receives the simultaneous interpretation voice or the multiplexed voice, and the demultiplexed voice is received, the demultiplexed unit 251 performs demultiplexing to perform demultiplexing, and the original 2 or more. Get the voice of. Here, it is assumed that the multiplexed voice is received, and three voices, a simultaneous translation voice in English, a simultaneous translation voice in Chinese, and a spoken voice in Japanese, are acquired.

The voice selection unit 252 selects the voice corresponding to the language identifier of the user information stored in the user information storage unit 211 from the three acquired voices, and the terminal output unit 26 selects the selected voice. Audio is output via the speaker. Here, among the above three voices, the "simultaneous interpretation voice in English" corresponding to the language identifier "English" possessed by the user information "(a, X, English)" is selected and output.

As a result, the simultaneous interpretation voice in English is output from the speaker of the terminal device 2a, and the user a can listen to the speaker A's story in English.

The terminal device 2b also receives the multiplexed voice, and the above three voices are acquired by demultiplexing. Then, of the three acquired voices, the "simultaneous interpretation voice in Chinese" corresponding to the language identifier "middle" of the stored user information "(b, X, middle)" is selected, and the voice is selected. The selected audio is output. As a result, the simultaneous interpretation voice in Chinese is output from the speaker of the terminal device 2b, and the user b can listen to the speaker A's speech in Chinese.

Further, the processing unit 13 periodically or irregularly determines whether or not the amount of the second buffer, which is the amount of data of the simultaneous interpretation information stored in the second buffer area, is equal to or greater than or greater than the threshold value. If it is determined that the amount of the second buffer is equal to or greater than the threshold value or exceeds the threshold value, it is determined that the distribution is performed to the two venues Y and Z, which are the second venues. In response to such a determination result, the transmission unit 14 transmits one or more terminal devices 2c and the like existing in the venue Y and one or more terminal devices 2d existing in the venue Z via the second communication means 142. The second transmission process for transmitting the simultaneous interpretation information stored in the second buffer area is started.

The second transmission process ends when the lecture A ends and the untransmitted simultaneous interpretation information stored in the second buffer area disappears.

In the terminal device 2c, the terminal receiving unit 24 receives the simultaneous interpretation information, and the demultiplexing unit 251 performs demultiplexing when the received simultaneous interpretation information includes the multiplexed voice. Get the original two or more voices. Here, it is assumed that the simultaneous interpretation information includes the multiplexed voice, and the above three voices are acquired. The voice selection unit 252 selects the voice corresponding to the language identifier "English" of the stored user information "(c, Y, English)" from the three acquired voices, and the terminal output unit 26 Outputs the selected audio through the speaker.

Further, the terminal output unit 26 outputs the video included in the received simultaneous interpretation information via the display. As a result, the image of the speaker A is displayed on the display of the terminal device 2c, and the simultaneous interpretation voice in English is output from the speaker of the terminal device 2c. Therefore, the user c can listen to the speaker A's story in English while watching the speaker A's image.

In the terminal device 2d, the same processing as described above is performed, the video of the speaker A is displayed, and the simultaneous interpretation voice in English is output. Therefore, the user d can listen to the speaker A's story in English while watching the speaker A's image.

When the transmission unit 14 finishes transmitting the simultaneous interpretation voice and the like in the server device 1, the reception unit 15 accepts the input of the flag indicating public or private. The processing unit 13 has a simultaneous interpretation voice stored in the storage unit 11, the accepted flag, and an event identifier “A lecture” stored in the user information group storage unit 111 or the like. Information is configured and stored in the simultaneous interpretation-related information storage unit 112.

The simultaneous interpretation-related information storage unit 112 may also accumulate simultaneous interpretation-related information regarding other events (for example, "B lecture" described in Specific Example 2). Of the one or more simultaneous interpretation-related information stored in the simultaneous interpretation-related information storage unit 112, one or more simultaneous interpretation-related information having a flag indicating disclosure is uploaded to an external server by the upload unit 139. .. The uploading of information related to simultaneous interpretation will be described in Specific Example 3.

The processing when the voice change instruction is input during the output of the simultaneous interpretation voice or the like is as follows. For example, in the terminal device 2a, if the user a inputs a voice change instruction having the language code "medium" via an input device such as a touch panel while outputting the simultaneous translation voice in English, the terminal reception unit 22 Receives the voice change instruction, and the terminal processing unit 25 changes the language code "English" of the user information "(a, X, English)" stored in the user information storage unit 211. Change to the language code "medium" that the instruction has.

In response to this, the voice selection unit 252 selects "simultaneous interpretation voice in Chinese" corresponding to the changed language identifier "middle" from the above three voices, and the terminal output unit 26 is selected. Output the audio. As a result, the voice output from the terminal device 2a is switched from the simultaneous interpretation voice in English to the simultaneous interpretation voice in Chinese, and the user a can listen to the speaker A's speech in Chinese.

In each of the other terminal devices 2b to 2f and the like, the voice can be changed by the same processing as described above.

When the transmission unit 14 finishes transmitting the simultaneous interpretation information or the like in the server device 1, the processing unit 13 acquires the current time from the built-in clock or the like and sets the variable “transmission end time” indicating the time when the transmission is completed. Set the acquired current time. Next, the processing unit 13 subtracts the value of the variable "transmission start time" from the value of the variable "transmission end time", and sets the result of the subtraction in the variable "interpretation provision time" indicating the interpretation provision time. Further, the processing unit 13 counts the number of user information stored in the user information group storage unit 111, and sets the result of the counting in the variable "number of interpreter enjoyers" indicating the number of interpreters enjoyed.

The above two variables "interpretation provision time" and "number of interpreter recipients" are used when calculating the reward. The calculation of the reward will be described in Specific Example 4.

(Specific example 2)
Specific example 2 is for "B lecture", which is an event to listen to speaker B's lecture, and the spoken voice of speaker B in English and the spoken voice are simultaneously translated into Japanese by one interpreter z. One simultaneous interpretation voice and a video of speaker B are acquired, and the multiplexed voice obtained by multiplexing the two acquired voices is transmitted to speaker B by a first communication means 141 such as a wireless LAN. , The simultaneous interpretation information including the multiplexed audio and video is distributed to the venue P, which is the first venue where one or more listeners including the user e are present, by the second communication means 142 such as the Internet, including the user f. This is an example of distribution to venue Q, which is the second venue where only one or more listeners are present.

In this example, the interpreter z is at home and performs simultaneous interpretation while listening to the spoken voice output from the interpreter device 4. Further, it is assumed that the "B lecture" was held after the "A lecture".

The information system in this example includes server devices 1, 2 or more terminal devices 2, a speaker device 3, and one interpreter device 4. The speaker device 3 exists in the venue P, and the interpreter device 4 exists in the home of the interpreter z. Of the two or more terminal devices 2, one terminal device 2 (hereinafter, terminal device 2e) is a mobile terminal of the user e and exists in the venue P. Of the two or more terminal devices 2, the other terminal device 2 (hereinafter, terminal device 2f) is a mobile terminal of the user f and exists in the venue Q.

As shown in FIG. 8, for example, the storage unit 11 of the server device 1 stores a second venue type information group in association with the event identifier “B lecture”. An ID is associated with each of the two venue type information constituting the venue type information group corresponding to the event identifier "B lecture". For example, the venue type information 1 associated with the ID "1" has a venue identifier "P" and a type information "first venue". Similarly, the venue type information 2 has a venue identifier “Q” and a type information “second venue”.

The user information group storage unit 111 stores, for example, a second user information group composed of two user information as shown in FIG. 9 in association with the event identifier "B lecture". An ID is associated with each of the two or more user information constituting the user information group corresponding to the event identifier "B lecture". For example, the user information 1 associated with the ID "1" is the user identifier ". It has an e ”, a venue identifier“ P ”, and a language identifier“ day ”. Similarly, the user information 2 has a user identifier "f", a venue identifier "Q", and a language identifier "English".

The user information "(e, P, day)" corresponding to the user information 1 is stored in the user information storage unit 211 of the terminal device 2e. The user information "(f, Q, English)" corresponding to the user information 2 is stored in the user information storage unit 211 of the terminal device 2f.

Now, it is assumed that the B lecture has started and the simultaneous interpretation voice and the like have started to be distributed by the simultaneous interpretation system. The processing unit 13 of the server device 1 acquires the current time from the built-in clock or the like in response to the start of transmission of the simultaneous interpretation voice by the first communication means 141, and sets the variable “transmission start time”. do.

The speaker device 3 receives the spoken voice of the speaker B in English via the built-in microphone, shoots the image of the speaker B with the built-in camera, and captures the spoken voice and the shot video on a network or the like. The operation of transmitting to the server device 1 via the above is started. The interpreter device 4z starts an operation of receiving the simultaneous interpretation voice of the interpreter z in Japanese and transmitting it to the server device 1.

In the server device 1, the receiving unit 12 receives information such as the simultaneous interpretation voice in Japanese, the utterance voice in English, and the video, and the processing unit 13 stores the received information in the storage unit 11. do. Of the received information, two voices, a simultaneous interpretation voice in Japanese and a spoken voice in Japanese, are stored in the first buffer area. The multiplexing unit 132 multiplexes the two voices stored in the first buffer area and acquires the multiplexed voice. The processing unit 13 replaces the original two voices in the first buffer area with the acquired multiplexed voice.

Of the received information, only the simultaneous interpretation voice in Japanese is stored in the first buffer area, and the spoken voice in English does not have to be stored. In this case, the multiplexing unit 132 does not perform multiplexing.

The simultaneous interpretation information acquisition unit 131 acquires simultaneous interpretation information including the multiplexed audio acquired by the multiplexing unit 132 and the video stored in the storage unit 11, and the processing unit 13 acquires the acquired simultaneous interpretation. The information is stored in the second buffer area of the storage unit 11.

The simultaneous interpretation information acquisition unit 131 acquires simultaneous interpretation information including the simultaneous interpretation audio and video in Japanese, and the processing unit 13 stores the acquired simultaneous interpretation information in the second buffer area of the storage unit 11. May be accumulated in.

When the amount of the first buffer, which is the amount of data of one simultaneous translation voice or the multiplexed voice stored in the first buffer area, becomes equal to or larger than the threshold value or becomes larger than the threshold value, the processing unit 13 is the venue P, which is the first venue. Judge to deliver to. In response to such a determination result, the transmission unit 14 transmits one simultaneous interpretation voice stored in the first buffer area in one or more terminal devices 2e or the like existing in the venue P via the first communication means 141. Alternatively, the first transmission process for transmitting the multiplexed voice is started. The first transmission process is stopped when the lecture B ends and the untransmitted simultaneous translation voice or the multiplexed voice stored in the first buffer area disappears.

In the terminal device 2e, when the terminal receiving unit 24 receives the simultaneous interpretation voice or the multiplexed voice, and the demultiplexed voice is received, the demultiplexed unit 251 performs demultiplexing to perform demultiplexing, and the original 2 or more. Get the voice of. Here, it is assumed that the multiplexed voice is received and two voices, a simultaneous interpretation voice in Japanese and an utterance voice in English, are acquired.

The voice selection unit 252 uses "Japanese" corresponding to the language identifier "day" of the user information "(e, P, day)" stored in the user information storage unit 211 of the two acquired voices. "Simultaneous interpretation voice by" is selected, and the terminal output unit 26 outputs the selected voice via the speaker. As a result, the simultaneous interpretation voice in Japanese is output from the speaker of the terminal device 2e, and the user e can listen to the speaker B's story in Japanese.

Further, when the amount of the second buffer, which is the amount of data of the simultaneous interpretation information stored in the second buffer area, is equal to or greater than the threshold value or becomes larger than the threshold value, the processing unit 13 delivers the data to the venue Q, which is the second venue. Judge. In response to such a determination result, the transmission unit 14 transmits the simultaneous interpretation information stored in the second buffer area in one or more terminal devices 2f or the like existing in the second venue Q via the second communication means 142. The second transmission process for transmitting is started. Here, it is assumed that simultaneous interpretation information including the multiplexed audio and video is transmitted. Further, the second transmission process is stopped when the lecture B ends and the untransmitted simultaneous interpretation information stored in the second buffer area disappears.

In the terminal device 2f, the terminal receiving unit 24 receives the simultaneous interpretation information, and the demultiplexing unit 251 demultiplexes the multiplexed voice included in the simultaneous interpretation information and acquires the two voices. The voice selection unit 252 selects "simultaneous interpretation voice in English" corresponding to the language identifier "English" of the stored user information "(f, Q, English)" from the two acquired voices. Then, the terminal output unit 26 outputs the selected voice through the speaker. As a result, the spoken voice in English is output from the speaker of the terminal device 2f, and the user b can listen to the speaker B's story in the original language (that is, in English) while watching the speaker B's image. ..

When the transmission unit 14 finishes transmitting the simultaneous interpretation voice and the like in the server device 1, the reception unit 15 accepts the input of the flag, and the processing unit 13 receives the simultaneous interpretation voice stored in the storage unit 11 and the reception. Simultaneous interpretation-related information having the flag and the event identifier "B lecture" stored in the user information group storage unit 111 or the like is configured and stored in the simultaneous interpretation-related information storage unit 112.

(Specific example 3)
The specific example 3 is an example in which the advertisement information is transmitted in a timely manner when the simultaneous interpretation voice or the like is distributed in the above specific example 1.

In the advertisement information storage unit 113, for example, three or more pairs of language identifiers and advertisement information are stored as shown in FIG. FIG. 10 is a diagram showing the contents of the advertisement information storage unit 113. The pair of the language identifier and the advertisement information is, for example, the pair of the language identifier "day" and the advertisement information "xx.mp4", the pair of the language identifier "English" and the advertisement information "yy.mp4", and the language identifier ". It is a pair of "medium" and the advertisement information "zz.mp4". The advertisement information "xx.mp4" is information on advertisements in Japanese, and includes Japanese audio and video. The advertisement information "yy.mp4" is information on advertisements in English, and includes audio and video in English. The advertisement information "zz.mp4" is information on advertisements in Chinese, and includes audio and video in Chinese.

The advertising information including audio and video as described above is suitable for transmission by the second communication means 142, but may be transmitted by the first communication means 141. However, the advertisement information does not include video and may include audio. Such advertising information including only voice is suitable for transmission by the first communication means 141, but may be transmitted by the second communication means 142.

Further, the video in this example is, for example, a video common to two or more advertisement information, but may be different.

The operator of the server device 1 inputs the advertisement information via an input device such as a keyboard at an appropriate timing such as immediately before starting the distribution of the simultaneous interpretation voice or the like, during a break, or immediately after the distribution of the simultaneous interpretation voice or the like is completed. Enter the instruction to send.

In the server device 1, the reception unit 15 receives the above instruction, and the language identifier acquisition unit 134 acquires the language identifier of the simultaneous interpretation voice to be distributed. When a multiplexed voice obtained by multiplexing two or more voices is delivered, the language identifier of each of the two or more voices is acquired. Therefore, for example, as in Specific Example 1, when a multiplexed voice in which three voices are multiplexed, a simultaneous translation voice in English, a simultaneous translation voice in Chinese, and a utterance voice in Japanese, is delivered. Is acquired with three language identifiers "English", "Chinese", and "Japanese" corresponding to the three voices.

The advertisement information selection unit 135 acquires the advertisement information corresponding to each of the acquired one or more language identifiers from the advertisement information storage unit 113. Therefore, for example, when three language identifiers "English", "Chinese", and "Japanese" are acquired, the advertisement information "yy.mp4" corresponding to the language identifier "English" and the language identifier "Chinese" are used. Three types of advertising information are acquired: the corresponding advertising information "zz.mp4" and the advertising information "xx.mp4" corresponding to the language identifier "day".

The transmission unit 14 transmits the selected one or more advertisement information to one or more terminal devices 2. The one or more advertising information is transmitted by one or more of the first communication means 141 or the second communication means 142. In this example, the second communication means 142 transmits the selected one or more advertisement information to the terminal device 2 in each of the one or more second venues, and the first communication means 141 is the advertisement information. It shall not be transmitted. Therefore, the three acquired advertisement information is transmitted to one or more terminal devices 2c and the like in the venue Y and one or more terminal devices 2c and the like in the venue Z.

In the terminal device 2c, the terminal receiving unit 24 receives the above three advertisement information, and the terminal output unit 26 receives the user information "of the three received advertisement information, which is stored in the user information storage unit 211." The advertisement information "yy.mp4" corresponding to the language identifier "English" possessed by "(a, X, English)" is output via an output device such as a speaker or a display. As a result, the advertisement is output from the terminal device 2c in the same language as the simultaneous interpretation information. Similarly, the advertisement is output from the terminal device 2d in the same language as the simultaneous interpretation information. As a result, the effectiveness of the advertisement for the users in the second venue can be enhanced.

(Modification of Specific Example 3)
The advertisement information storage unit 113 has two types of advertisement information, a first advertisement information that does not include video and includes only audio, and a second advertisement information that includes video and audio in association with one language identifier. May be stored.

The advertisement information selection unit 135 selects the first and second advertisement information corresponding to the language identifier acquired by the language identifier acquisition unit 134 from the advertisement information storage unit 113. Then, the first communication means 141 transmits the first advertisement information out of the two selected advertisement information to the terminal device 2 in the first venue. Further, the second communication means 142 transmits the second advertisement information out of the two selected advertisement information to the terminal device 2 in each one or more second venues.

Therefore, when the three language identifiers "English", "Chinese", and "Japanese" are acquired, the first and second two advertising information corresponding to the language identifier "English" (for example, "yy1.mp4"). "And" yy2.mp4 "), the first and second advertising information corresponding to the language identifier" medium "(eg," zz1.mp4 "and" zz2.mp4 "), and the language identifier" day ". The first and second advertising information (for example, "xx1.mp4" and "xx2.mp4") corresponding to the above are selected.

The first communication means 141 has two or more selected first advertisement information (for example, "yy1.mp4", "zz1.mp4", and "xx1.mp4") existing in the venue X. It is transmitted to the terminal devices 2a and 2b and the like. The second communication means 142 transmits the three selected second advertisement information (for example, “yy2.mp4”, “zz2.mp4”, and “xx2.mp4”) to one or more existing in the venue Y. It is transmitted to the terminal device 2c and the like of the above, and one or more terminal devices 2d and the like existing in the venue Z.

As a result, the audio-only advertisement is output from the terminal device 2a or the like in the same language as the simultaneous interpretation audio, and the advertisement including the audio and video is output from the terminal device 2d or the like in the same language as the simultaneous interpretation information. NS. As a result, it is possible to enhance the effectiveness of the advertisement for each of the users in the first venue and the users in the second venue while suppressing the amount of communication.

(Specific example 4)
Specific example 4 is an example of calculating the remuneration for each of two or more related parties including the operator and the interpreter.

For example, the reward calculation information as shown in FIG. 11 is stored in the reward calculation information storage unit 114. FIG. 11 is a data structure diagram of the reward calculation information. This remuneration calculation information includes the operator remuneration calculation information "(operator, α1 x interpreter provision time + β1 x number of interpreter recipients)" and the interpreter remuneration calculation information "(operator, α2 x interpreter provision time + β2 x interpreter enjoyment). Number of people) ”etc. are included.

The remuneration calculation unit 137 uses the stored remuneration calculation information and the two variables “interpretation provision time” and “interpretation provision time” described in Specific Example 1 to the operator and the interpreter. Calculate the reward.

Specifically, for example, in the storage unit 11, the first coefficient information "(0 yen, 100 yen)" indicating the set of coefficients (α1, β1) corresponding to the operator, and the set of coefficients corresponding to the interpreter (α2). , Β2) The second coefficient information (2000 yen, 10 yen) is stored, the variable "interpretation provision time" is "2 hours", and the variable "number of interpreter recipients" is "2000". Then, the reward calculation unit 137 has "α1 = 0 yen, β1 = 100 yen, interpreter provision time =" with respect to the increase function "α1 × interpreter provision time + β1 × number of interpreter beneficiaries" possessed by the operator compensation calculation information. By substituting "2 hours, number of interpreter recipients = 2000"
The remuneration to the operator is calculated as "0 yen x 2 hours + 100 yen x 2000 people = 200,000 yen", and the calculation result "(operator, 200,000 yen)" is obtained.

In addition, the remuneration calculation unit 137 has "α2 = 2000 yen, β2 = 10 yen, interpreter provision time = 2" for the increasing function "α2 x interpreter provision time + β2 x number of interpreter beneficiaries" possessed by the interpreter remuneration calculation information. By substituting "time, number of interpreters = 2000", the reward for the interpreter is calculated as "2000 yen x 2 hours + 10 yen x 2000 = 24,000 yen", and the calculation result is "(interpreter). Person, 24,000 yen) ”.

The reward output unit 161 outputs reward information "(operator, 200,000 yen), (interpreter, 24,000 yen)" including the two acquired calculation results via an output device such as a display. ..

It is preferable that the reward output unit 161 configures and outputs a screen including the reward information by using, for example, the two acquired calculation results.

For example, screen configuration information is stored in the storage unit 11. The screen configuration information is information for configuring the screen. The screen configuration information includes, for example, one or more images, one or more character strings, layout information, and the like. The image is, for example, a table, but may be a button, a dialog box, or the like, and the type thereof does not matter.

The character string is, for example, a fixed phrase. The fixed phrase is, for example, "The rewards for the parties concerned are as follows." However, the content does not matter. Alternatively, the character string may be, for example, a template sentence. A template sentence is a sentence containing a variable {}. The template sentences are, for example, "The target of this interpretation service is {event identifier}.", "The provision time of the interpretation service was {interpretation provision time}.", "The number of users of the interpretation service is {interpretation." It was the number of beneficiaries}. ”, But the content and structure do not matter.

The layout information is information indicating the arrangement of two or more elements such as figures and character strings on the screen. The layout information is composed of, for example, a set of two or more coordinates, but the structure does not matter.

The reward output unit 161 performs the following processing using, for example, the stored screen configuration information and the two acquired calculation results. That is, the reward output unit 161 describes the reward information by arranging the two calculation results "(operator, 200,000 yen)" and "(interpreter, 24,000 yen)" in the above table. Get the table. Further, the reward output unit 161 substitutes the three variables {event identifier}, {interpretation provision time}, and {number of interpreter recipients} into the above three template sentences, respectively, to obtain three completed sentences. get. Then, the reward output unit 161 configures a screen by arranging the table in which the reward information is described, the fixed phrase, and the three completed sentences according to the layout information, and displays the configured screen on the display. Output via.

As a result, for example, a screen as shown in FIG. 12 is displayed on the display of the server device 1. FIG. 12 is a diagram showing an output example of reward information. The operator can know the rewards to each person concerned, as well as the provision time and the number of beneficiaries, for the interpretation service provided for the "A lecture".

(Modification of Specific Example 4)
The advertising fee storage unit (not shown) of the storage unit 11 stores advertising fee information (for example, "500,000 yen") related to the advertising fee paid by the advertiser as a consideration for the transmission of the advertising information described in the specific example 3. Will be done. The reward calculation information stored in the reward calculation information storage unit 114 is a set of a set of the related party identifier and the ratio information. For example, the operator advertisement fee calculation information "(operator, X% of the advertisement fee)", Also includes interpreter advertising fee calculation information (interpreter, 10,000 yen + Z% of advertising fee). Further, "X = 4, Z = 2" is stored in the storage unit 11.

The remuneration calculation department 137 uses the operator remuneration calculation information "(operator, X% of advertising fee)", the advertising fee information "500,000 yen", and "X = 1" to "reward the operator". Calculate 500,000 yen x (4/10) "and obtain the calculation result" operator, 200,000 yen ". In addition, the compensation calculation unit 137 uses the interpreter compensation calculation information "(interpreter, 10,000 yen + Z% of the advertising fee)", the advertising fee information "500,000 yen", and "Z = 2". , Calculate the reward "10,000 yen + 500,000 yen x (2/100)" for the interpreter, and obtain the calculation result "interpreter, 20,000 yen".

The remuneration output unit 161 outputs remuneration information "(operator, 200,000 yen), (interpreter, 20,000 yen)" including the two acquired calculation results.

(Specific example 5)
Specific Example 5 is an example of uploading simultaneous interpretation-related information stored in the simultaneous interpretation-related information storage unit 112 in Specific Example 1 and the like.

The simultaneous interpretation-related information storage unit 112 stores, for example, two or more simultaneous interpretation-related information as shown in FIG. FIG. 13 is a data structure diagram of information related to simultaneous interpretation. Simultaneous interpretation-related information includes simultaneous interpretation information, an event identifier, and a flag. Simultaneous interpretation information includes one or more simultaneous interpretation voices (for example, simultaneous interpretation voice 1 in English and simultaneous interpretation voice 2 in Chinese), spoken voice (for example, spoken voice in Japanese), and video (for example, spoken voice in Japanese). For example, a video of speaker A) is included.

An ID is associated with each of the two or more simultaneous interpretation-related information. For example, the simultaneous interpretation-related information 1 associated with the ID "1" includes the simultaneous interpretation voice 1 "aa1.mp3", the simultaneous translation voice 2 "aa2.mp3", the spoken voice "aa3.mp3", and the video "aa.mp3". It has simultaneous interpretation information "(aa1.mp3, aa2.mp3, aa3.mp3, aa.mp4)" including "mp4", an event identifier "A lecture", and a flag "public".

Similarly, the simultaneous interpretation-related information 2 includes simultaneous interpretation information "(bb1.mp3, bb2.mp3, bb3.mp3, bb.mp4)", an event identifier "B lecture", and a flag "private". Have.

The storage unit 11 stores the timing information "21:00 every day", and the processing unit 13 determines whether or not the current time acquired from the built-in clock or the like is the timing indicated by the stored timing information. Is determined regularly or irregularly. When it is determined that the current time is the timing indicated by the timing information, the inspection unit 138 inspects the respective flags (for example, flags 1 and 2) of the two stored simultaneous interpretation related information 1 and 2. , Acquires inspection result information "(flag 1, public), (flag 2, private)" including the two inspection results.

The uploading unit 139 uses the inspection result information acquired by the inspection unit 138, and for each of the two inspection results, the inspection result is the inspection result that the simultaneous interpretation information is disclosed, or the simultaneous interpretation information is not disclosed. If it is the inspection result that the simultaneous interpretation information is not disclosed, the inspection that the simultaneous interpretation information is disclosed without uploading the simultaneous interpretation related information corresponding to the inspection result. Only when it is a result, the information related to simultaneous interpretation corresponding to the inspection result is uploaded to an external server. As a result, the simultaneous interpretation-related information 2 having the flag indicating non-disclosure is not uploaded, and only the simultaneous interpretation-related information 1 having the flag indicating disclosure is uploaded to the external server.

As a result, even a user other than the registered user (for example, users a to f) whose user information is stored in the user information group storage unit 111 can view the simultaneous interpretation information by accessing the external server. can.

As described above, according to the present embodiment, the server device 1 acquires the simultaneous interpretation information including the simultaneous interpretation voice that the interpreter simultaneously interprets the spoken voice spoken in the first venue, and obtains two or more simultaneous interpretation information. It is transmitted to the terminal device 2 of. At that time, the server device 1 transmits at least the simultaneous interpretation voice to the terminal device 2 existing in the first venue by the first communication means 141, and in each one or more second venues different from the first venue. Simultaneous interpretation information is transmitted to the existing terminal device 2 by the second communication means 142. The first communication means 141 and the second communication means 142 are different communication means. As a result, information such as simultaneous interpretation voice can be accurately distributed to the first venue where the speaker and the listener are present and the second venue where only the listener is present.

Further, in the above configuration, since the first communication means 141 is a communication means having a lower delay than the second communication means 142, at least simultaneous interpretation voice is uttered at the first venue where the speaker and the listener are present. It can be delivered with low delay for audio.

Further, in the above configuration, the second communication means 142 is a communication means having a higher quality than the first communication means 141, so that the second venue where only the listener is present may be, for example, an image in the first venue. , Simultaneous interpretation Simultaneous interpretation information including information other than voice can be delivered with high quality.

Further, in the above configuration, the first communication means 141 and the second communication means 142 transmit different information, so that at least simultaneous interpretation voice is transmitted to the first venue where the speaker and the listener are present. On the other hand, simultaneous interpretation information including information other than simultaneous interpretation audio can be distributed with high quality to the second venue where only listeners are present.

Further, the server device 1 acquires an image of the inside of the first venue, the simultaneous interpretation information includes the image, and the first communication means 141 does not transmit the image but transmits the simultaneous interpretation audio. By transmitting the simultaneous interpretation audio and the video, the second communication means 142 can deliver at least the simultaneous interpretation audio to the first venue where the speaker and the listener are present, while suppressing the delay with respect to the spoken audio to a low level, while the listener. Simultaneous interpretation information including the video inside the first venue can be delivered with high quality to the second venue where only the venue is located.

Further, the simultaneous interpretation-related information storage unit 112 stores the simultaneous interpretation information acquired by the simultaneous interpretation information acquisition unit 131 and the simultaneous interpretation-related information having a flag indicating either public or private, and the server device 1 stores the simultaneous interpretation-related information. , When the flag is inspected and the result of the flag inspection is the inspection result that the simultaneous interpretation information is disclosed, the simultaneous interpretation information is disclosed by uploading the simultaneous interpretation related information corresponding to the flag to an external server. You can manage private.

Further, in the above configuration, the simultaneous interpretation information includes two or more voices of the spoken voice or one or two or more simultaneous translation voices in which one or two or more interpreters simultaneously translate the spoken voice into different languages. The server device 1 multiplexes two or more voices and acquires the multiplexed voice, and one or more of the first communication means 141 and the second communication means 142 has one or more terminals for the multiplexed voice. By transmitting to the device 2, simultaneous interpretation voice in multiple languages can be distributed.

Further, the advertisement information which is the advertisement information is stored in the advertisement information storage unit 113, and one or more of the first communication means 141 and the second communication means 142 store the advertisement information in one or more terminal devices. By transmitting to 2, the advertisement information can be accurately delivered. In addition, the advertiser can obtain an advertising fee that is a source of rewards to the parties concerned.

Further, the reward calculation information storage unit 114 stores the reward calculation information for calculating the reward to two or more related parties involved in the transmission of the simultaneous interpretation information, and the server device 1 uses the reward calculation information. By calculating the remuneration for each of two or more related parties and outputting the remuneration information that specifies the remuneration, the remuneration for each of the two or more related parties can be automatically calculated.

Further, in the above configuration, the two or more related parties include the interpreter, the compensation calculation information includes the interpreter compensation calculation information for calculating the compensation to the interpreter, and the server device 1 includes the interpreter compensation calculation. By using the information to calculate the reward for the interpreter, the reward for the interpreter can be calculated automatically.

Further, the server device 1 includes the interpretation provision time information that specifies the length of the period during which the simultaneous interpretation information is transmitted, and the number of interpreter beneficiaries information that specifies the number of the terminal devices 2 to which the simultaneous interpretation information is transmitted. By acquiring one or more interpreter attribute values and calculating the interpreter's reward using one or more interpreter attribute values, the interpreter's reward can be accurately calculated.

In the above configuration, it is preferable that the server device 1 obtains a higher reward, for example, the longer the interpretation provision time information indicates, and the larger the number indicated by the interpretation enjoyer number information.

Further, the advertisement information storage unit 113 stores two or more advertisement information in association with the language identifier that identifies the language, and the server device 1 acquires the language identifier that identifies the language of the simultaneous interpretation voice being transmitted. Then, from the two or more advertising information, the advertising information corresponding to the acquired language identifier is selected, and one or more of the first communication means 141 and the second communication means 142 are used. By transmitting the advertisement information selected by the advertisement information selection unit 135 to the terminal device 2 of the above, the effect of the advertisement can be enhanced.

Further, the terminal device 2 of the present embodiment receives the multiplexed voice transmitted from the server device 1, demultiplexes the received multiplexed voice, acquires two or more voices, and obtains two or more voices. By outputting one or more of these voices, it is possible to receive the simultaneous translation voices of multiple languages and output the simultaneous translation voices of one or more languages.

In the present embodiment, the case where the simultaneous interpretation voice or the like is distributed to the lecture or the like spoken by only one speaker has been described, but the information system is a discussion in which two or more speakers speak. Simultaneous interpretation audio, etc. can also be distributed for meetings and plays. In the latter case, each of the two or more interpreters usually translates the story of any of the two or more speakers. The speaker and the interpreter have a one-to-one correspondence, for example, but a one-to-many correspondence may be used.

The number of speaker devices 3 constituting the information system shown in FIG. 1 is 2 or more. Each of the two or more speaker devices 3 pairs the spoken voice of the speaker corresponding to the speaker device 3 with a speaker identifier (for example, speaker name, ID, terminal identifier, etc.) that identifies the speaker. , Sent to server device 1.

In the storage unit 11 of the server device 1, for example, one of the venue type information corresponding to one event identifier (for example, one of the two venue type information shown in FIG. 8 corresponding to the event identifier "A lecture"". Of the two or more venue identifiers (for example, "X" to "Z") possessed by the eye venue type information), one venue identifier (for example, "X") corresponding to the type information indicating "first venue". One or more speaker identifiers are stored in association with. In addition, the storage unit 11 also stores, for example, correspondence information that is a set of pairs of a speaker identifier and an interpreter identifier.

The receiving unit 12 receives the uttered voice from each of the two or more speaker devices 3 in pairs with the speaker identifier, and the transmitting unit 14 uses the corresponding information to use the received uttered voice as the uttered voice. It is transmitted to the interpreter device 4 of the interpreter identified by the interpreter identifier corresponding to the pair of received speaker identifiers.

The interpreter device 4 receives the speaker voice and the like, and outputs the received speaker voice and the like. Then, the interpreter device 4 receives the simultaneous interpretation voice for the output speaker voice, and transmits the received simultaneous interpretation voice to the server device 1 in pairs with the received speaker identifier.

In the server device 1, the receiving unit 12 receives the pair of the simultaneous interpretation voice and the speaker identifier, and the processing unit 13 stores the received simultaneous interpretation voice in association with the speaker identifier in the storage unit 11. The first communication means 141 is one or more stories associated with a venue identifier associated with venue type information indicating "first venue" among two or more simultaneous interpretation voices stored in the storage unit 11. One or more simultaneous interpretation voices corresponding to the person identifier are acquired and transmitted to the terminal device 2 in the first venue identified by the venue identifier.

Further, the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and disseminated.

The software that realizes the server device 1 is, for example, the following program. That is, this program uses the computer to acquire the simultaneous interpretation information including the simultaneous interpretation voice that the interpreter simultaneously interprets the spoken voice spoken in the first venue, and the simultaneous interpretation information acquisition unit 131 and the simultaneous interpretation information. The transmission unit 14 functions as a transmission unit 14 for transmitting to two or more terminal devices 2, and the transmission unit 14 has a first communication means 141 that transmits at least the simultaneous interpretation voice to the terminal device 2 existing in the first venue. The terminal device 2 existing in each one or more second venues different from the first venue is provided with the second communication means 142 for transmitting the simultaneous interpretation information, and the first communication means 141 and the first communication means 141. The second communication means 142 is a program that is a different communication means.

In the above configuration, the simultaneous interpretation information is two or more voices of the spoken voice or one or two or more simultaneous translation voices in which one or two or more interpreters simultaneously translate the spoken voice into different languages. The program further functions as a multiplexing unit 132 that multiplexes the two or more voices and acquires the multiplexed voice, and one or more of the first communication means 141 and the second communication means 142. It is preferable that the communication means of the above transmits the multiplexed voice to one or more terminal devices 2.

The software that realizes the terminal device 2 is, for example, the following program. That is, this program demultiplexes the terminal receiving unit 24 that receives the multiplexed voice transmitted from the server device 1 and the multiplexed voice received by the terminal receiving unit 24, and acquires two or more voices. This is a program for functioning as a conversion unit 251 and a terminal output unit 26 that outputs one or more of the two or more voices.

FIG. 14 is an external view of a computer system 900 that executes a program according to the present embodiment to realize a server device 1, a terminal device 2, and the like. This embodiment can be realized by computer hardware and a computer program executed on the computer hardware. In FIG. 14, the computer system 900 includes a computer 901 including a disk drive 905, a keyboard 902, a mouse 903, a display 904, a camera 917, a microphone 918, and a speaker 919. The entire system including the keyboard 902, the mouse 903, the display 904, the camera 917, the microphone 918, and the speaker 919 may be called a computer.

FIG. 15 is a diagram showing an example of the internal configuration of the computer system 900. In FIG. 15, the computer 901 is connected to the MPU 911, the ROM 912 for storing a program such as a boot-up program, and the MPU 911 in addition to the disk drive 905, and temporarily stores the instructions of the application program and temporarily. It provides a RAM 913 that provides a storage space, a storage 914 that stores application programs, system programs, and data, a bus 915 that interconnects MPU 911, ROM 912, and the like, and a connection to a network such as an external network or an internal network. It includes a network card 916, a camera 917, a microphone 918, and a speaker 919. The storage 914 is, for example, a hard disk, an SSD, a flash memory, or the like.

The program for causing the computer system 900 to execute the function may be stored in, for example, a disc 921 such as a DVD or a CD-ROM, inserted into the disc drive 905, and transferred to the storage 914. Alternatively, the program may be transmitted over the network to computer 901 and stored in storage 914. The program is loaded into RAM 913 at run time. The program may be loaded directly from disk 921 or the network. Further, the program may be read into the computer system 900 via another removable recording medium (for example, a DVD, a memory card, etc.) instead of the disk 921.

The program does not necessarily include an operating system (OS) for executing the functions of the server device 1 and the terminal device 2, a third-party program, and the like in 901 showing the details of the computer. The program may contain only parts of instructions that call the appropriate functions or modules in a controlled manner to achieve the desired result. It is well known how the computer system 900 works, and detailed description thereof will be omitted.

The computer system 900 described above is a server or a stationary PC, but the terminal device 2 may be realized by a mobile terminal such as a tablet terminal, a smartphone, or a notebook PC. In this case, for example, the keyboard 902 and the mouse 903 may be replaced with a touch panel, the disk drive 905 may be replaced with a memory card slot, and the disk 921 may be replaced with a memory card. The basic hardware configuration of the speaker device 3 and the interpreter device 4 may be the same as described above. However, the above is an example, and the hardware configuration of the computer that realizes the server device 1, the terminal device 2, and the like does not matter.

In the above program, in the transmission step of transmitting information and the receiving step of receiving information, processing performed by hardware, for example, processing performed by a modem or interface card in the transmission step (only performed by hardware). Processing that is not done) is not included.

Further, the number of computers that execute the above program may be singular or plural. That is, one computer may perform centralized processing, or a plurality of computers may perform distributed processing.

Further, in the above embodiment, it goes without saying that the two or more communication means (reception unit 12, transmission unit 14, etc.) existing in one device may be physically realized by one medium.

Further, in the above embodiment, each process (each function) may be realized by centralized processing by a single device (system), or may be realized by distributed processing by a plurality of devices. You may.

It goes without saying that the present invention is not limited to the above embodiments, and various modifications can be made, and these are also included in the scope of the present invention.

As described above, the server device according to the present invention accurately distributes information such as simultaneous interpretation voice by the interpreter to the first venue where the speaker and the listener are present and the second venue where only the listener is present. It has the effect of being able to be used, and is useful as a server device or the like.

1 Server device 2 Terminal device 3 Speaker device 4 Interpreter device 5 Camera 11 Storage unit 12 Reception unit 13 Processing unit 14 Transmission unit 15 Reception unit 16 Output unit 21 Terminal storage unit 22 Terminal reception unit 23 Terminal transmission unit 24 Terminal reception unit 25 Terminal processing unit 26 Terminal output unit 111 User information group storage unit 112 Simultaneous interpretation related information storage unit 113 Advertising information storage unit 114 Reward calculation information storage unit 131 Simultaneous interpretation information acquisition unit 132 Multiplexing unit 133 Video acquisition unit 134 Language identifier acquisition Department 135 Advertising information selection unit 136 Interpreter attribute value acquisition unit 137 Reward calculation unit 138 Inspection unit 139 Upload unit 141 First communication means 142 Second communication means 161 Reward output unit 211 User information storage unit 251 Demultiplexing unit 252 Voice Selection section

Claims (18)

Simultaneous interpretation information acquisition department that acquires simultaneous interpretation information including simultaneous interpretation voice that the interpreter simultaneously translated the spoken voice spoken in the first venue,
It is provided with a transmission unit that transmits the simultaneous interpretation information to two or more terminal devices.
The transmitter
With the first communication means for transmitting at least the simultaneous interpretation voice to the terminal device existing in the first venue,
It is provided with a second communication means for transmitting the simultaneous interpretation information to a terminal device existing in each one or more second venues different from the first venue.
A server device in which the first communication means and the second communication means are different communication means. The server device according to claim 1, wherein the first communication means is a communication means having a lower delay than the second communication means. The server device according to claim 1 or 2, wherein the second communication means is a communication means having higher quality than the first communication means. The server device according to any one of claims 1 to 3, wherein the first communication means and the second communication means transmit different information. It is further equipped with a video acquisition unit for acquiring video shot in the first venue.
The simultaneous interpretation information includes the video and includes the video.
The first communication means is
Instead of transmitting the video, the simultaneous interpretation audio is transmitted,
The second communication means is
The server device according to claim 4, wherein the simultaneous interpretation audio and the video are transmitted. A simultaneous interpretation-related information storage unit that stores simultaneous interpretation-related information having a simultaneous interpretation information acquired by the simultaneous interpretation information acquisition unit and a flag indicating whether it is public or private, and a simultaneous interpretation-related information storage unit.
The inspection department that inspects the flag and
A claim further comprising an uploading unit that uploads simultaneous interpretation-related information corresponding to the flag to an external server when the inspection result of the flag of the inspection unit is an inspection result of disclosing simultaneous interpretation information. The server device according to any one of claims 1 to 5. The simultaneous interpretation information includes two or more voices of the spoken voice or one or two or more simultaneous interpreting voices obtained by simultaneously interpreting the spoken voice into different languages by one or two or more interpreters. It is further equipped with a multiplexing unit that multiplexes the voice of the above and acquires the multiplexed voice.
One or more of the first communication means and the second communication means
The server device according to any one of claims 1 to 6, wherein the multiplexed voice is transmitted to one or more terminal devices. Further provided with an advertisement information storage unit for storing advertisement information which is advertisement information,
One or more of the first communication means and the second communication means
The server device according to any one of claims 1 to 7, wherein the advertisement information is transmitted to one or more terminal devices. A remuneration calculation information storage unit that stores remuneration calculation information for calculating remuneration to two or more related parties involved in the transmission of the simultaneous interpretation information, and a remuneration calculation information storage unit.
Using the remuneration calculation information, the remuneration calculation department that calculates the remuneration for each of two or more related parties,
The server device according to claim 8, further comprising a reward output unit that outputs reward information that specifies the reward. The two or more parties concerned include an interpreter.
The remuneration calculation information includes the interpreter remuneration calculation information for calculating the remuneration to the interpreter.
The remuneration calculation department
The server device according to claim 9, wherein the interpreter's remuneration is calculated by using the interpreter's remuneration calculation information. Interpretation provision time information that specifies the length of the period during which the simultaneous interpretation information is transmitted by the transmission unit, and information on the number of interpreter beneficiaries that specifies the number of terminal devices to which the simultaneous interpretation information is transmitted by the transmission unit. An interpreter attribute value acquisition unit for acquiring one or more of the interpreter attribute values is further provided.
The remuneration calculation department
The server device according to claim 10, wherein a reward to the interpreter is calculated using the one or more interpreter attribute values. In the advertisement information storage unit,
Two or more advertising information is stored in association with the language identifier that identifies the language.
A language identifier acquisition unit that acquires a language identifier that identifies the language of the simultaneous interpretation voice transmitted by the transmission unit, and a language identifier acquisition unit.
Of the two or more advertisement information, the advertisement information selection unit for selecting the advertisement information corresponding to the language identifier acquired by the language identifier acquisition unit is further provided.
The transmitter
Claim 8 for transmitting the advertisement information selected by the advertisement information selection unit to one or more terminal devices by using one or more communication means of the first communication means and the second communication means. Item 11. The server device according to any one of the items. A terminal receiving unit that receives the multiplexed voice transmitted from the server device according to claim 7.
A demultiplexing unit that demultiplexes the multiplexed voice received by the terminal receiving unit and acquires two or more voices, and a demultiplexing unit.
A terminal device including a terminal output unit that outputs one or more of the two or more voices. A voice selection unit for selecting one of the two or more voices is further provided.
The terminal device according to claim 13, wherein the terminal output unit outputs the above-mentioned one voice. It is a simultaneous interpretation voice transmission method realized by the simultaneous interpretation information acquisition unit and the transmission unit.
A simultaneous interpretation information acquisition step in which the simultaneous interpretation information acquisition unit acquires simultaneous interpretation information including the simultaneous interpretation voice that the interpreter simultaneously interprets the spoken voice spoken in the first venue.
The transmission unit includes a transmission step of transmitting the simultaneous interpretation information to two or more terminal devices.
The transmitter
With the first communication means for transmitting at least the simultaneous interpretation voice to the terminal device existing in the first venue,
It is provided with a second communication means for transmitting the simultaneous interpretation information to a terminal device existing in each one or more second venues different from the first venue.
A simultaneous interpretation voice transmission method in which the first communication means and the second communication means are different communication means. A multiplexed audio receiving method realized by a terminal receiver, a demultiplexer, and an output.
A terminal receiving step in which the terminal receiving unit receives the multiplexed voice transmitted from the server device according to claim 7.
A demultiplexing step in which the demultiplexing unit demultiplexes the multiplexed voice received by the terminal receiving unit and acquires two or more voices.
A method of receiving a multiplexed voice including a terminal output step in which the output unit outputs one or more voices out of the two or more voices. Computer,
Simultaneous interpretation information acquisition department that acquires simultaneous interpretation information including simultaneous interpretation voice that the interpreter simultaneously translated the spoken voice spoken in the first venue,
It functions as a transmitter that transmits the simultaneous interpretation information to two or more terminal devices.
The transmitter
With the first communication means for transmitting at least the simultaneous interpretation voice to the terminal device existing in the first venue,
It is provided with a second communication means for transmitting the simultaneous interpretation information to a terminal device existing in each one or more second venues different from the first venue.
A program in which the first communication means and the second communication means are different communication means. Computer,
A terminal receiving unit that receives the multiplexed voice transmitted from the server device according to claim 7.
A demultiplexing unit that demultiplexes the multiplexed voice received by the terminal receiving unit and acquires the two or more voices, and a demultiplexing unit.
A program for functioning as a terminal output unit that outputs one or more of the two or more voices.

Images