JP5614798B2 - Telephone conference system, communication server, communication terminal, and telephone conference method. - Google Patents

Description

  The present invention relates to a telephone conference system, a communication server, a communication terminal, and a telephone conference method for performing a telephone conference using a communication terminal connected to a communication network.

  2. Description of the Related Art Conventionally, there is a technology for performing a conference call among a plurality of users using a multi-call function of a mobile phone that is a communication terminal (for example, Patent Document 1). With the technology disclosed in Patent Document 1, through a voice conference using a mobile phone, a plurality of users can participate in a conference even if they are not in a specific place.

JP 2001-309432 A

  However, in the above-described technology, there are problems in the audio conference that it is difficult to hear other users' conversations, or that it is difficult to refer to relevant materials during the conference.

  Therefore, the present invention solves the above-described problems, and when a conference call is performed by a communication terminal connected to a communication network, the document data is shared, and the document data is immediately updated according to the progress of the conference. It is an object to provide a telephone conference system, a communication server, a communication terminal, and a telephone conference method that can be referred to.

(Teleconference system and teleconference method)
In order to solve the above problems, the present invention connects a communication server arranged on a communication network from a plurality of communication terminals and forms a virtual conference room through communication between the plurality of communication terminals. a teleconferencing system for the communication terminal comprises a call unit for making a call by voice, and a data manipulation unit that performs user operation relating to article data referenced in the conference room on the communication server, communications server, meeting Based on a call for calling a room , communication is established between a plurality of communication terminals, and a communication control unit that forms a conference room and a communication terminal that establishes communication by the call control unit in response to a user operation in the data operation unit, and a data control unit which performs data communication relating to article data, a control history for article data controlled by the data control unit, those The control history storage unit that accumulates together with the conference progress time information, the control history, and the control target data recorded in the control history are associated with each other according to the progress time information and distributed as the reference data. The data control unit includes a document data distribution unit, and the call control unit receives a call from a caller user who calls the conference room, thereby calling a calling telephone number unique to the virtual conference room, A call destination calling unit that calls a plurality of communication terminals from a communication terminal associated with the call telephone number and establishes one or more call destination voice call sessions with the plurality of communication terminals; After at least one destination voice call session has been established, the caller's communication terminal is called with the calling telephone number as the caller, and the caller's voice call is made with the caller user's communication terminal. Between the caller user communication terminal and the callee user communication terminal by bridging the caller calling unit that establishes the session with one or more callee voice call sessions and the caller voice call session. And a bridge processing unit that establishes a voice call of the device, the control history includes convocation result information performed before the conference, and the communication terminal uses the output interface to transmit the material reference data distributed from the material data distribution unit. Is output or displayed .

According to another aspect of the present invention, there is provided a telephone conference method in which a plurality of communication terminals are connected to a communication server arranged on a communication network and a virtual conference room is formed through communication between the plurality of communication terminals. There,
(1) Based on an outgoing call to convene a conference room , communication is established between the communication server and a plurality of communication terminals to form a conference room, and voice communication between the plurality of communication terminals is performed. A call control step that enables
(2) In the communication terminal, a data operation step for performing an operation on the material data referred to in the conference room;
(3) a data control step of performing data communication regarding the document data in response to a user operation in the data operation step with a communication terminal in which communication is established by the call control step ;
The data control step is
A control history storage step for accumulating the control history for the material data controlled by the communication server together with the conference progress time information, the control history, and the material data to be controlled recorded in the control history. Further comprising: a material data distribution step for associating and distributing as material reference data in accordance with the progress time information; and an output step for outputting or displaying the material reference data distributed by the material data distribution step in the communication terminal, In the step, by receiving a call from a caller user who calls the conference room, a caller telephone number unique to the virtual conference room is used as a caller and associated with the caller telephone number. A call is made from a communication terminal to a plurality of communication terminals, and one call destination voice call session is established between the communication terminals. After establishing at least one call destination voice call session, call the caller's communication terminal using the caller's phone number as the caller, and call the caller's call to the caller's communication terminal. Establish a voice session between the caller user's communication terminal and the callee user's communication terminal by establishing a call session and bridging one or more callee voice call sessions with the caller voice call session Let

  According to these inventions, material data to be referred to during a conference can be shared between communication terminals of all users participating in the conference via the communication server. Can be clearly understood through voice calls and document data.

  Here, the user operations are all operations that are performed while the conference is in progress. For example, the file upload operation in which the conference participants save the conference material on the server, the scroll operation by the mouse operation, the conference This includes a pointer operation for specifying the reference location of the material, a download operation for reading the conference material into the communication terminal, and the like. The material data is text, images, moving images, audio, Web information, etc. that are referred to during the conference, and includes data in various file formats such as JPG, PDF, AVI, and WAV.

Further, according to the present invention, the communication server records the control history for the material data controlled by the data control unit along with the progress time information of the conference, the control history, and the control history. And a document data distribution unit for associating the document data subject to control in accordance with the progress time information and distributing it as document reference data, and the communication terminal references the document distributed from the document data distribution unit Runode further comprise an output interface for outputting or displaying the use data, the communication server, for example, such as material data the user is displayed on the communication terminal by a user operation that is in the conference, the article data referenced during the conference It is recorded as a control history, and the control history and the data subject to control are related according to the progress time. Therefore, even if there is a user who joined the meeting later, the user can refer to this data reference data to determine which material is referenced at which time zone during the meeting. It is possible to grasp clearly. Here, as an association method, for example, the control history may be stored as log information, link information may be added to the log information, and the corresponding material data may be extracted from the log information.

  In the above invention, it is preferable that the control history storage unit also accumulates as a control history the results of voting conducted during a meeting or chat between users.

  In the above invention, the communication server records the voice acquired from the communication terminal for each terminal, converts the recorded voice into character information, and character information obtained from each communication terminal. And a minutes data generation unit for generating the minutes data, and the document data distribution unit associates the data reference data and the minutes data based on the progress time information. Preferably, the communication terminal further has a function of distributing, and the output interface of the communication terminal further has a function of outputting or displaying the material reference data and the minutes data distributed from the material data distribution unit.

  In this case, the communication server records voice for each communication terminal and converts the voice data into text, so even if conversations are duplicated by multiple users during a conference, Can be converted into text, and accurate text processing can be executed. In addition, since the text information that has been converted into text is integrated according to time series, accurate minutes data of the entire meeting can be generated. Furthermore, since the minutes data is related to the document reference data and distributed according to the time of the meeting, the user can refer to the minutes in the text to match the progress of the meeting. The referenced material can be grasped immediately.

  In the above invention, in the minutes data, the voice data of the recorded voice is associated with the character information obtained by converting the voice, and the voice data corresponding to the character information is searched based on each character information. Preferably, the output interface of the communication terminal further has a function of searching for corresponding voice data based on character information included in the minutes data, and outputting or displaying it.

  In this case, since the voice data can be output from the character information of the minutes data, the user can view the target voice data immediately. Here, as an association between the voice data and the character information, for example, there is a method of adding a link function to the character information, so that the user views the voice data only by clicking the displayed character information. be able to.

  In the above invention, in the minutes data, the character information is associated with the data reference data, and based on each character information, it is possible to search for the data reference data corresponding to the character information. It is preferable that the output interface of the terminal further has a function of searching for corresponding material reference data based on character information included in the minutes data, and outputting or displaying the data.

  In this case, since the material reference data can be output from the character information of the minutes data, the user can immediately refer to the target conference material. Here, as a method of searching for data for reference to materials, for example, there is a method of adding a link function to character information. With this, the user simply clicks on the displayed character information to start the corresponding application. You can browse the data for data reference.

(Communication server and communication terminal)
In the telephone conference system and the conference method, a communication server and a communication terminal which are other inventions as described below can be used.

(1) Communication server The invention of the above communication server is a communication server that is arranged on a communication network and forms a virtual conference room through communication between a plurality of communication terminals, and is a device for calling a conference room. Based on the call , communication is established with a plurality of communication terminals, a call control unit that forms a conference room, and a user operation related to material data referred to in the conference room is acquired from the communication terminal, and the call control unit According to the user operation in the communication terminal with the communication terminal established by communication, the data control unit for performing data communication regarding the material data, and the control history for the material data controlled by the data control unit, The control history storage unit that accumulates together with the conference progress time information, the control history, and the control target recorded in the control history A serial article data, associating in accordance with the running time information, and a document data delivery unit for delivering the article reference data, the call control unit receives a call from caller user to convene the conference room Thus, using the calling telephone number unique to the virtual conference room as a caller, the communication terminal associated with the calling telephone number is called to the plurality of communication terminals, and the plurality of communication A call destination calling unit for establishing one or more call destination voice call sessions with a terminal; and at least one call destination voice call session is established, and then the call source with the caller telephone number as a call source A caller calling unit for calling a user communication terminal and establishing a caller voice call session with the caller user communication terminal, and the one or more callee voice calls And a bridge processing unit that establishes a voice call between the communication terminal of the caller user and the communication terminal of the callee user by bridging the caller and the caller voice call session. Includes convocation result information before the meeting .

According to the present invention as described above, the communication server can form a conference room between all the communication terminals of the established users and distribute the material data corresponding to the user operation. It is possible to centrally manage the materials and provide the conference materials to users participating in the conference. According to the present invention, the communication server stores, as a control history, material data referred to during the conference, such as material data displayed on the communication terminal by a user operation during a conference, for example. Since the control history and the material data subject to the control are associated according to the progress time, for example, even when the user joins the meeting later, the data reference data is sent to the user. By referring, it is possible for the user to clearly understand which material is being referred to in which time zone during the meeting.

In the above invention, it is preferable that the control history storage unit also accumulates the results of voting performed during the meeting or chat between users as the control history.

  In the above invention, the voice acquired from the communication terminal is recorded for each terminal, and the text conversion unit that converts the recorded voice into character information, and the character information obtained from each communication terminal are time-series. And a minutes data generation unit that generates the minutes data, and the document data distribution unit associates and distributes the material reference data and the minutes data based on the progress time information. It is preferable to further have.

  In this case, the communication server records voice for each communication terminal and converts the voice data into text, so even if conversations are duplicated by multiple users during a conference, Can be converted into text, and accurate text processing can be executed. In addition, since the text information that has been converted into text is integrated according to time series, accurate minutes data of the entire meeting can be generated.

  In the above invention, in the minutes data, the voice data of the recorded voice is associated with the character information obtained by converting the voice, and the voice data corresponding to the character information is searched based on each character information. Is preferably possible. In this case, the communication server associates the character data of the minutes data with the voice data and can search the voice data from each character information, so that the target voice data corresponding to the user operation can be immediately obtained. Can be delivered.

  Further, in the above invention, in the minutes data, the character information and the data reference data are associated with each other, and based on each character information, it is possible to search for the data reference data corresponding to the character information. preferable.

  In this case, the communication server associates the character data of the minutes data with the data reference data, and can search the voice data from each character information, so the target data reference data according to the user operation. Can be delivered immediately.

(2) Communication terminal On the other hand, the invention of the communication terminal is a communication terminal that can connect to the communication server and participate in a virtual conference room formed through communication between a plurality of communication terminals. The communication terminal responds to a user operation in the data operation unit between a communication unit that performs a voice call, a data operation unit that performs operations related to material data referred to in a conference room on the communication server, and a communication server. And a data communication unit that performs data communication regarding the material data.

  According to the present invention, the communication terminal operated by the user can share the material data managed centrally in the communication server, and the user does not need to prepare the material at hand, and immediately Identify and refer to meeting materials.

  In the above invention, the control history for the material data controlled on the communication server is stored together with the progress time information of the conference, the control history, and the material data to be controlled recorded in the control history, It is preferable to further include a material data receiving unit for associating and receiving the data as material reference data and an output interface for outputting or displaying the material reference data distributed from the material data distribution unit.

  In this case, the communication terminal can output or display the control history associated with the progress time information as the data reference data, so that, for example, a user who has joined the conference later can also adjust to the progress of the conference. Can be immediately identified and referenced.

  Further, in the above invention, the material data receiving unit converts, in the communication server, voices respectively acquired from a plurality of communication terminals into character information, and integrates the character information obtained from each of the communication terminals according to a time series. The function further includes a function of associating and receiving the minutes data generated and the data reference data based on the progress time information, and the output interface includes the data reference data distributed from the document data distribution unit and It is preferable to further have a function of outputting or displaying the minutes data.

  In this case, the communication terminal can output or display the minutes data and the data reference data associated based on the progress time information, so that the user can refer to the minutes to view the meeting. It is possible to immediately identify and refer to the referenced materials as they progress.

  In the above invention, in the minutes data, the voice data of the recorded voice is associated with the character information obtained by converting the voice, and the voice data corresponding to the character information is searched based on each character information. Preferably, the output interface further has a function of searching for corresponding voice data based on character information included in the minutes data and outputting or displaying it. In this case, since the voice data can be output from the character information of the minutes data at the communication terminal, the user can immediately identify and refer to the target voice data while referring to the minutes. .

  In the above invention, in the minutes data, the character information is associated with the data for data reference, and based on each character information, it is possible to search for voice data corresponding to the character information. It is preferable to further have a function of searching for corresponding material reference data based on character information included in the minutes data, and outputting or displaying the data. In this case, since the data for document reference can be output from the character information of the minutes data at the communication terminal, the user can immediately identify and refer to the target data reference data while referring to the minutes. can do.

  As described above, according to the present invention, when performing a conference call by a call through a communication terminal connected to a communication network, the document data can be shared through data communication, and the document is synchronized with the progress of the conference. Data can be referenced immediately.

It is a conceptual diagram which shows the whole structure of the telephone conference system which concerns on embodiment. It is a block diagram which shows the function structure of the application server with which the telephone conference system which concerns on embodiment is provided, and a call service server, The same figure (b) is explanatory drawing which shows the data structure of a user database typically. It is explanatory drawing which shows the outline | summary of the data sharing system in the telephone conference system in embodiment. It is a block diagram which shows the internal structure of each apparatus which concerns on embodiment. It is explanatory drawing which shows typically operation | movement of the data association of the telephone conference system which concerns on embodiment. It is explanatory drawing which shows the display screen of the telephone conference function which concerns on embodiment. It is a flowchart figure which shows the material sharing method of the telephone conference system which concerns on embodiment. It is a flowchart figure which shows the material acquisition method of the telephone conference system which concerns on embodiment. It is a flowchart figure which shows the material acquisition method of the telephone conference system which concerns on embodiment. It is explanatory drawing which shows the display screen regarding the convocation function which concerns on embodiment. It is explanatory drawing which shows the display screen regarding the vote function which concerns on embodiment, and a chat function.

(Overall configuration of the conference call system)
Embodiments of a telephone conference system according to the present invention will be described below in detail with reference to the accompanying drawings. FIG. 1 is a conceptual diagram showing the overall configuration of the telephone conference system according to the present embodiment.

  As shown in FIG. 1, the telephone conference system according to the present embodiment is connected to a communication server 10 arranged on a communication network from a plurality of communication terminals 20 and 30, and communication between the plurality of communication terminals is performed. Is a call control system that forms a virtual conference room, and connects to a group composed of a plurality of users a to e according to the operation of the caller user x. In this embodiment, such a group is composed of members participating in the conference call. Specifically, the telephone conference system includes an application server 100, a call service server 200, and a user database 400 as the communication server 10, and is connected to the IP network 70 and is connected to the general public line / line via the gateway 90. Connection to the mobile communication network 80 is also possible. In the present embodiment, a case where a conference call is started in response to an operation from the caller user x will be described as an example. However, any of the other users a to e can be a caller user. The telephone conference can be started in accordance with the operations from the users a to e.

  Here, the IP network 70 uses a communication protocol TCP / IP to connect various communication lines (telephone lines, ISDN lines, ADSL lines, public lines such as optical lines, dedicated lines, wireless communication networks) to each other. The IP network includes a LAN such as an intranet (intra-company network) or a home network based on 10BASE-T or 100BASE-TX.

  The general public line network / mobile communication network 80 is a general term for telephone lines for voice calls such as fixed telephone and mobile communication. Note that a public switched telephone network (PSTN) is a communication network of a general subscriber telephone line, and connects to the other party's telephone from the telephone by a line switching method to perform a voice call. The mobile communication network is a communication network using wireless communication. As the communication method, for example, there are FDMA method, TDMA method, CDMA method, W-CDMA, PHS (Personal Handyphone System) method, etc. Can be mentioned. Further, the gateway 90 performs a process of mutually converting the data format, protocol, etc. in order to enable mutual communication between the IP network 70 and the general public line / mobile communication network 80.

  The example shown in FIG. 1 shows a case where a caller user x who is a conferee of a conference call calls callee users a to e who are participants of the conference using the conference call system. The caller user x can use the terminal device 20b having an IP network connection function and a Web browser function, and the telephone 20a having a general public line / mobile communication network connection function. It is assumed that the communication terminal 20 having both functions of the telephone 20a and the telephone 20a is used. That is, the communication terminal 20 has a function of accessing a Web page via the IP network 70 such as a browser function in addition to a mobile communication telephone function.

  The called users a to e are communication terminals 30 that are connected to the communication server 10 arranged on the communication network and can participate in a virtual conference room formed through communication between a plurality of communication terminals. Thus, communication terminals 30a to 30c, which are fixed telephones or mobile telephones having a general public line / mobile communication network connection function, and communication terminals 30d and 30e having a so-called IP telephone function for performing a voice call using the Internet protocol are used. . Here, it is assumed that the communication terminals 30d and 30e are connected to the IP network 70 and have a Web browser function like the communication terminal 20 used by the caller user x.

  FIG. 2A is a block diagram showing the functional configuration of the application server 100 and the call service server 200 constituting the telephone conference system, and FIG. 2B schematically shows the data structure of the user database 400. FIG.

  As shown in FIG. 2A, the application server 100 includes a communication interface (I / F) 130 for performing a voice call and data communication, and a connection control unit connected to the IP network 70 via the communication I / F 130. 110, and an application unit 120 that functions as a back end of the connection control unit 110. In addition, a user database 400 is connected to the application server 100 and the call service server 200, and the data of the user database 400 can be shared by the application server 100 and the call service server 200.

  The user database 400 associates the calling telephone number (050-xxxx-xxxx) unique to the group with the telephone number of the telephone terminal of the caller user x and the callee users a to e who are users belonging to the group. A database device that stores and holds data. Specifically, the user database 400 is a database configured on a non-volatile storage device, and stores information related to users who can receive services provided by the telephone conference system. In the present embodiment, for example, as shown in FIG. 2B, a name for each conference room that is a group and a calling telephone number unique to each conference room are held, and the conference room is associated with each conference room. Identification information of the caller user x who is a member of the room, the telephone number of the telephone 20a of the caller user x, the identification information of the communication terminal 20 of the caller user x, and the participant (call) Memorize a list of users that can be specified as (destination). The list of users that can be specified as call destinations includes call destination users a to e, and further associates the telephone numbers of the communication terminals 30a to 30e of the call destination users a to e.

  The application server 100 is a module that executes an application for controlling the telephone conference system and constructs a user interface for the telephone conference system, and includes a connection control unit 110 and an application unit 120.

  The connection control unit 110 is a connection request from the caller user x to the callee users a to e, information for specifying the phone number of the telephone 20a of the caller user x, the conference room or the callee users a to and a function for receiving a connection request including information for specifying the telephone number of e from the terminal device 20b of the caller user x via the IP network 70.

  Such a connection request can be made, for example, on a Web page that the application unit 120 displays on the browser function of the communication terminal 20. In the present embodiment, the telephone number of the communication terminal 20 of the calling user x and the telephone number of the communication terminal 30 of the callee users a to e are stored in the user database 400, and the calling user x By simply selecting an arbitrary callee user ae above, it is possible to make a connection request to the callee user ae without entering the telephone numbers of the telephones 30a-30e of the callee user ae. . In addition, the connection request can include information on the call reservation time, and the connection destination can be specified. Note that a conference call function, which will be described later, can be used to set the call reservation time.

  In the present embodiment, the call control unit 220 in the call service server 200 also has a function as a connection request receiving unit, and the call destination users a to e are also made by a call from the call source user x to the call service server 200. A connection request to can be sent. Specifically, the calling user x starts calling the conference room by calling the call control unit 220 through the general public line network / mobile communication network. Call the conference room specific phone number. Upon receiving this call, the call control unit 220 performs authentication based on the telephone number of the user x included in the calling signal, and the telephone number of the user x and the telephone number of the called call service, that is, the call The telephone number is sent to the application unit 120 of the application server 100 as a connection request. Further, the call control unit 220 may be provided with a voice guidance function using a toe key, and additional information input such as setting of the reservation time described above may be performed by voice or dial push operation.

  In response to a connection request from the call source user x received from the connection control unit 110 or the call control unit 220, the application unit 120 calls the call destination users a to e that are members of the group to the call service server 200. . Specifically, the application unit 120 requests call connection processing between the caller user x and the plurality of callee users a to e, and responds to the connection request from information included in the connection request from the caller user x. With reference to the user database 400, the telephone number of the communication terminal of the caller user x and the telephone numbers of the communication terminals 30a to 30e of the callee users a to e are specified and notified to the call service server 200.

  Further, the application unit 120 has a function of performing web front processing, and can be configured by, for example, a web server. As this Web server, a server computer that transmits information such as an HTML (HyperText Markup Language) file, an image file, or a music file in a document system such as WWW (World Wide Web) or software having the function is adopted. Information such as HTML documents and images is stored, and the information is transmitted through the IP network 70 in response to a request from client software such as a Web browser.

  The call service server 200 includes an interface unit 210 and a call control unit 220. The interface unit 210 performs an interface process with the application server 100, receives the telephone number of the call source telephone and the telephone number of the call destination telephone, and performs a process of notifying the call control unit 220.

  The call control unit 220 includes a caller calling unit 221, a callee calling unit 222, a bridge processing unit 223, and a security management unit 224, and the caller telephone number and the callee notified from the interface unit 210. In accordance with the telephone number of the telephone, the communication is established between the caller telephone and the callee telephone, a conference room is formed, and a voice call is established. The call control unit 220 can perform call control by software processing, for example.

  The calling party calling unit 221 calls the calling user's telephone from the communication terminal associated with one of the calling telephone numbers, and connects the calling telephone number with the calling user's telephone. In the meantime, a process of establishing a callee voice call session is performed.

  The called party calling unit 222 calls the telephone of the called user from the communication terminal associated with one of the calling telephone numbers, and between the calling telephone number and the called user telephone. A process for establishing a callee voice call session is performed. In the present embodiment, the call to the telephone of the caller user is made after the callee voice call session is established.

  The bridging processing unit 223 realizes a voice call between the caller user's telephone and the callee user's telephone by bridging the callee voice call session and the caller voice call session established separately. I do.

  The security management unit 224 is a module that mainly manages the security of a conference room that is being executed, and authenticates users who have participated in a meeting late to prevent unauthorized participation. Participating late in a meeting is when, for example, a caller is called by a calling phone number and the called user is unable to answer the call. You can join the conference by making a call from the other user. At this time, the security management unit 224 checks the user database 400 based on the telephone number notification of the caller (callee user) included in the call in response to a call from the callee user. If the call originates from a number that is not registered in the network, the connection is rejected. If the call originates from a registered number, the connection is established and participation in the conference room is permitted.

(Outline of document sharing system)
The telephone conference system having the above configuration includes a material sharing system. FIG. 3 is an explanatory diagram showing an outline of a material sharing system in the telephone conference system according to the present embodiment. The “module” used in the description refers to a functional unit that is configured by hardware such as an apparatus or a device, software having the function, or a combination thereof, and achieves a predetermined operation. .

  In the present embodiment, as shown in FIG. 3, the document sharing system manages document data in the application server 100, thereby holding various document data D2 in a server accessible from a plurality of communication terminals (P1). ) By distributing the material data D2 to the caller user x and the callee users a to e (P4), the material data is shared among the users. This material data can also be uploaded from each communication terminal to the server by each user (P5).

  In addition, the document sharing system converts the voice data D5 during a call into text at any time to generate the minutes data D4 (P2), and associates the minutes data D4 and each material data D2 based on the meeting progress time. (P3) In response to a user operation, the associated document data D2 is distributed together with the minutes data D4 (P4).

(Configuration of document sharing system)
FIG. 4 is a block diagram showing the internal structure of each device in this embodiment. FIG. 5 is an explanatory diagram showing an outline of document data association in the telephone conference system according to the present embodiment.

  As shown in FIG. 4, the outline material sharing system described above is roughly composed of a communication terminal 30, an application server 100, and a call service server 200 that are connected to a communication network and used by users a to e. In this embodiment, it is assumed that the communication terminal 20 owned by the caller user x has the same configuration as the communication terminal 30 owned by the callee users a to e.

(1) Application Server The application server 100 includes an application unit 120 as an application execution module and a connection control unit 110 as a communication control module.

  The connection control unit 110 is a connection request from the caller user x to the callee users a to e, information for specifying the phone number of the telephone 20a of the caller user x, the conference room or the callee users a to This is a module for receiving a connection request including information for specifying the telephone number of e via the IP network 70 from the terminal device 20b of the calling user x.

  In addition, the application server 100 includes a communication I / F 130 as a communication module. The communication I / F 130 is a communication interface for performing telephone calls and data communication, and has a function of performing contact (wired) communication by wireless or the like, or by cable, adapter means, or the like. In addition, the communication I / F 130 according to the present embodiment includes a voice communication unit 131 and a data communication unit 132.

  The voice communication unit 131 is a module that receives, from each terminal, a voice signal related to a voice call having a conversation in a telephone conference, and transmits the voice signal for each terminal to the voice data conversion unit 123. The data communication unit 132 is a module that transmits data through the IP network 70, and transmits each data in packets. In particular, in the present embodiment, the data communication unit 132 receives, from each communication terminal 30, IP packet data related to a voice call having a conversation in a conference call, or transmits each material data D2.

  The application unit 120 includes an audio data conversion unit 123, a text unit 124, a time information addition unit 125, and a minutes data generation unit 126 as modules relating to the generation of minutes data.

  The audio data conversion unit 123 is a module that receives and digitizes the audio data D5, and records (records) the digitized audio data. In this embodiment, the audio data conversion unit 123 receives the analog signal received by the audio communication unit 131. The voice is converted into a digital signal, and the converted voice data D5 is recorded in the voice database 121b for each of the communication terminals 30a to 30e and input to the text unit 124.

  The text unit 124 is a module that converts the voice data D5 obtained from the communication terminal 30 and digitized into character information by voice recognition processing. Specifically, the text conversion unit 124 acquires the audio data D5 for each terminal from the audio data conversion unit 123, records the audio data D5 at predetermined time intervals, and converts it into a file. The audio data D5 recorded for each terminal is recorded. Then, by analyzing by speech recognition processing, an acoustic feature amount is taken out from the speech data D5, and a candidate closest to each phoneme of the speech data D5 input from the phoneme sequence is obtained based on the acoustic model and the language model. Output as character information, and convert voice data D5 into text data as character information. Here, for example, a hidden Markov model can be used as the acoustic model, and an N-gram model can be used as the language model. Note that the speech recognition method is not limited to these, and it is sufficient that character information is output from the speech data D5, and various methods may be used.

  Further, as shown in FIG. 5, the text unit 124 also has a function of associating character information P1 constituting the text converted from the voice data D5 with the recorded voice data D5 (FIG. 5). L3 in 5). Specifically, the link information adding unit 128a stores the address information (domain or folder name) of the storage unit 121 in which the voice data D5 related to the character information P1 is stored in the individual character information P1 included in the text data. , URL including file name). The character information P1 here is information formed by a character string, and can be set to various data lengths such as a word unit, a phrase / sentence unit, and a paragraph unit. And the audio | voice data linked | related with this character information P1 can be made into the range of the predetermined time length before and behind including the audio | voice data from which the character information P1 was extracted. Then, the character information P1 for each terminal output in the text unit 124 is transmitted to the minutes data generator 126.

  The time information adding unit 125 is a module for adding time information when the user utters the voice to the character information P1 converted into text for each terminal. In the present embodiment, the time information adding unit 125 includes, in the character information P1, the number of seconds after the start of the conference by the user and the number of seconds after the end of the speech based on the received voice data D5. Time information is added in units of words, clauses / sentences, or paragraphs. In this embodiment, the time information adding unit 125 is measured from the conference start time. However, the present invention is not limited to this method, and a method of adding time information based on absolute time is used. Also good.

  The minutes data generation unit 126 is a module that integrates the character information P1 obtained from each communication terminal 30 according to time series and generates minutes data D4. Specifically, the minutes data generation unit 126 arranges text data (character information P1) from each communication terminal 30 in time series from the start of the conference based on the time information added by the time information addition unit 125. By switching, the minutes data D4 is generated. The minutes data D4 is transmitted to the minutes database 121c in the storage unit 121.

  In addition, the application unit 120 includes a document data distribution unit 128, a data control unit 129, a storage unit 121, and an operation signal reception unit 127 as modules relating to storage and distribution of the document data D2 referred to in the conference. Yes.

  The operation signal receiving unit 127 is a module that receives an operation signal generated by a user operation from each user's communication terminal, analyzes the received operation signal, and causes another module to execute processing according to the user operation. In particular, in the present embodiment, the operation signal receiving unit 127 transmits a signal related to the user operation to the data control unit 129 when receiving a user operation from the callee users a to e.

  The data control unit 129 acquires a user operation related to the document data D2 referred to in the conference room from the communication terminal 30, and performs communication with the communication terminal 30 established by the connection control unit 110 in the data operation unit 309a. This module performs data communication related to the material data D2 in response to a user operation, controls the material data distribution unit 128 based on an operation signal from the operation signal receiving unit 127, and distributes each material data D2 to the communication terminal 30. Let Further, the data control unit 129 generates a control history D1 for the material data D2 controlled by the data control unit 129, and transmits it to the control history storage database 121e. Furthermore, the data control unit 129 accumulates the material data uploaded from the user terminal received by the data communication unit 132 in the material database 121d, and controls the material data distribution unit 128 to transmit the material data to other communication terminals. 30 is also provided. In this case, since the material data uploaded by the user is transmitted to another terminal even when there is no other user's download operation, the material data can be shared immediately.

  The data control unit 129 also has a function of performing data communication related to pop-up display based on an operation signal related to a screen display request in a conference call. This pop-up display is a window that is controlled by the communication 316 and the communication interface unit 310b of each communication terminal 30 and is displayed on the foreground in the display unit 307 of each communication terminal 30 with priority over other displays. In addition, the screen display request includes a meeting convocation function, a voting function, a chat function, etc., and controls broadcast distribution and distribution to specified users according to user operation signals. .

  The data control unit 129 also has a function of analyzing each data acquired by the meeting calling function and the voting function and generating analysis result data. This analysis result is input to the material data distribution unit 128 and linked to the communication control unit 316 of each communication terminal 30 through the data communication units 132 and 302 to convene a meeting, vote during the meeting, chat between users, etc. Provide communication tools.

  The storage unit 121 is a database that stores information related to the material sharing system. In the present embodiment, the Web database 121a, the audio database 121b, the minutes database 121c, the material database 121d, and the control history storage database 121e It has.

  The document database 121d is a memory device that stores document data D2 used in a conference call, and stores text data, images, video data, and the like for each conference room that is a group. The minutes database 121c is a memory device that accumulates the minutes data D4 generated by the minutes data generator 126, and stores the minutes data D4 converted into text for each meeting room as a group. The Web database 121a is a storage device that stores Web data that is display information. In particular, the Web database 121a includes a Web page related to a connection request that is operated and executed by the user, and a telephone that is viewed by the callee users a to e. Display data such as web pages related to meetings and screens related to pop-up displays are stored.

  The control history storage database 121e is a memory device that accumulates the control history D1 related to the material data D2 controlled by the data control unit 129 together with the conference progress time information. Specifically, the control history storage database 121e includes, for example, the time information when the operation instruction is given when there is an operation instruction such as downloading of the material data D2 from each user during the meeting. And the downloaded document data D2 are stored and accumulated as a control history D1. In the present embodiment, the control history storage database 121e also stores, as control history information, convocation result information performed before the conference call, voting result information performed during the conference call, and the like.

  The voice database is a memory device that stores the voice data D5 received from each of the communication terminals 30a to 30e and converted by the voice data converter 123 for each conference room that is a group.

  The document data distribution unit 128 is a module that distributes document data according to user operations. In the present embodiment, the document data distribution unit 128 controls document data referred to in a telephone conference under the control of the data control unit 129. Extracted from the storage unit 121 and distributes each material data to the communication terminal 30. Here, each material data distributed by the material data distribution unit 128 includes all data related to the telephone conference such as material reference data, minutes data, audio data, and image data.

  The material data distribution unit 128 includes a link information adding unit 128a that associates each material data stored in the storage unit 121. The material data distribution unit 128 includes the material associated with the link information adding unit 128a. Also distribute data.

  Here, the association of each material data by the link information adding unit 128a will be described. The link information adding unit 128a associates the control history D1 stored in the control history database with the material data D2 to be controlled recorded in the control history D1 according to the traveling time information T1, and is used for material reference. Generated as data D3. Further, the link information adding unit 128a associates the material reference data D3 with the minutes data D4 stored in the minutes database 121c based on the traveling time information T1.

  Specifically, first, the link information adding unit 128a, as shown in FIG. 5, links information (the book information D21, D22, D23) in which the material data D21, D22, D23 that are the objects of the control are stored in the control histories D11, D12, D13. In the embodiment, the URL of the material database 121d) is described and related (L1 in FIG. 5), and the respective log information D31, D32, and D33 are generated. Then, the link information adding unit 128a integrates the log information D31, D32, D33 according to the traveling time information T1, and accumulates this data in the material database 121d as material reference data D3.

  Further, the link information adding unit 128a describes and associates with the minutes data D4 the link information (URL of the material database 121d) in which the material reference data D3 is accumulated based on the traveling time information T1 (in FIG. 5). L2).

  This material reference data D3 also includes information for displaying an icon of the recorded material data D2 to be controlled on the Web page, and is expressed by, for example, a tag such as HTML. . In addition, the data reference data D3 is generated and returned by CGI or JAVA (registered trademark) read and executed from the browser of the communication terminal 30, and is sent to any area on the Web page displayed on the browser. Link information that describes whether to display the document data is included.

  Then, the material data distribution unit 128 distributes the log information of the entire meeting as the material reference data D3 to the communication terminal 30, and the material data distribution unit 128 uses the associated material reference for reference based on the traveling time information T1. Data D3 and minutes data D4 are distributed to each communication terminal 30. The range of document data to be linked according to the progress time information can be changed by adjusting the specified time length before and after the conference progress time information, and the range of association of each document data can be limited or expanded. You can make it. For example, according to the minutes data D4 and the progress time information, the associated data reference data D3 can be set to various data lengths such as 1 minute, 10 minutes, and 1 hour by setting the specified range length. Can do.

  The link information adding unit 128a also associates the character information P1 converted from the audio data D5 with the material reference data D3 (L4 in FIG. 5). Specifically, the link information adding unit 128a includes, in the character information P1, the address of the storage unit 121 in which the material reference data D3 related to the character information P1 is accumulated (URL including domain, folder name, file name, etc. )

  Then, the material data distribution unit 128 distributes the material reference data D33 corresponding to the character information P1 to each communication terminal 30 based on the character information P1 related to the minutes data D4. As a result, the material data D23 associated with the material reference data D33 can be specified. For example, when the character information P1 includes the character information “Table 1”, the “Table 1” includes The corresponding document data D23 can be output or displayed on the display unit 307. The character information P1 here is information formed by a character string, and can be set to various data lengths such as a word unit, a phrase / sentence unit, and a paragraph unit. The material reference data associated with the character information P1 includes a range of a predetermined time length including the material reference data D33 from which the character information P1 is extracted (for example, the material reference data D31, 32). Range).

  Note that the document data distribution unit 128 also communicates the corresponding voice data D5 with respect to the character information P1 and the voice data D5 associated by the text unit 124 based on the character information P1 related to the minutes data D4. A function of delivering to the terminal 30 is provided.

  As the association process executed by the link information adding unit 128a, for example, the character information P1 of the minutes data D4 displayed on the display unit 307 of the communication terminal 30 or the icon or the like is clicked, whereby the character information is displayed. Processing for acquiring the content of each material data associated with P1 and describing a script for processing content reproduction is also included.

(2) Communication Terminal The communication terminal 30 includes a voice call unit 304 and a VoIP unit 303 as modules relating to call processing. The voice call unit 304 is a module that executes a normal call by transmitting and receiving a voice signal. For example, a voice input from the microphone 305 of the handset is transmitted as a voice signal from the voice communication unit 301 through the line. The received audio signal is output as audio from the speaker 306 of the receiver. In addition, the voice call unit 304 is connected to the VoIP unit 303. When an Internet telephone is possible, the voice call unit 304 transmits / receives a voice signal as IP packet data through the VoIP unit 303 and performs a call through the IP network 70.

  The VoIP unit 303 is a module that realizes an Internet telephone using a VoIP function. As this VoIP function, the voice signal input from the voice call unit 304 is converted into IP packet data, transmitted to the call partner terminal, and the IP packet data received from the call partner terminal is converted into a voice signal. Input to the voice call unit 304, thereby making a call between the communication terminals 30 d and 30 e on the IP network 70 and the telephones 30 a to 30 c on the general public line / mobile communication network 80.

  In addition, the communication terminal 30 includes an input interface 309 and an output interface 308 as modules related to the user interface.

  The input interface 309 is a device for inputting a user operation such as an operation button, a touch panel, or a jog dial, and includes a data operation unit 309a in the present embodiment. The data operation unit 309a is a module that performs a user operation regarding the material data D2 referred to in the conference room on the communication server. Specifically, the user operation includes a file upload operation for the conference organizer to save the conference material on the server, a scroll operation by a mouse operation, a pointer operation, a download operation for reading the conference material to the communication terminal, and the like.

  The output interface 308 is a module that outputs text data and output signals of image and audio data from the display unit 307 and the speaker 306, respectively. In particular, in the present embodiment, the output interface 308 outputs or displays or stores each material data D2 such as audio data D5, material reference data D3, and minutes data D4 distributed from the material data distribution unit 128. Each material data D2 stored in the unit 314 is output or displayed.

  A display unit 307 such as a liquid crystal display is connected to the output interface 308, and a GUI (Graphical User Interface) constructed by an application is displayed on the display unit 307. In the present embodiment, the input interface 309 and the output interface 308 display a GUI regarding the conference call on the window 307a of the display unit 307, and the user confirms whether or not to approve with an operation button or the like through this GUI. Perform the operation.

  The display unit 307 is a display device such as a liquid crystal display, for example, and can display images, characters, and the like through a window 307a generated by an application such as text display or image display.

  In addition, the communication terminal 30 includes a content reproduction unit 311, an output signal generation unit 312, an application execution unit 310, a material data request unit 315, and a material data reception unit 313 as modules for acquiring and reproducing the material data D 2. And a storage unit 314.

  The content reproduction unit 311 is a module that outputs or displays each material data D2 stored in the storage unit 314. Specifically, the content reproduction unit 311 receives material reference data, minutes data, Web pages, and video data from the storage unit 314. And audio data and the like are extracted and reproduced to display an image and a web page in the window 307a on the display unit 307, and output sound from the speaker 306 or the like. The content reproduction unit 311 acquires the material data D2 referred to in the meeting according to the operation signal from the data operation unit 309a from the storage unit 314, and transmits this data to the output signal generation unit 312.

  In the present embodiment, the content reproduction unit 311 includes a browser unit 311a. The browser unit 311a is a module for browsing web pages constructed by executing browser software. It downloads HTML (HyperText Markup Language) files and image files from the Internet, analyzes the layout, displays them, Reproduce.

  The output signal generation unit 312 is a module that converts each material data D2 that can be reproduced by the content reproduction unit 311 into an image signal and an audio signal, and generates a signal that can be output by the display unit 307 and the speaker 306.

  The storage unit 314 is a memory device that stores programs for executing the OS and browser, programs for various applications installed in the terminal, data on conference materials, and the like, distributed from the material data distribution unit 128. The document data D2 relating to the conference that has been held is stored.

  The application execution unit 310 is a module that executes applications such as general OS, office software such as browser software and word processor software, and image display software, and is usually realized by a CPU or the like.

  In the present embodiment, the application execution unit 310 includes an output interface control unit 310a. The output interface control unit 310a is a module that searches for material data associated with each material data and outputs or displays the data on the output interface 308. In particular, in this embodiment, the output interface control unit 310a stores the corresponding voice data D5 or document reference data D3 based on the character information P1 included in the minutes data D4 displayed on the display unit 307. It has a function to search from the storage unit 314 for the corresponding data reference data D3 based on the minutes data D4 that is searched from 314 or related based on the meeting progress time.

  For example, when the user clicks on the character information P1, the output interface control unit 310a determines whether or not the document data D2 linked to the character information P1 is stored in the storage unit 314 on the communication terminal 30 side. If stored in the storage unit 314, a signal for outputting or displaying the material data accumulated in the storage unit 314 is transmitted to the content reproduction unit 311. On the other hand, if the data is not stored in the storage unit 314, a signal for distributing the material data corresponding to the communication server 10 is transmitted to the material data request unit 315.

  Furthermore, the output interface control unit 310a has a function of searching, as associated material data, material data included in a range of a predetermined time length before and after the conference progress time information of the material data subjected to user operation. ing. More specifically, the output interface control unit 310a extracts the conference progress time information from the material data subjected to the user operation, refers to the control history, and obtains the predetermined time information before and after the resource progress time information. Search for the presence of material data. As a result, as shown in FIG. 5, for example, the material reference data associated with the character information P1 includes a range of a predetermined time length before and after the data reference data D33 from which the character information P1 is extracted (for example, material Range including the reference data D31, 32).

  In the present embodiment, the output interface control unit 310a makes a distribution request to the server device side after retrieving each material data D2 from the storage unit 314 on the terminal side, but the present invention is limited to this. Instead of storing the material data D2 referred to during the meeting on the communication terminal 30 side, it may be configured to request distribution to the server side for all user operations. Data D2 is stored, one communication terminal 30 makes a distribution request to the other communication terminal 30, and each document data D2 stored in the storage unit 314 of the other communication terminal 30 is distributed to one communication terminal 30 It is good also as composition to do.

  The document data requesting unit 315 is a module that requests each document data D2 corresponding to a user operation to the server device via the data communication unit 302, and is stored in the storage unit 314 under the control of the output interface control unit 310a. When the conference material is not stored, the request data for distributing the material data D2 is transmitted to the communication server device 10 of the telephone conference system. The material data request unit 315 also has a function of distributing the material data stored in the storage unit 314 to the communication server side in response to a user operation. That is, when the user uploads the material data, the material data request unit 315 extracts the corresponding material data from the storage unit 314 under the control of the application execution unit 310, and passes the application server via the data communication unit 302. To 100.

  In the present embodiment, the application execution unit 310 also has a function of realizing an Internet telephone using the VoIP function by executing an IP telephone application.

  The material data receiving unit 313 is a module that receives each material data D2 distributed from the material data distributing unit 128. In particular, in the present embodiment, the link information adding unit 129a stores the control history D1 in the progress of the telephone conference. While accumulating with time information, this control history D1 and the material data D2 which are the object of control recorded on the control history D1 are received according to the traveling time information T1, and data reference data D3 is received. It also has functions. The material data receiving unit 313 also has a function of receiving the minutes data D4 and the material reference data D3 associated with each other based on the progress time information.

  In the present embodiment, the application execution unit 310 includes a communication interface unit 310b and a communication control unit 316 as communication modules. The communication interface unit 310b and the communication control unit 316 cooperate with the data control unit 129 and the material data distribution unit 128 of the application server 100 to provide a tool for communication between users before and during the conference.

  The communication interface unit 310b is a module that constructs a user interface that displays each function in the conference call on the display unit 307, prompts a user operation, and accepts a click operation, a character input, and the like on the screen. In the present embodiment, each function in the telephone conference includes a conference call function, a voting function, and a chat function, and a dedicated viewer is used in accordance with a user operation signal in its own communication terminal or an operation signal from another person. It is started and executed as an add-in to software and general-purpose browser software.

  Here, the screen display for each function executed in the communication interface unit 310b will be described. 10 and 11 are explanatory diagrams showing a display screen of the telephone conference function according to the present embodiment.

  Specifically, when the meeting convocation process is executed, as shown in FIGS. 10A and 10B, the communication interface unit 310b displays a convocation display screen on the calling side and a convocation on the display unit 307. Display the invitation response screen. As shown in FIG. 10 (a), a column 307h for inputting a conference start candidate date, a column 307i for describing conference contents, and communication terminals of callee users a to e are selected on the convocation display screen. A column 307j is also displayed. On the other hand, as shown in FIG. 10B, a convocation reply screen 307 on the convocation side includes a conference start time candidate display field 307l, a participation permission / inhibition input field 307m for determining whether or not to participate in the meeting, and transmission. Button 307k is displayed.

  Further, when the voting function is executed during a meeting or the like, as shown in FIG. 11A, the communication interface unit 310b pops up a voting approval / disapproval screen 307n on the display unit 307 of each communication terminal 30. This vote approval / disapproval screen 307n is a window that is displayed in the foreground preferentially over other displays, and includes an anonymity vote field 307p field together with an approval / disapproval button 307o, and can vote anonymously.

  Further, when the chat function is executed, as shown in FIG. 11B, the communication interface unit 310b displays a chat screen 307r to enable chatting between two parties or between multiple parties. For example, character strings, voice data, other data files, and the like can be transmitted / received to / from other users specified by one user regardless of the progress of the conference.

  In addition, the communication interface unit 310 receives operation signals input to the input fields of the display screens by the users a to e, controls the communication control unit 316, and transmits the operation signals to the application server 100. This operation signal is stored in the control history storage DB 121e of the application server 100 through the IP network 70. In addition, about the data transmitted / received by the chat function, it can be selected whether it accumulate | stores in the server side according to a user setting.

  The communication control unit 316 is a module that transmits an operation signal related to each screen display through the communication network and receives screen display information transmitted from the application server 100 according to control by the communication interface unit 310b.

  Specifically, when the conference call function is executed, the communication control unit 316 of the communication terminal 30 that calls the call transmits an operation signal related to the call to the application server 100. On the other hand, the communication control unit 316 of the called communication terminal 30 receives screen display information related to the invitation from the application server 100 and transmits invitation return information to the application server 100.

  When the voting function is executed, the communication control unit 316 of the communication terminal 30 that starts voting transmits an operation signal related to the voting to the application server 100. On the other hand, the communication control unit 316 of the other communication terminal 30 receives screen display information related to voting from the application server 100, and transmits result information indicating whether voting is possible and anonymous presence / absence information to the application server 100. . Further, when the chat function is executed, the character information of each communication terminal is transmitted / received to / from the application server 100.

(Conference call method)
The telephone conference method can be implemented by operating the telephone conference system having the above configuration. FIG. 6 is an explanatory diagram showing a display screen of the conference call function according to the present embodiment, FIG. 7 is a flowchart diagram showing a material association method of the conference call system according to the present embodiment, and FIG. It is a flowchart figure which shows the material delivery method of the telephone conference system which concerns on embodiment, and FIG. 10 is explanatory drawing which shows the display screen of the telephone conference function which concerns on this embodiment. Here, a case where the users c and d who use the communication terminal 30 have participated in the conference call from the beginning and the user e participates in the conference call from the middle will be described as an example.

  First, a method for associating material data when a telephone conference is executed will be described.

  Here, as illustrated in FIG. 7, the connection control unit 110 forms a virtual conference room through communication between the communication terminals 30 of the users c and d by the connection from the communication terminals 30 of the users c and d. Assume that voice communication between terminals is possible. In this case, as shown in FIG. 6A, the user who attended the meeting is displayed as an attendee icon 307c in the window 307a.

  At the meeting time, the users c and d make a voice call using the microphone 305 and the speaker 306 of each other's communication terminal (S101, S102). The audio signal input from the microphone 305 of the communication terminal 30 is transmitted to the application server 100 by the audio communication unit 301 or the data communication unit 302 (S103, S104).

  Upon receiving the audio signal, the application server 100 records the audio acquired from the communication terminal for each terminal 30 (S105), and converts the recorded audio into character information P1 by the text unit 124 (S106). . Also, the text unit 124 associates the character information P1 converted from the voice data D5 with the voice data D5 of the recorded voice, and based on the character information P1, the voice data D5 corresponding to the character information P1. Can be searched. Then, the character information P1 for each terminal is transmitted to the minutes data generation unit 126.

  Furthermore, the minutes data generation unit 126 that has received the character information P1 for each terminal integrates the character information P1 obtained from each communication terminal 30 in time series to generate the minutes data D4 (S107). Minutes data D4 is stored in the minutes database 121c.

  In addition, during a telephone conference, in order for the user d to acquire the material data D2 referred to in the conference room, for example, the user d acquires the material data D2 such as clicking the material icon displayed on the screen. Data operation for this is performed (S108). In this case, material data acquisition processing is performed on the communication terminal side 30, and the material data request unit 315 transmits request data corresponding to the data operation to the application server 100.

  The data control unit 129 that has received the request data extracts the material data D2 related to the control history D1 corresponding to the user operation from the storage unit 121, and transmits the corresponding material data D2 (S109, S110). The communication terminal 30 of the user b who has received the document data D2 outputs and displays the received document data D2 on the window 307a (S111).

  Here, the data control unit 129 accumulates the control history D1 for the material data D2 controlled according to the data operation of the user d in the control history storage database 121e together with the conference progress time information (S112), and the link The information adding unit 128a associates the control history D1 with the material data D2 to be controlled recorded in the control history D1 according to the traveling time information, and generates the material reference data D3 (S113).

  Further, the link information adding unit 128a associates the material reference data D3 and the minutes data D4 based on the traveling time information T1 (S114). Further, the link information adding unit 128a associates the character information P1 of the minutes data D4 with the material reference data D3, and can search the material reference data D3 corresponding to the character information P1 based on each character information P1. And Then, these associated data are accumulated in each database of the storage unit 121 (S115).

  Next, the user e performs connection processing from the middle and participates in the conference call (S116). In this case, as shown in FIG. 6B, the user e is displayed on the attendee icon 307c.

  Then, by performing a document data acquisition process by the user e (S117), each associated document data is distributed to the communication terminal 30 (S118 and S119), and the output interface 308 is distributed from the document data distribution unit 128. The document reference data D3, minutes data D4, etc. are output or displayed (S120).

  In addition, for participation in the telephone conference in the present embodiment, a conference invitation function may be executed in advance to invite participants to participate in the telephone conference. Hereinafter, a case will be described in which a conference call function is executed to invite participants to join a conference call. In the present embodiment, a case where a meeting organizer is a user d and users c and e are convened will be described as an example.

  First, as shown in FIG. 10A, the communication terminal 30d of the user d who is the convener side displays a conference call display screen by the communication interface unit 310b, and inputs the conference start time candidate date and time. Information is entered in each item of the column 307h, the column 307i describing the contents of the conference, and the column 307j for selecting the communication terminal of the called user, and the transmission button is clicked. The communication interface unit 310 b receives this user operation, controls the communication control unit 316, and transmits an operation signal to the application server 100 through the IP network 70.

  The data control unit 129 of the application server 100 receives this operation signal, stores it in the control history storage DB 121e, and transmits the meeting call screen information to each of the communication terminals 30c and 30e.

  The communication control unit 316 of the communication terminals 30c and 30e receives this screen information, and the communication interface unit 310b executes an application based on this screen information, and as shown in FIG. To display the meeting invitation screen. Then, each user inputs a check for either participation or non-participation in the check box of the participation permission / inhibition input field 307m for determining participation / nonparticipation of the conference through the input interface 309, and clicks or presses the transmission button 307k To do. The communication interface unit 310b accepts the invitation return information and transmits it to the communication control unit 316.

  The invitation reply information is transmitted to the application server 100 by the communication control unit 316, and the application server 100 accumulates the invitation reply information in the control history storage DB 121e, and the call service server 200 based on the invitation reply information. And request connection only to participants in the conference call.

(Data acquisition method)
Next, a material data acquisition method according to a user operation will be described in detail. FIG. 8 is a flowchart showing a material data acquisition method according to this embodiment. Here, a case where the user e participates in the conference call from the middle of the conference call, refers to the minutes data D4 from the start of the conference, and obtains the data reference data D3 associated with the minutes data D4 will be described as an example. To do.

  When a user e who is a participant in a conference call intends to participate in a conference call using the conference call system, he / she first accesses a predetermined URL using the communication terminal 30 (S201). Then, the communication server 10 receives this access (S202), and extracts the teleconference web page from the web database 121a according to the access and distributes it (S203). Thereby, the web page of the conference call is displayed on the window 307a of the communication terminal 30 (S204).

  As shown in FIG. 6B, the conference call Web page displays a conference call attendee icon 307c, a document data column 307e, and a document reference data column 307b in a window 307a.

  Then, the user e refers to the minutes data D4 displayed in the material data column 307e from the start of the meeting in order to grasp the contents of the meeting so far. At this time, an icon 307d of the document reference data D3 corresponding to the displayed minutes data D4 is displayed in the document reference data column 307b.

  Here, the display of the icon 307d of the data reference data D3 will be described. Since the document data distribution unit 128 distributes the document reference data D3 and the minutes data D4 in association with each other based on the progress time information, the output interface 308 displays the minutes displayed in the document data column 307e. The control history D1 of the corresponding time information is referred to from the progress time information of the data D4, and if there is the data reference data D3 that is the object, the data reference data D3 is specified, and the data reference data is used. From the link information described in the data D3, an icon display script is processed to display an icon 307d.

  The user e browses the minutes data D4 displayed in the window 307a from the start of the meeting, and the user e refers to the document reference data D3 while viewing the minutes data D4. Then, the user clicks the icon of the data reference data D3 with a mouse or the like (S205). The user operation of the user e is input to the input interface 309, the data operation unit 309a receives the operation signal, and the data operation unit 309a inputs the data operation signal to the output interface control unit 310a.

  First, the output interface control unit 310a searches the corresponding data reference data D3 from the storage unit 314 inside the terminal (S206), and determines whether there is corresponding data reference data D3 in the terminal (S207). ). If it is determined that there is the material reference data D3 corresponding to the storage unit 314 (“Y” in S207), the content reproduction unit 311 controls the content reproduction unit 311 from the storage unit 314 under the control of the output interface control unit 310a. Data D2 is extracted (S208) and output / displayed in the material data column 307e (S219).

  On the other hand, when it is determined that there is no material reference data D3 corresponding to the storage unit 314 (“N” in S207), the material data request unit 315 controls the material reference data D3 under the control of the output interface control unit 310a. The corresponding data reference data D3 is requested to the application server 100 (S209).

  The operation signal receiving unit 127 receives the request data (S210) and transmits the signal to the data control unit 129. Under the control of the data control unit 129, the material data distribution unit 128 receives the corresponding data from the material database 121d. The reference data D3 is searched (S211), and the material reference data D3 is transmitted (S212).

  The material data receiving unit 313 receives the material reference data D3 and accumulates it in the storage unit 314 (S213). Then, the output interface control unit 310a determines whether or not there is document data D2 associated with the received document reference data D3 (S214). When there is no material data D2 associated with the received material reference data D3 (“N” in S214), only the material reference data D3 distributed by the material data distribution unit 128 is displayed by the content reproduction unit 311. The data is output and displayed at 307 (S219).

  On the other hand, when there is document data D2 associated with the received document reference data D3 (“Y” in S214), the output interface control unit 310a determines that the associated document data D2 is stored in the storage unit 314 in the terminal. Is stored (S215). When the associated document data D2 is stored in the storage unit 314 in the terminal (“Y” in S215), the content reproduction unit 311 stores the associated document reference data D3 and the associated document reference data D3 from the storage unit 314. The material data D2 is extracted, and output and displayed on the display unit 307 (S219).

  On the other hand, when the associated document data D2 is not accumulated in the storage unit 314 in the terminal (“N” in S215), the document data requesting unit 315 controls the corresponding association by the control of the output interface control unit 310a. The requested material data D2 is requested (S216).

  The operation signal receiving unit 127 that has received the request data transmits the signal to the data control unit 129, and under the control of the data control unit 129, the material data distribution unit 128 receives the corresponding associated material data from the material database 121 d. D2 is searched (S217), and the associated document data D2 is transmitted (S218).

  The material data receiving unit 313 receives the associated material data D2 (S213), accumulates it in the storage unit 314, and the content reproduction unit 311 stores the corresponding material reference data D3 and the associated material from the storage unit 314. Data D2 is extracted (S208) and output / displayed on the display unit 307 (S219). Further, the output interface control unit 310a determines whether there is any document data associated with the received document data D2, and continues this operation until there is no associated document data (S214 to S219).

  In the present embodiment, the data operation in step 205 includes an operation for executing a voting function during a meeting and a chat function. Hereinafter, operations when the user e executes the voting function and the chat function during the telephone conference will be described. Here, in the present embodiment, a case where the user e executes the voting function and the chat function will be described as an example.

  First, the case where the voting function is executed will be described. The user e on the vote side clicks the vote icon 307q as shown in FIG. This operation signal is input from the input interface 309 to the communication interface unit 310b. Then, the communication control unit 316 transmits the operation signal to the application server 100 under the control of the communication interface unit 310b. The data control unit 129 of the application server 100 receives this operation signal, extracts screen information related to voting from the WebDB 121a, and transmits it to the communication terminals 30 of other users participating in the conference.

  The communication control unit 316 of each communication terminal 30 receives an operation signal and screen information related to voting, the application is executed by the communication interface unit 310b, and a pop-up display is displayed on the display unit 307. As shown in FIG. 11A, a voting approval / disapproval screen 307n is displayed on the display unit 307 as a separate window. This voting approval / disapproval screen 307n includes an approval / disapproval button 307o and an anonymous voting column 307p. ing. Then, the user clicks or presses the approval button or the opposite button through the input interface 309. At this time, it is also possible to vote anonymously by checking the check box in the anonymous voting column 307p.

  The communication interface unit 310b receives the input operation information, and the communication control unit 316 transmits the result information of the vote to the application server 100. The operation signal receiving unit 127 receives the result information and stores it in the control history storage DB 121e, and the data control unit 129 analyzes the result information, generates analysis result data, and transmits the analysis result data to each communication. Transmit to terminal 30.

  Further, when executing the chat function, the user e who starts the chat clicks the chat icon 307 s displayed on the display unit 307. Based on this operation signal, the communication interface unit 310b executes the application and causes the display unit 307 to display the chat screen 307r. Then, the user e inputs character information and specifies and transmits a communication destination user. The communication interface unit 310b receives the operation signal, controls the communication control unit 316, and transmits the operation signal and character information to the application server 100 through the IP network 70.

  The data control unit 129 that has received the operation signal transmits character information to the identified communication terminal 30 on the other side via the IP network 70. In the communication terminal 30 on the other side, the communication control unit 316 receives the character information, the communication interface unit 310b executes the application, the display unit 307 displays a chat screen 307r as a separate window, and the transmission-side user The character information input by e is displayed.

  The other user inputs character information on the displayed chat screen 307r, specifies the user e, and transmits it to perform the same processing.

(Example of change)
In the present embodiment, the document data acquisition method is performed by operating the document reference data D3 associated with the minutes data D4 by operating the icon 307d of the document reference data D3 displayed in the document data column 307e. However, the present invention is not limited to this. For example, clicking the character information P1 of the minutes data D4 displayed in the material data column 307e, etc. The voice data D5 or the data reference data D3 associated with the character information P1 may be retrieved and output or displayed according to a user operation. Hereinafter, a method for outputting or displaying the voice data D5 or the data reference data D3 associated with the character information P1 by a user operation will be described. FIG. 9 is a flowchart showing a material data acquisition method according to this modification.

  First, similarly to the above, when a user e who is a participant in a conference call intends to participate in a conference call using the conference call system, first, the communication terminal 30 is used to set a predetermined URL. Access is made (S301). Then, the communication server 10 receives this access (S302), and distributes the conference call Web page according to the access (S303). Thereby, the web page of the conference call is displayed in the window 307a of the communication terminal 30 (S304).

  As shown in FIG. 6B, the conference call Web page displays a conference call attendee icon 307c, a document data column 307e, and a document reference data column 307b in a window 307a.

  Then, the user e refers to the minutes data D4 displayed in the material data column 307e from the start of the meeting in order to grasp the contents of the meeting so far. At this time, an icon 307d of the document reference data D3 corresponding to the displayed minutes data D4 is displayed in the document reference data column 307b. Further, when the displayed minutes data D4 includes, for example, character information P1 subjected to the link processing as shown in FIG. 6B, the character information P1 is underlined or colored. Is displayed.

  Then, the user e browses the minutes data D4 displayed in the window 307a from the start of the meeting, and the user e is reading the audio data D5 or the data reference data while viewing the minutes data D4. In order to refer to D3, the character information 307f is clicked with a mouse or the like (S305). The user operation of the user e is input to the input interface 309, and the data operation unit 309a receives the operation signal and receives the data operation unit. 309a inputs a data operation signal to the output interface control unit 310a.

  First, the output interface controller 310a searches the corresponding voice data D5 or document reference data D3 from the storage unit 314 inside the terminal based on the character information P1 included in the minutes data D4 (S306), It is determined whether there is audio data D5 or material reference data D3 corresponding to (S307). When it is determined that there is audio data D5 or material reference data D3 corresponding to the storage unit 314 (“Y” in S307), the content playback unit 311 controls the storage unit 314 under the control of the output interface control unit 310a. The corresponding audio data D5 or material reference data D3 is extracted from (S308), and is output or displayed on the window 307a (S319).

  On the other hand, when it is determined that there is no audio data D5 or material reference data D3 corresponding to the storage unit 314 ("N" in S307), the material data request unit 315 responds under the control of the output interface control unit 310a. The voice data D5 or the data reference data D3 to be requested is requested to the application server 100 (S309).

  The operation signal receiving unit 127 receives the request data (S310) and transmits the signal to the data control unit 129. Under the control of the data control unit 129, the material data distribution unit 128 receives the character information P1 from the material database 121d. The voice data D5 or the data reference data D3 corresponding to is searched (S311), and the voice data D5 or the data reference data D3 is transmitted (S312).

  The material data receiving unit 313 receives the audio data D5 or the data reference data D3 (S313), accumulates the data in the storage unit 314, and also outputs the received audio data D5 or the material reference data D3 by the output interface control unit 310a. It is determined whether or not there is document data associated with (S314). If there is no material data D2 associated with the received audio data D5 or material reference data D3 ("N" in S314), only the audio data D5 or material reference data D3 distributed by the material data distribution unit 128 is provided. Is output or displayed on the display unit 307 by the content reproduction unit 311 (S319) The output or display of the content on the display unit 307 is, for example, as shown in FIG. In addition, the display 307g regarding the audio data is displayed in the material data column 307e, and the audio is output through the speaker 306.

  On the other hand, when there is document data D2 associated with the received audio data D5 or document reference data D3 (“Y” in S314), the output interface control unit 310a indicates that the associated document data D2 is stored in the terminal. Is stored in the storage unit 314 (S315). When the associated document data D2 is stored in the storage unit 314 in the terminal (“Y” in S315), the content reproduction unit 311 stores the corresponding audio data D5 or document reference data D3 from the storage unit 314. Then, the associated material data D2 is extracted and output or displayed on the display unit 307 (S319).

  On the other hand, when the associated document data D2 is not accumulated in the storage unit 314 in the terminal (“N” in S315), the document data requesting unit 315 controls the output of the output interface control unit 310a so that the corresponding association is performed. The requested material data D2 is requested (S316).

  The operation signal receiving unit 127 that has received the request data transmits the signal to the data control unit 129, and under the control of the data control unit 129, the material data distribution unit 128 receives the corresponding associated material data from the material database 121 d. D2 is searched (S317), and the associated document data D2 is transmitted (S318).

  The material data receiving unit 313 receives the associated material data D2 (S313), accumulates it in the storage unit 314, and the content reproduction unit 311 receives the corresponding audio data D5 or material reference data D3 from the storage unit 314. Then, the associated document data D2 is extracted (S308), and output / displayed on the display unit 307 (S319). Further, the application execution unit 310 determines whether there is any document data associated with the received document data D2, and continues this operation until there is no associated document data (S314 to S319).

(Action / Effect)
According to the present embodiment, the material data distribution unit 128 distributes the material data D2 referred to in the conference to the communication terminals of all users who have participated in the conference call, so that the material data is shared. In addition, users participating in the conference can refer to the conference material immediately without having to prepare the material at hand.

  In addition, the material data distribution unit 128 stores, for example, the material data referred to during the meeting as the history, such as the material data D2 operated and displayed by the user, and associates the material data D2 according to the progress time. Since the data is distributed to the user as the material reference data D3, the user can clearly grasp which material is referenced in which time zone during the meeting.

  Furthermore, since the text conversion unit 124 records the voice data D5 for each communication terminal 30 and converts the voice data D5 into text, the text data is recorded even when conversations are overlapped by a plurality of users during the conference. Each voice data D5 can be converted into text, and accurate text processing can be executed. Moreover, since the minutes data generation unit 126 integrates the text information P1 that has been converted into text according to time series, it is possible to generate the minutes data D4 in which the timeline of the entire meeting is accurate. Furthermore, since the minutes data D4 is related and distributed by the material data distribution unit 128 in correspondence with the material reference data D3 in accordance with the progress time of the meeting, the user refers to the texted minutes. Thus, it is possible to instantly refer to materials that are referred to as the conference progresses.

  Further, according to such an embodiment, the voice data D5 or the material reference data D3 can be output or displayed from the character information P1 of the minutes data D4, so that the user can refer to the target voice data D5 or the material. The data D3 can be referred to immediately.

D1, D11, D12, D13 ... Control history D2, D21, D22, D23 ... Document data D3 ... Document reference data D31, D32, D33 ... Log information D4 ... Minutes data D5 ... Audio data P1 ... Text information T1 ... Progress Time information a to e ... Callee user x ... Caller user 10 ... Communication server 20 ... Communication terminal 20a ... Telephone 20b ... Terminal device 30 ... Communication terminal 30a-30e ... Communication terminal 30a-30e ... Each communication terminal 30a-30e ... Telephone 70 ... IP network 80 ... General public line / mobile communication network 90 ... Gateway 100 ... Application server 110 ... Connection control unit 120 ... Application unit 121 ... Storage unit 123 ... Voice data conversion unit 124 ... Text conversion unit 125 ... Time information Addition unit 126 ... Minutes data generation unit 127 ... Operation signal Appendix 128: Document data distribution unit 128a ... Link information addition unit 129 ... Data control unit 130 ... Communication interface 131 ... Voice communication unit 132 ... Data communication unit 200 ... Call service server 210 ... Interface unit 220 ... Call control unit 221 ... Call Original calling part 222 ... Call destination calling part 223 ... Bridge processing part 224 ... Security management part 301 ... Voice communication part 302 ... Data communication part 303 ... VoIP part 304 ... Voice call part 305 ... Microphone 306 ... Speaker 307 ... Display part 307a ... window 307b ... data reference data field 307c ... attendee icon 307d ... data reference data icon 307e ... minutes data field 307f ... link display 307g ... audio data display 307h ... conference start candidate date / time entry field 307i ... meeting Content description field 307j ... Communication terminal selection field 307k ... Send button 307l ... Conference start time candidate display field 307m ... Participation availability input field 307n ... Voting availability screen 307o ... Pros / cons button 307p ... Anonymous voting field 307q ... Voting icon 307r ... Chat screen 307s ... Chat icon 308 ... Output interface 309 ... Input interface 309a ... Data operation part 310 ... Application execution part 310a ... Output interface control part 310b ... Communication interface part 311 ... Content reproduction part 311a ... Browser part 312 ... Output signal generation part 313 ... Material data receiving unit 314 ... Storage unit 315 ... Material data requesting unit 316 ... Communication control unit 333 ... Operation signal acquiring unit 400 ... User database

Claims (20)

A telephone conference system that connects to a communication server arranged on a communication network from a plurality of communication terminals and forms a virtual conference room through communication between the plurality of communication terminals,
The communication terminal is
A call part for making a voice call;
A data operation unit for performing a user operation regarding material data referred to in the conference room on the communication server,
The communication server is
Based on an outgoing call to convene a conference room , communication is established with the plurality of communication terminals, and a call control unit that forms the conference room;
A data control unit that performs data communication related to the material data in response to a user operation in the data operation unit with a communication terminal in which communication is established by a call control unit ;
A control history storage unit that accumulates a control history for the material data controlled by the data control unit, together with progress time information of the conference;
A material data distribution unit for associating the control history with the material data to be controlled recorded in the control history according to the progress time information and distributing the data as material reference data. ,
The call control unit
By receiving a call from a caller who calls the conference room, a call phone number unique to the virtual conference room is used as a caller, and the call is associated with the call phone number. A call destination calling unit that calls the plurality of communication terminals from a terminal and establishes one or more call destination voice call sessions with the plurality of communication terminals;
After at least one callee voice call session is established, the caller's communication terminal is called with the calling telephone number as a caller, and the caller's voice is communicated with the caller user's communication terminal. A caller calling unit for establishing a call session;
Establishing a voice call between the communication terminal of the caller user and the communication terminal of the callee user by bridging the one or more callee voice call sessions and the caller voice call session With the bridge processor
Prepared,
The control history includes convocation result information conducted before the meeting,
The telephone conference system , wherein the communication terminal outputs or displays the material reference data distributed from the material data distribution unit by an output interface . The telephone conference system according to claim 1, wherein the control history storage unit also stores the result of voting performed during a meeting or chat between users as the control history . The communication server is
A voice conversion unit that records the voice acquired from the communication terminal for each terminal and converts the recorded voice into character information;
A text data obtained from each communication terminal is integrated according to time series, and further includes a minutes data generation unit that generates minutes data,
The material data distribution unit further has a function of associating and distributing the material reference data and the minutes data based on the progress time information,
The output interface of the communication terminal further has a function of outputting or displaying the material reference data and the minutes data distributed from the material data distribution unit. Teleconference system. In the minutes data, the voice data of the recorded voice is associated with the character information converted from the voice, and the voice data corresponding to the character information can be searched based on each character information. And
The telephone according to claim 3, wherein the output interface of the communication terminal further has a function of searching for corresponding voice data based on character information included in the minutes data and outputting or displaying the same. Conference system. In the minutes data, the character information and the material reference data are associated, and based on each character information, it is possible to search for the data reference data corresponding to the character information,
5. The output interface of the communication terminal further has a function of searching for corresponding material reference data based on character information included in the minutes data, and outputting or displaying the data. The telephone conference system described in 1. A communication server arranged on a communication network and forming a virtual conference room through communication between a plurality of communication terminals,
Based on an outgoing call to convene a conference room , communication is established with the plurality of communication terminals, and a call control unit that forms the conference room;
The user operation related to the document data referred to in the conference room is acquired from the communication terminal, and the document is communicated with the communication terminal established by the call control unit according to the user operation on the communication terminal. A data control unit for data communication regarding data ;
A control history storage unit that accumulates a control history for the material data controlled by the data control unit, together with progress time information of the conference;
A material data distribution unit for associating the control history with the material data to be controlled recorded in the control history according to the progress time information and distributing the data as material reference data. ,
The call control unit
By receiving a call from a caller who calls the conference room, a call phone number unique to the virtual conference room is used as a caller, and the call is associated with the call phone number. A call destination calling unit that calls the plurality of communication terminals from a terminal and establishes one or more call destination voice call sessions with the plurality of communication terminals;
After at least one callee voice call session is established, the caller's communication terminal is called with the calling telephone number as a caller, and the caller's voice is communicated with the caller user's communication terminal. A caller calling unit for establishing a call session;
Establishing a voice call between the communication terminal of the caller user and the communication terminal of the callee user by bridging the one or more callee voice call sessions and the caller voice call session With the bridge processor
Prepared,
The communication server , wherein the control history includes convocation result information before a meeting . The communication server according to claim 6, wherein the control history storage unit also accumulates the results of voting performed during a meeting or chat between users as the control history . A voice conversion unit that records the voice acquired from the communication terminal for each terminal and converts the recorded voice into character information;
A text data obtained from each communication terminal is integrated according to time series, and further includes a minutes data generation unit that generates minutes data,
The said document data delivery part further has a function which links | relates and distributes the said document reference data and the said minutes data based on the said progress time information, The Claim 6 or 7 characterized by the above-mentioned. Communication server.   In the minutes data, the voice data of the recorded voice is associated with the character information converted from the voice, and the voice data corresponding to the character information can be searched based on each character information. The communication server according to claim 8, wherein:   In the minutes data, the character information and the material reference data are associated with each other, and based on each character information, the material reference data corresponding to the character information can be searched. The communication server according to claim 8 or 9. A communication terminal connected to the communication server according to any one of claims 6 to 10 and capable of participating in a virtual conference room formed through communication between a plurality of communication terminals,
The communication terminal is
A call part for making a voice call;
A data operating portion for performing an operation related to article data referenced in the conference room on the communication server,
A communication terminal, comprising: a data communication unit that performs data communication with respect to the material data in response to a user operation in the data operation unit with the communication server. The control history for the material data controlled on the communication server is stored together with the progress time information of the conference, and the control history and the material data to be controlled recorded in the control history are stored. , In accordance with the travel time information, a material data receiving unit for receiving as data for data reference,
The communication terminal according to claim 11, further comprising: an output interface that outputs or displays the material reference data distributed from the material data distribution unit. The material data receiving unit is configured to convert the voice respectively acquired from the plurality of communication terminals into character information in the communication server, and to integrate the character information obtained from each communication terminal according to a time series. A function of associating and receiving the minutes data and the material reference data based on the progress time information;
The communication terminal according to claim 11 or 12, wherein the output interface further has a function of outputting or displaying the material reference data and the minutes data distributed from the material data distribution unit. In the minutes data, the voice data of the recorded voice is associated with the character information converted from the voice, and the voice data corresponding to the character information can be searched based on each character information. And
The communication terminal according to claim 13, wherein the output interface further has a function of searching for corresponding voice data based on character information included in the minutes data, and outputting or displaying the voice data. In the minutes data, the character information and the material reference data are associated, and based on each character information, it is possible to search for the data reference data corresponding to the character information,
The communication according to claim 13 or 14, wherein the output interface further has a function of searching for corresponding data reference data based on character information included in the minutes data, and outputting or displaying the data. Terminal. A telephone conference method for connecting to a communication server arranged on a communication network from a plurality of communication terminals and forming a virtual conference room through communication between the plurality of communication terminals,
Based on an outgoing call to convene a conference room , communication is established between the communication server and the plurality of communication terminals to form the conference room, and voice communication between the plurality of communication terminals is performed. A call control step that enables
In the communication terminal, a data operation step for performing an operation related to material data referred to in the conference room;
A data control step of performing data communication regarding the material data in response to a user operation in the data operation step with a communication terminal in which communication is established by the call control step ;
The data control step includes
A control history storage step for accumulating a control history for the material data controlled by the communication server, together with progress time information of the conference;
A material data distribution step of associating the control history with the material data to be controlled recorded in the control history according to the progress time information, and distributing the data as material reference data;
In the communication terminal, an output step for outputting or displaying the material reference data distributed in the material data distribution step;
Further comprising
In the call control step,
By receiving a call from a caller who calls the conference room, a call phone number unique to the virtual conference room is used as a caller, and the call is associated with the call phone number. Making a call from the terminal to the plurality of communication terminals, establishing one or more callee voice call sessions with the plurality of communication terminals,
After at least one callee voice call session is established, the caller's communication terminal is called with the calling telephone number as a caller, and the caller's voice is communicated with the caller user's communication terminal. Establish a call session,
Establishing a voice call between the communication terminal of the caller user and the communication terminal of the callee user by bridging the one or more callee voice call sessions and the caller voice call session <br/> A telephone conference method characterized by the above. 17. The telephone conference method according to claim 16, wherein in the control history storing step, a result of voting performed during a meeting or chat between users is also accumulated as the control history . In the communication server, recording the voice acquired from the communication terminal for each terminal, and converting the recorded voice into character information;
It further comprises a minutes data generation step that integrates character information obtained from each communication terminal according to a time series and generates minutes data,
In the document data distribution step, the document reference data and the minutes data are associated and distributed based on the progress time information,
The telephone conference method according to claim 16 or 17, wherein, in the output step, the material reference data and the minutes data distributed from the material data distribution unit are output or displayed. In the minutes data, the voice data of the recorded voice is associated with the character information converted from the voice, and the voice data corresponding to the character information can be searched based on each character information. And
19. The telephone conference method according to claim 18, wherein in the output step, corresponding voice data is searched based on character information included in the minutes data, and is output or displayed. In the minutes data, the character information and the material reference data are associated, and based on each character information, it is possible to search for the data reference data corresponding to the character information,
20. The telephone conference method according to claim 18 or 19, wherein in the output step, the corresponding material reference data is searched based on character information included in the minutes data, and is output or displayed.