JP2018060297A - Conference terminal, microphone selection method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which: sounds when a finger or a pen or the like drawing an image touches on a conference terminal are collected.SOLUTION: A conference terminal comprises: a touch panel display accepting an input by drawing from a user and displaying an image; a plurality of microphones collecting surrounding sounds; and a control part determining a position on the touch panel display on which the user is drawing and selecting the microphone for sound collection for collecting sounds from the plurality of microphones according to the drawing position.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a conference terminal, a microphone selection method, and a program.

  There is known a video conference system for conducting a conference between remote locations via a network. In such a video conferencing system, digital image and audio data acquired at one remote location is transmitted to another remote location, and the image and audio are output and shared by the display and speaker at the other remote location. Yes.

  In video conference systems, a technology related to a conference terminal having an interactive whiteboard (or electronic blackboard) realized by a touch panel-mounted display is known. Such a conference terminal converts an image hand-drawn on the touch panel by a user at one remote location into electrical image data and transmits the image data to another remote location. When the other remote conference terminal receives the image data, it displays a hand-drawn image on the display.

  However, the above-described technique has a problem that sounds are collected when a finger or a pen that draws an image on the conference terminal contacts.

  This invention is made in view of the above, Comprising: It aims at providing the conference terminal which can suppress collection of the sound which draws an image on a conference terminal.

  In order to solve the above-described problems and achieve the object, the conference terminal of the present invention receives input by drawing from a user, displays a touch panel display that displays images, and a plurality of microphones that collect surrounding sounds And a control unit that selects, from the plurality of microphones, a voice collecting microphone that collects voice according to a position on the touch panel display on which the user is drawing.

  According to the present invention, it is possible to suppress the collection of sound during drawing.

FIG. 1 is an overall configuration diagram of the video conference system according to the first embodiment. FIG. 2 is a block diagram illustrating a hardware configuration of an interactive whiteboard having a conference terminal function. FIG. 3 is a front view of the input / output board unit. FIG. 4 is a functional block diagram illustrating functions of the information processing unit of the conference terminal in the microphone selection process. FIG. 5 is a flowchart of microphone selection processing executed by the control unit. FIG. 6 is a diagram illustrating a state in which the user is drawing in the drawing area at the upper left of the touch panel display. FIG. 7 is a front view of the input / output board part for explaining the first modification. FIG. 8 is a front view of the input / output board part for explaining the second modification. FIG. 9 is a front view of the input / output board part for explaining the third modification. FIG. 10 is a front view of the input / output board part for explaining the fourth modification.

  Common constituent elements such as the following exemplary embodiments are denoted by common reference numerals, and redundant descriptions are omitted as appropriate.

<First Embodiment>
FIG. 1 is an overall configuration diagram of a video conference system 10 according to the first embodiment. As shown in FIG. 1, the video conference system 10 includes a conference reservation server 12, a plurality of conference terminals 14 a, 14 b, 14 c, 14 d, and a conference server 16. When it is not necessary to distinguish between the plurality of conference terminals 14a, 14b, 14c, and 14d, they are referred to as conference terminals 14. The conference reservation server 12, the conference server 16, and the plurality of conference terminals 14 are connected via a communication network 18 such as the Internet and a LAN (Local Area Network) that can transmit and receive data such as image data and audio data. .

  An example of the conference reservation server 12 is a computer. The conference reservation server 12 may be connected to another personal computer. The conference reservation server 12 acquires conference information input by a user such as a conference organizer from the conference terminal 14. The conference information is, for example, information related to the date and time of the conference, the location, the conference participant, the role, the conference terminal to participate in, and the like. The conference reservation server 12 may acquire conference information from a personal computer other than the conference terminal 14.

  The plurality of conference terminals 14 are installed at positions separated from each other (for example, a remote place). The conference terminal 14 is, for example, a computer having an interactive whiteboard function. The interactive whiteboard function is a function realized by a display equipped with a touch panel capable of communication. Specifically, the interactive whiteboard function transmits / receives image data of an image displayed by an instruction from a computer and drawing data obtained by converting an image hand-drawn on the screen to / from other conference terminals 14. To do. The conference terminal 14 inquires of the conference reservation server 12 whether or not there is conference information of a video conference registered as the conference terminal 14 with which the conference terminal 14 participates. If there is a video conference in which the conference terminal 14 participates, the conference terminal 14 controls the video conference based on a preset video conference program or the like. For example, the conference terminal 14 transmits image data and audio data acquired from the user to the conference server 16 during the video conference. The conference terminal 14 receives image data, audio data, and the like input by the user at the other conference terminals 14 from the conference server 16 and outputs images and audio.

  An example of the conference server 16 is a computer. The conference server 16 monitors whether or not each conference terminal 14 is connected to itself via the communication network 18. The conference server 16 performs call control of the conference terminal 14 at the start of the conference based on the conference information of the conference reservation server 12. The conference server 16 executes video conference control including transmission and reception of information with the conference terminal 14.

  FIG. 2 is a block diagram illustrating a hardware configuration of an interactive whiteboard having a conference terminal function. As shown in FIG. 2, the conference terminal 14 includes an input / output board unit 20, a communication I / F unit 22, an operation unit 24, and an information processing unit 26.

  The input / output board unit 20 includes a camera 30, a touch panel display 32, a plurality of microphones 34 a, 34 b, 34 c, 34 d,. In the following description, when it is not necessary to distinguish the microphones 34a, 34b, 34c, and 34d, they are described as the microphone 34. The camera 30, the touch panel display 32, the microphone 34, and the speaker 36 are connected to the information processing unit 26 so as to be able to transmit and receive data.

  An example of the camera 30 is an imaging device having a CMOS sensor, a CCD sensor, and the like. The camera 30 images surrounding subjects and generates image data such as a moving image. It is preferable that the camera 30 can image the surroundings in a wide angle range. For example, the camera 30 captures a participant in a conference room in which the conference terminal 14 participating in the video conference is installed and generates image data. The camera 30 transmits the captured image data to the information processing unit 26.

  The touch panel display 32 has a display function for displaying an image by a liquid crystal display device and the like, and a touch panel function for receiving an input by drawing from a user (for example, a participant in a video conference). For example, the touch panel display 32 acquires image data transmitted from another conference terminal 14 participating in a video conference from the information processing unit 26 and displays an image. When the touch panel display 32 receives an input by the user touching with a finger or a pen, the touch panel display 32 transmits the coordinate data of the touched position to the information processing unit 26. The touch panel display 32 may have a hovering detection function that can accept input even when the user is not in direct contact. An example of the touch panel display 32 having a hovering detection function is a display-integrated capacitive touch panel.

  The microphone 34 collects ambient sound, converts the sound into electrical sound data, and transmits the electrical sound data to the information processing unit 26. For example, the microphone 34 collects voices such as comments from participants in the video conference, converts them into voice data, and transmits the voice data.

  The speaker 36 converts voice data received from the information processing unit 26 into voice and outputs the voice to the outside. For example, the speaker 36 acquires audio data transmitted from other conference terminals 14 participating in the video conference from the information processing unit 26 and outputs audio.

  The communication I / F unit 22 is connected to the information processing unit 26 and the communication network 18 so that data can be transmitted and received. Accordingly, the communication I / F unit 22 connects the information processing unit 26 to the conference reservation server 12, the conference server 16, and the other conference terminals 14 so that data such as image data and audio data can be transmitted and received. The communication I / F unit 22 is a wired LAN interface that can be connected to Ethernet (registered trademark) compatible with at least one of 10Base-T, 100Base-TX, and 1000Base-T, for example. The communication I / F unit 22 may be a wireless LAN interface compatible with 802.11a / b / g / n.

  The operation unit 24 receives input from the user. The operation unit 24 includes, for example, at least one of a keyboard, operation buttons, a mouse, and the like. The operation unit 24 is connected to the information processing unit 26 so that data can be transmitted and received. The operation unit 24 transmits data related to the input received from the user to the information processing unit 26.

  The information processing unit 26 performs overall control of the conference terminal 14. An example of the information processing unit 26 is a computer. The information processing unit 26 may be provided integrally with the input / output board unit 20, or may be provided as a separate component from the input / output board unit 20. The information processing unit 26 includes a control unit 40, a storage device 42, and a memory 44.

  The control unit 40 is an arithmetic processing device such as a hardware processor including a CPU (Central Processing Unit), for example. The control unit 40 is connected to the camera 30, the touch panel / display 32, the microphone 34, the speaker 36, the communication I / F unit 22, and the operation unit 24 so that data can be transmitted and received. The control unit 40 performs device control. Specifically, the control unit 40 controls the camera 30, the touch panel / display 32, the microphone 34, the speaker 36, and the operation unit 24. For example, the control unit 40 acquires image data of a user or the like in the conference room from the camera 30. The control unit 40 transmits audio data received from another conference terminal 14 or the like to the speaker 36 to output audio. The control unit 40 transmits the image data and the drawing data received from the other conference terminal 14 or the like to the touch panel display 32 to display an image. The control unit 40 acquires voice data such as voice spoken by the user from the microphone 34. The control unit 40 generates drawing data based on the coordinate data of the image drawn by the user acquired from the touch panel display 32. The control unit 40 may execute control of the video conference by a CODEC (Coder / Decoder) function. The CODEC function of the control unit 40 is, for example, H.264. H.264 / AVC, H.H. H.264 / SVC and H.264. 265 and so on. For example, the control unit 40 performs processing such as encoding on image data, audio data, and drawing data in a video conference, and then transmits the data to the conference server 16 via the communication I / F unit 22. Good. The control unit 40 decodes the image data, audio data, drawing data, and the like of the other conference terminal 14 acquired from the conference server 16 via the communication I / F unit 22 and then displays the data on the touch panel display. 32 and the speaker 36 may be transmitted.

  The storage device 42 stores a microphone selection processing program executed by the device control and video conference control executed by the control unit 40, and data such as parameters necessary for the execution of the program. The storage device 42 is a nonvolatile storage medium such as a flash memory, an HDD (Hard Disk Drive), and an SSD (Solid State Drive).

  The memory 44 temporarily stores development of a program executed by the control unit 40 and operation data during the execution of the program. The memory 44 is a volatile memory such as a DDR SDRAM (Double-Data-Rate SDRAM).

  FIG. 3 is a front view of the input / output board unit 20. As shown in FIG. 3, the touch panel display 32 is disposed at substantially the center of the input / output board unit 20. When the user moves the touch panel display 32 while touching the pen 46 or the like, the touch panel display 32 displays an image DR along the movement locus. The touch panel display 32 has four drawing areas AR1, AR2, AR3, AR4 divided by 2 × 2 in the horizontal direction and the vertical direction. When there is no need to distinguish the drawing areas AR1, AR2, AR3, and AR4, they are referred to as a drawing area AR. Although the drawing area AR is divided by giving a dotted line to the drawing for the purpose of explanation, the four drawing areas AR do not have to be physically divided. Preferably, it is better that the user cannot visually recognize the four drawing areas AR. The four drawing areas AR have the same area, for example. The drawing area AR <b> 1 is arranged at the upper left of the touch panel display 32. The drawing area AR <b> 2 is arranged at the upper right of the touch panel display 32. The drawing area AR3 is arranged at the lower right of the touch panel display 32. The drawing area AR4 is arranged at the lower left of the touch panel display 32.

  The camera 30 is disposed above the touch panel display 32 and in the center of the upper part of the input / output board unit 20.

  The speaker 36 is disposed below the touch panel display 32 and below the input / output board unit 20.

  As shown in FIG. 3, the input / output board unit 20 of this embodiment includes four microphones 34a, 34b, 34c, and 34d. The number of microphones 34 is the same as the number of drawing areas AR. In other words, the number and arrangement of the drawing areas AR are preferably set in accordance with the number of microphones 34. The four microphones 34 are arranged at positions separated from each other. Specifically, the microphone 34 a is disposed at the upper left of the input / output board unit 20. The microphone 34 b is disposed on the upper right side of the input / output board unit 20. The microphone 34 c is disposed at the lower right of the input / output board unit 20. The microphone 34d is disposed at the lower left of the input / output board unit 20. That is, the four microphones 34a, 34b, 34c, and 34d are arranged in association with the drawing areas AR1, AR2, AR3, and AR4, respectively. Specifically, the microphone 34a is arranged in association with the vicinity of the drawing area AR1. The microphone 34b is arranged in association with the vicinity of the drawing area AR2. The microphone 34c is arranged in association with the vicinity of the drawing area AR3. The microphone 34d is arranged in association with the vicinity of the drawing area AR4.

  Next, the operation of the video conference system 10 described above will be described. Here, as an example, a video conference in which the conference terminals 14a, 14b, and 14c participate will be described. When the video conference time registered in the conference information of the conference reservation server 12 is reached, the conference server 16 calls the conference terminal 14 registered as the conference terminal 14 participating in the conference information. Thereby, the conference terminal 14 starts transmission / reception of data with the conference terminal 14 in response to the call.

  For example, image data of a user (for example, a conference participant) captured by the conference terminal 14 a with the camera 30, voice data such as a user's speech acquired by the microphone 34, and an image drawn on the touch panel display 32 by the user. Drawing data and the like are transmitted to the conference server 16. In this case, the conference server 16 transmits the received data to the participating conference terminals 14b and 14c, but does not transmit the data to the conference terminal 14d not participating in the video conference. As a result, the conference terminals 14b and 14c participating in the video conference display the image of the image data and the drawing data on the touch panel display 32 based on the received data and display the sound of the audio data on the speaker 36. Output from. Similarly, when the conference server 16 receives data from the conference terminal 14b (or the conference terminal 14c), the conference server 16 transmits data to the conference terminals 14a and 14c (or the conference terminals 14a and 14b), but transmits data to the conference terminal 14d. Do not send. Thereby, the video conference system 10 realizes a video conference between multiple bases by using the plurality of conference terminals 14 registered in advance in the conference information among the plurality of conference terminals 14.

  Here, in this embodiment, when the predetermined condition is satisfied, the conference terminal 14 transmits only the audio data generated by the microphone 34 selected by the microphone selection process described later to the conference server 16. On the other hand, when the predetermined condition is not satisfied, the conference terminal 14 transmits the audio data acquired by the microphone 34 having the highest acquired sound collection level to the conference server 16. An example of the predetermined condition is a time during which the user draws an image or the like on the touch panel display 32 and a time from when the drawing ends until a predetermined determination time elapses.

  FIG. 4 is a functional block diagram illustrating functions of the information processing unit 26 of the conference terminal 14 in the microphone selection process. As illustrated in FIG. 4, the information processing unit 26 includes a determination unit 50, a selection unit 52, and a storage unit 54. The determination unit 50 and the selection unit 52 are functions realized by being developed in the memory 44 when the control unit 40 reads a microphone selection processing program stored in the storage unit 54. Part or all of the determination unit 50 and the selection unit 52 may be configured by hardware such as a circuit including an ASIC (Application Specific Integrated Circuit). The storage unit 54 is a function realized by the storage device 42 and the memory 44.

  The determination unit 50 performs various determinations in the microphone selection process executed in the video conference control process. For example, the determination unit 50 determines whether or not the video conference is ended, that is, whether or not the video conference is ongoing. If the determination unit 50 determines that the operation is ongoing, the determination unit 50 outputs a determination result indicating that the operation is ongoing to the selection unit 52.

  The determination unit 50 determines whether or not the user is drawing on the screen of the touch panel display 32. For example, if the determination unit 50 determines that drawing is being performed on the touch panel display 32 by receiving coordinate data, for example, the determination unit 50 determines the position on the touch panel display 32 where the user is drawing, and further determines which position is being drawn. Is included in the drawing area AR. The determination unit 50 outputs information on the drawing area AR of the user's drawing position to the selection unit 52.

  The determination unit 50 determines whether or not the determination time has elapsed since the drawing on the touch panel display 32 has ended. The determination time is determined in advance and stored in the storage unit 54. Note that, after the user has drawn once, the determination unit 50 does not determine whether or not the video conference is ended until it is determined that the determination time has elapsed since the end of drawing.

  When acquiring the determination result indicating that the video conference is ongoing from the determination unit 50, the selection unit 52 selects the microphone 34 having the highest sound collection level as the microphone 34 for voice collection.

  The selection unit 52 selects the sound collection microphone 34 for collecting sound from the plurality of microphones 34. For example, when the user is drawing on the touch panel display 32, the selection unit 52 uses the microphones 34 set in advance according to the drawing position on the touch panel display 32 to collect sound from the plurality of microphones 34. Select as microphone 34. Specifically, when the information of the drawing area AR including the position where the user is drawing from the determination unit 50 is acquired from the determination unit 50, the selection unit 52 selects the microphone 34 for voice collection based on the drawing area AR. For example, the selection unit 52 selects the microphone 34 farthest from the drawing area AR, that is, the microphone 34 farthest from the drawing position as the voice collecting microphone 34.

  Here, the selection unit 52 does not acquire a determination result indicating that the determination unit 50 continues from the determination unit 50 until the determination time has elapsed since the end of the user's drawing. Therefore, after the user has drawn once, the selection unit 52 does not select the microphone 34 having the highest sound collection level until the determination time has elapsed since the drawing on the touch panel display 32 has ended. The microphone 34 selected based on the above is continued as the microphone 34 for voice collection. On the other hand, when the selection unit 52 obtains a determination result indicating that the video conference is continuing from the determination unit 50 after a drawing time has elapsed from the end of drawing on the touch panel display 32 after the user has once drawn, The microphone 34 having the highest sound collection level is selected as the collecting microphone 34.

  The storage unit 54 stores data such as a program and parameters necessary for executing the program. For example, the storage unit 54 stores a program for microphone selection processing. The storage unit 54 stores the coordinate data of the drawing area AR of the touch panel display 32, the position of each microphone 34, the determination time, and the like.

  The program for microphone selection processing executed by the control unit 40 of the conference terminal 14 according to the present embodiment has a module configuration including the above-described units (the determination unit 50 and the selection unit 52). As actual hardware, when the control unit 40 reads out and executes a program for microphone selection processing from the storage device 42, the respective units are loaded on the main storage device. Thereby, the determination part 50 and the selection part 52 are produced | generated on the main memory, and these functions are implement | achieved by the computer.

  For example, a microphone selection processing program executed by the control unit 40 of the conference terminal 14 according to the present embodiment is provided by being incorporated in advance in the storage device 42 or the like. The microphone selection processing program executed by the control unit 40 of the conference terminal 14 according to the present embodiment is a file in an installable format or an executable format, such as a CD-ROM, a flexible disk (FD), a CD-R, You may comprise so that it may record and provide on computer-readable recording media, such as DVD (Digital Versatile Disk).

  Furthermore, a program for microphone selection processing executed by the control unit 40 of the conference terminal 14 of the present embodiment is stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. It may be configured. Further, the microphone selection processing program executed by the control unit 40 of the conference terminal 14 according to the present embodiment may be provided or distributed via a network such as the Internet.

  FIG. 5 is a flowchart of the microphone selection process executed by the control unit 40. The control unit 40 reads a program for microphone selection processing, and executes microphone selection processing, which is an example of a microphone selection method, as part of video conference control processing.

  As shown in FIG. 5, in the microphone selection process, the determination unit 50 of the control unit 40 determines whether or not the video conference is ended when the video conference is started (S102). For example, the determination unit 50 determines the end of the video conference depending on whether or not the user operates the operation unit 24 and inputs an instruction to end the video conference. If the determination unit 50 determines that the video conference has not ended, that is, that the video conference is continuing (S102: No), the determination unit 50 outputs the determination result to the selection unit 52.

  Upon acquiring the determination result indicating that the video conference is ongoing from the determination unit 50, the selection unit 52 selects the microphone 34 having the maximum sound collection level as the sound collection microphone 34 (S104). As a result, the control unit 40 transmits to the conference server 16 the audio data of the sound collected by the microphone 34 having the maximum sound collection level.

  The determination unit 50 determines whether or not a user (for example, a conference participant) is drawing on the touch panel display 32 (S108). For example, the determination unit 50 determines whether or not drawing is performed based on whether or not coordinate data of a position where the user is drawing is received from the touch panel display 32. If the determination part 50 determines with the user not drawing on the touchscreen display 32 (S108: No), it will repeat step S102 and subsequent steps.

  On the other hand, when the determination unit 50 determines that the user is drawing on the touch panel display 32 (S108: Yes), the coordinate data acquired from the touch panel display 32 and the coordinate data of the drawing area stored in the storage unit 54 are displayed. The drawing area AR is determined based on the drawing position. FIG. 6 is a diagram illustrating a state in which the user is drawing in the drawing area AR <b> 1 at the upper left of the touch panel display 32.

  The determination unit 50 determines whether or not the drawing position is the upper left drawing area AR1 (S110). As illustrated in FIG. 6, when the determination unit 50 determines that the drawing position is the upper left drawing area AR <b> 1 (S <b> 110: Yes), the determination unit 50 outputs information on the drawing area AR <b> 1 to the selection unit 52. When acquiring the information of the drawing area AR1 from the determination unit 50, the selection unit 52 selects the lower right microphone 34c that is farthest from the drawing area AR1 and hardly collects the drawing sound as the voice collecting microphone 34 (S112).

  If the determination unit 50 determines that the drawing position is not the upper left drawing area AR1 (S110: No), the determination unit 50 determines whether the drawing position is the upper right drawing area AR2 (S114). If the determination unit 50 determines that the drawing position is the upper right drawing area AR <b> 2 (S <b> 114: Yes), it outputs information on the drawing area AR <b> 2 to the selection unit 52. Upon acquiring the information on the drawing area AR2 from the determination unit 50, the selection unit 52 selects the lower left microphone 34d that is the farthest from the drawing area AR2 and hardly collects the drawing sound as the sound collection microphone 34 (S116).

  If the determination unit 50 determines that the drawing position is not the upper right drawing area AR2 (S114: No), the determination unit 50 determines whether the drawing position is the lower right drawing area AR3 (S118). If the determination unit 50 determines that the drawing position is the lower right drawing area AR3 (S118: Yes), the information is output to the selection unit 52. When acquiring the information of the drawing area AR3 from the determination unit 50, the selection unit 52 selects the upper left microphone 34a that is the farthest from the drawing area AR3 and hardly collects the drawing sound as the voice collecting microphone 34 (S120).

  If the determination unit 50 determines that the drawing position is not the lower right drawing area AR3 (S118: No), the drawing position is the remaining lower left drawing area AR4. Information on the drawing area AR4 is output to the selection unit 52. Upon acquiring the information on the drawing area AR4 from the determination unit 50, the selection unit 52 selects the upper right microphone 34b that is the farthest from the drawing area AR4 and hardly collects the drawing sound as the voice collecting microphone 34 (S122).

  When the selection unit 52 selects any one of the microphones 34 in steps S112, S116, S120, and S122, the determination unit 50 determines whether or not the determination time that has been determined in advance from the end of drawing and stored in the storage unit 54 has elapsed. (S124). Note that the determination unit 50 may determine that the drawing is finished when the drawing coordinate data is not received from the touch panel display 32. If the determination unit 50 determines that the determination time has not passed since the end of drawing (S124: No), the determination unit 50 repeats step S124 and enters a standby state. Thereby, voice collection is continued by the microphone 34 selected based on the drawing area AR including the position where the selection unit 52 is drawing.

  If the determination unit 50 determines that the determination time has elapsed from the end of drawing (S124: Yes), it repeats step S102 and subsequent steps. Thereby, the selection part 52 selects again the microphone 34 with the largest sound collection level by step S104. Thereafter, when the determination unit 50 determines that the video conference is ended (S102: Yes), the microphone selection processing is ended together with the video conference control processing.

  As described above, in the conference terminal 14 of the video conference system 10, the selection unit 52 of the control unit 40 selects the microphone 34 farthest from the drawing area AR on which the user is drawing. Can be suppressed. Thereby, the conference terminal 14 can suppress the sound generated by the drawing from being transmitted to the other conference terminals 14, and can suppress the noise output from the other conference terminals 14.

  In the conference terminal 14, voice collection is continued by the microphone 34 selected by the selection unit 52 in the drawing area AR being drawn until the determination unit 50 of the control unit 40 determines that the determination time has elapsed since the end of drawing. As a result, even when the user draws across the drawing area AR and when the user temporarily stops drawing and speaks, the conference terminal 14 has the microphone 34 for voice collection frequently and unintentionally. Natural switching can be reduced, and the uncomfortable feeling due to the switching of the microphone 34 can be reduced.

  A modification in which a part of the above-described embodiment is modified will be described. In the following modification, the touch panel display 32 is configured to accept not only the single touch described above but also multi-touch drawing at a plurality of locations at the same time.

<First Modification>
FIG. 7 is a front view of the input / output board unit 20 for explaining the first modification. In the situation shown in FIG. 7, the determination unit 50 determines that the user is drawing at three locations on the touch panel display 32 at the same time, and obtains information on the drawing areas AR1, AR3, AR4 including the drawing positions. The data is output to the selection unit 52. When acquiring the drawing areas AR1, AR3, and AR4, the selection unit 52 selects the microphone 34b that is farthest from any of the three drawing areas AR1, AR3, and AR4 that are being drawn. For example, the selection unit 52 selects the microphone 34b farthest from the center of gravity of the three drawing areas AR1, AR3, AR4. In other words, the selection unit 52 selects the microphone 34b closest to the drawing area AR2 that is not drawn.

<Second Modification>
FIG. 8 is a front view of the input / output board unit 20 for explaining the second modification. In the situation shown in FIG. 8, the user is drawing simultaneously at two locations on the touch panel display 32. In this case, the determination unit 50 outputs information on a plurality of drawing areas AR <b> 1 and AR <b> 3 of the touch panel display 32 including the drawing position to the selection unit 52. When acquiring the information of the drawing areas AR1 and AR3, the selection unit 52 selects the microphone 34 farthest from any of the drawing areas AR1 and AR3 being drawn. However, drawing is performed in two drawing areas AR1 and AR3 (or drawing areas AR2 and AR4) intersected by the user, and a plurality of (for example, two) microphones 34 that are farthest from the drawing position and the drawing area AR are drawn. In some cases, the selection unit 52 preferentially selects the upper microphone 34b that is unlikely to be covered with the body of the user US as the microphone 34 for voice collection. Similarly, when the user US is drawing simultaneously in two drawing areas AR (for example, the drawing areas AR1 and AR4) arranged vertically, the selection unit 52 selects the upper microphone 34 (for example, the microphone 34b). To do. Thereby, the conference terminal 14 can suppress that the user who is drawing blocks the microphone 34 and prevents the voice collection.

<Third Modification>
FIG. 9 is a front view of the input / output board unit 20 for explaining the third modification. In the situation shown in FIG. 9, the determination unit 50 determines that the user is drawing at two locations on the touch panel display 32 at the same time, and selects information on the drawing areas AR3 and AR4 including the drawing positions. To 52. When acquiring the information of the drawing areas AR3 and AR4, the selection unit 52 selects the microphone 34 farthest from the drawing areas AR3 and AR4 being drawn. However, when the user is drawing in two drawing areas AR3 and AR4 arranged in the horizontal direction, the two farthest microphones 34 are at the same height, so the selection unit 52 sets the priority to a preset priority. Based on this, the microphone 34 is selected.

<Fourth Modification>
FIG. 10 is a front view of the input / output board unit 20 for explaining the fourth modification. As shown in FIG. 10, the input / output board unit 20 may include six microphones 34a, 34b, 34c, 34d, 34e, and 34f. The microphone 34 e is installed at the center of the upper part of the input / output board 20. The microphone 34 f is installed at the lower center of the input / output board 20. In this case, according to the microphone 34, the touch panel display 32 may be subdivided to set six drawing areas AR1, AR2, AR3, AR4, AR5, AR6. The drawing area AR5 is arranged on the upper side of the center of the touch panel display 32. The drawing area AR6 is arranged below the center of the touch panel display 32. Thereby, the selection part 52 can select the microphone 34 more accurately at the time of multi-touch.

  You may change suitably the function, arrangement | positioning, shape, number, etc. of each structure of the above-mentioned embodiment. Moreover, you may combine the above-mentioned embodiment and each modification.

  For example, the number of microphones 34 and drawing areas AR may be changed as appropriate.

  The order of steps S110, S114, and S118 for determining the drawing area AR by the determination unit 50 may be changed as appropriate.

  The above-described embodiments have been presented by way of example and are not intended to limit the scope of the present invention. The novel embodiment can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. The embodiments and modifications of the embodiments are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

14 ... Conference terminal 20 ... Input / output board unit 26 ... Information processing unit (computer)
30 ... Camera 32 ... Touch panel display 34 ... Microphone 40 ... Control unit AR ... Drawing area

JP 2016-111645 A JP2012-203122A

Claims (8)

A touch panel display that accepts input from a user and displays an image;
Multiple microphones that collect ambient audio,
A control unit that selects, from the plurality of microphones, a microphone for voice collection that collects voice according to a position on the touch panel display on which the user is drawing;
A conference terminal. The conference terminal according to claim 1, wherein the control unit selects a microphone farthest from the drawing position as the microphone for voice collection. The conference terminal according to claim 1, wherein the control unit selects a microphone set in advance according to a position on the touch panel display as the microphone for voice collection. 4. The control unit according to claim 1, wherein the control unit selects the microphone having the highest sound collection level as the microphone for sound collection when a predetermined determination time has elapsed from the end of drawing by the user. 5. The listed conference terminal. 5. The control unit according to claim 1, wherein when there are a plurality of microphones farthest from the drawing position, the control unit preferentially selects the upper microphone as the microphone for voice collection. 6. Meeting terminal. The touch panel display has four drawing areas divided by 2 × 2 in the horizontal and vertical directions,
When the user is drawing in a plurality of drawing areas on the touch panel display, and there are a plurality of microphones farthest from the plurality of drawing areas, the control unit preferentially selects the upper microphone. The conference terminal according to claim 1, wherein the conference terminal is selected as a microphone for voice collection. A touch panel display that accepts input from a user and displays an image;
Multiple microphones that collect ambient audio,
In the microphone selection method of the conference terminal comprising:
Determining a position on the touch panel display that the user is drawing;
Selecting a microphone for voice collection for collecting voice according to the drawing position from the plurality of microphones;
A microphone selection method comprising: A touch panel display that accepts input from a user and displays an image;
Multiple microphones that collect ambient audio,
A conference terminal computer comprising:
A function of determining a position on the touch panel display that the user is drawing;
A function of selecting a microphone for voice collection that collects voice according to the drawing position from the plurality of microphones;
A program to realize

Images