JP6733450B2 - Video conferencing device, information processing method and program - Google Patents

Description

The present invention relates to a video conference device, an information processing method, and a program.

2. Description of the Related Art Video conferencing apparatuses that perform video conferencing with remote locations via a communication network such as the Internet are widely used. Among the video conferencing devices, an interactive whiteboard type video conferencing device with a touch panel function has been proposed and already known in order to meet the need to share not only video and audio but also hand-drawn materials with the partner site. There is. By using this interactive whiteboard type video conferencing device, it becomes possible to share drawing data showing a locus indicating characters, symbols, figures, etc. written on the touch panel display with the partner base.

In such an interactive whiteboard type video conference device, a writing sound (hereinafter referred to as “writing noise”) is generated by touching a touch panel with a pen or a finger during writing. When a video conferencing microphone is built in or placed near the interactive whiteboard, this writing noise is picked up by the microphone and is heard at the other site, which hinders conversation. It is important to attenuate such sound noise by providing an audio filter.

As a technique to detect and suppress such noise of sound, voices including noise signals are appropriately detected for the purpose of appropriately detecting special sudden noise that has a relatively long duration and is non-monotonically attenuated, such as keyboard sound. An amplitude detection unit that detects the noise start point of the voice signal by comparing the amplitude value of the signal with a threshold value, and a frequency feature amount calculation unit that calculates the frequency feature amount that represents the frequency characteristic of the voice signal at least after the noise start point. Based on the frequency feature amount, the audio signal processing device including the noise determination unit that determines, as the noise interval, the interval that continuously includes the high frequency component equal to or higher than the reference frequency in the audio signal after the noise start point forms a beam. A forming method has been proposed (see Patent Document 1).

However, in the technique described in Patent Document 1, although specific unnecessary noise can be detected and suppressed from the input voice, the frequency feature amount of the sound is calculated and the reference of the voice signal is obtained. There is a problem that a complicated process such as determining a section including a high frequency component higher than the frequency as a noise section must be performed.

The present invention has been made in view of the above, and an object thereof is to provide a video conference device, an information processing method, and a program capable of accurately reducing writing noise by a simple process.

In order to solve the above-mentioned problems and achieve the object, the present invention has a detection unit that performs hovering detection to detect that a rod-shaped object has approached a predetermined distance with respect to a touch panel, and the hovering detection by the detection unit. In the case of being, for the voice data collected from the voice input unit, an applying unit that applies a voice filter for reducing writing noise generated when writing is performed by the rod-shaped object on the touch panel, The detection unit further performs contact detection to detect that the rod-shaped object has contacted the touch panel, and the application unit further includes the rod-shaped member after the contact detection is performed by the detection unit. When it is detected that an object has left the touch panel, the application of the audio filter is canceled .

According to the present invention, writing noise can be accurately reduced by a simple process.

FIG. 1 is a diagram showing an example of the external appearance of the video conference apparatus according to the first embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration of the video conference device according to the first embodiment. FIG. 3 is a diagram illustrating an example of the configuration of the conference system according to the first embodiment. FIG. 4 is a diagram showing an example of a configuration of functional blocks of the video conference apparatus according to the first embodiment. FIG. 5 is a diagram showing an example of a graph of the level of writing noise when the voice filter is not applied. FIG. 6 is a diagram showing an example of a graph of the level of writing noise when the voice filter is applied. FIG. 7 is a diagram for explaining the hovering detection function. FIG. 8 is a flowchart showing an example of the flow of processing for applying an audio filter to writing noise of the video conference apparatus according to the first embodiment. FIG. 9 is a diagram showing an example of the configuration of functional blocks of the video conference apparatus according to the second embodiment. FIG. 10 is a flowchart showing an example of the flow of processing for applying an audio filter to writing noise of the video conference device according to the second embodiment. FIG. 11 is a diagram showing an example of a configuration of functional blocks of the video conference apparatus according to the third embodiment. FIG. 12 is a flowchart showing an example of the flow of processing for applying an audio filter to writing noise of the video conference device according to the third embodiment. FIG. 13 is a flowchart showing an example of the flow of processing for applying an audio filter to writing noise in the video conference device according to the fourth embodiment.

Embodiments of a video conference device, an information processing method, and a program according to the present invention will be described in detail below with reference to FIGS. The present invention is not limited to the following embodiments, and constituent elements in the following embodiments include those that can be easily conceived by those skilled in the art, substantially the same, and so-called equivalent ranges. Stuff is included. Further, various omissions, substitutions, changes and combinations of the constituent elements can be made without departing from the scope of the following embodiments.

[First Embodiment]
(Hardware configuration of video conferencing equipment)
FIG. 1 is a diagram showing an example of the external appearance of the video conference apparatus according to the first embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration of the video conference device according to the first embodiment. The hardware configuration of the video conference apparatus 10 according to the present embodiment will be described with reference to FIGS. 1 and 2.

As shown in FIG. 2, the video conferencing apparatus 10 according to the present embodiment includes a CPU (Central Processing Unit) 201, a memory 202, a storage device 203, a touch panel display 204, a camera 205, a microphone 206, and A speaker 207, an operation unit 208, and a network I/F (Interface) 209 are provided.

The CPU 201 is an integrated circuit that controls the overall operation of the video conference device 10. The CPU 201 encodes the video data captured by the camera 205, the audio data collected by the microphone 206, and the drawing data displayed on the touch panel display 204, which are to be transmitted to the video conference apparatus 10 of the partner site. In addition, the CPU 201 decodes the video data, the audio data, and the drawing data received from the video conference apparatus 10 of the partner site, and transmits them to the touch panel display 204 and the camera 205. That is, the CPU 201 has a codec function. In order to realize the codec function, for example, a known method such as H.264 is used. H.264/AVC, or H.264. A compression encoding technique such as H.264/SVC may be used.

The memory 202 is a storage device such as a volatile RAM (Random Access Memory) used as a work area of the CPU 201.

The storage device 203 is a non-volatile auxiliary storage device that stores various programs for implementing the operation of the video conference device 10, various data such as video data and audio data, and information of an audio filter described later. The storage device 203 is, for example, a flash memory, a HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like.

The touch panel display 204 has a function of displaying video data and the like on a display device, detects that a user's finger or a pen (for example, the pen 301 shown in FIG. 1) has approached the touch panel to a predetermined distance, and the detected coordinates are detected by the CPU 201. The display device with a hovering and contact detection function has a hovering detection function (details will be described later) transmitted to the touch panel, and a contact detection function that detects the touch on the touch panel and transmits the detected coordinates to the CPU 201. For example, the touch panel of the touch panel display 204 is a capacitive panel. As shown in FIG. 1, the touch panel display 204 has a function as an electronic blackboard capable of writing by, for example, tracing a surface of the panel with a pen 301 to display a locus indicating characters, symbols, figures, and the like. That is, the drawing data written on the touch panel display 204 can be shared with the video conference apparatus 10 at the partner site. In addition, the touch panel display 204 can display the video data captured by the camera 205 of the video conference apparatus 10 of the partner site in the other site display area 204a of the entire display area. The display device of the touch panel display 204 is, for example, an LCD (Liquid Crystal Display), an organic EL (Organic Electro-Luminescence) display, or the like.

The pen 301 for writing on the touch panel display 204 is not limited to the accessory of the video conference device 10 or the product specified by the manufacturer of the video conference device 10. Moreover, the number of pens used for writing is not limited to one type for one video conferencing apparatus 10, and it is also assumed that a plurality of types of pens are used for the same video conferencing apparatus 10. Further, the pen 301 is not limited to a particular material for the pen tip. For example, the material used for the pen tip may be felt-based, plastic-based, rubber-based, metal-based, resin-based, or the like.

Here, since the distance from the touch panel display 204 of the video conferencing apparatus 10 to the user is maintained to some extent, the writing noise directly heard by the user's ears is minute, and the writer and the participants around it are particularly offensive to the ears. I don't feel it. On the other hand, for the participant of the conference at the other site, the writing noise generated on the touch panel display 204 of the own site is picked up by the microphone 206 as voice, transmitted to the video conference device 10 at the other site, and output as voice from the speaker 207. Therefore, you may feel annoyance. From the above, when the user writes with the finger or the pen 301, it is important to accurately reduce the writing noise. The above-mentioned writing noise may indicate the voice itself generated by writing, or may indicate the voice data. In addition, a finger or pen 301 for writing on the touch panel display 204 may be collectively referred to as a “stylus” for convenience.

The camera 205 is an imaging device including a lens and a solid-state imaging device that converts light into electric charges and digitizes an image (video) of a subject. The video data of the participants of the conference captured by the camera 205 is displayed on the touch panel display 204 of the video conference apparatus 10 at the partner site by being transmitted to the video conference apparatus 10 at the partner site. The camera 205 is installed on the upper side of the touch panel display 204, for example, as shown in FIG. 1, and shoots a participant facing the video conference device 10. As the solid-state image sensor, a CMOS (Complementary Metal Oxide Semiconductor), a CCD (Charge Coupled Device), or the like is used. Note that the position where the camera 205 is installed is not limited to the upper side of the touch panel display 204, and may be installed at other positions.

The microphone 206 is a sound pickup device for inputting voices of participants participating in the conference. The microphone 206 is fixed to the upper side of the touch panel display 204, for example, as shown in FIG. 1, and inputs a voice uttered by a participant facing the video conference device 10. Note that the position where the microphone 206 is fixed is not limited to the upper side of the touch panel display 204, and may be fixed at another position.

The speaker 207 is a device that outputs audio under the control of the CPU 201. The speaker 207 is installed below the touch panel display 204, for example, as shown in FIG. 1, and outputs the voice data collected by the video conferencing apparatus 10 at the partner site received via the network as voice. To do. The position where the speaker 207 is installed is not limited to the lower side of the touch panel display 204, and may be installed at other positions.

The operation unit 208 is an input device such as buttons for performing various operations on the video conference device 10. The operation unit 208 is installed on the lateral side of the touch panel display 204, for example, as shown in FIG. It should be noted that the operation unit 208 is not limited to being configured by a button or the like as hardware as shown in FIG. 1, and for example, a software switch may be provided on the touch panel display 204 by a touch detection function of the touch panel display 204. It may be configured as.

The network I/F 209 is an interface for communicating data with an external device using a network such as the Internet (for example, the network 2 shown in FIG. 3 described later). The network I/F 209 is, for example, a NIC (Network Interface Card) or the like. As a standard supported by the network I/F 209, in the case of a wired LAN (Local Area Network), for example, an Ethernet (Ethernet) standard such as 10Base-T, 100Base-TX, or 1000BASE-T can be cited. In the case of a wireless LAN, for example, 802.11a/b/g/n can be cited.

The hardware configuration of the video conference device 10 is not limited to the configuration shown in FIG. For example, the video conferencing apparatus 10 is a non-volatile storage device such as a ROM (Read Only Memory) storing firmware for controlling the video conferencing apparatus 10 or a PC (Personal Computer) or an external storage device. May be provided with an I/F or the like for an external device for connecting to. Further, as shown in FIG. 2, the memory 202, the storage device 203, the touch panel display 204, the camera 205, the microphone 206, the speaker 207, the operation unit 208, and the network I/F 209 are connected to the CPU 201. The configuration is not limited, and for example, the above-described components may be connected to each other via a bus such as an address bus and a data bus so that they can communicate with each other.

Further, in FIG. 1, the video conference apparatus 10 has a configuration in which the camera 205, the microphone 206, and the speaker 207 are incorporated in the main body, but at least one of these may be configured separately. For example, in the case where the camera 205 is not a built-in one but a separate external device, it may be connected to the video conferencing apparatus 10 via the above-mentioned external device I/F.

(Conference system configuration)
FIG. 3 is a diagram illustrating an example of the configuration of the conference system according to the first embodiment. The configuration of the conference system 1 according to the present embodiment will be described with reference to FIG.

As shown in FIG. 3, the conference system 1 according to the present embodiment includes two or more video conference devices (video conference devices 10_1 to 10_4 in FIG. 3 ), a conference server 20, and a conference reservation server 30. Including. It should be noted that the two or more video conferencing devices (10_1, 10_2,...) Shown in FIG. 3 are simply referred to as “video conferencing device 10” when referring to or collectively referring to any video conferencing device. The video conference devices 10_1 to 10_4 can communicate with other video conference devices 10, the conference server 20, and the conference reservation server 30 via the network 2 such as the Internet.

The video conferencing apparatus 10 establishes a session with another video conferencing apparatus 10 under the control of the conference server 20, and interactively transmits/receives video data, audio data, and drawing data via the established session. -It is a whiteboard type conference device. At the time of a video conference (hereinafter sometimes simply referred to as “conference”), the video conference device 10 transmits video data, audio data, and drawing data to the conference server 20 at the time of transmission, and the conference server 20 makes the other party. Video data, audio data, and drawing data are transmitted to the video conference apparatus 10 at the base. Further, the video conferencing apparatus 10 receives the video data, the audio data, and the drawing data of the video conferencing apparatus 10 at the partner site from the conference server 20 at the time of reception.

For example, when a video conference is held by the video conference devices 10_1 to 10_3 in the conference system 1 illustrated in FIG. 3, the data transmitted by the video conference device 10_1 is transmitted to the video conference devices 10_2 and 10_3 via the conference server 20. , Are not transmitted to the video conferencing device 10_4. Similarly, the data transmitted by each of the video conferencing devices 10_2 and 10_3 is transmitted via the conference server 20 to the video conferencing device 10 participating in the video conference, and the video conferencing device 10(( not participating in the video conference). It is not transmitted to the video conference device 10_4). Thereby, in the conference system 1, a video conference between the plurality of video conference devices 10 is realized.

The conference server 20 is a server device that monitors whether or not each video conference device 10 is connected to the conference server 20, controls calling of each video conference device 10 at the start of a conference, and controls information processing during the conference. ..

The conference reservation server 30 registers (reserves) conference information (the date and time of the conference, the place of the conference, the participating users, the role, the information processing device to be used, etc.) in advance by the user who hosts the conference. It is a server device to be installed. When the video conference device 10 makes an inquiry to the conference reservation server 30 and finds the conference information of the corresponding conference, it joins the video conference based on the conference information. The conference reservation server 30 may be configured such that, for example, a management PC or the like is connected via the network 2 and settings such as registration of the conference information described above can be made.

Note that the configuration of the conference system 1 illustrated in FIG. 3 is an example, and the conference server 20 and the conference reservation server 30 are separate server devices, for example, but the configuration is not limited to this, and a single server device is used. It may be done.

(Functional block configuration of video conferencing device)
FIG. 4 is a diagram showing an example of a configuration of functional blocks of the video conference apparatus according to the first embodiment. FIG. 5 is a diagram showing an example of a graph of the level of writing noise when the voice filter is not applied. FIG. 6 is a diagram showing an example of a graph of the level of writing noise when the voice filter is applied. FIG. 7 is a diagram for explaining the hovering detection function. Details of the configuration and operation of the functional blocks of the video conference apparatus 10 according to the present embodiment will be described with reference to FIGS.

As shown in FIG. 4, the video conferencing apparatus 10 according to the present embodiment has an acquisition unit 101, a control unit 102, an application unit 103, a transmission unit 107, a reception unit 108, a communication unit 109, and an imaging unit. The control unit 110, the image pickup unit 111, the display control unit 112, the display unit 113, the panel detection unit 114, the sound output control unit 115, the sound output unit 116, the sound input unit 117, and the storage unit 118. , And an operation input unit 119.

The acquisition unit 101 is a functional unit that acquires conference information from the conference reservation server 30 via the communication unit 109 and the network 2. Specifically, the acquisition unit 101 acquires, for example, an acquisition request for acquiring the conference information, the date and time of the conference, the location of the conference, and the information of the used terminal via the communication unit 109 and the network 2 from the conference reservation server. Send to 30. Then, when the conference reservation server 30 receives the acquisition request, the conference reservation server 30 transmits the received conference information corresponding to the date and time of the conference, the venue, and the used terminal to the acquisition unit 101 via the network 2 and the communication unit 109. The acquisition unit 101 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The control unit 102 is a functional unit that comprehensively controls the processing for the video conference performed by the video conference device 10. The control unit 102 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The application unit 103 applies or cancels a voice filter corresponding to writing noise of a stylus (finger or pen 301, etc.) (rod) to the voice data input (picked up) to the voice input unit 117. Is. The voice filter is a digital filter that attenuates a specific frequency component or the like of writing noise. As shown in FIG. 5, writing noise occurs when the pen 301 contacts the touch panel display 204 (time t1 shown in FIG. 5). As shown in FIG. 5, this writing noise is different from other voices in that the sound volume suddenly increases in a short time when the pen 301 contacts the touch panel display 204 (“writing noise level” shown in FIG. 5). Is characterized by fluctuating. The application unit 103 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

Writing noise when a stylus (pen 301 or finger) (hereinafter, described as a medium for writing is the pen 301) contacts the touch panel display 204 will be described with reference to FIG. First, at the time when the pen 301 is not in contact with the touch panel display 204 (time t0), no writing noise is generated. At the time when the pen 301 comes into contact with the touch panel display 204 (time t1), writing noise occurs and the level of the writing noise sharply rises.

During the period of writing with the pen 301 (time t1 to t2), the level of the writing noise is smaller than that when the pen 301 is in contact, but vibration noise or the like occurs due to the writing. Then, during the period after the writing ends and the pen 301 moves away from the touch panel display 204 (for example, time t2 to t3), the writing noise does not occur.

FIG. 6 shows a graph of the writing noise when the voice filter including the writing noise input by the voice input unit 117 is applied by the applying unit 103 to the writing noise illustrated in FIG. Times t0 to t3 in FIG. 6 correspond to times t0 to t3 in FIG. 5, respectively. As shown in FIG. 6, the level of the writing noise to which the filter is applied can be appropriately reduced as compared with the writing noise to which the filter shown in FIG. 5 is not applied.

The transmission unit 107 transmits the video data captured by the image capturing unit 111, the audio data input by the audio input unit 117, and the drawing data displayed on the display unit 113 via the communication unit 109 and the network 2 to the partner site. Is a functional unit for transmitting to the video conferencing device 10. Specifically, the transmission unit 107 encodes video data, audio data, and drawing data, for example, and transmits the video data, the audio data, and the drawing data to the video conference apparatus 10 at the partner site. Here, as the encoding method, as described above, for example, a known method such as H.264 is used. H.264/AVC, or H.264. A compression encoding technique such as H.264/SVC may be used. The transmission unit 107 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The receiving unit 108 is a functional unit that receives, via the network 2 and the communication unit 109, the video data, the audio data, and the drawing data received from the video conference apparatus 10 at the partner site. Specifically, for example, the receiving unit 108 decodes the received video data, audio data, and drawing data, sends the decoded video data and drawing data to the display control unit 112, and decodes the decoded audio data as an audio output control unit. Send to 115. Here, as a decoding method, a known method may be used. The receiving unit 108 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The communication unit 109 is a functional unit that performs data communication with other video conference devices 10, the conference server 20, and the conference reservation server 30 via the network 2. The communication unit 109 is realized by, for example, the network I/F 209 shown in FIG.

The imaging control unit 110 is a functional unit that controls the operation of the imaging unit 111. Specifically, the image capturing control unit 110 controls, for example, the operation of starting and stopping the image capturing by the image capturing unit 111, and acquires the video data captured by the image capturing unit 111. The imaging control unit 110 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The image capturing unit 111 is a functional unit that captures an image in a direction facing the video conference device 10. The imaging unit 111 is realized by, for example, the camera 205 shown in FIG. It should be noted that the imaging direction of the imaging unit 111 is set to face the video conferencing apparatus 10, but the present invention is not limited to this. The imaging direction of the imaging unit 111 may be variable in any direction. Good.

The display control unit 112 is a functional unit that controls the display unit 113 to display various images and videos. The display control unit 112 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The display unit 113 is a functional unit that displays various images and videos under the control of the display control unit 112. The display unit 113 is realized by, for example, a display device in the touch panel display 204 shown in FIG.

The panel detection unit 114 is a functional unit that receives a writing input by a stylus such as a finger or a pen of a user (for example, a conference participant). The panel detection unit 114 has a hovering detection function of detecting that the stylus has approached the touch panel of the touch panel display 204 within a predetermined distance (distance d1 shown in FIG. 7 described later) (hovering detection). Furthermore, the panel detection unit 114 has a contact detection function of detecting that the stylus has touched the touch panel of the touch panel display 204 (contact detection). The panel detection unit 114 is realized by, for example, a hovering detection function and a contact detection function in the touch panel display 204 shown in FIG. The panel detection unit 114 detects a change in the capacitance of the touch panel of the touch panel display 204 and performs hovering detection and contact detection, and is specifically realized by the CPU 201 shown in FIG. 2 executing a program. To be done.

Here, the hovering detection function and the contact detection function of the panel detection unit 114 will be described with reference to FIG. 7. FIG. 7 shows the relationship between the distance of the touch panel and the time when the user brings the stylus (finger or pen) close to the touch panel, touches the stylus, and then releases the stylus. When the stylus is moved closer, at time t10, the distance from the touch panel (touch panel display 204) reaches the distance d1 at which the panel detection unit 114 can detect the hovering detection function. Then, the panel detection unit 114 detects that the stylus is approaching a predetermined distance (distance d1) by the hovering detection function from time t10 to time t11. Further, when the stylus is brought closer, the touch panel is touched at time t11. During the time t11 to t12 when the stylus is in contact with the touch panel, the panel detection unit 114 detects that the stylus is in contact with the touch panel by the contact detection function. At this time, the distance between the touch panel and the stylus does not change during the period when the stylus is in contact with the touch panel (time t11 to t12). Then, during the period until the stylus moves away from the touch panel to the distance d1 (time t12 to t13), the panel detection unit 114 has the stylus within the predetermined distance (distance d1) by the hover detection function. Is being detected. Further, after the time t13, when the stylus is separated from the touch panel by the distance d1, the panel detection unit 114 will not detect that the stylus is approaching or touching.

The voice output control unit 115 is a functional unit that controls the voice output unit 116 to output various voices. The audio output control unit 115 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The voice output unit 116 is a functional unit that outputs various voices under the control of the voice output control unit 115. The audio output unit 116 is realized by, for example, the speaker 207 shown in FIG.

The voice input unit 117 is a functional unit that inputs voice. The voice input unit 117 is realized by, for example, the microphone 206 shown in FIG.

The storage unit 118 is a functional unit that stores various programs for implementing the operation of the video conferencing apparatus 10, video data, audio data, drawing data, and various data such as audio filter information. The storage unit 118 is realized by, for example, the storage device 203 illustrated in FIG.

The operation input unit 119 is a functional unit that receives various operation inputs of a user (for example, a conference participant). The operation input unit 119 is realized by, for example, the operation unit 208 illustrated in FIG.

Note that the acquisition unit 101, the control unit 102, the application unit 103, the transmission unit 107, the reception unit 108, the communication unit 109, the imaging control unit 110, the imaging unit 111, the display control unit 112, and the display of the video conference apparatus 10 illustrated in FIG. The unit 113, the panel detection unit 114, the voice output control unit 115, the voice output unit 116, the voice input unit 117, the storage unit 118, and the operation input unit 119 conceptually show the functions and have such a configuration. It is not limited to. For example, a plurality of functional units illustrated as independent functional units in the video conference apparatus 10 shown in FIG. 4 may be configured as one functional unit. On the other hand, in the video conferencing device 10 shown in FIG. 4, the function of one functional unit may be divided into a plurality of units to be configured as a plurality of functional units.

Further, a part of the acquisition unit 101, the control unit 102, the application unit 103, the transmission unit 107, the reception unit 108, the imaging control unit 110, the display control unit 112, the panel detection unit 114, and the audio output control unit 115 of the video conference apparatus 10. Alternatively, all of them may be realized by a hardware circuit such as an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit) instead of a program that is software.

(Processing for writing noise of video conferencing equipment)
FIG. 8 is a flowchart showing an example of the flow of processing for applying an audio filter to writing noise of the video conference apparatus according to the first embodiment. The flow of processing of applying the audio filter to the writing noise of the video conference apparatus 10 according to the present embodiment will be described with reference to FIG. 8.

<Step S11>
The control unit 102 starts a video conference with the video conference device at the partner site indicated by the conference information, based on the conference information acquired from the conference reservation server 30 by the acquisition unit 101. Then, the process proceeds to step S12.

<Step S12>
The panel detection unit 114 detects whether or not the stylus (finger, pen, or the like) has approached the touch panel within a predetermined distance by the hovering detection function (hovering detection). If the hovering is detected (step S12: Yes), the process proceeds to step S13. If the hovering is not detected (step S12: No), the detection operation is continued.

<Step S13>
The application unit 103 applies an audio filter corresponding to writing noise of the stylus to the audio data input (picked up) by the audio input unit 117. Then, the process proceeds to step S14.

<Step S14>
The panel detection unit 114 detects whether or not the stylus contacts the touch panel (contact detection) by the contact detection function. When the contact is detected (step S14: Yes), the process proceeds to step S15, and when the contact is not detected (step S14: No), the process proceeds to step S17.

<Step S15>
The panel detection unit 114 detects whether or not the stylus is separated from the touch panel by the contact detection function. When it is detected that the touch panel is separated (step S15: Yes), the process proceeds to step S16. When it is detected that the touch panel is still in contact (step S15: No), the panel detection unit 114 continues to detect whether or not the touch panel is separated.

<Step S16>
Since the writing noise does not occur due to the stylus moving away from the touch panel, the application unit 103 cancels the application of the voice filter corresponding to the writing noise. Then, the process proceeds to step S19.

<Step S17>
The control unit 102 determines whether or not a predetermined time has elapsed since the application unit 103 applied the voice filter. When the predetermined time has elapsed (step S17: Yes), the process proceeds to step S18, and when the predetermined time has not elapsed (step S17: No), the process returns to step S14.

<Step S18>
The application unit 103 determines that the stylus has moved away from the touch panel and cancels the application of the voice filter corresponding to the writing noise when contact detection is not performed even after a lapse of a predetermined time after the stylus hovering detection. Then, the process proceeds to step S19.

<Step S19>
The control unit 102 determines whether or not the video conference ends after the application of the audio filter is canceled by the application unit 103. If the video conference has ended (step S19: Yes), a series of processes for applying the voice filter to the writing noise ends, and if the video conference has not ended (step S19: No), the process returns to step S12.

Through the above steps S11 to S19, the process of applying the audio filter to the writing noise of the video conference apparatus 10 according to the present embodiment is performed.

As described above, in this embodiment, when the panel detection unit 114 detects that the stylus has approached the touch panel within a predetermined distance (hovering detection), the application unit 103 inputs the voice to the voice input unit 117 (collection). It is assumed that a voice filter corresponding to writing noise of the stylus is applied to the (voiced) voice data. By applying the voice filter corresponding to the writing noise by such a method, the writing noise can be accurately reduced by a simple process.

Further, when it is detected that the stylus is separated after the stylus is contact-detected, the application unit 103 cancels the application of the voice filter corresponding to the writing noise. Further, when the contact detection is not performed for a predetermined time after the hovering detection of the stylus, the application unit 103 cancels the application of the voice filter corresponding to the writing noise. As a result, it is possible to suppress the influence of applying the audio filter to the audio data that does not include writing noise.

[Second Embodiment]
The video conference apparatus according to the second embodiment will be described focusing on the points different from the video conference apparatus 10 according to the first embodiment. In the first embodiment, the operation of applying the voice filter corresponding to the writing noise when the hovering detection is performed regardless of whether the stylus is a finger or a pen has been described. In the present embodiment, an operation of applying a voice filter according to the type of stylus when hovering is detected will be described.

The configuration of the conference system according to the present embodiment and the hardware configuration of the video conference device are the same as the configurations described in the first embodiment.

(Functional block configuration of video conferencing device)
FIG. 9 is a diagram showing an example of the configuration of functional blocks of the video conference apparatus according to the second embodiment. The configuration and operation of the functional blocks of the video conference apparatus 10a according to the present embodiment will be described in detail with reference to FIG.

As shown in FIG. 9, the video conferencing apparatus 10a according to the present embodiment includes an acquisition unit 101, a control unit 102, an application unit 103a, a determination unit 104, a transmission unit 107, a reception unit 108, and communication. The unit 109, the image pickup control unit 110, the image pickup unit 111, the display control unit 112, the display unit 113, the panel detection unit 114, the sound output control unit 115, the sound output unit 116, and the sound input unit 117. The storage unit 118 and the operation input unit 119 are included. Note that the acquisition unit 101, the control unit 102, the transmission unit 107, the reception unit 108, the communication unit 109, the imaging control unit 110, the imaging unit 111, the display control unit 112, the display unit 113, the panel detection unit 114, and the audio output control unit 115. The functions of the voice output unit 116, the voice input unit 117, and the operation input unit 119 are similar to the functions described in the first embodiment.

The application unit 103a applies to the voice data input (picked up) by the voice input unit 117, a voice filter corresponding to writing noise of a finger as a stylus, or a voice filter corresponding to writing noise of a pen as a stylus. Is a functional unit that applies or cancels. Generally, a pen has a smaller contact area than a finger and is often a hard material. Therefore, the characteristics of the writing noise (frequency component, level magnitude, etc.) differ between the pen and the finger. Therefore, the application unit 103a applies the audio filter corresponding to each of the stylus depending on whether the stylus is a finger or a pen. As a result, the writing noise can be reduced more accurately. The application unit 103a is realized by, for example, the CPU 201 illustrated in FIG. 2 executing a program.

The determination unit 104 is a functional unit that determines whether the stylus approaching the touch panel is a finger or a pen when the hovering detection is performed by the panel detection unit 114. The determination unit 104 determines whether the stylus is a finger or a pen, for example, based on the difference in the detection area when the hovering detection is performed by the panel detection unit 114. For example, the determination unit 104 determines that the stylus is a finger when the detected area is equal to or larger than a predetermined threshold value, and determines that the stylus is a pen when the detected area is less than the predetermined threshold value. The determination unit 104 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The storage unit 118 includes various programs for implementing the operation of the video conference apparatus 10a, video data, audio data, and drawing data, an audio filter corresponding to finger writing noise, and an audio filter corresponding to pen writing noise. It is a functional unit that stores various data such as information. The storage unit 118 is realized by, for example, the storage device 203 illustrated in FIG.

In addition, the acquisition unit 101, the control unit 102, the application unit 103a, the determination unit 104, the transmission unit 107, the reception unit 108, the communication unit 109, the imaging control unit 110, the imaging unit 111, and the display control of the video conference apparatus 10a illustrated in FIG. The unit 112, the display unit 113, the panel detection unit 114, the voice output control unit 115, the voice output unit 116, the voice input unit 117, the storage unit 118, and the operation input unit 119 conceptually show functions. The configuration is not limited to this. For example, a plurality of functional units illustrated as independent functional units in the video conference device 10a illustrated in FIG. 9 may be configured as one functional unit. On the other hand, in the video conferencing apparatus 10a shown in FIG. 9, the function of one functional unit may be divided into a plurality of units and configured as a plurality of functional units.

Further, the acquisition unit 101, the control unit 102, the application unit 103a, the determination unit 104, the transmission unit 107, the reception unit 108, the imaging control unit 110, the display control unit 112, the panel detection unit 114, and the audio output control unit of the video conference apparatus 10a. Part or all of 115 may be realized by a hardware circuit such as FPGA or ASIC instead of a program that is software.

(Processing for writing noise of video conferencing equipment)
FIG. 10 is a flowchart showing an example of the flow of processing for applying an audio filter to writing noise in the video conference device according to the second embodiment. With reference to FIG. 10, a flow of processing of applying the audio filter to the writing noise of the video conference apparatus 10a according to the present embodiment will be described.

<Step S31>
The control unit 102 starts a video conference with the video conference device at the partner site indicated by the conference information, based on the conference information acquired from the conference reservation server 30 by the acquisition unit 101. Then, the process proceeds to step S32.

<Step S32>
The panel detection unit 114 detects whether or not the stylus (finger, pen, or the like) has approached the touch panel within a predetermined distance by the hovering detection function (hovering detection). If the hovering is detected (step S32: Yes), the process proceeds to step S33. If the hovering is not detected (step S32: No), the detection operation is continued.

<Step S33>
When the hovering detection is performed by the panel detection unit 114, the determination unit 104 determines whether the stylus approaching the touch panel is a finger or a pen. When it is determined that the stylus is a finger (step S33: Yes), the process proceeds to step S34, and when it is determined that the stylus is a pen (step S33: No), the process proceeds to step S35.

<Step S34>
When the determination unit 104 determines that the stylus is a finger, the application unit 103a applies a voice filter corresponding to the writing noise of the finger to the voice data input (picked up) to the voice input unit 117. .. Then, the process proceeds to step S36.

<Step S35>
When the determination unit 104 determines that the stylus is a pen, the application unit 103a applies an audio filter corresponding to writing noise of the pen to the audio data input (picked up) to the audio input unit 117. .. Then, the process proceeds to step S36.

<Steps S36 to S41>
The operations of steps S36 to S41 are the same as the operations of steps S14 to S19 shown in FIG. 8 of the first embodiment, respectively.

Through the above steps S31 to S41, the process of applying the audio filter to the writing noise of the video conference apparatus 10a according to the present embodiment is performed.

As described above, in the present embodiment, when the hovering detection of the finger as the stylus is performed by the panel detection unit 114, with respect to the voice data input (picked up) to the voice input unit 117 by the application unit 103a. , A voice filter corresponding to finger writing noise is applied. When the hovering detection of the pen as the stylus is performed by the panel detection unit 114, a voice corresponding to the writing noise of the pen is added to the voice data input (picked up) to the voice input unit 117 by the application unit 103a. Filters are supposed to be applied. As described above, by applying the voice filter according to the type of the stylus, the writing noise can be further accurately reduced by the simple process.

A human finger and a pen are given as examples of the stylus, but the stylus is not limited to this, and a plurality of types of styluses having different writing noises may be detected during hovering detection.

[Third Embodiment]
The video conference apparatus according to the third embodiment will be described focusing on the points different from the video conference apparatus 10 according to the first embodiment. In the first embodiment, when the hovering detection of the stylus is detected, the operation of applying the voice filter corresponding to the writing noise is described, and the strength of the voice filter is not particularly described. In the present embodiment, an operation of applying a voice filter with an intensity according to the distance between the detection position on the touch panel and the microphone when hovering detection is performed will be described.

The configuration of the conference system according to the present embodiment and the hardware configuration of the video conference device are the same as the configurations described in the first embodiment.

(Functional block configuration of video conferencing device)
FIG. 11 is a diagram showing an example of a configuration of functional blocks of the video conference apparatus according to the third embodiment. The configuration and operation of the functional blocks of the video conference apparatus 10b according to this embodiment will be described in detail with reference to FIG.

As shown in FIG. 11, the video conferencing apparatus 10b according to the present embodiment includes an acquisition unit 101, a control unit 102, an application unit 103b, a calculation unit 105, a transmission unit 107, a reception unit 108, and communication. The unit 109, the image pickup control unit 110, the image pickup unit 111, the display control unit 112, the display unit 113, the panel detection unit 114, the sound output control unit 115, the sound output unit 116, and the sound input unit 117. The storage unit 118 and the operation input unit 119 are included. Note that the acquisition unit 101, the control unit 102, the transmission unit 107, the reception unit 108, the communication unit 109, the imaging control unit 110, the imaging unit 111, the display control unit 112, the display unit 113, the panel detection unit 114, and the audio output control unit 115. The functions of the voice output unit 116, the voice input unit 117, and the operation input unit 119 are similar to the functions described in the first embodiment.

The application unit 103b inputs (picks up) the voice input unit 117 with an intensity calculated according to the distance between the detection position of hover detection on the touch panel and the microphone 206 (voice input unit 117) calculated by the calculation unit 105. It is a functional unit that applies or cancels a voice filter corresponding to stylus writing noise to the voice data. In general, the stylus writing noise increases in sound pressure level input to the microphone 206 as the contact detection position is closer to the microphone 206, and the writing noise transmitted to the partner site increases. On the other hand, when contact detection is performed at a position far from the microphone 206, the sound pressure level decreases according to the distance, and thus the writing noise transmitted to the partner site decreases. Therefore, by changing the strength of the voice filter according to the distance, the writing noise can be reduced more accurately, and the influence on the sound other than the writing noise included in the voice data can be suppressed. .. Further, for example, the application unit 103b refers to a table, which is stored in the storage unit 118 and in which the distance between the above-described detection position and the microphone 206 is associated with the strength of the audio filter, as described later, and the audio filter is referred to. Should be determined. The application unit 103b is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The calculation unit 105 is a functional unit that calculates the physical distance between the detection position of the stylus and the microphone 206 (speech input unit 117) from the detection coordinates of the stylus on the touch panel on which hovering detection has been performed by the panel detection unit 114. .. The calculation unit 105 is realized, for example, by the CPU 201 shown in FIG. 2 executing a program.

The storage unit 118 stores various programs that realize the operation of the video conference apparatus 10b, video data, audio data, drawing data, information about an audio filter, the distance between the detection position of the stylus and the microphone 206, and the strength of the audio filter. It is a functional unit that stores various data such as a table in which the and are associated with each other. The storage unit 118 is realized by, for example, the storage device 203 illustrated in FIG.

In addition, the acquisition unit 101, the control unit 102, the application unit 103b, the calculation unit 105, the transmission unit 107, the reception unit 108, the communication unit 109, the imaging control unit 110, the imaging unit 111, and the display control of the video conference apparatus 10b illustrated in FIG. The unit 112, the display unit 113, the panel detection unit 114, the voice output control unit 115, the voice output unit 116, the voice input unit 117, the storage unit 118, and the operation input unit 119 conceptually show functions. The configuration is not limited to this. For example, a plurality of functional units illustrated as independent functional units in the video conference device 10b illustrated in FIG. 11 may be configured as one functional unit. On the other hand, in the video conferencing device 10b shown in FIG. 11, the function of one functional unit may be divided into a plurality of units to be configured as a plurality of functional units.

Further, the acquisition unit 101, the control unit 102, the application unit 103b, the calculation unit 105, the transmission unit 107, the reception unit 108, the imaging control unit 110, the display control unit 112, the panel detection unit 114, and the audio output control unit of the video conference apparatus 10b. Part or all of 115 may be realized by a hardware circuit such as FPGA or ASIC instead of a program that is software.

(Processing for writing noise of video conferencing equipment)
FIG. 12 is a flowchart showing an example of the flow of processing for applying an audio filter to writing noise of the video conference device according to the third embodiment. With reference to FIG. 12, a flow of a process of applying the audio filter to the writing noise of the video conference device 10b according to the present embodiment will be described.

<Step S51>
The control unit 102 starts a video conference with the video conference device at the partner site indicated by the conference information, based on the conference information acquired from the conference reservation server 30 by the acquisition unit 101. Then, the process proceeds to step S52.

<Step S52>
The panel detection unit 114 detects whether or not the stylus (finger, pen, or the like) has approached the touch panel within a predetermined distance by the hovering detection function (hovering detection). When the hovering is detected (step S52: Yes), the process proceeds to step S53, and when the hovering is not detected (step S52: No), the detection operation is continued.

<Step S53>
The calculation unit 105 calculates the physical distance between the detection position of the stylus and the microphone 206 (sound input unit 117) from the detection coordinates of the stylus on the touch panel that is hovering detected by the panel detection unit 114. Then, the process proceeds to step S54.

<Step S54>
The application unit 103b inputs (picks up) sound into the voice input unit 117 with an intensity calculated according to the distance between the detection position of hover detection on the touch panel and the microphone 206 (voice input unit 117) calculated by the calculation unit 105. A voice filter corresponding to stylus writing noise is applied to the voice data. In this case, the application unit 103b determines the strength of the voice filter by referring to a table stored in the storage unit 118 that associates the distance between the detection position and the microphone 206 with the strength of the voice filter, for example. Then, the process proceeds to step S55.

<Steps S55 to S60>
The operations of steps S55 to S60 are the same as the operations of steps S14 to S19 shown in FIG. 8 of the first embodiment, respectively.

By the above steps S51 to S60, the process of applying the audio filter to the writing noise of the video conference apparatus 10b according to the present embodiment is performed.

As described above, in the present embodiment, when hovering detection of the stylus is performed by panel detection unit 114, calculation unit 105 determines the stylus detection position and microphone 206 (voice input unit) from the detection coordinates of the stylus on the touch panel. The physical distance to 117) is calculated. Then, the application unit 103b applies the voice filter corresponding to the writing noise of the stylus to the voice data input (picked up) to the voice input unit 117 with the intensity according to the distance calculated by the calculation unit 105. It is supposed to do. In this way, by changing the strength of the voice filter in accordance with the distance between the detection position and the microphone 206, the writing noise can be reduced more accurately, and the sound other than the writing noise included in the voice data can be reduced. It is possible to suppress the influence of all.

It should be noted that the operation of applying the voice filter with the strength according to the distance between the detection position and the microphone 206 as in the present embodiment can also be applied to, for example, the second embodiment.

[Fourth Embodiment]
The video conference apparatus according to the fourth embodiment will be described focusing on the points different from the video conference apparatus 10b according to the third embodiment. In the third embodiment, the operation of applying the voice filter with the strength according to the distance between the detection position on the touch panel and the microphone when the hovering detection is performed has been described. In the present embodiment, an operation of reducing the strength of the audio filter by a predetermined method will be described.

The configuration of the conference system according to the present embodiment and the hardware configuration of the video conference device are the same as the configurations described in the first embodiment. Moreover, the configuration of the functional blocks of the video conference apparatus according to this embodiment is the same as the configuration described in the third embodiment.

(Processing for writing noise of video conferencing equipment)
FIG. 13 is a flowchart showing an example of the flow of processing for applying an audio filter to writing noise in the video conference device according to the fourth embodiment. With reference to FIG. 13, a flow of processing of applying the audio filter to the writing noise of the video conference apparatus according to the present embodiment will be described.

<Steps S71 to S77>
The operations of steps S71 to S77 are the same as the operations of steps S51 to S57 shown in FIG. 12 of the third embodiment, respectively. However, among these, in step S75, the panel detection unit 114 detects whether or not the stylus touches the touch panel by the contact detection function (contact detection), and when the contact detection is performed (step S75: Yes), If the contact is not detected in step S76 (step S75: No), the process proceeds to step S78. After the process of step S77, the process proceeds to step S82.

<Step S78>
The control unit 102 determines whether or not a predetermined time has passed since the application unit 103b applied the voice filter with a specific strength. When the predetermined time has elapsed (step S78: Yes), the process proceeds to step S79, and when it has not elapsed (step S78: No), the process returns to step S75.

<Step S79>
The application unit 103b reduces the strength of the current audio filter by one level (decreases the strength by a predetermined amount) and applies it. That is, the strength is lowered as the time from the hovering detection to the touch detection is longer, that is, the slower the speed at which the stylus approaches the touch panel (hereinafter, may be referred to as “contact speed”). Audio filters will be applied. This is because, generally, when the contact speed is high, the stylus has a large impact on the touch panel and the writing noise is large, and when the contact speed is slow, the impact is small and the writing noise is small. As in this step, as the time from the hovering detection to the contact detection is longer, the voice filter with lower strength is applied, so that the writing noise can be more accurately reduced according to the contact speed. be able to. Further, the control unit 102 resets the elapsed time measured in step S78. Then, the process proceeds to step S80.

As described above, the strength of the audio filter is lowered by one step (the strength is lowered by a predetermined amount) every time a predetermined time elapses between the time when the hovering is detected and the time when the contact is detected. However, the operation is not limited to this. For example, the strength of the audio filter may be continuously reduced in accordance with the time elapsed from the hovering detection to the contact detection.

<Step S80>
In step S74, the control unit 102 determines whether or not the application unit 103b has timed out after a predetermined time has elapsed since the voice filter was applied with the strength according to the distance calculated by the calculation unit 105. .. If it has timed out (step S80: Yes), the process proceeds to step S81. If it has not timed out (step S80: No), the process returns to step S75.

<Step S81>
The application unit 103b determines that the stylus is away from the touch panel when contact detection is not performed even after a lapse of a predetermined time after applying the voice filter, and the stylus is away from the touch panel, and the voice filter corresponding to the writing noise is applied. To cancel. Further, the control unit 102 resets the elapsed time measured in step S80. Then, the process proceeds to step S82.

<Step S82>
The control unit 102 determines whether or not the video conference ends after the application of the audio filter is canceled by the application unit 103b. If the video conference has ended (step S82: Yes), a series of processes for applying the voice filter to the writing noise ends, and if the video conference has not ended (step S82: No), the process returns to step S72.

Through the above steps S71 to S82, the process of applying the audio filter to the writing noise of the video conference apparatus according to the present embodiment is performed.

As described above, in the present embodiment, when hovering detection of the stylus is performed by panel detection unit 114, calculation unit 105 determines the stylus detection position and microphone 206 (voice input unit) from the detection coordinates of the stylus on the touch panel. The physical distance to 117) is calculated. Then, the application unit 103b applies the voice filter corresponding to the writing noise of the stylus to the voice data input (picked up) to the voice input unit 117 with the intensity according to the distance calculated by the calculation unit 105. It is supposed to do. Furthermore, the longer the time from the hovering detection to the contact detection, that is, the slower the contact speed, the lower the strength of the audio filter is applied. As a result, the writing noise can be further accurately reduced according to the contact speed.

Note that, as in the present embodiment, an operation of applying a voice filter with an intensity corresponding to the distance between the detection position and the microphone 206, and applying a voice filter with a lower intensity as the contact speed is slower, for example, It is also possible to apply to the second embodiment.

Further, in each of the above-described embodiments, when at least one of the functional units of the video conference apparatus is realized by executing the program, the program is provided by being pre-installed in the ROM or the like. The program executed by the video conferencing apparatus according to each of the above-described embodiments is a file in an installable format or an executable format, which is a CD-ROM (Compact Disc Read Only Memory), a flexible disk (FD), a CD. -R (Compact Disk-Recordable) or DVD (Digital Versatile Disc) may be configured to be stored and provided in a computer-readable storage medium. Further, the program executed by the video conferencing apparatus according to each of the above-described embodiments may be stored in a computer connected to a network such as the Internet and may be provided by being downloaded via the network. Further, the program executed by the video conferencing apparatus according to each of the above-described embodiments may be provided or distributed via a network such as the Internet. Further, the program executed by the video conferencing device of each of the above-described embodiments has a module configuration including at least one of the above-described functional units, and as actual hardware, the CPU 201 is the above-mentioned storage device. By reading and executing the program from (for example, the storage device 203), the above-described functional units are loaded onto the main storage device (for example, the memory 202) and generated.

1 Conference System 2 Network 10, 10a, 10b, 10_1 to 10_4 Video Conference Device 20 Conference Server 30 Conference Reservation Server 101 Acquisition Unit 102 Control Unit 103, 103a, 103b Application Unit 104 Judgment Unit 105 Calculation Unit 107 Transmission Unit 108 Reception Unit 109 Communication unit 110 Imaging control unit 111 Imaging unit 112 Display control unit 113 Display unit 114 Panel detection unit 115 Audio output control unit 116 Audio output unit 117 Audio input unit 118 Storage unit 119 Operation input unit 201 CPU
202 memory 203 storage device 204 touch panel display 204a other base display area 205 camera 206 microphone 207 speaker 208 operation unit 209 network I/F
301 pen

JP 2012-027186 A

Claims (14)

A detection unit that performs hovering detection to detect that a rod-shaped object has approached a predetermined distance to the touch panel,
When the hovering detection is performed by the detection unit, a voice for reducing writing noise generated when the rod-shaped object is written on the touch panel with respect to the voice data collected from the voice input unit. An application section to apply the filter,
Equipped with
The detection unit further performs contact detection to detect that the rod-shaped object has touched the touch panel,
The said application part is a video conferencing apparatus which cancels|applies the said audio|voice filter, when the said contact detection is not carried out within the predetermined time after the said detection part detects the said hovering . Prior SL application unit, after the contact detection is by the detection unit, further wherein if the stick-shaped material is detected that the away from the touch panel, video according to claim 1 for releasing the application of the audio filter Conference equipment. A detection unit that performs hovering detection to detect that a rod-shaped object has approached a predetermined distance to the touch panel,
When the hovering detection is performed by the detection unit, a voice for reducing writing noise generated when the rod-shaped object is written on the touch panel with respect to the voice data collected from the voice input unit. An application section to apply the filter,
When the hovering detection is performed by the detection unit, a determination unit that determines the type of the rod-shaped object ,
Bei to give a,
It said applying unit, the determination applied to the ruby Deo conference device the audio filter corresponding to the type of the stick-shaped material which is determined by the unit. The video conferencing device according to claim 3 , wherein when the hovering detection is performed by the detection unit, the determination unit determines the type of the rod-shaped object based on a difference in a detection area of the hovering detection. The determination section, as the stick-shaped material, video conferencing device according to claim 3 or 4 determines whether the pen or a human finger. When the hovering detection is performed by the detection unit, a detection unit that further calculates a distance between the detection position of the rod-shaped object on the touch panel on which the hovering detection is performed and the voice input unit,
It said applying unit, on the audio data, video conferencing apparatus according to any one of claims 1 to 5, applying said audio filter at an intensity corresponding to the distance calculated by the calculation unit. The video conference apparatus according to claim 6 , wherein the applying unit applies the audio filter by reducing the strength according to an elapsed time after the detection of the hovering by the detecting unit. The video conferencing apparatus according to claim 7 , wherein the applying unit lowers the strength of the audio filter by a predetermined amount each time a predetermined time elapses after the hovering detection is performed by the detection unit. The video conferencing apparatus according to claim 7 , wherein the application unit continuously lowers the strength of the audio filter in accordance with an elapsed time after the hovering detection is performed by the detection unit. Show handwriting trajectories in the touch panel, video conferencing apparatus according to any one of claims 1 to 9, a display unit integrated with the said panel, comprising further. A detection step of performing hovering detection to detect that the rod-shaped object has approached a predetermined distance to the touch panel,
When the hovering is detected, an audio filter is applied to the audio data picked up from the audio input unit to reduce writing noise generated when writing is made on the touch panel with the stick. Steps,
A step of performing contact detection for detecting that the rod-shaped object has touched the touch panel,
When the contact detection is not performed during a predetermined time after the hovering detection, a step of canceling the application of the voice filter,
An information processing method including. A detection step of performing hovering detection to detect that the rod-shaped object has approached a predetermined distance to the touch panel,
When the hovering is detected, an audio filter is applied to the audio data picked up from the audio input unit to reduce writing noise generated when writing is made on the touch panel with the stick. Steps,
When the hovering is detected, a determination step of determining the type of the rod-shaped object,
Applying the audio filter corresponding to the determined type of the rod-shaped object,
An information processing method including. Computer,
A detection unit that performs hovering detection to detect that a rod-shaped object has approached a predetermined distance to the touch panel,
When the hovering detection is performed by the detection unit, a voice for reducing writing noise generated when the rod-shaped object is written on the touch panel with respect to the voice data collected from the voice input unit. An application section to apply the filter,
And let it work ,
The detection unit further performs contact detection to detect that the rod-shaped object has touched the touch panel,
The said application part is a program for canceling|applying the said audio|voice filter, when the said contact detection is not carried out within the predetermined time after the said hovering detection by the said detection part . Computer,
A detection unit that performs hovering detection to detect that a rod-shaped object has approached a predetermined distance to the touch panel,
When the hovering detection is performed by the detection unit, a voice for reducing writing noise generated when the rod-shaped object is written on the touch panel with respect to the voice data collected from the voice input unit. An application section to apply the filter,
When the hovering detection is performed by the detection unit, a determination unit that determines the type of the rod-shaped object,
And let it work,
The application unit is a program for applying the voice filter corresponding to the type of the rod-shaped object determined by the determination unit.

Images