WO2010044209A1

WO2010044209A1 - Nuisance information determining device and method, nuisance information determining system, and program

Info

Publication number: WO2010044209A1
Application number: PCT/JP2009/005104
Authority: WO
Inventors: 永野竜一
Original assignee: 日本電気株式会社
Priority date: 2008-10-17
Filing date: 2009-10-02
Publication date: 2010-04-22
Also published as: JP2010098570A

Abstract

Provided is a nuisance information determining device which is connected between a transmitting terminal and a receiving terminal in order to determine whether or not moving image information or still image information transmitted by the transmitting terminal is nuisance information unnecessary for a user on the receiving terminal side. The nuisance information determining device is provided with a receiving unit for receiving the moving image information or still image information transmitted by the transmitting terminal, a separating unit for separating the moving image information or still image information into sound information, image information, and character string information, at least one of an intra-image character string extracting unit for extracting character string information from the image information separated by the separating unit and registering the character string information into a character string information storing unit or a character string information registering unit for registering the character string information separated by the separating unit into the character string information storing unit, a nuisance information storing unit for previously storing nuisance information identifying information for identifying the nuisance information, and a character string determining unit for determining whether or not the moving image information or still image information is the nuisance information on the basis of the nuisance information identifying information stored by the nuisance information storing unit and the character string information stored by the character string information storing unit.

Description

Nuisance information determination apparatus and method, nuisance information determination system and program

The present invention relates to a nuisance information determination apparatus, a nuisance information determination method, a nuisance information determination system, and a program for determining whether moving image information or still image information transmitted from a transmission terminal is nuisance information.
This application claims priority based on Japanese Patent Application No. 2008-268444 for which it applied on October 17, 2008, and uses the content here.

In recent years, technologies such as VoIP (Voice over Internet Protocol) have been studied, and development of services using IP (Internet Protocol) for a telephone network is progressing. In addition, the information processing capability of communication terminals has increased, and PCs (Personal Computers) have been developed for communication terminals.
As a result, various services using the telephone network can be realized. However, with the diversification of services, the number of services that become nuisance calls such as advertisements and solicitation calls will increase. Therefore, there is a need for a technique for detecting nuisance calls.

A technique for detecting such a nuisance call is disclosed in Patent Document 1.
Patent Document 1 converts voice information from a caller's communication terminal into character string information, character string information obtained by converting the voice information, character string information registered in advance and assumed to be included in a nuisance call Is a technique for determining whether or not the voice information from the communication terminal is a nuisance call.
In addition, it is considered that the number of video calls such as videophone calls increases with the increase in the capacity of communication channels due to the IP network of the telephone network. For this reason, it is assumed that not only audio but also nuisance information by video increases.

JP 2007-116542 A

However, the method described in Patent Document 1 can detect a nuisance call by voice, but the voice information does not include a character string that can be determined as nuisance information among the video information transmitted by the transmission terminal. If information such as advertisements or solicitations is embedded only in video information, or if information such as advertisements or solicitations is embedded only in character string information attached to video information as captions There has been a problem that it is not possible to determine that the video information transmitted by the terminal is nuisance information.

The present invention has been made in view of the above points, and an object of the present invention is to provide a nuisance information determination device, a nuisance information determination method, and a nuisance information determination that determine whether or not video information transmitted from a transmission terminal is nuisance information. It is to provide a system and a program.

Therefore, the present invention determines whether or not the moving image information or still image information transmitted between the transmitting terminal and the transmitting terminal is unnecessary nuisance information for the user on the receiving terminal side. A nuisance information determination device that receives moving image information or still image information transmitted from the transmitting terminal, and a separation unit that separates the moving image information or still image information into audio information, video information, and character string information The character string information extracted from the video information separated by the separation unit, and the character string information in the video that registers the character string information in the character string information storage unit; and the character string information separated by the separation unit At least one of the character string information registration unit to be registered in the character string information storage unit, the nuisance information storage unit for preliminarily storing the nuisance information identification information for identifying the nuisance information, and the nuisance information identification stored by the nuisance information storage unit A nuisance information determination device including a character string determination unit that determines whether the moving image information or still image information is nuisance information based on information and character string information stored in the character string information storage unit To do.

The present invention is also connected between the transmitting terminal and the receiving terminal, and determines whether the moving image information or the still image information transmitted by the transmitting terminal is unwanted information unnecessary for the user on the receiving terminal side, A nuisance information determination method using a nuisance information determination apparatus including a nuisance information storage unit that preliminarily stores nuisance information identification information for identifying the nuisance information, wherein the reception unit transmits video information or a still image transmitted by the transmission terminal. Receiving the information, the separation unit separates the moving image information or the still image information into audio information, video information, and character string information, and the in-video character string extraction unit extracts the character string from the video information separated by the separation unit. A process of extracting information and registering the character string information in the character string information storage unit, and a character string information registration unit is at least a process of registering the character string information separated by the separation unit in the character string information storage unit Do one, The character string determination unit, based on the nuisance information identification information stored in the nuisance information storage unit and the character string information stored in the character string information storage unit, the moving image information or the still image information is nuisance information. A nuisance information determination method is also provided.

The present invention is also a nuisance that is connected between a transmission terminal and a reception terminal and determines whether the moving image information or still image information transmitted by the transmission terminal is unnecessary nuisance information for the user on the reception terminal side. A nuisance information determination system including an information determination device, wherein the nuisance information determination device includes a receiving unit that receives moving image information or still image information transmitted from the transmitting terminal, and the moving image information or still image information as audio information. A separation unit that separates video information and character string information; a character string extraction unit that extracts character string information from the video information separated by the separation unit and registers the character string information in a character string information storage unit; And at least one of the character string information registration unit for registering the character string information separated by the separation unit in the character string information storage unit, and the nuisance information storage unit for preliminarily storing the nuisance information identification information for identifying the nuisance information Based on the nuisance information identification information stored in the nuisance information storage unit and the character string information stored in the character string information storage unit, it is determined whether the moving image information or the still image information is nuisance information. A nuisance information determination system including a character string determination unit is also provided.

The present invention is also a nuisance that is connected between a transmission terminal and a reception terminal and determines whether the moving image information or still image information transmitted by the transmission terminal is unnecessary nuisance information for the user on the reception terminal side. An information determination apparatus comprising: a receiving unit that receives moving image information or still image information transmitted from the transmitting terminal; a separating unit that separates the moving image information or still image information into audio information, video information, and character string information; and the separating unit Extracts character string information from the separated video information and registers the character string information in the character string information storage unit, and the character string information separated by the separation unit as the character string information storage unit At least one of the character string information registration unit to be registered, a nuisance information storage unit for preliminarily storing the nuisance information identification information for identifying the nuisance information, the nuisance information identification information stored by the nuisance information storage unit, and the character string On the basis of the character string information distribution storage unit stores also provides a program for causing to function as determining a string determining section for determining whether or not the moving image information or still picture information is junk information.

According to the present invention, whether or not it is nuisance information using character string information extracted from video information included in the moving picture information transmitted from the transmitting terminal or character string information included in the moving picture information transmitted from the transmitting terminal. Judgment is made. As a result, even when information such as advertisement or solicitation is embedded in the video information of the video information transmitted by the transmitting terminal, or when information such as advertisement or solicitation is embedded in the caption information Therefore, it can be determined that the video information transmitted from the transmission terminal is nuisance information.

It is a block diagram of the nuisance information determination system by one Embodiment of this invention. It is a schematic block diagram which shows the structure of the junk information determination apparatus by this embodiment. It is a flowchart which shows the operation | movement of a nuisance information determination apparatus. It is a block diagram of the nuisance information determination system in case a nuisance information determination apparatus is connected to a packet transfer apparatus. It is a block diagram of the nuisance information determination system in case a nuisance information determination apparatus is connected to a packet duplication apparatus. 1 is a configuration diagram of a nuisance information determination system when a nuisance information determination device is installed in a fixed telephone network in a system in which an IP telephone network and a fixed telephone network are connected. FIG. FIG. 3 is a configuration diagram of a nuisance information determination system when a nuisance information determination device is installed in a connection part between an IP telephone network and a fixed telephone network in a system in which an IP telephone network and a fixed telephone network are connected. It is a block diagram of the troublesome information determination system in the case of constructing a troublesome information determination system on a fixed telephone network.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a configuration diagram of a nuisance information determination system according to an embodiment of the present invention.
In the present embodiment, the nuisance information determination system is constructed on an IP telephone network system, and includes a plurality of nuisance information determination devices 10-1 to 10-4, a plurality of communication terminals 20-1 to 20-4, and a plurality of packets. And transfer devices 30-1 to 30-3.
A network formed by the nuisance information determination devices 10-1 to 10-4 and the packet transfer devices 30-1 to 30-3 is assumed to be a telephone network 40.
Nuisance information determination devices 10-1 to 10-4 are connected to communication terminals 20-1 to 20-4 and packet transfer devices 30-1 to 30-3, and communication terminals 20-1 to 20-4 receive an incoming call. It is determined whether the moving image information or the still image information is nuisance information.
Here, the still image information may be still image information accompanied by audio information or character string information, instead of information on only a still image. For example, there are those in which sound flows or a character string is displayed in accordance with a displayed still image.
The communication terminals 20-1 to 20-4 transmit or receive moving image information or still image information to other communication devices via the telephone network 40.
The packet transfer devices 30-1 to 30-3 are connected to the nuisance information determination devices 10-1 to 10-4 or other packet transfer devices, and transfer packets based on addresses given to received packets.
For the packet transfer apparatuses 30-1 to 30-3, for example, a layer 2 switch or a layer 3 switch may be used.
For convenience of explanation, FIG. 1 shows an example in which there are four communication terminals, four nuisance information determination devices, and three packet transfer devices. However, the number of installed devices can be changed as appropriate.
Hereinafter, a case where the communication terminal 20-1 (transmitting terminal) transmits moving image information to the communication terminal 20-4 (receiving terminal) will be described as an example.

FIG. 2 is a schematic block diagram illustrating the configuration of the nuisance information determination device according to the present embodiment.
Here, since the communication terminal 20-4 is a terminal on the receiving side, the nuisance information determination device 10-4 will be described as a representative of the nuisance information determination devices 10-1 to 10-4. However, it goes without saying that the nuisance information determination devices 10-1 to 10-3 have the same configuration as the nuisance information determination device 10-4.
The nuisance information determination apparatus 10-4 includes a communication interface unit 101 (reception unit), a separation unit 102, an in-video character string extraction unit 103, a voice character string conversion unit 104, a character string information registration unit 105, a character string Column information storage unit 106, filter storage unit 107 (nuisance information storage unit), character string determination unit 108, determination result storage unit 109, determination basis storage unit 110, and output unit 111 (determination result output unit, determination Ground output unit).
According to FIG. 1, communication terminal 20-1 and nuisance information determination device 10-4 are connected via nuisance information determination device 10-1 and packet transfer devices 30-1 to 30-3. However, since these only perform packet relay processing, they are not shown in FIG.

The communication interface unit 101 receives moving image information transmitted from the communication terminal 20-1 to the communication terminal 20-4.
The separating unit 102 separates the moving image information transmitted from the communication terminal 20-1 into audio information, video information, and character string information as will be described later.
The in-video character string extraction unit 103 extracts character string information from the video information separated by the separation unit 102, and uses the extracted character string information as a character code used by the nuisance information determination device 10-4. 106.
The voice character string conversion unit 104 converts the voice information separated by the separation unit 102 into character string information using a character code used in the nuisance information determination device 10-4, and converts the converted character string information into a character string information storage unit. 106.
The character string information registration unit 105 converts the character string information separated by the separation unit 102 into character string information using a character code used in the nuisance information determination device 10-4, and registers the character string information in the character string information storage unit 106.
The character string information storage unit 106 associates the character string information with a determination completion flag indicating whether the character string information is determined by the character string determination unit 108, and the character string information is annoying information. A nuisance information flag indicating whether or not it is determined to be present is stored.
The filter storage unit 107 stores in advance nuisance information identification information indicating character string information included in the nuisance information. This nuisance call identification information is input in advance according to an instruction from the user.
The nuisance information identification information is, for example, a set of character strings included in the nuisance information or information learned by statistics of the nuisance information.
The character string determination unit 108 transmits the communication terminal 20-1 to the communication terminal 20-4 based on the nuisance information identification information stored in the filter storage unit 107 and the character string information stored in the character string information storage unit 106. It is determined whether or not the moving image information is nuisance information, and the determination result is registered in the determination result storage unit 109.
When the character string determination unit 108 determines that the moving image information received by the communication terminal 20-4 is nuisance information, the determination reason acquisition unit 110 receives the determination result and receives the determination result from the character string information storage unit 106. Character string information including a character string as a basis is acquired, and the acquired character string information is registered in the determination result storage unit 109.
The output unit 111 outputs the determination result stored in the determination result storage unit 109 and the character string information that is the basis for the determination to the external device 50.
The external device 50 acquires the determination result determined by the nuisance information determination device 10-4 and the character string information that is the basis for the determination, and notifies the communication terminal 20-4 of the determination result. The external device 50 is mounted on, for example, a WEB server and performs notification by e-mail or the like.

Next, the operation of the nuisance information determination apparatus 10-4 will be described.
FIG. 3 is a flowchart showing the operation of the nuisance information determination apparatus.
When the communication terminal 20-1 transmits moving image information to the communication terminal 20-4, the communication interface unit 101 receives the moving image information (step S1).
At this time, for example, the communication interface unit 101 may directly receive the moving image information transmitted to the communication terminal 20-4 and relay the moving image information to the communication terminal 20-4, or may be transmitted to the communication terminal 20-4. The moving image information transmitted to the communication terminal 20-4 may not be directly received by receiving the copied moving image information.
When the communication interface unit 101 receives the moving image information, the separating unit 102 separates the received moving image information into video information, audio information, and character string information (step S2).
Generally, in the configuration of moving image information, video information, audio information, and character string information are subdivided.
Therefore, the separation unit 102 can perform separation by reading a portion indicating video information, a portion indicating audio information, and a portion indicating character string information from the moving image information in accordance with, for example, header information or index information of the moving image information. it can.

When the moving image information is separated, the in-video character string extraction unit 103 extracts the character string information from the video information separated from the moving image information (step S3). Extraction of character string information can be realized, for example, by extracting character string information from each frame of video information using an optical character recognition (OCR) technique.
When the character string information is extracted, the in-video character string extraction unit 103 registers the extracted character string information in the character string information storage unit 106 (step S4).
The in-video character string extraction unit 103 preferably generates character string information for each frame in which a new character string appears in the video information and sequentially registers it in the character string information storage unit 106. As a result, the character string information is registered in the character string information storage unit 106 when the new character string appears, and the character string determination unit 108 performs the determination, so that the determination delay can be reduced.

When the moving image information is separated in step S2, the voice character string converting unit 104 converts the voice information separated from the moving image information into character string information (step S5). Conversion from voice information to character string information can be realized as follows.
For example, a speech waveform corresponding to a character is stored in a database (not shown) in advance, and the speech character string conversion unit 104 compares the speech information with the speech waveform stored in the database, and a character string having a high likelihood (likelihood). Is converted into character string information.
When the voice information is converted into character string information, the voice character string conversion unit 104 registers the converted character string information in the character string information storage unit 106 (step S6).
Note that it is preferable that the voice character string conversion unit 104 generates character string information for each voice section and sequentially registers it in the character string information storage unit 106. Note that the speech section is a section in which speech is present, which is between silence sections of a predetermined length or more in the speech information (a section that is not completely silent but only environmental noise is also a silence section).
As a result, the character string information is registered in the character string information storage unit 106 at the time when the speech section is completed, and the character string determination unit 108 performs the determination, so that the determination delay can be reduced.

When the moving image information is separated in step S2, the character string information registration unit 105 converts the character code of the character string information separated from the moving image information into a character code used in the nuisance information determination device 10-4 (step S2). S7).
Here, the character string information separated from the moving image information is, for example, caption information attached to the moving image information. The character string information registration unit 105 registers the character string information in the character string information storage unit 106 after conversion of the character code of the character string information or when conversion of the character code is unnecessary, without conversion processing ( Step S8).
Note that the character string information registration unit 105 preferably registers the character string information in the character string information storage unit 106 sequentially, for example, by dividing the character string information for each sentence from the position of a punctuation mark or the like. Accordingly, when the determination basis acquisition unit 110 acquires the character string that is the basis for the determination, the user can easily search for a portion that is the basis for the determination.

When the character string information is registered in the character string information storage unit 106 in steps S4, S6, and S8 described above, the character string determination unit 108 performs character string information based on the nuisance information identification information stored in the filter storage unit 107. It is sequentially determined whether or not the character string information stored in the storage unit 106 is nuisance information (step S9).
At this time, the character string determination unit 108 reads the determination completion flag, extracts character string information whose determination completion flag is OFF, and determines whether or not the extracted character string information is nuisance information.
Whether the character string information is a nuisance call is determined by, for example, comparing the character string of the nuisance information identification information with the character string information stored in the character string information storage unit 106, and in the extracted character string information, This is done depending on whether there is a match with the nuisance information identification information.
That is, the character string determination unit 108 determines that it is nuisance information when there is a match with the nuisance information identification information. It is also possible to determine whether the call is a nuisance call by a statistical method such as a Bayesian filter.
When the determination is made, the character string determination unit 108 sets the determination completion flag of the determined character string information to ON, and overwrites and registers the character string information with the determination completion flag turned ON in the character string information storage unit 106.

Further, when it is determined in step S9 that the information is nuisance information (step S9: YES), the character string determination unit 108 turns on the nuisance information flag of the character string information that has been determined (step S10).
Then, as described above, when character string determination unit 108 sets the nuisance information flag to ON in step S10 or determines that the information is not nuisance information in step S9 (step S9: NO), communication terminal 20-1 and communication terminal 20 -4 is ended, and it is determined whether the determination completion flags of all the character string information stored in the character string information storage unit 106 are ON (step S11).
The character string determination unit 108 determines that the call between the communication terminal 20-1 and the communication terminal 20-4 has not ended, or one character string information stored in the character string information storage unit 106. However, when it is determined that there is a flag whose determination completion flag is OFF (step S11: NO), the process returns to step S9, and it is continuously determined whether or not the information is nuisance information.

On the other hand, the character string determination unit 108 determines that the call between the communication terminal 20-1 and the communication terminal 20-4 has ended, and sets determination completion flags for all the character string information stored in the character string information storage unit 106. When it is determined that the character string information is ON (step S11: YES), it is determined whether or not there is at least one nuisance information flag in the character string information stored in the character string information storage unit 106 (step S12). ).
If the character string determination unit 108 determines that at least one of the character string information stored in the character string information storage unit 106 has the nuisance information flag ON (step S12: YES), the communication terminal 20-1 Is registered in the determination result storage unit 109 (step S13).
When the character string determination unit 108 registers that it is nuisance information in the determination result storage unit 109, the determination basis acquisition unit 110 uses the character string information as the basis for determining that it is nuisance information from the character string information storage unit 106. The character string information whose nuisance information flag is ON is acquired from the character string information storage unit 106 (step S14).
When the character string information that is the basis for the determination is acquired, the determination reason acquisition unit 110 registers the character string information that is the basis for the determination in the determination result storage unit 109 (step S15).

If all the nuisance information flags of the character string information stored in the character string information storage unit 106 are OFF (step S12: NO), the moving image information from the communication terminal 20-1 is not nuisance information in the determination result storage unit 109. Information indicating this is registered (step S16).
When the character string information that is the basis for the determination is registered in the determination result storage unit 109 in step S15 or the information indicating that it is not annoying information is registered in step S16, the output unit 111 stores the determination result storage unit 109. The information to be output is output to the external device 50 (step S17).
Here, the information stored in the determination result storage unit 109 is determination result information and character string information that serves as a basis for determination when the character string determination unit 108 determines that the call is a nuisance call. On the other hand, when the character string determination unit 108 determines that the call is not a nuisance call, the information stored in the determination result storage unit 109 is only the determination result information.
Note that if the information stored in the determination result storage unit 109 is output to the external device 50, the information stored in the character string information storage unit 106 and the determination result storage unit 109 becomes unnecessary. The information stored in the determination result storage unit 109 may be deleted.

By using the information output to the external device 50, various services can be performed.
For example, by permitting the communication terminal 20-4 to confirm the information stored in the external device 50, the communication terminal 20-4 can confirm whether or not the received video information is determined to be nuisance information. Anyway.
Further, the user of the communication terminal 20-4 may refer to the character string information that is the basis for the determination so that the user can know the reason why the moving image information is determined to be nuisance information.
Further, by transmitting the information stored in the external device 50 to the packet transfer devices 30-1 to 30-3, the packet transfer devices 30-1 to 30-3 restrict calls from communication terminals that transmit nuisance information. You may be able to do that.
Further, according to the user's instruction, the correctness / incorrectness information for the determination of the nuisance information is transmitted from the communication terminal 20-4 to the external device 50, and the determination is performed by feeding back the correct / incorrect information to the filter storage unit 107 of the nuisance information determination device 10-4 The accuracy may be improved.
In addition, by collecting determination results from a plurality of nuisance information determination devices, the external device 50 treats the information of the determination results as statistical information, and for a communication terminal having a large number of nuisance information determined to be a sender, You may make it notify to the provider etc. which provide IP telephone service.

Thus, according to the present embodiment, the nuisance information determination device 10-4 separates the moving image information into video information, audio information, and character string information, generates character string information from each, and To determine whether it is nuisance information.
Thereby, it is possible to determine whether or not the moving image information transmitted from the communication terminal 20-1 to the communication terminal 20-4 is nuisance information.
Further, according to the present embodiment, various services can be performed by outputting the determination result and the character string information that is the basis of the determination to the external device 50.

As described above, the embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to the above, and various design changes and the like can be made without departing from the scope of the present invention. It is possible to
For example, in the nuisance information determination system of the present embodiment, the case where the nuisance information determination device is configured to be directly connected to a communication terminal has been described, but the present invention is not limited to this.
FIG. 4 is a configuration diagram of the nuisance information determination system when the nuisance information determination apparatus is connected to the packet transfer apparatus without being directly connected to the communication terminal.
In the application example of FIG. 4, a plurality of packet transfer apparatuses 30-1 to 30-3 are provided in the telephone network 40, and communication terminals 20-1 to 20-4 are connected to these. As shown in FIG. 4, the nuisance information determination device 10 may be connected to the mirror ports of the packet transfer devices 30-1 to 30-3 to collect each packet.
FIG. 5 is a configuration diagram of the nuisance information determination system when the nuisance information determination device is connected to the packet duplicating device without being directly connected to the communication terminal.
In the application example of FIG. 5, a plurality of packet transfer apparatuses 30-1 to 30-3 are provided in the telephone network 40, and packet duplicating apparatuses 11-1 to 11-4 are connected to these.
The packet duplicating devices 11-1 to 11-4 are devices that duplicate input packets and output them to the outside. For example, the packet duplicating devices 11-1 to 11-4 are implemented using network taps. In addition, communication terminals 20-1 to 20-4 are connected to the packet duplicators 11-1 to 11-4. As shown in FIG. 5, the nuisance information determination device 10 may be connected to the packet duplicating devices 11-1 to 11-4 to collect each packet.
Moreover, it is good also as a structure which does not provide a nuisance information determination apparatus separately by mounting a nuisance information determination apparatus in a communication terminal or a packet transfer apparatus.

Moreover, although this embodiment demonstrated the case where the nuisance information determination system was constructed | assembled on the IP telephone network system, this invention is not limited to this.
FIG. 6 is a configuration diagram of a nuisance information determination system when a nuisance information determination device is installed in a fixed telephone network in a system in which an IP telephone network and a fixed telephone network are connected.
In the application example of FIG. 6, the communication terminal 20-1 is connected to the IP telephone network 41, and the communication terminal 20-4 is connected to the fixed telephone network.
As shown in FIG. 6, the nuisance information determination device 10 may be installed in the fixed telephone network 42 to determine the moving image information received by the communication terminal 20-4.
FIG. 7 is a configuration diagram of a nuisance information determination system when a nuisance information determination device is installed in a connection portion between an IP telephone network and a fixed telephone network in a system in which an IP telephone network and a fixed telephone network are connected.
In the application example of FIG. 7, the communication terminal 20-1 is connected to the IP telephone network 41 and the communication terminal 20-4 is connected to the fixed telephone network 42.
As shown in FIG. 7, the nuisance information determination apparatus 10 may be installed between the IP telephone network 41 and the fixed telephone network 42 to determine the moving image information received by the communication terminal 20-4.
FIG. 8 is a configuration diagram of the nuisance information determination system when the nuisance information determination system is constructed on the fixed telephone network.
In the application example of FIG. 8, the communication terminal 20-1 and the communication terminal 20-4 are connected on the fixed telephone network. As shown in FIG. 8, the nuisance information determination device 10 may be installed in the fixed telephone network 42 to determine the moving image information received by the communication terminal 20-4.

In this embodiment, the nuisance information is determined using all of the video information, audio information, and character string information separated from the moving image information. However, the present invention is not limited to this, and only one piece of the separated information is used. The determination may be performed, or the determination may be performed using two pieces of information out of the separated information.

Further, in the present embodiment, the case where the communication terminal 20-4 receives the moving image information and the nuisance information determination device 10-4 determines the moving image information is described, but the present invention is not limited to this, and the communication terminal 20-4 Even when the still image information is received and the nuisance information determination device 10-4 determines the still image information, the same processing can be performed.

Further, in the present embodiment, the case has been described in which the external device 50 is provided in the nuisance information determination system, and the nuisance information determination device 10-4 outputs the determination result and character string information that is the basis of the determination to the external device 50. For example, the configuration may be such that the nuisance information determination device 10-4 directly outputs the determination result and the character string information that is the basis for the determination to the communication terminal 20-4 and does not include the external device 50.
Further, when it is not necessary to notify the user of the determination result, the determination result and the character string information that is the basis of the determination may be held in the nuisance information determination device 10-4 without providing the output unit 111.

In the present embodiment, when all the nuisance information flags of the character string information stored in the character string information storage unit 106 are OFF in step S12 described above, an incoming call is received in the determination result storage unit 109 in step S16. Although the example which registers the information which shows that moving image information is not nuisance information was demonstrated, it is not restricted to this, For example, you may make it register nothing in the determination result memory | storage part 109 by step S16.
In this case, the determination result storage unit 109 stores only information about moving image information determined to be nuisance information. Thereby, it can be seen that the moving image information for which the determination result storage unit 109 does not store the determination result is determined not to be nuisance information.

Further, in the present embodiment, the case where the determination basis acquisition unit 110 acquires only the character string information whose nuisance information flag is ON from the character string information storage unit as the basis of the determination has been described.
Regardless of whether the junk information flag is ON or OFF, all character string information is acquired and registered in the determination result storage unit 109. As information for determination, video information, audio information, and character strings separated by the separation unit 102 At least one or more of the information is registered in the determination result storage unit 109. As a basis for the determination, the moving image information acquired by the communication interface unit 101 may be registered in the determination result storage unit 109. .
In addition, what the registration basis acquisition unit 110 registers may be registered in advance in the environment setting file, and information to be registered by the determination basis acquisition unit 110 may be determined based on the environment setting file.

Further, in the present embodiment, after the communication between the communication terminal 20-1 and the communication terminal 20-4 is finished and the determination of all the character string information stored in the character string information storage unit 106 is completed, The case where the character string determination unit 108 determines whether or not the moving image information is nuisance information has been described in step S12. However, the present invention is not limited to this, and the character string information stored in the character string information storage unit 106 in step S9. When the video information is determined to be nuisance information, the video information may be determined to be nuisance information.
As a result, the determination result of the nuisance information can be obtained in real time. For example, when the character string determination unit 108 determines that there is a dangerous word in the moving image information, the person who implements the IP telephone service and others It is possible to carry out a service of notifying the person designated by and specifying the sender of the nuisance information.
Other designated persons include, for example, police and security organizations.

The nuisance information determination apparatus described above has a computer system inside.
And the process by each process part mentioned above is memorize | stored in the computer-readable recording medium in the format of the program, The said process is performed when a computer reads and runs this program.
Here, the computer-readable recording medium means a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like.
Alternatively, the computer program may be distributed to the computer via a communication line, and the computer that has received the distribution may execute the program.

The program may be for realizing a part of the functions described above.
Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

10-1 to 10-4 ... Nuisance information determination device 20-1 to 20-4 ... Communication terminal 30-1 to 30-3 ... Packet transfer device 40 ... Telephone network 50 ... External device 101 ... Communication interface unit 102 ... Separation unit DESCRIPTION OF SYMBOLS 103 ... Video character string extraction part 104 ... Voice character string conversion part 105 ... Character string information registration part 106 ... Character string information storage part 107 ... Filter storage part 108 ... Character string determination part 109 ... Judgment result storage part 110 ... Determination basis Acquisition unit 111 ... Output unit

Claims

A nuisance information determination device that is connected between a transmission terminal and a reception terminal and determines whether moving image information or still image information transmitted by the transmission terminal is unnecessary nuisance information for a user on the reception terminal side. And
A receiving unit for receiving moving image information or still image information transmitted by the transmitting terminal;
A separation unit that separates the moving image information or still image information into audio information, video information, and character string information;
The character string information is extracted from the video information separated by the separation unit, and the character string information in the video is registered in the character string information storage unit, and the character string information separated by the separation unit is a character string. At least one of the character string information registration units to be registered in the information storage unit;
A nuisance information storage unit for preliminarily storing nuisance information identification information for identifying the nuisance information;
Based on the nuisance information identification information stored in the nuisance information storage unit and the character string information stored in the character string information storage unit, it is determined whether the moving image information or the still image information is nuisance information. A nuisance information determination device comprising a character string determination unit.
The nuisance information according to claim 1, further comprising: a voice character string conversion unit that converts the voice information separated by the separation unit into character string information and registers the character string information in a character string information storage unit. Judgment device.
The nuisance information determination device according to claim 1, further comprising a determination result output unit that outputs a determination result determined by the character string determination unit to an external device.
When the character string determination unit determines that the moving image information or still image information is nuisance information, obtains character string information including a character string that is a basis for the determination from the character string information storage unit, or A determination basis acquisition unit that acquires at least one of audio information, video information, and character string information separated from the moving image information or still image information from the separation unit;
The nuisance information determination device according to any one of claims 1 to 3, further comprising: a determination basis output unit that outputs information acquired by the determination basis acquisition unit to an external device.
The in-video character string extraction unit
From the video information separated by the separation unit, character string information is generated for each frame in which a new character string appears and sequentially registered in the character string information storage unit,
The character string determination unit
The nuisance information determination device according to claim 1, wherein the determination is sequentially performed on character string information stored in the character string information storage unit.
The character string information registration unit
The character string information separated by the separation unit is divided into sentences and sequentially registered in the character string information storage unit,
The character string determination unit
The nuisance information determination device according to claim 1, wherein the determination is sequentially performed on character string information stored in the character string information storage unit.
The phonetic character string conversion unit
Character string information is generated for each voice section from the voice information separated by the separation unit and sequentially registered in the character string information storage unit,
The character string determination unit
The nuisance information determination device according to claim 2, wherein the determination is sequentially performed on the character string information stored in the character string information storage unit.
It is connected between the transmitting terminal and the receiving terminal, and determines whether the video information or still image information transmitted by the transmitting terminal is unwanted information unnecessary for the user on the receiving terminal side, and identifies the unwanted information A nuisance information determination method using a nuisance information determination device including a nuisance information storage unit that stores in advance nuisance information identification information,
The receiving unit receives moving image information or still image information transmitted by the transmitting terminal,
The separation unit separates the moving image information or still image information into audio information, video information, and character string information,
The character string extraction unit in the video extracts character string information from the video information separated by the separation unit, registers the character string information in the character string information storage unit, and the character string information registration unit Perform at least one of the process of registering the character string information separated by the part in the character string information storage unit,
The character string determination unit, based on the nuisance information identification information stored in the nuisance information storage unit and the character string information stored in the character string information storage unit, the moving image information or the still image information is nuisance information. A method for determining nuisance information, characterized by determining whether or not.
A nuisance information determination device is connected between a transmission terminal and a reception terminal, and determines whether moving image information or still image information transmitted from the transmission terminal is nuisance information unnecessary for a user on the reception terminal side. An annoying information determination system,
The nuisance information determination device
A receiving unit for receiving moving image information or still image information transmitted by the transmitting terminal;
A separation unit that separates the moving image information or still image information into audio information, video information, and character string information;
The character string information is extracted from the video information separated by the separation unit, and the character string information in the video is registered in the character string information storage unit, and the character string information separated by the separation unit is a character string. At least one of the character string information registration units to be registered in the information storage unit;
A nuisance information storage unit for preliminarily storing nuisance information identification information for identifying the nuisance information;
Based on the nuisance information identification information stored in the nuisance information storage unit and the character string information stored in the character string information storage unit, it is determined whether the moving image information or the still image information is nuisance information. A nuisance information determination system comprising a character string determination unit.
A nuisance information determination device that is connected between a transmission terminal and a reception terminal and determines whether or not video information or still image information transmitted by the transmission terminal is unnecessary nuisance information for a user on the reception terminal side,
A receiving unit for receiving moving image information or still image information transmitted by the transmitting terminal;
A separation unit that separates the moving image information or still image information into audio information, video information, and character string information;
The character string information is extracted from the video information separated by the separation unit, and the character string information in the video is registered in the character string information storage unit, and the character string information separated by the separation unit is a character string. At least one of the character string information registration parts to be registered in the information storage part,
A nuisance information storage unit for preliminarily storing nuisance information identification information for identifying the nuisance information;
Based on the nuisance information identification information stored in the nuisance information storage unit and the character string information stored in the character string information storage unit, it is determined whether the moving image information or the still image information is nuisance information. Program to function as a character string judgment unit.