JP3488481B2 - Multimedia email system - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia electronic mail system for handling voice, text, images and the like.

[0002]

2. Description of the Related Art In recent years, computer and communication technologies have been remarkably developed, and electronic mail systems utilizing these technologies are rapidly becoming widespread.

Unlike a telephone or a FAX, an electronic mail is based on a computer and thus has a great deal of flexibility, and text data can be sent as a character code to various countries around the world without causing trouble to the other party, and a communication tool. Has been proven to be powerful.

On the other hand, on the other hand, the number of unnecessary mails increases with the spread of electronic mails, and so-called junk mails increase, and the file capacity for storing the contents of electronic mails is insufficient. It's becoming a problem.

On the other hand, in ordinary e-mail, the information that can be sent is limited to text data (character data), so a user who is unfamiliar with the keyboard can input (send,
It is difficult to reply, and expectations for voice mails and multimedia e-mails that combine image input are increasing. Since the intent and emotions that cannot be expressed in text by voice or image data, or visual information such as figures and drawings can be transferred, the range of communication increases,
Dialogue and information exchange between the sender and the receiver become easy.

[0006]

However, when it comes to realizing a multimedia electronic mail which can utilize not only the conventional text data but also data having a large amount of information compared to character data such as voice data and image data, the media of the electronic mail is to be realized. There has been a problem that the file capacity for storing information becomes more and more serious, and the operation of the electronic mail system is hindered.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a multimedia electronic mail system capable of efficiently storing media information of an electronic mail without hindering system operation.

[0008]

The present invention provides an input means for inputting multimedia information, an electronic mail transmitting means for transmitting the multimedia information input by the input means as electronic mail, and an electronic mail transmitting means. E-mail receiving means for receiving e-mail transmitted by the e-mail, media information storage means for storing the e-mail received by the e-mail receiving means, and calculation load information processing for monitoring the calculation load of the calculation processing part of the system And means for performing compression processing on the multimedia information stored in the media information storage means on the basis of the calculation load information from the calculation load information processing means, and again performing the compression processing on the compressed media information. The media information compression processing means to be stored in the storage means, and the pressure information stored in the media information storage means. It is constituted by a media presenting means for presenting the specified media information processing multimedia information decompression processing on.

[0009]

As a result, according to the present invention, the electronic mail sent from the multimedia electronic mail creating and transmitting function is temporarily stored in the media information storage unit, and the media information in the media information storage unit is stored under a predetermined condition. The media information compression processing unit performs compression processing and stores it again in the media information storage unit. As a result, a large amount of e-mail can be efficiently stored in the media information storage unit, the lack of file capacity can be resolved, and compression processing is performed only under a predetermined condition, so that a normal personal computer or the like can be used. Even if is used, system operation will not be hindered and stable system operation can always be realized.

[0010]

Embodiments of the present invention will be described below with reference to the drawings. (First embodiment)

FIG. 1 shows a schematic configuration of a general multimedia electronic mail system. In this case, the multimedia electronic mail system is configured to connect the multimedia electronic mail creation / transmission function 1 and the multimedia electronic mail reception / presentation function 2 via the network 3.

Multimedia electronic mail creation and transmission function 1
Has a media input unit 101 and an electronic mail transmission unit 102. The media input unit 101 performs key input, voice input, mouse input, image input, adds destination information such as creation date and time as an e-mail, subject, sender information, etc., and sends an e-mail from the e-mail sending unit 102. To send as. At this time, by supporting voice input and image input in addition to conventional text information,
Natural, friendly, and efficient communication with a wide range of people, organizations and local people.

On the other hand, the multimedia e-mail reception / presentation function 2 has an e-mail reception unit 201, a media information storage unit 202, and a media output unit 203. Upon receiving the electronic mail, the electronic mail receiving unit 202 adds, to the media information storage unit 202, the mail destination information from the sender and the contents of the mail to be sent, the date and time of the reception, the route of the electronic mail to the reception, and the like. And remember. The media output unit 203 outputs and presents the received mail in response to a request from the user. At this time, the user can specify the mail to be read by using the mouse, menu, key input, or voice recognition input. In the media output unit 203, the text information can be displayed on the screen as character data, or can be presented as a voice output to the user by text-to-speech synthesis. In this case, the input voice information of the sender is digitized by a coding system called CODEC, for example, by a logarithmic coding with a sampling frequency of 8 kHz and 8 bits. Then, the encoded voice information is decoded and reproduced as a voice signal, and is output and presented to the user. The image information includes image information input by an online pen, moving image information captured by a camera, three-dimensional graphics information, still image information, graphic information created by a document creation support system or electronic publishing system, and format and layout information. And the like are added to control the screen display and be presented to the user. At this time, when a large number of various kinds of complicated e-mails are input, the limitation of the file storage capacity of the mails becomes a problem. FIG. 2 shows a schematic configuration in which the configuration of FIG. 1 is made more concrete.
The same parts as those in FIG. 1 are designated by the same reference numerals.

In this case, the media information compression processing unit 204 is connected to the media information storage unit 202, and the media output unit 203 comprises a media information expansion processing unit 2031 and a media presentation unit 2032.

Here, the electronic mails sent from the multimedia electronic mail creating and transmitting function 1 every moment are recorded in the media information storage unit 202 by, for example, the ADPCM system, and stored under a predetermined condition, for example, a computer. When the calculation load on the media information is light and the real-time response becomes unnecessary due to non-use by the user, the media information compression processing unit 204 performs compression processing on the multimedia information stored in the media information storage unit 202. Get to run.

The media information compression processing unit 204 includes a text, an image stored in the media information storage unit 202,
A process of compressing the amount of information is performed on multimedia information such as pen input information and voice information in order to limit the storage capacity, and the compressed media information is stored in the media information storage unit 202 again. Like

In this case, the media information compression processing unit 204
Requires a large amount of calculation, but various information compression and coding methods have been proposed and put to practical use for moving image and still image, pen input, voice and drawing input information. For example, in the case of voice coding, there is a compression coding standard by CCITT, and G771 (PC
M), which compresses the amount of data in half, G726 (ADPC
M), G728 that compresses the data to 1/4 (LD-CE
Although real-time voice encoding technology for telephone and wireless communication based on (LP) has been developed, the information compression processing in the electronic mail system requires special hardware when performing real-time processing. Runs on a personal computer or workstation. These compression processes
The one that is performed continuously in time is widely used, but in the case of an electronic mail system, it is read offline, so
Compressibility and quality become more important. That is, Causa
It is possible to perform encoding that ignores the lit (causality) and various optimal encodings. Various coding methods have been proposed, for example, a method called Q-coder (reference: I
BM Journal of Research and
DevelopmentVol. 32, No6, pp7
15-840 (1998) November "Q-coder
adaptive binary arithmati
C coder ") is known to perform high-quality coding with a high compression rate. Although the coding method is not the gist of the present invention, the current real-time coding technology can be used for compression. The same compression process is applied to other media.

When the user reads the contents of the multimedia electronic mail information, the media information decompression processing unit 20
According to 31, the media information decompression process (decoding process) is performed on the media information of the compressed email of the email designated by the user. Since the decompression process of the media information here generally uses a much smaller amount of calculation (for example, 1/10 to 1/100) than the compression process, real-time processing can be easily realized.

Various digitalized multimedia information is presented by the media presenting section 2032 as a media output through screen display output and voice output.

Therefore, in this way, the electronic mail sent from the multimedia electronic mail creating / sending function 1 is temporarily stored in the media information storage unit 202, and the media information storage unit 202 stores the media information under a predetermined condition. The media information compression processing unit 204 compresses this and stores it again in the media information storage unit 202. Therefore, a large amount of e-mail can be efficiently stored in the media information storage unit, You can eliminate the lack of capacity. Further, since the compression process is performed only under a predetermined condition, the system operation will not be hindered even if an ordinary personal computer or the like is used, and stable system operation can always be realized. (Second Embodiment) FIG. 3 shows a schematic configuration of the second embodiment. Here, only the multimedia electronic mail reception / presentation function 2 in which the same parts as those in FIG. In this case, the remaining file information processing unit 205 is connected to the media information storage unit 202 together with the media information compression processing unit 204. In this case, the file remaining amount information processing unit 205 determines the file remaining amount (extra space).
Is to monitor.

In the second embodiment, generally, when the data compression degree is increased, the output information of images and voices becomes inferior in quality and is unsightly or unpleasant to listen to. Therefore, compression processing of media information is performed as much as possible. The feature is to delay and try to maintain the quality.

In this case, the remaining file information processing unit 205
Check the remaining capacity of the file by. This can be easily achieved by utilizing the functions of a normal computer operating system.

And, for example, 90% consumption (10 remaining
%), Or the absolute remaining file amount such as the remaining 150 MBytes, the remaining file amount information processing unit 2
When the judgment is made by 05, the media information is taken out from the media information storage unit 202, and the media information compression processing unit 204 executes the compression processing. In this case, the file remaining amount information processing unit 205 always checks the remaining space of the file, checks the mail information in the media information storage unit 202, and if there is a compressible multimedia mail, sends it to the media information compression processing unit 204. A command is issued to perform media information compression processing.

For example, in the case of audio media, CODEC
When the mail stored in step 1 is stored, the compression process is performed when the file remaining amount is, for example, 10%. The encoding method for compression at this time can reduce the file space by, for example, a method using Q-coder. (Third Embodiment) FIG. 4 shows a schematic configuration of the third embodiment. Here, only the multimedia electronic mail reception / presentation function 2 in which the same parts as those in FIG. In this case, the computation information processing unit 206 is connected to the media information storage unit 202 together with the media information compression processing unit 204. In this case, the calculation load information processing unit 206 monitors the calculation load information in the computer and detects a situation where the load of other programs and tasks is small.

In the third embodiment, if information compression processing is performed in a situation where a plurality of tasks and application programs are being executed, the processing of these plurality of tasks will be delayed. The processing load information is monitored by the processing unit 206, and when the processing load information processing unit 206 determines that the load of other programs or tasks is small, the media information compression processing unit 204 starts the compression processing.

In this way, the media information is compressed only at night or during lunch breaks or when there is a spare computing unit, so that the necessary storage space for multimedia mail is reduced without inconvenience to the user. Can be made. (Fourth Embodiment) FIG. 5 shows a schematic configuration of the fourth embodiment. Here, the same parts as those in FIG. 2 are designated by the same reference numerals.

In this case, the multimedia electronic mail creation / transmission function 1 has a media input unit 101, an electronic mail transmission unit 102, and a media information compression processing unit 103.

The media information compression processing unit 103 performs a process of, for example, determining the load state of the transmission side and compressing the information amount of the media information input from the media input 101, if necessary.

In the fourth embodiment, the multimedia electronic mail creation / transmission function 1 is provided with a function of compressing media information. That is, when the computing capacity of the computer is sufficient, the media information compression processing unit 103 compresses and encodes the media information, and the electronic mail transmission unit 1
It will be sent as an email from 02. In this case, compression-coded information may be added with compression type information indicating what kind of code has been performed, a decompression program necessary for decompression processing, and the like. At this time, it is also possible to send both the mail information by simple recording / playback encoding and the mail information after compression processing. This is an effective method when the computer power of the other party (reception side) computer is weak, or in the case of a system that does not consider the compression and expansion of mail.

In this way, the amount of transmission from the transmitting side to the network 3 is reduced, so that the efficiency of the network 3 can be improved, and moreover, a kind of encryption is performed on the electronic mail information by compression encoding. It is also possible to improve security.

On the other hand, the multimedia electronic mail reception / presentation function 2 can discard the compression-coded mail information at the time of reception in the case of duplicate quality or abundant computing power. On the contrary, when the remaining files are duplicated, the recording / playback type encoded media information close to the original medium is discarded to save the file. Further, even if compression coding is performed on the transmitting side, second and third compression coding on the receiving side, for example, LD-CELP or AD-CELP is performed.
(Proc.ICASSP pp29-32 "CELP
CUDING WITH AN ADAPTIVE D
ENSITY PULSE EXCITATION M
ODEL ″) makes it possible to save the file space. (Fifth Embodiment) FIG. 6 shows a schematic configuration of the fifth embodiment. Here, the same parts as those in FIG. Only the multimedia electronic mail reception / presentation function 2 marked with is shown, in which case the media information multistage compression processing unit 207 and the control unit 208 are connected to the media information storage unit 202.

In the fifth embodiment, the media information multistage compression processing section 207 enables the media information to be compressed in a plurality of stages. In this case, since the compression degree and the quality are inversely proportional, the condition check for the media information compression processing is performed and the information compression processing is performed according to the situation by using the method shown in FIGS. . That is,
Here, when the file space becomes more severe, higher-order compression can be performed to efficiently store a larger amount of e-mail. Regarding the compression processing here, compression methods of various bit rates have been proposed at present, and these can be used. (Sixth Embodiment) FIG. 7 shows a schematic configuration of the sixth embodiment. Here, only the multimedia electronic mail reception / presentation function 2 in which the same parts as those in FIG. In this case, the mail transmission / reception information management unit 209 is connected to the media information storage unit 202 together with the media information compression processing unit 204.

In the sixth embodiment, for the information that the user once accessed, for example, only text (screen display) was read due to the restriction of the computer when moving, or only the voice was read by accessing from the telephone. The history such as is recorded in the mail transmission / reception information management unit 209, and is used at the time of later re-access. In this case, manage the importance of the email, use the email from your boss or save version without using compression process, use friends or private, or perform the compression process on old email, or use multimedia information that has multimedia information. Try to cut off some media. Also,
For the important part of the mail, the most important part of the text part and the voice part is duplicated, and if the mail is sufficient for text information, discard the voice part, the person and the subject,
Only date, time and voice can be left and the others can be removed. In this way, the important part management of the mail can be re-accessed and re-searched, so its use is useful.

FIG. 8 is an example of a display interface showing a history of voice mail processing by the mail transmission / reception information management unit 209. In this display example, information is displayed, for example, in the case of erasing a voice mail that has been read once, in the case of compressing the voice part for 10 seconds from the beginning and discarding the remaining part. It also tries to show the user what compression was done, why and when. In addition, for stored versions of email that want to eliminate the deterioration of the original signal due to compression, add information that indicates that the email should not be compressed or specify the compression method when sending an email, or specify the compression method when receiving an email. It is also possible to specify.
The present invention is not limited to the above-mentioned embodiments, and can be implemented by appropriately modifying it without changing the gist.

[0035]

According to the present invention, the electronic mail sent from the multimedia electronic mail creating and transmitting function is temporarily stored in the media information storage unit, and the media information in the media information storage unit is stored in the media information storage unit under a predetermined condition. Since the information is compressed by the information compression processing unit and stored again in the media information storage unit, a large amount of e-mail can be efficiently stored in the media information storage unit and the lack of file capacity can be resolved. Further, since the compression process is performed only under a predetermined condition, the system operation will not be hindered even if an ordinary personal computer or the like is used, and stable system operation can always be realized.

[Brief description of drawings]

FIG. 1 is a diagram showing a schematic configuration of a first embodiment of the present invention.

FIG. 2 is a diagram showing a schematic configuration in which the first embodiment is concretely illustrated.

FIG. 3 is a diagram showing a schematic configuration of a second embodiment of the present invention.

FIG. 4 is a diagram showing a schematic configuration of a third embodiment of the present invention.

FIG. 5 is a diagram showing a schematic configuration of a fourth embodiment of the present invention.

FIG. 6 is a diagram showing a schematic configuration of a fifth embodiment of the present invention.

FIG. 7 is a diagram showing a schematic configuration of a sixth embodiment of the present invention.

FIG. 8 is a diagram showing an example of a display interface showing a history of voice mail processing by a mail transmission / reception information management unit of the sixth embodiment.

[Explanation of symbols]

1 ... Multimedia e-mail creation and transmission function, 101 ...
Media input unit, 102 ... E-mail transmission unit, 103 ...
Media information compression processing unit, 2 ... Multimedia e-mail reception / presentation function, 201 ... E-mail receiving unit, 202 ...
Media information storage unit, 203 ... Media output unit, 203
1 ... Media information decompression processing unit, 2032 ... Media presentation unit, 204 ... Media information compression processing unit, 205 ... File remaining amount information processing unit, 206 ... Calculation load information processing unit, 20
7 ... Media information multi-stage compression processing unit, 208 ... Control unit, 2
09 ... E-mail transmission / reception information management section, 3 ... Network.

─────────────────────────────────────────────────── ─── Continuation of the front page (72) Hideki Hashimoto, Inventor Hideki Hashimoto 1385 Shinmachi, Ome-shi, Tokyo Within Toshiba Software Engineering Co., Ltd. (56) Reference JP-A-3-136570 (JP, A) JP-A-3-276939 (JP, A) JP-A-4-342014 (JP, A) Actual development 5-4651 (JP, U) Japanese Patent Publication 5-35941 (JP, B2) (58) Fields investigated (Int.Cl. ⁷⁾ , DB name) H04L 12/58 100 G06F 13/00 610

Claims (2)

(57) [Claims] 1. Input means for inputting multimedia information, electronic mail sending means for sending the multimedia information input by the input means as an electronic mail, and receiving electronic mail sent by the electronic mail sending means. Electronic mail receiving means, a media information storage means for storing the electronic mail received by the electronic mail receiving means, a calculation load information processing means for monitoring a calculation load of a calculation processing part of the system, and the calculation load information processing Media information compression for executing compression processing on the multimedia information stored in the media information storage means based on the calculation load information from the means, and storing the compressed media information in the media information storage means again Processing means and compressed multimedia data stored in the media information storage means Multimedia electronic mail system for a media presentation unit for presenting to decompression processing the specified media information A information, characterized by comprising a. 2. The multimedia electronic mail system according to claim 1, wherein said media information compression processing means performs compression processing on said multimedia information in a plurality of stages.