RU2302703C2 - System for real-time transmission and reception of audio-video and scribal information - Google Patents

Abstract

FIELD: midget phones or electronic secretaries.

SUBSTANCE: proposed system enables user to pack, transfer, or save dynamic or static information such as video, audio, and scribal information from video display for other user through Internet. Upon receiving information package user can browse all pieces of information contained in mentioned package without addressing various application programs.

EFFECT: facilitated data exchange and message compilation, provision for preventing virus infection through e-mail.

27 cl, 8 dwg

Description

BACKGROUND OF THE INVENTION

Technical field

The present invention generally relates to the transmission and reception of information, more specifically, the invention relates to a system for transmitting and receiving static and dynamic information, such as audio, video and ink information in real time.

Description of the prior art

Despite technical progress, until recently, the most common means of communication was a telephone, allowing participants to communicate only voice information, or e-mail, which usually allows only text information to be exchanged. Telephone communication is convenient, but more expensive and allows you to transmit or receive only speech. At the same time, thanks to the ubiquity of the Internet, e-mail has gained wide popularity. Being much cheaper and capable of providing one-to-many messaging, email has become the predominant modern means of communication. However, e-mail is primarily designed to work with text, and any non-textual information can only be transmitted as an attachment. To transmit, receive and process non-textual information, the user must have a certain level of computer knowledge. In addition, typing a message on the keyboard is a burden for those who do not have English as their native language, and those who cannot type quickly.

Summary of the invention

The main objective of the present invention is to provide an easy-to-use system for transmitting and receiving static and dynamic information, such as audio, video, text and visual information in real time.

According to the present invention, the source and the format of the pieces of information to be processed are initially identified. Such formats are graphic, audio, video, handwritten information, etc. After identifying pieces of information, they are alternately encapsulated in the corresponding storage areas inside the information package. After processing all portions of information, the information package is stored and / or transmitted over the Internet to the recipient. After receiving the entire information package, the recipient can immediately view all portions of the information contained in the information package, without resorting to various application programs. Thus, in the present invention, the limitations of existing e-mail systems have been overcome, in which just to view the non-text information contained in the e-mail is required to type and own other application programs. According to the present invention, a user can read messages and reply to them with simple keystrokes.

Brief Description of the Drawings

1 is a flowchart illustrating a process for transmitting and receiving information according to the present invention,

figure 2 is a schematic representation of various sources of information according to the present invention,

figure 3 - schematic representation of the structure of the information package according to the present invention,

figure 4 - schematic representation of the information window prompts according to the present invention,

figure 5 - schematic representation of the imposed information windows prompt according to the present invention,

6-8 are flowcharts illustrating various execution sequences according to embodiments of the present invention.

Detailed Description of Preferred Embodiments

As shown in FIG. 1, which illustrates a flowchart of a process for transmitting and receiving information according to the present invention, the present invention has the following processing means.

A. Means 11 format identification, allowing the Central processor of a personal computer (or computer type "laptop") to identify the source and format of the portion of information after the receipt of such a portion of information in the computer. For static and dynamic information, all formats are possible, including video, graphic, audio, handwritten information, etc. A piece of information comes through the following various mechanisms, shown in figure 2:

a) a camera 111 installed on a personal computer (or a computer such as a "laptop"), with the help of which video or graphic information is collected;

b) a tablet (or mouse) 112 for handwriting data input connected to a personal computer (or a laptop computer), by which handwriting information is input when a user writes something on a tablet 112 for handwriting data input;

c) a microphone 113 connected to a personal computer (or a laptop computer) by which voice information is recorded, and

d) a video display 115, which captures the currently displayed still image or the currently playing video.

B. Tool 12 for generating an information packet, preparing an information packet 20 having several predetermined storage areas in a personal computer (or laptop) computer. As shown in FIG. 3, such areas include a destination information storage area 21, an image information storage area 22, an audio information storage area 23, a handwritten information storage area 24, a captured image storage area 25. The destination information storage area 21 may comprise a recipient address (such as an email address), a file access path, and a file name stored in a storage device or a recipient account identifier. The image information storage area 22 is used to store video or image information.

C. Encapsulation means 13 for storing a portion of information of a specific format identified by the format identification means in the corresponding storage area of the information packet.

D. A means 14 for transmitting information for transmission via an internal bus or the Internet of an information packet to a recipient indicated in a destination information storage area 21, such as an email address or an account identifier, or a file access path and file name.

E. Means 15 for receiving / viewing information for displaying a prompt information window 26 (shown in FIG. 4) in the form of an upper window on a video display 27 after receiving an information packet of a personal computer (or a laptop computer). The user can read the contents of the package by marking the info window 26 with the mouse, while the computer operating system will sequentially extract the information stored in each storage area of the package, and with the help of the multiplex player will display on the video display 27 all such information in accordance with its format.

FIG. 4 illustrates an embodiment of the above prompt information window 26. Another embodiment of the prompt information window 26 'is illustrated in FIG. 5, which shows a plurality of overlapped prompt information windows 26' on the video display 27. The prompt information window 26 or 26 'comprises at least:

- date and time 261 of receipt of the information package;

- information 262 about the sender indicating his name, name of the company (or organization), source of the information package, topic, etc .;

- information about the open state 263 indicating whether the contents of the information package have been previously opened and displayed;

- information about the level 264 messages indicating the level of importance of the information package, which may be ordinary, urgent or important;

- a window control key 265 to close the prompt information window 26; and

a window control key 266 for deleting the information packet.

Thus, after receiving the information package 20, the user sees on the video display 27 the corresponding information window 26 prompts and can find out who is its sender and what is the level of importance of its content. If the user wants to familiarize himself with the contents of the information package 20, he selects with the mouse the open state 263 of the help information window 26, after which the contents of the information package 20 will be displayed on the video display 27. If desired, the user can use the response tool to reply to the sender or send the contents to another person . In the process of reading the information package 20, the user can use the response tool to use a tablet for handwriting data input, a camera and a microphone installed on the computer to perform the above steps AE and save the content of the response in the information package 20 and transfer it to the original sender or another to the addressee.

According to the present invention, a user with the help of a camera, a tablet for handwriting data input and a microphone installed on a computer, can completely save the captured video and image, handwritten information written on a tablet for handwriting data input, etc. directly in the information package. Since the Internet is used to transmit the packet, for a person or company already having a broadband connection (such as an asymmetric digital subscriber line (ADSL) or a leased line), the costs will be very small.

Given the formats that support storage areas of the information packet, the present invention may have the following applications.

(1) If the information packet 20 consists only of the destination information storage area 21, the image information storage area 22 and the audio information storage area 23, the present invention can be implemented as a video / audio answering machine.

(2) If the information package 20 consists of a destination information storage area 21, an image information storage area 22, an audio information storage area 23, a handwriting information storage area 24 and a captured image storage area 25, the present invention can be implemented as an electronic information presentation system or documentation, including video, audio, and handwritten information.

(3) If the information package 20 consists only of the ink information storage area 24, the present invention can be implemented as an electronic “board” or electronic notebook.

Using the means described in the present invention, a system for transmitting and receiving information in real time can be created, the processing steps of which are illustrated in the flowchart shown in Fig.6. The system has three main functions: Function Zoo, M-Message and M-Writing, each of which is explained below.

Function zoo

Consider Fig.6. After starting the computer operating system, it automatically performs step 30, at which a real-time data transmission and reception system is initiated, and a user interface is displayed on the video display, as shown in Fig. 4. As for the Function Zoo function, it is used to annotate an existing piece of information using video, audio, and handwritten information. Thus, the user first opens an information window with information that he wants to annotate or provide comments. Then, in step 31, the user selects the desired function. If the user selected the Function Zoo function, step 32 is performed, in which the video (coming from the camera 111), sound (coming from the microphone 113) and handwritten information (entered through the tablet 112 for handwriting data input) are synchronously recorded. Upon completion of recording, the recorded content in step 35 is automatically displayed in the viewing window. At this point, the user may decide to print the contents of the viewport in step 351. Essentially, this is a screen capture function that allows the user to print the contents of any window displayed on the video display and / or save it as a file in step 40 and step 391. In other words, this function allows the user to capture any part of the video display and save it as a file, or save it along with video / audio explanations. Thus, a report or document of any kind can subsequently be viewed accompanied by a visual video / audio commentary. Then, the user can decide at step 36 to transfer the contents of the viewport in the information packet, for which the user selects the recipient from the address book. After selecting the destination, the system requests the topic of the information packet (as well as the importance level, etc.) and at step 38 transmits the packet. Then, the user can decide at step 39 to save the contents of the viewport as a file, which happens at step 391, otherwise the process ends at step 392.

Consider Fig.7. After the user initiates, at step 50, a real-time information transmission and reception system and receives an information packet, the system displays the prompt information window shown in FIG. 4 in step 51. The help information window is designed using various colors and styles depending on how the information package is formed (using Function Zoo, M-Message, etc.). The information window of the prompt contains the following information about the received information packet:

(a1) the date of formation and transmission of the information package;

(b1) the time of formation and transmission of the information packet;

(c1) a method for generating an information packet;

(d1) name of the sending company;

(e1) the name of the sender;

(f1) whether it is necessary to open an information package;

(g1) whether it is necessary to save the information packet;

(h1) whether it is necessary to delete the information packet;

(i1) level of importance of the information package;

(j1) information package topic.

The recipient can save the information packet in step 53, delete the information packet in step 54, or open the information packet in step 52. After the information package is opened for reading at step 52, the recipient has the following options:

(a) reply (at step 55) or forward the information packet (at step 56);

(b) after responding or forwarding the information packet in step 55 and step 56, remove the information packet in step 54;

(c) after responding or forwarding the information packet in step 55 and step 56, save the information packet in step 53;

(d) print the information packet in step 57;

(e) reproduce the information packet in step 58;

(f) remove the information packet in step 54; and

(g) save the information packet as a file in step 53.

If the recipient decides to respond or forward the information packet, the system automatically activates the development environment, which was used to form the information packet, as shown in Fig.6. For example, if the recipient decides to respond in step 55 of FIG. 7, then steps 32 or 33 of FIG. 6 are performed. If the recipient decides to forward the information packet in step 56 of FIG. 7, the original information packet is stored and step 34 of FIG. 6 is performed. Then the original information packet is sent along with the newly created explanations.

M-message

Refer again to Fig.6. After starting the computer operating system, it automatically performs step 30, on which a real-time data transmission and reception system is initiated and a user interface is displayed on the video display. Then, at step 31, the system awaits the user's decision to select the desired function. If the user selects the M-Message function, step 33 is performed, in which synchronous recording of video (coming from camera 111) and sound (coming from microphone 113) begins. Upon completion of recording, the recorded content in step 35 is automatically displayed in the viewing window. At this stage, the user can decide to save the contents of the viewport as a file in step 40. In other words, the M-Message function is similar to a tape recorder for recording your own video and voice as a file for later retrieval and access. Then, the user can decide at step 36 to transfer the contents of the viewport in the information packet, for which the user selects the recipient from the address book. After selecting the destination, the system requests the topic of the information packet (as well as the importance level, etc.) and at step 38 transmits the packet. Next, the user can decide at step 39 to save the contents of the viewport as a file, which happens at step 391, otherwise the process ends at step 392.

Similarly, after the recipient opens the information packet for reading at step 52, shown in FIG. 52, the following options are available to the recipient:

(a) reply (at step 55) or forward the information packet (at step 56);

(b) after responding or forwarding the information packet in step 55 and step 56, remove the information packet in step 54;

(c) after responding or forwarding the information packet in step 55 and step 56, save the information packet in step 53;

(d) print the information packet in step 57;

(e) reproduce the information packet in step 58;

(f) remove the information packet in step 54; and

(g) save the information packet as a file in step 53.

If the recipient decides to respond or forward the information packet, the system automatically activates the development environment, which was used to form the information packet, as shown in Fig.6. For example, if the recipient decides to respond in step 55 of FIG. 7, then steps 32 or 33 of FIG. 6 are performed. If the recipient decides to forward the information packet in step 56 of FIG. 7, the original information packet is stored and step 34 of FIG. 6 is performed. Then the original information packet is sent along with the newly created explanations.

M write

Consider Fig.6 and Fig.8. After starting the computer operating system, it automatically performs step 30, in which a real-time data transmission and reception system is initiated and a user interface according to the present invention is displayed on a video display. Then, at step 31, the system awaits the user's decision to select the desired function. If the user selects the M-Write function, step 34 is performed, at which writing of the handwritten information (entered through the tablet 112 for handwriting data input) begins. The details of step 34 are illustrated in FIG. 8, after which, at step 60, a handwritten information window is launched. Then, the user can decide to start a new record in step 66. If this decision is not made, in step 61 the user can find and open an existing record to change it. If, in step 62, the user presses the “new” key to start a new recording, the system starts recording the user's handwritten information on the tablet 112 for handwriting data input. At the end of the recording, the user can decide to print the handwritten information in step 64 or go to the Function Zoo function in step 65 to obtain synchronous recording of video, sound and handwritten information (in step 32, shown in FIG. 6) for combination with the newly created handwritten information. Upon completion of recording, the recorded content in step 35 is automatically displayed in the viewing window. At this stage, the user can decide to save the contents of the viewport as a file in step 391 and transfer it to the information packet in step 36. After selecting the destination, the system proceeds to step 38, where the packet is transmitted. Next, the user can decide in step 39 to save the contents of the viewport as a file. If such a decision is made, this occurs at step 391, otherwise the process ends at step 392.

Claims (27)

1. The system of real-time information exchange between computing devices over the Internet, including: format identification means allowing the central processor of the named computing device to identify the source and format of the piece of information after the receipt of such a piece of information in the named computing device, information packet forming means preparing an information packet having a plurality of predetermined storage areas in a storage device of said computing device, wherein such areas include a destination information storage area, an image information storage area, an audio information storage area, a handwritten information storage area, a captured storage area Images, encapsulation means for storing a portion of information of a certain format identified by the format identification means in the corresponding storage area of the information packet, means for transmitting information, which is used to transmit over the Internet an information package to the address specified in the storage area of information about the addressee, and means for receiving / viewing information, which is used to display the contents of each storage area of the information packet in the information window of the prompt in the form of an upper window on the video display after receiving such an information packet by a computing device, wherein the information window of the prompt contains at least: date and time of receipt of the information package, information about the sender indicating his name, company (or organization) name, source of information package and topic, information about the open state indicating whether the contents of the information package were previously opened and displayed, message level information indicating the importance level of the information packet, and a plurality of window control keys for closing and deleting a help information window. 2. The information exchange system according to claim 1, in which the named piece of information has one of the following formats: video, graphic, audio and handwritten information. 3. The information exchange system according to claim 1, in which the area of storage of information about the addressee contains the email address of the recipient. 4. The information exchange system according to claim 1, in which the destination information storage area comprises a file access path and a file name in a storage device. 5. The information exchange system according to claim 1, in which the area of storage of information about the addressee contains the identifier of the account of the recipient. 6. The information exchange system according to claim 1, in which the message can have one of the following levels: regular and urgent. 7. The information exchange system according to claim 1, in which the piece of information is graphic information received from a camera installed on a computing device. 8. The information exchange system according to claim 1, in which the piece of information is handwritten information received from a tablet or mouse for handwriting data input installed on a computing device. 9. The information exchange system according to claim 1, in which the piece of information is audio information received from a microphone installed on a computing device. 10. The information exchange system according to claim 1, in which the piece of information is a still image received from a video display connected to a computing device. 11. The information exchange system according to claim 1, further comprising an information display means for simultaneously displaying the contents of the entire information packet on a video display of a computing device. 12. The information exchange system according to claim 1, further comprising a reproducing means allowing the user to receive information from the camera, handwriting input tablet, microphone and video display and save the captured information in the information packet. 13. A system for exchanging real-time information between computing devices over the Internet, including: video / audio information capturing means for capturing a portion of audio information and a portion of video information from a video display of a computing device, information packet generating means for preparing an information packet having a plurality of predetermined storage areas in a memory of said computing device, wherein such areas include a destination information storage area, an image information storage area for storing said portion of video information, and an audio information storage area for storing said portions of audio information means for transmitting information, which is used to transmit over the Internet an information package to the address specified in the storage area of information about the addressee, and means for receiving / viewing information, which is used to display the contents of each storage area of the information packet in the information window of the prompt in the form of an upper window on the video display after receiving such an information packet by a computing device, wherein the information window of the prompt contains at least: date and time of receipt of the information package, information about the sender indicating his name, company (or organization) name, source of information package and topic, information about the open state indicating whether the contents of the information package were previously opened and displayed, message level information indicating the importance level of the information packet, and a plurality of window control keys for closing and deleting a help information window. 14. The information exchange system according to item 13, in which the area of storage of information about the addressee contains the email address of the recipient. 15. The information exchange system of claim 13, wherein the destination information storage area comprises a file access path and a file name in a storage device. 16. The information exchange system according to item 13, in which the area of storage of information about the addressee contains the identifier of the account of the recipient. 17. The information exchange system according to item 13, in which the message can have one of the following levels: regular and urgent. 18. The information exchange system according to claim 13, further comprising an information display means for simultaneously displaying the contents of the entire information packet on a video display of a computing device. 19. The information exchange system according to item 13, further comprising a playback means that allows the user to receive information from the camera, tablet for handwriting data input, microphone and video display and save the captured information in the information package. 20. A system for exchanging real-time information between computing devices over the Internet, including: video / audio information capturing means for capturing a portion of handwritten information from a video display of a computing device and recording captured image information from a current active window, information packet generating means for preparing an information packet having a plurality of predetermined storage areas in a memory of said computing device, wherein such areas include a destination information storage area, a handwritten information storage area for storing said portion of the handwritten information, and a captured image information storage area for storing the named portion of captured visual information, means for transmitting information, which is used to transmit over the Internet an information package to the address specified in the storage area of information about the addressee, and means for receiving / viewing information, which is used to display the contents of each storage area of the information packet in the information window of the prompt in the form of an upper window on the video display after receiving such an information packet by a computing device, wherein the information window of the prompt contains at least: date and time of receipt of the information package, information about the sender indicating his name, company (or organization) name, source of information package and topic, information about the open state indicating whether the contents of the information package were previously opened and displayed, message level information indicating the importance level of the information packet, and a plurality of window control keys for closing and deleting a help information window. 21. The information exchange system according to claim 20, in which the storage area of information about the addressee contains the email address of the recipient. 22. The information exchange system of claim 20, wherein the destination information storage area comprises a file access path and a file name in a storage device. 23. The information exchange system according to claim 20, in which the area of storage of information about the addressee contains the identifier of the account of the recipient. 24. The information exchange system according to claim 20, in which the message can have one of the following levels: regular and urgent. 25. The information exchange system according to claim 20, further comprising an information display means for simultaneously displaying the contents of the entire information packet on a video display of a computing device. 26. The information exchange system according to claim 20, further comprising a reproducing means allowing the user to receive information from the camera, handwriting input tablet, microphone and video display and save the captured information in the information packet. 27. The information exchange system according to claim 20, further comprising storing the contents of said information packet in the form of a file.

Images