UA104334C2 - Method and system of interactive mediatelecommunications - Google Patents

Abstract

A method and a system relate to telecommunication field and are meant for interactive mediatelecommunications between telecommunication devices of users, which are used for video-, audio- and text information with use of WEB-site of INTERNET resource, and/or multimedia information. According to the proposed method, packets of thread-specific data comprise video-and/or audio-, and/or multimedia information, while establishing communication channels through a packet network between server and at least two client computers, of a transmission protocol of video-and/or audio-, and/or text and/or multimedia information is performed. While processing a video stream by a server, recognition of commands and/or information of the corresponding client computer user is performed, the commands are given by action or facial expression via comparison of obtained video-data with patterns of action and/or facial expression library, which is stored on the server, and recoding the recognized commands and/or information into audio or text information with simultaneous thereof output to interface of at least one corresponding user of the client computer, participating in conference. While processing an audio stream by the server, recognition of commands and/or information of the corresponding client computer user is performed, commands are given with help of a sound and recoding of recognized commands and/or information into text information and performance of voice commands of at least one corresponding client computer user participating in conference are performed. While output of the received video- and/or audio- and and/or text information and/or multimedia data to interface of at least one client computer, on-line translation using a translator library is made, and simultaneous output of the translated information to interface of at least one corresponding user participating in conference is performed. The proposed invention provides the possibility to transmit and receive information of different protocols with adaptation of transmitted data and the increase of communication speed between users.

Description

user of the client computer submitted by means of sound and transcoding recognized commands and/or information into text information and execution of voice commands of at least one corresponding user of the client computer participating in the conference. When outputting received video and/or audio, and/or text, and/or multimedia data to the interface of at least one client computer on the server, online multilingual translation is performed using a library of translators with simultaneous output of the translated information to the interface of at least one corresponding user client computer participating in the conference. With the help of the proposed invention, it is possible to transmit and receive data of various protocols with adaptation of the transmitted data and the speed of communication between users is increased. : : : SHY and Shchi : 56 8910. : in BosrjeeK, Beoodnnia ni ik p pi kN | x : y and 5 of them. No and! : with i "japnnyzh nnyy in shk. v, 2 BU U

N ru of the day : : ! nY and shchi x : : them. and E i: x ki her E N; i : - i I IC. , : i OK ddvantenten A En m I i : 4. their khlaiazhkh plati ANSONI "lzhajkkhya in Z and N

Fig. 1

The present invention describes the operation of a method and system for providing interactive media telecommunication communication between telecommunication devices of users and can be used for simultaneous reception and transmission of video, audio and text information using the mayor page of an Internet resource and various types of communication. The invention provides flexibility in the provision of communication services regardless of the platforms used by users.

Thus, the scope of the proposed invention extends to all types of telecommunication communication services.

Using the Internet, it is currently possible to carry out communications (communication, exchange of information) in various formats. To transfer information over the Internet, the user usually runs a communication program that establishes a connection with other communication programs running on remote computers that are connected to the Internet. The specified standard communication programs use one or more communication protocols that are associated with the type of communication program. For example, a video communication application would use its own video communication protocol, and an interactive text dialog (chat) would use its own communication protocol. Different types of communication protocols are often specific to specific communication programs. Therefore, a text-based interactive dialog program taken from one application provider will not necessarily use the same interactive dialog protocol used by an application from another application provider. Such proprietary communications operating environments have led to countless different types of communications, and within those types of communications, countless different protocols to enable each type of communication.

Currently, various methods of providing communication services in communication networks are widely known.

A separate group is the so-called "text chats", which allow instant transmission of text messages.

Such applications are launched in a separate browser window, which in some circumstances causes difficulties in working with them. For example, when communicating in an open text chat window, the user must go to the site, copy the information and return to the chat window to send it. The user faces difficulty in finding the desired window, with an additional one

With switching between windows, which often makes work confusing and reduces the effectiveness of this type of communication.

The ISO interactive application is widely known and popular. ISO is a network protocol that provides instant sending and receiving of text messages, as well as an instant messaging program of the same name that implements this protocol. ISO) is a centralized instant messaging service using a protocol

O5SANK. The user of the service works with a client program (the so-called messenger), which is launched on a device connected to the Internet. The messenger connects to the server. Search and communication with other clients is carried out through the server, and the exchange of service data and messages between users can be carried out both through the server and without its participation (see per:/іК uliKireaia.огдлмики/СО). The main disadvantages of this application are that it needs to be installed on the client's computer, updated from time to time, and its functionality is limited to the transmission of text messages or graphic symbols - "emoticons".

Currently, the ZKure program is widely used - free software with a closed code that provides encrypted voice communication over the Internet between computers (MoIR), as well as paid services for calls to mobile and landline phones (see pIryikK.mikireadia. ogd/lmiki/5Kure). The program also allows you to make conference calls (up to 25 voice subscribers, including the initiator), video calls (including video conferences of up to 10 subscribers), and also provides the transmission of text messages (chat) and file transfer. It is possible to transfer the image from the monitor screen instead of the image from the web camera.

Unlike many other IR-telephony programs, 5Kure uses data transmission

P2P architecture. The directory of ZKure users is distributed among the computers of network users

ZKure, which allows the network to easily scale to very large sizes (currently more than 100 million users, 15-25 million online).

ZKure-chat allows you to arrange group chats, send "smileys", save history.

The usual features for IM chats are also provided - user profiles, status indicators (status), and so on. In addition, ZKure provides the ability to exchange files without size limits and with standard options of temporary stop of transfer and automatic recovery when connecting after a loss of connection or turning off the 5Kure program until the end of the file transfer. 60 The main disadvantages of this application are that users need to install it on their telecommunications device. In addition, this program is loaded in a separate window, which leads to inconvenience when using it, and to translate, for example, text information, you need to use an online translator or dictionaries.

A known method of holding conferences (Russian Patent No. 2293368, IPC SObE 15/16, NOM 3/56, publ. 02.10.2007), which includes the following stages: receiving sound signals from many endpoints; transmission of a sound signal to a common sound interface; selection of audio signals for further mixing, which is performed using the cross-conference database; mixing of selected sound signals; transmission of a mixed signal to at least one end point, and at least one participant can participate in two or more conferences. This method does not provide conferences with simultaneous translation of the language of communication and is limited only to the transmission of sound signals.

In addition, when conducting such conferences, participants cannot control the functions of conducting conferences with their gestures or facial expressions.

A known method for implementing multilingual conference communication (Patent RF Mo 2426247, IPC

НО4их 12/18, НО4М 7/15, НОМ 3/56, publ. 08/10/2011), which includes the stages at which, with the help of a multipoint control unit, the audio data transmitted from each of the conference communication terminals is received, the sound mixing process is carried out for the audio data from each of the conference communication terminals on different audio channels according to by language types and transmit the processed audio data to the conference terminals to which the respective languages are assigned, and the audio data in one language is processed in a single audio channel, in which the audio data received by the multipoint control unit contains the audio data transmitted to the multipoint control unit after processing languages of the conferencing site by the conferencing terminals, and/or audio data transmitted to the multipoint control unit after the translation terminal from the conferencing terminals translates the language of the conferencing site according to the audio data transmitted from the multipoint control unit and processes translated audio data The present invention uses multi-channel technology and therefore participants on each of the conference call sites can hear the speech in any desired language, thereby successfully avoiding useless language information, but this method does not provide translation in text format, thereby reducing the scope of use of this method. In addition, when conducting such

From conferences, participants cannot control conference functions with their gestures or facial expressions.

A known system for holding conferences (Russian Patent No. 2293368, IPC СОб6Е 15/16, НО-М 3/56, publ. 02.10.2007), which contains a multi-point control unit, including a control system for controlling two or more interconnected conferences, wherein the control system creates and/or updates a cross-conference database that includes selected connection parameters and selected connection states of each endpoint, and based on the cross-conference database controls the switching of signals from conference participants in a multi-point block management. This system does not provide conferences with simultaneous translation of the language of communication. In addition, when conducting such conferences, participants cannot control the conference functions with their gestures or facial expressions.

A known system for ensuring communication through a computer network (Patent 05 2008/0144603 JSC, IPC NO4iY 12/66, publ. 19.06.2008), which consists of a communication module included in an interactive application, in which the communication module adapted to establish real-time communication with a remote recipient and a media stream management module that is adapted to run outside of an application running in an interactive application. The media stream management module is adapted to transfer streaming data to (and from) a remote destination. The communication module is adapted to control the streaming media module by means of the Ipieg-Rhose55 Sottipisayop (IRS) mechanism. This patent discloses only the area of operation of the telecommunications application on the Adobe platform

Nia5y. The scope of this patent is limited to applications capable of directly connecting to remote 5IR devices. Accordingly, using this system, when trying to communicate with a specific user who may be in standby mode, the process of contacting the user requires the installation of a specific communication application program. Moreover, contact information must be re-entered for each individual communication program.

A well-known system for the implementation of multilingual conference communication (Patent RF Mo 2426247,

IPC NOIY 12/18, NOM 7/15, NO4M 3/56, publ. 08/10/2011), which includes conference communication terminals (TCZ) and multipoint control unit (MCU). Conferencing terminals are capable of transmitting the language of the conference site after processing at the multipoint control unit 60, processing the audio data received from the multipoint control unit, and outputting them.

At least one of the conferencing terminals is a translation terminal capable of translating the language of the conferencing site according to the audio data transmitted from the multipoint control unit, processing the translated audio data, and transmitting the processed audio data to the multipoint control unit, wherein the multipoint control unit performs the audio mixing process for the audio data from the conference terminals on different audio channels according to the language types and then transmits the audio data after the audio mixing process to the conference terminals. In this invention, multi-channel technology is used, and therefore the participants at each of the conferencing sites can hear the speech in any desired language, thereby successfully avoiding useless language information, but this system does not provide translation in text format, thereby reducing the scope of use of this systems.

Also, in cases where participants are located in different countries, there are situations of incompatibility of information systems and data on language selection does not enter the corresponding device or due to other transmission problems, for example, overloading of communication lines or due to the difference in time zones. In these cases, the system does not provide simultaneous translation of speeches.

The application selected as a prototype (M/O/2008/018065 IPC СО6Е 15/16, publication date 02/14/2008) is known, which describes the method of conducting video communication over IR networks. This application describes a method that includes: establishing communication channels over a packet network between a server and a plurality of client computers participating in video-teleconferences; receiving on the server from client computers upstream audio and video packets, which respectively contain audio and video data received by each of the client computers; mixing audio data from audio outgoing packets to the server so as to create appropriate streams of mixed audio data for transmission to client computers; transmission from the server to client computers of downstream audio packets containing relevant streams of mixed audio data, transmission of video data from the server to client computers in downstream video packets; receiving and synchronizing video data with mixed audio data on client computers, as well as outputting synchronized video and mixed audio data on each of the client computers

From the respective user's computers.

When using this method, data is not translated between users. Also, this method does not provide for the provision of simultaneous communication services in video, audio and text formats using existing channels and means of communication. In addition, when conducting such video conferences, participants cannot control the conference functions with their gestures, facial expressions or voice.

The application chosen as a prototype (ММО/2008/018065 МПК СОбЕ 15/16, publication date 02/14/2008) is known, which describes the system of conducting video communication over IR networks. The system, which is described in the prototype, includes a plurality of client computers participating in video-teleconferences, which are combined into a packet network and configured in such a way to receive audio and video information and transmit audio and video packets through the packet network. which respectively contain audio and video information and a conference server which is connected via a packet network to client computers participating in the video conference and receiving audio and video packets through the communication channels, and which is configured to mix the audio data of the upstream packets so that to create the respective mixed audio streams for transmission to client computers containing the respective mixed audio streams and to relay video data from the upstream video streams to the client computers of the downstream video packets, the client computers being configured to synchronize the video data with the mixed audio data and to output of synchronized and mixed data to the corresponding user interface client computer.

This decision does not allow the creation of a telecommunications system for receiving and transmitting video, audio and text data in real time using existing channels and means of communication, involving an unlimited number of users. In addition, when conducting such video conferences, participants cannot control the conference functions with their gestures, facial expressions or voice.

The invention is based on the task of creating such a method, in which due to the proposed implementation of the sequence of operations during the provision of interactive media telecommunication communication, the possibility of transmitting and receiving data of various protocols is achieved with the adaptation of the transmitted data to the corresponding user of the telecommunication device, and fast communication is carried out between users through the erbo page of the Internet resource using existing channels and means of communication to ensure the recognition of commands given using gestures, facial expressions or voice and multilingual translation of received and sent data.

The task is solved by the fact that in a known method of interactive media telecommunications, which includes: establishing communication channels over a packet network between the server and at least two client computers that participate in video conferences using a data transfer protocol; receiving packets on the server from the client computers, which respectively contain streaming data received by each of the client computers; mixing streaming data packets to the server to create appropriate mixed data streams for transmission to client computers; transfer from the server to the client computers of packets containing the corresponding streams of mixed data; receiving and synchronizing streaming data to client computers, as well as outputting synchronized streaming data to the corresponding user interface of each of the client computers with quality control of received streaming data, according to the invention streaming data packages include video and/or audio, and /or text, and/or multimedia information, and during the establishment of communication channels over a packet network between the server and at least two client computers, recognition of the video and/or audio, and/or text, and/or transmission protocol is carried out multimedia data, and when processing the video stream by the server, recognition of commands and/or information of the corresponding user of the client computer given by performing gestures and/or facial expressions is performed by comparing the received video data with the templates of the library of gestures and/or facial expressions stored on the server, and transcoding recognized commands and/or information into audio and/or text information with simultaneous output by connecting it to the interface of at least one corresponding user of the client computer participating in the conference or watching the broadcast, and during the processing of the audio stream by the server, the commands and/or information of the corresponding user of the client computer are recognized using sound and recoding of the recognized commands and/ or information into text information and execution of voice commands by at least one corresponding user of the client computer participating in a conference or watching a broadcast, and before accepting synchronized video and/or audio, and/or text, and/or multimedia data on interface of the corresponding user of each of the client computers participating in the conference, on the server they measure the bandwidth of the data transmission protocol channel and, if necessary, change the quality of streaming data, and when outputting the received video and/or audio, and/or text and/or multimedia data to the interface at least one client computer on the server performs online multilingual translation using a library of translators with simultaneous output of the translated information to the interface of at least one corresponding user of the client computer participating in the conference.

In addition, reception, conversion, further transport of streaming data and retransmission are carried out to at least one type of telecommunication device of the user, which works on signaling protocols and data transfer protocols, on at least one streaming data network and on at least one protocol.

In addition, the method provides that the initiator or end node of the communication sessions for the transmission of streaming data packets are user applications that are launched by users from the user's telecommunication device on a platform that implements support for this type of applications on the user's telecommunication device.

In addition, the method provides that the initiator or end node of the communication sessions for the transmission of streaming data packets are ware-oriented applications that provide users with the opportunity to use telecommunications communication services and carry out streaming data transmission, and the start of the user's ware application is carried out in the environment within the browser and/or outside of it.

In addition, the method provides that the initiator or end node of communication sessions for transmission of streaming data packets is an application, which is at least one element from the ware applications of the corresponding user participating in the conference, and is an e-mail application and/or an application for file sharing and/or an application for managing communication sessions and/or an application for managing corporate networks and/or an application for information processing.

In addition, before the establishment of communication channels, transmission and delivery of streaming data, the server makes a decision on the admissibility or prohibition of the transmission of streaming data, the duration of the transmission session and the end of the session.

In addition, when receiving streaming data packets from client computers on the server, user personalization, recording, saving and archiving of communication sessions are carried out.

In addition, when receiving, converting and further transporting streaming data and/or signaling messages on the server from client computers, restrictions are imposed on at least one data transmission protocol and/or on at least one data transmission network.

Also, this method allows users to control their mzher application or other telecommunication device using gestures or facial expressions, and also to transmit certain information that is shown using gestures or facial expressions to another user participating in a conference or watching a broadcast. Such use of the method allows people with impaired health functions, such as, for example, deafness or muteness to communicate, transfer information, pay for services, etc.

Another advantage of the proposed method is that during the processing of the audio stream by the server, the commands and/or information of the corresponding user of the client computer are recognized using sound, and the recognized commands and/or information are recoded into text information and the voice commands of one of the corresponding users of the client computer are performed. a computer participating in a conference or watching a broadcast. So, for example, this method provides communication between people, one category of which has visual impairment.

The invention is based on the task of expanding the capabilities of modern computer and telecommunication systems by implementing the technology of automatic recognition of the transmission protocol and acceptance of video and/or audio and/or text and/or multimedia data, which allows for rapid communication between users through browser page of the Internet resource using existing channels and means of communication, to ensure recognition of commands given by users using gestures, facial expressions or voice and to provide users

With multilingual translation of received and sent data, which leads to the involvement of users with limited abilities and health defects in telecommunications.

The problem is solved by the fact that in a known system of interactive media telecommunications, which includes a server and at least two client computers connected by a packet network, which take part in a video conference using a data transfer protocol, and the server is configured to receive from client computers of packets that respectively contain the stream data received by each of the client computers and mixing the stream data packets in such a way as to create corresponding streams of mixed data for transmission to the client computers and transmit to the client computers packets containing the respective streams of mixed data, and the interface of the corresponding user of each of the client computers is made with the ability to receive and output synchronized streaming data from the server with quality control of the received streaming data, according to the invention, the server is additionally configured to receive streaming data that includes video and/or audio, and/or text, and/ or multimedia information and for the recognition of the video and/or audio, and/or text, and/or multimedia data transmission protocol, and the system additionally contains the following combined elements located on the server: a library of gesture templates and/or facial expressions, which connected to the interface of at least one corresponding user of the client computer participating in the conference or watching the broadcast, means for recognizing the commands and/or information of the corresponding user of the client computer provided by means of sound and transcoding the recognized commands and/or information into text information , which is connected to the interface of at least one corresponding user of the client computer participating in the conference or watching the broadcast, executing voice commands of at least one corresponding user of the client computer participating in the conference or watching the broadcast, measuring the bandwidth of the channel data transfer protocol and, if necessary, implemented changing the quality of streaming data, and a library of multilingual translators, which is connected to the interface of at least one corresponding user of the client computer participating in the conference, and with a means of outputting the translated information to the interface of at least one corresponding user of the client computer, which takes part in the conference.

In addition, the system includes: a media module, which measures the bandwidth of the channel and, if necessary, changes the quality of the video and outputs synchronized stream data to the corresponding user interface of each of the client computers participating in the conference, a transport module, which performs reception, conversion and further transport of streaming data to the user's telecommunications devices over data transmission networks using a specific protocol, the accounting module that makes a decision on the admissibility or prohibition of the transmission of streaming data, the duration of the transmission session and the end of the session, and the media module and the transport module are connected by control logic with accounting module.

Setting the server of this system to accept streaming data, including video and/or audio, and/or text, or multimedia information and to recognize the protocol for the transmission of video and/or audio, and/or text, and/or multimedia data enables users to communicate in any format without resorting to other application programs.

The essence of the invention is explained by the drawings, where Fig. 1 schematically presents the main parts of the proposed system of media telecommunications, in Fig. 2 presents a schematic diagram of the proposed method and system of media telecommunication communication, on

Fig. With are presented examples of the implementation of the constituent elements of this method and system, and on

Fig. 4A, fig. 4B, Fig. 4C and Fig. 40 presents options for using accounting module 13.

The media telecommunications system includes a server 2 connected by a packet network 1 and at least two client computers 3 that participate in a video conference using a data transfer protocol, and the server 2 is configured to receive from the client computers Z packets that, respectively containing the stream data received by each of the client computers C and mixing the stream data packets in such a way as to create corresponding streams of mixed data for transmission to the client computers C and transmitting to the client computers C the packets containing the corresponding streams of mixed data , moreover

The interface 4 of the corresponding user of each of the client computers Z is made with the ability to receive and output synchronized streaming data from the server 2 with quality control of the received streaming data. Server 2 is additionally configured to receive streaming data including video and/or audio and/or text and/or multimedia information and to recognize the video and/or audio and/or text and/or transmission protocol multimedia data, and the additional system contains the following elements combined, which are located on the server: 5 - a library of gesture and/or facial expressions templates, which is connected to the interface 4 of at least one corresponding user of the client computer 3 participating in the conference, b - means for recognizing the commands and/or information of the corresponding user of the client computer From the given by means of sound and recoding the recognized commands and/or information into text information, which are connected to the interface 4 of at least one corresponding user of the participating client computer in the conference, 7 - means of executing voice commands of at least one corresponding user of the client computer 3 participating in the conference, 8 - means of measuring of the bandwidth of the data transmission protocol channel and which, if necessary, change the quality of streaming data, 9 - a library of multilingual translators, which is connected to the interface 4 of at least one corresponding user of the client computer 3, participating in the conference, 10 - tools output of the translated information to the interface 4 of at least one corresponding user of the client computer 3 participating in the conference.

Also, the proposed system includes (see Fig. 2): 11 - a media module that measures the bandwidth of the channel and, if necessary, changes the video quality and outputs synchronized stream data to the interface 4 of the corresponding user of each of the participating client computers 3 in the conference, 12 - the transport module, which receives, converts and further transports streaming data to the user's telecommunications devices via data transmission networks using a certain protocol, 13 - the accounting module, which makes a decision on the admissibility or prohibition of the transmission of streaming data, the duration transmission session and the end of the session, and the media module 11 and the transport module 12 are connected by the control logic to the accounting module 13.

For the organization of this system of media telecommunications, the presence of two main logical components is required (see Fig. 2). These are the accounting module 13 and the transport module 12. To ensure compatibility with the platforms of some mayor applications 14, the media module 11 is used. The listed modules are independent of physical location. The entire system as a whole or its separate parts can be implemented both on one and on a group of servers. Modules are software and hardware products located locally or remotely from each other (for example, using servers or services of communication service providers).

In the event that the mer-application platform 14 is limited by the need to use the media module 11, it receives streaming data from the mer-applications launched by users for further processing and transmission to the transport module 12. At this stage, the transmitted data can be converted for proper interaction connections between transport 12 and media modules 11.

The transport module 12 organizes the delivery of streaming data to users of other telecommunication communication networks 15 in the format required for transmission. In the same way, users of other communication networks can organize the transmission of streaming data to users of uger applications.

The accounting module 13 can contain information about the communication tariffs that are intended for the user, accounts, statistical data and other information. Coordinated operation of the accounting module 13 with other modules of the system allows the system to make decisions about the admissibility or prohibition of data transmission, the duration of the transmission session and the end of the session.

Data transfer using the proposed method and system is carried out as follows.

The initiator or end point of streaming data can be: - shared applications launched by users on a platform that implements support for this type of applications on a personal computer, mobile or other communication device; - a telecommunications device connected to the Internet; - the device is connected to other streaming data networks.

The MMer-application 14 performs for users the reception and delivery of stream data to the transport module 12. When using the MMer-applications 14, whose platforms impose restrictions on the transmission formats of streaming data, the reception and delivery of streams is carried out through the media module 11.

To implement communication sessions, the media module 11 exchanges streaming data with the transport module 12. In order to facilitate the transmission of streaming data between the system modules, the data can be reduced to a common transmission format (protocol, codec), encoded or otherwise changed.

Transport module 12 performs end-to-end data transfer to other communication networks. For each separate communication network, the transport module 12 converts stream data into the required format.

In Fig. 3 presents examples of implementation of the constituent elements of this method. 16 - one of the initiators or end nodes of the communication session of streaming data packets are mayor-oriented applications that provide users with the opportunity to use telecommunication communication services. Some platforms limit the number of supported streaming data protocols, such applications work with the media module 11, others directly with the transport module 12. The platform for implementing such mer-applications can be: Adobe Riahp (through the media module), Misgozoi 5iimepidni (through the media module), Zy! ip Udama,

Misgozoi Asiimekh and any other that allows applications to stream data.

It is possible that the zhmer-applications based on several platforms will be used. 17 - a platform that allows you to launch the user's telecommunications mzher application in the browser environment and/or outside of it. The listed platforms are supported in mer-browsers: Ipiegpei Ehriogeg, Mo2ia Rigetoh, Orega, Arrie Zaiagi, Soodie

SPpgote, Meizzare Mamidaig, Satipo, Kopdiegog and any others. The platform supports this type of applications on a personal computer, mobile or any other communication device. The ware-application platform ensures the launch of the mer-application in the ware-browser environment, from the operating system. 18 - one of the initiators or end nodes of a communication session is telecommunication equipment that works on signal protocols and media data transmission protocols, such as 5IR, IAX2,

НЗ23, EТР (and any other streaming data and signaling protocols). These devices can be telephones, videophones, MOIR gateways, video cameras, broadcast systems and any other hardware and software telecommunications devices. 19 - one of the initiators or end nodes of the communication session are the clients of the telecommunications communication networks present on the Internet (for the transmission of streaming data and signaling messages), such as: ZKure, Soodie TaiYIK, Siayato, IOM Mezzepdeg, Manoo IM, dipaie - UCHhabbeg, ISO and any other streaming Internet networks - communication and transfer of instant applications. 20 - one of the initiators or end nodes of the communication session are users of other telecommunication communication networks, such as ROZTM (public telephone network), mobile cellular communication networks (00, 10, 26, 2.756, 36, 3.50, 3.756, 4c) and any other streaming data networks.

The method allows the exclusion from its scheme of some links (Fig. 3), which can be one of the initiators of a communication session or be the end node of data transmission. Excluding a link from the scheme leads to the absence of media data transport in its direction, without affecting the performance of other directions and nodes. This allows you to build a flexible telecommunications system according to the given requirements.

In Fig. 4A, Fig. 4B, fig. 4C and Fig. 40 presents options for using accounting module 13.

The method assumes that the accounting module 13 plays an important role in the management of communication sessions and their regulation.

Accounting module 13 can contain information about communication tariffs, user accounts, statistical data and other information.

Coordinated operation of the accounting module 13 with other modules of the system allows the system to make decisions about the admissibility or prohibition of data transmission, the duration of the transmission session and the end of the session.

It can be seen from the general scheme of the method that one of the most important subsystems for making decisions about the transport of media data is the accounting module 13. Interaction with it is mandatory.

It is permissible to use one accounting module 13 or more. Thus, at least one transport 12 or media module 11 (or each of them) must contact the accounting module 13 to make decisions about the possibility of further transport of streaming data, including video and/or audio and/or text and/or multimedia data.

Possible applications of the accounting module 13 are shown in Fig. 4A, Fig. 4B, Fig. 4C and

Fig. 40.

In Fig. 4A shows the general scheme of calls to the accounting module by other modules of the system to make decisions about the admissibility or prohibition of data transfer, the duration of the session

From the transfer and the end of the session.

In Fig. 48 shows the possibility of using several accounting modules (or other systems that perform the same functions), and which are located locally or remotely from each other (for example, using servers or services of communication service providers).

In Fig. 4C shows the regulation of communication sessions, which is performed by addressing the media module 11 to the accounting module 13.

In Fig. 40 shows the regulation of communication sessions, which is performed by addressing the transport module 12 to the accounting module 13.

According to the inventive concept, the proposed method and system of media telecommunication communication is implemented on the functioning of interactive applications that allow quick communication between users through the Internet page of the resource using various types of communication. This application works in the browser within the mer-page on which it was launched.

The application does not require installation and starts working immediately after launch (for example, after pressing the "mouse" button). Also, this application allows you to organize communication between interested users, for example, between the operator of the online store and the buyer, or between the user of the service and the customer support center . The application can combine one or more different types of communication, depending on the technical capabilities of the application users. Yes, the declared types of communication are: text chat, for exchanging text messages between people; voice communication, video conference, file transfer. Also, applications can support transport to other information networks and communication environments, such as: Internet pagers (diaikK, 5Kure, isd, iabregait and others), telephone networks (5ir, reip, mobile networks). The application is expanded with additional functions: payment via the Internet, entering statistics, filling out personal user questionnaires, recording and storing communication sessions, automatic online multilingual translation in text chat and/or video/voice formats, managing the work of pages with the help of gestures performed by the user of a telecommunications device equipped with a video camera, controlling the work of the website using voice, and the greatest advantage of this technical solution is the possibility of communication between users and the provision of services by operators of online resources in the event that, for example, one of the users has limited abilities (has visual, hearing and voice impairments).

The following are examples of the use of the proposed invention, which increase the quality of media telecommunication services.

Example 1

The interactive application window opens directly in the browser window on top of the site the visitor is on. The user has the ability to move the window inside the browser, change its size, open it to the entire screen and return it to its original position. At the same time, the visitor does not need to switch between browser windows, he remains on the site all the time, thereby not being distracted from the main purpose of visiting the resource. If technically the user's browser does not allow to do so, then the application will be opened in a separate window.

Example 2

The offered interactive applications have built-in file sharing capabilities. This advantage is important when using applications for online business. In the framework of business, any agreement must be documented, and the function of fast and secure file exchange is an opportunity to accelerate the period of contractual relations as much as possible. For example, in the case when the owner of a website needs to send any documents (contracts, invoices, etc.) to a potential customer (site visitor), then using the proposed application, he will send these documents to the customer without leaving the application window. This function is also used by ordinary Internet users who place an interactive application on their blog or other Internet resource. Users transfer photos or other files without having to store them online, as data storage is usually a paid service for any service.

Example C

Using this application allows users to communicate using voice communication. Nowadays, almost every computer is equipped with a built-in microphone or has a headset (headphones with a microphone). The quality of voice communication is clearly higher than any text analogue. The ability to voice your questions directly in the communication session and receive a competent answer to them without the need to enter text and install additional programs on the computer, directly from the website - the main need of the visitors. The owner of the Internet resource receives a tool that will allow him to focus on a specific customer/client,

By conveying information in such a way as to increase the purchasing functions of your product. This format of communications will not be replaced by text analogues.

Example 4

The proposed interactive applications provide video communication capabilities. By simply and quickly launching the application directly from the resource page, the visitor starts a video conference with the operator. The video communication format "brings closer" the distance between the site visitor and the customer, allowing consultations and/or sales to be carried out in more detail and more objectively. For example, the operator can demonstrate the product in action and, seeing the reaction of the potential buyer, focus on certain features of the product.

Example 5

Using interactive applications on its own web resource, the company not only raises the level of customer service, but also leads to an increase in new customers, increases sales and significantly saves on communication costs. A company can use interactive applications internally to provide its own corporate communications. For example, conducting negotiations between departments that are at a significant geographical distance.

Example 6

The online store receives a tool with which it brings the buyer and the seller as close as possible to the transaction. Thus, it minimizes time and material costs, both on its part and on the part of the buyer. A visitor to the online store can open the application at any time and get a quick answer to questions related to the product being purchased. Different communication formats allow to increase the level of customer service: through a video conference, the buyer can familiarize himself with the nuances of the product's operation and visually feel it, voice communication will allow the seller to make a broad presentation of the product, taking into account the buyer's needs, text chat allows to serve the user - the customer even in the absence of a video camera or headset. File transfer is a convenient document management tool that allows you to send product passports, presentation booklets and invoices to the customer, as well as receive completed documents from the customer.

Example 7

Now blogs are not just a personal diary on the Internet, but a full-fledged environment for self-expression, recreation and business. Offered interactive applications 60 will help to always be in touch without being tied to the same computer, as well as without installing many means of communication, such as Internet pagers, by adding built-in U/ER applications based on this method to your blog page. An active Internet user receives two-way communication with his readers at any time, even without being on the Internet. At the same time, neither the blog owner nor blog visitors need to install additional programs, they can even be registered in different

Internet pagers (for example, one in 5Kure, another in is4). The application itself, transparently for the user, will send messages from the network of one Internet pager (for example, 5Kure) to users of other networks (for example, ISD/DiaIK). If the owner of the blog is not online (offline), it is just as easy to contact him through the voice communication of the application, which will automatically call his mobile phone.

Example 8

Directly from the website of the consulting company, interactive applications for consulting are available to clients. After opening it and selecting the required heading, a trained specialist of the company is called, who can immediately conduct a consultation on the issues that have arisen using file transfer, transfer the necessary documents and/or presentations during communication. Using applications built on the basis of this method, consulting companies can conduct trainings and seminars by sending invitations to clients' e-mail addresses with a start time and an Internet link in advance. Users can pay for consultation services directly from the application.

Example 9

Recruitment agencies have large expenditure items for recruitment, calling them, conducting interviews in the agency's office. Interactive applications built on the basis of this method allow you to conduct online video interviews directly from the PG agency website, and transfer the saved interview recording to the customer along with the work report.

Example 10

Applications created on the basis of this invention are aimed at increasing the efficiency of communications in telecommunication networks. For example, it is known that the worldwide Internet is multilingual, so the possibility of serving visitors who speak other languages is in great demand. In these applications, multilingualism can be available in several formats: c

From a text chat, when messages are transparently translated between the language of the visitor and the operator of the resource, and in video-lolos formats, when the translation is carried out by a running line or a background translator who has knowledge of the translation between the language of the visitor and the operator of the resource. In any of the options for using multilingual capabilities, they are transparent to users. The application interface automatically selects the language that will be most convenient for the user.

Example 11

The proposed interactive applications include the possibility of connecting to the telephone system. After connecting telephony to the application, advanced voice communication options become available. The user starts a voice call, and the application connects him to an operator who dials the specified phone number. In the event that the user does not have the technical means for live communication (voice or video), he enters the number to call, and the application connects users with the operator of the uger resource, who dials the specified phone number. At the user's request, the application sets call forwarding to the user's mobile or landline phone numbers. Example 12.

Using the proposed interactive application allows you to pay for services/goods, transfer funds, etc. being on the mzher page where this application is downloaded.

Example 13

The use of the proposed interactive application makes it possible to conduct multiple conferences (voice and/or video). Regardless of where the interactive application is used, whether for customer service or for internal company needs, this application allows you to communicate with several people at the same time. This function is very interesting and important, as it allows you to organize meetings or offer clients a new service format - online consultations, trainings, seminars via the Internet.

Claims (10)

FORMULA OF THE INVENTION 1. A method of interactive media telecommunication communication, which includes: establishing communication channels over a packet network between the server and at least two client computers that participate in video conferences using a data transfer protocol; receiving packets on the server from the client computers, which respectively contain streaming data received by each of the client computers; mixing streaming data packets to the server to create appropriate mixed data streams for transmission to client computers; transfer from the server to the client computers of packets containing the corresponding streams of mixed data; receiving and synchronizing streaming data to client computers, as well as outputting synchronized streaming data to the corresponding user interface of each of the client computers with quality control of the received streaming data, which is distinguished by the fact that streaming data packets include video and/or audio -, and/or text, and/or multimedia information, and during the establishment of communication channels over a packet network between the server and at least two client computers, they perform video and/or audio, and/or text transmission protocol recognition, and/or multimedia data, and during the processing of the video stream by the server, the commands and/or information of the corresponding user of the client computer given by performing gestures and/or facial expressions are recognized by comparing the received video data with the templates of the library of gestures and/or facial expressions stored on the server , and recoding recognized commands and/or information into audio and/or text information from one by immediately outputting it to the interface of at least one corresponding user of the client computer participating in the conference, and during the processing of the audio stream by the server, recognition of commands and/or information from the corresponding user of the client computer given using sound and recoding of the recognized commands and/or information into text information and the execution of voice commands of at least one corresponding user of the client computer participating in the conference, and before accepting synchronized video and/or audio, and/or text, and/or multimedia data on the interface of each corresponding user from client computers participating in the conference, on the server they measure the bandwidth of the data transfer protocol channel and, if necessary, change the quality of streaming data, and when outputting received video and/or audio, and/or text, and/ or multimedia data to the interface of at least one client computer era on the server perform online multilingual translation using a library of translators with simultaneous output of the translated information to the interface of at least one corresponding user of the client computer participating in the conference. 2. The method according to claim 1, which is characterized by the fact that the reception, conversion and subsequent transport of streaming data is carried out to at least one type of telecommunication device of the user, which works on signaling protocols and data transfer protocols, on at least one streaming data network and on at least one protocol 3. The method according to claim 1 or 2, which differs in that it provides that the initiator or the end node of communication sessions for the transmission of streaming data packets are mer-applications that are launched by users from the user's telecommunication device on a platform that implements support for this type of applications on the user's telecommunications device. 4. The method according to any one of claims 1-3, which is characterized by the fact that it provides that the initiator or end node of the communication sessions for the transmission of streaming data packets are mer-oriented applications that provide users with the opportunity to use telecommunication communication services and to transmit streaming data, and the user's application is launched in the user's browser environment and/or outside of it. 5. The method according to any one of claims 1-4, which is characterized by the fact that it provides that the initiator or end node of the communication sessions for the transmission of streaming data packets is an application that is at least one element from the host applications of the corresponding receiving user conference participation, and is an e-mail application and/or a file sharing application and/or an application for managing communication sessions and/or an application for managing corporate networks and/or an application for information processing. 6. The method according to any one of claims 1-5, which is characterized by the fact that before the establishment of communication channels, transmission and delivery of streaming data, the server makes a decision on the admissibility or prohibition of the transmission of streaming data, the duration of the transmission session and the end of the session. 7. The method according to any one of claims 1-6, which differs in that when the server receives stream data packets from client computers, user personalization, recording, saving and archiving of the communication sessions are carried out. 8. The method according to any of claims 1-7, which is characterized by the fact that when receiving, converting and further transporting streaming data and/or signal messages on the server from client computers, restrictions are made according to at least one data transfer protocol and/or on at least one data transmission network. 9. A system of interactive media telecommunication communication, which includes a server connected by a packet network and at least two client computers that take part in a video conference using a data transfer protocol, and the server is configured to receive packets from the client computers, which, respectively containing stream data received by each of the client computers and mixing the stream data packets so as to create corresponding mixed data streams for transmission to the client computers and transmitting to the client computers packets containing the corresponding mixed data streams, wherein the interface of the corresponding user of each of the client computers is made with the ability to receive and output synchronized streaming data from the server with quality control of the received streaming data, which is characterized by the fact that the server is additionally configured to receive streaming data, including video and/or audio, and/or text and/or multimedia information and on recognition of the video and/or audio, and/or text, and/or multimedia data transfer protocol, and the system additionally contains the following elements, which are located on the server: a library of gesture templates and/or facial expressions, which is connected to the interface at least one corresponding user of the client computer participating in the conference, by means of recognizing the commands and/or information of the corresponding user of the client computer given by means of sound and transcoding the recognized commands and/or information into text information, which is connected to the interface at least one corresponding user of the client computer participating in the conference, means for executing voice commands of at least one corresponding user of the client computer participating in the conference, means for measuring the bandwidth of the data transmission protocol channel and, if necessary, changing the quality of streaming data , and a library of multilingual translators that is linked to the interface of at least one corresponding user of the client computer participating in the conference, and with a means of outputting the translated information to the interface of at least one corresponding user of the client computer participating in the conference. 10. The system according to claim 9, which is characterized by the fact that the system contains a media module that measures the bandwidth of the channel and, if necessary, changes the quality of the video and outputs synchronized stream data to the corresponding user interface of each of the client computers participating in the conference, a transport module that receives, converts and further transports streaming data to the user's telecommunications devices via data transmission networks using a specific protocol, an accounting module that makes a decision on the admissibility or prohibition of streaming data transmission, the duration of the transmission session and the end of the session, and the media module and the transport module are connected by control logic to the accounting module.