KR20010110557A - complex multimedia service method, and system for the same - Google Patents

Abstract

The present invention relates to a communication service system, in particular integrating one-to-one video telephony, remote video conferencing, distance education, internet live broadcasting, teleconsulting, video on demand (VOD), etc. The present invention relates to a complex multimedia service method and system for providing same), wherein one or more clients are connected to a complex service site that supports one-to-one multimedia communication, one-to-many multimedia communication, and many-to-many multimedia communication. To connect; At the connected service site, a complex multimedia service in which a plurality of predetermined clients, by selection and predetermined transmission and reception of multimedia data in different data formats, are centrally and decentralized under the control of a multimedia server connecting each of the multimedia communications listed above. And a system for the service method. In particular, the present invention further provides a variety of services that involve advertisers in service groups that perform multimedia communications.

Description

Complex multimedia service method, and system for the same

TECHNICAL FIELD The present invention relates to a communication service system, and in particular, one-to-one video telephony, teleconference, distance education, internet broadcasting, teleconsulting, teleconsulting, on-demand video service ( The present invention relates to a complex multimedia service method for providing voice and video at the same time in a comprehensive and real time by integrating VOD), and a system therefor.

Today, people all over the world can freely search for information, watch news, trade goods, and learn about various courses and participate in local communities. This is because the Internet supports the connection of many networks around the world.

The Internet connects servers that send information from various networks, and sends information from various web pages around the world using tools such as e-mail and web browsers. World Wide Web (WWW), which allows you to find information, NET NEWS, where you can exchange information and discuss topics, and file transfer protocols that send and receive files between your computer and the server for file transfer. FTP: File Transfer Protocol).

As a result, the number of Internet users is increasing day by day, and the development of technology to meet the needs of users continues.

Recently, users' satisfaction has increased due to the increase of internet speed, that is, the increase of transmission bandwidth (which means that the amount of data to be transmitted) is increasing. Internet services are now available that allow users to view and listen to multimedia on-line combined video. His representative is a multimedia streaming service. In this case, streaming means that the audio data or the image data (video data) having a large size is not downloaded and executed, but is divided into several files and transmitted in real time.

In order to listen to or display such audio files or image files in a streaming format, various application softwares must be embedded in a client personal computer. In other words, audio streaming / video streaming requires a built-in voice streaming application such as a real audio player or a multimedia streaming application such as a windows media player.

Most such streaming applications are multimedia plug-ins that support voice / video streaming in real time and are additional application programs that can operate based on a web browser.

Currently, multimedia services including the above-mentioned multimedia streaming service include one-to-one video phone, teleconference, distance education, internet broadcasting, remote counseling, remote consultation. ), Video On Demand (VOD).

However, in providing multimedia services through the Internet or intra-company intranets, both at home and abroad, many service providers that provide services based on multimedia contents provide only one or two pieces of fragmented multimedia communications. There is currently no multimedia service site that combines all the multimedia services such as teleconferencing, teleconferencing, distance education, live internet, teleconsulting, telemedicine and video on demand (VOD).

Accordingly, there is a need for a complex multimedia service capable of maximizing client satisfaction by implementing all services of multimedia communication in one web site.

However, in order to implement all the services of the multimedia communication in one web site, there is a drawback that a host device, which is essential for operating the web site, must be large in capacity. This is because all the multimedia data transmitted to the various clients and all the control messages for the multimedia communication must be delivered to the counterpart via the multimedia server (component of the host device) supporting the multimedia communication.

Of course, the burden on the host device was reduced to some extent by applying the streaming technology. However, in the future, when the complex multimedia service is realized in which all the services of the multimedia communication are implemented in one web site, the streaming technology alone will reduce the burden on the host device. It is not enough.

The object of the present invention has been devised in view of the above, and in particular, one-to-one video telephony, teleconference, distance education, internet broadcasting, teleconsulting, telemedicine, video on demand The present invention provides a complex multimedia service method that supports all multimedia communication services such as service (VOD) through a single web site.

It is still another object of the present invention to minimize the burden on the multimedia server and maximize the client capacity per unit server when the complex multimedia service in which all the services of the multimedia communication are implemented in one web site is realized. It is an object of the present invention to provide a complex multimedia system in which a part of all multimedia data transmitted for a network is transmitted directly through a local network (or the Internet) without passing through a multimedia server.

Another object of the present invention is to provide a variety of advertising services when forming a service group for performing a specific multimedia communication in a complex type of service site in which one-to-one multimedia communication, one-to-many multimedia communication and many-to-many multimedia communication are integrally supported. To provide a complex multimedia service method that allows advertisers to provide real-time multimedia advertising to the service group.

A feature of the complex multimedia system according to the present invention for achieving the above object is a web browser for web access and a plurality of client computers with embedded software for transmitting and receiving multimedia data in different data formats; In response to the web access attempt of each client computer, a web page for providing a complex multimedia service as a service content, which supports one-to-one multimedia communication, one-to-many multimedia communication, and many-to-many multimedia communication as an integrated service. A web server for performing a web interface to the plurality of client computers; Built-in a number of software for each different multimedia service driven in accordance with the selection of the service content of a particular client through the client computer, and controls the communication path so that communication between the client computers via it, and optionally the client It is configured to include a multimedia server for controlling the communication path so that direct communication between the computers.

Preferably, the multimedia server includes a main management program for controlling a communication path between the client computers, and the main management program may log in / log out to a specific client, execute a messenger command, and create / delete a service group / It controls entry / exit command execution, group member call / response / exclusion command execution, group token acquisition / permit / release command execution for voice management, and multimedia data transmission / reception command execution.

In addition, a feature of the complex multimedia service method according to the present invention for achieving the above object is a complex type of service in which one or more clients support one-to-one multimedia communication, one-to-many multimedia communication and many-to-many multimedia communication. Accessing the site; In the connected service site, a plurality of specific clients predetermined by selection transmit and receive multimedia data in different data formats according to control of a multimedia server connecting each multimedia communication.

Preferably, in the step of transmitting and receiving the multimedia data, the plurality of clients are divided into regular members for performing the multimedia communication in both directions and sub-members for performing the multimedia communication in one direction.

Next, in the multimedia data transmitting / receiving step, some of the plurality of clients are controlled to transmit / receive bidirectionally or unidirectionally only data of a specific format among the multimedia data of different formats.

Next, some of the plurality of clients transmitting and receiving the multimedia data perform the respective multimedia communication in one direction to provide multimedia advertisements to the service site.

Next, a plurality of clients transmitting and receiving the multimedia data form a group to perform multimedia communication in both directions, and some of the clients of the formed group are restricted to perform one-way communication by the specific client that created the group. .

1 is a diagram illustrating a host device-side protocol architecture for a complex multimedia service of the present invention.

2 is a diagram showing the overall system configuration for a complex multimedia service of the present invention.

3 is a system diagram of a centralized and distributed system in the complex multimedia service of the present invention.

4 illustrates an internal process on the host device side for the complex multimedia service of the present invention.

5 is a diagram of the host device side for login / logout and messenger commands in the complex multimedia service of the present invention.

6 is a diagram of a host device side for a service group create / delete / enter / exit command in a complex multimedia service of the present invention.

7 is a diagram of the host device side for a group member call / response / exclusion command in the complex multimedia service of the present invention.

8 is a host device side diagram for a group token acquire / authorize / release command in the complex multimedia service of the present invention.

9 is a host device-side diagram for a block data insertion / update / delete command of a specific member and a delivery command of group communication media data in a complex multimedia service of the present invention.

10 is a diagram illustrating a process for delivering group communication media data when the complex multimedia communication of the present invention is distributedly serviced.

11 is a system configuration diagram for text chatting in the complex multimedia service of the present invention.

12 is a system configuration diagram for multimedia teleconferencing in the complex multimedia service of the present invention.

13 is a system configuration diagram for multimedia distance education in the complex multimedia service of the present invention.

* Description of symbols on the main parts of the drawings *

100: host device 110: web server

130: multimedia server 200 to 400: client computer

Hereinafter, a preferred embodiment of a complex multimedia service method and a system therefor according to the present invention will be described with reference to the accompanying drawings.

The complex multimedia service of the present invention is a one-to-one video phone, teleconference, teleclass, internet broadcasting, remote counseling, teleconsulting, video on demand service All the multimedia services such as VOD) are integrated and supported through one web site.

One-to-one video telephony service of the complex multimedia service of the present invention transmits voice and video in real time from point to point, and for this purpose, a codec (Coder / Decoder) capable of encoding / decoding voice and video is provided. Used for system This one-to-one videophone service connects to a remote counseling service and supports chat via text and voice as well as video transmission.

Next, the complex multimedia service of the present invention provides a multi-party free discussion and a discussion group of a specific group, and provides a teleconferencing service supporting free video chatting between group members.

Next, the distance learning service of the complex multimedia service of the present invention is image data, audio data, text data, and whiteboard data are transmitted in real time from the instructor who created the training room to the members who enter the training room, Separated into open mode and close mode, in the open mode, distance education for general users is conducted in two-way communication method, and in closed mode, paid education contents are provided to members who are reserved in advance. . Especially in cloth mode, the instructor checks whether the paid member is connected.

Next, the Internet live broadcasting service of the complex multimedia service of the present invention provides all broadcasts in real time live broadcasting. In particular, the Internet live broadcasting service has one that provides a live broadcast service through the content provided from the service system side, and another service that provides a broadcast broadcast by a specific group member in real time through the contents of the group member. In addition, this Internet live broadcasting service changes contents according to the season or social situation to compose a broadcasting program, and then services, for example, broadcasting the beach in the summer and skiing in the winter.

Next, the telemedicine service of the complex multimedia service of the present invention is similar to the characteristics of a videophone service in which one-to-one communication is highlighted among the services of the present invention, and voice, video, and text chats as well as ancillary functions related to medical care are provided. Supported. Auxiliary functions related to medical treatment are functions of storing / viewing / presenting photographed image data such as x-ray, CT, and MRI, and writing and prescription data. In particular, the telemedicine service stores medical records so that the stored medical records can be viewed through the web if necessary.

The multimedia service of the present invention incorporating each of these individual multimedia services may or may not adopt On Demand for each individual service.

A system based on providing the complex multimedia service of the present invention described so far will be described below.

1 is a diagram illustrating a protocol structure of a host device side for a complex multimedia service of the present invention.

Referring to FIG. 1, the protocol structure of a host device for a complex multimedia service of the present invention is composed of four application layers, and basically a LAN as a physical layer between the host device and a client's personal computer. Transmission Control Protocol / Internet Protocol (TCP / IP) and HyperText Markup Language (HTML), which support connection and Internet access, provide Hypertext Transfer Protocol (HTTP). Is defined.

Among the protocol layers of the host device, the first layer is an OS layer, which uses Linux, which is a UNIX clone operating system, as the operating system, or Windows 95 or Windows 98. Define to use Windows 2000 or Windows NT. However, other operating systems can be used.

The second layer is a host device driven by the operating system of the first layer, and defines a web server and a multimedia server.

The third layer then defines several application engines, which are defined to perform functions such as video telephony services, distance learning services, teleconferencing services, live internet services, and remote consultation services.

The fourth layer then defines several applications, which define the complex multimedia application, database interworking application, and extensible application of the present invention.

Among the protocol layers of the client computers, a first layer is defined as an operating system, and a second layer is defined as a user interface layer, which defines a web browser (eg, Internet Explorer or Netscape Navigator).

Next, the third layer of the client computer defines a multimedia communication application that interacts with the application engine of the host device.

A core configuration of the present invention implemented based on the protocol stack structure defined as above will be described with reference to FIG. 2.

2 is a diagram showing the overall system configuration for the complex multimedia service of the present invention.

Referring to FIG. 2, the complex multimedia system of the present invention includes a host device 100 and personal computers 200, 300, and 400 of various clients connected to the host device 100 through various local networks including the Internet. In particular, the host device 100 of the present invention includes a web server 110 interoperating with one or more databases 120 and a multimedia server 130 interoperating with one or more other databases 130. In particular, the web server 110 and the multimedia server 130 are only software independent, and the web server 110 and the multimedia server 130 may be integrated into one hardware.

Here, the web server 110 includes software for web access, and the database 120 linked with the web server 110 stores user information of a specific group and members of each group. Next, the multimedia server 130 includes each software for performing various multimedia communication procedures and software for controlling the complex multimedia communication of the present invention. The multimedia server 130 interoperates with the multimedia server 130 for various multimedia. Each execution result of the communication procedure, a service execution history, and service information necessary for each multimedia service are stored.

The web server 110 of the host device 100 starts to drive the first operating system (OS) to provide an interface of a web environment to the computers 200 to 400 of various clients.

A particular client attempts to connect to a service site that provides a complex multimedia service of the present invention after running a web browser by running its own computer.

Then, as the client is successfully connected, the web server 110 of the host device 100 runs the software for web access to web the web page of the complex multimedia service site of the present invention to the client's computer.

The client then selects one desired multimedia service content (one of each content of video telephony service, distance education service, teleconference service, internet live broadcast service, remote consultation service) from the displayed web page.

According to the client's selection, the multimedia server 130 drives one software corresponding to the selected content among the various multimedia software embedded therein.

Eventually, one multimedia service selected by the client is executed.

The following describes each multimedia service procedure performed by the selection of each client in more detail.

FIG. 3 is a centralized and distributed system diagram of the complex multimedia service of the present invention. In the present invention, the system provides the service centrally as shown in FIG. 3 to provide various various multimedia services in one service site. It is also built to provide services decentralized.

Referring to FIG. 3, the multimedia server 130 may be used for one-to-one video calling service, distance education service, teleconferencing service, internet broadcasting service, remote counseling service, and other messenger services provided through the complex multimedia service of the present invention. Several protocols are defined between each computer 200-400 of multiple clients.

First (A), login / logout and messenger service protocols are defined. An instruction by this protocol and a processing procedure by the instruction will be described in more detail with reference to FIG. 5 below.

Second (B), service protocols related to service group creation / destruction / entry / exit are defined. An instruction by this protocol and a processing procedure by the instruction will be described in more detail with reference to FIG. 6 below.

Third (C), service protocols related to various control messages for multimedia communication are defined. Control commands by this protocol and control procedures by the control commands will be described in more detail with reference to FIGS. 7 and 8.

Fourth (D1, D2), a service protocol related to multimedia streaming data transmitted through each multimedia communication is defined. The multimedia streaming data transmission procedure by this protocol will be described in more detail with reference to FIG. 9.

The protocol defined through the Internet between the multimedia server 130 and each of the computers 200 to 400 of the plurality of clients is applied centrally when the complex multimedia service of the present invention is provided, and among the above protocols, a local network The service protocol related to the direct client-to-client transmission of multimedia streaming data via e) is distributed and applied when the complex multimedia service of the present invention is provided.

In other words, after a plurality of clients access the service site to receive the complex multimedia service of the present invention, a login / logout and messenger command procedure or a service group is first performed between the client computers 200 to 400 and the multimedia server 130. The creation / destruction / entry / exit command procedure, the group member call / response / exclusion command procedure, the group token acquisition / permit / release command procedure are performed, and the transmission and reception of multimedia streaming data is then performed through the multimedia server 130 through the Internet. In this case, the multimedia streaming data is transmitted centrally through the local network when the load on the multimedia server 130 is increased in consideration of the burden of the multimedia server 130. Decentralized service.

In the complex multimedia system of the present invention for the distributed service, the web server 110 initially attempts to connect to a web browser through a web browser, so that one desired multimedia service content (video telephone service, distance education, etc.) is accessed from the connected web page. Service, remote video conferencing service, internet live broadcasting service, or one of the contents of the remote consultation service), and the corresponding service path to the multimedia server 130 is opened according to the client's selection. One of the various pieces of multimedia software embedded therein runs one software corresponding to the selected content, so that the objects of the multimedia communication serviced by the software, that is, the clients, can directly transmit and receive the multimedia streaming data through the local network.

4 is a diagram illustrating an internal process on the host device side for the complex multimedia service of the present invention, wherein a service operation related to a service group creation / destruction / enter / exit command is performed between a multimedia server 130 and a client, and a group member call / Service progress management related to response / exclusion orders and group token acquisition / authorization / release commands, management of service communications related to inserting / updating / removing blocking data of specific members, and delivering orders of group communication media data, and requesting one-on-one conversation or whispering. Service assistance functions, such as communication or invitation of waiting room personnel, are the overall representation of the procedures performed through Transmission Control Protocol / Internet Protocol (TCP / IP).

For this overall main management process, the multimedia server 130 has a built-in main management program, and is viewed through the transmission control protocol / Internet protocol (TCP / IP) defined between the multimedia server 130 and the client computer (200 to 400). A virtual circuit is connected to provide a main management process for the complex multimedia service of the invention. At this time, the identification of the virtual line is confirmed by a socket assigned with a port number of a transmission control protocol (TCP) and an internet protocol (IP) address.

Looking at the overall flow of Figure 4, the client first sends a transmission socket to the multimedia server 130 connected to the virtual line by the transmission control protocol / Internet Protocol (TCP / IP). Accordingly, a program for the main management process is started, and the main management program that manages the process executes handlers associated with various receive commands and multimedia data.

The handlers executed by the main manager are login / logout handlers, messenger command handlers, service group creation / destruction / enter / exit command handlers, group member call / response / explicit and group token acquisition / permission for management. Multimedia communication control command handlers, such as on / off, and finally multimedia streaming data handlers.

By the execution of the handlers, the specific client transmits the multimedia data to the multimedia server 130 together with the reception command, and the client capable of transmitting and receiving the multimedia data by the main management program sends the delivery command and its transmission from the multimedia server 130. It receives a notification of and then receives multimedia data.

The following describes the execution procedure by the handlers in detail with respect to the multimedia data communication of the present invention. In the following procedure, the multimedia server 130 is driven by internal commands, and the database 140 interworking with the multimedia server 130 includes a service member table, a service member buddy table, and a service group. It is driven by several table structures, such as a group table, a group's member table, and a group's blocking member table. In addition, the multimedia server 130 is provided with a service member's send queue and a service group's send queue for temporarily storing specific data and delivering the data to a destination when the system is intensively serviced. . At this time, the specific data of the sending client is delivered to the service member's send queue or the service group's send queue, which means that the multimedia data can be delivered to the receiving client.

5 is a diagram of the host device side for login / logout and messenger commands in the complex multimedia service of the present invention, which is a diagram of a login / logout handler and a messenger command handler of the multimedia server 130 controlled by the main management program. This is an execution procedure.

Execution of the login / logout handler or messenger command handler begins at the point in time when the receiving command of the approaching client is transmitted to the multimedia server 130.

The multimedia server 130 executes a login handler if there is a delivery of a received command related to a data login from a specific client.

The login handler reads and writes the service member table to check whether the currently accessed client is an online user, and writes the client as an online user in the service member table (A1, A2).

The login handler then reads the member buddy of the service member buddy table and verifies that the client is a service member buddy (A3). At this time, when it is confirmed that the client belongs to the service member buddy, the login handler transmits the login fact to the service member's send queue (A4).

The data in the service member delivery queue is thus notified to the buddys of the client by the delivery instruction and also forwarded to the access client (A5, A6, A7).

When the login is completed, the messenger command handler is executed.

Execution of the messenger command handler consists of the procedures of search, insert, and delete.

First, the search procedure starts from the messenger command handler finding a messenger among the service member buddy in the service member buddy table (B1). At this time, when a messenger is found, the messenger command handler transmits the search fact to the service member's send queue (B2).

Accordingly, the data of the service member delivery queue is delivered to the client requesting the messenger search by the delivery instruction (B3, B4).

The next insertion procedure begins with the messenger command handler writing to insert the logged-in client as a messenger into the service member buddy table (C1). The messenger command handler then transfers the insertion as a messenger of the client to the Member's send queue (C2). Accordingly, the data of the service member delivery queue is delivered to the client requesting the messenger insertion by the delivery instruction (C3, C4).

The next delete procedure begins with the messenger command handler writing to delete the logged in client from the messenger in the service member buddy table (D1). The messenger command handler then delivers the deletion to the service member's send queue as a messenger of the client (D2). Accordingly, the data of the service member delivery queue is delivered to the client who requested to delete the messenger by the delivery command. (D3, D4).

When the execution of the messenger command handler is completed, the logout handler is executed. Of course, the logout handler is not executed only when the execution of the messenger command handler is completed, and the logout handler is executed even when a specific client wants to log out after performing one or more multimedia communication services.

The logout handler first reads and writes to the service member table to verify that the currently logged in client is an online user and to log out that client from the online user of that service member table. Write (E1, E2).

The logout handler then reads the member buddy of the service member buddy table, verifies that the client is a service member buddy, and then checks that client's member belonging to the service member buddy. The logout is forwarded to the Member's send queue (E3, E4).

The data in the service member delivery queue is thus notified to the client's buddies by a delivery instruction and also forwarded to the client who requested the logout (E5, E6, E7).

The execution procedure of the login / logout handler and the messenger command handler of the multimedia server 130 described above with reference to FIG. 5 may be viewed by each multimedia communication such as one-to-one video telephony, distance education, teleconference, live internet broadcasting, and remote consultation. It is basically executed when each is serviced by the complex multimedia communication of the invention.

6 is a diagram of the host device side for the service group creation / destruction / entry / exit command in the complex multimedia service of the present invention, which is a service group creation / destruction / entry of the multimedia server 130 controlled by the main management program Execution procedure of the / exit command handler.

Execution of the service group creation / destruction / enter / exit command handler is performed once the receiving command of the approaching client is transmitted to the multimedia server 130, so that the currently accessing client in the service member table is an online user. After confirmation, it is started if the client is an online user.

The multimedia server 130 executes a service group creation command handler when there is a reception command transmission related to service group creation from a client that is currently approaching.

The service group creation command handler delivers a group creation command to the service group table (A1), and then writes the access client as a member to the group member table associated with the created group (A2).

The service group creation command handler then reads the group member from the group member table and sends the service group creation fact to the service member's send queue (A3, A4).

Accordingly, the data of the service member delivery queue is delivered to the access client that created the service group by the delivery instruction (A5, A6).

The multimedia server 130 then executes the service group destruction command handler when there is a received command transmission related to service group deletion from the client currently approaching.

The service group destruction command handler sends a group destruction command to the service group table (B1), and then the service group destruction command handler reads the members of the group to be destroyed from the group member table and reports that the service group is destroyed. Member's send queue) (B2, B3).

The data in the service member delivery queue is thus notified by the service order to the group members to be destroyed, and also forwarded to the access client requesting the service group destruction (B4, B5, B6).

In relation to the member entering the created service group, the multimedia server 130 executes the service group entry command handler if there is a reception command transmission related to the entry from the currently approaching client to the service group.

The service group entry command handler writes the access client as the group member to the group member table (C1).

The service group entry command handler then reads the group member from the group member table and delivers the service group entry to the member's send queue (C2, C3).

Accordingly, the data of the service member delivery queue is notified to the members of the group to which the access client enters by the service order, and is also delivered to the access client entering the service group (C4, C5, C6).

In relation to the member leaving the generated service group, the multimedia server 130 executes the service group exit command handler if there is a reception command transmission related to the exit from the service group from the client which is currently approaching.

The service group exit command handler writes to remove the client currently in the state from the group member in the group member table (D1).

The service group exit command handler then reads the group members whose access client is sent out as a group member from the group member table and delivers the service group exit to the service member's send queue (D2, D3).

Accordingly, the data of the service member delivery queue is notified to the members of the group to which the access client enters by the service order, and is also delivered to the access client entering the service group (D4, D5, D6).

The execution procedure of the service group creation / destruction / entrance / exit command handler of the multimedia server 130 described above with reference to FIG. 6 includes a distance education, a teleconference, internet live broadcasting, a remote consultation, a telemedicine, and the like. It is executed when each is serviced by multimedia communication.

In one example, when a distance learning service is provided, it is executed when a room (service group) is created by an instructor and the room is lost by the instructor, and the student enters the room or is instructed. This is done when the student leaves the room after the end (depending on the characteristics of the room, the instructor may manually enter the student, and conversely, the instructor may leave the student forcibly).

7 is a diagram on the host device side for a group member call / response / disapproval command in the complex multimedia service of the present invention, which is an execution procedure of the multimedia communication control command handler of the multimedia server 130 controlled by the main management program. . In particular, it is a group member call / response / exclusion command procedure by executing the multimedia communication control command handler.

Execution of the group member call / response / disapproval command handler is performed once the receiving command of the approaching client is transmitted to the multimedia server 130, after confirming whether the currently accessing client is an online user in the service member table. It starts if the client is an online user.

The multimedia server 130 executes the group member call command handler when there is a reception command transmission related to the group member call from the client that is currently approaching.

The group member call command handler reads the current online user (On-line user) from the service member table and invites a specific user among them (A1).

The group member call command handler then forwards the group member call to the service member's send queue (A2).

The data in the service member delivery queue is thus notified to the logged in member by a delivery order, and also delivered to the accessing client who has called the group member (A4, A5).

In case there is a call of a specific client as described above, a group member response command handler for the called client is executed. That is, when the group member call command is transmitted from a specific client, the multimedia server 130 executes a group member response command handler for a response command of the counterpart client which is the target of the call.

First, the group member response command handler checks in the service member table whether there is a specific online user who has responded to a call by a specific client among the current online users (B1).

If there is an online user who responded to the call of a particular client, then the group member response command handler then forwards the group member response to the Member's send queue (B2).

Accordingly, the data of the service member delivery queue is notified to the user who called the logged-in member by the delivery instruction, and is delivered to the responding client (B4, B5).

Next, when the multimedia server 130 receives a reception command related to the group member expulsion to expel a specific member from the created group from the client that created the specific group, the group member expulsion command handler is executed.

The group member removal handler reads the group from the service group table (C1), and then the group member removal handler reads the member of the group to be removed from the group member table (C2), and reports the group member removal fact to the service member delivery queue ( Member's send queue) (C3).

Accordingly, the data of the service member delivery queue is notified to the members of the service group who wants to remove the particular member by the service order, and is also delivered to the client removed from the service group (C4, C5).

The execution procedure of the group member call / response / disapproval command handler of the multimedia server 130 described above with reference to FIG. 7 includes one-to-one video calling, remote education, teleconference, live internet broadcasting, telemedicine, and remote consultation. It is executed when each is serviced by a complex multimedia communication.

8 is a host device side diagram for a group token acquisition / authorization / release command in the complex multimedia service of the present invention, which is an execution procedure of the multimedia communication control command handler of the multimedia server 130 controlled by the main management program. In particular, the group token acquisition / permission / release command procedure by execution of the multimedia communication control command handler.

Execution of the group token acquisition / authorization / release command handler is performed once the receiving command of the approaching client is transmitted to the multimedia server 130 to confirm whether the currently accessing client is an online user in the service member table. It starts if the client is an online user.

The multimedia server 130 executes a group token acquisition command handler when there is a reception command transmission related to group token capture from a client that is currently approaching.

The group token acquisition command handler reads a service group currently online from the service group table (A1), and reads and writes the group token associated with the service group to obtain a group token and obtain an access client that obtained the group token. Write to the group member table (A2, A3).

Thereafter, the group token acquisition command handler transmits to the service member's send queue that the access client acquires the group token and has a voice (A4).

Accordingly, the data of the service member delivery queue is notified to the members belonging to the group by the delivery order, and also the group token is obtained from the service group and delivered to the access client having a voice (A5, A6, A7).

The multimedia server 130 then executes the group token acquisition command handler if there is a delivery of the received command related to the group token grant from the currently approaching client.

The group token acquisition command handler reads the current online service group that acquired the group token from the service group table (B1), reads and writes the group token associated with the service group, and receives the token (B2). ), Writes the access client with the token to the group member table (B3).

The group token permission command handler then transmits to the service member's send queue that the access client that obtained the token was granted the token and the speech was granted (B4).

As a result, the data in the service member delivery queue is notified to members belonging to the group by a delivery order, and also the group token is obtained from the service group and delivered to the authorized access client (B5, B6, B7). .

Next, the multimedia server 130 executes the group token release command handler when there is a received command transfer related to the group token release from the currently approaching client.

The group token release command handler reads the service group of the client that is currently granted the token from the service group table (C1), and releases the token by interworking with (read / write) the group member table associated with the service group ( C2), the access client releasing the token is written to the group member table (C3).

Thereafter, the group token release command handler transmits to the service member's send queue that the access client, which has been granted the token, releases the token to end the speech (C4).

The data in the service member delivery queue is thus notified to members belonging to the group by a delivery order, and also delivered to access clients whose group tokens have been released in the service group (C5, C6, C7).

The execution procedure of the group token acquisition / authorization / release command handler of the multimedia server 130 described above with reference to FIG. 8 includes one-to-one video telephony, remote education, teleconferencing, internet live broadcasting, and telemedicine. It is executed when each service is performed.

FIG. 9 is a diagram of a host device for inserting / updating / removing a block data of a specific member and a command for delivering a group communication media data in the complex multimedia service according to the present invention, which is controlled by the main management program. Execution procedure of the multimedia streaming data handler.

Execution of the multimedia streaming data handler for inserting / updating / deleting block data of a specific member and delivering communication media data starts at a point when a receiving command of an approaching client is transmitted to the multimedia server 130.

Here, the multimedia streaming data handler blocks transmission of all multimedia data including voice data, image data, and chat data of voice / image / text to a specific member. Optionally, the multimedia streaming data handler is configured by a preset value. Blocks the transmission of only some of the multimedia data, including audio data, image data, and chat data of voice, image, and text, to a specific member. The following is a procedure that applies to the blocking of all and part of multimedia data.

The multimedia server 130 executes the multimedia streaming data handler when there is a reception command transmission related to the insertion of blocking data from the accessing client.

The multimedia streaming data handler reads the members of a specific group from the group member table (A1), and writes a specific member to the group's blocking member table (A2) to block multimedia data transmission from the group.

Thereafter, the multimedia streaming data handler transmits the fact that the specific member's multimedia data transmission is blocked to the service member's send queue (A3).

Accordingly, the data of the service member delivery queue is notified to the members belonging to the group by the service order, and also to the group members whose multimedia data transmission is blocked in the service group (A4, A5, A6).

The multimedia server 130 then executes the multimedia streaming data handler if there is a delivery of the received instruction related to the blocking data update from the accessing client.

The multimedia streaming data handler reads the members of a particular group from the group member table (B1), thereby adding additional members to block multimedia data transmission from that group or specific members to change the multimedia data transmission blocking status. table) (B2).

Thereafter, the multimedia streaming data handler transmits the fact that the specific data of the member is blocked from being added or changed to the member's send queue (B3).

As a result, the data in the service member service queue is notified to the members of the group by the service order, and also to the group members whose multimedia data transmission is further blocked in the service group or to the group members whose multimedia data transmission blocking status is changed. Delivered (B4, B5, B6).

Next, the multimedia server 130 executes the multimedia streaming data handler when there is a reception command transmission related to the deletion of the blocking data from the accessing client.

The multimedia streaming data handler reads the members of a specific group from the group member table (C1), and deletes the specific member from the group's blocking member table (C2) whose multimedia data transmission is blocked in the group.

Thereafter, the multimedia streaming data handler delivers the fact that the specific member deletes the multimedia data transmission block to the service member's send queue (C3).

Accordingly, the data of the service member delivery queue is notified to the members belonging to the group by the delivery order, and also to the group members whose multimedia data transmission block is released from the service group (C4, C5, C6).

The multimedia server 130 then executes the multimedia streaming data handler if there is a reception command transmission related to the delivery of the group communication media data from the accessing client.

The multimedia streaming data handler reads the members of a specific group to send multimedia data from the group member table (D1), and then reads the members of that particular group from the group's blocking member table (D2). ).

Thereafter, the multimedia streaming data handler delivers the fact of delivery of the group communication media data to the service group delivery queue (D3).

Accordingly, the data of the service group delivery queue is notified to the members belonging to the group by the delivery order, and also delivered to the group member who will serve the group communication media data (D4, D5, D6).

The complex multimedia service of the present invention described above with reference to FIGS. 4 to 9 is a centralized service through which multimedia communication is performed through the multimedia server 130. Next, FIG. 10 is shown after completion of execution of each handler in FIGS. 5 to 9. It is a comprehensive representation of the process when distributed group communication media data is delivered directly through a local network.

FIG. 10 is a diagram illustrating a process for delivering group communication media data when the complex multimedia communication service of the present invention is distributed. In this case, a service group creation / destruction / enter / exit command is performed between the multimedia server 130 and the client. Service communication related to operation of related services, management of service related to group member call / response / exclusion orders and group token acquisition / authorization / release commands, insertion / update / deletion of blocking data of specific members, and delivery of group communication media data Management and service assistance functions such as one-on-one chat requests, whisper communication, and invitations to waiting room personnel have already been achieved through Transmission Control Protocol / Internet Protocol (TCP / IP).

In this state, the group communication media data is directly transmitted and received between the clients belonging to the service group through the Internet or through a local network such as a local network or a local area network (LAN).

However, when the delivery of the group communication media data is executed, the actual structure of the data stream transmitted from the access client, including the reception command, is different from that of the centralized service and the distributed service. In other words, in the case of centralized service, since a reception command to control the execution of the various handlers described above is inserted into the data stream, the data stream may include the header and the multimedia server 130 in which destination and source location information are inserted. It consists of a control field into which a receive command for executing various handlers is inserted and a data field into which multimedia data to be transmitted is inserted. On the other hand, if the service is distributed, since multimedia data is directly transmitted through a local network, the execution of various handlers of the multimedia server 130 is not necessary. Therefore, the data stream in distributed service is not inserted into the control field with valid values even if the external structure is the same as the data stream in the centralized service (that is, the data stream is the same length). Valid values are inserted only in the header and the data field into which the multimedia data to be delivered is inserted.

The following is defined by the respective application engines in relation to the complex multimedia application of each service based on the process of the complex multimedia system of the present invention for supporting the centralized service and the distributed service so far. Various embodiments of one-to-one video telephony service, remote education service, remote video conferencing service, internet live broadcasting service, and remote counseling service will be described.

First, the complex multimedia service of the present invention supports basic one-to-one text chat, one-to-many text chat with lecture, and many-to-many text chat with skepticism, and also has one-to-one multimedia communication and lecture It supports the majority of multimedia communications and the many to many multimedia communications with skepticism.

11 is a system configuration diagram for text chatting in the complex multimedia service of the present invention, the multimedia server 130 supporting the chat of voice data, image data and text data is active-X. The component is downloaded to each computer 200 to 400 of the client connected to the web site.

Therefore, the client initially accesses the web server 110 using a web browser embedded in the computers 200 to 400, and the web server 110 uses the HTTP protocol to display a web page in HTML format as the client computer 200 to 400. ) Interface.

Then, when the client requests a text chat service, an Active-X component provided by the multimedia server 130 is displayed on the web pages of the client computers 200 to 400.

The client then creates a chat room for the text chat or selects one of the chat rooms already created and conducts a text chat with the desired counterpart client. Such chat room creation or chat room selection is basically realized by the group creation procedure by the group creation command handler and the group entry procedure by the group entry command handler among the internal processes of the multimedia server 130 described above.

However, if it is determined that the burden on the multimedia server 130 is increased while the text chat is concentrated as described above, the distributed text message is transmitted to the opposite client directly without passing through the multimedia server 130. Switch to chat service. This is achieved by service conversion by the built-in software of the multimedia server 130 for controlling the complex multimedia communication of the present invention.

12 is a system configuration diagram for multimedia teleconferencing in the complex multimedia service according to the present invention. First, a service related to a service group creation / destruction / entry / exit command between the multimedia server 130 and the client computers 200 to 400. Service communication management related to operation, group member call / response / disapproval command and group token acquisition / authorization / release command, service insertion management related to insert / update / delete blocking data of specific member and delivery command of group communication media data. Multimedia communication control for the first time is executed. At the same time, the multimedia server 130 downloads an Active-X component for the multimedia teleconferencing service to the client computers 200 to 400.

Accordingly, the communication media data of the multimedia teleconferencing group is transmitted and received via the multimedia server 130.

However, if it is determined that the burden on the multimedia server 130 is increased while the multimedia teleconference is intensively performed as described above, the communication media data is not directly passed through the multimedia server 130, and the client or the teleconference group thereof is directly connected. It will switch to a distributed multimedia teleconferencing service that will be delivered to the public. This is a service conversion by the built-in software of the multimedia server 130 for controlling the complex multimedia communication of the present invention, the communication media data transmitted and received are image data, voice data, text data and whiteboard data.

13 is a system configuration diagram for multimedia distance education in the complex multimedia service of the present invention. First, the service operation and service progress management already described through FIG. 12 between the multimedia server 130 and the client computers 200 to 400. For example, multimedia communication control for service communication managements is executed first. At the same time, the multimedia server 130 downloads an Active-X component for the multimedia distance learning service to the client computers 200 to 400.

Accordingly, the instructor who will perform the distance education establishes a training room through the service group creation procedure among the multimedia communication control, and gathers the service group members for the multimedia distance education. After that, the client (instructor) that creates the service group sends the broadcasting media data of the broadcasting method to the multimedia server 130, and the multimedia server 130 sends to the various clients capable of transmitting and receiving the communication media with the group generating client. Send multimedia data.

Such multimedia distance education is intensive, and in particular, after creating a service group, the regular members of the service group to be recruited are mainly students (clients) to be educated. However, parents of students can also participate as members of the service group, and advertisers who provide real-time multimedia advertisements can participate as members of the service group. However, service group sub-members, such as parents and advertisers, selectively use a mode in which multimedia data transmission and reception are restricted compared to regular members. That is, the sub-member can only receive the multimedia data and the transmission of the multimedia data is restricted.

Communication media data transmitted and received centrally are image data, audio data, text data and whiteboard data.

The complex multimedia service of the present invention is also applied to a multimedia telemedicine service, and the multimedia telemedicine service is comprehensively applied to each multimedia service described so far.

As described above, in the present invention, the following effects can be obtained.

First, all services of multimedia communication such as one-on-one video telephony, remote video conferencing, distance education, internet live broadcasting, teleconsulting, telemedicine, on-demand video service (VOD) are all implemented in one web site. Maximize client satisfaction.

Second, for various clients requiring various multimedia communication, only the part of the multimedia data delivered and the control message for the multimedia communication are centralized via the multimedia server supporting the multimedia communication, and the rest of the multimedia data is centralized. Since the distributed type transmitted to the other party directly through the local network without passing through the multimedia server is applied to the system of the present invention, the unit server of the system when a complex multimedia service in which all the services of multimedia communication are implemented in one web site is realized. The client capacity is maximized, minimizing the burden on the multimedia server.

Third, in the complex multimedia service method of the present invention, streaming data such as voice data, image data, chat data, and whiteboard data are transmitted for multimedia communication, and various solutions such as operation, progress, and communication management of multimedia communication are provided. Therefore, it is possible to support complex and diverse multimedia services more efficiently.

Fourth, although the user has been provided with limited multimedia services based on text transmission or web, the present invention provides the user with a complete multimedia communication incorporating voice data or image data. In addition, in the past, the service operator had a high hardware construction cost for video communication, but in the present invention, various multimedia services can be converted to a portal service so that video communication can be implemented at low cost.

Those skilled in the art will appreciate that various changes and modifications can be made without departing from the spirit of the present invention.

Therefore, the technical scope of the present invention should not be limited to the contents described in the embodiments, but should be defined by the claims.

Claims (8)

One or more clients accessing a complex service site in which one-to-one multimedia communication, one-to-many multimedia communication and many-to-many multimedia communication are collectively supported; At the connected service site, under a control of a multimedia server connecting each multimedia communication, a specific plurality of predetermined clients transmit and receive multimedia data of different data formats by a selection. Service method. The method of claim 1, wherein in the transmitting / receiving of the multimedia data, the plurality of clients are divided into regular members who perform the multimedia communication in both directions and sub-members who perform the multimedia communication in one direction. Complex Multimedia Service Method. The complex multimedia service method of claim 1, wherein, in the multimedia data transmitting / receiving step, some of the plurality of clients are controlled to transmit or receive only a specific type of data among the different types of multimedia data in both directions. The complex multimedia service method of claim 1, wherein some of the plurality of clients transmitting and receiving the multimedia data perform the respective multimedia communication in one direction to provide multimedia advertisements to the service site. The method of claim 1, wherein the plurality of clients transmitting and receiving the multimedia data form a group to perform multimedia communication in both directions, and some of the clients of the formed group perform unidirectional communication by a specific client that creates the group. Complex multimedia service method, characterized in that limited to enforce. A plurality of client computers each having a web browser for web access and software for transmitting and receiving multimedia data in different data formats; In response to the web access attempt of each client computer, a web page for providing a complex multimedia service as a service content in which one-to-one multimedia communication, one-to-many multimedia communication, and many-to-many multimedia communication are collectively supported. A web server for performing a web interface to the plurality of client computers; Built-in a number of software for each different multimedia service driven in accordance with the selection of the service content of a particular client through the client computer, and controls the communication path so that communication between the client computers via it, and optionally the client Complex multimedia service system comprising a multimedia server for controlling the communication path to direct communication between computers. 7. The multimedia server of claim 6, wherein the multimedia server includes a main management program for controlling a communication path between the client computers, wherein the main management program logs in / logs out to a specific client, executes a messenger command, and creates a service group. Controlling the execution of an extinction / entrance / exit command, execution of a group member call / response / exclusion command, execution of a group token acquisition / authorization / cancellation command for management of utterance rights, and execution of transmission / reception and blocking commands of multimedia data. Complex Multimedia Service System. One or more clients are integrated with one-to-one video telephony, teleconferencing, classroom, internet broadcasting, remote counseling, and video on demand services (VOD). Accessing a complex service site; At the connected service site, under the control of a multimedia server connecting each multimedia service, multiple members of a predetermined group predetermined by selection transmit and receive multimedia data of different data formats via the multimedia server; According to the control of the multimedia server, a plurality of members of the specific group comprises the step of directly transmitting and receiving multimedia data of different data format.