KR980010813A - Session management system and its method in a mutual participation multimedia application development environment - Google Patents

Abstract

1. Technical field to which the invention described in the claims belongs

A session management system and method for supporting session management and control of media resources required for developing interoperable multimedia applications.

2. Technical Challenges to be Solved by the Invention

There is a problem that media resources collide when the application development cost is increased and multiple sessions are created.

3. The point of the solution of the invention

In a mutually-participating multimedia application development environment supporting session creation, maintenance and destruction services required for session management according to application service requirements and simultaneous media control for enabling media access to a limited resource at the same time, Session management system and method therefor.

4. Important Uses of the Invention

Used to create multiple sessions over a network on a single personal computer

Description

Session management system and its method in a mutual participation multimedia application development environment

The present invention relates to a session management system and method for supporting session management and media resource control required for developing a mutually-participating multimedia application in a distributed environment.

Conventional multimedia applications are typically used by a single user on a single platform. Session management for multimedia applications used by such a single user requires only management of users who use applications asynchronously in an independent platform.

However, in the case of a session in which a plurality of users collaborate through a multimedia application in a distributed environment, there is a problem in that a session can not be managed with a simple user information recording or access control function.

Conventionally, when a plurality of multimedia interworking applications are used to perform a plurality of sessions on a single platform, conventionally, each application performs a service such as creation, maintenance, and destruction of a session and a media service Since the application part needs to be completely included in the application itself, it increases the development cost of the application. Since the application is not considered to be structurally linked with other applications in one platform, it is possible to use multi- There is a problem that media resources collide when creating a session.

In order to solve the above problems, the present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a method and system for providing services such as session creation, maintenance, and destruction required for session management, The present invention provides a session management system and a method thereof in a mutual-participation multimedia application development environment, which performs control of a session and performs a comprehensive management function of sessions necessary for media control among a plurality of users in a single session.

In order to accomplish the above object, an apparatus of the present invention is created in a fixed state in which a mutual participation application registers an application to receive a session management service for the first time and creates a session, and a plurality of mutually-participating multimedia applications commonly use it as an information channel Common application interface; A mutual participation type multimedia application development environment daemon for initializing each media server, generating the common application interface to support application session creation, and allocating network resources by requesting network resource allocation; A session manager, which is generated by the mutual-participation multimedia application development environment daemon and controls a session and requests creation of a media resource requested by an application; A private application interface generated by the session manager and used as a communication path between the interoperable application and the session manager after a session is created; A network service provider connected to the interoperable multimedia application development environment daemon and a session manager to form a virtual network independent of other sessions when a session is created, thereby providing a session management network service and a network service of media resources; A media interface for handling an interface between an external media server and the session manager, for delivering a media resource requested by the session manager to the media server and for forwarding a response from the media server to the session manager; A floor control unit for controlling a voice in a single session, adjusting a media control request of the session manager requested through the media interface, and delivering the media control request to the media server; An overall session manager for allocating network support requested by the mutual-participant multimedia application development environment daemon and controlling network resources required for creating a session by controlling the network service provider; A session monitor which is generated by the overall session manager and is connected to the session manager, the media server and the network service provider to monitor and adjust the overall situation of the session; And a traffic monitor connected to the session monitor for monitoring and outputting traffic of a virtual network of the session.

According to another aspect of the present invention, there is provided a session management method applied to a session management system in a mutual-participation multimedia application development environment, the method comprising: when a mutual-participation application requests registration with a mutual- The participating multimedia application development environment daemon has a first step of assigning a unique number of an application; When the interoperable application requests generation of a session by transmitting the session creation information to the interoperable multimedia application development environment daemon through a common application interface, the interoperable multimedia application development environment daemon registers the application in the entire session manager A second step of requesting assignment of network resources at the same time; A third step of the session manager creating a session monitor and allocating network resources to the mutual-participation multimedia application development environment daemon; The interoperable multimedia application development environment daemon creates a session manager with the allocated network resources and requests the generated session manager to generate media resources for each media server; The media server creating a media server instance using the network resource received from the session manager and transmitting the handle to the session manager; And the session manager notifies the session establishment result to the interoperable application through a private application interface, and the interoperable application requests a session management service to the session manager

FIG. 1 is a conceptual diagram showing a case where the present invention is applied to a computer distributed over a network; FIG.

FIG. 2 is a configuration diagram illustrating a relationship in which service objects providing session management services are located in respective computers on a network in the present invention; FIG.

FIG. 3 is a schematic diagram showing a general configuration in which the present invention is applied in a mutual participation type multimedia application development environment.

FIG. 4 is a detailed configuration diagram illustrating a relationship between a media resource and a session management service in a mutually-participating multimedia application development environment.

FIG. 5 is a detailed configuration diagram illustrating relationships among objects providing a session management service according to the present invention in a mutual-participation multimedia application development environment.

6 is a detailed configuration diagram of a session manager among session management service objects according to the present invention;

7 is a state transition diagram illustrating a scenario in which a mutually-participating application creates a session by a session management service;

Figure 8 is a flow diagram of a mutually-participating multimedia application development environment daemon in accordance with the present invention;

9 is a flowchart of a session manager according to the present invention;

FIG. 10 is a detailed flowchart of the session management service of FIG. 9 according to the present invention;

FIG. 11 is a detailed flowchart of the invitation service of FIG. 10 according to the present invention;

12 is a detailed flowchart of the participant management service of FIG. 10 according to the present invention;

FIG. 13 is a detailed flowchart of the session maintenance service of FIG. 10 according to the present invention;

14 is a detailed flowchart of the end service of FIG. 9 according to the present invention;

FIG. 15 is a detailed flowchart of the media service of FIG. 9 according to the present invention;

FIG. 16 is a detailed flowchart of the audio service of FIG. 15 according to the present invention;

17 shows a detailed flowchart of the video service of FIG. 15 according to the present invention.

18 is a detailed flowchart of the whiteboard service of FIG. 15 according to the present invention;

FIG. 19 is a detailed flowchart of the application sharing service of FIG. 15 according to the present invention;

Figure 20 is a flow diagram of a participant manager according to the present invention;

21 is a detailed flowchart of the participant maintenance service of FIG. 20 according to the present invention;

Figure 22 is a flow diagram of an overall session manager according to the present invention;

23 is a flowchart of a session monitor according to the present invention;

DESCRIPTION OF THE REFERENCE NUMERALS

20: Session Management Service 21: Common Application Interface

22: Mutual Participation Multimedia Application Development Environment Daemon 23: Private Application Interface

24: Session Manager 25: Network Service Provider

26: Media interface 27: Floor control

28: Full Session Manager 29: Session Monitor

30: Traffic Monitor

Hereinafter, a temporal example according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram illustrating a case where the present invention is applied to a computer distributed over a network.

In the present invention, a comprehensive management function of a session required for interactive application development is configured as middleware of an application and an operating system.

In the drawing, five computers constitute a network. In each computer, service objects for receiving session management services are activated, and the services required by the mutual application are provided through interworking of the session management service objects distributed over the network.

Computer 1, Computer 2, and Computer 4 are participating in Session A, Computer 2 and Computer 3, and Computer 4 and Computer 5 are participating in Session B. In this case, the computer 2 and the computer 4 are simultaneously participating in the session A and the session B. The session management service of the multi-participative multimedia application development environment (Dure) can activate one session of the computer, Not only does one session need exclusive use of required media resources, but it also supports simultaneous control by applications participating in multiple sessions

FIG. 2 is a block diagram illustrating a relationship in which service objects providing a session management service are located in respective computers on a network in the present invention.

In order to provide the session management service to the application in the interactive multimedia application development environment (Dure), there are objects that must be activated in the computer. In FIG. 2, a computer having one entire session manager in a LAN is required as in the computer 6, and a traffic monitor for monitoring network traffic occupied by each session is created in the computer 6 having the entire session manager , A session monitor is created by the entire session manager to monitor all the situations in which the session is performed whenever a session is created in a mutually-participating multimedia application development environment (DREE).

In addition, all of the computers 7, 8, and 9 except the computer 6 having the full session manager for receiving the session management service must have a mutual participation multimedia application development environment (DREE) daemon. The interoperable multimedia application development environment (DURAY) daemon supports the service of the session creation process by activating the first application by the interaction with the overall session management, and the session management service Object. There are two types of objects created by the mutual participation type multimedia application development environment (Dure) daemon: a session manager object and a participant manager object. When a session is created by the application, the mutual participation multimedia application development environment A session manager object is created. In response to the invitation, a participant manager is created on the participant side participating in the session.

In the drawing, the computer 6 has an entire session manager object, a session monitor, and a traffic monitor. In the computer 7, a session manager object is created because the session is initialized by executing a mutually-participating application. In addition, the computers 8 and 9 are participating in the session created by the computer 6, and a participant manager is created by the mutual participation multimedia application development environment (Dure) daemon.

FIG. 3 is a schematic diagram of a general application of the present invention in a mutual-participation multimedia application development environment. FIG. 3 shows locations of session management service objects supporting a service of an operating system and applications for each media server in one computer.

3 is a media server; 4 is a session management service; 5 is an operating system; 6 is a camera; "7" indicates a microphone, "8" indicates a video capture board, "9" indicates a sound card, and "10" indicates a network card.

The platform to which the present invention is applied is an " IBM "computer compatible device, and the operating system 5 uses an operating system (e.g., Windows 95 or Windows NT) that supports Win32 and WinSock Version 1.1 or higher. Since the type of the media is the media server 3 having the same media interface as that of the session management service 4, it does not matter if any hardware has only the protocol with the designated session management service object.

The session management service 4 provides access to services and media such as creation, maintenance, and destruction of sessions for a number of inter-participant applications 1. [ The service request received from the application (1) is serviced by the system service of the media server (3), the operating system (5), and the interaction with the session management service objects at the remote location.

The network card 10 should use a device driver that can be registered in the system and use an Ethernet having a speed of 10 Mbits / sec. Since the video camerboard 8 and the sound card 9 are determined according to the design of the media server 3 which is dependent on the respective media card, any use is irrelevant to the session management service. However, the media server 3 designed by the interface of the media card must adhere to the interface provided for receiving the session management service 4. The mutual participation type application 1 must be an application that complies with the interface for receiving the session management service 4 so as to be provided with the session management service 4 provided by the present invention.

Devices such as the video capture board 8 and the sound card 9, including the network card 10, are generally managed by the operating system 5 and provided to applications 1 that require use by a specified system function, . In the case of network resources, unlike the video capture board 8 or the sound card 9, a plurality of applications can be provided at the same time, but video resources or sound resources do not allow access to a plurality of applications at the same time. Therefore, the simultaneous media control, which is a part of the session management service 4 provided by the present invention, allocates the media resources to the media server 3 for each resource, To provide services to a plurality of applications 1 at the same time. At this time, the session management service 4 supports arbitration with other participants in the session to access media resources by an independent voice method for each application 1.

The session management service 4 also provides a session control service for a plurality of applications. The session management service 4 forms an independent virtual network for each application. In this virtual network, not only a service for creating a session but also an individual management service for a participant and a session The maintenance service for the whole and the service for the destruction of the session are serviced according to the demand of the application, or if necessary, even if there is no demand.

FIG. 4 is a detailed configuration diagram showing a relationship between a media resource and a session management service in a mutual participation type multimedia application development environment. In the figure, "11" is a mutual participation type multimedia application development environment, "12" 16 is an audio server, 17 is a video server, 18 is a white server, 19 is an application sharing server, , And "20 " represents a session management service.

The multimedia application development environment 11 includes a session management service module 20 for session management and a variety of media servers for providing a media service, I have a server instance. Examples of types of media provided by the interoperable multimedia application development environment 11 include an audio server 16 supporting two-way audio, a video server 17 supporting a plurality of image windows, And an application sharing server 19 for supporting a single application to be collaborative by a plurality of users. The audio server instance 12, the video server instance 13, the white server instance 14, and the application sharing server instance 15, which are dedicated to the media service for the session each time a session is created, / RTI >

The interoperable multimedia application development environment (DREA) 11 provides a server for each media required to use such media resources. In contrast to the form in which the application directly accesses the media, the application Since the media service is requested to the media server, a plurality of applications can simultaneously use the media resources, so that it is possible to use media resources exclusively at the same time in multiple sessions on one computer.

In the drawing, a mutually-participating application requests a media resource required when initially creating a session. At this time, the session management service 20 requests each media server to create a server instance. The server that has requested to create the instance creates a media server instance that can access the server, 20) to the object for

FIG. 5 is a detailed configuration diagram illustrating the relationship between objects providing a session management service according to the present invention in a mutual participation type multimedia application development environment, wherein "20" is a session management service, "21" 23 is a private application interface, 24 is a session manager, 25 is a network service provider, 26 is a media interface, 27 is a floor control controller, 28 is a full-fledged multimedia application development environment daemon, A session manager, 29 a session monitor, and 30 a traffic monitor.

A session management service (20) in a mutually-participating multimedia application development environment (Dure) is a system for inter-participating applications, a media server, and an operating system, in which a service requested by an application is connected to a media server, an operating system, Provided by interaction. In order to provide such a service, a consistent interaction between the various configuration modules is required. FIG. 5 is a detailed representation of the interaction relationships among all the configuration modules required for the session management service.

First, when a mutual participation application receiving a session management service is executed in a mutual participation multimedia application development environment (DREE), the application is provided with an interface for accessing a mutual participation multimedia application development environment (DREE). Herein, the interface used by the application is referred to as a common application interface 21. In the process of registering an application and creating a session to receive a session management service for the first time, the common application interface 21 is a mutual-participation multimedia application Is generated by an object called the development environment daemon 22 and a plurality of mutually-participating multimedia applications can be commonly reused. The common application interface 21 includes a handle and an application unique to the interactive multimedia application development environment daemon 22 in which a handle and an application can access the interactive multimedia application development environment daemon 22, And the degree of allocation of network resources required for forming a session thereafter.

The mutual-participation multimedia application development environment daemon 22 initializes each media server so that a subsequent session can be used, and the application services the service for the process of creating a session through the common application interface 21. The mutual-participation multimedia application development environment daemon 22 receives the data required for the session creation request and the session creation from the application through the common application interface 21, and allocates necessary network resources to the entire session manager 28 And receives the allocation of the network resources required for the session creation from the overall session manager 28, the session manager 24 which will be dedicated to the session service of the next application is generated. If the application is requested not to be a session creator but to participate in a session generated at a remote place, the mutual participation multimedia application development environment daemon 22 creates a participant manager object, not a session manager object, Supports the function of controlling the media server to provide media service to the session manager object, but is subject to passive management of the session management service performed by the session manager object.

The session manager or participant manager 24 generated by the mutual-participation multimedia application development environment daemon 22 generates a private application interface 23 for interaction with an application required to provide a session management service, The media interface 26 requests the media server 26 to create a media resource requested by the application through the application interface 23.

The private application interface 23 is used for data exchange and application such as the type of media resource required by the application, the name of the session, the information of the participant participating in the current session, Is used to request a session management service,

The network service user 25 is a service module required for session management. When a session is created, the network service user 25 forms a virtual network independent of other sessions and provides all network services necessary for session management. The network service provider 25 provides not only the session management service but also the network service of the media resources required for the session.

The media interface 26 is an interface between the media server and the session manager 24 for controlling the media through the session management service. Access to the media is communicated to the media server by the talk controller 27 via the media interface 26 and responses to the service are entered into the session manager (participant manager 24) via the media interface 26 .

The talk right controller 27 is a service module that independently provides the talk right method among the participants requested in the session management service for each session. The talk right controller 27 is a service module, which is set through the designated talk controller 27 before all the media control requests are transmitted to the media server As shown in FIG.

The overall session manager 28 controls the network service provider 25 to perform arbitration of network resources necessary for the session creation and also performs the process of creating the session monitor 29 object. The session monitor 29 generated from the entire session manager object is uniquely generated for each session. The session monitor 29 is connected to the session manager 24 to monitor and adjust the overall state of the session, And is connected to the network service provider 25. The traffic monitor 30 provides a service for monitoring the traffic of the virtual network of all the sessions and manages the network load of the session with various types of output .

FIG. 6 is a detailed configuration diagram of a session manager among session management service objects according to the present invention. In FIG. 6, reference numeral 31 denotes an event interpreter, 32 denotes a packet analyzer, 33 denotes a session controller, A controller 35, and a media server controller 35, respectively.

The session manager 24 interacts with the application through the private application interface 23, interacts with the media server 26 via the media interface 26, interacts with other participant managers via the network service provider 25, Communication, and communication with the session monitor,

The session manager 24 is comprised of an event interpreter 31, a packet interpreter 32, a session controller 33, a media instance controller 34 and a media server controller 35, Packets coming in via the parser 31 but being transmitted to the network enter the event interpreter 31 via the packet interpreter 32,

The packet analyzer 32 serves to analyze a corresponding packet in the process of transmitting a message to a partner manager at a remote location. The packet type is used to maintain a session with a session creation packet generated in the process of creating a session A packet generated in the process, and a packet necessary for destroying the session. This packet is generated when the session controller 33 controls the talk right required on the session with the participant manager in the remote place. The analyzed packet is sent to the session controller 33, To the media interface 26 via the media instance controller 34. The media server controller 35 is responsible for the control of each corresponding media server and control for the media service of the actual application Is performed via the media instance controller 34,

7 is a state transition diagram illustrating a scenario in which a mutually-participating application creates a session by a session management service.

When the application is executed for the first time, the application searches for the presence of the mutually-participating multimedia application development environment daemon object and requests registration as an application (36). The mutual participation type multimedia application development environment daemon 22 allocates a unique number of an application usable in the corresponding platform 37. The unique number of the application allocated at this time is a key for accessing the private application interface 23,

Next, the application notifies the mutual participation type multimedia application development environment daemon 22 through the common application interface 21 of necessary items such as the media resources and the voice right method necessary for the session creation, and requests the generation of the session (38). At this time, the mutual-participation multimedia application development environment daemon 22 registers the application in the entire session manager 28 and requests allocation of network resources necessary for session creation (39).

The full session manager 28 allocates necessary network resources and generates a session monitor 29 required for monitoring the session, and at the same time, allocates the requested network resources to the mutual-participation multimedia application development environment daemon 22 (41). The mutual participation type multimedia application development environment daemon 22 creates the session manager 24 with the allocated network resources 42 and the created session manager 24 sends a request for generating the requested media resource to each media server To be generated through the designated network resource (43).

The media server creates a media server instance to perform a service for a media resource to be requested from an application using the network resource provided from the session manager 24 (44). When the media server instance is created, the server instance notifies the session manager 24 that the media server instance has been successfully created.

When all necessary preparations for the session creation are completed, the session manager 24 informs the application via the private application interface 23 that a session has been established (46). The application may then request all services for the session through the session manager 24 (47).

FIG. 8 is a flowchart of a mutually-participating multimedia application development environment daemon according to the present invention.

In the computer for receiving the session management, the mutual-participation multimedia application development environment daemon 22 is executed 48 before executing the mutual application. At this time, the mutually-participating multimedia application development environment daemon 22 finishes the initial preparation work for activating itself, executes the media server with reference to the media server information of the already registered file (49) And transmits a handle to access the application development environment daemon 22

The media server activated by the mutual-participation multimedia application development environment daemon 22 is a means for notifying the user that the media server can support the session management service of the mutual-participation multimedia application development environment, It responds with daemon 22 (50) and then forwards the handle for the service request to the server. After receiving the response from the media server, the mutual participation type multimedia application development environment daemon 22 registers the type of usable media server (51), and then supports only the currently registered resources among the media resources requested by the application.

The mutual-participation multimedia application development environment daemon 22 classifies the application requesting the service whether it is an application on the same computer or a remote application (52).

In the case of an application on the same computer, a process of requesting registration from the application so as to be accessible to the mutual-participation multimedia application development environment daemon 22 is required. This process is executed by the mutual participation type multimedia application development environment daemon 22 Through the common application interface 21. (53) The mutual participation type multimedia application development environment daemon 22 that has been requested to register from the application registers the application with the unique number of the application that can be used by the application (54). Next, the application may request the creation of a session for the mutual participation type work through the mutual participation type multimedia application development environment daemon 22. At this time, the mutual participation type multimedia application development environment daemon 22 acquires media information and network resource information Able to know. The interoperable multimedia application development environment daemon 22 which has been requested to create a session from the application requests the entire session manager 28 to allocate network resources required for session creation 56 and simultaneously receives 57), a session manager is created (58) to be responsible for all session management services of the application. This ends the interaction with the application to provide the service.

If the invitation packet is received from the remote site, (59) the mutual-participation multimedia application development environment daemon (22) transmits the session management service of the application participating in the session with the information necessary for the session participation transmitted by the initial session creator And creates a supporting participant manager 24 (60).

9 is a flowchart of a session manager according to the present invention.

When the session manager 24 is created by the mutual-participation multimedia application development environment daemon 22, the session manager 24 requests each media server to create a media server instance that can use the media resources required for the delivered session (61). When the media server is requested to create a media server instance from the session manager 24, the media server creates an accessible media server instance of the corresponding media server and transmits a handle of the created server instance as a parameter through a handle of the session manager object (62).

The Session Manager object registers 63 that it is available for the media resource for which the response is received, and 63 informs the application of such registration information and its handle 64 to provide the session management service to the application requesting the session creation from now on .

Thereafter, the session manager object repeatedly performs a process of continuously servicing the service requested by itself. Such a service request is performed by the applications that are the object of the participant manager object, the session monitor, and the session management service of the remote site.

The service is requested 65 and the event is interpreted 66 to determine what service to provide first.

After the event interpretation step, the type of the service is determined in order to perform the service (67). Executes a session management service 68 for maintaining and managing a session, a termination service 69 for destroying a session, or a media service 70 for accessing media resources of the application according to the determination result .

10 is a detailed flowchart of the session management service of FIG. 9 according to the present invention.

In order to perform the session management service, the type of the corresponding session management service is determined (71). According to the determination result, the invitation service 72 for participating the participant in the session after the session creation, the participant management service 73 for managing the participant participating in the session, or the session is maintained by the interaction with the session monitor And performs session maintenance service 74.

11 is a detailed flowchart of the invitation service of FIG. 10 according to the present invention.

After the session is created, the application can request the invitation service to invite the participants to perform the collaboration. The service for the request is the invitation service.

When the invitation service is started and the user is requested to input the data required for the invitation and the invitation data is input 75, the interactive application multimedia application with the information about the input data and the media and network resources required to participate in the session is developed Invitation information is transmitted to the environment daemon 22 (76).

(79) Until the invitation is terminated after the transmission of the invitation information, the participant receives the information corresponding to the invitation of the remote place (77), and registers the participant as a participant participating in the session (78). When the invitation is terminated (79), all information about the participant currently participating is transmitted to the participant manager object (80).

12 is a detailed flowchart of the participant management service of FIG. 10 according to the present invention.

After performing the invitation service of the application, the service for managing the participants participating in the session is performed in the session management service. Such a participant management service includes the output request of the participant information requested by the application, the withdrawal process, the participant survival test There is a process of.

In order to perform the participant management service, the type of the corresponding service is first determined (81). At this time, if the application requests the browse of the participant information, the participant information is output (82). When the application receives information that the withdrawer has occurred in the session (83), the withdrawer information is deleted from the session participant registration information 84) Notify within the session that the withdrawer has occurred (85).

On the other hand, in order to check that the corresponding participant is not able to participate in the session any more due to abnormal situation (eg, network disconnection, computer down, etc.), the participant's biological test is continuously performed. The survivor check packet is periodically transmitted to the participant manager object (86). (87) If it is determined that the tolerance value has been exceeded (88), it is determined that the number of failures is greater than the number of failures in the session participant registration (84) Notify in the session that the withdrawer has occurred (85), and return if the allowance has not been exceeded.

However, if the participant survival test packet is transmitted and the participant survival response packet is received (89), the number of failures is reinitialized (90) to prevent the exceeding of the tolerance value.

13 is a detailed flowchart of the session maintenance service of FIG. 10 according to the present invention.

The session manager is also managed by the session monitor in the same way that the management of the participants participating in the session is performed by the session manager. In the session maintenance service, the session monitor 29 generated by the overall session manager 24 performs a session survival test, and if the session manager 24 receives such a session survival check packet (91) (92) and transmits a packet informing that the session is alive to the session monitor 29 (93).

14 is a detailed flowchart of the end service of FIG. 9 according to the present invention.

The session manager 24 also provides a session creation service when the application that created the session is terminated, as well as a termination service for the session. This termination service destroys the media server instance that was used in the session 94, informs each participant manager object that the session has ended, notifies the participants in the session that the session is terminated 95, Destroy Himself (96)

15 is a detailed flowchart of the media service of FIG. 9 according to the present invention.

The session management service provides the media access request from the application as an interaction with the media server instance to support the media service in the application. In order to support the media service, the end of the media resource required first is determined (97).

The media service instance 98 is controlled by adjusting the media server instance so that the media service requested by the application can be performed in the media interface capable of performing the corresponding media service according to the result of determining the type of the requested media resource, ), A whiteboard service 100, or an application sharing service 101.

16 is a detailed flowchart of the audio service of FIG. 15 according to the present invention.

In order to provide the audio service, the type of the service required first is determined (102). When the type of the service to be provided is determined, the corresponding service is provided among the voice request service 103, the voice release service 104, the voice transmission service 105, or the audio activation control service 106. At this time, the service regarding the voice is operated by the voice mode used in the current session.

The floor request service 103 is a service requested when an application desires to speak through audio, such as a floor control method (a non-arbitration method, a chair arbitration method, a token delivery method, a time limit method, a priority method) And supports the interaction with the participant manager at the remote site.

The floor waiving service 104 is a service for preventing speech from audio in the session from now on when having the floor.

The voice transmission service 105 provides a service for providing a voice to a corresponding participant by selecting a speaker in the case of a specific floor mode (chairman arbitration system, token transmission system).

When audio is used, the sampled data should be transmitted even if the user speaks a lot of speech and does not speak to reduce traffic on the network. However, in order to support such a method, a variable that can distinguish between speaking and non-speaking is required. The audio activation control service 106 is a service that controls the variable according to the system.

17 is a detailed flowchart of the video service of FIG. 15 according to the present invention.

In order to support the service required for using the video resource of the application, the type of the service is first determined (107). The following services are performed according to the judgment result.

There is an image window addition service 108 for adding a picture by selecting participants and conversely an image window deletion service 109 for selecting a participant and deleting the currently activated image window.

The image window sorting service 110 provides a service for displaying a plurality of images in a balanced manner when a plurality of image windows are added.

The frame rate adjustment service 111 is a service for supporting a function of adjusting a frame generated per second of a video image and the picture taking service 112 is a service for adjusting a frame rate It provides a service to save your pictures as files for use.

The video adjustment service 113 provides a service for setting the relationship between the video capture board and the camera, and the overlay adjustment service 114 provides a service for adjusting brightness, density, contrast, color, etc. of the image.

18 is a detailed flowchart of the whiteboard service of FIG. 15 according to the present invention.

A white service is a service that provides a work space where all participants in a session can work together. First, the type of the service required by the application is determined (115) to perform the white service. The following services are performed according to the judgment result.

The white service includes a drawing service 116 for providing a service for drawing a picture in a shared work area and a text editing service 117 for providing a service for a portion using non-pictures.

In addition, the white service includes a file related service 118 that handles file processing of a document. The access control service 119 accesses a shared area by a plurality of users at the same time, And provides a locking method that can control access to the system.

FIG. 19 is a detailed flowchart of the application sharing service of FIG. 15 according to the present invention.

Application Sharing Service is a service that enables applications supported by a single user to be collaboratively supported by a large number of users distributed over the network. In order to process the application sharing service, the type of the service requested by the mutual participation application participating in the session is determined (120).

When the type of the service is determined, a process for providing the corresponding service is performed. The type of the service includes an initial setting service 121 for setting an initial environment for application sharing

The sharing control service 122 provides a service that allows the user to select between a time interval updated with a service that makes the necessary adjustments to provide a view of the shared application, whether to update, whether continuous update or simple update.

The shared access control service 123 provides a method of ordering access to a shared application and a service of locking.

The sharing end service 124 provides a service for releasing the application sharing environment setting performed in the initial setting service by interaction with the application sharing server.

20 is a flow diagram of a participant manager in accordance with the present invention.

The participant manager object is an object generated by the mutual-participation multimedia application development environment daemon that is remotely located in the invitation request of the session manager object. When the first participant manager object is created, invitation information and generation factor are analyzed 125.

When the object creation is completed, the participant manager object outputs an invitation message to the user (126), and determines whether or not to participate (127) with the data input by the user. If the user does not want to participate, the participant manager object is terminated. If the user participates in the session, information about the participant is requested to be transmitted to the invited session manager object from the remote place (128).

Next, the session manager 24 terminates the invitation, and transmits information about the participant to all participant managers. The participant manager object receives the transmitted participant information (129). Next, the participant manager object requests the media server to generate a media instance necessary for participating in the session included in the invitation information (130).

When a media instance is created, a response is received 131 from the media server to the participant manager 24 indicating that the media server instance has been created 131. The participant manager object registers the handle of the received media instance 132, The application program is executed (133).

In this way, the participant can request and receive a session management service from the participant manager 24 through the application. The object of the service provided by the participant manager 24 provides not only the application provided with the session management service of the participant manager in the same computer but also the service by interacting with the session manager object in the remote place.

When a service request is input 134, an event analysis is performed 135 to analyze the input service request. After the analysis of the event is completed, the type of the corresponding service is determined to provide the corresponding service (136), and a service such as the participant user service 137, the end service 138, or the media service 139 is performed do.

These services are continuously provided while the participant administrator and the session manager are connected. When the participant withdraws or the session is terminated by the session manager, the participant manager is destroyed after the completion of the termination service.

In addition, the participant manager is an object that plays a symmetrical role with the session manager, and the termination service and the mere service are implemented in almost the same manner as the session manager.

21 is a detailed flowchart of the participant maintenance service of FIG. 20 according to the present invention.

The Participant Retention Service performs a service regarding the Participant Survival Inspection Packet generated by the Session Manager 24 in response to the Participant Manager Object being alive and the Participant Information Update Service in the event of the withdrawal.

First, the type of the corresponding service is determined (140). In the type of service provided by the participant maintenance service, information on a withdrawer transmitted from a remote site when a withdrawer occurs is received in a session (141), and a service (142) (143), and transmits a participant survival response packet to the session manager (24) (144).

22 is a flowchart of an overall session manager according to the present invention.

The overall session manager object is used to arbitrate the network resources used by each session occurring on the network, to create a session monitor to monitor the status of each session, and to monitor all network traffic And the generation of a traffic monitor capable of monitoring the traffic monitor.

The entire session manager 28 can not participate in the session through the interactive application on the computer with the entire session manager 24 because it can not be run on one computer at the same time as the mutual participation multimedia application development environment daemon 22.

When the full session manager 28 is running, a traffic monitor is generated 145 and an audio playback server 146 is created in the session monitor 29 to support audio playback occurring in the session.

When the overall session manager object receives the network resource request generated from the mutual-participation multimedia application development environment daemon 22 at the remote location (150) until the end of the entire session manager object (147), the network resource required for session creation is stored in the existing active session (148) so as not to collide with the session to be generated later. The entire session manager 28 generates a session monitor 29 using the same network resources 150 that can monitor all the situations of the session since network resource allocation 150,

23 is a flowchart of a session monitor according to the present invention.

The session monitor 29 is a session management object that is generated by the overall session manager 28 and supports the overall status of the session.

When the session monitor 29 is created for the first time, the session monitor 29 analyzes a factor received from the overall session manager 28 and generates a communication path for monitoring all the traffic of the session (step 152)

The session monitor 29 supports the corresponding service by determining the type of the service to be provided and expressing the state of the session to the user (153).

The session monitor 29 determines whether the session is viable by interacting with the session manager 24. The session monitor 29 periodically transmits a session survival check packet to the session manager object. At this time, the session monitor 29 that has transmitted the session survival check packet records the number of times the response to the survival check packet has failed (155) by increasing the number of failures. At this time, it is determined whether the number of failures exceeds the allowable value (156). If the number of failures exceeds the allowable value, the session is determined to be inoperable and a packet requesting the forced termination service of the session is transmitted within the session (157) It is determined whether it is immediately terminated (164). If not terminated, it is repeatedly executed from the service type determination step (153).

However, if a session survival response packet is received in response to the session survival information transmission (158), the session monitor (29) initializes the number of failures (159), blocks the case in which the number of failures exceeds the allowable value, (164). If not, it is repeated from the service type determination step (153).

The session monitor 29 receives all the packets generated in the session 160 and determines the type of the received data (161). If the packet is media data, it is expressed through the media presentation layer (162), the traffic monitor 30 notifies the traffic occurrence (163), and if the packet is not media data, (163). By notifying the traffic monitor 30 of all packets thus received, the traffic monitor 30 can know the traffic of the network currently being generated. If it is not terminated, it is determined whether it is terminated (164).

INDUSTRIAL APPLICABILITY As described above, the present invention is applied to a distributed object-oriented collaborative environment (DOORAE) to reduce mutual participation application development costs and support a plurality of virtual networks in a single network. It is possible to create and participate in multiple sessions over a network in a single personal computer.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. It is not limited to the drawings

Claims (13)

A common application interface 21 which is generated in the course of registering an application and creating a session to receive a session management service for the first time, and which is commonly used by a plurality of mutually-participating multimedia applications as information paths; A mutual-participation multimedia application development environment daemon 22 for initializing each media server, generating the common application interface 21 to support application session creation, and allocating network resources by requesting network resource allocation; A session manager (24) generated by the mutual-participation multimedia application development environment daemon (22), for controlling a session and requesting creation of a media resource requested by an application; A private application interface (23) generated by the session manager (24) and used as a communication path between the interoperable application and the session manager (24) after a session is created; When the session is created, a virtual network independent of the other sessions is formed to provide a session management network service and a network service of the media resource, which are connected to the mutual-participation multimedia application development environment daemon 22 and the session manager 24 A network service provider 25; A media server that is in charge of an interface between the external media server and the session manager 240 to deliver the media resource requested by the session manager 24 to the media server and forwards the response of the media server to the session manager 24 An interface 26 for controlling a voice in a single session and adjusting a media control request of the session manager 24 requested through the media interface 26 and delivering the media control request to the media server 27; An overall session manager 28 for allocating network resources requested by the participating multimedia application development environment daemon 22 and controlling the network resources necessary for creating a session by controlling the technology service provider 25, The session manager 24, the media server, and the network service provider 25 are generated by the manager 28, And a traffic monitor (30) connected to the session monitor (29) for monitoring and outputting virtual network traffic of the session, the monitor monitor (29) being connected to monitor and adjust the overall situation of the session, Session Management System in Participatory Multimedia Application Development Environment. The system according to claim 1, wherein the session manager (24) comprises: a packet analyzer (32) for analyzing a packet transmitted through the network service provider (25); An event analyzer 31 for analyzing events input through the private application interface 23, the packet analyzer 32, and the media interface 26; A media instance controller (34) for performing control for media use of an application in a single session; A media server controller (35) requesting media resources from the media server for use of the media; And a session controller (33) for integrally controlling the event analyzer (31), the packet analyzer (32), the media server controller (35) and the media instance controller (34) Session management system in the environment. In a session management method applied to a session management system in a mutual participation multimedia application development environment, when a mutual participation application requests registration with a mutual participation multimedia application development environment daemon (22), the mutual participation multimedia application development environment daemon (22) A first step (36,37) of assigning a unique number of the application; When the interoperable application sends the session creation information to the mutual-participation multimedia application development environment daemon 22 through the common application interface 21 to request the generation of the session, the mutual-participation multimedia application development environment daemon 22 A second step (38,39) of registering an application in the session manager (28) and requesting allocation of network resources; A third step (40,41) of generating the session monitor (29) and simultaneously allocating the requested network resources to the mutual-participation multimedia application development environment daemon (22); The interoperable multimedia application development environment daemon 22 generates the session manager 24 with the allocated network resources and requests the generated session manager 24 to generate media resources for each media server 42, 43); The media server creates a media server instance using the network resource provided from the session manager 24 and transmits the handle to the session manager 24 in a fifth step (44, 45) ; And the session manager 24 notifies the session establishment result to the interoperable application through the private application interface 23 and the interoperable application requests the session management service to the session manager 24 A method for managing a session in a mutually-participating multimedia application development environment, comprising: 4. The method of claim 3, wherein the interoperable multimedia application development environment daemon (22) processes the multimedia application development environment daemon (22) when the interoperable multimedia application development environment daemon (22) A step (48 to 52) of receiving a response and registering the type of the media server and then judging whether the service requesting location is an application in the same computer or a remote application; As a result of the determination in steps (48) to (52), if the application is located on the same computer, the registration is requested from the application and the application is registered by assigning a unique number of the application usable by the application. (53 to 58) for requesting the allocation of network resources to the entire session manager (28) to generate a session manager (24) while receiving network resources; If it is determined in the steps (48 to 52) that the application is a remote application, the participant manager 24 receiving the session participation information from the initial session creator of the remote site and supporting the session management service of the application participating in the session is created The method of claim 1, further comprising the step of: The method according to claim 3 or 4, wherein the processing of the session manager (24) requests the media server to create a media server instance capable of using media resources required for the session, and registers the media server instance (61-64) of transmitting the registration information and its handle to the application later; A step (65 to 67) of interpreting the event when the service is requested and judging the kind of the service; And a session management service for maintaining / managing a session according to the determination result of the steps (63 to 67), repeats the steps from the steps (65) to (67) And a step (68 to 70) of performing a termination service for destroying the session, and terminating the termination service (68 to 70) after performing the steps of the steps (65 to 67) after performing the service. How to manage. 6. The method of claim 5, wherein the session management service of steps (68) to (70) comprises: (71) determining a type of the session management service; Performing an invitation service (72) for participating a participant in a session after the session is created according to the determination result of the step (71); Performing (73) a participant management service for managing a participant participating in a session according to the determination result of the step (71); And a step (74) of performing a session maintenance service to maintain a session by interaction with the session monitor (29) according to the determination result of the group (71) A method of session management. 7. The method of claim 6, wherein the invitation service in step (72) requests the user to input data necessary for invitation, and when the invitation data is input, the invitation service has information about the input data and media and network resources Transmitting invitation information to a mutual-participation multimedia application development environment daemon at a remote site (75, 76); Receiving information corresponding to the invitation until the invitation is terminated and registering the participant as a participant participating in the session (77, 78); And transmitting (80) all the information on the participant (s) currently participating to the participant manager (24) when the invitation is terminated (80). 7. The method of claim 6, wherein the participant management service in step (73) comprises: determining (81) the type of participant management service; (82) when the application (81) requests the viewing of the participant information as a result of the determination; A step (83-85) of deleting the information on the withdrawal from the session participant registration information and notifying the session that the withdrawer has occurred when the information indicating that the withdrawer has occurred in the session is determined as a result of the determination in step (81); As a result of the determination in step 81, if the participant survival check is performed, the participant survival inspection packet is periodically transmitted as a participant manager object. If the number of failures exceeds the allowable value, the session participant registration information is deleted, (84-88) if the number of failures does not exceed the tolerance; And a step (89, 90) of initializing the number of failures when a participant survival response packet is received as a result of the determination in step (81). 6. The method of claim 5, wherein the media service of steps (68-70) comprises: (97) determining a type of media service; A speech grant request service for supporting the utterance request of the application by audio in accordance with the determination result of the step (97), a floor granting service for giving up the present floor, a floor granting service for giving a voice by selecting a speaker, Performing audio services such as audio activation control services (98, 102 - 106); An image window addition service for adding an image according to a result of the determination in the step (97), an image window deletion service for deleting an activated image window, an image window sorting service for aligning a plurality of images in a balanced manner, Such as a frame rate service, a photo taking service that saves a picture of itself as a file, a video adjustment service that establishes a relationship between the video capture board and the camera, and an overlay adjustment service that adjusts the brightness, Performing (99, 107-114) a video service; A drawing service capable of drawing a picture in a shared work area, a character editing service capable of using a character, a file related service responsible for file processing, and a shared area, Performing a whiteboard service (100, 115 to 119) such as an access control service that provides a sequencing of an occurrence of a case and a locking method that can control access to a specific user when accessing the same at the same time; And an initial environment for application sharing according to a result of the determination in step (97), a sharing control service for adjusting necessary to provide a view of a shared application, (101, 120-124) of performing an application sharing service such as a method for ordering, a sharing access control service for locking, and a sharing end service for canceling an application sharing configuration. Session Management Method in Participatory Multimedia Application Development Environment. 5. The method according to claim 4, wherein the participant manager (24) of the step (59, 60) analyzes the invitation information and the generation factor when the participant manager (24) is created and outputs an invitation message to the user, A step 125 to 127 of terminating the participant manager 24 if the participant judges participation with the input data and the user participates; If it is determined in steps 125 to 127 that the participant is participating in the session, the step of requesting the participant information transmission and receiving the participant information, 131); Receiving a service request after registering a handle of a received media instance and executing an application program, interpreting the event to determine the type of service (132 to 136); And a step (137 to 139) of executing a participant maintenance service, a termination service, or a media service according to the determination result of the steps (132 to 136). . 11. The method of claim 10, wherein the participant maintenance service of steps (137-139) comprises: (10) determining the type of participant maintenance service; A step (141, 142) of receiving information on a withdrawer transmitted from a remote site in a session when a withdrawal occurs in accordance with the determination result of step (140), and deleting information about a withdrawer currently possessed; And a step (143, 144) of receiving a participant survival inspection packet generated periodically from the session manager (24) according to the determination result of the step (140) and transmitting a participant survival response packet to the session manager (24) Wherein the session management method comprises the steps of: 4. The method of claim 3, wherein the processing of the overall session manager (28) comprises: generating (145,146) an audio playback server capable of supporting audio playback after creating the traffic monitor (30); And generating (147-150) the session monitor (29) after receiving and allocating a network resource request generated from the mutual-participation multimedia application development environment daemon (22) Session Management Method in Participatory Multimedia Application Development Environment. 13. The method of claim 12, wherein the process of the session monitor (29) analyzes a factor received from the overall session manager (28) to generate a communication path capable of monitoring all traffic of the session, (151 to 153); As a result of the determination in steps 151 to 153, if the session survival check is performed, the session survival inspection packet is periodically transmitted to the session manager 24 to increase the number of failures. If the number of failures exceeds the allowable value, (154 to 157, 164) of judging whether the number of times of failure is an end or not if the number of failures does not exceed the allowable value; Receiving a session survival response packet as a result of the determination in steps (151) to (153), determining (158, 159, 164) whether the number of failures is initialized and then terminated; As a result of the determination in steps 151 to 153, if a packet in the session is received, the type of data is determined. If the packet is media data, the traffic is notified to the traffic monitor 30 (160-164) informing the traffic monitor (30) of the occurrence of traffic and determining whether the traffic is terminated if the traffic data is not media data; And determining whether the session is ended or not, and if the session is not terminated, repeating the steps of determining the type of service of the steps (151 to 153) , ※ Note: It is disclosed by the contents of the first application.