KR100186959B1 - Management system in application development of mutual engagement - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

Session management system and method for supporting session management and control of media resources required for developing interactive multimedia applications

2. The technical problem to be solved by the invention

Increasing the development cost of the application, there was a problem that media resources conflict when creating multiple sessions.

3. Summary of Solution to Invention

In an interactive participant multimedia application development environment that supports simultaneous creation, maintenance, and destruction of sessions required for session management according to the service requirements of an application, and simultaneous control of media to allow multiple applications to simultaneously access a limited resource of media. To provide a session management system and method thereof.

4. Important uses of the invention

Used to create multiple sessions over a network on a single personal computer.

Description

Session Management System and its Method in an Interactive Participation Development Environment

The present invention relates to a session management system and method for supporting session management and control of media resources required for developing mutually participating multimedia applications in a distributed environment.

In the case of conventional multimedia applications it is generally used by a single user on a single platform. Session management for a multimedia application used by a single user only requires management of users who use the application asynchronously on an independent platform.

However, in the case of a session in which collaboration is performed through a multimedia application by a plurality of users in a distributed environment, there is a problem in that the session cannot be managed by simply recording user information or access control function.

In the case of collaborating multiple sessions on a single platform using a plurality of multimedia interactive applications, a part of performing a service such as creating, maintaining, and destroying a session to each application and a media service used in the application are conventionally used. This increases the development cost of the application because the parts it provides must be completely contained within the application itself, and the application is not considered structurally interoperable with other applications on one platform. There was a problem that media resources conflicted when creating a session.

The present invention devised to solve the above problems is the simultaneous control of the media to allow a plurality of applications to simultaneously access the service, such as the creation, maintenance, destruction of the session required for session management according to the service request of the application and a limited resource media Session in an interactive participant multimedia application development environment that performs comprehensive management of sessions required for interactive participant application development, including voice control required for media control between multiple users in a single session and network management services required for distributed environments. Its purpose is to provide a management system and method thereof.

The apparatus of the present invention for achieving the above object is generated in the process of registering an application and creating a session for the first time to receive a session management service, so that a plurality of mutually participating multimedia applications commonly used as an information path. Common application interface; A mutually participating multimedia application development environment daemon for initializing each media server, generating the common application interface to support session creation of an application, and requesting allocation of network resources and allocating network resources; A session manager generated by the interactive participant multimedia application development environment daemon to control a session and request generation of a media resource requested by the application; A private application interface generated by the session manager and used as a communication path between the mutually participating application and the session manager after a session is created; A network service provider connected to the interactive participant multimedia application development environment daemon and a session manager to provide a session management network service and a network resource of a media resource by forming a virtual network independent of other sessions when a session is created; A media interface in charge of an interface between an external media server and the session manager to transmit the generation of a media resource requested by the session manager to the media server, and to transmit a response of the media server to the session manager; A floor control controller that controls a floor space within a single session and coordinates and delivers a media control request of the session manager requested through the media interface to the media server; An entire session manager for allocating network resources requested by the interactive participant multimedia application development environment daemon and controlling the network service provider to arbitrate network resources necessary for creating a session; A session monitor generated by the entire session manager and connected to the session manager, the media server, and a network service provider to monitor and coordinate the overall situation of the session; And a traffic monitor connected to the session monitor to monitor and output traffic of the virtual network of the session.

In the method of the present invention for achieving the above object, in the session management method applied to the session management system in the mutual participation multimedia application development environment, if the mutual participation application requires registration as the mutual participation multimedia application development environment daemon, The participatory multimedia application development environment daemon comprises the first step of assigning a unique number of applications; When the mutual participant application transmits session creation information to the mutual participant multimedia application development environment daemon through a common application interface and requests creation of a session, the mutual participant multimedia application development environment daemon registers the application in the entire session manager. A second step of requesting allocation of network resources; The third session manager generates a session monitor and simultaneously allocates the requested network resources to the interactive multimedia application development environment daemon; A fourth step of generating a session manager using the allocated network resources, and the created session manager requesting each media server to create a media resource; The media server creating a media server instance by using the network resources granted from the session manager, and the created media server instance sends a handle to the session manager; And the session manager notifies the mutually participating application of a session establishment result through a private application interface, and the mutually participating application includes a sixth step of requesting a session management service to the session manager.

1 is a conceptual diagram illustrating a case where the present invention is applied to a computer distributed through a network;

FIG. 2 is a diagram illustrating a relationship in which service objects for providing a session management service are located at each computer on a network.

3 is a schematic configuration diagram to which the present invention is applied in an interactive participatory multimedia application development environment;

4 is a detailed block diagram illustrating a relationship between a media resource and a session management service in an interactive participatory multimedia application development environment;

5 is a detailed configuration diagram illustrating a relationship between objects providing a session management service according to the present invention in an interactive participatory multimedia application development environment;

6 is a detailed configuration diagram of a session manager among session management service objects according to the present invention;

7 is a state transition diagram illustrating a scenario in which a mutual participation application creates a session by a session management service;

8 is a flowchart of an interactive participant multimedia application development environment daemon according to the present invention;

9 is a flowchart of a session manager according to the present invention;

10 is a detailed flowchart of the session management service of FIG. 9 according to the present invention;

11 is a detailed flowchart of the invitation service of FIG. 10 according to the present invention;

12 is a detailed flowchart of the participant management service of FIG. 10 according to the present invention;

13 is a detailed flowchart of the session maintenance service of FIG. 10 according to the present invention;

14 is a detailed flowchart of the termination service of FIG. 9 according to the present invention;

15 is a detailed flowchart of the media service of FIG. 9 according to the present invention;

16 is a detailed flowchart of an audio service of FIG. 15 according to the present invention;

17 is a detailed flowchart of the video service of FIG. 15 according to the present invention;

18 is a detailed flowchart of the whiteboard service of FIG. 15 in accordance with the present invention;

19 is a detailed flowchart of the application sharing service of FIG. 15 according to the present invention;

20 is a flowchart of a participant manager according to the present invention;

21 is a detailed flowchart of the participant retention service of FIG. 20 according to the present invention;

22 is a flowchart of an entire session manager in accordance with the present invention;

23 is a flow chart of a session monitor according to the present invention.

* Explanation of symbols for the main parts of the drawings

20: Session Management Service 21: Common Application Interface

22: interactive participatory multimedia application development environment daemon

23: Private Application Interface 24: Session Manager

25: network service provider 26: media interface

27: Speech Controller 28: Full Session Manager

29: Session Monitor 30: Traffic Monitor

Hereinafter, with reference to the accompanying drawings will be described an embodiment according to the present invention;

1 is a conceptual diagram illustrating a case where the present invention is applied to a computer distributed through a network.

In the present invention, the comprehensive management function of the session required for the mutual participant application development is configured in the form of middleware of the application and the operating system.

In the figure, five computers form a network. Each computer has service objects for supporting session management services, and provides services required by mutually participating applications through interworking of distributed session management service objects through a network.

Computer 1, Computer 2, and Computer 4 are participating in Session A, and Computer 2, Computer 3, and Computer 4 and Computer 5 are participating in Session B. At this time, computer 2 and computer 4 are simultaneously participating in session A and session B. The session management service of the interactive participatory multimedia application development environment (Dure) can thus enable multiple sessions on one computer. The necessary media resources also support simultaneous control by applications that participate in multiple sessions rather than exclusive use of one session.

FIG. 2 is a diagram illustrating a relationship in which service objects providing a session management service are located in each computer on a network.

In an interactive participatory multimedia application development environment, there are objects that must be enabled on the computer to provide session management services to the application. In FIG. 2, a computer in which a single full session manager exists in a single LAN is required, as in the computer 6, and a traffic monitor for monitoring network traffic occupied by each session is generated in the computer 6 having the full session manager. Each time a session is created in an interactive participatory multimedia application development environment, a session monitor is created by the entire session manager to monitor all the situations in which the session proceeds.

In addition, all computers 7, 8, and 9, except for computer 6, which has a full session manager to receive session management services, must have a interactive participant development environment (Dure) daemon. The interactive participant multimedia application development environment (Dure) daemon supports the service for creating a session by interacting with the entire session manager when the first application is activated, and is a session management service that first encounters invitation messages from remote locations. Object. The objects created by the interactive participant multimedia application development environment (Dure) daemon include the session manager object and the participant manager object. When the application runs independently and creates a session, the interactive participant multimedia application development environment (Dure) daemon A session manager object is created, and a participant manager is created on the participant side participating in the session in response to the invitation.

In the figure, the computer 6 includes the entire session manager object, the session monitor, and the traffic monitor. In the computer 7, the session manager object is created because the session is initialized by executing a mutually participating application. In addition, Computer 8 and Computer 9 have participated in the session created by Computer 6, and the Participant Manager is created by the interactive participant multimedia application development environment (Dure) daemon.

FIG. 3 is a schematic configuration diagram to which the present invention is applied in an interactive participatory multimedia application development environment, and illustrates locations of session management service objects supporting an application service for an operating system and each media server in one computer.

In the drawings, 1 is an interactive participant application, 2 is an interactive participant multimedia application development environment (circle), 3 is a media server, 4 is a session management service, 5 is an operating system, 6 is a camera, 7 is a microphone, 8 is a video capture board, 9 denotes a sound card and 10 denotes a network card.

The platform to which the present invention is applied is an IBM computer compatible model, and the operating system 5 uses an operating system (eg, Windows 95 or Windows Entity) that supports Win32 and WinSock Version 1.1 or later. The type of media can be any media server 3 having the same media interface as the session management service 4, so it does not matter as long as it has only a protocol with the designated session management service object using any hardware.

The session management service 4 provides access to media and services such as creating, maintaining, and destroying sessions for a number of mutually participating applications 1. Service requests received from the application 1 are serviced by interaction with the media server 3 and the system services of the operating system 5 and with session management service objects at remote locations.

The network card 10 should use a device driver that can be registered in the system and use Ethernet having a speed of 10M bits / second. The video capture board 8 and the sound card 9 are determined according to the design of the media server 3 dependent on each media card, and thus, regardless of which session management service is used. However, the media server 3 designed by the interface of the media card must observe the interface provided for receiving the session management service 4. The mutual participant application 1 may be provided with the session management service 4 provided by the present invention only if the application complies with the interface for receiving the session management service 4.

In general, devices such as the video capture board 8 and the sound card 9, including the network card 10, are serviced by applications 1 that are managed by the operating system 5 and require use by designated system functions. It is done. In the case of network resources, unlike video capture board 8 or sound card 9, services of multiple applications can be simultaneously provided, but video resources or sound resources do not allow access of multiple applications at the same time. Therefore, the media simultaneous control, which is a part of the session management service 4 provided by the present invention, has a media server 3 for each resource and allocates a media resource corresponding to the media server 3, and then the session management service ( Through the interface with 4) it is possible to provide a service to a plurality of applications (1) at the same time. At this time, the session management service 4 supports access to media resources by means of an independent speech right for each application 1 so that it can arbitrate with other participants in the session.

The session management service 4 also provides session control services for a number of applications, each of which forms an independent virtual network, providing services for creating sessions within the corresponding virtual network, as well as individual management services and sessions for participants. The service for maintenance of the whole and the destruction of the session are serviced according to the needs of the application, or even if not required.

4 is a detailed block diagram illustrating a relationship between a media resource and a session management service in an interactive participant multimedia application development environment, in which FIG. 11 is an interactive participant multimedia application development environment, 12 is an audio server instance, 13 is a video server instance, and FIG. 14 represents a white server instance, 15 represents an application sharing server instance, 16 represents an audio server, 17 represents a video server, 18 represents a white server, 19 represents an application sharing server, and 20 represents a session management service.

The interactive participant multimedia application development environment (Dure) 11 includes session management service modules 20 for session management and various types of media servers for providing media services, and media dedicated to media services of corresponding applications. There is a service instance. Types of media provided by the interactive participatory multimedia application development environment (Dure) 11 include an audio server 16 supporting two-way voice, a video server 17 supporting multiple video windows, and a shared area by event exchange. There is a white server 18 to support a, and an application sharing server 19 to support a single application to be collaborated by multiple users. In addition, the audio server instance 12, the video server instance 13, the white server instance 14, and the application sharing server instance 15, which are dedicated to the media service for each session, are created at the media server level as each session is created. Is provided.

The interactive participatory multimedia application development environment (Dure) 11 provides a server for each media required to use these media resources, which is more effective than the application directly accessing such media. By requesting a media service to a media server, multiple applications can simultaneously allocate and use media resources, which has the advantage that they can be used exclusively at the same time in multiple sessions on a single computer.

In the drawing, the mutual participant application requests media resources required when initially creating a session. At this time, the session management service 20 requests each media server to create a server instance, and the server, which is requested to create the instance, creates a media server instance that can access the server, and handles the session management service. Pass in an object for 20.

5 is a detailed block diagram illustrating a relationship between objects providing a session management service according to the present invention in an interactive participatory multimedia application development environment, in which 20 is a session management service, 21 is a common application interface, and 22 is a mutual participant multimedia application. The development environment daemon, 23 is a private application interface, 24 is a session manager, 25 is a network service provider, 26 is a media interface, 27 is a talk controller, 28 is a full session manager, 29 is a session monitor, and 30 is a traffic monitor.

The session management service 20 in an interactive participatory multimedia application development environment (Dure) is an interface between an interactive participant, a media server, and an operating system. Provided by interaction. In order to provide such a service, a consistent interaction between various configuration modules is required. FIG. 5 illustrates in detail the interaction relationship between all configuration modules required for the session management service.

Initially, when an interactive participant application receiving session management service is executed in the interactive participant multimedia application development environment (Dure), the application is provided with an interface for accessing the interactive participant multimedia application development environment (Dure). In this case, the interface used by the application is referred to as a common application interface 21. In the process of registering an application and creating a session for mutually participating applications to receive session management services for the first time, the common application interface 21 is a mutually participating multimedia application. Created by an object called development environment daemon 22, a number of interactive multimedia applications can be commonly reused. The common application interface 21 includes handles for the interactive participant multimedia application development environment daemon 22 to access the application, handles for the application to access the interactive participant multimedia application development environment daemon 22, and unique variables of the application. In addition, it provides a path for exchanging information on the allocation of network resources required for subsequent session establishment.

The interactive participant multimedia application development environment daemon 22 is an object that initializes each media server so that a subsequent session can be used, and services a service for a process in which an application creates a session through a common application interface 21. When the interactive participant multimedia application development environment daemon 22 receives a session creation request from the application through the common application interface 21 and the necessary data for creating the session, the entire session manager 28 allocates network resources required for session creation. Upon request and allocation of network resources required for session creation from the entire session manager 28, a session manager 24 will be created which will then be dedicated to the session service of the application. If the application is requested to participate in a session created remotely rather than to create a session, the interactive participant multimedia application development environment daemon 22 generates a participant manager object instead of a session manager object. Supporting the function of controlling the media server to provide the media service to the user is the same as the session manager object, but is passively managed by the session management service performed by the session manager object.

The session manager or participant manager 24 generated by the interactive participant multimedia application development environment daemon 22 then creates a private application interface 23 for interaction with the applications required to provide session management services. The media server 26 requests the media server to generate a media resource requested by the application through the application interface 23.

The private application interface 23 is exclusive to the data exchange and application such as the type of media resource required by the application, the media manager that the session manager can support, the name of the session, and the information of the participants participating in the current session. Used to request session management service.

The network service provider 25 is a service module necessary for session management. When a session is created, the network service provider 25 forms a virtual network independent of other sessions and provides all network services necessary for session management. The network service provider 25 also provides not only session management services but also network services of media resources required for sessions.

The media interface 26 is an interface between the media server and the session manager 24 for controlling media through the session management service. Access to the media is communicated to the media server by the floor controller 27 via the media interface 26, and the response to the service enters the session manager (participant manager) 24 via the media interface 26. .

The talk right controller 27 is a service module that independently provides a talk right method between participants required in the session management service for each session. The talk right method set through the designated talk right controller 27 before all media control requests are transmitted to the media server. Is adjusted to the control in conformity with

The entire session manager 28 controls the network service provider 25 to mediate network resources necessary for creating a session, and also performs a process of creating a session monitor 29 object. The session monitor 29 generated from the entire session manager object is uniquely generated for each session, which is connected to the session manager 24 to monitor and coordinate the overall situation of the session. It is connected to the network service provider 25. The traffic monitor 30 provides a service for monitoring the traffic of the virtual network that all sessions have, and manages the network load of the session with various types of outputs.

6 is a detailed configuration diagram of a session manager among session management service objects according to the present invention, in which 31 is an event interpreter, 32 is a packet interpreter, 33 is a session controller, 34 is a media instance controller, and 35 is a media server controller. Represent each.

The session manager 24 primarily interacts with the application through the private application interface 23, with the media server via the media interface 26, and with other participant managers via the network service provider 25. Communication with the session monitor.

The session manager 24 is composed of an event interpreter 31, a packet interpreter 32, a session controller 33, a media instance controller 34, and a media server controller 35, all of which communicate with other modules. A packet coming in through the event interpreter 31 but transmitted to the network enters the event interpreter 31 through the packet interpreter 32.

The packet interpreter 32 analyzes a corresponding packet in a process of communicating a message with a participant manager at a remote location. The packet interpreter 32 maintains a session generation packet and a session generated during a session creation. There are packets that occur in the process and packets that are needed to destroy the session. In addition, there is a packet required for controlling the voice. This packet is generated when the session controller 33 controls the necessary voice on the session with the remote participant manager. The analyzed packet is the session controller 33. The media interface 26 is passed through the media instance controller 34 after the processing of. The media server controller 35 is responsible for the control of each corresponding media server, and the control for the media service of the actual application is performed through the media instance controller 34.

7 is a state transition diagram illustrating a scenario in which a mutual participation application creates a session by a session management service.

When the application is executed for the first time, the application finds the existence of the interactive participant development environment daemon object and requests registration as an application (36). The interactive participant multimedia application development environment daemon 22 assigns a unique number of an application available on the platform (37), and the unique number of the assigned application becomes a key for accessing the private application interface 23.

Next, the application informs the interactive participant multimedia application development environment daemon 22 of the media resource required for the creation of the session and the right of speaking, and the like through the common application interface 21 and requests the creation of the session (38). At this time, the interactive participatory multimedia application development environment daemon 22 registers an application with the entire session manager 28 and requests the allocation of network resources necessary for creating a session (39).

The entire session manager 28 allocates the necessary network resources, generates a session monitor 29 for monitoring the session, and simultaneously allocates the requested network resources to the interactive participant multimedia application development environment daemon 22. (41). The interactive participant multimedia application development environment daemon 22 generates a session manager 24 with the allocated network resources (42), and the generated session manager 24 issues a creation request for the requested media resource to each media server. Ask the user to create via the specified network resource (43).

The media server creates a media server instance 44 to perform a service for a media resource to be requested from an application by using the network resource granted from the session manager 24 (44). When the media server instance is created, the server instance notifies the session manager 24 that the media server instance has been successfully created. At this time, the server instance passes a handle to access the media server instance (45).

When all necessary preparations for session creation are complete, session manager 24 informs 46 that the session has been established with the application via private application interface 23. The application may then request all services for the session through session manager 24 (47).

8 is a flowchart of an interactive participant multimedia application development environment daemon according to the present invention.

The computer for receiving session management runs the interactive participant multimedia application development environment daemon 22 before executing the interactive participant application (48). At this time, the interactive participant multimedia application development environment daemon (22) finishes initial preparation for its activation and executes the media server by referring to the media server information of the file already registered (49). Pass a handle to access the application development environment daemon (22).

The media server activated by the interactive participant multimedia application development environment daemon (22) indicates that it can now support the session management service of the interactive participant multimedia application development environment. It responds to the daemon 22 (50) and then passes a handle for the service request to the server. After receiving a response from the media server, the interactive participant multimedia application development environment daemon 22 registers a type of media server that can be used, and then supports a service only for resources currently registered among media resources requested by the application.

The interactive participant multimedia application development environment daemon (22) is a service 52 to distinguish whether the application requesting the application on the same computer or a remote application (52).

In the case of an application on the same computer, a process of requesting registration to access the interactive participant multimedia application development environment daemon 22 from the application is required, which is generated by the interactive participant multimedia application development environment daemon 22. This is done through the common application interface 21. The mutual participation multimedia application development environment daemon 22, which is requested to register from the application 53, registers the application by assigning a unique number of the application that the application can use (54). Next, an application may request the creation of a session for an interactive participant through the interactive participant multimedia application development environment daemon (22), where the interactive participant multimedia application development environment daemon (22) provides resource information of the media and network required for session creation. It can be seen. The interactive participant multimedia application development environment daemon 22 requesting the session creation from the application (55) requests the allocation of network resources necessary for the session creation to the entire session manager 28 (56) and receives the network resources. (58) Create a session manager that will be in charge of all session management services of the application (58). This concludes the interaction with the application to provide the service.

If an invitation packet is received from a remote site (59), the interactive participant multimedia application development environment daemon (22) provides a session management service of an application that participates in a session with information required for session participation transmitted by the initial session creator of the remote site. Create a supporting participant manager 24 (60).

9 is a flowchart of a session manager in accordance with the present invention.

When the session manager 24 is generated by the interactive participant multimedia application development environment daemon 22, the media manager 24 requests each media server to create a media server instance that can use the media resources required for the session received at the time of creation. When the media server is requested to create a media server instance from the session manager 24, the media server creates a media server instance that can access the media server, and uses the handle of the session manager object that receives the handle of the created server instance as an argument. Respond 62.

The session manager object can provide session management services from now on to applications that have requested session creation by registering (63) that the session manager object is available for the media resource it received and notifying the application of its properties and its handle (64). You will be notified.

Thereafter, the session manager object repeatedly performs a process of continuously servicing a service required by the session manager object, and the service request is made by applications that are targets of a remote participant manager object, a session monitor, and a session management service.

When a service is requested (65), the event is first interpreted (66) to determine what service to provide. After the event analysis step, the type of service is determined to perform the corresponding service (67). Depending on the result of the determination, the session management service 68 for maintaining and managing the session, the termination service 69 for destroying the session, or the media service 70 for servicing access to the media resource of the corresponding application are executed. .

10 is a detailed flowchart of the session management service of FIG. 9 in accordance with the present invention.

In order to perform the session management service, first, the type of the corresponding session management service is determined (71). Based on the determination result, the session may be maintained by an invitation service 72 for inviting a participant to the session after creation of the session, a participant management service 73 for managing a participant participating in the session, or a session monitor. Perform session maintenance service 74.

11 is a detailed flowchart of the invitation service of FIG. 10 in accordance with the present invention.

After the session is created, the application can request an invitation service to the session manager object to recruit participants to perform the collaboration. The service for this request is the invitation service.

When the invitation service is started and the user inputs the necessary data for the invitation and the invited data is input (75), the interactive participant multimedia application development with information about the received data and media and network resources necessary for participation in the session The invitation information is sent to the environment daemon 22 (76).

After transmission of the invitation information, until the invitation is terminated (79), information corresponding to the remote invitation is received (77), and a participant therefor registers as a participant participating in the session (78). When the invitation is terminated (79), all information on the currently participating participants is transmitted to the participant manager object (80).

12 is a detailed flowchart of the participant management service of FIG. 10 in accordance with the present invention.

After performing the invitation service of the application, the session management service performs the service for managing the participants participating in the session.The participant management service requests the output of the participant information requested by the application, the withdrawal process, and the participant survival test. There is a process.

In order to perform the participant management service, first, a type of a corresponding service is determined (81). In this case, when the application requests reading of the participant information, the participant information is output (82), and when the information that the withdrawal has occurred at a remote location is received in the session (83), the participant information is deleted from the session participant registration information (83); 84. Inform the session that the withdrawal has occurred (85).

On the other hand, the participant survival check is continuously performed to check that the participant is unable to participate in the session anymore due to abnormal circumstances (eg disconnection of the network, down of the computer, etc.). The survival check packet is periodically transmitted to the participant manager object (86). The number of times the Participant Survival Check packet is transmitted is indicated as the number of failures, and each time the packet is transmitted, the number of failures is increased (87) and it is determined whether the allowance has been exceeded (88). It is deleted from the information (84) and notified in the session that the withdrawal has occurred (85) and returns if the allowance has not been exceeded.

However, if the participant survival test packet is transmitted and the participant survival response packet is received (89), the number of failures is reinitialized (90) to prevent the case where the allowance is exceeded.

13 is a detailed flowchart of the session maintenance service of FIG. 10 in accordance with the present invention.

The session manager is also managed by the session monitor in the same way that the management of the participants participating in the session is done by the session manager. In the session maintenance service, the session monitor 29 generated by the entire session manager 24 performs a survival test of the session, and when the session manager 24 receives such a session survival check packet (91), it receives the received packet. The packet is analyzed (92) and sent to the session monitor 29 informing that the session is alive (93).

14 is a detailed flowchart of the termination service of FIG. 9 in accordance with the present invention.

The session manager 24 also supports a termination service for the session, such as providing a session creation service when the application that created the session is terminated. This termination service destroys the media server instance used in the session (94) and informs each participant manager object that the session has ended, informing participants in the session that the session has ended (95) and finally destroying the session manager object itself. (96).

15 is a detailed flowchart of the media service of FIG. 9 in accordance with the present invention.

The session management service provides a media access request from the application in interaction with the media server instance to support the media service for the application. The type of media resource required for supporting a media service is first determined (97).

Based on the result of determining the type of media resource required, the media server instance is adjusted to perform the media service requested by the application in the media interface capable of performing the corresponding media service. ), Whiteboard service 100, or application sharing service 101.

16 is a detailed flowchart of the audio service of FIG. 15 in accordance with the present invention.

In order to provide an audio service, a type of a requested service is first determined (102). When the type of service to be provided is determined, the corresponding service is provided from the voice request service 103, the voice renunciation service 104, the voice transfer service 105, or the audio activation control service 106. At this time, the service regarding the right to speak is acted on by the speaking right method used in the current session.

The floor request service 103 is a service requesting when an application wants to speak through audio. The floor right request method supported by the session management service (no arbitration method, chair moderation method, token delivery method, time limit method, priority method) Support by interacting with a remote participant manager.

The disclaimer service 104 is a service for disabling speaking through audio in a session from now on when the speaker has a voice.

The right to speak delivery service 105 is a service in the case of a specific speaking right (chairman arbitration, token delivery), and then provides a service to select a talker and give the right to speak to the corresponding participant.

In the case of using audio, the sampled data should be transmitted only in the case of speaking without distinguishing the speech from the speech in order to reduce the traffic of the network. However, in order to support such a method, a variable for distinguishing between a spoken case and a non-ceeded case is required, and the audio activation adjusting service 106 is a service that allows to adjust such a variable for each system.

17 is a detailed flowchart of the video service of FIG. 15 in accordance with the present invention.

In order to support a service required to use an application's video resource, the type of service is first determined (107). The following services are executed according to the judgment result.

The video service includes a video window adding service 108 that selects a participant and adds an image. On the contrary, a video window deleting service 109 selects a participant and deletes a currently activated video window.

The image window alignment service 110 provides a service of displaying a plurality of images in a balanced manner when a plurality of image windows are added.

The frame rate control service 111 is a service for supporting a function of adjusting a frame occurring per second of a video image, and the photo taking service 112 is a case where a picture of a participant needs an individual's photo such as a user registration or user registration. It provides a service to save a picture of itself to a file for use.

The video adjustment service 113 provides a service for establishing a relationship between the video capture board and the camera, and the overlay adjustment service 114 provides a service for adjusting the brightness, density, contrast, color, and the like of the image.

18 is a detailed flowchart of the whiteboard service of FIG. 15 in accordance with the present invention.

The white service is a service that provides a workspace where all participants in a session can work collaboratively. In order to perform the white service, first, the type of service required by the application is determined (115). The following services are executed according to the judgment result.

The white service includes a drawing service 116 that provides a service for drawing a picture in a shared work area, and a text editing service 117 that provides a service for a part using a character other than a picture.

In addition, the white service includes a file-related service 118 that handles file processing for a document, and the access control service 119 provides an ordering of event occurrence and a specific user when multiple users simultaneously access a shared area. Provides a locking method to control access to the system.

19 is a detailed flowchart of the application sharing service of FIG. 15 according to the present invention.

An application sharing service is a service that enables applications supporting a single user to be collaborated by multiple users distributed over a network. In order to process the application sharing service, first, the type of service requested by the mutual participation type application participating in the session is determined (120).

When the type of service is determined, a process for providing a corresponding service is performed. There is an initial setting service 121 that sets an initial environment for application sharing.

The sharing control service 122 is a service for adjusting a service required to provide a view of a shared application. The sharing control service 122 provides a service for selecting a time interval, update, continuous or simple update, and the like.

The shared access control service 123 provides a method for ordering access of a shared application and a service for locking.

The sharing end service 124 provides a service for releasing an application sharing environment setting performed in the initial setting service by interaction with an application sharing server.

20 is a flowchart of a participant manager in accordance with the present invention.

The participant manager object is an object created by the interactive participant multimedia application development environment daemon that is remote to the request of the session manager object. When the first participant manager object is created, the participant manager object analyzes the invitation information and a generation factor (125).

When the object creation is completed, the participant manager object outputs an invitation message to the user (126) and determines whether to participate with the data input by the user (127). If the user does not want to participate, the participant manager object is terminated, and if the user participates in the session, information about the participant is requested to be transmitted to the session manager object invited from a remote location (128).

Next, the session manager 24 transmits the information about the participant to all the participant managers participating in the invitation, and the participant manager object receives the transmitted participant information (129). Next, the participant manager object requests the creation of a media instance necessary to participate in the session in the invitation information to the media server (130).

When the media instance is created, a response is sent from the media server to the participant manager 24 stating that the media server instance has been created (131). The participant manager object registers the handle of the responded media instance (132) Run the application (133).

This allows the participant side to request and receive session management services from the participant manager 24 through the application. The target of the service provided by the participant manager 24 is not only an application that receives the session management service of the participant manager on the same computer, but also provides a service by interacting with a remote session manager object.

When a request for a service is input (134), an event analysis for analyzing the input service request is performed (135). After the interpretation of the event, in order to provide a corresponding service, the type of the corresponding service is determined (136), and according to the result, a service such as participant maintenance service (137), termination service (138), or media service (139) is performed. do.

These services are continuously provided while the participant manager and the session manager are connected, and the participant manager is destroyed when the participant leaves or terminates the session by the session manager.

In addition, the participant manager is an object that plays a symmetrical role with the session manager, and the termination service and the media service are implemented in a form similar to that of the session manager.

21 is a detailed flowchart of the participant retention service of FIG. 20 in accordance with the present invention.

The participant maintenance service performs a service regarding responding that a participant manager object is alive to a participant survival check packet generated by the session manager 24 and updating participant information when a participant occurs.

First, the type of the service is determined (140). The types of services provided by the Participant Retention Service include a service and a session manager (141) for receiving information about the withdrawal sent from a remote place when a withdrawal occurs in a session (141) and deleting the information about the withdrawal currently owned (142). There is a service that receives 143 a participant survival check packet that is periodically generated (143) and transmits a participant survival response packet to the session manager 24 (144).

22 is a flowchart of an overall session manager in accordance with the present invention.

The entire session manager object is the mediation of the network resources used by each session on the network, the creation of a session monitor to monitor the status of each session, and the network traffic generated by the interactive sessions of the multimedia application development environment. Responsible for the creation of traffic monitors that can be monitored.

Since the full session manager 28 cannot run on a single computer at the same time as the interactive participant multimedia application development environment daemon 22, the computer with the full session manager 24 cannot participate in a session through the interactive participant application.

When the full session manager 28 is executed, it generates a traffic monitor (145) and the session monitor 29 creates an audio playback server capable of supporting audio playback occurring in the session (146).

Subsequently, when the entire session manager object receives the network resource request generated from the remote participant multimedia application development environment daemon 22 until the termination (150) (147), the network resource necessary for generating a session is allocated to the previously activated session. The allocation is performed so as not to conflict with a session to be created later (148). The entire session manager 28 generates a session monitor 29 using the same network resource, which can monitor all situations of the session after network resource allocation (150).

23 is a flowchart of a session monitor according to the present invention.

The session monitor 29 is a session management object created by the entire session manager 28 to assist in viewing the overall situation of the session.

The session monitor 29 analyzes the factors received from the entire session manager 28 when it is first generated (151) and generates a communication path capable of monitoring all traffic of the session (152).

The session monitor 29 determines the type of service to be provided to the user by expressing the situation of the session (153) and supports the corresponding service.

The session monitor 29 determines whether the session survives by interacting with the session manager 24. The session monitor 29 periodically transmits a session survival check packet to the session manager object (155). At this time, the session monitor 29 that transmits the session survival check packet records the number of failures in response to the survival check packet so far by increasing the number of failures (155). In this case, if it is determined that the number of failures exceeds the allowance (156), the session is determined to be inoperable and the packet for requesting the forced termination service of the session is transmitted in the session (157). If not, it is determined whether the service is terminated immediately (164). If not, the service type determination step 153 is repeated.

However, if a session survival response packet is received in response to the transmission of session survival check information (158), the session monitor 29 initializes the number of failures (159) and terminates after preventing the number of failures from being forcibly terminated beyond the tolerance. If it is not the end (164), the service type determination step 153 is repeated.

The session monitor 29 receives all the packets occurring in the session (160) and determines the type of the received data (161). As a result of the determination, if the packet is media data, the packet is expressed through the media presentation layer (162), and then the traffic monitor 30 is notified of the traffic occurrence (163). If the packet is not media data, the traffic is immediately sent to the traffic monitor 30. Inform the occurrence (163). In this way, all the received packets are notified to the traffic monitor 30 so that the traffic monitor 30 can know the traffic of the network currently occurring. After that, it is determined whether the service is terminated (164). If not, the service type determination step (153) is repeated.

The present invention as described above is applied to a distributed object-oriented collaboRAtion environment (DOORAE) to reduce the cost of developing mutually participating applications and to support the formation of multiple virtual networks in one network. It is possible to create and participate in multiple sessions over a network in a single personal computer.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains, and the above-described embodiments and accompanying It is not limited to the drawing.

Claims (13)

A common application interface 21 in which an interactive participant application is generated in a process of registering an application and creating a session to receive a session management service for the first time, and a plurality of mutual participant multimedia applications commonly use as an information path; An interactive participant multimedia application development environment daemon 22 for initializing each media server, generating the common application interface 21 to support session creation of an application, and requesting allocation of network resources and allocating network resources; A session manager (24) generated by the interactive participant multimedia application development environment daemon (22) to control the session and to generate a media resource requested by the application; A private application interface (23) generated by the session manager (24) and used as a communication path between the mutually participating application and the session manager (24) after a session is created; Connected to the interactive participant multimedia application development environment daemon 22 and session manager 24, when a session is created, a virtual network independent of other sessions is formed to provide a session management network service and a network resource of a media resource. Network service provider 25; It is in charge of the interface between the external media server and the session manager 24 to transmit the creation of the media resource requested by the session manager 24 to the media server and to transmit the response of the media server to the session manager 24. Media interface 26; A talk controller 27 for controlling talk in a single session and for coordinating a media control request of the session manager 24 requested through the media interface 26 to the media server; An entire session manager (28) for allocating network resources requested by the interactive participant multimedia application development environment daemon (22) and controlling the network service provider (25) to mediate network resources necessary for creating a session; A session monitor (29) generated by the full session manager (28) and connected to the session manager (24), a media server, and a network service provider (25) to monitor and coordinate the overall situation of the session; And And a traffic monitor (30) connected to the session monitor (29) to monitor and output the traffic of the virtual network of the session. The method of claim 1, The session manager 24, A packet interpreter 32 for interpreting a packet transmitted through the network service provider 25; An event interpreter 31 for interpreting events input through the private application interface 23, the packet interpreter 32, and the media interface 26; A media instance controller 34 that performs control for media use of the application in a single session; A media server controller 35 requesting a media resource from the media server for use of media; And An interactive participant multimedia application development environment comprising: an event interpreter 31, a packet interpreter 32, a media server controller 35, and a session controller 33 for integrally controlling the media instance controller 34. Session management system A session management method applied to a session management system in an interactive participatory multimedia application development environment, If the mutual participation application requires registration with the interactive participant multimedia application development environment daemon (22), the mutual participant multimedia application development environment daemon (22) includes a first step (36, 37) of assigning a unique number of the application; When the mutual participant application transmits session creation information to the mutual participant multimedia application development environment daemon 22 through the common application interface 21, and requests creation of a session, the mutual participant multimedia application development environment daemon 22 is set to the whole. Second steps 38 and 39 for requesting allocation of network resources while registering an application with the session manager 28; A third step (40, 41) of generating a session monitor (29) and allocating a requested network resource to the interactive participant development environment daemon (22); The mutual participant multimedia application development environment daemon 22 generates a session manager 24 with the allocated network resources, and the generated session manager 24 requests a media resource to be generated by each media server. 42,43); The media server creates a media server instance by using the network resources granted from the session manager 24, and the generated media server instance transmits a handle to the session manager 24 (44, 45). ; And The session manager 24 notifies the mutually participating application of the session establishment result through the private application interface 23, and the mutually participating application requests the session manager 24 to the session manager 24 for the sixth step 46 Session management method in an interactive participatory multimedia application development environment. The method of claim 3, wherein The process of the interactive participatory multimedia application development environment daemon 22, When the interactive participant multimedia application development environment daemon 22 is executed, the computer executes the media server, transfers a handle to the media server, receives a response, registers the type of the media server, and then requests a service. Determining whether the application is at or is an application at a remote location (48 to 52); As a result of the determination of the steps 48 to 52, in the case of an application on the same computer, if a request is made from an application, the application allocates a unique number of an application that can be used by the application, registers the application, and then receives a session creation request from the application. Requesting allocation of network resources to the session manager 28 to receive network resources and simultaneously generating the session manager 24 (53 to 58); And As a result of the determination of the steps 48 to 52, in case of a remote application, generating a participant manager 24 supporting session management service of an application participating in a session by receiving session participation information from a remote initial session creator. Session management method in an interactive participatory multimedia application development environment comprising: (59,60). The method according to claim 3 or 4, The process of the session manager 24, Requesting the media server to create a media server instance that can use the media resources required for the session and responding to the result of the creation, transmitting the registration information and its handle to the application after registering the media server instance; Interpreting the event when the service is requested to determine the type of service (65 to 67); And After performing the session management service for maintaining / managing the session according to the determination result of the steps (65 to 67) and repeats from the steps (65 to 67), the media service to service the access to the media resources of the application Session management in the interactive participant multimedia application development environment, characterized in that it repeats the steps (65 to 67) after performing, and performing and terminating (68 to 70) the termination service that destroys the session. Way. The method of claim 5, The session management service of the steps 68 to 70, Determining (71) a type of session management service; Performing (72) an invitation service involving the participant in the session after creation of the session according to the determination result of the step (71); Performing a participant management service for managing a participant participating in a session according to the determination result of the step 71; And And performing a session maintenance service for maintaining a session by interacting with the session monitor 29 according to the determination result of the step 71. Session management method. The method of claim 6, The invitation service of step 72, When the invited data is inputted by the user, the invitation information is sent to the remotely participating multimedia application development environment daemon with information about the received data and the media and network resources required to participate in the session. Steps 75 and 76; Receiving information corresponding to the invitation and registering as a participant participating in the session until the invitation is terminated (77,78); And And ending (80) transmitting all information on the currently participating participants to the participant manager (24) when the invitation is terminated. The method of claim 6, Participant management service of the step 73, Determining (81) a type of participant management service; Outputting participant information when the application requests viewing of the participant information as a result of the determination of the step 81; Determining that the withdrawal has occurred at a remote location within the session as a result of the determination of step 81, deleting the withdrawal information from the session participant registration information and notifying within the session that the withdrawal has occurred; As a result of the determination of the step 81, if the participant survival test, the participant survival test packet is periodically transmitted to the participant manager object, and if the number of failures is increased one by one, the session participant registration information is deleted and the notification is received in the session when the number of failures exceeds the allowable value Returning if the number of failures does not exceed the tolerance (84 to 88); And And (89,90) initializing the number of failures upon receiving the participant survival response packet as a result of the determination of the step (81). The method of claim 5, The media service of the steps 68 to 70, Determining (97) a type of media service; According to the determination result of the step 97, a voice request service for supporting an application's voice request as an audio service, a voice renunciation service for relinquishing a current voice, a voice transfer service for giving a voice by selecting a speaker, and controlling traffic Performing an audio service such as an audio activation adjustment service (98, 102 to 106); According to the determination result of the step 97, a picture window addition service for adding an image, a picture window deletion service for deleting an activated picture window, a picture window alignment service for aligning a plurality of images in a balanced manner, and a frame generated per second A frame rate control service, a picture taking service to save a picture of yourself as a file, a video control service to set up a relationship between a video capture board and a camera, and an overlay control service to adjust brightness, density, contrast, and color of an image. Performing the same video service (99,107-114); According to the determination result of the step 97, a plurality of users share a drawing service for drawing in a shared work area, a text editing service for using text, a file related service for file processing, and a sharing area. Performing a whiteboard service (100, 115 to 119) such as an access control service that provides an ordering of occurrence of events and a locking method for controlling access to a specific user when accessing at the same time; And According to the determination result of the step 97, the initial setting service for setting the initial environment for application sharing, the sharing control service for adjusting the necessary to provide a view of the shared application, the order of access of the shared application A method (101,120 to 124) for performing an application sharing service such as a shared access control service for locking and a sharing termination service for releasing an application sharing environment; How sessions are managed in your environment. The method of claim 4, wherein The process of the participant manager 24 of the step (59, 60), When the participant manager 24 is generated, the participant manager 24 analyzes the invitation information and the generation factor, outputs an invitation message to the user, and then judges whether the participant participates with the data input by the user. Terminating steps 125 to 127; As a result of the determination of steps 125 to 127, in case of participating in the session, requesting transmission of participant information and receiving participant information, requesting creation of a media instance to the media server and receiving a media server instance creation response (128 to 128). 131); Registering a handle of the received media instance and executing the application and interpreting the event to determine the type of service (132 to 136); And And performing (137 to 139) a participant maintenance service, a termination service, or a media service according to the determination result of the steps (132 to 136). The method of claim 10, The participant retention service of the steps (137 to 139), Determining a type of participant maintenance service (140); If the withdrawal occurs according to the determination result of the step 140, receiving information on the withdrawal transmitted from a remote place in the session and deleting the information on the withdrawal currently possessed; And Receiving the participant survival test packet periodically generated from the session manager 24 according to the determination result of the step 140 and transmitting the participant survival response packet to the session manager 24 (143,144). A session management method in an interactive participatory multimedia application development environment. The method of claim 3, wherein The process of the entire session manager 28, Generating an audio playback server capable of supporting audio playback after generating the traffic monitor 30 (145,146); And And generating (147 to 150) the session monitor 29 after receiving and allocating a network resource request generated from the interactive participant multimedia application development environment daemon 22 until termination. Session Management in Multimedia Application Development Environment. The method of claim 12, The process of the session monitor 29, Analyzing the factors received from the entire session manager 28 to generate a communication path for monitoring all traffic of the session, and then determining the type of service (151 to 153); As a result of the determination of the steps 151 to 153, if the session survival test is performed, the session manager 24 periodically sends a session survival test packet to increase the number of failures. Determining later if it is an end, and if it is not exceeded a tolerance, determining whether it is an end (154 to 157,164); Determining (158, 159, 164) whether the session survival response packet is terminated after initializing the number of failures as a result of the determination of the steps (151 to 153); As a result of the determination of the steps 151 to 153, when the packet in the session is received, the type of data is determined, and in the case of media data, the traffic is displayed to the traffic monitor 30 after being expressed through the media presentation layer. If it is not the media data, notifying the traffic monitor 30 of the occurrence of traffic and determining whether it is finished (160 to 164); And And if it is not an end after performing the process of determining whether it is the end, repeating the process from the service type determination process of steps (151 to 153).