US20090003248A1 - Conference system and server apparatus therefor - Google Patents
Conference system and server apparatus therefor Download PDFInfo
- Publication number
- US20090003248A1 US20090003248A1 US12/133,846 US13384608A US2009003248A1 US 20090003248 A1 US20090003248 A1 US 20090003248A1 US 13384608 A US13384608 A US 13384608A US 2009003248 A1 US2009003248 A1 US 2009003248A1
- Authority
- US
- United States
- Prior art keywords
- conference
- resource
- client terminals
- mcu
- conferences
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000004891 communication Methods 0.000 claims abstract description 30
- 230000004044 response Effects 0.000 claims abstract description 12
- 230000000007 visual effect Effects 0.000 claims description 33
- 230000005540 biological transmission Effects 0.000 claims description 25
- 230000008859 change Effects 0.000 claims description 16
- 238000012545 processing Methods 0.000 description 26
- 238000000034 method Methods 0.000 description 22
- 238000012546 transfer Methods 0.000 description 10
- 230000007423 decrease Effects 0.000 description 9
- 230000003247 decreasing effect Effects 0.000 description 5
- 238000012423 maintenance Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000012729 immediate-release (IR) formulation Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1818—Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
Definitions
- One embodiment of the present invention relates to a conference system and a server apparatus therefor.
- the conference system is actualized, for example, as an application of a telephone system to be formed by using an Internet Protocol (IP) technique.
- IP Internet Protocol
- IP telephone system A system actualizing voice communication via a best effort type network such as the Internet has been known.
- VoIP Voice over IP
- IP telephone sets including fixed telephone sets and software phones.
- VCS visual communication system
- a control form of the visual communication system is generally described as follows.
- a change in call state among extension terminals to be connected to the exchange makes the exchange transmit a call information event (origination side device information, termination side device information).
- the VCS server received this call information event to interpret the connection states among extension terminals on the basis of the received event.
- the VCS server instructs starts and terminations of visual communications to visual clients to be associated with extension terminals.
- the conference system is not required the MCU, and peer-to-peer communications among clients may be enough for the conference system. For instance, in a certain form, four persons become the boundary, and then, if the number of the clients is three, the conference system adopts peer-to-peer and if the number of the clients is four or larger, the conference system utilizes the MCU. In this form, in switching to another speaker while the conference is held among four persons, the conference system temporarily becomes a state for three persons, becomes peer-to-peer communication and opens the resource of the MCU. In this state, if the resource is taken by another conference, an original conference form which the resource has been completely transferred becomes impossible to utilize the MCU. In this way, there is still room for improvement in the existing technology and some pieces of technical development have been expected.
- FIG. 1 is a system view depicting a form of an embodiment of a conference system regarding the invention
- FIG. 2 is a view depicting an example of setting condition information 70 b of FIG. 1 ;
- FIG. 3 is a view depicting an example of timer set value information 70 c of FIG. 1 ;
- FIG. 4 is a view depicting an another example of the timer set value information 70 c of FIG. 1 ;
- FIG. 5 is a view depicting an example of a management table for use in setting whether a conference resource of a multi-point control unit (MCU) 50 should be used or not;
- MCU multi-point control unit
- FIG. 6 is a flowchart depicting an example of a processing procedure in holding a video conference using the conference resource of the MCU 50 ;
- FIG. 7 is a flowchart depicting an example of a processing procedure in holding a video conference without using the conference resource of the MCU 50 ;
- FIG. 8 is a flowchart depicting an example of a processing procedure when a client starts the video conference.
- FIG. 9 is a flowchart depicting an example of a processing procedure in decreasing the number of speakers in holding a multi-person conference by the use of the conference resource of the MCU 50 .
- a conference system which includes a plurality of client terminals to be connected with a communication network, and a conference unit supporting conferences to be held among the plurality of client terminals via the communication network, comprising: a resource control unit which dynamically allocate a resource of the conference unit to be consumed for supporting the conferences for each group to individually hold the conferences in response to occurrences of events showing changes in states of client terminals belonging to the group; and a release control unit which releases at least a part of the resources to be allocated to groups in which the events occur while the conferences are held under preset conditions.
- FIG. 1 shows a system view illustrating a form of an embodiment of a conference system regarding the present invention.
- a plurality of IP telephone sets 11 - 1 n are connected with an exchange 20 via an IP network 100 .
- the IP telephone sets 11 - 1 n are, for example, exclusive telephone terminals. Or the IP telephone sets 11 - 1 n are soft-phones in which telephone software is installed in computers.
- a visual communication system server (VCS server) 30 and an MCU 50 are also connected to the IP network 100 .
- the VCS server 30 may be connected to a maintenance terminal MT as a setting unit so as to set various items of data.
- the VCS server 30 manages the MCU 50 and a plurality of visual clients 61 - 66 via the IP network 100 .
- the visual clients 61 - 66 are objects equivalent to participants capable of becoming conference members, and, for example, computer terminals function by individually cooperating with the IP telephone sets 11 - 1 n . Therefore, the number of the visual clients 61 - 66 is not limited to six.
- the visual clients 61 - 66 are each provided with video cameras VCs which acquire visual data of speakers (users) and transmit the visual data to the IP network 100 .
- Voice data of the speakers may be also acquired with the video cameras VCs.
- a quantity of a resource needed by the visual communication conference is significantly affected by the presence/absence of the video camera VC or on/off of its function.
- the visual communications may be achieved by peer-to-peer communication among client terminals.
- the MCU 50 performs its part as a support device to make visual communication. The resource of the MCU is limited.
- the MCU 50 is provided with a combining processing unit 50 a .
- the processing unit 50 a combines video data and voice data transmitted via the IP network 100 to actualize multiple pieces of visual communication by a plurality of members.
- a session among all the visual clients 61 - 66 and the MCU 50 is established; this conference is composed of all the conference members.
- the members of the conference are notified to each visual client 61 - 66 , the names of the participants are displayed on the client terminals and video images of all the participants are displayed on the client terminals.
- the VCS server 30 includes a control unit 40 and a database unit 70 .
- the control unit 40 includes a call control unit 40 a , a client specification unit 40 b , a conference control unit 40 c , a resource control unit 40 d , a release control unit 40 e and a software timer 40 f , as its processing functions.
- the call control unit 40 a acquires a call information event regarding various kinds of call control from the exchange 20 , and executes processing such as call connection and session control regarding the IP telephone sets 11 - 1 n and visual clients 61 - 66 in cooperation with the exchange 20 .
- the client specification unit 40 b specifies members (clients) to participate in the conference under a given set condition. Information on the specified members is used for session control by the conference control unit 40 c.
- the conference control unit 40 c detects the remaining quantity of the resource of the MCU 50 for supporting the conference to record the remaining quantity in MCU conference resource information 70 a of the database unit 70 .
- the conference control unit 40 c constitutes members to participate in the conference in response to the remaining quantity of the resource.
- the members are selected in a form corresponding to a request from the client, and the selected members are notified to the visual clients 61 - 66 .
- the MCU 50 receives session control information which reflects the structure of the members from the conference control unit 40 c to form the session only among the selected members.
- the resource control unit 40 d allocates the conference resource of the MCU 50 to be consumed for supporting the conference for each call group which individually holds conferences.
- Each call group is a set of members composed of each conference.
- the scale of the call group and the scale of the conference vary while the conference is held, and in response to the variation, the resource control unit 40 d dynamically varies the allocation quantity of the resources to each group.
- a change in a state of a visual client belonging to a call group is designated. This change is recognized by the system as an occurrence of an event.
- the release control unit 40 e When the release control unit 40 e detects that an event related to resource allocation has occurred in the system and that the rest of the resource has produced the remainder of the resource, the release control unit 40 e releases the remainder of the resource under a preset condition. That is the release control unit 40 e at least a part of the resource allocated to the group that has caused an event such as a decrease (or an increase) in the number of participating clients, a changeover of speakers, and turning on/off of a video camera VC while the conference is held under the preset condition.
- an event such as a decrease (or an increase) in the number of participating clients, a changeover of speakers, and turning on/off of a video camera VC while the conference is held under the preset condition.
- the software timer 40 f counts a defined time regarding the resource release.
- the database unit 70 stores the MCU conference resource information 70 a , the setting condition information 70 b and timer set value information 70 c in its storage area.
- the resource information 70 a is the information in which the resource of the MCU 50 to be consumed for supporting the visual communication is subjected to the database.
- This database is used, for instance, in order to manage what the extent of the resources has been currently allocated for each call group. With the change in members who have been participated in the conference and with the version up of the system and so on, the resource information 70 a varies.
- FIG. 2 shows an example of the setting condition information 70 b .
- the condition information 70 b is stored in a table in which the condition, making the release control unit 40 e release the resource of the MCU 50 , is defined.
- a flag has been set in such a condition that the resource is released after the elapse of a timer period.
- the release control unit 40 e releases the redundancy resource in accordance with this condition.
- the condition also may be set for each call group or for each visual client by further segmentalizing.
- FIG. 3 shows a view illustrating an example if the timer set value information 70 c .
- This example relates to the condition for releasing the resource after the elapse of the timer period, and is used when the condition is set.
- the timer set value to be counted by the software timer 40 f is registered for each visual client terminal (PC 1 -PCn).
- Using the table releases the resource, for example, after 30 seconds from the time when the redundancy resource has produced with a change if a state of the visual client terminal. If a state change event is further occurs before the elapse of the time and results in short of redundancy resource, it is sure that the resource remains not to be released.
- FIG. 4 shows a view illustrating other example of the timer set value information 70 c .
- the timer set value to be counted by the software timer 40 f is registered for each call group.
- Using the table of release conditions enables managing the change if the redundancy resource for each group, and achieving control such as a release of the redundancy resource, for example, after 30 seconds from the time point of the occurrence of the change.
- the change in the state in the call group occurs, for example, in a case in which a call transfer event so as to switch speakers and the number of speakers is temporarily varies.
- FIG. 5 shows a view illustrating an example of a management table to be used in order to determine if the resource of the MCU 50 is used or to set the recourse itself.
- the management table is used in order to decide whether or not the resource of the MCU 50 is used in a state in which the video camera function of the visual client in the group has been turned off for each call group.
- the conference resource of the MCU Since it has been set to use the resource in FIG. 5 , even if the video camera function is turned off (a state of little resource consumption), the conference resource of the MCU is used by default at the time of the start of the video conference. Other than this, a form to determine the use of the conference resource of the MCU in response to the number of clients participating in the conference is a possible approach. For instance, there is a form in which at a conference with the number of participating clients is not larger than three, the conference resource is not used, and the conference resource is used for the first time when the number of the clients becomes four or larger.
- the set data for each table shown in FIGS. 2 to 5 is prepared in advance due to the operation of the maintenance terminal MT by the manager. Even in operation of the system, this setting may be changed. If the timer set values are equivalent to zero seconds, in FIGS. 3 , 4 , the redundancy resources are immediately released, and becomes into the same state in which the flag is set to the condition of the immediate release of the resource in FIG. 2 . Conversely, if the timer set values are equivalent to infinity ( ⁇ ), at least until the end (disbandment), the redundant resource will not be released. Next, the procedure of the release of the event will be described with reference to FIGS. 6-9 . The event which becomes a trigger of the release of the resource is turning on/off of a video transmission and reception function, or a decrease in the number of the speakers.
- FIG. 6 shows a flowchart illustrating an example of a processing procedure in holding the video conference using the conference resource of the MCU 50 .
- the flowchart it is assumed a state that the video transmission and reception function of the visual client terminal is turned on at the time of the start.
- Block B 901 if the video transmission and reception function is turned off at any of the client terminals (Yes, Block B 901 ), this event is notified to the VCS server 30 as client information notification. In response to this notification, the VCS server 30 confirms the setting of the table in FIG. 2 (Block B 902 ).
- Block B 902 if the setting instructs ‘release resource immediately’, the processing procedure shifts to Block 909 and the resource of the relevant client is immediately released. If the setting instructs ‘don't release resource’, the VCS server 30 does not release the resource of the MCU conference to continue the video conference (Block B 908 ).
- the VCS server 30 If the setting on the table indicates ‘release the resource after the elapse of the timer period’, the VCS server 30 reads the timer set value from the table of FIG. 3 or FIG. 4 . The VCS server 30 then starts a timer corresponding to a client terminal of which the video transmission and reception function has been tuned off (Block B 903 ). After this, a time-out of the timer is checked without interruption (Block B 904 ).
- the VCS server 30 continues count processing (a timer operation) (Block B 905 ), and also checks whether or not the client turns on the video transmission and reception function again (Block B 906 ). If the video transmission and reception is not turned on, the processing procedure returns to Block B 904 . If the video transmission and reception function is turned on (Yes, Block B 906 ), the VCS server 30 stops the timer operation and continues the video conference without releasing the resource of the MCU conference (Block B 907 ).
- Block B 904 the VCS server 30 releases the resource of the MCU conference resource which has been allocated to the client terminal the video transmission and reception function of which has been turned off (Block B 909 ), and performs conference control corresponding to the condition of the number of the speakers in the conference (Block B 910 ).
- FIG. 7 is a flowchart illustrating an example of a processing procedure while the video conference not using the conference resource of the MCU 50 is held. This flowchart assumes a state in which the video transmission and reception function of the visual client terminal is turned off at the time point of the start.
- Block B 1001 if the video transmission and reception function is turned on at any client terminal (Yes, Block B 1001 ), this event is notified as client information notification to the VCS server 30 .
- the VCS server 30 checks whether or not the number of speakers in the conference coincides with the condition of the conference using the MCU 50 (Block B 1002 ). That is, the VCS server 30 checks, for example, the number of the speakers in the conference is not larger than three (not using MCU 50 ), or not smaller than four (using the MCU 50 ).
- the VCS server 30 continues the conference control not using the MCU 50 (Block B 1005 ). Conversely, if the number of the speakers in the conference satisfies the condition of the conference using the MCU 50 , the VCS server 30 checks whether or not the MCU conference resource has any redundancy (free space) of the resource of the MCU conference (Block B 1003 ). If the MCU conference resource has no free space, the processing procedure shifts to Block B 1005 . If the MCU conference resource has any free space, the VCS server 30 resets the session to control the conference in a form using the MCU 50 (Block B 1004 ).
- FIG. 8 shows a flowchart illustrating an example of the processing procedure when a client starts the video conference.
- the VCS server 30 checks whether or not the video camera VC is connected to the client (Block B 1102 ). If the video camera VC is not connected, the VCS server 30 does not count the clients as expected users of the MCU conference resource and performs the conference control (Block B 1106 ).
- the VCS server 30 checks whether the video transmission and reception function is turned on or off (Block B 1103 ). If the video transmission and reception function is turned off, the VCS server 30 confirms the setting of the table of FIG. 5 under the condition that the video conference is started by turning off the video transmission and reception function (Block B 1105 ). If the setting is indicates ‘use the resource’, the processing procedure shifts to Block B 1104 . If the setting indicates ‘don't use the resource’, the processing procedure shifts to Block B 1106 .
- Block B 1103 the VCS server 30 counts its clients as the expected users of the MCU conference resource and performs the conference control (Block B 1104 ).
- FIG. 9 is a flowchart illustrating an example of a processing procedure in decreasing the number of the speakers while the conference using the conference resource of the MCU 50 is held.
- conference organizer operates a transfer of a call; thereby the flowchart illustrates a process to temporarily decrease the number of the speakers.
- the VCS server 30 If the setting shows ‘Release resource after elapse of timer period’, the VCS server 30 reads the timer set value from the table in FIG. 3 or FIG. 4 . The VCS server 30 starts the timer corresponding to the call group of which the number of speakers has decreased (Block B 1206 ). After this, the time-out of the timer is checked without interruption (Block B 1207 ).
- the VCS server 30 continues the count processing (timer operation), and a state in which the resources of the MCU conference are not released by the decreased number of the speakers (Block B 1208 ). If the timer times out in Block B 1207 , the VCS server 30 releases the resources of the MCU conference by the decreased number of the speakers (Block B 1209 ), and performs the conference control in response to the condition of the number of the speakers in the conference (Block B 1210 ). In contrast, if the setting confirmed in Block B 1204 instructs ‘release resource immediately’, the processing procedure proceeds to Block B 1209 as it is.
- the conference system does not blindly release the resources of the MCU 50 which have been free. That is, the VCS server 30 confirms the setting of the processing in generation of the redundant resources from the setting condition information 70 b , and performs the processing under the condition corresponding to the setting. For instance, if the processing condition is set to release the resources after the elapse of 30 seconds, the VCS server 30 releases the redundant resources after the software timer 40 f counts 30 seconds from the occurrence of the event.
- the conference organizer In a four-person conference using the conference resource of the MCU 50 , when the conference organizer expects to perform a transfer operation to other speakers and shift to another four-person conference, the conference organizer firstly reserves the conference to transfer the call, thereby the video conference temporarily becomes a three-person conference excluding the conference organizer. In this case, if the VCS server 30 immediately releases the conference resources of the MCU 50 , a peer-to-peer communication environment for each three person is subjected to be formed.
- this embodiment may select control systems for the conference resource, while many-person conference using the conference resource of the MCU 50 is held, even if the number of speakers decreases due to the variation of the call state, the situation described above does not occur.
- a conference resource control system of the MCU 50 may be selected. In either case, especially, user the setting condition to release the resource after waiting for the count of the timer period, the count value of the timer may be arbitrarily set.
- the conference resource of the MCU 50 when the conference resource of the MCU 50 is allocated once to the call group in conference depending on the setting condition, the conference resource may not be released while the call group is present. If any client turns on the video transmission reception function while the video conference not using the conference resource of the MCU 50 is held, the turning on coincides with the condition of the number of the speakers in the conference for using the conference resource of the MCU 50 , and also the conference resource of the MCU 50 has any free space, the conference system may uses the conference resource of the MCU 50 .
- the conference system may not use the conference resource of the MCU 50 . Further, in starting the video conference in a state of turning off of the video transmission and reception function of the client, the turning off coincides with the condition of the number of the speakers in the conference for using the conference resource of the MCU 50 , and also the conference resource of the MCU 50 has any free space, the conference system may select by setting how to allocate the conference resource of the MCU 50 .
- the embodiment may sensitively set the conditions such that the conference resource of the MCU 50 should be used or not, or how to release the redundant resources.
- the conference system which has achieved further effective utilization of the conference resource may be provided.
- the invention is not limited to the foregoing embodiment.
- the maintenance terminal MT may set a condition of resource release, counted value of the timer, etc.
- the conference system may be configured to implement that setting from the IP telephone sets 11 - 1 n or visual clients 61 - 66 .
- Various kinds of setting may individually set for each client or each call group.
- a transfer operation in a many-person conference is taken by way of example as a factor of a decrease in the number of speakers.
- a case in which a speaker in participation in the conference simply leaves from the conference is thought as a factor of a decrease in the number of speakers in the conference.
- the invention may control the conference resource of the MCU 50 .
- the resource control unit and the release control unit may be provided as processing functions of an exclusive server device.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
- This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2007-173039, filed Jun. 29, 2007, the entire contents of which are incorporated herein by reference.
- 1. Field
- One embodiment of the present invention relates to a conference system and a server apparatus therefor. The conference system is actualized, for example, as an application of a telephone system to be formed by using an Internet Protocol (IP) technique.
- 2. Description of the Related Art
- A system actualizing voice communication via a best effort type network such as the Internet has been known. Such a system has been called an IP telephone system or a Voice over IP (VoIP), and has been applied not only to a wide range telephone network but also to a local communication network such as a private telephone network. Hereinafter, telephone terminals in this kind of system are referred to as IP telephone sets including fixed telephone sets and software phones.
- In recent years, a conference system called a visual communication system (VCS) has become widely used by using this kind of system (e.g., refer to Jpn. Patent Appln. KOKAI Publication No. 2006-270166). This reference has disclosed a system in which voice communication by means of a telephone exchange (hereinafter, it is abbreviated to an exchange) which has been widely used conventionally is cooperated with video communication by a visual communication server VCS server.
- A control form of the visual communication system is generally described as follows. A change in call state among extension terminals to be connected to the exchange makes the exchange transmit a call information event (origination side device information, termination side device information). The VCS server received this call information event to interpret the connection states among extension terminals on the basis of the received event. Depending on the connection states, the VCS server instructs starts and terminations of visual communications to visual clients to be associated with extension terminals.
- Meanwhile, in recent years, if the number of participates (hereinafter, referred to as video members) is large, a technique which combines conferences by a device called a multi-point control unit (MCU) has been examined (e.g., Jpn. Pat. Appln KOKAI Publication No. 2007-259270). Using the MCU for combining the conferences establishes a video stream among clients and the MCU. In relation to this technique, a system which intends effective application of a conference resource by enabling selection of the video members in response to a demand from a user has been examined and the system has been filed as Japanese Patent Application No. 2006-330943 (filed Dec. 7, 2006).
- Most of client terminals to participate in the conference have video transmission and reception functions, the on and off states of the functions significantly affect on a consumption amount of the conference resources. In an existing technique, even if any client turns off the video transmission and reception function while the conference using the MCU is held, the conference resource of the MCU is continuously secured until the client himself or herself leaves from the conference. Even if a client who has not been connected with a video camera participates in the conference, and even if a client of whom the video transmission and reception function has been turned off participates in the conference, the conference resource of the MCU is used. Therefore, there is a problem such that the conference resource of the MCU cannot be effectively utilized at a maximum.
- Other than this, there is the following problem. That is, depending on the number of participants in the conference, the conference system is not required the MCU, and peer-to-peer communications among clients may be enough for the conference system. For instance, in a certain form, four persons become the boundary, and then, if the number of the clients is three, the conference system adopts peer-to-peer and if the number of the clients is four or larger, the conference system utilizes the MCU. In this form, in switching to another speaker while the conference is held among four persons, the conference system temporarily becomes a state for three persons, becomes peer-to-peer communication and opens the resource of the MCU. In this state, if the resource is taken by another conference, an original conference form which the resource has been completely transferred becomes impossible to utilize the MCU. In this way, there is still room for improvement in the existing technology and some pieces of technical development have been expected.
- A general architecture that implements the various feature of the invention will now be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate embodiments of the invention and not to limit the scope of the invention.
-
FIG. 1 is a system view depicting a form of an embodiment of a conference system regarding the invention; -
FIG. 2 is a view depicting an example of settingcondition information 70 b ofFIG. 1 ; -
FIG. 3 is a view depicting an example of timer setvalue information 70 c ofFIG. 1 ; -
FIG. 4 is a view depicting an another example of the timer setvalue information 70 c ofFIG. 1 ; -
FIG. 5 is a view depicting an example of a management table for use in setting whether a conference resource of a multi-point control unit (MCU) 50 should be used or not; -
FIG. 6 is a flowchart depicting an example of a processing procedure in holding a video conference using the conference resource of the MCU 50; -
FIG. 7 is a flowchart depicting an example of a processing procedure in holding a video conference without using the conference resource of the MCU 50; -
FIG. 8 is a flowchart depicting an example of a processing procedure when a client starts the video conference; and -
FIG. 9 is a flowchart depicting an example of a processing procedure in decreasing the number of speakers in holding a multi-person conference by the use of the conference resource of the MCU 50. - Various embodiments according to the invention will be described hereinafter with reference to the accompanying drawings. In general, according to one embodiment of the invention, a conference system which includes a plurality of client terminals to be connected with a communication network, and a conference unit supporting conferences to be held among the plurality of client terminals via the communication network, comprising: a resource control unit which dynamically allocate a resource of the conference unit to be consumed for supporting the conferences for each group to individually hold the conferences in response to occurrences of events showing changes in states of client terminals belonging to the group; and a release control unit which releases at least a part of the resources to be allocated to groups in which the events occur while the conferences are held under preset conditions.
- According to an embodiment,
FIG. 1 shows a system view illustrating a form of an embodiment of a conference system regarding the present invention. InFIG. 1 , a plurality of IP telephone sets 11-1 n are connected with anexchange 20 via anIP network 100. The IP telephone sets 11-1 n are, for example, exclusive telephone terminals. Or the IP telephone sets 11-1 n are soft-phones in which telephone software is installed in computers. A visual communication system server (VCS server) 30 and anMCU 50 are also connected to theIP network 100. TheVCS server 30 may be connected to a maintenance terminal MT as a setting unit so as to set various items of data. - The VCS
server 30 manages the MCU 50 and a plurality of visual clients 61-66 via theIP network 100. The visual clients 61-66 are objects equivalent to participants capable of becoming conference members, and, for example, computer terminals function by individually cooperating with the IP telephone sets 11-1 n. Therefore, the number of the visual clients 61-66 is not limited to six. - The visual clients 61-66 are each provided with video cameras VCs which acquire visual data of speakers (users) and transmit the visual data to the
IP network 100. Voice data of the speakers may be also acquired with the video cameras VCs. A quantity of a resource needed by the visual communication conference is significantly affected by the presence/absence of the video camera VC or on/off of its function. - If a processing ability of the
VCS server 30 is enough in comparison with a scale or the number of the visual communications, the visual communications may be achieved by peer-to-peer communication among client terminals. However, such a situation is not always comes true. In such a meaning, The MCU 50 performs its part as a support device to make visual communication. The resource of the MCU is limited. - The
MCU 50 is provided with a combiningprocessing unit 50 a. Theprocessing unit 50 a combines video data and voice data transmitted via theIP network 100 to actualize multiple pieces of visual communication by a plurality of members. In a state of enough resources of theMCU 50, as shown inFIG. 1 , a session among all the visual clients 61-66 and theMCU 50 is established; this conference is composed of all the conference members. The members of the conference are notified to each visual client 61-66, the names of the participants are displayed on the client terminals and video images of all the participants are displayed on the client terminals. - The
VCS server 30 includes acontrol unit 40 and adatabase unit 70. Thecontrol unit 40 includes acall control unit 40 a, aclient specification unit 40 b, aconference control unit 40 c, aresource control unit 40 d, arelease control unit 40 e and asoftware timer 40 f, as its processing functions. - Among of them, the
call control unit 40 a acquires a call information event regarding various kinds of call control from theexchange 20, and executes processing such as call connection and session control regarding the IP telephone sets 11-1 n and visual clients 61-66 in cooperation with theexchange 20. Theclient specification unit 40 b specifies members (clients) to participate in the conference under a given set condition. Information on the specified members is used for session control by theconference control unit 40 c. - The
conference control unit 40 c detects the remaining quantity of the resource of theMCU 50 for supporting the conference to record the remaining quantity in MCUconference resource information 70 a of thedatabase unit 70. Theconference control unit 40 c constitutes members to participate in the conference in response to the remaining quantity of the resource. The members are selected in a form corresponding to a request from the client, and the selected members are notified to the visual clients 61-66. At the time of the start of the conference, theMCU 50 receives session control information which reflects the structure of the members from theconference control unit 40 c to form the session only among the selected members. - The
resource control unit 40 d allocates the conference resource of theMCU 50 to be consumed for supporting the conference for each call group which individually holds conferences. Each call group is a set of members composed of each conference. Usually, the scale of the call group and the scale of the conference vary while the conference is held, and in response to the variation, theresource control unit 40 d dynamically varies the allocation quantity of the resources to each group. As regards one of causes to vary the allocation quantity of the resources, a change in a state of a visual client belonging to a call group is designated. This change is recognized by the system as an occurrence of an event. - When the
release control unit 40 e detects that an event related to resource allocation has occurred in the system and that the rest of the resource has produced the remainder of the resource, therelease control unit 40 e releases the remainder of the resource under a preset condition. That is therelease control unit 40 e at least a part of the resource allocated to the group that has caused an event such as a decrease (or an increase) in the number of participating clients, a changeover of speakers, and turning on/off of a video camera VC while the conference is held under the preset condition. - The
software timer 40 f counts a defined time regarding the resource release. Thedatabase unit 70 stores the MCUconference resource information 70 a, the settingcondition information 70 b and timer setvalue information 70 c in its storage area. Among of them, theresource information 70 a is the information in which the resource of theMCU 50 to be consumed for supporting the visual communication is subjected to the database. This database is used, for instance, in order to manage what the extent of the resources has been currently allocated for each call group. With the change in members who have been participated in the conference and with the version up of the system and so on, theresource information 70 a varies. -
FIG. 2 shows an example of the settingcondition information 70 b. Thecondition information 70 b is stored in a table in which the condition, making therelease control unit 40 e release the resource of theMCU 50, is defined. InFIG. 2 , a flag has been set in such a condition that the resource is released after the elapse of a timer period. Thereby, therelease control unit 40 e releases the redundancy resource in accordance with this condition. The condition also may be set for each call group or for each visual client by further segmentalizing. -
FIG. 3 shows a view illustrating an example if the timer setvalue information 70 c. This example relates to the condition for releasing the resource after the elapse of the timer period, and is used when the condition is set. As shown inFIG. 3 , the timer set value to be counted by thesoftware timer 40 f is registered for each visual client terminal (PC1-PCn). Using the table releases the resource, for example, after 30 seconds from the time when the redundancy resource has produced with a change if a state of the visual client terminal. If a state change event is further occurs before the elapse of the time and results in short of redundancy resource, it is sure that the resource remains not to be released. -
FIG. 4 shows a view illustrating other example of the timer setvalue information 70 c. InFIG. 4 , the timer set value to be counted by thesoftware timer 40 f is registered for each call group. Using the table of release conditions enables managing the change if the redundancy resource for each group, and achieving control such as a release of the redundancy resource, for example, after 30 seconds from the time point of the occurrence of the change. The change in the state in the call group occurs, for example, in a case in which a call transfer event so as to switch speakers and the number of speakers is temporarily varies. -
FIG. 5 shows a view illustrating an example of a management table to be used in order to determine if the resource of theMCU 50 is used or to set the recourse itself. For instance, the management table is used in order to decide whether or not the resource of theMCU 50 is used in a state in which the video camera function of the visual client in the group has been turned off for each call group. - Since it has been set to use the resource in
FIG. 5 , even if the video camera function is turned off (a state of little resource consumption), the conference resource of the MCU is used by default at the time of the start of the video conference. Other than this, a form to determine the use of the conference resource of the MCU in response to the number of clients participating in the conference is a possible approach. For instance, there is a form in which at a conference with the number of participating clients is not larger than three, the conference resource is not used, and the conference resource is used for the first time when the number of the clients becomes four or larger. - The set data for each table shown in
FIGS. 2 to 5 is prepared in advance due to the operation of the maintenance terminal MT by the manager. Even in operation of the system, this setting may be changed. If the timer set values are equivalent to zero seconds, inFIGS. 3 , 4, the redundancy resources are immediately released, and becomes into the same state in which the flag is set to the condition of the immediate release of the resource inFIG. 2 . Conversely, if the timer set values are equivalent to infinity (∞), at least until the end (disbandment), the redundant resource will not be released. Next, the procedure of the release of the event will be described with reference toFIGS. 6-9 . The event which becomes a trigger of the release of the resource is turning on/off of a video transmission and reception function, or a decrease in the number of the speakers. -
FIG. 6 shows a flowchart illustrating an example of a processing procedure in holding the video conference using the conference resource of theMCU 50. In the flowchart, it is assumed a state that the video transmission and reception function of the visual client terminal is turned on at the time of the start. - In
FIG. 6 , if the video transmission and reception function is turned off at any of the client terminals (Yes, Block B901), this event is notified to theVCS server 30 as client information notification. In response to this notification, theVCS server 30 confirms the setting of the table inFIG. 2 (Block B902). - In Block B902, if the setting instructs ‘release resource immediately’, the processing procedure shifts to Block 909 and the resource of the relevant client is immediately released. If the setting instructs ‘don't release resource’, the
VCS server 30 does not release the resource of the MCU conference to continue the video conference (Block B908). - If the setting on the table indicates ‘release the resource after the elapse of the timer period’, the
VCS server 30 reads the timer set value from the table ofFIG. 3 orFIG. 4 . TheVCS server 30 then starts a timer corresponding to a client terminal of which the video transmission and reception function has been tuned off (Block B903). After this, a time-out of the timer is checked without interruption (Block B904). - In a state in which the
software timer 40 f does not time out, theVCS server 30 continues count processing (a timer operation) (Block B905), and also checks whether or not the client turns on the video transmission and reception function again (Block B906). If the video transmission and reception is not turned on, the processing procedure returns to Block B904. If the video transmission and reception function is turned on (Yes, Block B906), theVCS server 30 stops the timer operation and continues the video conference without releasing the resource of the MCU conference (Block B907). - If the time times out in Block B904, the
VCS server 30 releases the resource of the MCU conference resource which has been allocated to the client terminal the video transmission and reception function of which has been turned off (Block B909), and performs conference control corresponding to the condition of the number of the speakers in the conference (Block B910). -
FIG. 7 is a flowchart illustrating an example of a processing procedure while the video conference not using the conference resource of theMCU 50 is held. This flowchart assumes a state in which the video transmission and reception function of the visual client terminal is turned off at the time point of the start. - In
FIG. 7 , if the video transmission and reception function is turned on at any client terminal (Yes, Block B1001), this event is notified as client information notification to theVCS server 30. In response to this notification, theVCS server 30 checks whether or not the number of speakers in the conference coincides with the condition of the conference using the MCU 50 (Block B1002). That is, theVCS server 30 checks, for example, the number of the speakers in the conference is not larger than three (not using MCU 50), or not smaller than four (using the MCU 50). - If the number of speakers in the conference does not satisfy the condition of the conference using the
MCU 50, theVCS server 30 continues the conference control not using the MCU 50 (Block B1005). Conversely, if the number of the speakers in the conference satisfies the condition of the conference using theMCU 50, theVCS server 30 checks whether or not the MCU conference resource has any redundancy (free space) of the resource of the MCU conference (Block B1003). If the MCU conference resource has no free space, the processing procedure shifts to Block B1005. If the MCU conference resource has any free space, theVCS server 30 resets the session to control the conference in a form using the MCU 50 (Block B1004). -
FIG. 8 shows a flowchart illustrating an example of the processing procedure when a client starts the video conference. InFIG. 8 , if the client starts the video conference (Block B1101), theVCS server 30 checks whether or not the video camera VC is connected to the client (Block B1102). If the video camera VC is not connected, theVCS server 30 does not count the clients as expected users of the MCU conference resource and performs the conference control (Block B1106). - If the video camera VC is connected to the client, the
VCS server 30 checks whether the video transmission and reception function is turned on or off (Block B1103). If the video transmission and reception function is turned off, theVCS server 30 confirms the setting of the table ofFIG. 5 under the condition that the video conference is started by turning off the video transmission and reception function (Block B1105). If the setting is indicates ‘use the resource’, the processing procedure shifts to Block B1104. If the setting indicates ‘don't use the resource’, the processing procedure shifts to Block B1106. - Conversely, if the video transmission and reception function is turned on in Block B1103, the
VCS server 30 counts its clients as the expected users of the MCU conference resource and performs the conference control (Block B1104). -
FIG. 9 is a flowchart illustrating an example of a processing procedure in decreasing the number of the speakers while the conference using the conference resource of theMCU 50 is held. In this flowchart, especially, for the changeover of the speakers, conference organizer operates a transfer of a call; thereby the flowchart illustrates a process to temporarily decrease the number of the speakers. - When the organizer of the conference depresses a conference transfer key of her or his own IP telephone set (or a client terminal), the transfer processing starts, the call is temporarily disconnected then the number of the speakers decreases (Yes, Block B1201). Thus, a call information event showing that the call state has varied is notified from the
exchange 20 to theVCS server 30. When receiving this notification, theVCS server 30 checks the MCUconference resource information 70 a, and determines whether or not any call group is present at that time point (Block B1202). - If any call group is not present, all the resources of the MCU conference which is currently allocated to the call groups are released (Block B1203). If any call group is present, the
VCS server 30 confirms the table ofFIG. 2 (Block B1204). If the setting instructs ‘Don't release’ theVCS server 30 continues the video conference without having to release the resources of the MCU conference by the decrease in the number of speakers (Block B1205). - If the setting shows ‘Release resource after elapse of timer period’, the
VCS server 30 reads the timer set value from the table inFIG. 3 orFIG. 4 . TheVCS server 30 starts the timer corresponding to the call group of which the number of speakers has decreased (Block B1206). After this, the time-out of the timer is checked without interruption (Block B1207). - In a state in which the
software timer 40 f is not timed out, theVCS server 30 continues the count processing (timer operation), and a state in which the resources of the MCU conference are not released by the decreased number of the speakers (Block B1208). If the timer times out in Block B1207, theVCS server 30 releases the resources of the MCU conference by the decreased number of the speakers (Block B1209), and performs the conference control in response to the condition of the number of the speakers in the conference (Block B1210). In contrast, if the setting confirmed in Block B1204 instructs ‘release resource immediately’, the processing procedure proceeds to Block B1209 as it is. - As described above, in this embodiment, even when the event of turning on/off of the video transmission and reception function, or the decrease in the speakers is detected, the conference system does not blindly release the resources of the
MCU 50 which have been free. That is, theVCS server 30 confirms the setting of the processing in generation of the redundant resources from the settingcondition information 70 b, and performs the processing under the condition corresponding to the setting. For instance, if the processing condition is set to release the resources after the elapse of 30 seconds, theVCS server 30 releases the redundant resources after thesoftware timer 40 f counts 30 seconds from the occurrence of the event. - In a four-person conference using the conference resource of the
MCU 50, when the conference organizer expects to perform a transfer operation to other speakers and shift to another four-person conference, the conference organizer firstly reserves the conference to transfer the call, thereby the video conference temporarily becomes a three-person conference excluding the conference organizer. In this case, if theVCS server 30 immediately releases the conference resources of theMCU 50, a peer-to-peer communication environment for each three person is subjected to be formed. - Although a four-person conference state is set again after waiting for the response from a transfer destination, if the conference resource of the
MCU 50 is acquired by other user, the conference resource for making visual communication among four persons again results in having no free space. In other words, although the four-person conference using the conference resource of theMCU 50 may be realized before the conference organizer transfers the calls to other speakers, the four-person conference using the conference resource of theMCU 50 may not be held at the time of the end of the transfer operation. Conversely, this embodiment may select control systems for the conference resource, while many-person conference using the conference resource of theMCU 50 is held, even if the number of speakers decreases due to the variation of the call state, the situation described above does not occur. In this embodiment, even when the client turns off the video transmission and reception function in the many-person conference using the conference resource of theMCU 50, a conference resource control system of theMCU 50 may be selected. In either case, especially, user the setting condition to release the resource after waiting for the count of the timer period, the count value of the timer may be arbitrarily set. - Of course, when the conference resource of the
MCU 50 is allocated once to the call group in conference depending on the setting condition, the conference resource may not be released while the call group is present. If any client turns on the video transmission reception function while the video conference not using the conference resource of theMCU 50 is held, the turning on coincides with the condition of the number of the speakers in the conference for using the conference resource of theMCU 50, and also the conference resource of theMCU 50 has any free space, the conference system may uses the conference resource of theMCU 50. - If the video camera VC is not connected to the client terminal at the time of start of the video conference, the conference system may not use the conference resource of the
MCU 50. Further, in starting the video conference in a state of turning off of the video transmission and reception function of the client, the turning off coincides with the condition of the number of the speakers in the conference for using the conference resource of theMCU 50, and also the conference resource of theMCU 50 has any free space, the conference system may select by setting how to allocate the conference resource of theMCU 50. - Like this, the embodiment may sensitively set the conditions such that the conference resource of the
MCU 50 should be used or not, or how to release the redundant resources. Thus, the conference system which has achieved further effective utilization of the conference resource may be provided. - The invention is not limited to the foregoing embodiment. For instance, while the embodiment has described that the maintenance terminal MT may set a condition of resource release, counted value of the timer, etc., the conference system may be configured to implement that setting from the IP telephone sets 11-1 n or visual clients 61-66. Various kinds of setting may individually set for each client or each call group.
- In the flowchart of
FIG. 9 , a transfer operation in a many-person conference is taken by way of example as a factor of a decrease in the number of speakers. Other than this, a case in which a speaker in participation in the conference simply leaves from the conference is thought as a factor of a decrease in the number of speakers in the conference. In this way, under a situation without departing from the spirit or scope of the general inventive concept of the invention, the invention may control the conference resource of theMCU 50. - The resource control unit and the release control unit may be provided as processing functions of an exclusive server device.
- While certain embodiments of the inventions have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Claims (13)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2007-173039 | 2007-06-29 | ||
| JP2007173039A JP2009016907A (en) | 2007-06-29 | 2007-06-29 | Conference system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US20090003248A1 true US20090003248A1 (en) | 2009-01-01 |
Family
ID=40160340
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US12/133,846 Abandoned US20090003248A1 (en) | 2007-06-29 | 2008-06-05 | Conference system and server apparatus therefor |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20090003248A1 (en) |
| JP (1) | JP2009016907A (en) |
| CN (1) | CN101335870A (en) |
| CA (1) | CA2633930A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090245143A1 (en) * | 2008-03-27 | 2009-10-01 | Fujitsu Limited | Conference system, conference program, and conference resource allocation method |
| US20120075996A1 (en) * | 2010-09-28 | 2012-03-29 | Microsoft Corporation | Techniques to support large numbers of subscribers to a real-time event |
| EP2863632A1 (en) * | 2013-10-15 | 2015-04-22 | Polycom, Inc. | System and method for real-time adaptation of a conferencing system to current conditions of a conference session |
| CN106094942A (en) * | 2016-06-23 | 2016-11-09 | 广州派诺网络技术有限公司 | Smart meeting room control method |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9558787B2 (en) | 2014-01-29 | 2017-01-31 | Google Inc. | Media application backgrounding |
| US10686873B2 (en) * | 2016-03-16 | 2020-06-16 | Polycom, Inc. | Seamless transition of a video session between a mesh topology and a centralized bridge topology |
| CN113311958B (en) * | 2016-06-11 | 2022-09-09 | 苹果公司 | Apparatus, method and graphical user interface for meeting space management and interaction |
| CN109246383B (en) | 2017-07-11 | 2022-03-29 | 中兴通讯股份有限公司 | Control method of multimedia conference terminal and multimedia conference server |
| CN110324286B (en) * | 2018-03-30 | 2022-02-22 | 视联动力信息技术股份有限公司 | Conference control system and method |
| EP3958544A4 (en) * | 2019-04-19 | 2023-01-11 | Bonx Inc. | Communication terminal, application program for communication terminal, and communication method |
| JP7373890B1 (en) * | 2023-03-01 | 2023-11-06 | Kddi株式会社 | Information processing device and information processing method |
-
2007
- 2007-06-29 JP JP2007173039A patent/JP2009016907A/en not_active Withdrawn
-
2008
- 2008-06-05 CA CA002633930A patent/CA2633930A1/en not_active Abandoned
- 2008-06-05 US US12/133,846 patent/US20090003248A1/en not_active Abandoned
- 2008-06-13 CN CNA2008101101409A patent/CN101335870A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090245143A1 (en) * | 2008-03-27 | 2009-10-01 | Fujitsu Limited | Conference system, conference program, and conference resource allocation method |
| US20120075996A1 (en) * | 2010-09-28 | 2012-03-29 | Microsoft Corporation | Techniques to support large numbers of subscribers to a real-time event |
| US8379525B2 (en) * | 2010-09-28 | 2013-02-19 | Microsoft Corporation | Techniques to support large numbers of subscribers to a real-time event |
| EP2863632A1 (en) * | 2013-10-15 | 2015-04-22 | Polycom, Inc. | System and method for real-time adaptation of a conferencing system to current conditions of a conference session |
| US10091461B2 (en) | 2013-10-15 | 2018-10-02 | Polycom, Inc. | System and method for real-time adaptation of a conferencing system to current conditions of a conference session |
| CN106094942A (en) * | 2016-06-23 | 2016-11-09 | 广州派诺网络技术有限公司 | Smart meeting room control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101335870A (en) | 2008-12-31 |
| CA2633930A1 (en) | 2008-12-29 |
| JP2009016907A (en) | 2009-01-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2633930A1 (en) | Conference system and server apparatus therefor | |
| US8526336B2 (en) | Conference resource allocation and dynamic reallocation | |
| US8068866B2 (en) | Group communication server | |
| US7139807B2 (en) | Media role management in a video conferencing network | |
| CN1790998B (en) | Presentation integrated management system, presentation server and presentation information management method | |
| US20080137559A1 (en) | Conference system | |
| US7436428B2 (en) | System and method for including participants in a conference call | |
| US20050027581A1 (en) | System and method for setup of meetings and conferences | |
| US6128649A (en) | Dynamic selection of media streams for display | |
| US20050195955A1 (en) | Network conference system, management server, conference terminal, and information origination authorization management method | |
| NO319437B1 (en) | Procedure for ad hoc buffer | |
| JP4700977B2 (en) | Multipoint conference system | |
| JP2008016880A (en) | COMMUNICATION SYSTEM, SERVER DEVICE, AND DISPLAY CONTROL METHOD | |
| JP2008252177A (en) | Electronic conference system, information processing apparatus, and program | |
| CN100502295C (en) | A method of terminal dynamic access based on multi-point control unit | |
| JP4081068B2 (en) | Teleconferencing system | |
| JP2010033569A (en) | Management method of information transmitting authority of network conference system | |
| JP4903477B2 (en) | Group call server | |
| CA2610115A1 (en) | Server apparatus | |
| GB2403865A (en) | Method for displaying a multimedia conference | |
| EP2649747B1 (en) | Unification of rosters in a communication system | |
| JP2007259312A (en) | Server device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: KABUSHIKI KAISHA TOSHIBA, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SHIMA, KOJI;REEL/FRAME:021054/0252 Effective date: 20080527 |
|
| AS | Assignment |
Owner name: KABUSHIKI KAISHA TOSHIBA, JAPAN Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR PREVIOUSLY RECORDED ON REEL 021054 FRAME 0252;ASSIGNORS:SHIMA, KOJI;SASAKI, YASUMASA;REEL/FRAME:021207/0467 Effective date: 20080527 |
|
| STCB | Information on status: application discontinuation |
Free format text: EXPRESSLY ABANDONED -- DURING EXAMINATION |