JP2012022715A - Information processing apparatus, information processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system allowing execution of various kinds of information processing by efficient use of a function of each information processing apparatus in user environment allowing use of resources as a plurality of information processing apparatuses.SOLUTION: In environment where various usable information processing apparatuses are present near a user, detection processing of an information processing apparatuses having a function corresponding to a user request from a main terminal used by the user can be executed according to the user request. And data communication and data processing corresponding to the user request which is not executed by only one information processing apparatus can be executed by using the detected information processing apparatus. By transmitting a resource finding/use query packet to the information processing apparatus allowing the data communication, function confirmation and environment setting of each information processing apparatus can be executed, and the information processing apparatus can be used based on updated information even when the function of the information processing apparatuses dynamically changes.

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program. More specifically, in a user environment where resources as a plurality of information processing devices can be used, information that makes it possible to execute various information processing such as communication by efficiently using the functions of each device. The present invention relates to a processing device, an information processing method, and a program.

  Recently, data transfer such as image and audio data via various communication media such as Internet communication has been actively performed. In addition, so-called ubiquitous computing networks are being realized in which information devices such as personal computers (PCs), information appliances, and portable terminals exist throughout the home and office and are connected to each other.

  In this way, in a ubiquitous environment where various information devices are ubiquitous, there are multiple devices in the vicinity that can be used simultaneously by the user, and the user can selectively use these devices or simultaneously It is possible to use multiple devices in parallel. By using a plurality of devices, it becomes possible to perform efficient information processing combining the characteristic functions of a plurality of devices, which cannot be achieved by a single device owned by a user.

  For example, when communicating with other users' communication devices via the Internet using one communication device, it is possible to use high-quality peripheral devices that are different from the communication device being used. It becomes possible to realize simple communication.

  In order to efficiently use such functions of a plurality of devices, it is desired to construct a service platform for realizing environment-adaptive communication by dynamically combining the functions of a plurality of information processing devices. Currently, Jini and UPnP (Universal Plug and Play) have been proposed as technologies for automatically configuring devices that implement these service platforms.

  UPnP (Universal Plug and Play) is a technical specification for connecting devices such as personal computers, peripheral devices, AV devices, telephones, and home appliances in the home via a network and providing functions mutually. It is a technology advocated by Microsoft and supported by more than 20 companies including Intel, 3Com, AT & T, and Dell Computer. UPnP (Universal Plug and Play) is based on technology standardized on the Internet, and aims to function without complicated operations and setting operations simply by connecting to a network. As the network infrastructure, in addition to Ethernet (registered trademark), which is most widely used for personal computer LANs, standards for home LAN such as home PNA (HomePNA) and home RF (HomeRF) are also supported. The

  Jini is a technical specification for connecting various devices such as personal computers, peripheral devices, AV devices, telephones, and home appliances over a network and providing functions to each other. It is supported by many major corporations such as Microsoft, Cisco Systems, Motorola, Canon, Sharp and Sony. Since it is based on Sun's JAVA (registered trademark) technology, it does not depend on a specific OS or microprocessor. In addition, a device that supports Jini functions immediately without being complicated and requiring setting operations simply by connecting to a network. In order to use Jini, it is necessary to install a JVM which is a JAVA (registered trademark) execution environment, or to be able to use a JVM installed in another device on the network.

  However, the technologies such as Jini and UPnP described above merely extend existing OSs and network automatic setting mechanisms and provide existing services. In order to provide environment-adaptive communication, it is desirable to consider not only simple automatic settings, but also changes in the user environment caused by user movement and device ON / OFF, and user requirements. It is also desirable to realize more flexible environmental adaptability, such as dynamically combining the functions of neighboring devices and transparently maintaining multiple sessions or creating sessions.

  The present invention has been made in view of the above-described problems, and an information processing apparatus and an information processing method for realizing optimal device selection and device usage according to changes in the device environment as a user-usable resource The purpose is to provide.

  The present invention also provides an information processing apparatus and an information processing method for adaptively communicating with a communication partner using equipment resources in the vicinity in an environment where various information processing apparatuses can be used. The purpose is to do.

  In addition, the present invention is an advanced session that realizes simple session start and end by simply specifying a communication partner user and a tool, moving and swapping between active session devices, and dividing and combining sessions in units of media. It is possible to extract devices with the necessary functions based on the management mechanism and user request evaluation, and it is possible to discover and use devices with optimal functions from the neighborhood by function evaluation of neighboring devices It is an object of the present invention to provide an information processing apparatus and an information processing method.

The first aspect of the present invention is:
An information processing apparatus that executes communication processing,
Request input means for inputting a search request for a device having a content server function;
In response to the request, a function inquiry to a plurality of peripheral devices capable of communication is executed, an answer is received, an apparatus having a contents server function is searched by analyzing the answer, and the contents server function selected as a result of the search Control means for making a request to execute a content server function to a device having
Is in an information processing apparatus.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the information processing apparatus receives status information indicating that content can be received from a service receiving apparatus that performs content reception processing by executing a content server function, It is the structure which starts the content provision process with respect to the said service reception apparatus from the apparatus which has the said content server function.

  Furthermore, in an embodiment of the information processing apparatus of the present invention, the information processing apparatus inputs the search request during communication processing with another communication partner and executes search processing of the content server.

Furthermore, the second aspect of the present invention provides
An information processing device that performs communication with a plurality of peripheral devices during communication connection with another communication device,
Search request detecting means for detecting a request to search for a content server from among the plurality of peripheral devices during communication with the other communication device;
Inquiry means for inquiring whether or not there is a content server function for the plurality of peripheral devices according to the detection result of the search request detecting means,
Receiving means for receiving an answer to the inquiry from the plurality of peripheral devices;
A device determination unit that selects a device having the content server function based on a reception result of the reception unit;
A server function request transmitting means for requesting the selected apparatus to execute a content server function based on a determination result of the apparatus determining means;
Is in an information processing apparatus.

Furthermore, the third aspect of the present invention provides
An information processing method executed in an information processing device that executes communication processing,
A request input step in which the request input means inputs a search request for a device having a content server function;
In response to the request, the control means executes a function inquiry to a plurality of peripheral devices capable of communication, receives an answer, searches for an apparatus having a content server function by analyzing the answer, and is selected as a result of the search. Making an execution request for the content server function to an apparatus having the content server function,
There is an information processing method for executing.

Furthermore, the fourth aspect of the present invention provides
A program for executing information processing in an information processing apparatus that executes communication processing,
In a request input means, a request input step for performing input detection of a search request for a device having a content server function;
In response to the request, the control means executes a function inquiry to a plurality of peripheral devices capable of communication, receives an answer, searches for an apparatus having a content server function by analyzing the answer, and is selected as a result of the search. Causing the apparatus having the content server function to make an execution request for the content server function;
It is in the program that executes

  The program of the present invention is a storage medium or communication medium provided in a computer-readable format to a computer system capable of executing various program codes, for example, a recording medium such as a DVD, CD, or MO. Or a computer program that can be provided by a communication medium such as a network. By providing such a program in a computer-readable format, processing corresponding to the program is realized on the computer system.

  Other objects, features, and advantages of the present invention will become apparent from a more detailed description based on embodiments of the present invention described later and the accompanying drawings. In this specification, the system is a logical set configuration of a plurality of devices, and is not limited to one in which the devices of each configuration are in the same casing.

  According to the configuration of the present invention, in an environment where various usable information processing devices exist in the vicinity of the user, the information processing device having a function corresponding to the user request from the main terminal used by the user in response to the user request. Detection processing can be performed, and by using the detected device, data processing and data communication according to a user request that cannot be performed by one apparatus can be performed.

  In addition, according to the configuration of the present invention, by transmitting a resource discovery / use query packet to a device capable of data communication, it is possible to check the function of each information processing device and set the environment. Even when the function of the information processing apparatus dynamically changes, it is possible to acquire the latest function information of each information processing apparatus based on the Service Capability List (SCL) as the updated terminal capability description data. .

  Further, according to the configuration of the present invention, each information processing device has a session management mechanism, and searches for other functions not included in the communication device being used from the peripheral information processing device, Even when a new session using resources is established, session management is executed in the session management mechanism in each information processing apparatus, so that a smooth transition of a communication session is possible.

It is a figure which shows the structure of the data processing system of this invention, and the outline | summary of a process. It is a figure which shows the structure of a data processing system of this invention, and the detail of a process. It is a figure explaining the resource discovery / search process performed in the data processing system of this invention. It is a figure which shows the data structure of the resource discovery / utilization query used in the data processing system of this invention. It is a figure which shows the data structure of the resource discovery / use response used in the data processing system of this invention. It is a figure which shows the example of data of the resource discovery / utilization query and response used in the data processing system of this invention. It is a figure explaining the session management process performed in the data processing system of this invention. It is a figure explaining the processing sequence performed in the data processing system of this invention. It is a flowchart explaining the process performed in the user main terminal in the data processing system of this invention. It is a figure explaining the example of a process performed in the data processing system of this invention. It is a figure which shows the structural example of the information processing apparatus utilized in the data processing system of this invention.

[System Overview]
First, an overview of the system of the present invention will be described with reference to FIG.

  The data processing system in FIG. 1 includes a user main terminal 100, a user sub terminal 110, a content server 120, and a data conversion device 130 as information processing devices used by a certain user. These information processing apparatuses shown in FIG. 1, which will be described in detail later, are devices that issue a resource discovery query from the user main terminal 100 and execute a response to the query. When each of these devices is set as a resource to be used by the user, the function of each device, for example, the display function of the user sub-terminal 110, the content distribution function of the content server 120, the data conversion function of the data conversion device 130, for example, MPEG, Data communication using a conversion processing function of various encoded data such as Motion-JPEG is executed.

  It should be noted that a user profile database 101, a service description database 102, a session management mechanism (FSM: Flexible Session Manager) 103, an environment adaptive engine (EAE) 104, which are shown as components inside the user main terminal 100, The rich communication support mechanism (RCN: Rich Communication Navigator) 105, the application unit 106, and the SCL processing unit 107 are also configured in the user auxiliary terminal 110, the content server 120, and the data conversion device 130, which are other information processing devices, respectively. However, the same processing as that of the user main terminal is possible.

  In FIG. 1, it is assumed that the user main terminal 100 executes communication with the external communication terminal 140 using a data communication network such as the Internet as a media stream path.

  In the system of the present invention, the external communication terminal 140 can communicate with the user main terminal 100, the user sub terminal 110, the content server 120, and the data conversion device 130 via a data communication network such as the Internet or a LAN. Note that “communication” used in the following description of the present invention refers to an information processing apparatus connected to the Internet such as a computer, a mobile phone or the like between two-way or unidirectional video and audio streams (real-time). For example, video communication is performed using a stream, and data communication between terminals via a data communication network is generally referred to as communication.

  In FIG. 1, when a user who is using a user main terminal 100 communicates with a user main terminal 100 that is mainly used by a user and an external communication terminal 140 that is a communication partner, a user who is using the user main terminal That is, it is assumed that a request for communication by a plurality of devices is generated by combining the user sub-terminal 110, the content server 120, and the data conversion device 130.

  The user has a video conference with the external communication terminal 140 in accordance with, for example, a video conference application program set in the application unit 106 of the user main terminal 100. During the communication, when new data processing or communication using peripheral resources is attempted, a user request is input from the user interface set in the application unit 106 of the user main terminal 100 and the application unit 106 is used. In the rich communication support mechanism (RCN: Rich Communication Navigator) 105, user request analysis processing is executed, and the user sub-terminal 110 as each resource available to the user from the rich communication support mechanism (RCN: Rich Communication Navigator) 105. The resource discovery query is distributed by multicast to the rich communication support mechanism (RCN: Rich Communication Navigator) of each of the content server 120 and the data conversion device 130.

  The rich communication support mechanism (RCN: Rich Communication Navigator) of the user sub-terminal 110, the content server 120, and the data conversion device 130 as each resource that has received the resource discovery query can provide the function requested by the user. Perform function provision. For example, when the function requested by the user is data conversion processing related to data transmitted / received between the user main terminal 100 and the external communication terminal 140 and the data conversion device 130 is available, the session management mechanism ( It is possible to use the data conversion device 130 to execute communication data conversion processing between the user main terminal 100 and the external communication terminal 140 in the middle of the FSM (Flexible Session Manager).

  An environment adaptive engine (EAE) 104 is a processing module that executes information processing, such as data conversion processing, data display processing, and arithmetic processing, that each information processing apparatus has, a cache unit that temporarily stores data, and the like Have

  The user profile database 101 is a database that is distributedly managed by each device, in which the user's hobbies and preferences and the setting environment of the user-owned device are described. The service description database 102 is a database managed in a distributed manner in each device in which the hardware performance of each device, the type of software, and the network service that can be provided are described. Each information processing apparatus including the user main terminal 100 is configured by hardware and software having a plurality of applications, and is a capability detection daemon that is a capability detection unit that detects the capabilities of the hardware and software. The service description database 102 includes an SCL processing unit 107 including capability information generation means for generating a terminal capability information file, and information generated by the function of the SCL processing unit 107 is stored in the service description database 102.

  The capability detection daemon of the SCL processing unit 107 is a program that is resident on the system and is activated when a specific condition is satisfied, and realizes capability detection means for detecting the capabilities of the terminal such as hardware and software. The capability detection daemon is used when a dynamic change occurs in the hardware or software when the terminal starts up, that is, when the hardware is changed during startup, when the software is installed, etc. Start operation when requested. For example, in a portable terminal, since there is a possibility that the hardware is changed during activation such as insertion / removal of a PC card, the capability is detected when there is a change. For this reason, it is necessary to make a program for detecting changes resident. Since software functions are often determined at the time of installation, it is usually necessary to detect the capability only once at the time of installation. In addition, when the user starts communication, real-time terminal information may be required, so the capability is detected by a request from the user. The detected terminal capabilities are sent to the SCL creation daemon.

  The SCL creation daemon is a program that is activated when the capability detection daemon detects the capabilities of the terminal. The capability information creation means for creating a terminal capability information file by listing the capabilities of the terminals detected by the capability detection daemon in a general-purpose format. Is realized. The terminal capabilities are described in a list using, for example, an XML tree structure. XML is a description language based on the specification of the description language HTML, and the specification is extended so that a structured document can be described. The HTML specification has been expanded so that the logical structure of documents and the meaning of components can be defined. For example, in XML, an HTML tag can be used as an extension, and an arbitrary term defined by a user can be used in the tag, and the meaning of elements constituting a document can be specified. Also, by specifying a nested structure using DTD (Document Type Definition), it is possible to define the relationship between document components in a tree format. The terminal capability descriptions listed using XML are referred to as a Service Capability List (hereinafter referred to as SCL). The created SCL is stored in the service description database 102. At this time, an identification code that can be referred to from the outside, that is, a globally unique one (for example, IPv6 address) is assigned as the ID. Thereby, it becomes possible to improve the interoperability of the SCL on the network. Only one ID needs to be described in one SCL.

  For example, the rich communication support mechanism (RCN: Rich Communication Navigator) of the user sub-terminal 110, the content server 120, and the data conversion device 130 as each resource that has received the resource discovery query is a terminal stored in the service description database of each device. By referring to the capability description list (SCL), it is possible to obtain the latest information on the function that dynamically changes in each device and determine whether the function can be provided.

  In the system of the present invention, the functions of a device used by a user or a device existing in the vicinity are dynamically combined, and communication using a plurality of devices at the same time according to the computer environment on the spot is made to the user. It becomes possible to provide. The operation of the present invention is roughly divided into two operations. The two operations will be briefly described with reference to the block diagram of the entire system shown in FIG.

(1) Resource discovery / retrieval process This is an operation for finding a neighboring device and searching for a corresponding function based on a user's request and action. Referring to FIG. 1, based on the functions extracted by the user's actions and requests, referring to the user profile database 101 and the service description database 102, using the network interface provided with the user main terminal 100, the neighboring device The user sub-terminal 110, the content server 120, and the data conversion device 130 are found, and the functions of the devices are searched.

(2) Session management processing This is an operation for managing and operating a plurality of sessions in various states. In FIG. 1, the session management mechanism 103 starts, ends, and changes a session using the function of the discovered device. At this time, the setting of the device is performed by the environment adaptation engine 104, and after the setting is completed, a plurality of sessions are created between the devices.

[Detailed system configuration]
Next, the detailed configuration of the information processing apparatus of the present invention will be described with reference to FIG. FIG. 2 shows a user main terminal 300, a content server 370 that is an information processing apparatus as a user's available resources, a data conversion apparatus 380, and a communication partner terminal 350 that is performing communication with the user main terminal. Yes. Hereinafter, internal components of the user main terminal 300 will be described. These internal components are also included in the content server 370 and the data conversion device 380 as neighboring resources.

Application unit 310
The application 310 includes a user interface unit 311 including hardware and software parts that receive user actions and speech as inputs. The user interface unit 311 can employ various input modes such as mouse events, keyboard events, device movement detection information input, and voice input during conversation. The video conference application 312 is an example of an application that the application unit 310 has. The video conference application 312 is provided as a software part for allowing users to communicate with each other by a bidirectional or unidirectional real-time stream as communication software. The application unit 310 executes not only a video conference application but also various service providing applications corresponding to the devices.

  In FIG. 2, the communication partner terminal 350 that is executing communication with the user main terminal 300 also has an application unit 351 having the same video conference application 352, and the video conference communication is performed by operating both applications. Is possible.

Rich Communication Support Organization (RCN) 320
The rich communication support mechanism (RCN) 320 is a processing unit that mainly executes a search process for other available resources. The context analysis unit 321 is a part that analyzes information input from the user interface unit 311 of the application unit 310. For example, a process of analyzing neighboring resource discovery request data input from the user interface unit 311 and extracting information necessary for generating a resource discovery query, or as necessary information from voice information input to the user interface unit 311 A process of extracting a token and extracting information necessary for generating a resource discovery query is executed.

  The neighborhood resource discovery unit 323 is a processing unit that executes a resource discovery process for specifying an information processing apparatus as a resource that provides a function according to a user request. The service search unit 324 is extracted by the context analysis unit. This is a part for searching whether a device having a function exists in the vicinity of the user. The search for resources and services is executed based on a response packet from another device to the resource discovery query packet by outputting a resource discovery query packet, which is an inquiry packet, to a peripheral information processing apparatus via a network interface. The search can be performed not only by inquiry to the device itself but also by inquiry to the directory server.

  The control unit 322 executes control of message transmission / reception with each part of the context analysis unit 321, the neighboring resource discovery unit 323, the service search unit 324, and other devices.

  The service search unit 372 and the neighboring resource discovery unit 373 of the rich communication support mechanism (RCN) 371 of the content server 370 and the service search unit 383 of the rich communication support mechanism (RCN) 381 of the data conversion device 380 shown in FIG. The part 382 also has the same function as described above.

Session Management Mechanism (FSM) 330
The session management mechanism (FSM) 330 is a processing unit that executes session management. The session management client unit 331 executes processing control for actually starting, ending, and changing a stream session. The session control unit 332 is a processing unit that controls a session operation method. The session control unit 332 determines an operation method based on a message from the rich communication support mechanism of the device itself or another device, and notifies the session management client unit 331 of the operation method. Specifically, for example, processing such as changing a data communication session that is directly communicating with another device to a session that performs communication via other resources is executed based on a message from the rich communication support mechanism. .

  In FIG. 2, a communication partner terminal 350 that is executing communication with the user main terminal 300 also has a similar session management client unit 354 and a session management mechanism 353 having 355 for session control. The session is maintained by the process.

Environment adaptive engine (EAE) 340, 384
The environment adaptive engines (EAE) 340 and 384 have processing modules that execute information processing, such as data conversion processing, data display processing, and arithmetic processing, that each information processing apparatus has, a cache unit that temporarily stores data, and the like. . For example, the environment adaptation engine (EAE) 384 of the data conversion device 380 includes a conversion unit 387. The conversion unit 387 is hardware or software that performs conversion of the stream media format during communication, conversion of the media type itself, and the like. For example, media format conversion such as conversion from MPEG to Motion-JPEG, voice to character Perform media type conversion, such as

  The cache unit 386 is a part that temporarily caches the stream data being communicated. The module environment adaptation engine stores various processing module groups corresponding to each device. If the device does not have the appropriate module, it can also be handled by uploading / downloading via the network. The control units 341 and 385 are units for setting and controlling the environment adaptation engine based on a message from the rich communication support mechanism of another device.

User profile database 301
This is a database managed in a distributed manner in each device, describing the user's hobbies and preferences and the setting environment of the device owned by the user.
Service description databases 302, 374, 388
A database in which each device's hardware performance, software type, and network services it can provide are distributed and managed by each device. The database update processing and the like are executed by the processing of the SCL processing unit as described above.
Content database 303, 375
It is a database that stores various user-owned files such as still images, moving images, and audio.

[Resource discovery / search process and session management process]
As described above, in the system of the present invention, the functions of devices used by users and devices in the vicinity are dynamically combined, and communication using a plurality of devices at the same time according to the computer environment on the spot. Is provided to the user. The processing in the system of the present invention includes (1) resource discovery / retrieval processing, that is, discovery of neighboring devices based on user requests and actions, search for relevant functions, and (2) session management processing, It can be broadly divided into two processes for managing and operating a plurality of sessions in various states. Details of these processes will be described below with reference to the drawings.

(1) Resource Discovery / Search Processing First, resource discovery / search processing executed as processing for searching for neighboring devices and searching for the corresponding function based on user requests and actions will be described with reference to FIG.

  The resource discovery / retrieval process is a process of finding devices in the vicinity and searching for appropriate functions from these devices. First, consider that the user takes some action due to changes in the computer environment. For example, it is assumed that the user inputs “switch a low-quality video stream currently being viewed on a PDA to a nearby high-quality television” from a user interface such as a keyboard. The request input may be executed as a device switching request input based on keyboard input, voice input, or other user action detection, for example, detection of returning home from the outside.

  Details of the resource discovery / search process will be described with reference to FIG. A description will be given in correspondence with the processes (1) to (10) shown in FIG. First, (1) user input information is input to the control unit 322 of the rich communication support mechanism 320 via a user interface. Next, (2) and (3) the control unit 322 requests the service search unit 324 and the neighborhood resource discovery unit 323 to discover service resources based on the user input information. At this time, there are two cases depending on the specific situation of the device to be used.

a. When a device to be used cannot be identified based on information held by the user main terminal When a device capable of providing a function corresponding to a user request has not been identified, its own service search unit 324 and databases 301 to 303, In addition, by issuing a resource discovery query to the service search unit or neighborhood resource discovery unit of the neighboring device, the device having the corresponding function is discovered.

b. When a device to be used can be identified When a device that provides a service based on a request from the user, that is, a device to be used by a user can be identified, the service search unit 324 directly issues a device usage query to the device, Issue only to the specified device.

  First, a. The operation will be described with a specific example. Here, it is assumed that the user main terminal needs a “display function” and “video content with live recording”. The user main terminal first inquires of the service search unit 324 whether the user main terminal has the corresponding function, and the local service description database 302 returns the result. If the problem cannot be resolved locally, a resource discovery query is issued to neighboring devices.

  FIG. 4 shows the internal structure of the resource discovery / use query packet. The internal data of the resource discovery / use query packet will be described.

Destination address Stores the address of the specific device to which the message packet is sent and the multicast address in the same link.
Message type Stores whether the message packet is a discovery query or a usage query.
Source address Stores the address of the device that sends the message packet.
User name The name of the user who uses the resource is stored.
Usage period The period during which the resource is used is stored.
Various parameters List the functions required by the equipment. For example, “display function” and “audio output function” can be mentioned. If the device to be used can be specifically specified, its resource name is described.

  Returning to FIG. 3, the description of the resource discovery / retrieval process will be continued. For example, when the service search unit 372 of the content server 370 in FIG. 3 receives a resource discovery query packet (for example, searching for a certain content) (processing (4)), the service search database 374 and the content database 375 are inquired. (Processing of (8) and (9)).

  Depending on the contents of the resource discovery query packet, a resource whose state changes dynamically may be required. In that case, not only the database but also the neighboring resource discovery unit is inquired (process (7)). The result for the inquiry is returned to the service search unit 324 of the user main terminal 300. Whether or not the device exists in the vicinity of the user is determined by using the neighboring resource information registered in the device in advance, or in the neighboring resource discovery units 323, 373, and 382 of each device, respectively. Each device acquires neighboring resource information (processes (5) and (6)) by executing an information exchange process including

  The resource discovery / use query packet from the user main terminal 300 is, for example, as shown in FIG. 3, when there are two neighboring resources, that is, the content server 370 and the data conversion device 380, for all the neighboring resources. Multicast distribution. The device that has received the resource discovery / use query packet returns a response packet.

  The internal structure of the response packet is shown in FIG. The internal data of the resource discovery / use response packet will be described.

Destination address Stores the address of the specific device to which the message packet is sent and the multicast address in the same link.
Message type Stores whether the message packet is a response packet.
Source address Stores the address of the device that sends the message packet.
Status code Stores a response indicating whether the query is successful, that is, whether the device provides a function in response to a resource discovery / use query request.

  A specific example of the resource discovery / use query packet and a specific example of the resource discovery / use response packet are shown in FIG.

  FIG. 6A shows an example of a resource discovery / use query, where the destination address and message type indicate that it is a resource discovery query, and the source address, user name used, and resource are used. As a period, a usage period, and as parameters, here, a display device has a wide-angle and high-quality display request, and an artist live movie is specified as content.

  FIG. 6B is an example of a resource discovery / use response, which shows a response as a destination address and a message type, and shows a source address, a use user name, and a resource use period. The use period and the function acceptance (OK) are specified as the status.

  When the device and function to be actually used can be specified by transmitting and receiving the resource discovery query and resource discovery response packets described above, a resource use query packet is issued to the corresponding device as a request for using the device. The resource use query packet has the same data structure as described above with reference to FIG. 4, and the message type is a use query setting. The resource reservation period can be set when a resource discovery query packet is issued, that is, when searching for a service. However, when a reservation is made after some time, the resource reservation period may be changed. The resource reservation period information is also stored in the resource use query packet.

  As described above, the resource discovery / usage query and resource discovery / usage response packets are transmitted and received between the user main terminal 300 and the available resources as the peripheral devices, and are input via the user interface. A device that provides a function corresponding to a user request is selected from neighboring resources.

(2) Session Management Processing Next, session management processing for managing and operating a plurality of sessions in various states will be described with reference to FIG. The session management process is a process for executing establishment of a new session or change of a session using an information processing apparatus as a resource searched by the above-described (1) resource discovery / search process.

  Details of the session management process will be described with reference to FIG. A description will be given in correspondence with the processes (1) to (4) shown in FIG. For management operations such as session start and end, signaling by a normal session start protocol can be applied. However, in the system of the present invention, the environment adaptation engine is set simultaneously with the request from the session initiation protocol or the rich communication support mechanism.

  Details of the session management operation will be described with reference to FIG. 7, taking as an example a process when the user main terminal 300 selects the data conversion device 380, which is a server that executes media format conversion, as a neighboring device to be used. .

  When the rich communication support mechanism (RCN) control unit 322 of the user main terminal 300 determines a device to be used and a function to be used, the information is passed to the environment adaptive engine control unit 341 on the user main terminal 300 side (in (2)). processing). At the same time, the rich communication support mechanism (RCN) control unit 322 passes the same information to the session management mechanism (FSM) control unit 332 (process (5)).

  The environment adaptation engine (EAE) control unit 341 on the user main terminal side sends to the environment adaptation engine (EAE) control unit 384 of the data conversion apparatus 380 as the utilization resource determined by transmission / reception of the resource discovery / use query and response packet described above. On the other hand, an environment setting packet is issued in synchronization with the session start protocol (process (3)). The contents of the environment setting packet differ depending on the function of the neighboring device. However, as shown in FIG. 7, when the data conversion process using the function of the conversion module 387 of the data conversion device 380 is requested, the conversion module 387 is used. It is configured as a packet including input / output address / port, input / output media format, etc. Even if the module group does not exist in the neighboring device, it can be uploaded / downloaded from other devices. When these processes are executed, the module group is configured as a packet including the setting information. The environment adaptation engine (EAE) control unit 384 of the data conversion device 380 that has received the environment setting packet executes the setting of the conversion module 387 in accordance with the packet (process (4)).

  The environment setting packet may be issued together with the resource usage query. In this case, the input / output address / port, input / output media format, etc. for setting the data processing module in the resource usage query The information processing apparatus that stores the environment setting information and receives the resource use query performs module setting according to the information in the resource use query.

  In the system of the present invention, each information processing apparatus has a session management mechanism, and searches for other functions that the communication apparatus being used does not have from surrounding information processing apparatuses and uses its resources. Even when a new session is established, session management is performed in the session management mechanism in each information processing apparatus, and a smooth transition of a communication session is possible.

[Processing sequence]
Next, a specific example of the processing sequence executed in the system of the present invention will be described with reference to FIG.

  The example described below corresponds to the system configuration of FIG. 1, and the user has a user main terminal, a user sub terminal, a content server, and a data conversion device as resources that can be used, that is, an information processing device. The example of a process which performs the communication process between a user main terminal and an external communication terminal is shown.

  The user mainly has a user main terminal as a terminal to be used, and the user sub-terminal is a terminal to be used as a secondary. In the vicinity, there are a content server in which content is stored and a conversion device that executes conversion processing such as a media type. Here, it is assumed that a request (J1) for establishing a session using a bidirectional stream such as a video conference with a communication partner is generated, that is, input from the user interface of the application unit 310 in FIG.

  From the user main terminal, first, a resource discovery query (M1) is multicast distributed to neighboring resources in order to discover neighboring terminals. The resource discovery query (M1) is issued in the rich communication support mechanism 320 to all information processing devices as neighboring resources, here, the user sub-terminal, the content server, and the data conversion device.

  As described above with reference to FIG. 5, the resource discovery query (M1) is a resource discovery query, a sender address, a user name used as a message type, a usage period as a resource usage period, and a resource usage period. A packet in which a period and parameters are set.

  Thereafter, although not shown in the figure, a response packet to the resource discovery query is returned to the user main terminal from each information processing device, user sub-terminal, content server, and data conversion device. As described above with reference to FIG. 6, the response packet includes a destination address, a message type indicated as a response, a source address, a user name, a usage period as a resource usage period, Furthermore, it is a packet in which function provision acceptance or rejection information is stored as a status.

  Thereafter, the user using the user main terminal issues a session start request message (M2) from the user main terminal to the communication partner in order to execute data communication via the network such as the Internet with the communication partner, and the response Receive. Here, if communication that can be satisfied as it is is not possible between the communication partner and the user terminal, a resource usage query is issued to the information processing device that has been discovered in the resource discovery query (M1) and response reception processing described above. .

  Here, a resource use query is issued (M3) to a conversion device capable of data conversion in data communication between the user main terminal and the communication partner. This resource usage query includes environment setting information such as input / output address / port and input / output media format for setting the data processing module, that is, the conversion module of the conversion device, and the conversion that received the resource usage query. The device performs the necessary settings.

  After the resource use setting, a session start confirmation message (M4) is issued from the user main terminal to the communication partner, and a session is set and confirmed in the mutual session management mechanism (FSM). When the setting is completed in this way, a bidirectional data stream in which data conversion (J3) is performed by the conversion module of the conversion device is stretched between the user main terminal and the communication partner via the conversion device.

  Next, while the session between the user main terminal and the communication partner with the above conversion process is ongoing, the user inputs a request (J2) that the user wants to receive content streaming on the user sub terminal via the user interface of the user main terminal. Think about the case. First, in response to a request input, the user main terminal generates a resource discovery query in which the rich communication support mechanism (RCN) sets [content streaming reception] as a parameter, and generates the generated resource discovery query for neighboring resources. Issued (M5), receives a resource discovery response packet storing status information of content reception OK from a user sub-terminal in the vicinity, and receives a resource discovery response packet storing status information of content provision OK from the content server Is determined from the content server to be capable of providing content to the user sub-terminal, and a resource use query is issued to these information processing devices (M6).

  The user main terminal transmits a resource use query in which the content transmission processing request for the user sub-terminal and the communication partner is set as a parameter to the content server, and the resource use query in which the content reception process from the content server is set as a parameter Is transmitted to the user sub-terminal.

  When the resource use setting is executed in each information processing apparatus that has received the resource use query, the user main terminal issues a session start request message (M7) to each information processing apparatus that has received the resource use query, and delivers it. The device that has received the request message performs settings for delivery and reception start, and after the setting is completed, streaming distribution of the content is executed from the content server to the user sub-terminal and the communication partner terminal.

[Resource discovery use processing procedure at the main terminal]
Next, a processing procedure in the main terminal that executes a process of finding an information processing apparatus as an available resource will be described with reference to the processing flow of FIG.

  With reference to the system configuration diagram of FIG. 2, processing of each step in the flow of FIG. 9 will be described. In step S101, when a user request is input via the user interface 311 of the application unit 310 of the user main terminal 300, it is determined in step S102 whether or not an information processing apparatus as a resource to be used can be specified. This means that the resource discovery query has already been sent to the peripheral device, the resource discovery response reception has been executed, and the resource used based on the response packet can be determined. And determining whether or not a new resource discovery query is not required to be issued.

  If it is determined that the use resource determination process in the device is impossible, the process proceeds to step S106, and the rich communication support mechanism (RCN) 321 of the user main terminal 300 uses the resource discovery query as a peripheral device as an available resource, for example, It is issued to the content server 370 and the data conversion device 380 shown in FIG.

  As described above with reference to FIG. 5, the resource discovery query includes a transmission destination address, a resource discovery query as a message type, a transmission source address, a user name to be used, a usage period as a resource usage period, , Packets with parameters set. Thereafter, a response packet is returned to the user main terminal, and if resource discovery is successful based on the status of the response packet (Yes in S107), the process proceeds to step S103.

  If it is determined that the used resource determination process in the device, that is, the user main terminal 300 is possible, the process proceeds to step S103 without performing a new resource discovery query issuing process.

  In step S103, the rich communication support mechanism (RCN) 321 of the user main terminal 300 issues a resource usage query for the determined usage resource. In this flow, the resource use query assumes a packet storing environment setting information including module setting information of a device to be used.

  In step S104, when the rich communication support mechanism (RCN) 321 of the user main terminal 300 receives status information indicating that it can be used in a response packet to the resource use query, in step S105, the session management mechanism and the session management in the environment adaptation engine. Then, module setting processing and the like are executed, and a session using resources is started.

[Data communication example]
Next, an example of data communication between devices in the system of the present invention will be described with reference to FIG. In FIG. 10, a user uses two terminals, a user PC (main terminal) 710 and a user PDA (sub-terminal) 720, and tries to communicate with a communication PC 750 as a communication partner using a videophone or video content. This is an example. Note that existing technologies are used for each of the bidirectional session start protocol and SIP, and for the unidirectional stream session start protocol, RTSP.

  First, when a user requests to make a videophone call with a communication partner, the user PC 710 transmits (1) a SIP-INVITE message to the communication partner communication PC 750. The SIP-INVITE message (1) is a message exchange process for exchanging function information such as media formats that can be used by communication devices. In the figure, all responses to the message are omitted, but it is assumed that if there is a response to the SIP-INVITE message, the media formats that can be handled are different between the PCs, so that it is determined that communication is not possible.

  Here, the user PC 710 issues (2) a resource discovery packet by multicast distribution to determine whether there is a device that converts the media format in the vicinity, and executes a resource search process by receiving the response. The user PDA 720, the data conversion device 730, and the content server 740 are found in the vicinity by the resource search using the resource discovery packet. Based on the resource discovery response packet, the data conversion device 730 can be used for data conversion. judge.

  Next, the resource conversion packet storing the setting information of the use period or the setting information of the processing module is issued to the data converter 730 to perform the use procedure. The resource use packet and the environment setting packet may be set as separate packets, and the environment setting packet may be issued and the environment setting (4) performed after the use procedure (3) using the resource use packet is completed. When all the settings are completed, the user PC 710 transmits a SIPACK message to the communication partner PC 750 (5).

  When this reply is received, a two-way videophone call is performed between the user qyjz 710 and the communication PC 750 via the data conversion device 730. Furthermore, when the user requests to communicate while watching the video stream, in order to search for a content server in the vicinity where the video stream is stored and a device capable of displaying the video stream, A resource discovery process is executed by issuing (2) a resource discovery packet by multicast delivery and receiving the response.

  The user PDA 720, the data conversion device 730, and the content server 740 are detected in the vicinity by the resource search using the resource discovery packet. Based on the resource discovery response packet, the content server stores the video stream. The content server 740 discovers the user PDA 720 as a device that can display the video stream.

  After the discovery of these resources, a resource use packet in which a use period is set is issued and a use procedure (6) is performed. After the use procedure is completed, an environment setting packet is issued to perform environment setting (7). When all the settings are completed, an RTSPSTART message is issued to the content server 740 (8) to view a unidirectional video stream. . By doing so, it becomes possible to perform advanced communication by a plurality of devices using neighboring devices, such as viewing a video stream on the PDA 720 at hand and making a videophone call on the user PC 710.

[Information processor hardware configuration example]
The series of processes described in the above embodiments can be executed by hardware, software, or a combined configuration of both. When executing processing by software, a program in which a processing sequence is recorded is installed in a memory in a data processing device incorporated in dedicated hardware and executed, or a general-purpose computer capable of executing various types of processing is used. It is possible to install and run the program. When a series of processing is performed by software, a program constituting the software is installed in, for example, a general-purpose computer or a microcomputer.

  FIG. 11 shows a configuration example of a user main terminal that executes the series of processes described in the above-described embodiment and various information processing apparatuses as neighboring resources. The information processing apparatus illustrated in FIG. 11 illustrates an example of a hardware configuration example that executes the functions described above with reference to FIGS. That is, a user profile database 101, a service description database 102, a session management mechanism FSM (Flexible Session Manager) 103, and an environment adaptive engine (EAE) shown as the components inside the user main terminal 100 in FIG. 104 is a configuration example of a hardware device that executes each process of a rich communication support mechanism (RCN) 105, an application unit 106, and an SCL processing unit 107.

  The information processing apparatus (ex. PC) 850 in FIG. 11 executes various programs such as generation of resource discovery / use query packets and analysis processing of responses to the packets described above, and various programs controlled and executed by the CPU 856. Storage, data storage, RAM serving as a work area for the CPU 856, a memory 857 consisting of ROM, and an HDD 858 as a storage medium for data storage and program storage, each connected to a PCI bus 859 for mutual data transmission and reception Have a possible configuration. Furthermore, for example, a data processing module 851 that executes functions specific to each device such as data conversion processing is included.

  Further, the network interface 852 that functions as an interface with a communication network, the input / output interface 853 with input devices such as a mouse 837 and a keyboard 836, data input from AV data input / output devices such as a video camera 833, a microphone 834, and a speaker 835. An AV interface 854 for performing output and a display interface 855 as a data output interface for the display 832 are provided.

  In the configuration example of FIG. 11, when an information processing terminal having a video conference execution function is taken as an example, the data processing module 851 inputs, for example, image data from the video camera 833 and audio data from the microphone 834 and encodes them. After processing, packet generation processing (packetizing) is executed, and finally a packet with encoded data as a payload is generated. The generated packet is output on the PCI bus 859 and output to the network via the network interface 852. And delivered to the destination address set in the header of the packet. These packet data are applied as communication data for the video conference application. In addition, a received packet in which moving image encoded data such as a video conference is stored is decoded by the data processing module 851 and reproduced and output by the display 832 and the speaker 835.

  On the other hand, a resource discovery / use query packet or a response packet input via the network is output on the bus 856 via the network interface 852, processed under the control of the CPU 856, and a resource discovery / use query packet. Alternatively, data analysis such as a response packet is performed, and resource discovery processing or environment setting processing is executed.

  These resource discovery / use query packet generation processing, response packet data analysis processing, environment setting processing, and other programs are stored in a memory 857 such as a ROM and are executed by the CPU 856. However, the CPU 856 loads not only the ROM storage program but also a program stored in the hard disk, a program transferred from a satellite or a network, received and installed in a memory such as a RAM (Random Access Memory). It is also possible to execute.

  Here, in the present specification, the program may be processed by one computer or may be distributedly processed by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.

  The present invention has been described in detail above with reference to specific embodiments. However, it is obvious that those skilled in the art can make modifications and substitutions of the embodiments without departing from the gist of the present invention. In other words, the present invention has been disclosed in the form of exemplification, and should not be interpreted in a limited manner. In order to determine the gist of the present invention, the claims section described at the beginning should be considered.

  As described above, according to the configuration of the present invention, in an environment where there are various usable information processing devices in the vicinity of the user, the main terminal used by the user responds to the user request in response to the user request. The information processing apparatus having the function to perform the detection process can be performed, and by using the detected device, the data processing and the data communication according to the user request that cannot be performed by one apparatus can be performed.

  In addition, according to the configuration of the present invention, by transmitting a resource discovery / use query packet to a device capable of data communication, it is possible to check the function of each information processing device and set the environment. Even when the function of the information processing apparatus dynamically changes, it is possible to acquire the latest function information of each information processing apparatus based on the Service Capability List (SCL) as the updated terminal capability description data. .

  Further, according to the configuration of the present invention, each information processing device has a session management mechanism, and searches for other functions not included in the communication device being used from the peripheral information processing device, Even when a new session using resources is established, session management is executed in the session management mechanism in each information processing apparatus, so that a smooth transition of a communication session is possible.

100 User main terminal 101 User profile database 102 Service description database 103 Session management mechanism (FSM: Flexible Session Manager)
104 Environment Adaptive Engine (EAE)
105 Rich Communication Support Organization (RCN)
DESCRIPTION OF SYMBOLS 106 Application part 107 SCL process part 110 User subterminal 120 Content server 130 Data converter 300 User main terminal 301 User profile database 302 Service description database 303 Content database 310 Application part 311 User interface 312 Video conference application 320 Rich communication support mechanism 321 Context Analysis unit 322 Control unit 323 Neighboring resource discovery unit 324 Service search unit 330 Session management mechanism 331 Session management client unit 332 Session control unit 340 Environment adaptive engine 341 Control unit 350 Communication partner terminal 351 Application unit 352 Video conference application 353 Session management mechanism 354 Session management client unit 355 session control unit 370 content server 371 rich communication support mechanism 372 service search unit 373 neighbor resource discovery unit 380 data conversion device 381 rich communication support mechanism 382 neighbor resource discovery unit 383 service search unit 384 environment adaptation engine 385 control unit 386 Cache unit 387 Conversion unit 710 User PC (main terminal)
720 User PDA (sub-terminal)
730 Data converter 740 Content server 750 Communication PC
809 PCI bus 832 display 833 video camera 834 microphone 835 speaker 837 mouse 838 keyboard 850 data transmission / reception device 851 data processing module 852 network interface 853 input / output interface 854 AV interface 855 display interface 856 CPU
857 Memory 858 HDD

The first aspect of the present invention is:
A control device for controlling the function providing device,
Transmission means for transmitting a search packet for searching for a function that can be provided by the function providing apparatus to a plurality of function providing apparatuses by multicast;
Receiving means for receiving a response packet for the search packet from the function providing device when the providing function corresponding to the providing function searched by the search packet is included in at least one of the plurality of function providing devices. When,
The control apparatus includes function requesting means for requesting provision of the function to at least one of the function providing apparatuses that transmitted the response packet.

  The second aspect of the present invention is
  A function providing device among a plurality of function providing devices controlled by the control device,
  Receiving means for receiving, from the control device, a multicast search packet for searching for a function that can be provided by each of the plurality of function providing devices;
  A determination unit that determines whether or not the provided function corresponds to the provided function searched by the search packet;
  A transmission means for transmitting a response packet to the search packet when having a function that can be provided by the search packet;
  Execution means for executing the function that can be provided in response to a request from the control device;
A function providing device comprising:

  The third aspect of the present invention is
  A program for executing information processing in a control device that controls a function providing device,
  Causing the transmission means to execute search processing for transmitting a search packet for searching for a function that can be provided by the function providing apparatus to a plurality of function providing apparatuses by multicast;
  When the receiving function includes a providing function corresponding to the providing function searched by the search packet in at least one of the plurality of function providing devices, a response packet for the search packet is received from the function providing device. Execute the receiving process to receive,
  There is a program for causing a function requesting unit to execute a function requesting process for requesting the provision of the function to at least one of the function providing apparatuses that transmitted the response packet.

The fourth aspect of the present invention is
A program for executing information processing in one function providing apparatus among a plurality of function providing apparatuses controlled by the control apparatus,
Causing the receiving means to execute a reception process for receiving, from the control device, a search packet for searching for a function that can be provided by each of the plurality of function providing devices by multicast;
Causing the determination means to execute a determination process for determining whether or not it has a function that can be provided, corresponding to the provided function searched by the search packet;
When the transmission means has a function that can be provided that is searched by the search packet, the transmission unit executes a transmission process of transmitting a response packet to the search packet,
Execution processing for executing the function that can be provided in response to a request from the control device to execution means;
It is in the program that executes

Claims (6)

An information processing apparatus that executes communication processing,
Request input means for inputting a search request for a device having a content server function;
In response to the request, a function inquiry to a plurality of peripheral devices capable of communication is executed, an answer is received, an apparatus having a contents server function is searched by analyzing the answer, and the contents server function selected as a result of the search Control means for making a request to execute a content server function to a device having
An information processing apparatus. The information processing apparatus includes:
Receives status information indicating that content can be received from a service receiving device that performs content reception processing by executing the content server function.
The information processing apparatus according to claim 1, wherein a content providing process for the service receiving apparatus is started from an apparatus having the content server function. The information processing apparatus includes:
The information processing apparatus according to claim 1 or 2, wherein the search request is input and the search process of the content server is executed during a communication process with another communication partner. An information processing device that performs communication with a plurality of peripheral devices during communication connection with another communication device,
Search request detecting means for detecting a request to search for a content server from among the plurality of peripheral devices during communication with the other communication device;
Inquiry means for inquiring whether or not there is a content server function for the plurality of peripheral devices according to the detection result of the search request detecting means,
Receiving means for receiving an answer to the inquiry from the plurality of peripheral devices;
A device determination unit that selects a device having the content server function based on a reception result of the reception unit;
A server function request transmitting means for requesting the selected apparatus to execute a content server function based on a determination result of the apparatus determining means;
An information processing apparatus. An information processing method executed in an information processing device that executes communication processing,
A request input step in which the request input means inputs a search request for a device having a content server function;
In response to the request, the control means executes a function inquiry to a plurality of peripheral devices capable of communication, receives an answer, searches for an apparatus having a content server function by analyzing the answer, and is selected as a result of the search. Making an execution request for the content server function to an apparatus having the content server function,
Information processing method to execute. A program for executing information processing in an information processing apparatus that executes communication processing,
In a request input means, a request input step for performing input detection of a search request for a device having a content server function;
In response to the request, the control means executes a function inquiry to a plurality of peripheral devices capable of communication, receives an answer, searches for an apparatus having a content server function by analyzing the answer, and is selected as a result of the search. Causing the apparatus having the content server function to make an execution request for the content server function;
A program that executes