JP4689500B2 - Information processing device - Google Patents

Description

  The present invention relates to a technique for transmitting / receiving audio data, video data, and the like to / from a communication partner via a network, and in particular, information processing that detects a change in data type and performs processing corresponding to the data type. Relates to the device.

  In recent years, communication environments including the Internet have become widespread, and information processing apparatuses having a communication function are increasing. Such information processing apparatuses are used in offices and homes. In communication environments, broadbandization is progressing, and information processing apparatuses and applications having a multimedia communication function for transmitting and receiving audio data, video data, and the like are increasing accordingly.

  Also, telephones that have been used as communication means are being IP-based using VoIP (Voice over Internet Protocol) technology, and video such as videophones and video conferences that transmit and receive video in addition to voice. Communication has also been realized.

  With such communication IP, as a technology for realizing media communication such as VoIP, the Internet standard defines protocols such as SIP (Session Initiation Protocol) and RTP (Real-time Transport Protocol). Yes. In order to compress and transmit media data, many codecs represented by MPEG (Moving Picture Experts Group) 2 and MPEG4 are defined and used. By using these technologies, basic functions such as start, change, and disconnection of communication and transmission / reception of contents are realized.

  On the other hand, various problems are found when such media communication is realized. As one of the problems, it has been pointed out that when the encoding method is switched during communication, abnormal noise is generated at the switching timing, or the video is disturbed or interrupted. The following Patent Document 1 is for solving such a problem.

In Patent Document 1, when the encoding method is switched from the first encoding method to the second encoding method during communication with the communication partner, the packet communication device (transmission side) completes preparation of the communication partner. Until then, the audio and / or video signal encoded by the first encoding method is transmitted. Then, the packet communication device (receiving side) can decode the voice decoded by the second decoding method and / or after the decoding process of the second decoding method corresponding to the second encoding method is stabilized. Output video signal.
JP 2002-247137 A

  However, in Patent Document 1 described above, when the encoding method is switched during communication, it is possible to prevent abnormal noise from being generated at the switching timing, or to prevent the video from being disturbed or interrupted. If the type of data to be changed is changed halfway, the change cannot be detected on the receiving side, and it cannot be handled.

  For example, in a normal videophone call, video images taken by a caller with a camera and audio collected by a microphone are sent and received in real time. During that time, one caller shows a video previously recorded by the other party. If you want to, you can send the recorded image to the other party by encoding the recorded video instead of the video taken by the camera and sending it to the other party. This is possible by switching the input of the video source to be transmitted using an AV (Audio Visual) selector or the like.

  At that time, in the transmission side device, the user designates the source and instructs switching, so that it can be recognized that the videophone video is switched to the recorded video as a trigger. However, the receiving apparatus has a problem that even if the source is switched at the transmission source, it cannot be recognized at what timing what content is switched.

  In addition, when changing the codec used for encoding, for example, when transmitting a video of content or the like to the other party instead of transmitting the image of the caller in the videophone, the image quality is higher than that of the camera itself. If you want to show the video to the other party, it is necessary to re-negotiate by changing the call control signaling to change to a high-quality codec. Or notification of information that the video input device has changed. Therefore, since the codec has been changed on the receiving side, it cannot be recognized whether the transmission content has been changed or whether it has been changed due to other factors such as changes in conditions such as the communication bandwidth state and the processing capability of the device. There was a problem.

  The present invention has been made in order to solve the above-described problems. The first object is to change the communication data during connection with the information processing apparatus of the other party, at what timing, and at what timing. An object of the present invention is to provide an information processing apparatus capable of notifying whether data is changed.

  Secondly, when communication data is changed while connected to the information processing device of the other party, a notification of when the data is changed and at what timing is received, and the screen configuration is changed. It is to provide an information processing apparatus that can be changed.

  According to an aspect of the present invention, an information processing apparatus is input by a communication unit that transmits / receives data to / from an external device, an interface unit that inputs an input source switching instruction from a user, and an interface unit. In accordance with the input source switching instruction, the input source is switched, data is input and transmitted to the external device via the communication means, and identification information for identifying the type of input data or a combination of types of input data is provided. Control means for transmitting to an external device via the communication means.

  Preferably, the control means selects the input device, switches the input source to input data, and inputs the type or identification information of the input data by signaling for controlling media communication with the external device. And signaling means for transmitting via.

  More preferably, the signaling means transmits the type or identification information of the input data described by the session description protocol to the external device.

  Preferably, the control means further includes an encoding means for performing codec processing by selecting an encoder according to the data switched by the input control means, and the signaling means transmits information relating to the codec processing to an external device.

  Preferably, the signaling unit transmits information specifying the output form to the external device according to the data switched by the input control unit.

  Preferably, the control means selects the input device and switches the input source to input data, and inputs the data input by the input control means and the type or identification information of the input data via the communication means. Data transmission means for transmitting to the apparatus.

  More preferably, the data transmission means transmits the type or identification information of the input data to the external device using the payload type of the real-time transport protocol packet.

  According to another aspect of the present invention, an information processing device includes a communication unit that transmits and receives data to and from an external device, and a type of data received from the external device via the communication unit or a set of types of received data. Control means for extracting identification information for identifying the combination and controlling the output of the received data in accordance with the type or identification information of the received data.

  Preferably, the control means controls the output of the received data in accordance with the type of the received data or the identification information, and the signaling means for receiving the type or the identification information of the received data by signaling for controlling the media communication with the external device. Output control means.

  More preferably, the signaling means receives the type or identification information of the received data described by the session description protocol.

  Preferably, the control means further includes decoding means for selecting the decoder in accordance with information related to the codec processing received by the signaling means and performing codec processing, and the output control means outputs the data decoded by the decoding means. To control.

  Preferably, the output control means changes the output form of the output device according to the information specifying the output form received by the signaling means and outputs the data.

  Preferably, the control means receives the received data and the type or identification information of the received data via the communication means, and the output control means controls the output of the received data according to the type or identification information of the received data. Including.

  More preferably, the data receiving means receives a real-time transport stream packet in which the type or identification information of the received data is specified using the payload type.

  According to an aspect of the present invention, the control unit switches the input source in accordance with the input source switching instruction input by the interface unit, inputs data, and transmits the data to the external device via the communication unit. Since identification information for identifying the type of data or the combination of types of input data is transmitted to the external device via the communication means, the data is changed to what data at what timing with respect to the external device. Can be notified.

  In addition, since the signaling means transmits the type or identification information of the input data via the communication means by signaling that controls media communication with the external device, it is possible to reliably notify the external device of data changes, etc. It becomes.

  In addition, since the signaling means transmits the type or identification information of the input data described by the session description protocol to the external device, it is possible to notify the external device of data changes using the existing protocol. It becomes.

  In addition, since the signaling unit transmits information related to the codec processing to the external device, the external device can recognize what codec processing should be used to decode the data.

  In addition, since the signaling unit transmits information specifying the output mode according to the data switched by the input control unit to the external device, the external device can change the output mode accordingly.

  In addition, since the data transmission means transmits the data input by the input control means and the type or identification information of the input data to the external device via the communication means, it is possible to easily notify the external device of data change or the like. It becomes possible.

  In addition, since the data transmission means transmits the type or identification information of the input data to the external device using the payload type of the real-time transport protocol packet, the data is changed to the external device without using special signaling. Can be notified.

  According to another aspect of the present invention, the control means extracts identification information for identifying the type of data received from the external device via the communication means or a combination of the types of received data, and the type of received data. Alternatively, since the output of the received data is controlled according to the identification information, it is possible to easily recognize the data change and the like, and to change the output form accordingly.

  Further, since the signaling unit receives the type or identification information of the received data by signaling for controlling the media communication with the external device, it is possible to reliably receive notifications such as data changes.

  In addition, since the signaling means receives the type or identification information of the received data described by the session description protocol, it is possible to receive notifications such as data changes using the existing protocol.

  Further, since the codec means selects the decoder according to the information related to the codec processing received by the signaling means and performs the codec processing, the decoder can be easily selected.

  Further, since the output control means changes the output form of the output device according to the information specifying the output form received by the signaling means and outputs the data, the data is output in an output form suitable for the received data. It becomes possible.

  In addition, since the data receiving means receives the received data and the type or identification information of the received data via the communication means, it is possible to easily receive notifications such as data changes.

  In addition, since the data receiving means receives the real-time transport stream packet specifying the type or identification information of the received data using the payload type, it receives a notification such as data change without using special signaling. It becomes possible.

(First embodiment)
FIG. 1 is a diagram showing an example of the appearance of an information processing apparatus according to the first embodiment of the present invention. The information processing apparatus includes a computer main body 1, a display 2, a speaker 3 that outputs voice, a microphone 4 that collects a voice of a caller, a camera 5 that captures a video of the caller, and a remote controller 10 includes an infrared port 6 that communicates with infrared rays 10 and an external AV input terminal 7 to which an audio signal and a video signal are input from the outside.

  The remote controller 10 includes a numeric key 101, a call key 102, a disconnect key 103, a cross key 104, and an enter key 105.

  FIG. 2 is a block diagram showing a hardware configuration of the information processing apparatus according to the first embodiment of this invention. This information processing apparatus includes a display 2, a speaker 3, a microphone 4, a camera 5, an infrared port 6, an audio external input terminal 7-1, a video external input terminal 7-2, and an audio external output terminal 8. -1, an external video output terminal 8-2, an external speaker terminal 9 for connecting an external speaker (not shown), a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, and a RAM (Random Access) Memory) 13, AV selector 14, network device 15, TV tuner 16 that receives TV broadcast waves, mpeg4 decoder 17, mpeg4 encoder 18, mpeg2 decoder 19, and mpeg2 encoder 20.

  A program for controlling the entire information processing apparatus is stored in the ROM 12, and the CPU 11 develops the program stored in the ROM 12 on the RAM 13 and executes it. The RAM 13 is also used for temporarily storing audio data, video data, and the like.

  The AV selector 14 includes a display 2, a speaker 3, a microphone 4, a camera 5, an infrared port 6, an audio external input terminal 7-1, an external video input terminal 7-2, an external audio output terminal 8-1, and an external video output terminal 8. -2, external speaker terminal 9, TV tuner 16, mpeg4 decoder 17, mpeg4 encoder 18, mpeg2 decoder 19, and mpeg2 encoder 20 for switching and mixing audio and video input / output devices.

  The network device 15 is connected to a network such as the Internet, and transmits / receives audio data, video data, and the like to / from the other information processing apparatus.

  FIG. 3 is a block diagram showing a functional configuration of the information processing apparatus according to the first embodiment of the present invention. In FIG. 3, a portion surrounded by a dotted line is configured by hardware, and a portion surrounded by a solid line is configured by software.

  The input device 21 corresponds to the microphone 4, the camera 5, the infrared port 6, the audio external input terminal 7-1, the video external input terminal 7-2, the TV tuner 16, and the like shown in FIG. The output device 22 corresponds to the display 2, the speaker 3, the audio external output terminal 8-1, the video external output terminal 8-2, the external speaker terminal 9, and the like shown in FIG.

  The encoder 24 corresponds to the mpeg4 encoder 18 and the mpeg2 encoder 20. The decoder 25 corresponds to the mpeg4 decoder 17 and the mpeg2 decoder 19. The communication device 23 corresponds to the network device 15.

  Functions realized by software include a GUI (Graphical User Interface) unit 31, a communication management unit 32, an input control unit 33, an output control unit 34, an encoding unit 35, a decoding unit 36, and a data transmission unit 37. A signaling unit 38, a data receiving unit 39, and a communication unit 40.

  The GUI unit 31 realizes the function of the graphical user interface of the information processing apparatus in the present embodiment. For example, the GUI unit 31 receives an input signal from the remote controller 10 via the infrared port 6 and enables an application operation or the like according to the display on the display 2. Further, by controlling the screen configuration in accordance with an instruction from the communication management unit 32, it is possible to display a screen in cooperation with the video displayed by the output control unit 34.

  In addition, if there is an instruction to change the source of data to be transmitted by the remote controller 10 or the like from the user, the GUI unit 31 notifies the communication management unit 32 of the instruction.

  The communication management unit 32 manages notification from the GUI unit 31 based on user operations and information on signal reception from the signaling unit 38. The communication management unit 32 controls the input control unit 33 based on these pieces of information, causes the encoding unit 35 to encode data such as audio and video from the designated input device 21, and transmits the encoded data as data. To the unit 37.

  In addition, the communication management unit 32 causes the decoding unit 36 to decode the data received by the data receiving unit 39 from the partner information processing apparatus. Then, the output control unit 34 is controlled to output the decoded data to an appropriate output device 22.

  When the communication management unit 32 receives a notification indicating a connection change from the GUI unit 31, the communication management unit 32 causes the signaling unit 38 to transmit a SIP signal. When the communication management unit 32 causes the signaling unit 38 to transmit the SIP signal, the communication management unit 32 notifies the source information of the communication data to be transmitted together. When the signaling unit 38 receives the communication data source information from the partner information processing apparatus and the connection change negotiation is completed, the communication management unit 32 responds to the connection change by the input control unit 33 and the output control unit 34. And the input device 21 and the output device 22 are changed, or the screen configuration is changed using the GUI unit 31.

  The input control unit 33 outputs data from the designated input device 21 to the encoding unit 35 in response to an instruction from the communication management unit 32.

  The encoding unit 35 encodes data using the designated encoder 24 in response to an instruction from the communication management unit 32, and outputs the encoded data to the data transmission unit 37.

  The data transmission unit 37 instructs the communication unit 40 to convert the encoded data received from the encoding unit 35 into an RTP packet and transmit it to the destination designated by the communication management unit 32.

  The communication unit 40 generates an IP packet from the RTP packet received from the data transmission unit 37 and transmits it via the communication device 23. Further, the communication unit 40 outputs the data packet received via the communication device 23 to the signaling unit 38 or the data receiving unit 39. Whether the received data packet is output depends on an instruction from the communication management unit 32.

  The data receiving unit 39 extracts data from the data packet received from the communication unit 40 and outputs the data to the decoding unit 36.

  The decoding unit 36 decodes data using the decoder 25 designated by the communication management unit 32 and outputs a signal obtained by the decoding to the output control unit 34.

  The output control unit 34 selects the output device 22 in response to an instruction from the communication management unit 32, and outputs the signal received from the decoding unit 36 to the selected output device 22 in cooperation with the GUI unit 31.

  In response to an instruction from the communication management unit 32, the signaling unit 38 requests the partner information processing device to start, change, or end communication, and makes a response to the request from the partner information processing device. Further, it interprets the packet data of the SIP signal received by the communication unit 40 and notifies the communication management unit 32 of the information.

  As will be described later, when the signaling unit 38 receives an instruction to transmit a connection change SIP signal from the communication management unit 32, the signaling unit 38 inserts the source information by inserting an a = X-media-source line into the message body of the SIP signal. Append. Conversely, when a SIP signal is received from the partner information processing apparatus, information on the a = X-media-source line appended to each medium is extracted and notified to the communication management unit 32.

  FIG. 4 is a sequence diagram for explaining transmission media change by signaling of the information processing apparatus according to the first embodiment of this invention. First, when the terminal A transmits an INVITE request to the terminal B (T1), the terminal B recognizes that it is an incoming videophone call based on the media information included in the message body of the INVITE, and transmits a 200 OK response to the terminal A. (T2). Thereby, transmission / reception of the video imaged by the camera 5 and the sound collected by the microphone 4 is started (communication state 1).

  Next, when the terminal A transmits a re-INVITE request to the terminal B (T3), the terminal B recognizes the communication change by the media information included in the message body of the re-INVITE, and processes it according to the new data. And a 200 OK response is transmitted to terminal A (T4). As a result, the terminal A starts transmission of the recorded video (hereinafter referred to as external input video) input from the video external input terminal 7-2 and the like and the sound collected by the microphone 4 ( Communication state 2).

  Next, when the terminal A transmits a re-INVITE request to the terminal B (T5), the terminal B recognizes that it is an incoming videophone call based on the media information included in the message body of the re-INVITE, and receives a 200 OK response. Is transmitted to the terminal A (T6). As a result, transmission / reception as a TV phone is resumed (communication state 3).

  FIG. 5 is a flowchart for explaining the overall processing procedure of the information processing apparatus according to the first embodiment of the present invention. When the information processing apparatus is activated, first, the communication management unit 32 transitions to a standby state (S11), and instructs the GUI unit 31 to display a standby screen on the display 2 (S12).

  Next, the communication management unit 32 determines whether an event has been received (S13). This event includes an event related to signal information from the signaling unit 38 and an event by a user operation from the GUI unit 31. If the communication management unit 32 has not received an event (S13, No), it waits until an event is received. When the communication management unit 32 receives an event (S13, Yes), it is determined whether the event is a request reception event (S14).

  If the event is a request reception event (S14, Yes), a request reception process as described later is performed (S15), and the process returns to step S13 to repeat the subsequent processes. This request reception event occurs when the signaling unit 38 receives a SIP signal.

  If the event is not a request reception event (S14, No), it is determined whether or not the event is a request transmission event (S16). If the event is a request transmission event (S16, Yes), a request transmission process as described later is performed (S17), and the process returns to step S13 and the subsequent processes are repeated. This request transmission event occurs when the GUI unit 31 detects a user operation.

  If the event is not a request transmission event (S16, No), it is determined whether or not the event is a response reception event (S18). If the event is a response reception event (S18, Yes), a response reception process as described later is performed (S19), the process returns to step S13 and the subsequent processes are repeated. This response reception event occurs when the signaling unit 38 receives a SIP signal.

  If the event is not a response reception event (S18, No), it is determined whether or not the event is a response transmission event (S20). If the event is a response transmission event (S20, Yes), a response transmission process as described later is performed (S21), and the process returns to step S13 and the subsequent processes are repeated. This response transmission event occurs when the GUI unit 31 detects a user operation.

  If the event is not a response transmission event (S20, No), it is determined whether or not the event is an end event (S22). If the event is an end event (S22, Yes), the communication management unit 32 ends the entire process. This end event occurs, for example, when the GUI unit 31 detects that the user has long pressed the power button of the remote controller 10. If it is not an end event (S22, No), the process returns to step S13 and the subsequent processing is repeated.

  FIG. 6 is a diagram for explaining state transitions managed by the information processing apparatus according to the first embodiment of this invention. As will be described later, the request reception process includes a status of accepting a change (T16) and a status of incoming connection (T13). The request transmission process includes a change requesting state (T15) and a outgoing connection state (T12). Further, the response reception process and the response transmission process include a state (T14) during connection communication.

  In the state transition diagram shown in FIG. 6, for example, there is a transition from the standby state (T11) to the outgoing connection state (T12) or the incoming connection state (T13), but the connection communication state (T14), change This indicates that there is no transition to the requesting state (T15) and the change accepting state (T16).

  FIG. 7 is a flowchart for explaining the processing procedure of the request reception processing (S15) shown in FIG. Since the request reception event is an event that occurs when a request message is received among SIP signals, the request message processing corresponds to this request reception processing.

  First, the communication manager 32 checks the state (S31). This state confirmation is to confirm the received event and the current state. When an event that cannot be received in the sequence in the current state is received (S32, No), the signaling unit 38 is instructed to transmit an error response. Then, the signaling unit 38 creates an error response and transmits the error response to the partner information processing apparatus via the communication unit 40 (S47).

  FIG. 8 is a diagram illustrating an example of a state confirmation table referred to by the communication management unit 32. In the status confirmation table shown in FIG. 8, in the standby state, events of connection request transmission, connection request reception, connection response transmission and connection response reception may be received, but other events will not be received. Show. Each event shown in FIG. 8 will become clear from the description of the flowcharts shown in FIG. 7 and FIGS.

  If the status check is completed (S32, Yes), the communication management unit 32 determines whether the request reception event is a change request (change request reception event) (S33). If it is a change request reception event (S33, Yes), it changes to a change accepting state (S34), and message body change information described in SDP (Session Description Protocol) in the SIP signal received by the signaling unit 38 Is extracted (S35). Then, the communication management unit 32 instructs the GUI unit 31 to display the change acceptance screen (S36), temporarily stops transmission of communication data before the change request until the change is completed (S37), and performs processing. finish.

  If it is not a change request reception event (S33, No), the communication management unit 32 determines whether or not the request reception event is a connection request (connection request reception event) (S38). If it is a connection request reception event (S38, Yes), the state transits to the incoming connection state (S39), and the incoming information of the message body described in SDP in the SIP signal received by the signaling unit 38 is extracted (S40). ). Then, the communication management unit 32 instructs the GUI unit 31 to display the incoming call connection screen (S41), and ends the process.

  If it is not a connection request reception event (S38, No), the communication management unit 32 determines whether or not the request reception event is a disconnection request (disconnection request reception event) (S42). If it is a disconnection request reception event (S42, Yes), data transmission / reception unit 39 and data reception unit 39 are controlled to complete data transmission / reception (S44), and signaling unit 38 transmits a 200 OK response to the disconnection request (S44). S44). Then, the communication management unit 32 instructs the GUI unit 31 to display a standby screen that is an initial screen (S45), transitions to a standby state (S46), and ends the processing.

  FIG. 9 is a flowchart for explaining the processing procedure of the request transmission processing (S17) shown in FIG. The request transmission event is an event that occurs when the GUI unit 31 detects a user operation, and is related to processing when communication is started, changed, or disconnected.

  First, the communication management unit 32 performs state confirmation with reference to the state confirmation table shown in FIG. 8 (S51). When an event that cannot be received in the sequence in the current state is received (S52, No), the process is terminated as it is.

  If the status check is completed (S52, Yes), the communication management unit 32 determines whether or not the request transmission event is a change request (change request transmission event) (S53). If it is a change request transmission event (S53, Yes), the state changes to a change requesting state (S54), and information related to the change detected by the GUI unit 31 is extracted (S55). Then, the communication management unit 32 instructs the GUI unit 31 to display the change request screen (S56), causes the signaling unit 38 to transmit a re-INVITE message of the SIP signal to the other information processing apparatus (S57), Communication is temporarily stopped (S58), and the process is terminated.

  If it is not a change request transmission event (No in S53), the communication management unit 32 determines whether the request transmission event is a connection request (connection request transmission event) (S59). If it is a connection request transmission event (S59, Yes), the state transits to the outgoing connection state (S60), and information relating to the transmission detected by the GUI unit 31 is extracted (S61). Then, the communication management unit 32 instructs the GUI unit 31 to display the outgoing call connection screen (S62), and causes the signaling unit 38 to transmit the INVITE message of the SIP signal to the partner information processing apparatus (S63). Exit.

  If it is not a connection request transmission event (S59, No), the communication management unit 32 determines whether or not the request transmission event is a disconnection request (disconnection request transmission event) (S64). If it is a disconnection request transmission event (S64, Yes), the signaling unit 38 transmits a BYE message of the SIP signal to the partner information processing apparatus (S65), and controls the data transmission unit 37 and the data reception unit 39 to control the data transmission. Transmission / reception is terminated (S66). Then, the communication management unit 32 instructs the GUI unit 31 to display a standby screen that is an initial screen (S67), transitions to a standby state (S68), and ends the processing.

If it is not a disconnection request transmission event (S64, No), the process is terminated as it is.
FIG. 10 is a flowchart for explaining the procedure of the response reception process (S19) shown in FIG. A response reception event occurs when a response is received to any one of a connection request (INVITE message), a change request (re-INVITE message), and a disconnection request (BYE message) sent to the other information processing apparatus. The corresponding process corresponds to this response reception process.

  First, the communication manager 32 checks the state (S71). When an event that cannot be received in the sequence in the current state is received (S72, No), the process is terminated as it is.

  If the status check is completed (S72, Yes), the communication management unit 32 determines whether or not the response reception event is a change response (change response reception event) (S73). If it is a change response reception event (S73, Yes), change response information is extracted from the SIP signal received by the signaling unit 38 (S74). If the 200 OK response is confirmed by the change response information (S75, Yes), the communication management unit 32 controls the GUI unit 31, the input control unit 33, and the output control unit 34 to match the communication after the change. The screen is displayed (S76). Then, transmission / reception of communication data according to the negotiation result of the change is started (S77), the state transits to the connected communication state (S84), and the process is terminated.

  If the 200 OK response is not confirmed by the change response information (S75, No), the change request is canceled and the GUI unit 31 is instructed to return to the screen before the change request, and the data transmission unit 37 and the data reception are received. The communication before the change request is restarted by the unit 39 (S78), the state transits to the connected communication state (S84), and the process is terminated.

  If it is not a change response reception event (S73, No), the communication management unit 32 determines whether or not the response reception event is a transmission response (transmission response reception event) (S79). If it is a transmission response reception event (S79, Yes), transmission response information is extracted from the SIP signal received by the signaling unit 38 (S80). If a 200 OK response is confirmed by the outgoing response information (S81, Yes), the communication management unit 32 controls the GUI unit 31, the input control unit 33, and the output control unit 34 to match the communication after connection. The screen is displayed (S82). Then, transmission / reception of communication data according to the connection negotiation result is started (S83), the state transits to the connection communication in progress state (S84), and the process is terminated.

  If the 200 OK response is not confirmed by the outgoing response information (S81, No), the communication management unit 32 instructs the GUI unit 31 to display the standby screen that is the initial screen, assuming that the connection request is rejected. (S87), transition to the waiting state (S88), and the process is terminated.

  If it is not a transmission response reception event (S79, No), the communication management unit 32 determines whether or not the response reception event is a disconnection response (disconnection response reception event) (S85). If it is a disconnection response reception event (S85, Yes), the data transmission unit 37 and the data reception unit 39 are controlled to terminate communication (S86), and the GUI unit 31 is instructed to display a standby screen that is an initial screen. (S87), a transition is made to the waiting state (S88), and the process is terminated.

If it is not a disconnection response reception event (S85, No), the process is terminated as it is.
FIG. 11 is a flowchart for explaining the processing procedure of the response transmission processing (S21) shown in FIG. The response transmission event is an event that occurs when the GUI unit 31 detects a user operation after receiving a request from another information processing apparatus.

  First, the communication manager 32 checks the state (S91). When an event that cannot be received in the sequence in the current state is received (S92, No), the process is terminated as it is.

  If the status confirmation is completed (S92, Yes), the communication management unit 32 causes the signaling unit 38 to transmit a response corresponding to the event (S93). Then, it is determined whether or not the response transmission event is a change response (change response transmission event) (S94). If it is a change response transmission event (S94, Yes), it is determined whether a 200 OK response has been transmitted (S95).

  If the 200 OK response has been transmitted (S95, Yes), the communication management unit 32 controls the GUI unit 31 to switch the display screen and also controls the input control unit 33 and the output control unit 34 to input the input device. 21 and the output device 22 are changed, and the encoder 35 and decoder 36 are controlled to switch the encoder 24 and decoder 25 (S96). Then, transmission / reception of communication data according to the negotiation result of the change is started (S97), the state transits to the connected communication state (S104), and the process is terminated.

  If the 200 OK response has not been transmitted (S95, No), the GUI unit 31 is instructed to return to the screen before the change request, and the data transmission unit 37 and the data reception unit 39 resume communication before the change request. (S99), the state transits to the connected communication state (S104), and the process is terminated.

  If it is not a change response transmission event (S94, No), the communication management unit 32 determines whether or not the response transmission event is a connection response (connection response transmission event) (S100). If it is a connection response transmission event (S100, Yes), it is determined whether a 200 OK response has been transmitted (S101).

  If a 200 OK response has been transmitted (S101, Yes), the communication management unit 32 controls the GUI unit 31 to switch to a display screen according to the information of the communication data, and the input control unit 33 and the output control unit. 34 is controlled to change the settings of the input device 21 and the output device 22, and the encoder 35 and the decoder 36 are controlled to switch the encoder 24 and the decoder 25 (S102). Then, transmission / reception of communication data according to the connection negotiation result is started (S103), the state transits to the connection communication in-progress state (S104), and the process is terminated.

  If the 200 OK response has not been transmitted (S101, No), the communication management unit 32 instructs the GUI unit 31 to display the standby screen that is the initial screen (S105), and transitions to the standby state. (S106), the process ends.

  FIG. 12 is a diagram for explaining an example of communication start. FIG. 12A shows that the user has switched to the phone book display screen by pressing the # key on the remote controller 10. The destination is selected by depressing the up / down of the cross key of the remote controller 10, and the transmission is started by depressing the decision key 105.

  FIG. 12 (b) shows that the user enters a telephone number by pressing the call key, and inputs the connected TV telephone number with the numeric key 101. The transmission is started when the user presses the transmission key again.

  FIG. 13 is a diagram showing an example of an INVITE request (TV phone mode) of a SIP signal. This INVITE request includes a header field (1) and a message body (2).

  In the header field (1), the first header field describes INVITE as the request type and SIP URI (Uniform Resource Identifier). The Via header field indicates the transport used for the transaction and includes a branch parameter that identifies the transaction.

  The From header field indicates the logical identity of the person who initiated the request, and includes a tag parameter containing a random string. The To header field indicates the logical recipient of the desired request. The Call-ID header field indicates a unique identifier for grouping consecutive messages.

  The CSeq header field indicates a sequence number and method for identifying and ordering transactions. The Contact header field indicates a SIP URI or the like that can be used to contact a specific instance of the UA (User Agent) in subsequent requests. The Allow header field indicates a list of methods supported by the UA that generates the message, and INVITE, ACK, CANCEL, BYE, OPTIONS, MESSAGE, SUBSCRIBE, and NOTIFY are supported.

  The Supported header field indicates support for SIP extensions that the server can apply to the response. The Session-Expires header field indicates the relative time after which the message expires.

  The Max-Forwards header field indicates a limit on the number of hops that a request can pass in the process of going to the destination. The Content-Type header field indicates the media type of the message body sent to the recipient. The Content-Length header field indicates the size of the message body sent to the recipient.

  In the message body (2), (3) shows an audio media description, the audio RTP port number is 4050, and the audio compression method is G.264. 711 PCMU (Pulse Codec Modulation μ-Law). Further, a = X-media-source line indicates that the sound is a microphone sound.

  In the message body (2), (4) shows the media description of the video, and the video compression method that the transmission side device desires to receive the video data is MP4V-ES and the RTP port number is 4060. It is shown that. Further, the media requests the video of the camera by a = X-media-source line.

  The information in the message body can be interpreted as a videophone mode as an application, and the partner information processing apparatus can display a video as a videophone and output a microphone sound.

  FIG. 14 is a diagram illustrating an example of a 200 OK response (TV phone mode) of a SIP signal. This 200 OK response describes information relating to communication of communication data as a response for accepting connection to the INVITE request, and includes a header field (1) and a message body (2).

  In the header field (1), the difference from FIG. 13 is that a Record-Route header field is added. This Record-Route header field indicates that subsequent requests in the dialog are routed through the proxy.

  In the message body (2), (3) indicates a voice media description and indicates that the voice RTP port number is 16350. Other descriptions are the same as the description of the INVITE request.

  In the message body (2), (4) indicates the media description of the video and indicates that the RTP port number of the video is 16360. Other descriptions are the same as the description of the INVITE request.

  The 200 OK response is transmitted to the information processing apparatus that has transmitted the request, whereby a videophone call is started.

  FIG. 15 is a diagram showing a state during a call in the TV phone mode. On the display screen of each information processing apparatus, the other party's face is displayed larger, the own face is displayed smaller, and the other party's voice is output from the speaker of the information processing apparatus. In this state, when the user on the left side presses the * button on the remote controller 10, for example, switching of the transmission source is started.

  FIG. 16 is a diagram illustrating a transmission source switching screen. When the user on the left side presses the * button on the remote controller 10, a list of transmission sources is displayed on the display screen. For example, when the enter key 105 of the remote controller 10 is pressed in a state where the external input is selected, the camera video is switched to the external input video.

  FIG. 17 is a diagram illustrating an example of a re-INVITE request (external input video switching) of a SIP signal. This re-INVITE request requests switching from the camera video to the external input video, and includes a header field (1) and a message body (2).

  The header field (1) is the same as the INVITE message in FIG. 13, and the number of CSeq is increased from 1 to 2.

  In the message body (2), (3) shows an audio media description, the audio RTP port number is 4050, and the audio compression method is G.264. 711 PCMU. Further, a = X-media-source line indicates that the sound is a microphone sound.

  In the message body (2), (4) indicates the media description of the video, and indicates that the video RTP port number is 4060 and the video compression method is MP4V-ES. Further, a = X-media-source line indicates that the video is a camera video. Further, it is described that this video stream is only received on the request side.

  In the message body (2), (5) indicates the media description of the video, and indicates that the video RTP port number is 4080 and the video compression method is MP4V-ES. Further, a = X-media-source line indicates that the video is an external input video. Further, it is described that the video stream is only transmitted as viewed from the responding side.

  The message body information can be interpreted as switching from the camera video to the external input video, and the partner information processing apparatus can display the external input video and output the microphone sound.

  FIG. 18 is a diagram illustrating an example of a 200 OK response (external input video switching) of a SIP signal. This 200 OK response describes information relating to communication of communication data as a response to approve a change to the re-INVITE request, and includes a header field (1) and a message body (2).

  The header field (1) is the same as the header field (1) shown in FIG. In the message body (2), (3) shows the audio media description, which is the same as the description in (3) of FIG.

  In the message body (2), (4) indicates the media description of the video, and the RTP port number of the video is 16360, indicating that this video is only transmitted. The other descriptions are the same as the description (4) of the re-INVITE request shown in FIG.

  In the message body (2), (5) indicates the media description of the video, and the RTP port number of the video is 16370, indicating that this video is only received. Other descriptions are the same as the description (5) of the re-INVITE request shown in FIG. Here, the port “16370” that is different from the port “16360” that has received the camera video up to now is changed and responded. Therefore, the video data of the camera is prevented from being processed as an external input video at the switching timing.

  When this 200 OK response is transmitted to the information processing apparatus that has transmitted the re-INVITE request, the information processing apparatus as the transmission source starts transmission of the external input video. Moreover, since the voice is as before, the conversation can be continued.

  FIG. 19 is a diagram illustrating a screen display when the terminal A transmits a switching (change) request. When the user on the left transmits a switching request, “switch request transmission” is displayed on the screen of the information processing apparatus. In addition, “Receive switching request” is displayed on the screen of the right information processing apparatus that has received the switching request. The user on the right side operates the remote controller 10 to select whether or not to receive a switching request. When the right user selects switching, a 200 OK response is transmitted to the left information processing apparatus.

  FIG. 20 is a diagram showing a screen display when the video is switched to the external input video. As shown in FIG. 20, the screen configuration is changed to a screen configuration for sharing an externally input video instead of the conventional screen configuration of the TV phone. Since the voice is the same as before, the conversation can be continued.

  In the above description, the communication data is changed using the SIP signal. However, the communication data is not dependent on the SIP protocol, and may be realized by another call control protocol or its extension or the original notification protocol. Is possible.

  In this embodiment, an extension header defined as a = X-media-source is defined and information on the source device is notified to the other party, but information other than the source device can also be notified. is there. Specifically, the source content file type information, for example, a content such as “2005 birthday party photo”, “digital video shooting video”, “sport video”, “music” A category may be indicated such as “video”.

  In this way, for example, if the title is “athletic day”, an image matching “athletic day” is displayed in the background in accordance with video reception, and music that makes “athletic day” image is played on BGM. It is also possible to create a simple application.

  In the case of a title corresponding to “music”, it is possible to set the audio output to be switched to a stereo speaker connected to the audio external output terminal 8-1, and music from an external input is output to an external speaker. It is also possible to select an output device without mixing, such as outputting the microphone sound to a built-in speaker.

  In addition to directly describing source device information in the SIP signal, a combination of source devices may be selected by describing a communication mode. For example, a camera and a microphone are defined as a videophone mode, and a microphone and an external input video are defined as a video sharing voice communication mode, and the mode is described and notified to the other party. In the case of SIP, it is also possible to notify information using an i header field describing session information.

  Also, the session state may be described with a name. For example, “TVPhone” is described for a videophone mode using a camera, and “ExVideo” is described for a mode in which an external input video is transmitted and shared. In this case as well, the background and screen configuration can be switched between the normal videophone and the video sharing mode.

  As described above, in the information processing apparatus according to the present embodiment, the information processing apparatus transmits a re-INVITE request including information indicating the type of transmission data while connected to the partner information processing apparatus. Therefore, the other information processing apparatus can recognize that the received data is switched, and can change the screen configuration and select the output apparatus in accordance with the change.

(Second Embodiment)
The external appearance, hardware configuration, and functional configuration of the information processing apparatus in the second embodiment of the present invention are the same as the external appearance, hardware configuration, and functional configuration in the first embodiment shown in FIGS. is there. Further, the processing procedure of the information processing apparatus in the second embodiment of the present invention is the same as the processing procedure in the first embodiment shown in FIG. 5, FIG. 7 and FIGS. Therefore, detailed description will not be repeated.

  In the first embodiment, the video being transmitted is replaced with another video. The information processing apparatus according to the present embodiment adds new communication data communication in addition to communication data communication already in use.

  FIG. 21 is a diagram illustrating an example of a re-INVITE request for a SIP signal when a new medium is added to a medium in use. This re-INVITE request is for adding audio input from the audio external input terminal 7-1 or the like (hereinafter referred to as external input audio) and external input video in addition to the microphone audio and camera video. And includes a header field (1) and a message body (2).

  The header field (1) is the same as the header field (1) shown in FIG. The message body (2) is different from FIG. 13 in that the description of the external input audio (4) and the description of the external input video (6) are added.

  In the message body (2), (4) indicates a voice media description, the voice RTP port number is 4070, and the voice compression method is G.264. 711 PCMU. Further, the a = X-media-source line indicates that the voice is an externally input voice. In addition, it is described that this voice is only transmitted.

  In the message body (2), (6) indicates the media description of the video, and indicates that the video RTP port number is 4080 and the video compression method is MP4V-ES. Further, a = X-media-source line indicates that the video is an external input video. In addition, it is described that this video is only transmitted.

  FIG. 22 is a diagram illustrating an example of a 200 OK response of the SIP signal when a new medium is added to the medium in use. This 200 OK response describes information related to communication of communication data as a response to approve the addition of media in response to a re-INVITE request, and includes a header field (1) and a message body (2).

  The header field (1) is the same as the header field (1) shown in FIG. The message body (2) is different from FIG. 14 in that the description of the external input audio (4) and the description of the external input video (6) are added.

  In the message body (2), (4) indicates a voice media description, the voice RTP port number is 16370, and the voice compression method is G.264. 711 PCMU. Further, the a = X-media-source line indicates that the voice is an externally input voice. In addition, it is described that this voice is only received.

  In the message body (2), (6) indicates the media description of the video, the video RTP port number is 16380, and the video compression method is MP4V-ES. Further, a = X-media-source line indicates that the video is an external input video. In addition, it is described that this video is only received.

  FIG. 23 is a diagram illustrating an information processing apparatus when external input audio and external input video are added as media. On the display screen of each information processing apparatus, the external input video is displayed as a large main screen as a shared video, and the other party's face is displayed small as a sub-screen with picture-in-picture. In addition, external input audio is output from the built-in speaker 3 of each information processing apparatus, and the other party's audio is output from an external speaker connected to the audio external output terminal 8-1.

  In this way, it is possible to change to a session where the other party's facial expressions and conversation can be seen while simultaneously viewing video content. The output method of communication data of voice and video to be communicated can be freely controlled by an application.

  As described above, according to the information processing apparatus of the present embodiment, a new medium is added to a medium in use by a re-INVITE request, so that the operability of the information processing apparatus is further improved. Became possible.

(Third embodiment)
In the first and second embodiments, information is notified by signaling different from communication data. In the information processing apparatus according to the present embodiment, such information is notified in communication data communication without using special signaling.

  The external appearance, hardware configuration, and functional configuration of the information processing apparatus in the third embodiment of the present invention are the same as the external appearance, hardware configuration, and functional configuration in the first embodiment shown in FIGS. is there. Therefore, detailed description will not be repeated.

  FIG. 24 is a diagram illustrating a method of changing communication data using a payload type value transmitted in an RTP packet. By inserting and transmitting a predetermined payload type packet before this data, it is possible to notify the start and switching of the videophone mode, the changed communication mode, the source type, and the like.

  Normally, payload type information other than this data negotiated by SIP or the like is discarded, but if it is an information processing device that knows the value of a predetermined payload type, it can be divided into a delimited packet and the value of the payload type. It is possible to recognize what is switched to.

  In FIG. 24, a packet of the payload type (PT) = 100 is transmitted before the start of the videophone mode, and a packet of PT = 101 is transmitted at the start of the video sharing mode. As a packet. In this way, if only the videophone mode is changed to the video sharing mode, renegotiation by signaling is not required, and the communication such as the payload type and the receiving port is not changed at all, but the data transmitted on the receiving side is not changed. Can switch to another source.

  FIG. 25 is a flowchart for explaining the processing procedure of the information processing apparatus according to the third embodiment of the present invention. First, the communication management unit 32 selects the input device 21, the output device 22, and the like, switches the parameter setting, the screen configuration, and the like based on the result negotiated by the SIP signal (S111).

  Next, the communication management unit 32 determines whether a communication end event has occurred due to a user operation or signaling (S112). If the end event occurs (S112, Yes), the communication is ended. If no end event has occurred (S112, No), the communication management unit 32 reads the RTP packet received by the data receiving unit 39 from a reception buffer (not shown) (S113), and extracts its payload type ( S114).

  If it matches the payload type negotiated by the SIP signal (S115, Yes), the data is written in an input buffer (not shown) of the decoder 25 (S120), and the process returns to step S112 to repeat the subsequent processing.

  If it does not match the negotiated payload type (S115, No), it is confirmed where the transmission source of the packet is (S116), and it is determined whether or not it matches the communication partner (S117).

  If it does not coincide with the communication partner (S117, No), the packet is ignored and the processing returns to step S112 and the subsequent processing is repeated. If it matches with the communication partner (S117, Yes), the output setting assigned to the payload type is read (S118). If there is no mode corresponding to the payload type (S119, No), the data is read from the decoder 25. Writing to the input buffer (S120), returning to step S112, the subsequent processing is repeated.

  If there is a mode corresponding to the payload type (S119, Yes), the data remaining in the input buffer of the decoder is cleared (S121), and the screen configuration, output setting, etc. are changed to correspond to the mode corresponding to the payload ( S122), returning to step S112, the subsequent processing is repeated.

  FIG. 26 is a diagram illustrating an example of output settings (modes) assigned to payload types. In the case of PT = 100, a camera video is transmitted to indicate a videophone configuration (mode). In the case of PT = 101, an external input video (moving image) is transmitted, which indicates a video sharing configuration (mode). In the case of PT = 102, an external input video (still image) is transmitted, indicating that it is a still image sharing configuration (mode). In the case of PT = 103, a file video is transmitted, indicating that the file sharing configuration (mode) is set.

  FIG. 27 is a diagram showing a screen configuration corresponding to the assigned configuration shown in FIG. FIG. 27A shows a screen configuration corresponding to the videophone configuration, in which a camera image from a communication partner is displayed in a large size and its own camera image is displayed in a small size.

  FIG. 27B shows a screen configuration corresponding to the video sharing configuration, in which the other party's camera image is displayed on the video in a picture-in-picture manner so that the other party's display during video viewing can be seen. Yes.

  FIG. 27C shows a screen configuration corresponding to the still image sharing configuration, in which only still images are displayed.

  As described above, according to the information processing apparatus of the present embodiment, a packet of a predetermined payload type is inserted and transmitted before this data, so that no special signaling is used. The mode can be changed within the communication data communication.

(Fourth embodiment)
In the third embodiment, a payload type packet predetermined by the information processing apparatus is inserted before this data and transmitted. In the information processing apparatus according to the present embodiment, information is notified by embedding a payload type value in a communication data packet and transmitting it.

  The external appearance, hardware configuration, and functional configuration of the information processing apparatus in the fourth embodiment of the present invention are the same as the external appearance, hardware configuration, and functional configuration in the first embodiment shown in FIGS. is there. Therefore, detailed description will not be repeated.

  FIG. 28 is a diagram illustrating a method of changing communication data by embedding a payload type value in communication data transmitted by an RTP packet. By embedding a predetermined payload type in communication data and transmitting it, it is possible to notify the start and switching of the videophone mode, the changed communication mode, the type of source, and the like. In the case of embedded PT = 98, it indicates the videophone mode. Further, when PT = 99, the video sharing mode is indicated.

  FIG. 29 is a flowchart for explaining the processing procedure of the information processing apparatus according to the fourth embodiment of the present invention. First, the communication management unit 32 selects the input device 21, the output device 22, and the like, switches the parameter setting, the screen configuration, and the like based on the result negotiated by the SIP signal (S131).

  Next, the communication management unit 32 determines whether or not a communication end event has occurred due to a user operation or signaling (S132). If the end event occurs (S132, Yes), the communication is ended. If no end event has occurred (S132, No), the communication management unit 32 reads the RTP packet received by the data reception unit 39 from a reception buffer (not shown) (S133), and where is the transmission source of the packet? It is checked whether or not there is a match (S134), and it is determined whether or not it matches the communication partner (S135).

  If it does not coincide with the communication partner (S135, No), the packet is ignored, the process returns to step S132, and the subsequent processing is repeated. If it matches the communication partner (S135, Yes), the payload type is extracted (S136). Then, the output setting assigned to the payload type is read (S137), and if there is no mode corresponding to the payload type (S138, No), the communication is terminated.

  If there is a mode corresponding to the payload type (S138, Yes), the screen configuration, output setting, etc. are changed to correspond to the mode corresponding to the payload (S139), and the data remaining in the decoder input buffer is cleared ( (S140) The communication data is written in the input buffer of the decoder (S141), the process returns to step S132 and the subsequent processing is repeated.

  FIG. 30 is a diagram illustrating an example of a display screen when the communication mode is switched. As shown in FIG. 30, a message on the screen informs the user that the communication mode changes.

  It is also possible to change the display size and position of the image, and to change the display decoration such as the background image and the design of the video display frame. Such information can be realized by holding or notifying the information processing apparatus as a set value in advance.

  FIG. 31 is a diagram illustrating an example of a SIP signal when an attribute is extended with an SDP description and information regarding media display is transmitted. In this description, the video is displayed in an A × B size with (x, y) coordinates with the upper left position as the origin, and the layout of the design defined by the name “layout 1” is used as the display frame. It is shown. In this example, “layout 1” can specify a background image in the entire screen area, has a message display area at the bottom, and can display a free video display on top of it. . An image named “Background 1” is displayed in the background image, and “2005/5/8 concert video” is designated to be displayed in the message display area.

  FIG. 32 is a diagram illustrating an example of the definition data of the layout 1. In this definition data, the screen size is 640 × 480 with the upper left coordinates (0,0) as the origin, the background is not set as default (null), and the message area is from coordinates (0,500) to (500, 80).

  FIG. 33 is a diagram showing an example of a screen displayed based on the SDP description shown in FIG. 31 and the definition data of layout 1 shown in FIG.

  Also, the priority such as image quality changes depending on the type of video to be transmitted. For example, when sharing a video, high-quality video is required, but the video on a videophone camera may be high enough to see the other person's facial expression, rather it is better to reduce the image quality to reduce delay it is conceivable that. In video, the quality is affected by fluctuations in delay time called jitter, but by changing the buffer size for that purpose, the image quality and the delay can be controlled.

  In addition, since the buffer can be cleared at the switching timing as described above, the start delay of the video after switching can be reduced.

  As described above, according to the information processing apparatus of the present embodiment, since a predetermined payload type is inserted into a communication data packet and transmitted, communication can be performed without using special signaling. The mode can be changed in the data communication.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows the example of an external appearance of the information processing apparatus in the 1st Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the information processing apparatus in the 1st Embodiment of this invention. It is a block diagram which shows the functional structure of the information processing apparatus in the 1st Embodiment of this invention. It is a sequence diagram for demonstrating the transmission media change by signaling of the information processing apparatus in the 1st Embodiment of this invention. It is a flowchart for demonstrating the whole process sequence of the information processing apparatus in the 1st Embodiment of this invention. It is a figure for demonstrating the state transition managed by the information processing apparatus in the 1st Embodiment of this invention. It is a flowchart for demonstrating the process sequence of the request | requirement reception process (S15) shown in FIG. It is a figure which shows an example of the state confirmation table referred by the communication management part. It is a flowchart for demonstrating the process sequence of the request | requirement transmission process (S17) shown in FIG. It is a flowchart for demonstrating the process sequence of the response reception process (S19) shown in FIG. It is a flowchart for demonstrating the process sequence of the response transmission process (S21) shown in FIG. It is a figure for demonstrating an example of a communication start. It is a figure which shows an example of the INVITE request | requirement (TV telephone mode) of a SIP signal. It is a figure which shows an example of 200 OK response (TV telephone mode) of a SIP signal. It is a figure which shows the state during a telephone call in TV telephone mode. It is a figure which shows the switching screen of a transmission source. It is a figure which shows an example of the re-INVITE request | requirement (external input video switching) of a SIP signal. It is a figure which shows an example of 200 OK response (external input video switching) of a SIP signal. It is a figure which shows a screen display when the terminal A transmits the switching (change) request | requirement. It is a figure which shows a screen display when an image | video is switched to the external input image | video. It is a figure which shows an example of the re-INVITE request | requirement of a SIP signal in the case of adding a new medium to the medium in use. It is a figure which shows an example of the 200 OK response of a SIP signal in the case of adding a new medium to the medium in use. It is a figure which shows the information processing apparatus when the external input audio | voice and the external input video | video are added as a medium. It is a figure which shows the method of changing communication data using the value of the payload type transmitted with a RTP packet. It is a flowchart for demonstrating the process sequence of the information processing apparatus in the 3rd Embodiment of this invention. It is a figure which shows an example of the output setting (mode) assigned to the payload type. FIG. 27 is a diagram showing a screen configuration corresponding to the assigned configuration shown in FIG. 26. It is a figure which shows the method of embedding the value of a payload type in the communication data transmitted with a RTP packet, and changing communication data. It is a flowchart for demonstrating the process sequence of the information processing apparatus in the 4th Embodiment of this invention. It is a figure which shows an example of the display screen when the mode of communication switches. It is a figure which shows an example of the SIP signal in the case of extending attribute in SDP description and transmitting information related to media display. It is a figure which shows an example of the definition data of the layout 1. FIG. 33 is a diagram showing an example of a screen displayed based on the SDP description shown in FIG. 31 and the definition data of layout 1 shown in FIG. 32.

Explanation of symbols

  1 computer main body, 2 display, 3 speaker, 4 microphone, 5 camera, 6 infrared port, 7 external AV input terminal, 7-1 audio external input terminal, 7-2 video external input terminal, 8-1 audio external output terminal, 8-2 Video external output terminal, 9 External speaker terminal, 10 Remote controller, 11 CPU, 12 ROM, 13 RAM, 14 AV selector, 15 Network device, 16 TV tuner, 17 mpeg4 decoder, 18 mpeg4 encoder, 19 mpeg2 decoder, 20 mpeg2 encoder, 21 input device, 22 output device, 23 communication device, 24 encoder, 25 decoder, 31 GUI unit, 32 communication management unit, 33 input control unit, 34 output control unit, 35 encoding unit, 36 decoding unit, 37 decoder Data transmission unit, 38 signaling unit, 39 data reception unit, 40 communication unit, 101 numeric keys, 102 transmission key, 103 disconnect key, 104 cross key, 105 decision key.

Claims (14)

A communication means for transmitting / receiving data to / from an external device;
Interface means for inputting an input source switching instruction from the user;
In accordance with an input source switching instruction input by the interface unit, the input source is switched and data is input and transmitted to the external device via the communication unit. The type of the input data or the type of the input data An information processing apparatus comprising: control means for transmitting identification information for identifying a combination of the above to the external apparatus via the communication means. The control means is an input control means for selecting an input device and switching the input source to input data;
The information processing apparatus according to claim 1, further comprising: signaling means for transmitting the type of the input data or the identification information via the communication means by signaling for controlling media communication with the external apparatus.   The information processing apparatus according to claim 2, wherein the signaling unit transmits the type of the input data or the identification information described by a session description protocol to the external apparatus. The control means further includes an encoding means for performing codec processing by selecting an encoder in accordance with the data switched by the input control means,
The information processing apparatus according to claim 2, wherein the signaling unit transmits information related to codec processing to the external apparatus.   The information processing apparatus according to claim 2, wherein the signaling unit transmits information specifying an output form to the external device according to data switched by the input control unit. The control means is an input control means for selecting an input device and switching the input source to input data;
The information processing apparatus according to claim 1, further comprising: a data transmission unit configured to transmit data input by the input control unit and the type of the input data or the identification information to the external device via the communication unit.   The information processing apparatus according to claim 6, wherein the data transmission unit transmits the type of the input data or the identification information to the external apparatus using a payload type of a real-time transport protocol packet. A communication means for transmitting / receiving data to / from an external device;
Identification information for identifying the type of data received from the external device via the communication means or a combination of the types of received data is extracted, and the received data is extracted according to the type of received data or the identification information. An information processing apparatus including control means for controlling output. The control means is a signaling means for receiving the type of received data or the identification information by signaling for controlling media communication with the external device;
The information processing apparatus according to claim 8, further comprising: an output control unit that controls output of the received data according to a type of the received data or the identification information.   The information processing apparatus according to claim 9, wherein the signaling unit receives the type of the received data or the identification information described by a session description protocol. The control means further includes decoding means for selecting a decoder according to information on codec processing received by the signaling means and performing codec processing,
The information processing apparatus according to claim 9 or 10, wherein the output control means controls output of data decoded by the decoding means.   The information processing according to any one of claims 9 to 11, wherein the output control means changes the output form of the output device according to information designating the output form received by the signaling means and outputs data. apparatus. The control means includes data receiving means for receiving the received data and the type of the received data or the identification information via the communication means;
The information processing apparatus according to claim 8, further comprising: an output control unit that controls output of the received data according to a type of the received data or the identification information.   The information processing apparatus according to claim 13, wherein the data receiving unit receives a real-time transport stream packet specifying a type of the received data or the identification information using a payload type.

Images