Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/16—Analogue secrecy systems; Analogue subscription systems
  • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
  • H04N7/17309—Transmission or handling of upstream communications
  • H04N7/17318—Direct or substantially direct transmission and handling of requests
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L45/00—Routing or path finding of packets in data switching networks
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L61/00—Network arrangements, protocols or services for addressing or naming
  • H04L61/45—Network directories; Name-to-address mapping
  • H04L61/4505—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
  • H04L61/4511—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L63/00—Network architectures or network communication protocols for network security
  • H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
  • H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
  • H04L63/0492—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload by using a location-limited connection, e.g. near-field communication or limited proximity of entities
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L63/00—Network architectures or network communication protocols for network security
  • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
  • H04L63/0869—Network architectures or network communication protocols for network security for authentication of entities for achieving mutual authentication
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/27—Server based end-user applications
  • H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
  • H04N21/2743—Video hosting of uploaded data from client
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/41—Structure of client; Structure of client peripherals
  • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
  • H04N21/4223—Cameras
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
  • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
  • H04N21/43074—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
  • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

• the present invention relates to a communication processing device, a data communication system and method, and a computer program.
• a communication processing apparatus, a data communication system, and a data communication system capable of receiving and playing back image data acquired by an imaging apparatus such as a video camera via a network such as the Internet at a specific remote receiving apparatus, and Methods, as well as computer 'programs.
• Video cameras have become widespread, and many users have taken pictures using video cameras.
• Data taken by the video camera is recorded on a recording medium attached to the video camera, such as HD (Hard Disk) or DVD (Digital Versatile Disc).
• HD Hard Disk
• DVD Digital Versatile Disc
• ⁇ Shooting user side processing Uploads shooting data to a specific server via the Internet using the video camera's communication interface.
• Patent Document 1 Japanese Patent Laid-Open No. 2006-13739
• Patent Document 2 Japanese Patent Laid-Open No. 2005-101980
• a specific global IP address is assigned to such a web camera for video distribution, and anyone can access it.
• video cameras used by general individual users often do not have a global IP address setting. Therefore, when streaming from a video camera to a home TV via a home or public wireless LAN, the video camera is Power required to register IP addresses in DNS server and control router port forwarding Difficult to put in such functions due to limitations of video camera processing capacity and memory capacity There are cases.
• video shot by an individual user's video camera is generally private. Since it is not open to an unspecified number of people like a WEB camera, making it accessible to anyone by addressing is not preferable from the viewpoint of protecting personal information. Therefore, it is preferable to select a transmission partner on the photographer side on the video camera side and transmit the captured image to a specific selection client.
• Patent Document 1 Japanese Unexamined Patent Publication No. 2006-13739
• Patent Document 2 JP-A-2005-101980
• the present invention has been made in view of the above-described circumstances, and enables transmission of streaming data by transmitting shooting data to a remote place, and further transmission of data on the video camera side that acquires shooting data. It is an object of the present invention to provide a communication processing apparatus, a data communication system and method, and a computer program that can select a partner and transmit photographing data only to a selected specific client.
• the first aspect of the present invention provides
• a communication processing device having a video camera function
• a communication control unit that executes a process of generating a transmission packet storing data captured by the video camera function and outputting the packet to a network;
• a memory storing a host name of a data transmission destination device and a port number set for port forwarding processing for forwarding the transmission packet to the data transmission destination device in a relay device of a connection network of the data transmission destination device.
• the communication control unit controls the communication control unit
• a communication processing apparatus characterized in that it is configured to generate a transmission packet including address information corresponding to a host name of the data transmission destination device and the port number as destination information and output the packet to a network It is in.
• the communication control unit receives address information corresponding to a host name of the data transmission destination device stored in the memory from a DNS server.
• the present invention is characterized in that a process for generating a transmission packet including the received address as destination information and outputting it to the network is executed.
• the communication processing device includes an authentication processing unit that executes an authentication process with the data transmission destination device, and performs authentication in the authentication processing unit.
• the host name of the data transmission destination device and the set port number of the port forwarding process in the relay device of the connection network of the data transmission destination device are received from the data transmission destination device and stored in the memory. It is a configuration that executes processing.
• the communication processing device further includes a decoder that performs a decoding process of image and audio data included in the reception data of the communication control unit. And a data combining unit that performs control to combine the data generated by the decoder and the data captured by the video camera function.
• the second aspect of the present invention provides
• a communication processing device that executes output control of data received via a network, and performs port forwarding processing, which is packet forwarding processing for the communication processing device, to a relay device of the network to which the communication processing device is connected.
• a communication control unit that executes a setting request and receives data via a network and the relay device; a decoding processing unit that executes a decoding process of data received by the communication control unit;
• An output processing unit that executes an output process of data generated in the decoding processing unit
• the communication processing device further includes a camera unit, and the data received by the communication control unit and the camera And a data synthesizer that performs control to synthesize the captured data.
• the communication control unit is configured to execute a process of generating a packet storing data photographed by the camera and outputting the packet.
• the communication control unit is based on input information input via a user input unit! / The transmission and reception of packets that store data captured in this way are executed and stopped.
• the communication processing device further includes a data synthesis unit that displays and outputs bit rate information of data received by the communication control unit. To do.
• the communication control unit receives the data via a network based on bit rate setting information input via a user input unit! This is characterized in that a process for outputting a bit rate setting request to a data transmission source is executed.
• the third aspect of the present invention provides
• a data communication system comprising data transmission means having a video camera function and data reception means for receiving transmission data of the data transmission means;
• the data transmission means includes
• a communication control unit that executes a process of generating a transmission packet storing data captured by the video camera function and outputting the packet to a network;
• a memory storing a host name of the data receiving means and a set port number of port forwarding processing for forwarding the transmission packet in the relay device of the connection network of the data receiving means to the data receiving means;
• the communication control unit controls the communication control unit
• the data receiving means includes
• a communication control unit that executes a setting request for port forwarding processing to a relay device of the network to which the data receiving unit is connected, and receives data from the data transmitting unit via the network and the relay device;
• a decoding processing unit that executes a decoding process of data received from the data transmission unit
• An output processing unit that executes an output process of data generated in the decoding processing unit
• the fourth aspect of the present invention provides
• a communication control method in a communication processing apparatus having a video camera function wherein a communication control unit includes a host name of a data transmission destination device from a memory and a bucket for the data transmission destination device in a relay device of a connection network of the data transmission destination device. Obtaining a set port number for port forwarding processing, which is data transfer processing;
• the communication control unit generates address packets corresponding to the host name of the data transmission destination device and the port number as destination information, and generates a transmission packet storing data shot by the video camera and outputs the transmission packet to the network. Performing the process;
• the fifth aspect of the present invention provides
• a data processing method for executing control of data received via a network in a communication processing device
• the communication control unit In the communication control unit, executing a setting request for port forwarding processing as packet transfer processing to the communication processing device to a relay device of the network to which the communication processing device is connected;
• the communication control unit receives data via the network and the relay device.
• the decoding processing step executes the decoding processing of the data received in the communication control unit;
• an output processing step for executing output processing of the data generated in the decoding processing unit
• the sixth aspect of the present invention provides
• a computer program that executes communication control in a communication processing device with a video camera function.
• the communication control unit obtains the host name of the data transmission destination device from the memory and the set port number of the port forwarding process that is a packet transfer process for the data transmission destination device in the relay device of the connection network of the data transmission destination device. Step to be
• the communication control unit receiving address information corresponding to a host name of the data transmission destination device from a DNS server;
• the communication control unit generates address packets corresponding to the host name of the data transmission destination device and the port number as destination information, and generates a transmission packet storing data captured by the video camera and outputs the transmission packet to the network.
• There is a computer 'program characterized by executing a step of executing a process.
• a computer program that executes control of data received via a network in a communication processing device.
• the communication control unit receives data via the network and the relay device.
• a decoding processing step for executing decoding processing of data received in the communication control unit;
• an output processing step for executing output processing of the data generated in the decoding processing unit
• the computer is characterized by running a 'program.
• the computer 'program of the present invention is, for example, a storage medium, communication medium such as a CD or the like provided in a computer-readable format to a general-purpose computer' system capable of executing various programs' codes.
• a computer program that can be provided by a storage medium such as FD or MO or a communication medium such as a network. By providing such a program in a computer-readable format, processing according to the program is realized on the computer 'system.
• system is a logical group configuration of a plurality of devices, and the devices of each configuration are not limited to being in the same casing.
• the host name and data of the data transmission destination device are stored from the memory. Get the port number for port forwarding processing on the relay device in the connection network of the destination device, and obtain the address information corresponding to the host name of the data destination device from the DNS server.
• address information and port number are set as destination information in the transmission packet that stores the captured data, and the data is output to the network.
• Streaming data playback is realized as combined data playback.
• FIG. 1 is a diagram showing a system configuration example according to an embodiment of the present invention.
• FIG. 2 is a diagram showing a system configuration example in which the home A120 shown in FIG. 1 is replaced with a public unfountain LAN (hotspot) 126.
• a public unfountain LAN hotspot
• FIG. 3 is a diagram for explaining an example of display data displayed on the display screen of the output means.
• FIG. 4 A diagram explaining the IP packet transmission / reception sequence from the video camera to the inbox.
• FIG. 5 is a diagram for explaining a bidirectional communication configuration.
• FIG. 6 A diagram for explaining an example of simultaneously displaying the input video of the inbox that is only the video / audio from the video camera.
• Fig. 7 is a diagram for describing an example of a reception data reproduction processing configuration in a video camera.
• FIG. 8 is a diagram for explaining the details of the process for the video camera to know the IP address of the router.
• FIG. 9 A diagram illustrating the port forwarding setting process for the router to forward the IP packet to the inbox!
• FIG. 10 is a diagram illustrating a flowchart for explaining the overall processing flow of setting processing and communication execution processing for performing communication according to the present invention.
• FIG. 11 is a diagram illustrating a configuration example of a video camera as an example of a data transmission device.
• FIG. 12 is a diagram for explaining a configuration example of a receiving box as an example of a data receiving device.
• FIG. 13 is a diagram showing an example of a table of host names and port numbers.
• the present invention makes it possible to directly display video data taken by a video camera on a playback device (for example, a TV) at a remote location via a network, like a live broadcast.
• the data transmitted from the video camera to the playback device may be the data being played back by the video camera, which is explained as data captured by the video camera.
• net Shooting data of the video camera transferred via the video recording is also recorded on the recording medium of the video camera (for example, DVD or HD). The description will be made according to the following items.
• FIG. 1 a system configuration example of a data communication system according to an embodiment of the present invention will be shown.
• user A takes a picture with a video camera A122 and transfers the shot data to a home B140 at a remote location away from home A.
• this is a data communication system that outputs to the output means (for example, TV) 144 of the home B140 for viewing.
• IP network A121 and IP network B141 are network systems that can be connected to the Internet 130, such as a public wireless LAN (hotspot).
• the user A takes a picture using the digital video camera A122.
• the video camera A122 is configured as a device for streaming transmission of video and audio included in the shooting data in parallel with the shooting processing.
• the video camera A122 has a communication interface, and generates and outputs a communication packet.
• the video camera A122 can be set in various modes, and data transmitted to the home B via the Internet 130 is, for example, when the video camera A122 is in the "shooting mode". If the video camera A122 is in “Playback mode”, the video / audio being played back will be recorded on the monitor of the video camera 122 (if it is recorded on DV tape or HDD / DVD at the same time). 'It becomes audio data.
• the video camera A122 is connected to, for example, a wireless LAN such as IEEE802.lg, a wired LAN such as Ethernet (registered trademark) (ethernet) and! /, And an IP (Internet Protocol) network. It has a communication interface (I / F). Note that this communication interface may be an external module that is not necessarily integrated with the video camera A122 itself.
• the video camera A122 is connected to an IP network A121 such as a home network through a communication I / F.
• the video camera A122 performs real-time streaming via the IP network A121.
• the video camera A122 has an encoder that encodes (compresses and encodes) video and audio being shot or played back with a desired quality, and a packet generator that packetizes the encoded data. Packets are continuously sent to IP network A121.
• the protocol on the IP network A121 may be, for example, a connection type TCP (Tran sport Control Protocol) or a connectionless type UDP (User Datagram Protocol).
• the communication protocol is not limited.
• the bandwidth of the network may be difficult for the bandwidth of the network to send the same quality as the video / audio recorded on a DV tape or HDD / DVD to the network as it is.
• the shooting data is a large amount of data such as high-definition data.
• the video camera A122 performs encoding processing with reduced quality (frame rate 'resolution' image quality 'sound quality, etc.), reduces the amount of data, lowers the bit rate, and transmits to the IP network A121. Has function.
• Router A123 as a network relay device is connected to IP network A121, and transmission data from video camera A122 is output to Internet 130 via router A123. Note that the data packet sent to the Internet A130 must have a “destination IP address” set as the destination address! This “destination IP address” is the address of the router B 142 as the network relay device of the home B 140. This Details of the address setting process will be described later.
• IP network A121 and IP network B141 as home networks are configured in home A120 and home B140, respectively, and are connected by individual home network capabilities S Internet 130.
• the IP network A121 and the IP network B141 may be network systems that can be connected to the Internet 130, such as a public wireless LAN (hotspot).
• FIG. 2 shows an example in which the home A 120 shown in FIG. 1 is replaced with a public wireless LAN (hotspot) 126. Transmission data empty in the video camera 122 is output to the Internet 130 via an AP (access point) 127 installed in a public wireless LAN (hotspot) 126.
• AP access point
• the reception box B143 has a function of, for example, a so-called set top box (STB), and performs data reception processing via the network, analysis of received data, etc., and communication control and output by communication with the data transmission source. Processing such as output control of display data for means 144 is performed.
• STB set top box
• the reception box B143 is a device that receives the streaming of video / audio sent from the video camera A122.
• a communication interface I / F
• IP network B141 such as a wireless LAN (wireless LAN) such as ⁇ 802 ⁇ lg, and a wired LAN such as Ethernet (registered trademark) (ethernet).
• IP network B141 such as a home network and receives data via the router 142.
• the receiving box B143 can also receive the real-time streaming of the external device (in this example, the video camera A122) via the IP network B141.
• the data continuously received via the IP network B141 is notched for a short time for stable reproduction, decoded (decompression decoding), output to the output means 144, and displayed and reproduced. Perform processing. Therefore, the reception box B143 has a video / audio output unit for displaying / reproducing data on the output means 144 such as a TV.
• the reception box B143 is built in the output means 144 such as a TV, for example.
• the reception box B143 itself may be configured as the output unit 144.
• the video received from the video camera A122 and other data are displayed on the display screen of the output means 144 by the control of the reception button B143.
• FIG. 3 An example of display data displayed on the display screen of the output means 144 under the control of the reception box B143 will be described with reference to FIG.
• the output means 144 displays the stream reception data 201 and various information displays.
• the display screen of the output means 144 is set as a GUI (graphical 'user interface) that can be input and controlled by the user.
• GUI graphical 'user interface
• the received bit rate information 202, the bit rate control setting information 203, the video camera Status information 204 is displayed. These pieces of information are information acquired by the reception box B143.
• Reception bit rate information 202 is a bit rate of reception streaming.
• 128 kbps is displayed, and it can be recognized that the streaming received data being displayed is data transmitted at a bit rate of 201 kbps and 28 kbps.
• the bit rate control setting information 203 is a setting unit for setting whether to set the bit rate control to “automatic” or “manual”, and the user selects “automatic” or “manual”. be able to.
• “Manual” the user can set the bit rate between 0 and 300kbps as shown in the figure.
• “Auto” the receiving box B143 adaptively changes the bit rate.
• the receiving box B143 notifies the requested video bit rate information to the video camera A122 which is the data transmission side device by a signaling message, and the video camera A122 responds to the request. To change the transmission bit rate.
• the video camera status information 204 indicates the status of the video camera A122, that is, the power of the video camera A122 being “shooting”, the power of "shooting and recording", and "playing". This is the video camera status information indicating which state it is in. By performing this status display, user B can know whether the data output by the output means 144 is live video, and whether the video being recorded is still being recorded. Become.
• the processing for displaying the video camera status information 204 includes, for example, a video message A122 indicating a change in status every time the status changes, such as a signaling message. Then, the flag for indicating the state is set in the power to notify the receiving box B143, or the streaming data itself is transmitted to the receiving box B143.
• the reception box B143 displays the status information received as a message from the video camera A122 or the video camera status information 204 based on the verification result by verifying the flag.
• the IP network A121 to which the video power camera A122 is connected and the IP network B141 to which the inbox B143 is connected are connected by a global IP network (hereinafter referred to as the Internet) 130 such as the Internet.
• a router A123 such as a broadband router and a router B142 are installed.
• these routers have a firewall function that filters IP packets from the Internet and a NAT (Network Address Translator) function that converts the address between the global IP address of the Internet and the private IP address in the home network. providing.
• NAT Network Address Translator
• IP packet transmission / reception sequence from video camera A122 to inbox B143 will be described below with reference to FIG. Figure 4 (B) shows the address transition of the communication packet.
• GIP indicates a global IP address.
• IP network A121 is a network with a private IP address
• the IP packet sent from the video camera A122 to the IP network A121 is assigned a "source IP address" by the router A123. Convert to global IP address (NAT), and change "Destination IP address" to the global IP address of router B142
• the packet 222 set in the above is generated and transferred to the Internet 130.
• IP network A121 is a global IP address network, there is no need to perform address conversion.
• IP packet transferred to the Internet 130 is the router indicated in “Destination IP address”.
• the router B142 performs packet transfer control based on the source IP address and the like. For example, if the IP packet is not set to be forwarded, the IP packet is discarded by the firewall function. If forwarding is set in IP network B141, forwarding is performed according to that setting. At that time, if IP network B is a private IP address network, router B142 converts the “destination IP address” of the received packet into the private IP address of inbox B143 and forwards it to IP network B141. That is,
• Packet 223 set to, and output to IP network B141.
• IP network B141 is a network with a global IP address, there is no need to perform address conversion.
• an inbox B143 as a data transmission side device is:
• Distination IP address is the global IP address of router A123
• Packet 231 set to, and sent to IP network B141.
• IP packet sent from the inbox B143 to the IP network B141 is sent to the router B142 by the router B142 when the IP network B141 is a private IP address network. Convert to global IP address (NAT), and change "Destination IP address" to global IP address of router A123
• IP network B141 is a network with a global IP address, there is no need to perform address conversion.
• the IP packet transferred to the Internet 130 arrives at the router A123 indicated by “Destination IP address”.
• router A123 performs packet transfer control based on the source IP address and the like. For example, if the IP packet forwarding is not set, the IP packet is discarded by the firewall function. If forwarding is set in IP network A121, forwarding is performed according to that setting. At this time, if IP network A121 is a private IP address network, router A123 converts the “destination IP address” of the received packet into the private IP address of video camera 122 and forwards it to IP network A121. That is,
• IP network A121 is a global IP address network, there is no need to perform address conversion.
• the IP packet transmitted by video camera A122 is sent to inbox B143.
• the IP packet sent and received by the inbox B143 is delivered to the video camera A122.
• Video camera A122 knows the IP address of router B142
• IP packets are continuously transferred from video camera A122 to inbox B143, and real-time streaming is performed, so that data transmitted from video camera A122 can be output from a remote home B140 such as a TV. It is possible to display it directly in 144 like a live broadcast.
• a remote home B140 such as a TV.
• FIG. 4 (b2) it is possible to transmit data from the reception box B143 to the video camera A122.
• User A who is actually shooting or playing back using video camera A122, sees the response of user B who is viewing video and audio on output means 144 under the control of reception box B143. You may want to hear comments about. On the other hand, user B who is watching video / audio may make a request for video to be shown to user A, or may have a conversation about the details of the surroundings or situation! .
• the present invention also allows reverse real-time streaming.
• it is a configuration that enables bidirectional streaming communication.
• Communication packet address setting is performed by the processing described with reference to FIGS. 4 (B1) and (B2). Further, this bidirectional communication configuration will be described with reference to FIG. [0069]
• the reception box B143 on the home B140 side receives the streaming video “audio” received from the video camera A122 of the home A120, and simultaneously inputs it via the camera 145 and the microphone 146 attached to the reception box B143.
• Real-time streaming output to video camera A122 via the packet communication described with reference to Fig. 4 (B2), ie, the reverse of the data reception route, that is, the packet data described with reference to Fig. 4 (B2). To do.
• the video input from the video camera A122 and the video input from the reception box B143 are displayed at the same time.
• the self-photographed data 251 photographed by the camera 145 attached to the reception box 143 is displayed at the same time.
• GUI such as the self-photographing data transmission control GUI 252 shown in FIG. 6 is set.
• the video camera A122 streams video and audio to the reception box B143, and at the same time, receives video and audio captured from the reception box B143 by the camera 145 and microphone 146 attached to the reception box B143. It can be received as real-time streaming, and this received data can be displayed and played back.
• FIG. 7 An example of a reception data reproduction processing configuration in the video camera A122 will be described with reference to FIG.
• a display method of the video received from the reception box B143 as shown in FIG. 7, for example, a small screen can be displayed at the lower right corner of the liquid crystal screen of the video camera A122.
• the shooting data 301 that is the image being shot is displayed, and the screen area for displaying the video received from the receiving box B143 is set, and streaming reception is performed.
• Image data 302 is displayed.
• a different LCD screen from the shooting data display screen may be used.
• the sound is output from the sound output terminal of the video camera A122 and the user A listens to the sound, that is, the streaming reception sound data 303, with headphones or the like. Good.
• the camcorder A122 is in “shooting mode”, you can hear the surrounding sounds, so you only need to output the other party's voice from the headphones. Since they must be played at the same time, the audio is mixed, or one is controlled by the speaker power of the video camera A122 and the other is separated from the headphones.
• Video camera A122 knows the IP address of router B142
• Video camera A122 knows the IP address of router B142
• the DNS server 401 shown in FIG. 8 holds a host name / IP address correspondence table 402, which is a correspondence table between host names and IP addresses, as a database.
• the DNS server 401 receives an address inquiry specifying the host name from the network connection device, it searches the table 402, obtains the registered IP address associated with the host request, and notifies the inquiry device. To do. This makes it possible to obtain the IP address of the target device using a host name (such as www. Son y. Co. Jp) that is easier for humans to understand without knowing the IP address. Access to the target host using the address and packet transmission are possible. Data can be sent to the target host by setting the acquired IP address as the destination address for the transmission packet.
• the global IP address 402 of the router B 143 at the entrance of the home network is often fixed and not allocated.
• the IP address is set dynamically by a DHCP server. If the fixed IP address is not set and the IP address is set dynamically, Dynamic IP is used to obtain the dynamically set IP address.
• Dynamic DNS is a service that dynamically updates the database managed by the DNS server by notifying the DNS server of the currently set IP address each time.
• the inbox B143 shown in FIG. 8 has a Dynamic DNS global IP address notification function.
• the IP address is dynamically set by the DHCP server when the inbox B143 is activated, the inbox B143 is received by the DNS server 401. Notify the host name of box B143 and the global IP address of router B142.
• the video camera A122 uses the DNS mechanism to obtain the global IP address of the router B142 even if the global IP address of the router B142 is not fixed. Can be obtained from.
• the video camera A 122 transmits an address query based on the host name of the reception box B 143 to the DNS server 401, and is associated with the host name of the DNS box 401 and the table 402 in correspondence with the host name of the reception box B 143.
• the global IP address of router B142 can be obtained as the registered address.
• Glover of this acquired router B142 Generate an IP packet with the IP address set as the destination address and output it to the network.
• Video camera A122 knows the IP address of router B142
• router B142 The setting for router B 142 to transfer an IP packet to inbox B 143 and this process will be described with reference to FIG. Even if video camera A122 knows the global IP address of router B142 from the DNS server mentioned above, sets the global IP address of router B, generates a message packet for signaling and an actual streaming data packet and outputs it. In general, router B142 has a firewall function and discards IP packets.
• the packet is not transferred to the reception box B143.
• the user may manually set the port forwarding to the router, but there are cases where it is not preferable because the setting is complicated or a wrong setting may cause a security hole.
• port forwarding is dynamically set in the router B 142 using a UPnP (Universal Plug and Play) mechanism.
• UPnP Universal Plug and Play
• UPnP provides a mechanism that allows you to configure router port forwarding. For example,
• the inbox B143 has a function for performing the above UPnP port forwarding setting.
• Inbox B143 automatically sets a port for signaling messages at a predetermined timing, for example, when the power is turned on. Ie "Forward packets sent to TCP port number xx of router B142, Internet power, etc.” to router B142, and forwarded to TCP port number aaa of inbox 143 in the internal network (IP network B141). Send UPnP message for setting.
• an UPnP message for setting the streaming data port is established from the reception box B143 to the router B142 after the signaling is established.
• the signaling port and the streaming data port may be set separately.
• the port forwarding setting may be configured by dynamically changing the setting appropriately in a way that considers security.
• the signaling message can be reliably transmitted via the router B to the inbox B143. Can be sent to.
• the IP packet sent from the video camera 122 to the router B142 2 is set to the port number for which port forwarding is set, and the router B142 receives the packet that has reached the port number according to the port forwarding setting. Send to box B143.
• an authentication process between the video camera A122 and the reception box B143 can be applied.
• the authentication process is performed between both the devices of the video camera A122 and the reception box B143, and the reception box B143 is received on the condition that the video camera A122 is confirmed to be a valid device. From box B143 to camcorder A122
• the video camera A122 is configured to record and store these pieces of information in a memory.
• the authentication processing method is executed by mutual short-range communication. Specifically, for example, the “Easy Authentication” button is set for both the video camera A122 and the inbox B143, and these two devices are brought close together and the “Easy Authentication” button is pressed simultaneously. Communicate. By this neighboring wireless communication, authentication processing is executed, and the above information (1), (2) is provided from the reception box B143 to the video camera A122 on condition that the authentication is established.
• the inbox B143 sold as a product has its own URL (host name) and port number, ie,
• a document containing this information may be enclosed, and when the user purchases the device, the information may be recorded in the memory of the video camera used by the user.
• this information can be configured. ,.
• the data transmission side device (the video camera in this embodiment) is connected to the data reception side device.
• the data transmission side device (video camera in this embodiment) holds the information and performs processing using the information, so that the data transmission side device (video in this example) The camera) can reliably execute the data transmission to the data receiving side device (the receiving box in this embodiment).
• the data transmission side device (video camera in this embodiment) Using this information, the global IP address of router B142 is obtained from the DNS server, and in addition to this global IP address, the information (2) provided from the inbox 143 side, that is,
• the packet By generating this information, that is, the IP packet specifying the global IP address and port number of router B142 as the destination and outputting it to the network, the packet is delivered to router B142.
• the packet is transferred from 142 to the reception box B143, and the reception box B143 can receive the transmission packet from the video camera A122.
• FIG. 10 on the left side, processing and data reception of the data transmitting device (video camera in the embodiment) are shown. Each processing sequence of the communication device (in the embodiment, a reception box) is shown. Each processing step will be described.
• the data transmitting device (video camera) is connected from the data receiving device (inbox) side.
• step S101 the data receiving device (inbox in the embodiment) sends the global IP address of the router that is the network relay device and the host name of the data receiving device (receiving box) to the DNS server. Register with. This process is the process described with reference to FIG. 8, and the correspondence data between the global IP address of the router and the host name of the inbox is registered in the DNS server.
• step S102 the data receiving side device sets up port forwarding for sirenring in the router using UPnP.
• This process is the process described above with reference to FIG. 9, and as described with reference to FIG. 9, the inbox B143 has a function for setting UPnP port forwarding, and the router B142 "Forward the packet sent to TCP port number XX of router B142 to Internet power, address to TCP port number aaa of inbox 143 in the internal network (IP network B141)" Send UPnP message for setting.
• the NORATOR B142 executes the port forwarding setting according to this message.
• the data transmitting device (video camera) executes an IP address inquiry based on the host name of the data receiving device (inbox) to the DNS server in step S201. Obtain the global IP address of the relay device (Router B).
• step S202 the global IP address of the relay device (router B) acquired in step S201 and the "port number for signaling to be set in the router" provided by the data receiving device (inbox). "Send signaling messages to these IP addresses and port numbers as destinations.”
• This signaling message is sent to the data receiving device (inbox) side relay device (routing).
• the relay device (router B) forwards this signaling message to the data receiving device (inbox) according to the preset port forwarding settings.
• step S103 the data reception device (inbox) receives the message, and based on the transmission source address, whether the received message is a message from a specific data transmission device (video camera) or not. Confirm. If the received message is determined to be a message from a specific data transmission device (video camera), it waits for the reception of an ID for authentication.
• step S203 the data transmission device (video camera) transmits an authentication ID to the data reception device (reception box), and the data reception device (reception box) transmits this ID in step S104.
• the data is received and collated with an ID registered in advance in the memory to confirm that the data transmission device is a specific data transmission device (video camera).
• step S105 the data receiving device (inbox) sends a UPnP message that sets the port for streaming data to the relay device (router B) according to UPnP, and sets the port for streaming data.
• This flow is an example of setting the streaming data port separately from the signaling message port.
• step S106 the data receiving device (inbox) transmits the port number for streaming data and the parameters for transmitting streaming data, for example, parameters such as bit rate and encoding information. Send to device (video camera). If the port for streaming data and the port for signaling message are the same, the process of step S105 can be omitted, and the notification of the port number for streaming data is not required in step S106.
• step S204 the data transmission device (video camera) receives the streaming data port number and the streaming data transmission parameters from the data reception device (reception box).
• step S205 the data transmission device (video camera) receives the streaming port.
• step S206 streaming transmission is started.
• the data receiving device (inbox) side relay device (route) is used as the destination.
• the IP address of data B) and the port forwarding port for the data receiving device (inbox) are specified! /
• step S107 the data receiving device (inbox) confirms that the data is the forwarding data from the streaming data distribution port, and in step S108, the data transmitting device (video camera) Receives streaming data to be sent. After that, when transmission of streaming data from the data transmission device (video camera) is completed, the data reception device (inbox) transmits port forwarding according to UPnP to the relay device (router B) in step S109. The release processing request message is output. Receiving this message, the relay device (Router B) cancels the port forwarding setting for the data receiving device (inbox).
• the streaming data transmitted from the data transmission device (video camera) is transferred to the data reception device (inbox) via the relay device (router B) on the data reception device (inbox) side.
• Data that has been transmitted reliably for example, data captured by a data transmission device (video camera) can be output to the output means on the data reception device (reception box) side for viewing as a live broadcast. .
• FIG. 11 is a diagram showing a configuration example of a video camera as an example of a data transmission device
• FIG. 12 is a diagram showing a configuration example of a reception box as an example of a data reception device.
• the reception box shown in FIG. 12 is a configuration example integrated with output means.
• the video camera shown in FIG. 11 is a device that can execute data reception processing and output of received data.
• the reception box shown in FIG. 12 includes a camera and a microphone, and captures captured video and audio. It has a configuration that can execute network output processing.
• the video camera 500 receives audio from the audio input unit (microphone) 531 and inputs video from the video input unit (camera) 533 during shooting processing, and inputs the input data to the audio encoder 514 of the control unit 510,
• the video encoder 519 executes an encoding process, and records it on a recording medium 536 such as a DV tape, a hard disk, or a DVD via a recording / playback unit 523.
• the recording / reproducing unit 523 obtains audio and video encoded data from the recording medium 536 and decodes them by the audio decoder 515 and the video decoder 520, respectively.
• the audio data is output via the audio output processing unit 512 via the audio output unit 512 such as a speaker
• the video data is output via the video output processing unit 517 to the video output unit such as an LCD. Is output via 534.
• the user input via the input button 535 is detected by the user input unit 522 of the control unit 510, and the control of the control unit 510 is performed in accordance with the request type of shadow start and playback start as user input. Executed under. The above process is the same as that of an existing video camera.
• the communication control unit (packet processing unit) 521 inputs the audio encoded data generated by the audio encoder 514 and the video encoded data generated by the video encoder 519, and stores these encoded data. Packet is generated and output via the network I / F537.
• the destination information set for this transmission packet includes the IP address of the router set as the relay device of the local network of the receiving device and the port forwarding to the receiving device as described in the above-described embodiment. Once the settings are made, the information specifying the port number is applied. These pieces of information are stored in the memory 524, and the communication control unit (packet processing unit) 521 acquires these pieces of information from the memory 524, generates transmission packets, and outputs them via the network I / F 537.
• reproduction data can be transmitted together with reproduction processing of data recorded on the recording medium 536.
• the recording / reproducing unit 523 obtains audio and video encoded data from the recording medium 536, and performs decoding processing in the audio decoder 515 and the video decoder 520, respectively, and the recording / reproducing unit 523 performs the decoding process from the recording medium 536.
• the obtained encoded audio and video data is input to the communication control unit (bucket processing unit) 521, and the communication control unit (packet processing unit) 521 inputs these data.
• the destination setting is set based on the address and port number acquired from the memory 524, as in the above-described processing.
• the communication control unit (packet processing unit) 521 analyzes the packet received via the network I / F 537.
• the audio data and the video data are discriminated and input to the audio decoder 515 and the video decoder 520, respectively, and the decoding process is executed.
• the audio data is transmitted to the speaker via the audio output processing unit 512.
• the video data is output via the audio output unit 512, and the video data is output via the video output processing unit 517 via the video output unit 534 such as an LCD.
• the communication control unit (packet processing unit) 521 executes a process of generating a transmission packet storing data captured by the video camera and outputting it to the network. From the host name of the data transmission destination device and the port number set for port forwarding on the relay device of the connection network of the data transmission destination device, and the address information corresponding to the host name of the data transmission destination device is obtained from the DNS server. Is executed to generate a transmission packet including the received address and port number as destination information and output it to the network.
• the authentication processing unit 525 shown in the figure executes an authentication process with the data transmission destination device via the communication I / F 538. Subject to the establishment of authentication in the authentication processing unit 525, from the data transmission destination device, the host name of the data transmission destination device, the set port number of the port forwarding process in the relay device of the connection network of the data transmission destination device, and Receive Place each thread in Mori 524.
• the inbox shown in Fig. 12 functions as a communication means and a means for outputting received data.
• it is equipped with a powerful camera and microphone and has a configuration that can execute processing to output the captured video and audio to the network.
• the communication control unit (packet processing unit) 721 analyzes packets received via the network I / F 736. To determine the audio data and video data, input the respective data to the audio decoder 714 and the video decoder 720 to execute the decoding process, and the audio data is transmitted via the audio output processing unit 712. The video data is output via the audio output unit 732 such as a speaker, and the video data is output via the video output processing unit 717 and the video output unit 734 such as an LCD.
• the inbox shown in FIG. 12 includes a video input unit 733 such as a camera and an audio input unit 731 such as a microphone, and executes processing for outputting the captured video and audio over the network.
• a video input unit 733 such as a camera
• an audio input unit 731 such as a microphone
• the data output from the network is also output to the video output unit 734 of the own device.
• the output of data acquired by the own apparatus is also executed. The processing in this case will be described with reference to the configuration diagram shown in FIG.
• Inbox 700 receives audio from audio input unit (microphone) 731, inputs video from video input unit (camera) 733, and inputs the input data to audio encoder 714 of control unit 710.
• the video encoder 719 executes the encoding process and inputs the encoded data to the communication control unit (packet processing unit) 721.
• the communication control unit (packet processing unit) 7 21 inputs the audio encoded data generated by the audio encoder 714 and the video encoded data generated by the video encoder 719, and generates a packet storing these encoded data. Output via network I / F736.
• the destination information set for this transmission packet includes the IP address of the router set as the relay device of the local network to which the video camera is connected, and the receiver. Information specifying the port number for which port forwarding is set for the device is applicable. These pieces of information are stored in the memory 724, and the communication control unit (bucket processing unit) 721 acquires these pieces of information from the memory 724, generates transmission packets, and outputs them via the network I / F 736. To do.
• each data can be distinguished as described with reference to FIG. Is executed as an output process.
• the received video data is mainly output, and the image captured by the video input unit 733 of the own device is output as a sub screen to a part of the screen.
• These output control processes are executed as processes of the video synthesis unit 718 shown in FIG.
• Data reception, playback instructions, etc. can be input by, for example, a remote controller.
• Remote control receiving unit 735 receives user remote control operation information, and the remote control receiving unit receives a signal at user input unit 722.
• the analysis is performed and the user input is a display mode change process, for example, a user request is input to the controller display unit 723 and the video composition unit 718 is controlled to change the display mode.
• the user can set the bit rate of received data, and execute / stop the transmission of shooting data of the device itself. It is. These settings can also be processed by the remote control.
• the user input received by the remote control receiving unit 735 is analyzed by the user input unit. If the request is related to data transmission / reception processing, the request information is transmitted to the communication control unit (packet processing unit). Part) is output to 721.
• stop or start processing of transmission of captured data of the own apparatus is performed according to the request.
• the user request is a request for changing the bit rate for the received data
• processing for generating and transmitting a message packet storing the requested bit rate is executed.
• the communication control unit 721 executes and stops transmission of a packet storing data captured by the video input unit (camera) 733 based on input information input via the user input unit 722. Do. Further, the data synthesis unit 718 displays and outputs the bit rate information of the data received by the communication control unit, and the communication control unit 721 displays the user input unit 722. Based on the bit rate setting information input via the! /, A process of outputting a bit rate setting request to the transmission source of the data received via the network is executed.
• the authentication processing unit 725 shown in the figure executes authentication processing with the data transmission source device via the communication I / F 737. For example, reception of streaming data from the data transmission source device is started on the condition that the authentication processing unit 725 establishes authentication.
• the data transmission device (video camera) is set to transmit data to one data receiver device, and the data transmission device (video camera) has one host name in the memory.
• the host name corresponding to multiple data transmission destinations and the port forwarding of the relay device (router) set in the connection network of each host
• the port number as the setting information is stored in the memory of the data transmission device (video camera), so that the user can select one or more destinations.
• This selection information is input to the communication control unit 521 of the video camera shown in FIG. 11, and an address corresponding to the selected host name is obtained from the DNS server, and addresses and port numbers corresponding to these multiple hosts are set.
• the configuration may be such that the transmitted packet is transmitted. According to this configuration, data transmission can be performed by selecting an arbitrary transmission destination from various transmission destinations, and video camera shooting data can be simultaneously transmitted to a plurality of specific devices. Is also possible.
• the series of processes described in the specification can be executed by hardware, software, or a combined configuration of both.
• a program that records the processing sequence is installed in a memory in a computer built in dedicated hardware and executed, or a general-purpose computer that can execute various types of processing. It is possible to install and run the program.
• the program can be recorded in advance on a hard disk or ROM (Read Only Memory) as a recording medium.
• the program can be temporarily or permanently stored on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto optical) disk, DVD (Digital Versatile Disc), magnetic disk, or semiconductor memory. It can be stored (recorded).
• Such removable recording media can be provided as V, so-called packaged software.
• the program is installed on the computer from the removable recording medium as described above, or is wirelessly transferred from the download site to the computer, or via a network such as a LAN (Local Area Network) or the Internet.
• the computer can receive the program transferred in this way and install it on a built-in recording medium such as a hard disk.
• the data transmission destination is stored from the memory.
• Obtain the host name of the device and the port number for port forwarding processing on the relay device of the connection network of the data transmission destination device obtain the address information corresponding to the host name of the data transmission destination device from the DNS server, Since it has a configuration in which address information and port number are set as destination information in the transmission packet storing the data shot by the video camera and output to the network, reliable data transmission to a specific selected device is possible.
• Streaming data reproduction is realized as data reproduction in accordance with the shooting timing.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Multimedia (AREA)
• Computer Networks & Wireless Communication (AREA)
• General Engineering & Computer Science (AREA)
• Computer Security & Cryptography (AREA)
• Computer Hardware Design (AREA)
• Computing Systems (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
• Data Exchanges In Wide-Area Networks (AREA)
• Studio Devices (AREA)

Priority Applications (1)

Applications Claiming Priority (2)

Publications (1)

Family

ID=39032876

Family Applications (1)

Country Status (4)

Families Citing this family (22)

Citations (5)

Family Cites Families (16)

• 2006
  • 2006-08-10 JP JP2006217727A patent/JP4635983B2/ja not_active Expired - Fee Related
• 2007
  • 2007-07-25 TW TW96127098A patent/TW200826680A/zh not_active IP Right Cessation
  • 2007-08-01 WO PCT/JP2007/065097 patent/WO2008018343A1/ja not_active Ceased
  • 2007-08-01 US US12/303,122 patent/US20090207905A1/en not_active Abandoned

Patent Citations (5)

Also Published As

Similar Documents

Legal Events