CN100515026C - Camera for communication of streaming media to a remote client - Google Patents

Camera for communication of streaming media to a remote client Download PDF

Info

Publication number
CN100515026C
CN100515026C CNB2004800331884A CN200480033188A CN100515026C CN 100515026 C CN100515026 C CN 100515026C CN B2004800331884 A CNB2004800331884 A CN B2004800331884A CN 200480033188 A CN200480033188 A CN 200480033188A CN 100515026 C CN100515026 C CN 100515026C
Authority
CN
China
Prior art keywords
video
video camera
processing subsystem
msc
mobile streaming
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CNB2004800331884A
Other languages
Chinese (zh)
Other versions
CN1879400A (en
Inventor
克里斯多弗·T·卡瓦纳
康韦·A·维尔勒
罗伯特·R·迈康奈尔
蒂莫西·N·布朗
唐纳德·A·弗瑞林
肯特·D·沃瑟斯旁
威廉姆·J·加尔兰德斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Librestream Technologies Inc
Original Assignee
Librestream Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Librestream Technologies Inc filed Critical Librestream Technologies Inc
Publication of CN1879400A publication Critical patent/CN1879400A/en
Application granted granted Critical
Publication of CN100515026C publication Critical patent/CN100515026C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

A Mobile Streaming Camera is operable by an Operator for communication with one of more Remote Clients through a wireless network allows compressed communication of video and audio in both directions together with voice signals in a telephony type communication. The remote client is able to control the operation by voice signals or direct control. A video display at the Camera and at the remote client allows communication of additional data.

Description

Be used for transmitting the video camera of Streaming Media to remote client
Technical field
The application relates to a kind of and Streaming Media together uses, and is used from the device of creating mobile conference system together with the remote client device one of compatibility.
Background technology
The combination of internet and new technologies and methods is to allow anywhere/to communicate any time.Allow people from the world the electronics of maintenance Anywhere contact such as the high-data-rate wireless technology of IEEE802.11.Under current technical merit, a people can engage in the dialogue by the phone that exchanges Email, uses instant messaging or utilization to have Internet function, comes and another person or organizing communication.If enough bandwidth are arranged then may send video by the internet.
Existing video conferencing system begins to utilize the ubiquitous connectedness of internet, and not only just depends on the dedicated communication link of ISDN or other form.Conventional video conferencing system designs in the following manner: promptly main body must be brought to meeting-for example take to and be equipped with systematic meeting room, perhaps is brought to the PC that has been equipped with as video conferencing system.Under most of situation, main body is the individual or entity that hope and another person or tissue carry out real time communication.Some video conferencing system comprises that also transmission can be placed near the ability of the image of the midget plant of video conference device.These systems needing can't be used for small size and complete ambulant many environment, as factory floor, test laboratory or inspection post.Yet it is valuable can participating in video conference from these positions.
The another kind of optional situation of the position of these types is that the operator wears the wearable computer system that wears video camera and microphone, and this is worn video camera and links to each other with wearable computer with microphone, and wearable computer can be set up communication session with remote personnel.These systems are current to be restricted on function, and uses trouble under most of situation.Most of workman will find that the inconvenience that need wear calculation element will reduce the value that these systems provide.Therefore, they are suitable in special-purpose and some uncommon environment most.
Needed is a kind of real portable and without any the stream media equipment of the line of type, it can be by simply and fastly as phone, and key is not both has increased high-quality real-time video communication.In addition, this portable equipment need be incorporated the major function of conventional video conference system in the compact package as traditional cameras, and it can be used for any place, no matter this place be outdoor, or in industrial environment such as factory floor.This will allow meeting to be brought to main body, and it is with the validity that improves based on the communication of video prominently.
Engineering participation, manufacturing and maintenance costliness and the enterprise of complex product can utilize the advantage of this system to shorten the cost that Time To Market and reduction are developed new product.Many problems can occur during product development process, these problems will be slowed down or this process is ended.Missing due date and cost overrun is typical results.Given Time To Market demand and millions of dollar the cost relevant with introduction with the exploitation of many new products, these results are very serious.Can " arrive the problem place " and provide the mobile collaboration system of real-time video, audio frequency and other collaborative instrument to have remarkable reduction the deal with problems required time and the potentiality of cost to the residing PC of long-range expert.
For instance, consider the situation of millions of dollars milling machine damage.Machine breakdown may cause per hour losing hundreds of dollars income.On-site technical support can't address this problem, and everyone of milling machine must call the technical specialist from lathe manufacturer and keep in repair.Technical staff's availability, travel time and road cost only can amplify this problem.Utilize the mobile video cooperative system, the field technician can take out digital camera and be put on the milling machine, and the technical staff by internet and general headquarters of manufacturer gets in touch, and allows the expert that it is instructed in the maintenance period.
This situation has only been illustrated a kind of mode that this product can be used.Also have many other purposes.
Summary of the invention
According to a first aspect of the invention, provide a kind of equipment, comprising:
By the mobile streaming video camera of communicating by letter with remote client of being used for of operator operation, this moves the streaming video camera has:
The mobile camera shell;
Be installed in the battery supply in the described shell;
Be installed in camara module and camera lens thereof on the camera housing;
Be used for video display to operator's display video signal;
Be used for manually controlling camara module and camera lens to generate the manual control input of vision signal by the operator;
Be used for providing the audio frequency output of audio frequency and Speech Communication to the operator;
Be used at least one audio frequency input from operator and surrounding environment reception audio frequency and Speech Communication;
The network that is used for being connected with network wireless connects;
Processing subsystem in the described shell;
Described processing subsystem is set for from the camara module receiver, video, and receives audio frequency and Speech Communication from the audio frequency input, with compressed video, audio frequency and speech;
Described processing subsystem is set for the communication protocol of communicating by letter that is provided for video, audio frequency and voice signal, so that be real-time transmitted to network;
Described processing subsystem is set for video, audio frequency and voice signal and these signals of decompress(ion) that receive compression from network, so as on display display video signal and to operator's output audio and speech in real time;
Described video camera is set for remote client and communicates by letter, and wherein remote client has:
Video display;
Be used for the audio frequency output of audio frequency and speech;
Be used for the audio frequency input of speech at least;
The network that is used for being connected with network connects;
And processing subsystem;
The described processing subsystem of remote client is set for by network and receives video, audio frequency and the voice signal that compresses from camera unit, with decompress(ion) and output in real time in display and audio frequency output;
Described processing subsystem be set for be provided for the communication of voice signal at least communication protocol to be real-time transmitted to network.
Preferably, described mobile streaming video camera be set for the moving of startup, reception and participation and remote client, in real time, full duplex speech and video call.
Preferably, described mobile streaming video camera be set for by with being connected of Conference server, the moving of startup, reception and participation and a plurality of remote clients, in real time, full duplex speech and conference call.
Preferably, described mobile streaming video camera be set for by with being connected of video distribution service device, to a plurality of remote client distribution of video streams.
Preferably, described mobile streaming video camera is set for registrar and is connected with LIST SERVER, exists and obtains information about the remote client that need connect with them to set up network.
Preferably, described mobile streaming video camera comprises the touch-screen that covers on the video display.
Preferably, described mobile streaming video camera comprises the interface that is connected with external audio, video and Controlling Source, thereby mobile streaming video camera can receive the Voice ﹠ Video by external audio and delivery of video.
Preferably, described mobile streaming video camera comprises the shotgun microphone and the omnidirectional microphone that is used to catch operator's speech that is used for from the main body capturing audio.
Preferably, described mobile streaming video camera comprises loud speaker.
Preferably, described mobile streaming video camera comprises the connector that is used to connect headphone and transmitter.
Preferably, described mobile streaming video camera comprises radio set and the antenna that is used to connect wireless head-band earphone and transmitter.
Preferably, described mobile streaming video camera comprises illuminator, wherein this device can send the power of illuminator element by change to, under operator's the manual control and/or Long-distance Control by remote client and/or the automatic control under device software control, control the brightness of illumination grade.
Preferably, the automatic control of the brightness of described illuminator allows switch control and the continuous and variable brilliance control by the default control of relevant brightness degree, wherein, the video camera exposure parameter that utilizes the interior video cameras module to be reported calculates brightness degree.
Preferably, described mobile streaming video camera comprises be used for that video shows backlight, wherein can send power backlight to and control brightness degree backlight by adjusting, make brightness degree manually to control by the operator, with the brightness degree setting of selecting the menu that presents from video display to wish, and/or can come the calculating optimum brightness degree by the video camera exposure parameter that utilizes the interior video cameras module to be reported, control brightness degree automatically by this device.
Preferably, described mobile streaming video camera is set for the distance based on main body and this device, selects automatically to open suitable one or more illumination component groups, and wherein this distance is to calculate according to the focusing parameter that camara module is reported.
Preferably, described video display comprises the touch-screen of covering, and touch-screen is set for to the operator and provides environment sensitive control, positioning indicator and about the information of this device and operation thereof.
Preferably, the processing subsystem of described mobile streaming video camera is set for the described vision signal of digitlization, utilizes video compression algorithm that it is compressed then.
Preferably, the processing subsystem of described mobile streaming video camera is set for from built-in camera or the outside video source that connects and catches each frame of video, then they is treated to picture format.
Preferably, the processing subsystem of described mobile streaming video camera is set for audio frequency is carried out digitlization, utilizes audio compression algorithm that it is compressed then.
Preferably, the speech that the processing subsystem of described mobile streaming video camera is set for the operator carries out digitlization, utilizes the voice audio compression algorithm that it is compressed then.
Preferably, described mobile streaming video camera includes wired network interface.
Preferably, described mobile streaming video camera is set for the picture of will catch and sends to remote client.
Preferably, described mobile streaming video camera is set for and utilizes echo elimination and boombox and speech microphone, provides full duplex phone hands-free phone ability in the VoIP communication period.
Preferably, described mobile streaming video camera is set for and allows the operator to monitor the raw video signal that obtains from video camera on video display.
Preferably, described mobile streaming video camera is set for and allows the operator to monitor compressed video signal on video display.
Preferably, described mobile streaming video camera is set for and allows in the different windows of operator on video display, compressed video that monitor original video from camara module simultaneously, send to the compressed video signal of remote client, receives from remote client or their combination.
Preferably, described mobile streaming video camera is set for and allows the operator to utilize the headphone and the transmitter of connection, monitors the audio frequency of catching from shotgun microphone.
Preferably, the processing subsystem of described mobile streaming video camera is set for stream content and picture-storage in storage device.
Preferably, described mobile streaming video camera is set for to the operator ability that allows speech to explain the content in the storage device that is stored in mobile streaming video camera is provided.
Preferably, described mobile streaming video camera is set for and does following combination in any simultaneously:
Make content flow to remote client;
Receive and demonstration stream content from remote client;
Storage flow content on storage device;
Allow the full duplex speech and the video call of operator's participation and remote client;
And supervision is just sending to the video and the audio stream content of remote client.
Preferably, described mobile streaming video camera is set for the content of retrieve stored on the storage device of mobile streaming video camera, and carries out following combination in any simultaneously:
The content of storage is flowed to remote client;
Receive and play the stream content from remote client;
Allow the full duplex speech and the video call of operator's participation and remote client;
And supervision is just sending to the video and the audio stream content of remote client.
Preferably, described mobile streaming video camera is set for and allows the operator to specify will to be used to calculate zone on the video image shown on the video display of video camera exposure control parameter by this device.
Preferably, described mobile streaming video camera is set for to provide and allows the operator to use stylus, video display and the touch-screen relevant with video display, comes the ability of the cursor on the video display of Long-distance Control remote client.
Preferably, described mobile streaming video camera is set for to provide and allows the operator to use stylus, video display and the touch-screen relevant with video display, the ability of drawing on the video that shows on the video display of remote client.
Preferably, described mobile streaming video camera is set for and allows remote client by using the indicator device that links to each other with remote client, is controlled on the video display of mobile streaming video camera and the cursor that shows on the video display of remote client.
Preferably, described mobile streaming video camera is set for and allows remote client by using the indicator device that links to each other with remote client, draws on video shown on the video display of mobile streaming video camera and on the video display at remote client.
Preferably, described mobile streaming video camera is set for calculating and will be used on the video display of mobile streaming video camera and the highest contrast ink colors of the best of drawing on the video display of remote client.
Preferably, described mobile streaming video camera is set for by receiving network performance tolerance from remote client and regulating the Media Stream parameter, adapt to available network bandwidth so that network utilize optimization.
Preferably, described mobile streaming video camera is set for all or part content of utilizing cryptographic algorithm to encrypt to send to remote client.
Preferably, described mobile streaming video camera is set for and utilizes cryptographic algorithm to decipher the encrypted content that receives from remote client.
Preferably, described mobile streaming video camera is set for provides the remote control ability that allows remote client to control the function of mobile streaming video camera.
Preferably, the interface that provides with docking station is provided described mobile streaming video camera, be used to operate this device and to the power supply of internal cell charging to obtain, and wherein, this device provides a kind of long range positioning device function, and this function is reported unique docking station ID that its docking station of stopping from this device obtains to remote client.
Preferably, described mobile streaming video camera is set for and passes network insertion/firewall box.
Preferably, described mobile streaming video camera is set for the JA(junction ambient) that similar phone is provided to operator and client computer, and the wherein similar call of the connection request from a side to the opposing party (calling) makes:
Calling receiver can with such as but be not limited to following mode and respond incoming call: ignore automatically, automatic-answering back device, prompting remote client/operator's manual answering/ignore.
Participated in moving under the situation about being connected of streaming video camera with another remote client/operator, remote client will be to this new connection request response for busy.
Remote client and mobile streaming video camera provide listening and visual notice that mobile streaming video camera just attempting to be connected to the operator.
Under situation about not connecting as yet, promoter's (operator or remote client) can stay the message that comprises VoIP speech segment and/or main body Voice ﹠ Video segment for the recipient on described mobile streaming video camera/remote client.
Preferably, described mobile streaming video camera is set for by utilizing the optical parametric that obtains from camara module to calculate air line distance with main body.
Therefore, described mobile streaming video camera is the equipment of video camera shape normally, it comprises shell, video camera, color monitor, processing subsystem, and comprise battery, has audio subsystem with the codec of loud speaker and microphone interface, and/or headphone and transmitter interface, phone software, audio compression/decoder software and hardware, video compression/decoder software and hardware, echo is eliminated software, Ethernet interface, wireless device and can accept the assemblies such as power supply of power from AC adapter or battery, the combination of these assemblies be sound and the image transitions of the autonomous agent Voice ﹠ Video signal that becomes to be suitable for to utilize Internet Protocol to distribute on network in the future.This equipment has following feature and advantage:
It comprises the network that utilizes Internet Protocol and connects, and allows to catch sound and video information, and immediately with to have a miscellaneous equipment that network is connected shared, these devices comprise the device of those access the Internet.
It provides telephony feature, make device operator can with have other people that network is connected and carry out speech and get in touch, comprise the device of those access the Internet.
The integrated permission mobile device operation person of Wireless Networking ability with have other people that web/the Internet is connected and keep stable communication.
Description of drawings
How relevant with these systems Fig. 1 be the overall fundamental system of signal and the present invention fundamental system schematic diagram;
Fig. 2 is the MSC block diagram that depicted in greater detail moves each functional block of streaming video camera (MSC, Mobile StreamingCamera);
Fig. 3 is MSC rearview, the control that the representative rearview of MSC equipment and relevant control is shown;
Fig. 4 illustrates the representative front view of MSC equipment and their relevant control and front/top view, the control of top view;
Fig. 5 is the holonomic system block diagram of signal in conjunction with the holonomic system of all system components.
Embodiment
As Fig. 1 and shown in Figure 5, mobile video session system (MVCS, Mobile VideoConferencing System) comprises mobile streaming video camera (MSC) 100/500, remote client (RC) 110/510, registrar 104/504, LIST SERVER 108/508, video distribution service device 502 and speech Conference server 506.Following paragraph is described the purpose/function of each assembly.
Remote client
Remote client 110 comprises the computing platform with display and microphone/speaker system such as personal computer (PC) or PDA(Personal Digital Assistant) or smart phone or MSC, such as Windows Linux, Windows CE or PocketPC or other operating system, and specialized application software.RC allows RC user's (client computer) to cooperate with MSC user (operator).
Registrar
Registrar 104 comprises the computing platform such as personal computer (PC), such as Windows
Figure C200480033188D00142
Or Linux or other operating system, and such as registration software with SIP register.Registrar provides visit of optional system and controlled function to MVCS.
LIST SERVER
LIST SERVER comprises the computing platform such as PC, such as Windows
Figure C200480033188D00143
Or Linux or other operating system, and the directory services software of LDAP or equivalence.
The video distribution service device
The video distribution service device comprises the computing platform such as PC, such as Windows
Figure C200480033188D00144
Or Linux or other operating system, and will and be distributed to the function of a plurality of RC from main video and the audio stream reformatting of MSC.
The speech Conference server
The speech Conference server comprises the computing platform such as PC, such as Windows
Figure C200480033188D00151
Or Linux or other operating system, and the function that makes up and voice data is distributed to each participant in the MVCS conference call.
Mobile streaming video camera (MSC)
Basic MSC comprises the shell of video camera shape, and this shell includes camara module 200, two built-in microphones 230/269, built-in loud speaker 233, LCD (LCD) 254; Touch-screen 253, button and light-emitting diode (LED) indicating device 255 and other assembly shown in Figure 2, these combination of components are used for the main video image of will be caught by camara module 200 and are the form that is suitable for being transferred to RC 110 by the main body audio conversion that built-in microphone 230/269 is caught; And provide between operator and the client computer in real time, speech (VoIP) and video communication on the full duplex, IP.
MSC processing subsystem 213 comprises Linux or other operating system of microprocessor 235, SDRAM and flash memory 265, I/O circuit, digital signal processor (DSP), coprocessor 266, embedding, as Microsoft Windows CE.NET, Microsoft PocketPC, Symbian, Palm OS and customization MVCS software.MSC processor subsystem 213 provides video, audio frequency and voice compression that calculate to strengthen/separate compression functions, MSC100 flow effectively required network communicating function of content and user interface (UI) and the local I/O processing capacity that is used for MSC on IP network.
MSC has the camara module 200 that is used to catch main video.Camara module 200 allows MSC to be used in distance near as 1cm and is clear that checking than long-focus of far main body.Be formatted as the simulation S-video 201 of level 768 * vertical 494 pixels from the video of video camera output, camara module 200 provides control to its operating parameter via VISCA interface 262 or equivalent interface.By VISCA interface 262, MSC can control and obtain the state about camera parameters, as zoom, zoom rate, digital zoom, manual focusing, focusing speed, auto exposure mode, exposure screen position, white balance mode, aperture/aperture setting, shutter speed, gain, backlight, mirror image, memory preset, displaying contents, key lock, video camera ID and mains switch on the screen.
MSC has and is integrated with LCD backlight 254, and LCD 254 is used for presenting control and state information to operator's display video and picture and to the operator.Provide integrated backlight to improve the visual capabilities of LCD254 under low light level lighting condition.
MSC has display controller 212, the digital pixel data that it will receive from the MSC processing subsystem via Mini-PCI or equivalent interface 263, and/or be converted to via the digital pixel data that CCIR-601 or equivalent interface 203 receive from video a/d converter 202 and drive the required signal of LCD 254.
MSC has touch-screen.Touch-screen 253 covers on the LCD 254, and provides and touch sensitive surfaces, the operator can this touch on the sensitive surfaces with LCD 254 on the information that presented carry out alternately.
MSC 100 has built-in Ethernet interface 218.Can be by the standard ethernet cable being inserted in its Ethernet RJ45 connector 219 and MSC 100 is connected to network.
MSC 100 has built-in wideband data radio device 221 and coupling antenna 222.MSC 100 can be connected with network wireless by this radio device.The employed broadband wireless electric installation of MSC meets the Mini-PCI standard, and is connected with MSC processing subsystem 213 via internal pci bus 220.The broadband radio type that MSC supported including, but not limited to 802.11,802.16,3G and/or 4G cellular radio.
MSC 100 has built-in shotgun microphone 230, to catch the main body audio frequency relevant with main video.
MSC 100 has built-in omnidirectional microphone 269, is used to be captured in the speech of calling out manipulate person with the hands-free phone pattern voip phone of client computer.
MSC 100 has built-in loud speaker 233, and playing with just at the relevant audio frequency of the recording of video in advance of playback, and broadcast hands-free phone pattern VoIP communication period is from the voice audio of client computer.
Outside headphone can link to each other with MSC 100 via audio jack 227 with transmitter 228, and audio jack 227 replacement boomboxs and built-in omnidirectional microphone 269 and the boombox that is used for voice reproducing are used for VoIP and communicate by letter.
MSC 100 has usb host interface 130/259, is used to connect MSC 100 to select client apparatus.Be connected with the USB of MSC 100 and be to be undertaken by the A socket connector 260 that standard USB A-B cable is connected to MSC.
MSC 100 has external optical illuminator 261, to improve lighting condition under the situation that guarantees it.Illumination is to provide under the control of MSC processing subsystem 213 by one or more groups White LED or equivalent illuminator.One group of LED is positioned to be provided for the even illumination of distant place object, and second group of LED is positioned to be provided for the illumination of closer object.
By inner rechargeable battery pack 252, via offering the external power source of MSC 100 or, provide power supply via offering the external power source of MSC 100 through Ethernet interface 219 by power supply on the Ethernet (POE) interface by AC/DC converter 132/247 being connected to power connector 249.When adapter connected, the power supply 251 of MSC automatically switched to external power source and the internal cell 252 that charges again.
MSC has tripod mechanism 239 and is used to connect camera tripod 136/240.Tripod mechanism 239 also can be used for other erecting device such as magnetic bracket are connected to MSC, so that safety is connected to non-planar surface.
In that the physical button with tactile feedback and " soft " button that utilizes touch-screen 253/322 realization that covers on the LCD 254/322 are provided on the MSC 100, control camera function to allow the operator.Provide button be used on electric power on/off 300, menu ON/OFF 302, the screen showing ON/OFF 304, recording start/stop 306, flow back to decontrol begin/stop 308, LCD lamp ON/OFF 310, Manual focusing ON/OFF 312, video camera zoom-Manual focusing further/push away 320, stream begins/stop 400 and freeze frame 402.Physical button is connected with MSC processing subsystem 213 via discrete I/O circuit 255.Resistive touch-screen 253/322 covers on the LCD 254/322.Stylus 324 and/or operator's finger can be used for touch-screen 253/322 under LCD 254/322 on the button and the menu that are drawn carry out alternately.
MSC 100 provides to the operator can listen prompting.Can listen prompting to can be used for but be not limited to following function, as stream begin/stop, recording start/stop, still image capturing, voip call ring, voip call is busy, network connection state changes, low file system memory indication, low electric weight indication.
MSC 100 has the dedicated operator indicating device that is used for stream mode 314, power supply/charged state 316 and network connection state 318.These indicating devices are connected with MSC processing subsystem 213 via discrete I/O circuit 255.LCD 254/322 is used for showing additional visual detector to the operator together with display controller 212 and MSC processing subsystem 213.
MSC 100 has safe digital interface 257, or such as other interface of compact flash, is used for portable memory card 258 is installed to MSC.The storage card of installing is used for uploading/downloading MSC 100 configuration datas, is used to upgrade the software of MSC 100 and is used for record and/or playback of video, audio frequency and picture.
Operation
MVCS is provided for the device that MSC user (operator) and RC user (client) carry out telecommunication and cooperation.Main video of catching by MSC and audio frequency by digital processing and in real time (streaming) be sent to RC 110, reproduced by RC 110 this its, be used for (difference) and watched by the client and listen to.Speech Communication between operator and the client makes things convenient for by speech (VoIP) communication channel on the full duplex of setting up between MSC and the RC, IP.Registrar function 104 and LIST SERVER function 108 are used for checking and management from the visit of the system of operator/MSC and client/RC.Between MSC, RC and server, utilize Internet Protocol (IP) via following interconnected and mobile video, audio frequency and speech and communicating control information:
● Local Area Network;
● wireless lan (wlan);
● wireless wide area network (WWAN);
● the internet; Or
● above any combination.
For the purpose of this document, this internet is called as network.
The various standard network communication protocols of utilizing MVCS realize control and streaming function.Below tabulation has itemized the main agreement of using in a kind of realization of MVCS:
● utilize Session initiation Protocol (SIP, Session initiation Protocol) and Session Description Protocol (SDP, Session Description Protocol) to realize session initiation, control and end;
● VoIP stream can be unicast or multicast and be encapsulated in the real-time transport protocol (rtp) grouping;
● audio can be unicast or multicast and be encapsulated in the RTP grouping;
● RTCP Real-time Transport Control Protocol (RTCP) is used to monitor that real-time stream transmits, to allow to regulate to keep best in quality;
● T.120 standard agreement is used in application and data sharing (Long-distance Control, Image Sharing etc.).
In order clearly to describe the operation of MVCS, all use these agreements at the remainder of present patent application.Yet also can use other agreement.
Operator/MSC 100 and client/RC 110 be through network 102/112/114/116, utilizes to connect to the safety of registrar 104 to sign in in the system.MCS 100 and/or RC 110 pass to registrar 104 to examine their identity with the user name and password information.SIP registrar server 104 utilizes LDAP or equivalent LIST SERVER 108 to verify the user name and password information that passes to it again.If effective words then permit visit, and in the database of LIST SERVER 108, upgrade from the IP address information of operator/MSC and/or client/RC and have information.
In order to start be connected (calling) with the RC/ client computer, demonstration and control ability that the operator utilizes MSC to provide are input to the IP address information of RC/ client computer among the MSC.MSC utilizes SIP (RFC3261) to set up and being connected of this IP address then, and the characteristic of utilizing Session Description Protocol (RFC2327) or similar agreement to come negotiation communication.As selection, what the operator can be stored from MSC will select the title of RC/ client computer in title and the tabulation that the IP address is associated.As selection, the operator can be via network from the title of LIST SERVER 108 visit RC/ client computer and the tabulation of relevant IP address information.RC can be with following but be not limited to the connection request that following mode responds input: ignore automatically, automatic-answering back device, prompting client manual answering/ignore.Under the RC/ client computer had added situation about being connected with another MSC, RC will be to this new connection request response for busy.That can listen and visual notice are offered client computer and offered MSC by MSC by RC is just attempting the operator that is connected.MSC can not with situation that RC is connected under, provide a kind of operator of permission on RC, to stay to comprise the ability of the message of VoIP speech segment and/or main body Voice ﹠ Video segment.
In order to start and being connected of MSC/ operator, demonstration and control ability that the client utilizes RC to provide are input to MSC/ operator's IP address information among the RC.RC utilizes SIP (RFC3261) to set up and being connected of this IP address then, and the characteristic of utilizing Session Description Protocol (RFC2327) or similar agreement to come negotiation communication.As selection, the client can from RC, be stored with in title and the tabulation that the IP address is associated, select MSC/ operator's title.As selection, client computer can be via network, from LIST SERVER 108 visit MSC/ operators' the title and the tabulation of relevant IP address information.MSC can be with following but be not limited to the connection request that following mode responds input: ignore automatically, automatic-answering back device, prompting operation person's manual answering/ignore.Under the MSC/ operator had added situation about being connected with another RC, MSC will be to this new connection request response for busy.Can listen to offer client computer and offer RC by RC and just attempt the operator that is connected by MSC with visual notice.RC can not with situation that MSC is connected under, provide a kind of operator of permission on MSC, to stay to comprise the ability of the message of VoIP speech segment and/or main body Voice ﹠ Video segment.
The MSC video capability allow the operator with 100 video captured of MSC via network flow to RC 110, the local simultaneously video of browsing on the LCD 254.
Along with MSC starts, by 200 video captured of camara module with simulation S-video format 201 by continuous feeding to video a/d converter 202.Video a/d converter 202 is converted to the digital video pixel data with analog video.Then, these digital video pixel data are through CCIR0601 or equivalent interface 203﹠amp; 204, (difference) is fed to display controller 212 and video compression engine 205.
Video compression engine utilizes such as MPEG 4, Windows Media, Real or Compress softwares H.264, and the digital video pixel data compression that will receive from video a/d converter 202 is the form of high compression.Compressed digital video pixel data are gathered in the grouping, are labeled the last time, are fed to MSC processing subsystem 213 through USB interface 217 then.
The media stream server that realizes with software in MSC processing subsystem 213 receives the digital video pixel packet of compression from video compression engine 205, and according to the requirement such as the RTP of RFC3016 (the MPEG4A/V stream on the RTP) they is formatd.When the operator presses and discharge stream beginning/conclusion button 400, the media stream server of MSC is opened the compatible compact decompress(ion) of consulting to be used for main video and audio frequency with the real-time Transmission session of RC 100, mutually, and the video packets after network will format by this session sends to RC 110.
Display controller 212 utilizes the digital video pixel data that directly receive from A/D converter 202 under the control of MSC processing subsystem 213, provide video view finder ability to the operator.In order to realize this ability, display controller 212 by buffer memory, sampling, cutting, cut or it carried out the color transformed digital video pixel data that received that format, then by producing the signal that drives it on LCD 254 display video.The controlled function of utilizing MSC to provide, the operator can controlled sampling, cutting and is cut operation and amplify with the size of regulating viewfmder image and at the enterprising line number word of video section.
By provide connector 206 and interface circuit with S-video 201 internally camara module 200 be routed to external monitor 207, come the enhanced MSC video capability.This ability allows external monitor to be used to browse the vision signal of MSC when connecting by standard S-vision cable.This feature is used to LCD for example to the not visible situation of operator or need the situation of the bigger image of physics.
Come the enhanced MSC video capability by connector and the interface circuit that is provided for when being connected accepting the S-video from the external video video camera with standard S-vision cable.When enabling this ability, the video that video a/d converter 202 and video compression engine 205 handled from external video incoming interface 208, but not from the video of interior video cameras module 200.
By allowing the compressed digital video pixel packet video-frequency monitor pattern that this locality shows on LCD 254 when flowing to RC 110, come the enhanced MSC video capability.This allows the operator to watch video when video is seen by the client.The video-frequency monitor pattern is will unpack to conciliate from the packet that video compression engine 205 receives by MSC processing subsystem 213 to push back the digital video pixel data, and described pixel is routed to display controller 212 realizes to show on LCD 254.
To be come the enhanced MSC video capability by video camera module 200 be used to the to expose position of control by allowing the operator to utilize touch-screen 253 and stylus 264 to specify in the main video image.This ability has been utilized some exposure mode and LCD 254, touch-screen 253 and the stylus 264 of video camera.Along with LCD shows view finder video, video-frequency monitor video or the two, expectation touch-screen 253 surfaces on the point of control and treatment that are used to expose in operator's video image that stylus 264 contacts are shown.MSC processing subsystem 213 calculates the screen contact position, and these data are forwarded to camara module 200 through VISCA interface 262.Camara module 200 utilizes the appointed area to optimize exposure parameter then.
By allowing MSC 100 to receive main video and reproduce, come the enhanced MSC video capability at LCD254 from RC 110 or compatible apparatus.This video session is initiated by client/RC 110, and utilizes and be used to allow MSC 100 mobile videos to set up to the identical real-time protocol (RTP) of RC 110, and utilizes identical Compress softwares, MPEG4, Real, Windows Media, H.264.RC 110 compressed video packets that received from RC 110 through network by MSC processing subsystem 213 are unpacked is compressed digital video pixel packet.MSC processing subsystem 213 utilizes the Compress softwares of consulting then, is the digital video pixel data with compressed digital video pixel packet decompress(ion), and this data forwarding is shown with format and on LCD 254 to display controller 212.
The MSC video capability allows LCD 254 to show view finder video, video-frequency monitor video, RC 110 videos or its combination simultaneously in different windows.
Can improve main lighting by the illuminator 261 of utilizing MSC.Illuminator 261 brightness degrees can be by the operator, controlled and control automatically under the MSC software control through the remote control function of RC 110 by the client.Under software control, MSC utilizes the exposure parameter by camara module 200 reports to calculate the surrounding brightness condition, described parameter is including, but not limited to aperture, shutter speed and gain, and the light output of adjusting external optical illuminator 261 is to keep minimum acceptable ambient light condition.This algorithm allows to utilize the control of presetting on the brightness degree to carry out ON/OFF control and continuous and variable light output control.Similarly, utilize the focus information that is provided by camara module 200, MSC software will be opened the LED group of mating most from the distance of video camera with object.
MSC allows the client to be controlled at the cursor that shows on the LCD 254 by utilizing mouse or other indicator device that is connected with RC 110.This ability allows the client to point to the just item in the video of demonstration on LCD 254.By allowing the client, further strengthen this ability just on the video that shows on the LCD 254, drawing.On the contrary, this ability allows the operator to utilize touch-screen 253 and stylus 264 to come cursor on the Long-distance Control RC display, and allows the operator just drawing on the MSC video that shows on the RC 110.
The MSC video capability allow digital audio that MSC 100 will be relevant with video captured through network flow to RC 110.MSC 100 keeps the time synchronized between the audio and video stream.
The audio frequency of being caught by built-in shotgun microphone 230 is fed to audio codec subsystem 214 with analog format, is converted to pulse-code modulation (PCM) digital audio-frequency data in real time at this this audio frequency.This PCM digital audio-frequency data is sent to video compression engine 205 through 12S serial line interface 216.Video compression engine 205 gathers the PCM digital audio-frequency data that is received in the grouping, and utilize timestamp to make they and the digital video time synchronized of compressing, then synchronous PCM digital audio-frequency data grouping is forwarded to MSC processing subsystem 213 through USB interface 217.
MSC processing subsystem 213 will be from PCM digital audio-frequency data boil down to the 3rd layer of audio frequency of MPEG 1 (MP3) of video compression engine 205 receptions or the audio compression form of AAC or other video compatible.The media stream server that realizes with software in MSC processing subsystem 213 formats it according to the requirement such as the real-time Transmission session protocol of RFC3016 (the MPEG4A/V stream on the RTP) then.When the operator pressed and discharge stream beginning/conclusion button 400, the media stream server of MSC was opened the real-time Transmission session via network and RC 110, and formative audio packet is sent to client computer by this session.
By providing when utilizing standard RCA jack voice-frequency cable to be connected to external audio incoming interface 264, accept the connector and the interface circuit of external audio 263 from external video video camera or other external microphone source, come the enhanced MSC audio capability.When being activated, external audio 263 is treated to the main body audio frequency, rather than from the audio frequency of built-in shotgun microphone 230.
MSC allows the operator to hear by MSC to catch and flow main body audio frequency to client/RC.By hearing the main body audio frequency, the quality that the operator can monitor flows gives the audio frequency of client/RC, this just is called audio surveillance.The audio surveillance pattern is realized by MSC processing subsystem 213, and makes the audio frequency that is used for built-in shotgun microphone 230 or external audio 263 sources be routed to the headphone and the receiver 228/229 of connection.Utilize the demonstration and the controlled function that provide by MSC to come the control audio monitoring mode by the operator.By these control, the operator can select to listen to: client VoIP audio frequency only; Main body audio frequency only; Perhaps Yi Shang combination.
By allowing MSC 100 to receive the main body audio frequency and output to loud speaker 253, come the enhanced MSC audio capability from RC 110 or compatible apparatus.This audio session is initiated by client/RC 110 and is utilized and be used to allow MSC 110 mobile audio frequency to set up to the identical real-time protocol (RTP) of RC 110, and use identical Compress softwares (MP3, AAC).Utilize the compressed audio packets that the Compress softwares of consulting is unpacked and decompress(ion) MSC processing subsystem receives from RC 110 through network.MSC processing subsystem 213 flows to audio codec subsystem 214 through 12S interface 215 with it then.Audio codec subsystem 214 is converted to analog signal with the PCM digital audio-frequency data that is received, and with its filtration and amplification, and it is routed to the loud speaker of boombox 233 and/or headphone that is connected and receiver 228.
The MSC speech capability allows at MSC 100 when network flows to RC 110 with video, audio frequency and picture, allows the voip phone of operator's initiation or reception and client computer to call out.This calling utilizes Session Initiation Protocol to set up.The operator uses the hands-free phone ability through the headphone of audio jack 227 connections and transmitter 228 or MSC to be used for the voip phone calling.The hands-free phone ability has been utilized built-in omnidirectional microphone 269 and boombox 233 to eliminate software together with the echo of operation on MSC processing subsystem 213 full-duplex operation without hand is provided.
By feed-in audio codec subsystem 214, at this, this microphone audio is converted to pulse-code modulation (PCM) digital audio-frequency data in real time with analog format for the outside headphone that the audio jack 227 of hanging oneself connects and the microphone audio of transmitter 228.The PCM digital audio-frequency data is sent to MSC processing subsystem 213 through 12S interface 215 then.
From the audio frequency of built-in omnidirectional microphone 269 with analog format by feed-in audio codec subsystem 214, at this, this audio frequency is converted to pulse-code modulation (PCM) digital audio-frequency data in real time.This PCM digital audio-frequency data is sent to MSC processing subsystem 213 through 12S interface 215 then.
MSC processing subsystem 213 directly receives built-in omnidirectional microphone 230 and headphone and transmitter microphone 228PCM digital audio-frequency data from audio codec subsystem 214 through 12S interface 215.MSC processing subsystem 213 is carried out echo to this data and is eliminated operation, utilize then such as G.711, G.723, G.729, the Compress softwares of GSM or the Compress softwares that other VoIP is fit to, these data are compressed.The voice data of this compression be formatted as then the grouping and through network flow to RC 110.
The VoIP packet that receives from RC 110 through network by MSC processing subsystem 213 utilize such as G.711, G.723, G.729, GSM or other suitable Compress softwares, unpacking to conciliate pushes back the PCM digital audio-frequency data.MSC processing subsystem 213 flows to audio codec subsystem 214 with it through 12S interface 215 then.Audio codec subsystem 214 is converted to analog signal with the PCM digital audio-frequency data that is received, and to its filtration and amplification, and it is routed to the loud speaker of boombox 233 and/or headphone that is connected and transmitter 228.
By MSC processing subsystem 213 individual processing main body audio frequency and operator's voice audio, come the enhanced MSC audio capability.By individual processing and these sources of flowing, the client can control RC 110 only play the main body audio frequency, only play operation person the VoIP audio frequency or be mixed together and play these two kinds of audio-source.
By allowing use wireless head-band earphone and transmitter 229 but not wired headphone and transmitter 228, come the Voice ﹠ Video ability of enhanced MSC 100.MSC 100 provides digital wireless apparatus 224 or other equivalent radio system of 900MHz ISM frequency band, and be used for to/from the wireless head-band earphone of compatibility and the antenna 225 of transmitter 229 transmission/reception PCM digital audio-frequency datas.When enabling wireless head-band earphone and transmitter function, the PCM digital audio-frequency data is routed to 900MHz ISM number of bands radio link 224/225 through two-way 12S serial line interface 223 from audio codec subsystem 214, at this, this digital audio-frequency data is modulated and be sent to relevant wireless head-band earphone and transmitter 229.Same, be routed to audio codec subsystem 214 by the PCM digital audio-frequency data from wireless head-band earphone and transmitter 229 of 900MHz ISM number of bands radio link 224/225 demodulation by 12S interface 223.
By provide a plurality of independently double-direction radio radio channel to eliminate common location the MVCS system and the interference between their relevant wireless head-band earphone and the transmitter, strengthen wireless head-band earphone and transmitter ability.
Two kinds of implementations of wireless head-band earphone and transmitter 229 below are provided.First kind of mode is embedded into digital radio and battery supply in headphone and the transmitter.The second way utilizes little worn module (Dao Er chip) to hold digital radio and battery supply.On the Dao Er chip, provide aerial lug to allow inserting compatible wired headphone and transmitter, allow the range of choice of employed headphone and transmitter wideer thus, still keep the wireless connections between operator and the MSC 100 simultaneously.
Adapt to the available network bandwidth between itself and the RC 110 and the ability of reliability by MSC 100, come video, audio frequency and the speech capability of enhanced MSC 100.This is to utilize RTCP Real-time Transport Control Protocol (RTCP (RFC1889)) or similar agreement to collect the session performance metric that connects about the ad-hoc network between itself and the MSC 100 and report back that MSC 100 realizes by RC 110.The tolerance of being reported is including, but not limited to packet loss rate, packet awaits time and packet jitter.Utilize the data of this report, so MSC 100 regulates video, audio frequency and voice data stream parameter according to predetermined algorithm, to optimize the quality that sends RC 110 for available connection to.
Store the local file storage system 265 of MSC and/or the portable memory card 258 of installing into and/or in the USB memory module that usb host interface 259/260 is connected and/or store NFS (NFS) into and store in the facility 150, come video, audio frequency and the speech capability of enhanced MSC 100 by video, audio frequency and the speech stream that allows compression.This ability is independent of MSC 100 flow-data and flows to RC 110 and work.These files are automatic name and manually renames if necessary.These files can utilize such as the identity of date, time, coded message and the operator who relates in session, client and MSC and come automatic mark.The operator explains for each the interpolation file description text and the speech segment of storage.
By allowing operator's capturing still image (picture) from video flowing, and store into them in the local file system 265 or store on the portable memory card 258 of installation and/or and flow to RC 110, come the enhanced MSC video capability them.These files are named automatically and can manually be renamed if necessary.The identity of utilization such as date, time, coded message and the operator who relates in session, client and MSC is to the automatic mark of file.The operator can explain for each the interpolation file description text and the speech segment of storage.Press and discharge freeze frame 402 buttons and catch picture by the operator.Action is relevant therewith, MSC 100 is with next frame of video that capture camera provided, listened to the prompting of generation such as camera shutter sound has been caught image with indication, this picture format is turned to JPEG, TIFF, BMP or other picture format, on LCD 254, show the image of being caught then to the operator.MSC100 will provide and preserve image, send image to the operator then to remote client 110 or abandon the option of image.
By in the local file storage system 265 that allows to be stored in MSC or be stored in the portable memory card 258 of installation or be stored in the USB storage module that usb host interface 259/260 connects or the video, audio frequency, speech and the picture that store NFS (NFS) storage facility 150 into retrieval and playback and/or flow to RC110 on MSC 100, come video, audio frequency and the speech capability of enhanced MSC 100.The button 255 that is provided on can use device and 300 to 312 and touch-screen 253/322 control is play, time-out, rewinding, search for, stop and the described content of F.F..MSC processing subsystem 213 obtains data from storage medium, and decompression format also is forwarded to display controller 212 with it, and display controller 212 shows it again on LCD254.Simultaneously, MSC processing subsystem 213 can be sent to the data from storage medium RC 110.By in operation on the MSC processing subsystem 213 and on LCD 254, present the file browser application program of demonstration, and be convenient to retrieve the stream of being stored.The file browser function shows filename, file attribute and the thumbnail of each Storage Item on LCD 254.The file browser function provides through boombox 233 or headphone and transmitter 228,229 and plays the ability that any associated voice is explained.
By allowing before video, audio frequency, speech and picture are flowed to RC 110, to encrypt them, come video, audio frequency and the speech capability of enhanced MSC 100.This ability need to be used to the situation of safe transmission video, audio frequency and speech.Under this pattern, MSC processing subsystem 213 will transmit grouping offer the media stream server function before encrypted transmission grouping.For this purpose, MSC processing subsystem 213 uses data encryption standard (DES, Data EncryptionStandard), Triple DESC (3DES) or Advanced Encryption Standard (AES, AdvancedEncryption Standard) cryptographic algorithm.
Provide backlight to improve the visual capabilities of LCD under low light condition.Can utilize MSC electronic installation and software to regulate the backlight of LCD.MSC software allows the operator to select the rank of expectation manually to control brightness degree by the menu that shows from LCD 254, or be provided with by the exposure that utilizes camara module to report and control brightness degree automatically, exposure is provided with including, but not limited to for example aperture, shutter speed and gain.Utilize these settings, MSC calculates the surrounding brightness grade and regulates backlight illumination to mate these conditions.
Can be by order being sent to MSC 100 via network from RC 110 with remote control application in MSC 100, perhaps from master computer through the usb host interface with remote control application in MSC 100.RC can utilize this ability that the crucial compression parameters of MSC 100 is set, and comprising: the selection of Voice ﹠ Video codec, audio format, video size, frame rate, video bitrate, key frame interval, buffer size, video smoothness, decoder complexity, cutting method, deinterleaving processing, reverse telecine process, pixel format, time code generate and the grouping size.RC also can utilize this ability to control content stream function live and storage, comprising: stream beginning/stop/pause, recording start/stop, rewinding, after move, reach, F.F., far zoom, wide zoom, Manual focusing ON/OFF, focusing draw/push away, static catching.
Through usb host interface 259/260 MSC 100 is connected to keyboard and allows the operation of the local control of camera operation person MSC and all aspects of configuration.Through usb host 259/260 MSC 100 being connected to USB storage module client computer provides upload configuration data auto levelizers, the content that flows to be used to store and the ability of the content that playback is stored in advance to memory module.The usb host interface 259/260 of this device also provides the ability that is connected to such as the remote control of motor-driven tripod 240, gives the ability of the physical direction of MSC 100 and RC 110 control device thus.
MSC 100 provides the interface 244 with outside docking station 241, obtains DC power supply 242 and unique serial number information 243 to allow MSC 100 from docking station 241.DC power supply 242 is routed to the power supply of MSC and is used to move MSC 100 and charges to internal cell.Unique serial number information from docking station 241 is used to this device of assist location.This is to utilize the docking station that is positioned at known fixed position to realize.MSC 100 has hinted that to RC 110 report docking station sequence numbers MSC 100 and this docking station are positioned at same position.The unique serial number information 243 of docking station is read by MSC processing subsystem 213.MSC processing subsystem 213 with this information via network flow to RC 110.
MSC 100 provides the focus information that utilizes camara module 200 to be provided to measure the ability of the air line distance between MSC 100 and the main body.Focal length and aperture data that utilization receives from camara module 200, the estimated value of the average distance of MSC processing subsystem (213) calculating and main body, and these data can be obtained with RC 210 on LCD display 254.
By allowing a plurality of RC 510 mutual with single MSC 500 simultaneously, come enhanced MSC 500.RC 510 can browse the video that is flowed by MSC 500 and hear the audio frequency that is flowed by MSC 500, can Long-distance Control MSC 500 and can participate in VoIP Conference Calling session with MSC 500.
By adding video and the audio frequency support that video distribution service device function 502 realizes a plurality of RC 510.Video distribution service device 502 works together with registrar 504, so that set up SIP video and audio session between the RC 510 of MSC 500 and participation.In case set up session, MSC 500 flows to video distribution service device 502 with the video and the audio stream of best in quality, and video distribution service device 502 is given each RC 510 with these stream distribution again.Each RC 510 can control the selection of Voice ﹠ Video codec, audio format, video size, frame rate, video bitrate, key frame interval, buffer size, video smoothness, decoder complexity, cutting method, deinterleaving processing, reverse telecine process, pixel format, time code generation and the grouping dimension that is offered its stream by video distribution service device 502.This is to realize by the software that moves on the video distribution service device, the stream of the best in quality that the decoding of this video distribution service device receives from MSC 100, and according to the set characteristic of each RC510 to they recompiles.The video distribution service device then with the video flowing of recompile through network flow to RC 510.
Under the situation of a plurality of RC by utilizing speech Conference server function 506 that VoIP Conference Calling ability is provided.Conference server 506 works together with registrar 504, so that set up the SIP voice conversation between MSC 100 and RC 510.In case set up session, each participant (MSC 100 and RC 510) utilizes the VoIP Compress softwares of consulting in advance to compress its microphone audio, and by network it is flowed to speech Conference server 506.The speech Conference server receives these VoIP inlet flows by its network interface, the PCM digital voice audio stream of each establishment of decoding and standardize.It creates unique VoIP output stream, so that by will be from the PCM digital voice input audio stream of each participant the participant of stream is added together to flow back to each participant except sending it.For each participant creates such stream.Utilize the VoIP Compress softwares of consulting in advance to compress each stream then, and flow back to the target participant as the VoIP data flow through network.
By adapt between they and the RC 510 and they and MSC 500 between the ability of available network bandwidth, strengthen video distribution and VoIP Conference Calling ability.Each RC 510 collects and the performance statistics of the ad-hoc network connection between server report relevant itself and server.Similarly, the ad-hoc network switching performance tolerance of server between MSC 500 repayment they and MSC 500.The tolerance of being reported is including, but not limited to packet loss rate, packet awaits time and packet jitter.Utilize the data of these reports, server and MSC 500 just can regulate their the flow data parameter that is used for video, audio frequency and speech according to predetermined algorithm, to optimize the quality that sends RC and server for available connection (difference) to.

Claims (8)

1, a kind of primary importance that is used to have object to be watched and away from the method for communicating between at least one remote client of a plurality of remote clients of each position of object to be watched, described method comprises:
In described primary importance, the mobile streaming video camera by operator's operation is provided, described mobile streaming video camera comprises:
Whole mobile camera shell is arranged to be carried the unit as a whole by the operator;
Be installed in the battery supply in the described shell;
Be installed in camara module and camera lens thereof on the described camera housing;
Described camara module is provided in away from described outer casing frontispiece and watches on the view direction of object to be watched;
Be used for manually controlling described camara module and camera lens to generate the manual control input of vision signal by described operator, described camara module and camera lens are configured to towards object to be watched;
What have on the mobile camera shell is used for video display to described operator's display video signal;
Described video display is configured to be watched by the operator when the operator points to object to be watched with described camara module;
The touch-screen relevant with described video display is used for the operator and draws on video display;
Be used for providing the audio frequency output of voice communication to described operator;
Be used to receive at least one audio frequency input of voice communication;
The network that is used for being connected with network wireless connects;
Processing subsystem in the described shell; And
The storage device relevant with described processing subsystem;
At remote location away from described mobile streaming video camera, the computing platform by remote client's machine operation is provided, described computing platform comprises:
Video display;
Be used for the audio frequency output of audio frequency and speech;
Be used for the audio frequency input of speech;
The network that is used for being connected with network connects;
Manually input; And
Processing subsystem;
Connect the mobile streaming video camera of primary importance and the computing platform of remote location by network;
Registrar and LIST SERVER are provided on network;
Use described registrar and LIST SERVER, examine in title and password information under their situation of identity, enable the connection between the computer equipment of the mobile streaming video camera of primary importance and the second place;
Use described registrar and LIST SERVER obtain to set up with being connected of they required relevant a plurality of remote clients address information and have information;
Operate described camara module to obtain the video image of object to be watched;
Make the processing subsystem of described mobile streaming video camera import from described camara module receiver, video image and described at least one audio frequency, and compressed video and described at least one audio frequency input;
Make the processing subsystem of described mobile streaming video camera that the communication protocol that video and described at least one audio frequency input is real-time transmitted to network is provided;
Make the processing subsystem of described mobile streaming video camera receive the video and audio signal that compresses from network, and with these signal decompress(ion)s, so that on display, show described vision signal in real time and export described audio signal to described operator;
Make the processing subsystem of the described mobile streaming video camera figure that the display operation person draws on the described video display of described mobile streaming video camera;
On video shown on the described video display, draw;
Make the processing subsystem of described mobile streaming video camera on network, will draw and send to remote client from touch-screen;
Make the processing subsystem of described mobile streaming video camera to arrive described storage device from the video storage of described camara module;
Make the video of processing subsystem retrieve stored on storage device of described mobile streaming video camera, and with the video of storage through network flow to described remote client;
Make described mobile streaming video camera processing subsystem from network receive and on display display video signal and to operator's output audio so that play mobile content from described remote client;
Make the processing subsystem of described remote client receive compressed video and described at least one audio frequency input, so that decompress(ion) and on display, export in real time with audio frequency and export from described mobile streaming video camera by network;
Make the processing subsystem of described remote client be provided for the communication protocol that audio signal is real-time transmitted to the communication of network; And
Make the processing subsystem of described remote client on the video display of described remote client, be presented at the picture that receives from described mobile streaming video camera relatively with vision signal on the network.
2, method according to claim 1, being included in provides Conference server on the network, and makes the processing subsystem of described mobile streaming video camera pass through described Conference server, the mobile Conference Calling of startup, reception and participation and a plurality of remote clients.
3, method according to claim 1, being included in provides the video distribution service device on the network, and makes the processing subsystem of described mobile streaming video camera by described video distribution service device, to a plurality of remote client distribution of video streams.
4, method according to claim 1, wherein, mobile streaming video camera comprises illuminator, and makes the processing subsystem of described mobile streaming video camera come Long-distance Control brightness of illumination grade by described at least one remote client.
5, method according to claim 1, comprise all or some content that makes the processing subsystem of described mobile streaming video camera utilize cryptographic algorithm to encrypt to send at least one remote client to, and make the processing subsystem of described mobile streaming video camera utilize cryptographic algorithm to decipher the encrypted content that receives from least one remote client.
6, method according to claim 1, the remote signal that makes the processing subsystem of described mobile streaming video camera receive to provide by described at least one client computer is provided and these signals are sent to described camara module, so that the remote control ability that allows described at least one remote client to control the function of described camara module is provided.
7, according to any one described method of claim 1-6, wherein, described at least one audio frequency input comprises shotgun microphone and omnidirectional microphone, described shotgun microphone is configured to described camara module and camera lens towards object to be watched, so that catch audio frequency from object to be watched as first audio signal, described omnidirectional microphone is used to catch the speech of omnidirectional microphone location about as second audio signal; And wherein, make the processing subsystem of described mobile streaming video camera be independent of described second audio signal and on network, transmit described first audio signal, provide full duplex phone hands-free phone ability so that be used for the echo elimination of first audio signal.
8, any one described method according to claim 1-6, comprise by registrar and LIST SERVER are provided, so that only examine under their situation of identity in title and password information, enable the connection between the computer equipment of the mobile streaming video camera of primary importance and the second place, and all or some content by making the processing subsystem of described mobile streaming video camera utilize cryptographic algorithm to encrypt to send at least one remote client to, and make the processing subsystem of described mobile streaming video camera utilize cryptographic algorithm to decipher the encrypted content that receives from least one remote client, safe transmission is provided.
CNB2004800331884A 2003-10-07 2004-10-07 Camera for communication of streaming media to a remote client Active CN100515026C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US50886103P 2003-10-07 2003-10-07
US60/508,861 2003-10-07
US60/592,137 2004-07-30

Publications (2)

Publication Number Publication Date
CN1879400A CN1879400A (en) 2006-12-13
CN100515026C true CN100515026C (en) 2009-07-15

Family

ID=37510811

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2004800331884A Active CN100515026C (en) 2003-10-07 2004-10-07 Camera for communication of streaming media to a remote client

Country Status (1)

Country Link
CN (1) CN100515026C (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101291422B (en) * 2007-04-18 2011-01-12 威宝电信股份有限公司 Providing method for remote real-time video, system and communication structure thereof
US8767081B2 (en) * 2009-02-23 2014-07-01 Microsoft Corporation Sharing video data associated with the same event
JP6467395B2 (en) * 2016-11-25 2019-02-13 キヤノン株式会社 Image transmitting apparatus, image receiving apparatus, control method therefor, and image communication system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6327276B1 (en) * 1998-12-22 2001-12-04 Nortel Networks Limited Conferencing over LAN/WAN using a hybrid client/server configuration
US6466252B1 (en) * 1999-04-13 2002-10-15 Nec Corporation Video conference system, and its reservation server, control unit, video conference terminal equipment, and storage medium stored therein program thereof
US6473631B1 (en) * 1999-12-20 2002-10-29 Motorola, Inc. Video swivel phone
US20030142200A1 (en) * 2002-01-29 2003-07-31 Palm, Inc. System for and method of conferencing with a handheld computer using multiple media types
US6611503B1 (en) * 1998-05-22 2003-08-26 Tandberg Telecom As Method and apparatus for multimedia conferencing with dynamic bandwidth allocation

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6611503B1 (en) * 1998-05-22 2003-08-26 Tandberg Telecom As Method and apparatus for multimedia conferencing with dynamic bandwidth allocation
US6327276B1 (en) * 1998-12-22 2001-12-04 Nortel Networks Limited Conferencing over LAN/WAN using a hybrid client/server configuration
US6466252B1 (en) * 1999-04-13 2002-10-15 Nec Corporation Video conference system, and its reservation server, control unit, video conference terminal equipment, and storage medium stored therein program thereof
US6473631B1 (en) * 1999-12-20 2002-10-29 Motorola, Inc. Video swivel phone
US20030142200A1 (en) * 2002-01-29 2003-07-31 Palm, Inc. System for and method of conferencing with a handheld computer using multiple media types

Also Published As

Publication number Publication date
CN1879400A (en) 2006-12-13

Similar Documents

Publication Publication Date Title
EP1671480B1 (en) Camera for communication of streaming media to a remote client
US7539504B2 (en) Wireless telepresence collaboration system
CN103222262B (en) For skipping the system and method for Video coding in a network environment
US7051356B2 (en) Method and system for remote wireless video surveillance
US7929021B2 (en) Methods and systems for A/V input device to display networking
US8300079B2 (en) Apparatus and method for transferring video
US20060083194A1 (en) System and method rendering audio/image data on remote devices
US11477316B2 (en) Information processing system, wireless terminal, and information processing method
US20050208962A1 (en) Mobile phone, multimedia chatting system and method thereof
US20060033811A1 (en) Integrated broadband telecommunications A/V appliance and device
CN103888699A (en) Projection device with video function and method for video conference by using same
CN103905668A (en) Telephone set with video function and video meeting method thereof
TW550948B (en) Audio/video IP camcorder
KR20040064587A (en) A wireless system for transmitting and receiving multimedia data free of charge and a method therefor
JP2010239641A (en) Communication device, communication system, control program of communication device, and recording media-recording control program of communication device
CN100515026C (en) Camera for communication of streaming media to a remote client
CN113056031A (en) Method for establishing wireless screen projection connection
US7542067B2 (en) System of using digital frames in an idle web video conferencing device
US7321382B2 (en) Virtual communication device configuring method and apparatus
US6208378B1 (en) Video arrangement with remote activation of appliances and remote playback of locally captured video data
CN203788395U (en) Wireless communication device
JP4680034B2 (en) COMMUNICATION DEVICE, COMMUNICATION SYSTEM, COMMUNICATION DEVICE CONTROL PROGRAM, AND RECORDING MEDIUM CONTAINING COMMUNICATION DEVICE CONTROL PROGRAM
US7499085B2 (en) Information terminal with controller for stopping voice data
KR101386522B1 (en) Method and System for performing video call using of communication terminal without camera
CN104935864A (en) Wireless communication device and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant