CN103108126A - Video interactive system, method, interactive glasses and terminals - Google Patents
Video interactive system, method, interactive glasses and terminals Download PDFInfo
- Publication number
- CN103108126A CN103108126A CN2013100226179A CN201310022617A CN103108126A CN 103108126 A CN103108126 A CN 103108126A CN 2013100226179 A CN2013100226179 A CN 2013100226179A CN 201310022617 A CN201310022617 A CN 201310022617A CN 103108126 A CN103108126 A CN 103108126A
- Authority
- CN
- China
- Prior art keywords
- terminal
- control
- camera
- user
- infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 113
- 239000011521 glass Substances 0.000 title claims abstract description 57
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000012545 processing Methods 0.000 claims description 17
- 238000005538 encapsulation Methods 0.000 claims description 12
- 230000008569 process Effects 0.000 claims description 8
- 230000003993 interaction Effects 0.000 abstract description 3
- 230000005540 biological transmission Effects 0.000 description 14
- 230000033001 locomotion Effects 0.000 description 11
- 230000000694 effects Effects 0.000 description 4
- 210000003128 head Anatomy 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- PCTMTFRHKVHKIS-BMFZQQSSSA-N (1s,3r,4e,6e,8e,10e,12e,14e,16e,18s,19r,20r,21s,25r,27r,30r,31r,33s,35r,37s,38r)-3-[(2r,3s,4s,5s,6r)-4-amino-3,5-dihydroxy-6-methyloxan-2-yl]oxy-19,25,27,30,31,33,35,37-octahydroxy-18,20,21-trimethyl-23-oxo-22,39-dioxabicyclo[33.3.1]nonatriaconta-4,6,8,10 Chemical compound C1C=C2C[C@@H](OS(O)(=O)=O)CC[C@]2(C)[C@@H]2[C@@H]1[C@@H]1CC[C@H]([C@H](C)CCCC(C)C)[C@@]1(C)CC2.O[C@H]1[C@@H](N)[C@H](O)[C@@H](C)O[C@H]1O[C@H]1/C=C/C=C/C=C/C=C/C=C/C=C/C=C/[C@H](C)[C@@H](O)[C@@H](C)[C@H](C)OC(=O)C[C@H](O)C[C@H](O)CC[C@@H](O)[C@H](O)C[C@H](O)C[C@](O)(C[C@H](O)[C@H]2C(O)=O)O[C@H]2C1 PCTMTFRHKVHKIS-BMFZQQSSSA-N 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000000205 computational method Methods 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 239000005304 optical glass Substances 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 238000002347 injection Methods 0.000 description 2
- 239000007924 injection Substances 0.000 description 2
- 235000019640 taste Nutrition 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Details Of Television Systems (AREA)
- Selective Calling Equipment (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a video interactive method, a system, glasses and terminals. The interactive system comprises a first terminal and a second terminal which are connected through an internet video. The first terminal is provided with one or more than one cameras used for obtaining scene images of the first terminal and a controlled device used for remotely controlling rotation of the first terminal cameras. The second terminal is provided with a display device displaying the scene images and a control device which carries out control interaction with the controlled device of the first terminal and remotely controls the rotation of the first terminal cameras. According to the goal that the images of the first terminal are obtained in a multi-angle mode through control operation of a user on the second terminal, the video interactive method, the system, the glasses and the terminals achieve an intelligent control level and obviously improve video interactive experience of the user.
Description
Technical field
The invention belongs to the video interactive technical field, relate in particular to video interactive system, method, mutual glasses and terminal.
Background technology
In daily habits and customs, TV normally is positioned in the parlor.With respect to the chat of general computer video, the spatial dimension in parlor is more open, and privacy of user protection demand is lower, and the parlor Scene is many, and the personage of participation also may be more, watches area requirement higher to video.
TV is different from individual PC, intelligent television is generally heavier, perhaps carry on the wall, the fixing camera that is arranged on intelligent television can't move due to intelligent television and then can only keep single stiff shooting angle, cause user video to use alternately inconvenience, user's video tastes is not high.
Focus on the other hand the broadcast of 3D video due to current 3D TV, the user is with the 3D glasses, namely can watch the 3D images such as 3D film or program.Now a lot of 3D TVs all are provided with camera, and existing intelligent television can carry out Video chat, but also there is no perfect 3D video interactive system, but the user uses inconvenience by relevant software application, experiences not high.
Summary of the invention
Purport of the present invention is to provide the video interactive system that can obtain larger range of video between two users' end that carries out video interactive, one video interactive method also is provided simultaneously, a kind of video interactive glasses and terminal correspondingly are provided, experience for the more real video interactive of user.
A kind of video interactive provided by the invention system is achieved in that a kind of video interactive system, comprise the first terminal and the second terminal that connect by internet video, described first terminal is provided with one or more and is used for obtaining the camera of first terminal scene image and the controlled device that the described first terminal camera of Long-distance Control rotates, and described the second terminal is provided with the display unit that shows described scene image and carries out control device mutual and then that the described first terminal camera of Long-distance Control rotates by the controlled device with described first terminal.
Particularly, the control device of described the second terminal comprises a remote command processing module, the control command that described remote command processing module sends by remote control according to the user, to be transferred to the controlled device of first terminal after described control command encapsulation, described controlled device is controlled the rotation of described first terminal camera.
Particularly, the remote control of described the second terminal comprises: mutual glasses, described mutual glasses are provided with infrared launcher, are used for by particular transmit frequency emission infrared signal.
The control device of described the second terminal comprises:
User's viewpoint acquisition module is used for according to the view information of obtaining the second terminal use; The remote command processing module is used for described view information is encapsulated as the control command of controlling the first terminal camera, and sends described control command.Described control command is transferred to the controlled device of first terminal after encapsulation, described controlled device is controlled the rotation of described first terminal camera.
Compared to prior art, a kind of video interactive provided by the invention system obtains the scene image of first terminal periphery by the camera from described first terminal, the mode that transmits by the Internet is conveyed to the second terminal, through the display terminal of the second terminal, above-mentioned scene image is shown.For making the second terminal can change according to user's facial action the scene image that obtains the first terminal periphery of multi-angle, arrange one at first terminal and can control the controlled device that described first terminal camera rotates, in the second terminal, user's viewpoint deriving means and control device are set, obtain user's view information by this user's viewpoint deriving means, and by control device, user's viewpoint rotational orientation information is sent to the controlled device of described first terminal, control the rotation of first terminal camera by described controlled device, to realize the long-range adjustment of scene image.Further reach the scene image that obtains the first terminal periphery at the viewpoint variation automatic multi-angle of the second terminal according to the user, and be transferred to the purpose of the second terminal plays.
A kind of video interactive method provided by the invention is achieved in that it comprises:
First terminal is set up video with the second terminal through internet and is connected;
The second terminal is obtained user's mutual control command by control device, and described control command encapsulation, and be transferred to first terminal;
First terminal receives described control command, and controls the first terminal camera according to this control command and rotate.
Particularly, the second terminal use launches by remote control the remote signal that the Long-distance Control camera rotates, and the second terminal receives described remote signal, and described remote signal is encapsulated as the instruction bag of controlling the rotation of first terminal camera.
Particularly, the second terminal use wears the video interactive glasses, be built-in with gyroscope in described video interactive glasses, obtain user's viewpoint position information by gyroscope, and described viewpoint position information is converted to the control command that the Long-distance Control camera rotates.
Particularly, second terminal use's head-mount one is built-in with the video interactive glasses of infrared launcher, and described video interactive glasses are pressed certain frequency to described display screen emission infrared signal by described infrared launcher; Be provided with at least three not infrared remote receivers on same straight line on the second terminal, each described infrared remote receiver receives described infrared signal, and calculates active user's viewpoint position information according to the strong and weak information of the infrared signal that receives; Control the control command of first terminal camera deflection according to described viewpoint position Information generation.
Correspondingly, the present invention also provides a kind of video interactive glasses, described mutual glasses are provided with infrared launcher, and described infrared dispensing device is launched infrared signal by particular transmit frequency to terminal, are used for the infrared launcher that terminal is calculated user's viewpoint on terminal display screen.Further, described video interactive glasses also are provided with earphone-microphone.
Correspondingly, the present invention also provides a kind of video interactive first terminal, described terminal is provided be used to the camera that obtains scene image and controlled device, described terminal receives the second terminal control instruction by described controlled device, and control described camera according to described control command and rotate, take the orientation thereby adjust it.
Correspondingly, a kind of video interactive the second terminal, described terminal are provided with the control device of controlling alternately and then control the camera rotation of described first terminal with the controlled device of first terminal.
Compared to prior art, video interactive method provided by the invention enters the remote dummy scene by video interactive provided by the invention system, adopt the inventive method to obtain active user's viewpoint position information or video focus information, and then control the purpose that the first terminal camera is adjusted the shooting angle consistent with described viewpoint position or video focus, thereby satisfy user video freer, higher requirement of watching scope of control when mutual.
Simultaneously due to video interactive method of the present invention and video interactive glasses, video interactive first terminal, the second terminal, it can make the first terminal camera take the orientation and be subjected to Long-distance Control, perhaps the variation with user's viewpoint position information changes, its can be real-time the variation according to user's head visual angle deflection obtain the presentation content of the corresponding deflection angle direction of long-range scene, reach the intelligent level of controlling, improved significantly user's video interactive and experienced.
Description of drawings
Fig. 1 is the structural representation of the video interactive system that provides of the embodiment of the present invention one;
Fig. 2 is the structural representation of the video interactive system that provides of the embodiment of the present invention two;
Fig. 3 is the structural representation of the video interactive system that provides of the embodiment of the present invention three;
Fig. 4 is the refined structure schematic diagram of control device in Fig. 3;
Fig. 5 is the realization flow figure of the video interactive method that provides of the embodiment of the present invention four;
Fig. 6 is the realization flow figure of the video interactive method that provides of the embodiment of the present invention five;
Fig. 7 is the realization flow figure of the video interactive method that provides of the embodiment of the present invention six;
Fig. 8 is that the infrared remote receiver received signal amplitude size of the video interactive method that provides of the embodiment of the present invention seven receives the radius relationship illustraton of model with signal;
Fig. 9 is that the viewpoint that the embodiment of the present invention seven provides is calculated schematic diagram;
Figure 10 is the structural representation of the video interactive glasses that provide of the embodiment of the present invention eight.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, is not intended to limit the present invention.
Embodiment one
The present embodiment is the preferred implementation about the structural representation of video interactive provided by the invention system.
Please refer to Fig. 1, Fig. 1 is the structural representation of the video interactive system that provides of first embodiment of the invention.
In figure, first terminal 102 is connected by internet video with the second terminal 105, and video connects the network connection that refers to the Internet video chat here.Described first terminal 102 has one or more cameras 101 that is used for obtaining the first terminal scene image, but the orientation is taken in the controlled deflection of described camera 101, and the controlled device of described first terminal 102 cameras 101 rotations of Long-distance Control, be used for the receiving remote instruction and then control camera 101 according to described teleinstruction and rotate.
Described the second terminal 105 is provided with the display unit that shows described scene image, is used for playing the long-distance video scene image; Also be provided with by controlling control device mutual and then that described first terminal 102 cameras 101 of Long-distance Control rotate with the controlled device of described first terminal 102.Described control device is used for receiving user's control command, and instruction is encapsulated, and sends to the controlled device of first terminal 102 by the network transmission protocol, and then controls camera 101 rotations of first terminal 102 by the controlled device of described first terminal 102.Control described here refers to the controlled device of described first terminal 102 alternately and the control device of the second terminal 105 carries out mutually controlling coordinating.
In the present invention, described first terminal 102 can be set up unidirectional video with the second terminal 105 and be connected, and namely the second terminal 105 can only be controlled the rotation of the camera 101 of first terminal 102.Thereby due to be not each terminal be provided with requirement of the present invention rotatable adjust the camera that it takes the orientation, unidirectional video connect have compatible preferably.Even the second terminal 105 does not have the camera that the present invention describes, as long as corresponding control device is set on the second terminal 105 equipment or the corresponding software of controlling is installed can the cross-platform terminal 102 of describing with the present invention of striding equipment be set up video and be connected, the rotation shooting of the camera 101 of Long-distance Control first terminal 102.
In the situation that equipment is complete, it is the camera 101 that first terminal 102 is provided with requirement of the present invention, the second terminal 105 also is provided with the camera 104 of the setovered shooting of requirement of the present invention, and described first terminal 102 and the second terminal 105 also can be set up two-way video and be connected and carry out two-way video interactive (mutually controlling the rotation of camera each other).The second terminal 105 can be controlled the rotation of the camera 101 of first terminal 102, and first terminal 102 also can be controlled the rotation of the camera 104 of the second terminal 105 simultaneously.
In Fig. 1,106 is remote control, and the second terminal 105 users send by this remote control 106 the rotation shooting that first terminal 102 cameras 101 are controlled in instruction, and then obtains the moving image of multi-angled shooting in first terminal 102 scenes.Under the state of two-way video interactive, first terminal 102 users also can send the rotation shooting that the second terminal 105 cameras 104 are controlled in instruction by remote control 103.
Consider the convenience of description, the present invention is only with the unidirectional example that is connected to, specific embodiments of the present invention is described, under this unidirectional connection mode, the second terminal 105 users send instruction to the second terminal 105 by this remote control 106, and control the rotation shooting of first terminal 102 cameras 101 by the second terminal 105.
The embodiment that connects take one-way video is as example, for augmented video obtains effect, the control model that multiple camera automatic rotating is taken can be set in first terminal 102, described control model is corresponding one group of camera automatic rotating TRAJECTORY CONTROL formula, and the camera automatic rotating TRAJECTORY CONTROL formula algorithm by correspondence is controlled camera and it rotated by predefined rotary motion trace take.The user of the user of the second terminal 105 or local first terminal 102 is by switching screening-mode, and the camera 101 that can automatically control first terminal 102 rotates by particular track to be taken.For example, by certain slewing rate, the side-to-side movement scanning shoot; At the uniform velocity the rotating 360 degrees scanning shoot, namely control camera 101 circular scanning under certain angle and take; Moving target (such as the user) shooting etc. is followed in locking.
Locking described here is followed moving target (for example user) shooting and is according to scene image, by image processing algorithm, the automatic capturing moving target, and according to the movement of target, control the rotation of following of camera, and then locking accompany movement target (for example user) is obtained the scene motion image.
What deserves to be explained is, the rotary parts of camera can adopt the rotary parts of prior art, for example adopts motor-driven gear, and then drives the mode such as camera rotation.The applicant will disclose a kind of camera preferably and rotate the control parts in another application in addition.Also can adopt in addition one or more camera of wide viewing angle to carry out static state and take, and the method that adopts image to process, the rotation in the virtual image visual field.
Described remote control 106 can be general remote controller, also intelligent terminal, perhaps mutual glasses.
The video interactive system of the present embodiment, be in user's video interactive, the control ability that provides the user that remote image is obtained, make in video interactive, the video reception user can watch the long-range removable image of oneself liking by the wish of oneself, and provide a plurality of screening-modes to the user, greatly improved interest and the convenience of user interactions.
Embodiment two
The present embodiment is the preferred implementation about video interactive provided by the invention system, and the execution mode that connects take one-way video is described as example.
please refer to accompanying drawing 2, a kind of video interactive system, comprise by the interconnective first terminal 10 in the Internet and the second terminal 20, described first terminal 10 has the controlled device 11 of at least one camera that can obtain the first terminal scene image 12 and described camera 12 rotations of energy Long-distance Control, described the second terminal 20 comprises by controlling control device 23 mutual and then that the described first terminal camera 12 of Long-distance Control rotates with the controlled device 11 of described first terminal 10, described control device 23 comprises a remote command processing module 24, in addition, described video interactive system also comprises remote control 21, described remote control 21 is provided with gyroscope 22, and described remote control 21 and the second terminal 20 are set up as bluetooth, infrared, the wireless connections of WIIF, the second terminal 20 users control by described remote control 21 and the second terminal 20 alternately.
Described remote command processing module 24 is obtained the second terminal 20 users' video focus control information by above-mentioned remote control 21, and transfer the control information of described video focus to control command that the camera 12 of Long-distance Control first terminal 10 rotates, the controlled device 11 of described control command through encapsulating and be transferred to first terminal, and then the rotation of described first terminal 10 cameras 12 of Long-distance Control.Video focus described here refers in video interactive, the long-range scene focus that the user pays close attention to.
Remote control described here can be remote controller, intelligent terminal, mutual glasses etc., be built-in with the gyroscope of deriving means positional information in described remote control, obtain the rotation biasing of the motion deflection information control remote terminal camera of remote control by gyroscope.Certain gyroscope here also comprises the motion positions devices such as some speed, acceleration transducer.
Under the normal state that uses, the deflection parameter of the gyroscope 22 of the remote control 21 described remote controls 21 of Real-time Obtaining, and described deflection parameter transmission is sent to the second terminal 20.The second terminal 20 remote command processing modules 24 are encapsulated as the director data bag that the camera 12 of controlling first terminal 10 rotates biasing to described deflection parameter, and described Packet Generation to first terminal 10, control the deflection of first terminal 10 cameras 12 with this, realize that the user controls the second terminal 20 by described remote control 21, and carry out deflection by the camera of the second terminal control first terminal by the second terminal 20 users' concern wish.First terminal 10 and the second terminal 20 can be carried out the described instruction bag of XML communications by http protocol.
Further, in the present embodiment, the use needs according to reality can arrange the shielding of described Motions of Gyroscope sensing function.As described in controlling as the direction key that uses remote control 21 as the user during camera rotational angle, make the gyroscope 22 in described user's remote control 21 be in masked state, under this masked state, described gyroscope 22 is inoperative, and only presses the rotation of key control first terminal camera by the control of remote control 21.Certainly, for there is no built-in gyrostatic remote control, also can directly control by direction key.So, the user is in actual use procedure, adopts neatly the mode of controlling described camera, the demand for experience that the user that is more convenient for exchanges video.
In the present embodiment, described first terminal 10 also comprises the audio-visual coding module 13 of scene, video-audio data transport module 14.With above-mentioned first terminal 10 adaptably, described the second terminal 20 also comprises video-audio data receiver module 25, audio-visual decoder module 26, audio-visual playing module 27, the display screen of wherein said audio-visual playing module 27 and the second terminal 20 is electrically connected.
The audio-visual coding module 13 of described scene is connected with described camera 12 signals of telecommunication, after described camera 12 obtains first terminal 10 surrounding image information, be sent to the audio-visual coding module 13 of described scene, carry out through described audio-visual coding module 13 video format that code conversion becomes to be convenient to Internet Transmission.The speech data of microphone can also can transmit by absolute coding with coding transmission together with video data in addition, is not restricted here.
The audio-visual coding module 13 of described scene also comprises a network detecting unit, and described video-audio data coding/decoding module can also detect the image compression ratio that network speed (for example sending " ping " instruction to the second terminal) carries out automatically adjusting coding according to described network detecting unit.
Described video-audio data transport module 14 is connected with video-audio data receiver module 25 signals of the second terminal 20, can set up transmission of video buffering both, the image data that first terminal 10 is obtained by the RTP/RTCP agreement through Internet Transmission to described video-audio data receiver module 25.The image coding that described audio-visual decoder module 26 obtains described video-audio data receiver module 25 is carried out corresponding decoding and is processed, so that adapt to described audio-visual playing module 27, and make it and to play on the display screen of the second terminal 20 by described audio-visual playing module 27.
Preferably, system provided by the invention is in the situation that equipment is complete, and for example first terminal 10 comprises at least two described cameras 12, and has the 3D coding engine; The second terminal 20 has the 3D playback engine, and it is mutual that system provided by the invention is applicable to the 3D scene video.The video interactive system of the present embodiment can improve the mutual interactive experience of 3D scene video greatly.
Compared to prior art, a kind of video interactive provided by the invention system obtains the scene image of first terminal periphery by the camera from described first terminal, the mode that transmits by the Internet is conveyed to the second terminal, through the display terminal of the second terminal, above-mentioned scene image is shown.And in the second terminal, one built-in gyrostatic remote control is provided, reach by this remote control the camera of controlling easily first terminal by described remote control according to the demand of the user video focus of the second terminal and rotate biasing, and then obtain from first terminal and meet the purpose that the second terminal use pays close attention to the scene image of demand.
In the present embodiment, by built-in gyroscope in remote control, obtain user's video locations of points of interest information by gyroscope, and described video locations of points of interest is converted to the control command that the Long-distance Control camera rotates, again described control signal is sent to first terminal, and then control the first terminal camera and carry out deflection by local user's concern wish.The present embodiment has improved the mutual experience of user video by the improvement to remote control, and it is more convenient to operate.
Embodiment three
The present embodiment is to provide on technology contents basis based on embodiment two a kind of system of the video interactive that is undertaken by the video interactive glasses.
In this system, obtain the viewpoint position information of user on screen by a viewpoint deriving means, and control according to described viewpoint position Information generation the control command that the first terminal camera rotates.The mutual glasses that wear at the family that described viewpoint deriving means comprises, described mutual glasses can integrated 3D glasses, the function of earphone-microphone, and are built-in with the trap setting of user's viewpoint position on mutual glasses, are used for catching user's viewpoint position.Can certainly be some other user's viewpoint device that is worn on head, as long as user's viewpoint deriving means is arranged.Viewpoint described here refers to the intersection point on straight line (being also the transmit direction of infrared launcher) and plane, screen place at user's face positive direction place.
The present embodiment is mapped as the shooting direction of first terminal camera mainly according to the second terminal use's viewpoint position.For example drop on the centre position, the left side of screen when the second terminal use's viewpoint position, the camera of controlling first terminal rotates biasing toward left/right, and obtains the figure of first terminal left side scene; As drop on the position, the upper right corner of screen when the second terminal use's viewpoint position, the camera of controlling first terminal rotates toward position, the upper right corner, and obtains the figure of the first terminal upper right corner/upper left corner scene.
Due to the most of skew that needs to consider user's head in user's observation place, in order to catch user's viewpoint position, need further to calculate the skew of user's head, the present invention adopts infrared signal to receive the size of amplitude and the principle that its emission angle has functional relation, a kind of user's viewpoint deriving means also is provided, catches user's viewpoint position by described user's viewpoint deriving means.
As shown in Figure 3, in the present embodiment, the remote control of described the second terminal 20 replaces with video interactive glasses 29, described video interactive glasses 29 are used for carrying out the 3D video interactive, and described video interactive glasses 29 are provided with infrared launcher 30, described infrared launcher 30 is located at the middle position of described video interactive glasses 29, and to user face dead ahead direction emission infrared signal, described infrared signal is take the signal frequency of fixed frequency as good by particular transmit frequency for described infrared launcher 30.The integrated 3D glasses of described video interactive glasses 29, also has the function of earphone-microphone.
Described infrared launcher 30 can arrange the even means for diverging of infrared signal, one optical glass outer cover for example is set, so that infrared signal gradient uniform emission, and it is the linear relationship model that described infrared remote receiver receives the strong and weak relational model with signal reception radius of signal, under this relational model, infrared remote receiver receives the amplitude of signal and the functional relation that becomes of its reception radius.
In the present embodiment, also comprise control device 23 is improved, please continue with reference to Fig. 3, Fig. 4, described control device 23 comprises user's viewpoint deriving means 28.Described viewpoint deriving means 28 comprises:
Infrared receiving device 2802, described infrared receiving device 2802 comprises be arranged on described the second terminal 20 at least three the not infrared remote receivers on same straight line, particularly, describedly establish described four infrared remote receivers that are distributed in four jiaos of display screens on display terminal 20, described infrared remote receiver receive described mutual glasses 29 infrared launchers emissions infrared signal
User's viewpoint position information computing module 2801, calculate user's view information for the strong and weak information of the infrared signal that receives by each infrared remote receiver, because infrared remote receiver receives the amplitude of signal and the functional relation that becomes of its reception radius, therefore can determine according to the size of signal amplitude the radius distance that signal receives, the radius distance that described signal receives is also the distance of viewpoint to sight line to infrared remote receiver, and said viewpoint refers to the intersection point on user's face dead ahead square place straight line and plane, screen place here.And then can determine according to a plurality of infrared remote receivers the position of viewpoint to the geometrical relationship of the length and width of the proportionate relationship of view distance, screen.In detail computational process please refer to embodiment seven description, wouldn't describe in detail here.
Described remote command processing module comprises:
Instruction package module 2402 is used for generating according to described view information the control command that Long-distance Control first terminal camera rotates;
Instruction sending module 2401 for the control command of described process after encapsulation being transferred to the controlled device of first terminal, is controlled the rotation of described first terminal camera by described controlled device.
for making first terminal 10 can change according to the user's of the second terminal 20 facial action the scene image that obtains first terminal 10 peripheries of multi-angle, arrange one at first terminal 10 and can control the controlled device 11 that described first terminal camera rotates, in the second terminal 20, a control device 23 and mutual glasses 29 are set, be provided with user's viewpoint acquisition module 28 and remote command processing module 24 in control device 23, obtain user's viewpoint position information by this viewpoint acquisition module 28, and then the control command of rotating for controlling the first terminal camera by 24 pairs of viewpoint position Information encapsulations of remote command processing module again, and described control command is transferred to the controlled device 11 of first terminal, to realize the adjustment to camera 12 rotational angles on first terminal 10.
Compared to prior art, video interactive provided by the invention system, the user is undertaken alternately by mutual glasses, by calculating user's viewpoint position, and then this viewpoint position is mapped as the offset orientation of remote terminal camera.Only adopt an infrared injection device and four red external connectors, launch infrared signal according to certain tranmitting frequency to described display terminal by described infrared injection device, receive the strong and weak situation of above-mentioned signal through four red external connectors, judge that by mathematical computations the user is with respect to view directions and the viewpoint of display terminal, it is simple that it has a product structure, characteristics easy to use, and further improved user-interaction experience.
Embodiment four
Fig. 5 shows the realization flow of the video interactive method that the embodiment of the present invention provides, and details are as follows.Described video interactive method comprises the following steps:
In step S501, first terminal is set up video with the second terminal through internet and is connected, the transmission tone video data, and video connects the network connection that refers to the Internet video chat here;
In step S502, the second terminal is obtained user's mutual control command by control device, and described control command encapsulation, and be transferred to first terminal; Described remote control can be general remote controller, also intelligent terminal, perhaps mutual glasses.
In step S503, first terminal receives described control command, and controls the first terminal camera according to this control command and rotate.Here the rotary parts of camera can adopt the rotary parts of prior art, such as adopting the modes such as motor-driven gear and then the rotation of driving camera.
In step S502, described mutual control command comprises controls the control command that the first terminal camera rotates, also comprise the control command that first terminal camera acquisition parameters is set, the focal length of taking such as camera, brightness, contrast level parameter etc., the user can carry out local feature to photographic subjects by the focal length of controlling remote camera here.
What deserves to be explained is that it can unidirectional connection can be also two-way connection that described video connects, namely be provided with simultaneously in the situation of camera parts in video interactive provided by the invention system when first terminal and the second terminal, two terminals can be controlled camera rotation separately mutually.
Consider the convenience of description, the present invention describes specific embodiments of the present invention, under this unidirectional connection mode only with the unidirectional example that is connected to, the second terminal use sends instruction to the second terminal by this remote control, and passes through the rotation of the second terminal control first terminal camera.
The execution mode that connects take one-way video is as example, for the mutual effect of augmented video, described mutual control command comprises that also controlling camera carries out multiple automatic shooting mode instruction, described shooting model correspondence is provided with camera and controls formula, is used for automatically controlling the first terminal camera by controlling the predefined shooting track of formula follow shot according to described control formula.Described automatic shooting mode instruction comprises by specific slewing rate side-to-side movement scanning shoot, at the uniform velocity rotating 360 degrees shooting of the visual field, and moving target (such as the user) shooting etc. is followed in locking.Make the user of the second terminal or the user of local first terminal pass through to switch screening-mode owing to being provided with certain rotary motion trace control formula in described first terminal, can automatically control camera by the particular track follow shot.
For example, following under the moving target screening-mode, first terminal is according to the scene image that obtains, by image processing algorithm, the automatic capturing moving target, and according to the movement of target, control the rotation of following of camera, and then obtain the scene image of following moving target (for example user).
In the method that provides in the present embodiment, be to improve the control ability that the user obtains remote image in user's video interactive, make in video interactive, the video reception user can watch the long-range removable image of oneself liking by the wish of oneself, and provide a plurality of screening-modes to the user, interest and the convenience of user interactions is provided greatly.
Embodiment five
On the basis of embodiment four, Fig. 6 shows the realization flow of the video interactive method that the embodiment of the present invention provides, and is same, and the execution mode that the present embodiment connects take one-way video describes as example, and details are as follows.Described video interactive method comprises the following steps:
In the present embodiment, by built-in gyroscope in remote control, obtain user's video locations of points of interest information by gyroscope, and described video locations of points of interest is converted to the control command that the Long-distance Control camera rotates, again described control signal is sent to first terminal, and then control the first terminal camera and carry out deflection by local user's concern wish.
Remote control described here can be remote controller, intelligent terminal, mutual glasses etc., is built-in with the gyroscope of deriving means positional information in described remote control.Certain gyroscope here also comprises some speed, acceleration transducer.
In step S601, the second terminal is obtained the gyrostatic reference of remote control original location, the original reference location of orientating described remote control deflection as of described reference.Under default situations, when can be set to start described remote control, the location point at described remote control place or user in use repeatedly sample to the position of remote control and are averaging, and then definite reference location.
In step S602, under the normal state that uses of user, the described gyrostatic deflection parameter of the second terminal Real-time Obtaining.
In step S603, generate according to described gyrostatic deflection parameter the instruction of controlling the deflection of first terminal camera, this instruction can be transmitted through being encapsulated as the XML packet.
In step S605, the second terminal is sent to first terminal to packaged director data bag, control the deflection of first terminal camera, realize that the camera that the user controls first terminal by described remote control carries out deflection by first terminal user's concern wish.First terminal and the second terminal can communicate the described instruction bag of transmission by http protocol.
In the present embodiment, by built-in gyroscope in remote control, obtain user's video locations of points of interest information by gyroscope, and described video locations of points of interest is converted to the control command that the Long-distance Control camera rotates, again described control signal is sent to first terminal, and then control the first terminal camera and carry out deflection by local user's concern wish.The present embodiment is mainly to control the rotation of remote terminal camera by the built-in gyroscope of remote control, has the effect that the body sense is controlled.The present embodiment has improved the mutual experience of user video by the improvement to remote control, and it is more convenient to operate.
Embodiment six
On the basis of embodiment five, Fig. 7 shows the realization flow of the video interactive method that the embodiment of the present invention provides, and details are as follows.Described video interactive method comprises the following steps:
In step S701, the user wears the video interactive glasses, system enters the remote dummy scene by video interactive, and described mutual glasses are provided with an infrared launcher, and this infrared launcher is launched infrared signal by characteristic frequency to user face dead ahead direction.Especially, described infrared launcher can arrange the even means for diverging of infrared signal, one optical glass outer cover for example is set, so that infrared signal gradient uniform emission, and the strong and weak relational model with signal reception radius of described infrared remote receiver reception signal is the linear relationship model.
In step S702, receive described infrared signal by the infrared remote receiver that is arranged on the second terminal, and the amplitude size of signal is obtained in sampling.Described infrared remote receiver is arranged on the frame of the second terminal, and is provided with at least three not infrared remote receivers on same straight line, and better set-up mode is for arranging four infrared remote receivers at the frame of screen four jiaos.The signal amplitude process that infrared remote receiver receives is amplified, and carries out analog-to-digital conversion, generates the signal magnitude data of expression signal magnitude.
In step S703, the signal magnitude relation that the second terminal receives according to each infrared remote receiver is calculated the viewpoint position information of user on screen.
In step S704, the second terminal is controlled the control command of first terminal camera deflection according to described viewpoint position Information generation.This process is actual is that the viewpoint position of the second terminal use on screen is converted to the deflection angle of controlling the first terminal camera.Implementation procedure comprises the relational model of setting up second terminal use's viewpoint position and first terminal camera shooting angle, described relational model is to set up the relationship maps of second terminal use's viewpoint position and first terminal camera shooting angle, generate described control command according to described relationship maps, and then control the rotation of camera.Certainly this kind mapping relations can be that a plurality of viewpoint positions are corresponding with a certain shooting angle.
In step S705, the second terminal arrives first terminal to described control command by Internet Transmission, and then control the first terminal camera and adjust the shooting angle consistent with described viewpoint position, first terminal obtains and transmits the image of described first terminal scene under this shooting angle.
Wherein, in step S703, the described signal magnitude relation that receives according to each infrared remote receiver according to the second terminal, calculate the viewpoint position information step of user on screen and specifically comprise:
Build the relational model that infrared remote receiver receives signal power and signal reception radius;
Receive the strong and weak information of signal according to described relational model and each infrared remote receiver, obtain the range information of each infrared remote receiver and user viewpoint on screen;
Viewpoint according to described user on screen and the range information of each receiver calculate user's viewpoint position coordinate information.
Above-mentioned computational process will be described in detail at embodiment seven, not describe for the time being here.
Undertaken alternately by mutual glasses in the present embodiment, these mutual glasses also can integrated 3D glasses, the earphone-microphone function, realize the mutual parlor virtual reality under the 3D scene.
Obtaining of its 3D image, coding, transmission, decoding broadcast scheme have had comparatively ripe scheme in the prior art.Some applicable and 3D is mutual coding and decoding schemes are provided in prior art, such as tieing up grid codings etc. based on disparity estimation coding, 3.
In addition, consider the difference of user network transmission speed, described video-audio data coding/decoding module can also carry out automatically adjusting the image compression ratio of coding according to detecting network speed (for example sending " ping " instruction to the other side), and then improves the adaptivity of the Internet Transmission of native system in 3D is mutual.
Compared to prior art, video interactive method provided by the invention is worn by the user and is adopted after the video interactive glasses video interactive provided by the invention system to enter the remote dummy scene.The second terminal is obtained active user's viewpoint position information, and then controls the purpose that the first terminal camera is adjusted the shooting angle consistent with described viewpoint position, thereby satisfies user video higher area requirement of watching when mutual.Due to video interactive method of the present invention, it can make the first terminal camera change with the variation of user's viewpoint position, its can be real-time the displaying contents according to the variation conversion scene at user's sight line and visual angle, reach the intelligent level of controlling, improved significantly user's video tastes.
Embodiment seven
On the basis of embodiment six, the present embodiment provides the computational process of viewpoint in the video interactive method that the embodiment of the present invention provides in conjunction with Fig. 8 and Fig. 9, and details are as follows.
Comprise the steps:
2.1) build infrared remote receiver and receive that signal is strong and weak receives the relational model of radius with signal.
Infrared remote receiver receives the infrared signal of infrared launcher emission, usually, its signal amplitude that receives receives for unlike signal the signal amplitude that radius will produce varying strength, in the situation that its receiving range is certain, and the signal amplitude of its reception size and the direct correlation of reception radius.Accordingly, can measure for the signal amplitude that each signal reception radius produces infrared launcher and infrared launcher in advance, the signal amplitude value of measurement gained is corresponding one by one with signal reception radius value, and then sets up the relational model that infrared remote receiver receives signal power and signal reception radius.
as shown in Figure 8, infrared launcher 1 emission infrared signal, infrared receiving device 3 receives described infrared signal, its direction radius that connects signal is r, in the situation that distance L is certain, its signal amplitude size has functional relation with the deviation angle α of signal emission, α=arctan(r/L) again, thereby distance L is certain the time, signal receives the amplitude size and has functional relation with signal reception radius r, the α angle of infrared launcher emission is larger, signal amplitude is less, the α angle is less, its signal amplitude certainly will be larger, be that signal amplitude value and signal receive radius value existence function relation.
The functional relation of described infrared emission angle and infrared remote receiver reception signal power can be reduced to signal reception radius r and receiver reception signal power has function corresponding relation Π=F (r), wherein Π is the signal amplitude of infrared remote receiver, and r is that signal receives radius.Under the laboratory, measured signal receives function corresponding relation Π=F (r) of radius r and the strong and weak Π of receiver reception signal.
Be easier to express and measure for making signal amplitude value and signal receive radius value, described infrared launcher is provided with the even means for diverging of infrared signal, as optical lens, make the infrared signal gradient of infrared launcher emission evenly disperse, and the strong and weak relational model with signal reception radius of described infrared remote receiver reception signal is the linear relationship model.So, for example less in the α angle, in the certain situation of distance L, can set up the functional relation that signal amplitude F and signal receive radius r:
Wherein m, n, k are coefficient, and this is parameter intrinsic between infrared remote receiver and infrared launcher.
2.2), receive the strong and weak information of signal according to described relational model and each infrared remote receiver, obtain the distance of each infrared remote receiver and user viewpoint on screen.
For ease of analyzing, please refer to the left figure of Fig. 9 and right figure.
Four jiaos at intelligent television are provided with four infrared remote receivers 3, remember that four infrared remote receivers 3 are respectively and write a Chinese character in simplified form into A, B, C and D below infrared remote receiver A, infrared remote receiver B, infrared remote receiver C and infrared remote receiver D(), the viewpoint of remembering simultaneously the user is O, the S point is the launch point of infrared launcher, viewpoint O be also the straight line at user's face positive direction place and described display terminal display screen intersection point in the plane.Under this relational model, the reception radius of the signal of infrared remote receiver A is AO, and the reception radius of the signal of infrared remote receiver B is BO, and the reception radius of the signal of infrared remote receiver C is CO, and the reception radius of the signal of infrared remote receiver D is DO.
Suppose that the signal amplitude that A receives is 0.8 §, B is 1.6 §, and C is 0.7 §, D is 0.2 §, wherein § is the reference signal amplitude, remembers that simultaneously Ra, Rb, Rc, Rd are respectively four infrared remote receivers to the distance of viewpoint (being that signal receives radius r), have following equation group:
In above-mentioned equation group, due to signal amplitude
The value of middle coefficient can be measured in advance according to experiment, be the value of F (r) as can be known, function corresponding relation according to signal amplitude and signal reception radius like this, can obtain four infrared remote receivers to the distance of viewpoint (being that signal receives radius r), namely the signal of each infrared remote receiver receives the value of radius R a, Rb, Rc, Rd.In quadrangle ABCD, because length of side BC, CD can measure in advance, in the situation that AO, BO, CO, DO as can be known, easily calculate the position of O.
2.3), calculate the viewpoint position coordinate information of user on display terminal according to described user at the range information of the viewpoint on screen and each receiver.
In the present embodiment, a kind of computational methods of being convenient to calculate above-mentioned eye coordinates are provided, the method need not to determine the actual function relation of F (r), and under the model that receives the linear ratio of radius r and signal reception amplitude, the note viewpoint is O, in consisting of quadrangle by an A, B, C and D, point O be on A, B, C determined plane a bit, can calculate very soon AO, BO, CO, the ratio between DO.
Wherein, OA=Ra, OB=Rb, OC=Rc, and the value of line segment AB, BC, AC can directly record from display terminal.So in four limit body ABCD, Qi Gebian is known, obviously again according to Ra, and Rb, Rc, the proportionate relationship between Rd can be extrapolated viewpoint O in the position of quadrangle ABCD, and namely viewpoint is at the coordinate of display screen.
Itemize a kind of account form as follows, please refer to the right figure of Fig. 9, take C as initial point, CB is the x axle, and CD is the y axle, and the coordinate (x, y) of O can calculate by geometrical relationship.Specific as follows: in △ OBC, between note B and C apart from BC=L, have
Due to the value of line segment OC and OB as can be known, the value of u as can be known, and is a constant.
In like manner, in △ ADO, the distance C D=H between note C and D has
Due to the ratio of line segment OD and OA as can be known, the value of w as can be known, and is a constant.
According to the equation group that formula (1) and formula (2) consist of, namely can calculate the occurrence of O point coordinates (x, y).Learn that namely viewpoint O is with respect to the coordinate figure on display terminal.
Further, for the accuracy of calculating is provided, the reference difference of the viewpoint that the present invention can be by the user is revised.The note user face and normal viewed status under, the viewpoint of system-computed is O
1, the user in the situation that the biasing viewpoint, the viewpoint of system-computed is O
2, the reference difference of user's viewpoint is: P=O
2-O
1, remember that screen center is the O point, the revised viewpoint of system is Q=O+P, obtains the viewpoint position of Q for revising.
Further, in order accurately to catch user's viewpoint position, can also be to be built-in with the miniature image processing unit in glasses, pass through image processing techniques, obtain user's pupil rotation direction and obtain the direction that user's glasses are stared, thereby further revise user's viewpoint position.
A kind of user of calculating is provided in the present embodiment the computational methods of viewpoint position on screen, these computational methods have improved the accuracy that user's viewpoint is calculated, and can be applied in this video interactive method and interactive system, by determining user's viewpoint position, again this viewpoint position is mapped as the deflection orientation of remote terminal camera, has further improved the mutual experience of user video.
Embodiment eight
The present embodiment is a preferred implementation of a kind of video interactive glasses for the video interactive system provided by the invention.
Please refer to Figure 10, as described in Figure 10, these mutual glasses comprise common 3D Glasses structure parts 4, also are included in the central infrared launcher 1 that arranges of glasses, be used for pressing specific transmission frequency to terminal side to the emission infrared signal, be used for terminal calculating and obtain user's viewpoint on the screen of display terminal.
Preferably, described infrared launcher can arrange the even means for diverging of infrared signal, one optical glass outer cover for example is set, so that infrared signal gradient uniform emission, and the strong and weak relational model with signal reception radius of described infrared remote receiver reception signal is the linear relationship model.
Preferably, described mutual glasses also comprise wireless microphone and Microspeaker.
In the prior art, when the user watches 3D image video, usually wear the 3D video eyeglasses.The video interactive glasses that the present embodiment provides are on original 3D video eyeglasses, infrared launcher, microphone and Microspeaker to be set, to realize video interactive.Wherein, the operation principle of described infrared launcher does not repeat them here as describing in previous embodiment.
Compared to prior art, video interactive glasses provided by the invention can better coordinate video interactive provided by the invention system, realize catching user's viewpoint.It also possesses voice transmission and listening function simultaneously, can further improve the mutual experience effect of user video.
Embodiment nine
The present embodiment is about a kind of preferred implementation for video interactive system video interactive terminal provided by the invention.
Please refer to Fig. 2, video interactive first terminal provided by the invention is provided be used to the camera 12 that obtains scene image and is used for controlling the controlled device 11 that described first terminal camera rotates, described first terminal receives the control command of the second terminal by described controlled device 11, and control described camera 12 according to described control command and rotate, thereby adjust its camera site.
Preferably described first terminal also comprises the audio-visual coding module 13 of scene, encodes for the image data that camera 12 is obtained, the speech data that microphone obtains; Video-audio data transport module 14 is used for transmitting described video-audio data to the second terminal plays.The voice data that the view data that described camera 12 obtains and microphone obtain can together be encoded to specific audio frequency and video form, also can separately encode, transmit and broadcast, be not restricted here.
Video interactive the second terminal provided by the invention is provided with to be controlled mutual with the controlled device of first terminal and then controls the control device 23 that described first terminal camera rotates, control device 23 obtains the user and controls the control command that the first terminal camera rotates, described control command is through encapsulating and be transferred to first terminal, and then the camera of the described first terminal of Long-distance Control rotates.Control described here refers to the controlled device of described first terminal alternately and the control device of the second terminal carries out mutually controlling coordinating.
Preferably, described the second terminal also disposes remote control 21, be used for offering the user and control alternately, and can obtain the user to the video focus information of long-range scene by remote control 21, and control the rotation of first terminal camera according to described video focus information.
Described the second terminal also comprises video-audio data receiver module 25 in addition, is used for video-audio data, the audio-visual decoder module 26 of receiving remote video interactive, is used for decoding described video-audio data, audio-visual playing module 27, is used for playing described audio-visual.
The first terminal that is used for video interactive that the present embodiment provides and the specific works principle of the second terminal see also previous embodiment, do not repeat them here.
In the present embodiment, based on interactive system provided by the invention, provide two terminals, described terminal can be applied independently in described interactive system, and the interactive terminal that the present embodiment provides has been improved terminal and carried out user's experience of video interactive.
The above is only preferred embodiment of the present invention, not in order to limiting the present invention, all any modifications of doing within the spirit and principles in the present invention, is equal to and replaces and improvement etc., within all should being included in protection scope of the present invention.
Claims (21)
1. video interactive system, comprise the first terminal and the second terminal that connect by internet video, it is characterized in that: described first terminal has one or more and is used for obtaining the camera of first terminal scene image and the controlled device that the described first terminal camera of Long-distance Control rotates, and described the second terminal is provided with the display unit that shows described scene image and reaches by controlling mutual with the controlled device of described first terminal and then controlling the control device that described first terminal camera rotates.
2. interactive system as claimed in claim 1, it is characterized in that, the control device of described the second terminal comprises the remote command processing module, described remote command processing module receives the control command that the user sends by remote control, to be transferred to the controlled device of first terminal after described control command encapsulation, described controlled device is controlled described first terminal camera according to described control command and is rotated.
3. interactive system as claimed in claim 1, it is characterized in that, many group camera automatic rotating TRAJECTORY CONTROL formulas are set in described first terminal, are used for automatically controlling the first terminal camera by the shooting track follow shot of described control formula definition according to described control formula.
4. interactive system as claimed in claim 2, it is characterized in that, described control device is built-in with gyroscope, is used for obtaining by gyroscope user's video locations of points of interest information, and described video locations of points of interest is converted to the control command that the Long-distance Control camera rotates.
5. interactive system as claimed in claim 2, is characterized in that,
Described remote control comprises: mutual glasses, and described mutual glasses are provided with infrared launcher, are used for by particular transmit frequency emission infrared signal,
The control device of described the second terminal comprises:
User's viewpoint acquisition module is for the view information of obtaining the second terminal use;
The remote command processing module is used for described view information is encapsulated as the control command of controlling the first terminal camera, and sends described control command.
6. interactive system as claimed in claim 5, is characterized in that, described user's viewpoint acquisition module comprises:
Infrared receiving device, described infrared receiving device comprise be arranged on described the second terminal at least three the not infrared remote receivers on same straight line, and described infrared remote receiver receives the infrared signal of infrared launcher;
User's viewpoint position information computing module calculates the view information of user on screen for the strong and weak information of the infrared signal that receives by each infrared remote receiver,
Described remote command processing module comprises:
The instruction package module is used for generating according to described view information the control command that Long-distance Control first terminal camera rotates;
Instruction sending module for the control command of described process after encapsulation being transferred to the controlled device of first terminal, is controlled the rotation of described first terminal camera by described controlled device.
7. interactive system as claimed in claim 5, is characterized in that, described first terminal comprises audio-visual coding module, video-audio data transport module, and described the second terminal comprises audio-visual decoder module, video-audio data receiver module, audio-visual playing module.
8. interactive system as claimed in claim 6, is characterized in that, described infrared launcher is provided with the even means for diverging of infrared signal, so that infrared signal gradient uniform emission.
9. a video interactive method, is characterized in that, described method comprises step:
First terminal is set up video with the second terminal through internet and is connected;
The second terminal is obtained user's mutual control command by control device, and described mutual control command encapsulation, and be transferred to first terminal;
First terminal receives described control command, and controls the first terminal camera according to this control command and rotate.
10. exchange method as claimed in claim 9, is characterized in that, described the second terminal is obtained user's mutual control command by control device, and the encapsulation of described control command, and the step that is transferred to first terminal specifically comprises:
The remote signal that the second terminal use rotates by remote control emission control first terminal camera, the second terminal receives described remote signal, and described remote signal is encapsulated as the instruction bag of controlling the rotation of first terminal camera.
11. exchange method as claimed in claim 9 is characterized in that, described the second terminal is obtained user's mutual control command by control device, and the encapsulation of described control command, and the step that is transferred to first terminal specifically comprises:
The user is built-in with gyroscope by remote control emission control instruction in described remote control, obtains user's video locations of points of interest information by gyroscope, and described video locations of points of interest is converted to the control command that the Long-distance Control camera rotates.
12. exchange method as claimed in claim 9 is characterized in that, described the second terminal is obtained user's mutual control command by control device, and the encapsulation of described control command, and the step that is transferred to first terminal specifically comprises:
Second terminal use's head-mount one is built-in with the video interactive glasses of infrared launcher, and described video interactive glasses are launched infrared signal by certain frequency to screen by described infrared launcher;
Be provided with at least three not infrared remote receivers on same straight line on the second terminal, each described infrared remote receiver receives described infrared signal, and calculates active user's viewpoint position information according to the strong and weak information of the infrared signal that receives;
Control the control command of first terminal camera deflection according to described viewpoint position Information generation.
13. exchange method as claimed in claim 12 is characterized in that, the viewpoint position information step that the strong and weak information of the infrared signal that described basis receives is calculated the active user specifically comprises:
Build the relational model that infrared remote receiver receives signal power and signal reception radius;
Receive the strong and weak information of signal according to described relational model and each infrared remote receiver, obtain the range information of each infrared remote receiver and user viewpoint on screen;
Calculate user's viewpoint position coordinate information according to the range information of described each receiver and viewpoint.
14. exchange method as claimed in claim 13, it is characterized in that, described infrared launcher is provided with the even means for diverging of infrared signal, so that infrared signal gradient uniform emission, and the strong and weak relational model with signal reception radius of described infrared remote receiver reception signal is the linear relationship model.
15. exchange method as claimed in claim 12 is characterized in that, described control command step according to the deflection of described viewpoint position Information generation control first terminal camera specifically comprises:
Set up the relational model of second terminal use's viewpoint position and first terminal camera shooting angle, described relational model is to set up the relationship maps of second terminal use's viewpoint position and first terminal camera shooting angle.
16. exchange method as claimed in claim 9 is characterized in that, described method also comprises: first terminal receives described control command, and adjusts according to this control command the acquisition parameters that first terminal connects camera.
17. exchange method as claimed in claim 9 is characterized in that, described first terminal receives described control command, and the step of rotating according to this control command control first terminal camera also comprises:
Described control command comprises the instruction of switching the fixation locus screening-mode, is used for automatically controlling the particular track follow shot that camera is pressed screening-mode.
18. exchange method as claimed in claim 17 is characterized in that, described fixation locus screening-mode comprises target track shot pattern, under this pattern, described camera automatically locks moving target, and follows moving target and rotate, and obtains the movable image of target.
19. video interactive glasses, it is characterized in that, described video interactive glasses are provided with infrared launcher, described infrared launcher is provided with the even means for diverging of infrared signal, described infrared dispensing device is launched infrared signal by particular transmit frequency to terminal, is used for terminal and calculates user's viewpoint position on described terminal display screen.
20. video interactive first terminal, it is characterized in that, described first terminal is provided be used to the camera that obtains scene image and controlled device, described first terminal receives the control command of the second terminal by described controlled device, and control described camera according to described control command and rotate, take the orientation thereby adjust it.
21. video interactive second terminal is characterized in that, described the second terminal is provided with the control device of controlling alternately and then control the camera rotation of described first terminal with the controlled device of first terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310022617.9A CN103108126B (en) | 2013-01-21 | 2013-01-21 | A kind of video interactive system, method, interaction glasses and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310022617.9A CN103108126B (en) | 2013-01-21 | 2013-01-21 | A kind of video interactive system, method, interaction glasses and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103108126A true CN103108126A (en) | 2013-05-15 |
| CN103108126B CN103108126B (en) | 2017-08-25 |
Family
ID=48315666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310022617.9A Expired - Fee Related CN103108126B (en) | 2013-01-21 | 2013-01-21 | A kind of video interactive system, method, interaction glasses and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103108126B (en) |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103533247A (en) * | 2013-10-22 | 2014-01-22 | 小米科技有限责任公司 | Self-photographing method, device and terminal equipment |
| CN104378587A (en) * | 2014-10-27 | 2015-02-25 | 小米科技有限责任公司 | Camera equipment control method, device and equipment |
| CN105376554A (en) * | 2015-12-04 | 2016-03-02 | 深圳市第六星设计技术有限公司 | 3D camera mechanism, mobile device with the mechanism and control method |
| CN105516577A (en) * | 2014-09-24 | 2016-04-20 | 深圳Tcl数字技术有限公司 | Camera shooting control method and system |
| CN105721820A (en) * | 2016-03-29 | 2016-06-29 | 佛山市南海区广工大数控装备协同创新研究院 | Interactive remote video communication system |
| CN105721821A (en) * | 2016-04-01 | 2016-06-29 | 宇龙计算机通信科技(深圳)有限公司 | Video calling method and device |
| CN105786179A (en) * | 2016-02-26 | 2016-07-20 | 广东欧珀移动通信有限公司 | Terminal, imaging device, interaction system and control method and device of terminal, imaging device and interaction system |
| CN105791675A (en) * | 2016-02-26 | 2016-07-20 | 广东欧珀移动通信有限公司 | Terminal, imaging and interaction control method and device, and terminal and system thereof |
| CN106341641A (en) * | 2015-07-10 | 2017-01-18 | 小米科技有限责任公司 | Video communication method and device |
| CN107124589A (en) * | 2017-05-24 | 2017-09-01 | 武汉大学 | 360 degree of immersion Active Eyes and method based on Cardboard |
| CN108270986A (en) * | 2016-12-30 | 2018-07-10 | 中兴通讯股份有限公司 | A kind of cradle head control and processing method, device, system, electronic equipment |
| WO2018129664A1 (en) * | 2017-01-10 | 2018-07-19 | 深圳市柔宇科技有限公司 | Display content adjustment method and system, and head-mounted display device |
| CN108366206A (en) * | 2015-06-11 | 2018-08-03 | 广东欧珀移动通信有限公司 | A kind of image pickup method and system based on rotating camera and intelligent glasses |
| CN108834002A (en) * | 2018-08-17 | 2018-11-16 | 袁森 | A kind of method that can remotely adjust mobile terminal image frame |
| CN108900770A (en) * | 2018-07-17 | 2018-11-27 | 广东小天才科技有限公司 | A kind of method, apparatus, smartwatch and the mobile terminal of the rotation of control camera |
| CN110177285A (en) * | 2019-05-29 | 2019-08-27 | 王子君 | Live broadcasting method, device, system and dollying head |
| CN110798609A (en) * | 2018-08-02 | 2020-02-14 | 光宝电子(广州)有限公司 | Image display method, image display system and virtual window |
| CN111953936A (en) * | 2020-07-21 | 2020-11-17 | 福建升腾资讯有限公司 | Adjustable camera system and method for self-service equipment |
| CN113497910A (en) * | 2020-04-01 | 2021-10-12 | 南宁富桂精密工业有限公司 | Video system and picture generation method thereof |
| CN114005313A (en) * | 2021-01-12 | 2022-02-01 | 深圳动魅科技有限公司 | Motion interaction equipment and control method thereof |
| CN114040106A (en) * | 2021-11-17 | 2022-02-11 | 维沃移动通信有限公司 | Video call control method and device, electronic equipment and readable storage medium |
| CN114205669A (en) * | 2021-12-27 | 2022-03-18 | 咪咕视讯科技有限公司 | Free visual angle video playing method and device and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1145501A (en) * | 1995-04-06 | 1997-03-19 | Lg电子株式会社 | Point-type radio controller using infrared rays |
| CN101707671A (en) * | 2009-11-30 | 2010-05-12 | 杭州普维光电技术有限公司 | Panoramic camera and PTZ camera combined control method and panoramic camera and PTZ camera combined control device |
| CN101790070A (en) * | 2010-02-25 | 2010-07-28 | 电子科技大学 | Design of novel wireless video communication system |
| CN101860732A (en) * | 2010-06-04 | 2010-10-13 | 天津市亚安科技电子有限公司 | Method of controlling holder camera to automatically track target |
| CN101866215A (en) * | 2010-04-20 | 2010-10-20 | 复旦大学 | Human-computer interaction device and method adopting eye tracking in video monitoring |
| CN201629024U (en) * | 2009-12-21 | 2010-11-10 | 马胜利 | Wireless fatigue alarm instrument |
| CN101888534A (en) * | 2009-05-12 | 2010-11-17 | 胡伟强 | Flight image pick-up system |
| DE102011083184A1 (en) * | 2010-09-24 | 2012-03-29 | Denso Corporation | Rear parking assistance device for vehicle, has display control unit controlling display device and producing right and left side view images in correspondence with respective right and left side recording images |
-
2013
- 2013-01-21 CN CN201310022617.9A patent/CN103108126B/en not_active Expired - Fee Related
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1145501A (en) * | 1995-04-06 | 1997-03-19 | Lg电子株式会社 | Point-type radio controller using infrared rays |
| CN101888534A (en) * | 2009-05-12 | 2010-11-17 | 胡伟强 | Flight image pick-up system |
| CN101707671A (en) * | 2009-11-30 | 2010-05-12 | 杭州普维光电技术有限公司 | Panoramic camera and PTZ camera combined control method and panoramic camera and PTZ camera combined control device |
| CN201629024U (en) * | 2009-12-21 | 2010-11-10 | 马胜利 | Wireless fatigue alarm instrument |
| CN101790070A (en) * | 2010-02-25 | 2010-07-28 | 电子科技大学 | Design of novel wireless video communication system |
| CN101866215A (en) * | 2010-04-20 | 2010-10-20 | 复旦大学 | Human-computer interaction device and method adopting eye tracking in video monitoring |
| CN101860732A (en) * | 2010-06-04 | 2010-10-13 | 天津市亚安科技电子有限公司 | Method of controlling holder camera to automatically track target |
| DE102011083184A1 (en) * | 2010-09-24 | 2012-03-29 | Denso Corporation | Rear parking assistance device for vehicle, has display control unit controlling display device and producing right and left side view images in correspondence with respective right and left side recording images |
Cited By (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103533247A (en) * | 2013-10-22 | 2014-01-22 | 小米科技有限责任公司 | Self-photographing method, device and terminal equipment |
| CN105516577A (en) * | 2014-09-24 | 2016-04-20 | 深圳Tcl数字技术有限公司 | Camera shooting control method and system |
| CN105516577B (en) * | 2014-09-24 | 2018-11-16 | 深圳Tcl数字技术有限公司 | Camera filming control method and system |
| CN104378587A (en) * | 2014-10-27 | 2015-02-25 | 小米科技有限责任公司 | Camera equipment control method, device and equipment |
| CN108366206A (en) * | 2015-06-11 | 2018-08-03 | 广东欧珀移动通信有限公司 | A kind of image pickup method and system based on rotating camera and intelligent glasses |
| CN108366206B (en) * | 2015-06-11 | 2020-08-18 | Oppo广东移动通信有限公司 | Shooting method and system based on rotary camera and intelligent glasses |
| CN106341641A (en) * | 2015-07-10 | 2017-01-18 | 小米科技有限责任公司 | Video communication method and device |
| CN105376554A (en) * | 2015-12-04 | 2016-03-02 | 深圳市第六星设计技术有限公司 | 3D camera mechanism, mobile device with the mechanism and control method |
| CN105376554B (en) * | 2015-12-04 | 2017-07-18 | 深圳市第六星设计技术有限公司 | 3D cameras mechanism, the mobile device with the mechanism and control method |
| CN105786179A (en) * | 2016-02-26 | 2016-07-20 | 广东欧珀移动通信有限公司 | Terminal, imaging device, interaction system and control method and device of terminal, imaging device and interaction system |
| CN105791675A (en) * | 2016-02-26 | 2016-07-20 | 广东欧珀移动通信有限公司 | Terminal, imaging and interaction control method and device, and terminal and system thereof |
| CN105721820B (en) * | 2016-03-29 | 2018-10-30 | 佛山市南海区广工大数控装备协同创新研究院 | A kind of interaction long-distance video communication system |
| CN105721820A (en) * | 2016-03-29 | 2016-06-29 | 佛山市南海区广工大数控装备协同创新研究院 | Interactive remote video communication system |
| CN105721821A (en) * | 2016-04-01 | 2016-06-29 | 宇龙计算机通信科技(深圳)有限公司 | Video calling method and device |
| CN108270986A (en) * | 2016-12-30 | 2018-07-10 | 中兴通讯股份有限公司 | A kind of cradle head control and processing method, device, system, electronic equipment |
| WO2018129664A1 (en) * | 2017-01-10 | 2018-07-19 | 深圳市柔宇科技有限公司 | Display content adjustment method and system, and head-mounted display device |
| CN107124589A (en) * | 2017-05-24 | 2017-09-01 | 武汉大学 | 360 degree of immersion Active Eyes and method based on Cardboard |
| CN108900770A (en) * | 2018-07-17 | 2018-11-27 | 广东小天才科技有限公司 | A kind of method, apparatus, smartwatch and the mobile terminal of the rotation of control camera |
| CN108900770B (en) * | 2018-07-17 | 2021-01-22 | 广东小天才科技有限公司 | Method and device for controlling rotation of camera, smart watch and mobile terminal |
| CN110798609A (en) * | 2018-08-02 | 2020-02-14 | 光宝电子(广州)有限公司 | Image display method, image display system and virtual window |
| CN108834002A (en) * | 2018-08-17 | 2018-11-16 | 袁森 | A kind of method that can remotely adjust mobile terminal image frame |
| CN110177285A (en) * | 2019-05-29 | 2019-08-27 | 王子君 | Live broadcasting method, device, system and dollying head |
| CN113497910A (en) * | 2020-04-01 | 2021-10-12 | 南宁富桂精密工业有限公司 | Video system and picture generation method thereof |
| CN111953936A (en) * | 2020-07-21 | 2020-11-17 | 福建升腾资讯有限公司 | Adjustable camera system and method for self-service equipment |
| CN114005313A (en) * | 2021-01-12 | 2022-02-01 | 深圳动魅科技有限公司 | Motion interaction equipment and control method thereof |
| CN114005313B (en) * | 2021-01-12 | 2024-01-16 | 深圳动魅科技有限公司 | Motion interaction equipment and control method thereof |
| CN114040106A (en) * | 2021-11-17 | 2022-02-11 | 维沃移动通信有限公司 | Video call control method and device, electronic equipment and readable storage medium |
| CN114205669A (en) * | 2021-12-27 | 2022-03-18 | 咪咕视讯科技有限公司 | Free visual angle video playing method and device and electronic equipment |
| CN114205669B (en) * | 2021-12-27 | 2023-10-17 | 咪咕视讯科技有限公司 | Free view video playing method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103108126B (en) | 2017-08-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103108126A (en) | Video interactive system, method, interactive glasses and terminals | |
| US10757423B2 (en) | Apparatus and methods for compressing video content using adaptive projection selection | |
| US20200322532A1 (en) | Head-mountable display system | |
| US20150358539A1 (en) | Mobile Virtual Reality Camera, Method, And System | |
| US20170118458A1 (en) | Stereo viewing | |
| CN109076255A (en) | The method for sending 360 degree of videos, the method for receiving 360 degree of videos, the equipment for sending 360 degree of videos, the equipment for receiving 360 degree of videos | |
| CN103716611B (en) | The apparatus and method for three-dimensional video-frequency with motion sensor | |
| WO2017139789A1 (en) | Systems and methods for spatially adaptive video encoding | |
| CN106658011A (en) | Panoramic video coding and decoding methods and devices | |
| CN106454321A (en) | Panoramic video processing method, device and system | |
| EP3481067A1 (en) | Method, apparatus and stream for encoding/decoding volumetric video | |
| CN104065951B (en) | Video capture method, video broadcasting method and intelligent glasses | |
| US10977852B2 (en) | VR playing method, VR playing device, and VR playing system | |
| WO2018036112A1 (en) | Method and system for encoding/decoding panoramic video | |
| US20230217004A1 (en) | 360-degree virtual-reality system for dynamic events | |
| EP3695307A1 (en) | Method and apparatus for providing audio content in immersive reality | |
| WO2020206647A1 (en) | Method and apparatus for controlling, by means of following motion of user, playing of video content | |
| CN207397518U (en) | Wireless mobile objects projection system | |
| WO2018091770A1 (en) | Method for multi-camera device | |
| US20130113879A1 (en) | Multi-Depth Adaptation For Video Content | |
| GB2565836A (en) | Data processing | |
| CN109479147B (en) | Method and technical device for inter-temporal view prediction | |
| CN111147840A (en) | Automatic control and communication system for video and audio acquisition of 3D camera rocker arm | |
| TWI746463B (en) | Virtual reality apparatus | |
| CN206193344U (en) | Support projecting apparatus of VR technique |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170825 |