CN104216506A

CN104216506A - Data interaction method and device based on gesture operation

Info

Publication number: CN104216506A
Application number: CN201310210380.7A
Authority: CN
Inventors: 廉士国; 胡昌启; 姚峻
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2013-05-30
Filing date: 2013-05-30
Publication date: 2014-12-17
Anticipated expiration: 2033-05-30
Also published as: CN104216506B

Abstract

The invention discloses a data interaction method and device based on gesture operation, and belongs to the technical field of communication. The data interaction method and device are designed to solve the problem that the data interaction process in the prior art is poor in convenient level and low in user-friendly degree. The data interaction method based on the gesture operation comprises the steps that the to-be-sent target determining gesture operation executed by a user is obtained, and a terminal corresponding to the to-be-sent target determining gesture operation is adopted as a sending side; the sending gesture operation executed by the user is obtained, and a terminal corresponding to the sending gesture operation is adopted as a receiving side; the sending side sends data needing to be sent to the receiving side.

Description

Based on data interactive method and the device of gesture operation

Technical field

The present invention relates to communication technical field, particularly relate to a kind of data interactive method based on gesture operation and device.

Background technology

Along with the development of the communication technology, between terminal and terminal, the mode of operation of data interaction is also more and more abundanter, and user also promotes gradually for the convenient degree of mode of operation and the requirement of hommization degree.

Between existing terminal, data can, by sensor set in terminal, such as, by the content that the direct photographed data of camera is shown on the display screen of another terminal, thus make to obtain the data in another terminal between terminal alternately; Or the network set up between terminal with terminal is connected, such as bluetooth or adopting wireless fidelity technology (Wireless Fidelity, hereinafter referred to as WiFi) etc., using a terminal as transmitting terminal, and manually choose on transmitting terminal and to be in another terminal in same network with this transmitting terminal as receiving end, afterwards, user operation transmitting terminal chooses the data needing to send, and operate receiving end and receive this data, complete the data interaction between terminal and terminal.

When carrying out data interaction between above-mentioned terminal, user needs to carry out multi-pass operations in terminal, such as, carry out clicking with complete operation, for user in terminal, such complex operation and mechanization, thus reduce convenient degree and the hommization degree of data interaction between terminal.

Summary of the invention

Embodiments of the invention provide a kind of data interactive method based on gesture operation and device, easily, hommization can be completed the data interaction between terminal and terminal by the gesture operation of user.

For achieving the above object, embodiments of the invention adopt following technical scheme:

First aspect, the invention provides a kind of data interactive method based on gesture operation, comprising:

Obtain the determination target gesture operation pending that user performs, determine that terminal corresponding to target gesture operation pending is as transmitting terminal using described;

Obtain the transmission gesture operation that user performs, using the terminal corresponding to described transmission gesture operation as receiving end;

Described transmitting terminal is made to be sent to described receiving end by needing the data sent

In conjunction with a first aspect of the present invention, in the first possible embodiment of a first aspect of the present invention, described in make described transmitting terminal by need send data be sent to described receiving end, comprising:

Described transmitting terminal is made to send Trigger message to described receiving end;

Make described receiving end send feedback message according to described Trigger message to described transmitting terminal, described feedback message is for notifying that described transmitting terminal sends the described data needing to send to described receiving end;

Make the transmitting terminal receiving described feedback message that the described data sent that need are sent to described receiving end.

In conjunction with a first aspect of the present invention, in the implementation that the second of a first aspect of the present invention is possible, at the determination target gesture operation to be sent that described acquisition user performs, determine that terminal corresponding to target gesture operation to be sent is as after transmitting terminal, also comprises using described:

Described transmitting terminal is made to broadcast Trigger message;

At the transmission gesture operation that described acquisition user performs, using the terminal corresponding to described transmission gesture operation as after receiving end, also comprise:

Make the receiving end receiving described Trigger message, send feedback message according to described Trigger message to described transmitting terminal, described feedback message is for notifying that described transmitting terminal sends the described data needing to send to described receiving end.

In conjunction with the implementation that the second of a first aspect of the present invention is possible, in the third possible implementation of a first aspect of the present invention, described in make described transmitting terminal by need send data be sent to described receiving end, be specially:

In conjunction with the third possible implementation of a first aspect of the present invention, in the 4th kind of possible implementation of a first aspect of the present invention, after making described transmitting terminal broadcast Trigger message, also comprise:

Record the very first time that described transmitting terminal broadcasts described Trigger message;

Record obtains the second time receiving gesture operation;

Describedly make the receiving end receiving described Trigger message, send feedback message according to described Trigger message to described transmitting terminal, be specially:

When the time difference of the described very first time and described second time is not more than Preset Time difference, then the transmitting terminal making described receiving end be not more than described Preset Time difference to described time difference sends feedback message;

When the time difference of the described very first time and described second time is greater than Preset Time difference, then the transmitting terminal stopping described receiving end to be greater than described Preset Time difference to described time difference sends feedback message.

In conjunction with any one possible implementation of a first aspect of the present invention and first aspect, in the 5th kind of possible implementation of a first aspect of the present invention, the determination target gesture operation to be sent that described acquisition user performs, determine that terminal corresponding to target gesture operation to be sent is as transmitting terminal, comprising using described:

Obtain described the first physical message mark determining the terminal selected by target gesture operation to be sent, wherein, a corresponding terminal of physical message mark;

Inquire about according to described first physical message mark, using the terminal corresponding to described first physical message mark as described transmitting terminal;

The transmission gesture operation that described acquisition user performs, using the terminal corresponding to described transmission gesture operation as receiving end, comprising:

Obtain the second physical message mark of the terminal selected by described transmission gesture operation;

Inquire about according to described second physical message mark, using the terminal corresponding to described second physical message mark as described receiving end.

In conjunction with the 5th kind of possible implementation of a first aspect of the present invention, in the 6th kind of possible implementation of a first aspect of the present invention, inquire about according to described first physical message mark described, using the terminal corresponding to described first physical message mark as after described transmitting terminal, also comprise:

Determine target gesture operation to be sent according to described, obtain in described transmitting terminal the data needing to send.

In conjunction with the 6th kind of possible implementation of a first aspect of the present invention, in the 7th kind of possible implementation of a first aspect of the present invention, determine target gesture operation to be sent described according to described, after obtaining in described transmitting terminal the data needing to send, also comprise:

Mark needing the data sent described in described transmitting terminal.

In conjunction with the 5th kind of possible implementation of a first aspect of the present invention, in the 8th kind of possible implementation of a first aspect of the present invention, described mark according to described second physical message is inquired about, using the terminal corresponding to described second physical message mark as after receiving end, also comprise:

Obtain the display position that described transmission gesture operation is selected on described receiving end;

After the data making described transmitting terminal by needs transmission are sent to described receiving end, also comprise:

Make described receiving end in the described data needing to send of described display position display.

Second aspect, the invention provides a kind of data interaction device based on gesture operation, comprising:

Using described, transmitting terminal selection unit, for obtaining the determination target gesture operation to be sent that user performs, determines that terminal corresponding to target gesture operation to be sent is as transmitting terminal;

Receiving end selection unit, for obtaining the transmission gesture operation that user performs, using the terminal corresponding to described reception transmit operation as receiving end;

Data transmission unit, is sent to described receiving end for making described transmitting terminal by needing the data sent.

In conjunction with a second aspect of the present invention, in the first possible embodiment of a second aspect of the present invention, described data transmission unit, comprising:

Trigger module, sends Trigger message for making described transmitting terminal to described receiving end;

Feedback module, for making described receiving end send feedback message according to described Trigger message to described transmitting terminal, described feedback message is for notifying that described transmitting terminal sends the described data needing to send to described receiving end;

The described data sent that need are sent to described receiving end for making the transmitting terminal receiving described feedback message by sending module.

In conjunction with a second aspect of the present invention, in the implementation that the second of a second aspect of the present invention is possible, described device, also comprises:

Triggering radio unit, broadcasting Trigger message for making described transmitting terminal;

Broadcast feedback unit, for making the receiving end receiving described Trigger message, sends feedback message according to described Trigger message to described transmitting terminal, and described feedback message is for notifying that described transmitting terminal sends the described data needing to send to described receiving end.

In conjunction with the implementation that the second of a second aspect of the present invention is possible, in the third possible implementation of a second aspect of the present invention, the described data sent that need are sent to described receiving end specifically for making the transmitting terminal receiving described feedback message by described data transmission unit.

In conjunction with the implementation that the second of a second aspect of the present invention is possible, in the 4th kind of possible implementation of a second aspect of the present invention, described device, also comprises:

Clock unit, broadcasts the very first time of described Trigger message for recording described transmitting terminal; Record obtains the second time sending gesture operation;

Described broadcast feedback unit, specifically for when the time difference of the described very first time and described second time is not more than Preset Time difference, then the transmitting terminal making described receiving end be not more than described Preset Time difference to described time difference sends feedback message;

Described device, also comprises:

Stop element, for when the time difference of the described very first time and described second time is greater than Preset Time difference, then the transmitting terminal stopping described receiving end to be greater than described Preset Time difference to described time difference sends feedback message.

In conjunction with any one possible implementation of a second aspect of the present invention and second aspect, in the 5th kind of possible implementation of a second aspect of the present invention, described transmitting terminal selection unit, comprising:

First acquisition module, for obtaining described the first physical message mark determining the terminal selected by target gesture operation pending, wherein, a corresponding terminal of physical message mark;

First enquiry module, for inquiring about according to described first physical message mark, using the terminal corresponding to described first physical message mark as described transmitting terminal;

Described receiving end selection unit, comprising:

Second acquisition module, for obtaining the second physical message mark of the terminal selected by described transmission gesture operation;

Second enquiry module, for inquiring about according to described second physical message mark, using the terminal corresponding to described second physical message mark as described receiving end.

In conjunction with the 5th kind of possible implementation of a second aspect of the present invention, in the 6th kind of possible implementation of a second aspect of the present invention, described transmitting terminal selection unit, also comprises:

Data selecting module, for determining target gesture operation pending according to described, obtains in described transmitting terminal the data needing to send.

In conjunction with the 6th kind of possible implementation of a second aspect of the present invention, in the 7th kind of possible implementation of a second aspect of the present invention, described device, also comprises:

Mark unit, for need described in described transmitting terminal send data mark.

In conjunction with the 7th kind of possible implementation of a second aspect of the present invention, in the 8th kind of possible implementation of a second aspect of the present invention, described receiving end selection unit, also comprises:

Display position acquisition module, for obtaining described transmission gesture operation display position selected on described receiving end;

Described device, also comprises:

Fixed point display unit, for making described receiving end in the described data needing to send of described display position display.

A kind of data interactive method based on gesture operation that the embodiment of the present invention provides and device, by user to the target gesture operation pending of the determination performed by different terminals and transmission gesture operation, transmitting terminal and receiving end is determined in multiple terminal, transmitting terminal is made to be transferred to receiving end by needing the data sent, transmitting terminal and receiving end is selected respectively with the gesture operation higher by hommization degree, and by the data transmission between this gesture operation triggering terminal, thus avoid that user carries out in terminal loaded down with trivial details, the operation of machinery, improve convenient degree and the hommization degree of data interaction between terminal.

Accompanying drawing explanation

In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, below the accompanying drawing used required in describing embodiment is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.

Fig. 1 is the process flow diagram of a kind of data interactive method based on gesture operation of the present invention;

Fig. 2 is the structural representation realizing a kind of system of the data interactive method based on gesture operation of the present invention;

Fig. 3 is a kind of enforcement scene schematic diagram based on carrying out sending gesture operation in the data interactive method of gesture operation to the terminal as transmitting terminal of the present invention;

Fig. 4 is the enforcement scene schematic diagram of a kind of data interactive method based on gesture operation of the present invention, wherein terminal surrounding is provided with physical message mark;

Fig. 5 is a kind of schematic diagram based on carrying out receiving gesture operation in the data interactive method of gesture operation to the terminal as transmitting terminal of the present invention;

Fig. 6 is the structural representation realizing a kind of system of the data interactive method based on gesture operation described in the embodiment of the present invention 1;

Fig. 7 is the process flow diagram of a kind of data interactive method based on gesture operation described in the embodiment of the present invention 1;

Fig. 8 performs for realizing described in the embodiment of the present invention 1 is a kind of the enforcement scene schematic diagram sending gesture operation based on user in the data interactive method of gesture operation;

Fig. 9 performs for realizing described in the embodiment of the present invention 1 is a kind of the enforcement scene schematic diagram receiving gesture operation based on user in the data interactive method of gesture operation;

Figure 10 is for realizing a kind of schematic diagram based on completing data interaction in the data interactive method of gesture operation described in the embodiment of the present invention 1;

Figure 11 is the structural representation realizing a kind of system of the data interactive method based on gesture operation described in the embodiment of the present invention 2;

Figure 12 performs for realizing described in the embodiment of the present invention 2 is a kind of the enforcement scene schematic diagram sending gesture operation based on user in the data interactive method of gesture operation;

Figure 13 is a kind of described in the embodiment of the present invention 2 process flow diagram of the data interactive method based on gesture operation;

Figure 14 performs for realizing described in the embodiment of the present invention 2 is a kind of the enforcement scene schematic diagram receiving gesture operation based on user in the data interactive method of gesture operation;

Figure 15 is the process flow diagram of a kind of data interactive method based on gesture operation described in the embodiment of the present invention 3;

Figure 16 is the schematic diagram of the data selection operation described in the embodiment of the present invention 3;

Figure 17 is the schematic diagram of the labeled data described in the embodiment of the present invention 3;

Figure 18 is the schematic diagram of the display position selection operation described in the embodiment of the present invention 3;

Figure 19 realizes the system schematic of the data interactive method based on gesture operation for a kind of described in the embodiment of the present invention 4;

Figure 20 is the structural representation of a kind of data interaction device based on gesture operation described in the embodiment of the present invention;

Figure 21 is the structural representation realizing a kind of terminal of the data interactive method based on gesture operation described in the embodiment of the present invention;

Figure 22 is the structural representation realizing a kind of server of the data interactive method based on gesture operation described in the embodiment of the present invention.

Embodiment

Below in conjunction with accompanying drawing, a kind of data interactive method based on gesture operation of the embodiment of the present invention and device are described in detail.

Should be clear and definite, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.

The invention provides a kind of data interactive method based on gesture operation, as shown in Figure 1, comprising:

S101, obtain the determination target gesture operation to be sent that user performs, using the terminal determined corresponding to target gesture operation to be sent as transmitting terminal.

In order to complete the data interaction undertaken by gesture operation, there is a system, within the system, as shown in Figure 2, can be provided with a server 10 and two terminals 30,40, setting up between this server 10 and two terminals 30,40 has connection.This server 10 is connected with action recognition device 20; This action recognition device 20, needs covering two terminals 30,40 and the movable scope of user, with complete recording user to the gesture operation performed by terminal 30,40, and action recognition device 20 in the drawings.

Terminal 30, 40 can be PC (Personal Computer, hereinafter referred to as PC), personal digital assistant (Personal Digital Assistant, hereinafter referred to as PDA), mobile phone and panel computer etc., as long as multiple terminal can be connected to same network thus realize data interaction, wherein, this connection can be wired connection, also can be wireless connections, this is not restricted, here the data of indication comprise and can play in the terminal, the data of display and/or editor etc., such as, picture, video, document etc., this is not restricted.

Before carrying out the data interaction between terminal, start server 10, terminal 30 and terminal 40 respectively, user can use terminal 30 or terminal 40 normally; Terminal 30 and terminal 40 are registered respectively in server 10, namely, the terminal iidentification of terminal 30 and terminal 40 is stored in server 10, when server 10 receives the data that terminal 30,40 sends, can realize by this data retransmission in the terminal of correspondence, or the data that the direct receiving terminal 30,40 of server 10 forwards.Now, when user needs to carry out the data interaction between terminal, be shown on the display screen of terminal by needing the data sent, such as use user in the process of terminal 30, the image data of in terminal 30 is needed to send to terminal 40, then first user U makes terminal 30 show this picture, this picture is the data needing to send, as shown in Figure 3, now, in order to by this picture transfer to terminal 40, user U is needed to carry out gesture operation to terminal 30 in the coverage of action recognition device 20, it should be noted that, user U can by input equipment set in terminal 30, such as by mouse, keyboard selectes picture shown on a display screen, also can be identified by the gesture operation of the first-class action recognition device of shooting to user U set by terminal 30 or server 10, and make terminal 30 show data on its display screen based on identified gesture operation.

After action recognition device 20 collects the gesture operation of user U, resolved this gesture operation by server 10, this gesture operation is made up of with key elements such as the changes of the movement of hand, static and hand-type in the coverage of action recognition device 20 user U; For a gesture operation, can comprise multiple discernible operation, by multiple discernible operation, server 10 can perform multiple function.In the process of resolving, need to make respectively server 10 know this gesture operation for execution object and the execution object of this gesture operation.For example, when action recognition device 20 is camera, this camera can gather the image in covered scope, now, in the scope that camera covers, can by terminal 30, 40 positions of placing are relatively fixing, so, just two terminals 30 can be prestored in server 10 (at this server not shown of outdoor scene as in Figure 3-5), 40 positional informations in gathered image, be understandable that, terminal 30, the positional information of 40 can as terminal 30, the physical message mark of 40, thus to terminal 30, 40 indicate, wherein, a corresponding terminal of physical message mark.When user U performs gesture operation to terminal 30, obtain the position residing for hand of user U, when user U hand residing for position close to server 10 in the image that prestores during the positional information of terminal 30, server 10 just can determine that user U is performing gesture operation to terminal 30.

It should be noted that, judge user gesture operation for object time, be not limited to above-mentioned mode, as shown in Figure 4, when action recognition device 20 is camera, Sign Board 30A can be placed identify as the physical message of terminal 30 on the position of terminal 30, and on the position of terminal 40, place Sign Board 40A identify as the physical message of terminal 40, wherein can find out, sequence number " 1 " is marked with at Sign Board 30A, sequence number " 2 " is marked with at Sign Board 40A, and in server 10, store the corresponding relation of sequence number " 1 " with terminal 30 and the corresponding relation of sequence number " 2 " and terminal 40 respectively, so, even if move terminal 30 arbitrarily in the acquisition range of camera, 40 thus when changing its position, also can by the image gathered as the camera of action recognition device 20, server 10 is made to determine the position of each terminal, thus make server 10 know the gesture operation of user U for be which terminal.Certainly, on Sign Board mark picture sequence number be not limited to numeral, also can be a kind of, wherein two kinds or three kinds the combination in any in letter, symbol, icon, bar code, Quick Response Code etc., you need to add is that in addition, Sign Board is the form of a kind of physical message mark, and physical message mark also can be set to different forms.Such as, this physical message mark can also be the shape of terminal, such as in Figure 3-5, terminal 30 is rectangular structure, terminal 40 is that platy structure just can by identifying as the camera of action recognition device 20, similar, terminal also can identify from modes such as different sizes, such as, have the mobile phone of different size, panel computer and PC etc.In addition, this physical message mark also can not be identified by action recognition device 20, such as can signalization emitter on user and terminal respectively, and a signal receiving device is connected with server, server determines the position of terminal and user respectively by the signal receiving different sender units in real time and send over, and when action recognition device receives the gesture operation of user's execution, judge with the immediate terminal of user, by this terminal as gesture operation for terminal.Therefore, based on technology well known to those skilled in the art, also by other mode make server know the gesture operation of user for terminal, this is not restricted.

Server 10 except need to know gesture operation for terminal except, when server 10 processes the image that the camera as action recognition device 20 gathers, need to know the meaning of user U to the gesture operation performed by terminal 30.The meaning of user for the gesture operation performed by terminal is determined in order to make server 10, need to prestore some groups of gestures in server 10, such as store two groups of gestures, first group of gesture is that hand is clenched fist from opening up into, second group of gesture is that hand opens from clenching fist to, wherein first group of gesture be similar to grasping movement can as the gesture operation for determining target to be sent, namely target gesture operation to be sent is determined, second group of gesture is similar to release movement and as the gesture operation for pointing out transmitting terminal to send data, namely can sends gesture operation.When camera frame by frame gathers image, server 10 can record image in certain frame number and real-time renewal, such as 30 frames, when the hand first occurring opening in this 30 frame and rear there is the image of the hand of clenching fist time, just can determine that user is determining target gesture operation to be sent to terminal 30 execution, by this terminal 30 as the transmitting terminal in data exchange process, it is appreciated of course that, the frame number recorded in server 10 is 30 frames incessantly, and the quantity of the frame number of this record can be arranged according to the situation of reality.

Now, data are obtained in order to the mutual needs completing data make another terminal as receiving end know from which end, then obtain after user U determines target gesture operation to be sent to the terminal 30 as transmitting terminal, using terminal 30 as the transmitting terminal that will send data at server 10.

It should be noted that, because be applicable to the entity of the data interactive method based on gesture operation, be not limited to above-mentioned system, namely obtain without the need to server and notify transmitting terminal.Such as, an action recognition device can be set for each terminal, by it for terminal carries out the collection of gesture operation, and inform that terminal is as transmitting terminal or receiving end, now, terminal as transmitting terminal needs outwards to broadcast Trigger message, and this Trigger message for setting up the connection between the terminal as transmitting terminal and the terminal as receiving end, and notifies that this transmitting terminal of other-end is ready for sending data.Therefore, in Trigger message, service set (the Service Set Identifier of transmitting terminal can be comprised, hereinafter referred to as SSID), physical address or Internet protocol (Internet Protocol, hereinafter referred to as IP) address etc., certainly, set up the difference of the agreement of network according to system, also can be the information of other marking terminals, this is not restricted.

It should be noted that, determine target gesture operation to be sent and send gesture operation, be not limited to two groups of above-mentioned defined gesture operations, also the gesture operation of other modes can be stored according to the actual needs, such as using the gesture operation swung as determining target gesture operation to be sent, using the gesture operation of swing as transmission gesture operation.

The transmission gesture operation that S102, acquisition user perform, using the terminal corresponding to transmission gesture operation as receiving end.

After server 10 determines the terminal 30 as transmitting terminal, as shown in Figure 5, user U can move to the position of terminal 40 correspondence in the coverage of action recognition device 20, and carries out transmission gesture operation.Now, the position of server 10 residing for the positional information of the terminal 40 stored and user U compares, thus determine user U send gesture operation for object, by terminal 40 as receiving end.

It should be noted that, determining target gesture operation to be sent and sending the gesture that can comprise multiple implication in gesture operation, perform multiple function to make server by a gesture operation.

Determine that target gesture operation to be sent can comprise: transmitting terminal selects operation, data selection operation and targeting operations; Wherein, transmitting terminal selection operation may be used for selecting terminal, this terminal can be one also can be multiple, this transmitting terminal select operation form can such as by action recognition device 20 judge user U hand towards determining terminal, also can determine by the palm paddling of user U multiple terminals of determining in a paddling region wherein to comprise, at this, concrete restriction is not done for the mode and quantity selecting terminal; Data transmit operation is consistent with above-mentioned first group of gesture operation, the terminal selected by operation is selected to be defined as transmitting terminal transmitting terminal, in addition, in other implementations, targeting operations also can control as the terminal clean culture of transmitting terminal, multicast or broadcast Trigger message, to notify the terminal of determined receiving end or to need to carry out data interaction as the terminal of the surrounding of the terminal of transmitting terminal.

In addition, send gesture operation, comprising: receiving end selects operation, display position selects operation and send notice operation; Wherein, receiving end selects operation to select class of operation seemingly with above-mentioned transmitting terminal, can select some terminals, prepares against as the receiving end corresponding with transmitting terminal; Display position selects operation, and for determining the display position of these data after the data that transmitting terminal sends, this display position selects operation, can determine display position, but be not limited thereto by the sensing pointed; Send notice operation, consistent with above-mentioned second group of gesture, select the terminal selected by operation to be defined as receiving end receiving end; In other implementations, this targeting operations also terminal that can control as receiving end feeds back feedback message to transmitting terminal, to notify that transmitting terminal sends the data needing to send to receiving end, completes data interaction.

S103, make transmitting terminal by need send data be sent to receiving end.

After server 10 detects the determination target gesture operation to be sent that user U carries out the terminal 30 as transmitting terminal and the terminal as receiving end 40 respectively and transmission gesture operation, server 10 has known the transmitting terminal needing to send data and the receiving end receiving data, now, server 10 directly can notify that transmitting terminal sends to receiving end, to complete the mutual of data by needing the data sent.

Or, in other implementations, also can after determining transmitting terminal and receiving end, notify that transmitting terminal sends Trigger message to receiving end respectively, and notify that receiving end sends feedback message for Trigger message to transmitting terminal, thus make to connect between transmitting terminal and receiving end, send to receiving end by needing the data sent in transmitting terminal.In addition, also can after determining transmitting terminal and receiving end, transmitting terminal is made to broadcast Trigger message immediately, after determining receiving end, the Trigger message of receiving end by receiving, sends the feedback message for this Trigger message to transmitting terminal, so, just can connect between transmitting terminal and receiving end, and the picture as the data needing transmission is sent to receiving end from transmitting terminal, and show.

Wherein, the connection set up be based on institute in system according to procotol complete, and the Trigger message that transmitting terminal and receiving end send and feedback message same based on corresponding procotol, at this, concrete form for Trigger message and feedback message does not do concrete restriction, only need to complete establishment of connection between transmitting terminal and receiving end by Trigger message and feedback message, and notify that transmitting terminal and receiving end need to carry out data interaction.

After the data that needs send are sent to receiving end by transmitting terminal, receiving end can directly in the data that its display screen display receives, the display position that also can perform according to user selects the determined display position of operation, this display position shows the data that receiving end receives, can select according to the difference implementing scene at this, this is not restricted.

In addition, transmitting terminal is by when needing the data sent to send to receiving end, the process of process and receiving end reception data that transmitting terminal sends data can be realized by special efficacy, such as these data can be flown out transmitting terminal display screen and fly into the display screen of receiving end or carry out sending in the mode of transmitting terminal and receiving end playing animation and reception etc., do not do concrete restriction at this.

It should be noted that, in system shown in above-mentioned Fig. 2, server is only one and schematically illustrates, also can be realized by a terminal, only need this terminal can gather the gesture operation of user, with transmission gesture operation, the gesture operation obtained is identified by the determination target gesture operation to be sent wherein stored, and notify that the corresponding terminal as transmitting terminal and the terminal as receiving end carry out data interaction by the determination target gesture operation to be sent after identifying with transmission gesture operation.

In addition, above-mentioned process also can be completed by the terminal as transmitting terminal and the terminal as receiving end respectively, now, then need each terminal in the system of being respectively that an action recognition device is set, and prestore in each terminal identify gesture operation time necessary determine target gesture operation to be sent and send gesture operation.When terminal detects that user determines target gesture operation to be sent to it, then based on obtained to determining target gesture operation to be sent, using self as transmitting terminal, and outwards broadcast Trigger message, and according to receiving the feedback message fed back as the terminal of receiving end, to sending the data needing to send as receiving end; When terminal detects that user carries out transmission gesture operation to it, then based on obtained to transmission gesture operation using self as receiving end, using receive after the Trigger message that the terminal of transmitting terminal sends, feedback message is sent to as transmitting terminal, and the data that receiving end/sending end sends.

What need explanation further is, when there is multiple terminal in system, when sending Trigger message by the mode of broadcast, the Trigger message of broadcast can be received by multiple terminal, if and user operates multiple terminal as transmitting terminal respectively, so, the multiple terminals in system can receive the Trigger message that multiple transmitting terminal sends respectively.Which now, then need as by feeding back Trigger message as the terminal of receiving end or server determination receiving end.

Therefore, can containing the very first time as record Trigger message transmitting time in Trigger message, this very first time can be sent to server or other-end along with Trigger message, and server or other-end carry out record to this very first time; Further, after server or other-end obtain transmission gesture operation by action recognition device, second time obtained when receiving gesture operation can be recorded; Server or other-end pass through the size of the comparison very first time and the second time, using the terminal of time difference within certain limit as receiving end, thus make this receiving end send feedback message to transmitting terminal, to set up the connection between transmitting terminal and receiving end, and upon establishment of a connection, transmitting terminal will need the data sending terminal receiving end sent.

Be understandable that, in time carrying out by server the control sending and receive, also can gather in the process determining target gesture operation to be sent and transmission gesture operation respectively by server, record the very first time and the second time respectively, and according to the time difference preset comparing the time difference of the very first time and the second time, and whether send feedback message for this Trigger message according to the result notice receiving end compared, thus further improve the hommization degree based on the data interactive method of gesture operation.

A kind of data interactive method based on gesture operation that the embodiment of the present invention provides, by user to the target gesture operation to be sent of the determination performed by different terminals and transmission gesture operation, transmitting terminal and receiving end is determined in multiple terminal, transmitting terminal is made to be transferred to receiving end by needing the data sent, transmitting terminal and receiving end is selected respectively with the gesture operation higher by hommization degree, and by the data transmission between this gesture operation triggering terminal, thus avoid that user carries out in terminal loaded down with trivial details, the operation of machinery, improve convenient degree and the hommization degree of data interaction between terminal.

According to concrete enforcement scene, the data interactive method based on gesture operation of the present invention is described below, using this enforcement scene as embodiment 1, in embodiment 1, this system, as shown in Figure 6, server 11, the camera 21 as action recognition device be connected with this server 11, the terminal 31 as transmitting terminal and the terminal 41 as receiving end is comprised; Wherein user U operates terminal 31 and terminal 41 within the coverage 51 of camera 21, server 11, to be connected by wireless network between terminal 31 and terminal 41, server 11 gathers the gesture operation of user U execution by camera 21, and resolve, wherein, terminal 31 is PC, and terminal 41 is panel computer.It is to be understood that in order to make the scheme in this enforcement scene be easier to understand, size is exaggerated to some extent.

The data interactive method based on gesture operation described in the present embodiment, as shown in Figure 7, comprising:

S1, user perform gesture operation, and server is by this gesture operation of camera collection.

As shown in Figure 8, user U moves in the coverage 51 of camera 21 specific embodiment of the invention scene, performs and send gesture operation before terminal 31.Camera 21 frame by frame carry out image acquisition, and send to server 11 to process collected image.

In the process of camera 21 collection image frame by frame, arrange server 11 and record the 1st frame ... the 30th frame, the image in this 30 frame carries out the judgement of gesture operation.The collection carrying out image that camera 21 continues, now, such as, when collecting the 31st frame, server 11 just knows the content of the 1st frame, records the 31st frame, and continue by this way to record up-to-date 30 two field pictures collected after the 30th frame.

S20, server are resolved obtained gesture operation, judge that whether the gesture operation obtained is for determining target gesture operation to be sent.

Server 11 receives the image that camera 21 sends, and the gesture operation in image is resolved, result according to resolving judges whether the gesture operation performed by user U is consistent with the determination target to be sent gesture operation prestored in server 11, if it is step S21 is performed, if not then terminating to judge, continuing through camera 21 and gathering image.

The hand parsing user U when server 11 has first stopped a period of time around the first physical message mark 31A, and after this from open become clench fist time, the determination target to be sent gesture operation then can determined and prestore in server 11 is consistent, thus determines that user U performs and determine target gesture operation to be sent.

Now, if determine that this gesture operation is not determine target gesture operation to be sent or send gesture operation, then server 11 does not process.

S21, server obtain this transmitting terminal determining to comprise in target gesture operation to be sent and select operation and targeting operations.

Server 11, by determining the parsing that target gesture operation to be sent carries out, obtaining composition and determining that the transmitting terminal in target gesture operation to be sent selects operation and targeting operations.

S3, server select operation according to transmitting terminal, select the terminal as transmitting terminal.

In the process that server 11 is selected as the terminal of transmitting terminal, the following a few small step of concrete execution.

S30, server obtain the first physical message mark that transmitting terminal selects the terminal selected by operation.

Around terminal 31, be provided with the first physical message mark 31A, the first physical message mark 31A is for being decorated with the Sign Board of sequence number " 1 ".Wherein, the corresponding terminal of physical message mark, in the present embodiment, stores the corresponding relation that the corresponding relation of the first physical message mark 31A and terminal 31 and the second physical message identify 41A and terminal 41 in server 11.

When camera 21 detects determination that user performs target gesture operation to be sent, the hand of user U can stay for some time in the position that distance first physical message mark 31A is nearer; When in the image that the camera 21 of server 11 acquisition gathers, when the hand of user U stops more than 5 frame in the scope identifying 100 of 31A apart from the first physical message, then can determine that user U will determine target gesture operation to be sent to terminal 31, and the operation that the hand of user U stays for some time can be interpreted as that the transmitting terminal determined in target gesture operation to be sent selects operation.

S31, server are inquired about according to the first physical message mark, using the terminal corresponding to the first physical message mark as transmitting terminal.

After server 11 selects operation acquisition first physical message mark 31A by transmitting terminal, inquire about according to the sequence number " 1 " on the Sign Board as the first physical message mark 31A, what determine this sequence number " 1 " correspondence is terminal 31, now, server 11 just can using the terminal 31 corresponding to sequence number " 1 " as transmitting terminal.

S4, user perform gesture operation, and server is by this gesture operation of camera collection.

As shown in Figure 9, user U performs gesture operation before terminal 41.Camera 21 frame by frame carry out image acquisition, and send to server 11 to process collected image.

S50, server are resolved obtained gesture operation, judge whether the gesture operation obtained is send gesture operation.

Server 11 receives the image that camera 21 sends, and the gesture operation in image is resolved, result according to resolving judges whether the gesture operation performed by user U is consistent with the transmission gesture operation prestored in server 11, if it is step S61 is performed, if not then terminating to judge, continuing through camera 21 and gathering image.

The hand parsing user U when server 11 has first stopped one end time around the second physical message mark 41A, and become when opening after this from clenching fist, then can determine consistent with the transmission gesture operation prestored in server 11, thus determine that user U performs transmission gesture operation.

S51, server obtain the receiving end comprised in this transmission gesture operation and select operation and send notice operation.

The parsing of server 11 by carrying out transmission gesture operation, obtains the composition receiving end sent in gesture operation and selects to operate and send notice operation.

S6, server select operation according to receiving end, select the terminal as receiving end.

In the process that server 11 is selected as the terminal of receiving end, the following a few small step of concrete execution.

S60, server obtain the second physical message mark that receiving end selects the terminal selected by operation.

Around terminal 41, be provided with the second physical message mark 41A, the second physical message mark 41A is for being decorated with the Sign Board of sequence number " 2 ".

When in the image that the camera 21 of server 11 acquisition gathers, when the hand of user U stops more than 5 frame in the scope identifying 100 of 41A apart from the second physical message, then can determine that user U will carry out transmission gesture operation to terminal 41, and the operation that the hand of user U stays for some time can be interpreted as that the receiving end sent in gesture operation selects operation.

S61, server are inquired about according to the second physical message mark, using the corresponding terminal of the second physical message mark as receiving end.

After server 11 selects operation acquisition second physical message mark 41A by receiving end, inquire about according to the sequence number " 2 " on the Sign Board as the second physical message mark 41A, what determine this sequence number " 2 " correspondence is terminal 41, now, server 11 just can using the terminal 41 corresponding to sequence number " 2 " as receiving end.

S7, server are according to targeting operations, and notice transmitting terminal sends Trigger message to receiving end.

After determining the terminal 31 as transmitting terminal and the terminal 41 as receiving end, server 11 is according to obtained targeting operations and send notice operation, notification terminal 31 outwards sends Trigger message by wireless network, now, this Trigger message can be received by the terminal 41 as receiving end in system, but because terminal 41 receives the instruction of feeding back this Trigger message, so terminal 41 only receives this Trigger message at this moment.

S8, server are according to the operation of transmission notice, and notice receiving end sends feedback message to the transmitting terminal sending Trigger message.

After terminal 31 sends Trigger message to terminal 41, server 11 is according to obtained targeting operations, notification terminal 41, the Trigger message obtained based on terminal 41 sends feedback message to terminal 31, and namely notification terminal 31 is using as the terminal 41 of receiving end as the transmission target of data needing to send.

S9, according to Trigger message and feedback message, connect between transmitting terminal and receiving end, transmitting terminal is sent to described receiving end by needing the data sent.

When after the feedback message that the terminal 31 as transmitting terminal receives as the terminal 41 of receiving end, terminal 31 and terminal 41 connect, data shown on its display screen are sent to terminal 41 by terminal 31, and the display screen being presented at terminal 41 shows, as shown in Figure 10.

In above-mentioned system, multiple terminal can be provided with, with said system unlike, after server determination transmitting terminal, Trigger message can be broadcasted by transmitting terminal, and after server determination receiving end, feedback message can be sent to transmitting terminal based on Trigger message, to make between transmitting terminal and receiving end connecting voluntarily, and complete the mutual of data, and different terminals can be made respectively to send trigger message as transmitting terminal in the different time, so, then may there is the problem that have received data of the end-error as receiving end.Such as, described in embodiment 2, system as shown in Figure 11,12, two cameras 21 comprise server 11, being connected with server 11,22, terminal 31,32,41,42 and the physical message be arranged on around terminal 31,32,41,42 identify 31A, 32A, 41A (wherein, the physical message mark of terminal 42 is not shown), terminal 31,32,41,42 is covered among the coverage 52 of camera 21,22.

It should be noted that, in the present embodiment, be provided with two cameras 21,22 respectively, to those skilled in the art, the image gathered respectively by two cameras 21,22 judges the gesture operation of user U and determines that the content performed by this gesture operation is not difficult matter, do not repeat them here, judged by two cameras 21,22, can expand the coverage area on the one hand, the health of user U can be avoided to block the irradiation of camera and make server 11 cannot judge the problem of the gesture operation that user U performs on the other hand.

Of the present invention based in the data interactive method of gesture operation, step S1-S3 and embodiment 1 similar, unlike in step S1-S3, user U performs terminal 31 and terminal 32 respectively and determines target gesture operation to be sent, thus be that terminal 31 and terminal 32 outwards broadcast Trigger message as transmitting terminal respectively, but, different to the time of the determination target gesture operation to be sent performed by two terminals, now, in terminal 31, show the picture file of " flower ", in terminal 41, show the picture file of " circle ".

In order to solve the problem, described method, as shown in figure 13, comprising:

S3, server select operation according to transmitting terminal, determine the terminal as transmitting terminal.

The following a few small step of concrete execution in step S3.

Situation in above-mentioned steps S1-S31 and embodiment 1 is similar, does not repeat them here.

S40, server are according to targeting operations, and notice transmitting terminal broadcasts Trigger message.

In this enforcement scene, because need connect voluntarily between transmitting terminal and receiving end and send data, so after server 11 determines the transmitting terminal needing to send data, notice transmitting terminal outwards broadcasts Trigger message.Now, the terminal in the scope that can communicate all can receive this Trigger message, row cache of going forward side by side.

The very first time of S41, server record transmitting terminal broadcast Trigger message.

After server 11 has been known and is made terminal 31 and terminal 32 broadcast Trigger message respectively, it be the very first time that 12:32 and terminal 32 broadcast Trigger message is 12:30 that server 11 records very first time that terminal 31 broadcasts Trigger message respectively, and now terminal 41,42 can receive two Trigger message respectively.

After server 11 have recorded the very first time that terminal 31 and terminal 32 broadcast Trigger message respectively, user U performs terminal 41 and sends gesture operation, and by step S5, server 11 obtains the transmission gesture operation performed by user U by camera 21,22.

S50, user perform gesture operation, and server is by camera collection gesture operation.

Step S4 in step S50 and embodiment 1 is similar, does not repeat them here.

Further, after step S50, described method, also comprises:

S51, server record obtain the second time sending gesture operation.

When server 11 obtain user U to the transmission gesture operation performed by terminal 41 after, writing time again, namely the second time was 12:33.After server 11 have recorded the second time receiving and send gesture operation, continue to perform step S60-S71, the step S50-S61 in this implementation and embodiment 1 is similar, does not repeat them here.

S8, server are according to the operation of transmission notice, and notice receiving end sends feedback message to the transmitting terminal sending Trigger message

Step S8 specifically performs following a few small step:

S80, server judge the time difference of the very first time and the second time and the relation of Preset Time difference.

In server 11, be previously stored with a Preset Time difference, in the present embodiment, this Preset Time difference is set to 1 minute.After server 11 obtains the very first time and the second time respectively, calculate the time difference of the very first time and the second time, the time difference that namely can calculate between terminal 31 and terminal 41 is 1 minute, and the time difference between terminal 32 and terminal 41 is 3 minutes.

When the time difference of the very first time and the second time is not more than Preset Time difference, then perform step S81, when the time difference of the very first time and the second time is greater than Preset Time difference, then perform step S82.

S81, server are according to the operation of transmission notice, and the transmitting terminal making receiving end be less than Preset Time difference to time difference sends feedback message.

Server 11 determines that the time difference of the very first time of terminal 31 and the second time of terminal 41 is less than Preset Time difference, then notify that the terminal 41 as receiving end sends feedback message to the terminal 31 as transmitting terminal, send data with notification terminal 31 to terminal 41.

The transmitting terminal that S82, server stop receiving end being greater than Preset Time difference to time difference sends feedback message.

Server 11 determines that the time difference of the very first time of terminal 32 and the second time of terminal 41 is greater than Preset Time difference 1 minute for 3 minutes, then notify to stop sending feedback message to terminal 32 as the terminal 41 of receiving end, and terminates relevant process.

By step S80-S82 and with step S9, final on the display screen of the terminal 41 as receiving end, as shown in figure 14, receive the picture file of " flower " sended over terminal 31, instead of the picture file of " circle " shown on the display screen of terminal 32.

So, recorded by server 11 and record terminal respectively and send time of Trigger message and server 11 and collect the time sending gesture operation and judge, when the terminal in system just can be avoided more, terminal is made to receive unnecessary data, thus the convenient degree also further improved based on the data interactive method of gesture operation and hommization degree.

Described in embodiment 1 and embodiment 2 based in the data interactive method of gesture operation, also in the process of single job, multiple data can be transmitted respectively.Transmitting multiple data to realize single job, described method in embodiment 3, optionally, determining target gesture operation to be sent, also comprising: data selection operates.Below based on embodiment 2, be described, it should be noted that, although only based on embodiment 2, based on same principle, the method is also applicable to embodiment 1.

Operation selected by this file, and the hand that can be set to user keeps state 5 frame stretching out a finger.In the step s 21, determining in target gesture operation to be sent when server 11 gets, the hand of user keeps state 5 frame stretching out a finger, then server 11 is informed in this transmission gesture operation and comprises data selection operation.It should be noted that, the operation of this data selection is not limited only to above-mentioned form, also can be other form, only needs server 11 can identify the operation of this data selection.

Further, after step s 21, as shown in figure 15, also comprise:

S22, server based on data select operation, select the data needing in transmitting terminal to send.

Server 11 obtain determine target gesture operation to be sent after, parse wherein as shown in figure 16 data selection operation.In figure 16, terminal 31 shows these four files of file 1, file 2, file 3 and file 4, server 11 determines the data pointed by the operation of this data selection according to the image that camera 21,22 gathers.After user U have chosen file 1, need the data sent as transmitting terminal by this file 1.In addition, in the present embodiment, except file 1, user also have selected file 2.So, in step s 9, user-selected file 1 and file 2 can be sent to as in the terminal of receiving end by the terminal as transmitting terminal.

Therefore by the data selection operation in the transmission gesture operation performed by user, can make server, according to once sending gesture operation, the multiple data in transmitting terminal are sent to receiving end, thus promote the convenient degree of the data interaction between terminal further.

In order to improve user further in the hommization degree of carrying out the data interaction based on gesture operation, after step s 22, optionally, also comprise:

S23, server notice transmitting terminal, marks needing the data sent.

In step S22, server 11 has known that user have selected file 1 and file 2 as the data needing to send by data selection operation, now, server 11 notify terminal 31 as transmitting terminal around file 1 and file 2 display file frame to mark, find out that to make user have selected which data sends more intuitively, namely as shown in figure 17, carry out by file frame the file 1 that marks and file 2 is the data needing to send.So, also just further increasing the hommization degree of the data interaction based on gesture operation.

In order to improve the hommization degree in the process of data interaction further, optionally, receive gesture operation, also comprise: display position selects operation.

In step S60, server 11 being selected operation except obtaining the receiving end sent in gesture operation, being sent except notice operation, also obtains display position and selects operation.This display position selects operation, can operate similar with data selection, also can be set to other form, not do concrete restriction at this.Select operation and data selection to operate with display position to be in the present embodiment all example mutually and to be described.

After step S61, also comprise:

S62, server obtain the display position selected by described display position selection operation.

As shown in figure 18, server 11, by resolving the image that camera 21,22 gathers, as in the terminal 41 of receiving end, determines a display position P with display position selection operation.

After step S9, also comprise:

S10, server notice receiving end, at display position, shows the data that described needs send.

The coordinate of this display position P, after selecting operation to obtain display position P by display position, is sent to receiving end by server 11.Receiving end, after the data receiving the transmission of this transmitting terminal, shows the data received at this display position P place.If when terminal 41 receives multiple data, then can arrange and arrange this data received to side order from display position P.

It should be noted that, according to the concrete difference implementing scene, user can specify multiple display position respectively, thus can show at multiple display position place the multiple data received respectively, also the rule can preset according to, the data etc. that the arrangement of order receives from display position.

So, user can determine by display position selection operation the position showing the data received, thus can by reception gesture operation that user performs in the process of data interaction, determine the display position of the data received, further improve the hommization degree of data interaction.

In example 4, with embodiment 1-3 unlike, be provided with two terminals 33,43 in systems in which as shown in figure 19, wherein terminal 33 is connected with camera 23, terminal 43 is connected with camera 24, the scope that camera 23 can gather is the coverage 52 of the dotted line in diagram, and the scope that camera 24 can gather is the coverage 53 of the dotted line in diagram.

For the system in embodiment 4, similar with embodiment 2,3.When terminal 33 to gather after user U performs gesture operation by camera 23, the image that terminal 33 pairs of cameras 23 collect is resolved, and judges that whether this gesture operation is for determining target gesture operation to be sent; Terminal 33 determines that this gesture operation is for after determining target gesture operation to be sent, and terminal 33 selects operation, data selection operation and targeting operations by resolving and obtaining the transmitting terminal determined in target gesture operation to be sent.Terminal 33 is determined oneself as transmitting terminal, and to determine by data selection operation the data that the needs selected by user U send respectively by transmitting terminal selection operation, finally outwards broadcasts Trigger message according to data transmit operation.

Because now user U performs and sends gesture operation in the coverage of the camera 23 be connected with terminal 33, so terminal 43 can not detect this transmission gesture operation.When the terminal 33 as transmitting terminal outwards broadcasts Trigger message, terminal 43 can receive this Trigger message, and preserve, and the very first time receiving Trigger message can be recorded as described in Example 2 like that, the very first time directly carries out record by receiving end in the present embodiment.

After user U executes transmission gesture operation to terminal 33, user U moves in the coverage 53 of the camera 24 that terminal 43 connects, and performs gesture operation; The gesture operation that terminal 43 is performed by the connected camera 24 couples of user U gathers, and the image that terminal 33 pairs of cameras 23 collect after collecting gesture operation is resolved, and judges that gesture operation performed by user U is as transmission gesture operation; Terminal 43 determines that this gesture operation is after sending gesture operation, and terminal 43 is selected operation, display position selection operation by resolving and obtaining the receiving end sent in gesture operation and sends notice operation.Terminal 43 determines oneself to be receiving end by receiving end selection operation, the display position of the data received is determined by display position selection operation, triggered by data reception operation and the Trigger message that transmitting terminal sends is fed back, namely send feedback message to transmitting terminal.

To record the very first time receiving Trigger message corresponding with terminal 43, when terminal 43 receives reception gesture operation, recorded for the second time, by the very first time and the time difference of the second time and comparing between Preset Time difference, terminal 43 judges whether to feed back the Trigger message that terminal 33 sends.Because similar with embodiment 2, do not repeat them here.

So, terminal 33 and terminal 43 connect according to Trigger message and feedback message, thus make the terminal 33 as transmitting terminal be sent to as in the terminal 43 of receiving end, to complete data interaction using the data needing to send by the connection of having set up.

Described in embodiment 1-4 based in the data interactive method of gesture operation, gesture operation can be carried out to multiple terminal simultaneously, such as two terminals can obtain a gesture operation performed by user simultaneously, when determining this gesture operation for determining target gesture operation to be sent, then two terminals as transmitting terminal can broadcast Trigger message simultaneously; After user carries out gesture operation to two other terminal, the judgement undertaken by two other terminal, determines that this gesture operation is for sending gesture operation; Two terminals as receiving end send feedback message respectively to two terminals as transmitting terminal, then now, the data that needs send are sent to two terminals as receiving end by two terminals as transmitting terminal respectively.The data interaction between multiple terminal and multiple terminal can be completed in systems in which respectively, thus further improve convenient degree and the hommization degree of data interaction between terminal.

It should be noted that, above-described embodiment only schematically illustrates for server, also can be realized by a terminal, only need this terminal can gather the gesture operation of user, by the determination target gesture operation to be sent that wherein stores with send gesture operation and identify the gesture operation obtained, and determine target gesture operation to be sent by sending out after identifying and send the terminal as transmitting terminal corresponding to gesture operation notice and the terminal as receiving end carries out data interaction.

Corresponding with above-mentioned a kind of data interactive method based on gesture operation, present invention also offers a kind of data interaction device 100 based on gesture operation, as shown in figure 20, comprising:

Transmitting terminal selection unit 101, for obtaining the determination target gesture operation to be sent that user performs, using the terminal determined corresponding to target gesture operation to be sent as transmitting terminal;

Receiving end selection unit 102, for obtaining the transmission gesture operation that user performs, using the terminal corresponding to transmission gesture operation as receiving end;

Data transmission unit 103, is sent to receiving end for making transmitting terminal by needing the data sent.

Optionally, described data transmission unit 103, comprising:

Trigger module 1030, sends Trigger message for making transmitting terminal to receiving end;

Feedback module 1031, for making receiving end send feedback message according to Trigger message to transmitting terminal, this feedback message is for notifying that transmitting terminal sends the data needing to send to receiving end;

Sending module 1032, is sent to receiving end for making the transmitting terminal receiving feedback message by needing the data sent.

Optionally, described device 100, also comprises:

Triggering radio unit 104, broadcasting Trigger message for making transmitting terminal;

Broadcast feedback unit 105, for making the receiving end receiving Trigger message, sends feedback message according to Trigger message to transmitting terminal, and this feedback message is for notifying that transmitting terminal sends the data needing to send to receiving end.

Further, described data transmission unit 101, is sent to receiving end specifically for making the transmitting terminal receiving feedback message by needing the data sent.

Further, described device 100, also comprises:

Clock unit 106, for recording the very first time of transmitting terminal broadcast Trigger message; Record obtains the second time sending gesture operation;

Broadcast feedback unit 105, specifically for when the time difference of the very first time and the second time is not more than Preset Time difference, then the transmitting terminal making receiving end be not more than Preset Time difference to time difference sends feedback message;

Described device 100, also comprises:

Stop element 107, for when the time difference of the very first time and the second time is greater than Preset Time difference, then the transmitting terminal stopping receiving end being greater than Preset Time difference to time difference sends feedback message.

Optionally, described transmitting terminal selection unit 101, comprising:

First acquisition module 1010, for obtaining the first physical message mark of the terminal determined selected by target gesture operation pending, wherein, a corresponding terminal of physical message mark;

First enquiry module 1011, for inquiring about according to the first physical message mark, using the terminal corresponding to the first physical message mark as transmitting terminal;

Receiving end selection unit 102, comprising:

Second acquisition module 1020, for obtaining the second physical message mark of the terminal sent selected by gesture operation;

Second enquiry module 1021, for inquiring about according to the second physical message mark, using the terminal corresponding to the second physical message mark as receiving end.

Further, transmitting terminal selection unit 102, also comprises:

Data selecting module 1012, for according to determining target gesture operation pending, obtains the data needing in transmitting terminal to send.

Further, described device 100, also comprises:

Mark unit 108, for need in transmitting terminal send data mark.

Further, receiving end selection unit 102, also comprises:

Display position acquisition module 1022, sends gesture operation display position selected on the receive side for obtaining;

Described device 100, also comprises:

Fixed point display unit 109, needs the data sent in described display position display for making receiving end.

A kind of data interaction device based on gesture operation that the embodiment of the present invention provides, by user to the target gesture operation pending of the determination performed by different terminals and transmission gesture operation, transmitting terminal and receiving end is determined in multiple terminal, transmitting terminal is made to be transferred to receiving end by needing the data sent, transmitting terminal and receiving end is selected respectively with the gesture operation higher by hommization degree, and by the data transmission between this gesture operation triggering terminal, thus avoid that user carries out in terminal loaded down with trivial details, the operation of machinery, improve convenient degree and the hommization degree of data interaction between terminal.

Figure 21 shows the structure of the above-mentioned terminal of the present invention 200, may be used for implementing the method described in the embodiment of the present invention by the structure of this terminal 200, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention, concrete ins and outs do not disclose, and please refer to embodiment of the method for the present invention.

This terminal can for comprising PC, mobile phone, panel computer, PDA, point-of-sale terminal (Point of Sales, hereinafter referred to as POS), the terminal device such as vehicle-mounted computer, shown in Figure 21 is the block diagram of the part-structure of the terminal 200 provided with the embodiment of the present invention.Terminal 200, comprises the parts such as action recognition device 210, storer 220, display device 230, processor 240, communication module 250, power supply 260 and physical message mark 270.It will be understood by those skilled in the art that the restriction of the not structure paired terminal 200 of the structure shown in Figure 21, the parts more more or less than diagram can be comprised, or combine some parts, or different parts are arranged.

Below in conjunction with Figure 21, each component parts of terminal 200 is specifically introduced:

Action recognition device 210 can be used for gathering the gesture operation performed by user, and this action recognition device 210 can be camera, infrared three-dimensional camera, ultrasonic sensor, electromagnetic sensor etc.Terminal 200 by the information such as position, action of action recognition device 210 couples of users, and sends gathered information to processor 240 and processes.

Storer 220 can be used for storing software program and module, and processor 240 is stored in software program and the module of storer 220 by running, thus performs various function application and the data processing of terminal 200.Storer 220 mainly can comprise storage program district and store data field; Store data field and can store the data (such as picture file, document, voice data, phone directory etc.) etc. created according to the use of terminal 200.In addition, storer 220 can comprise high-speed random access memory, can also comprise nonvolatile memory, such as at least one disk memory, flush memory device or other volatile solid-state parts.

Display device 230 can be used for the various menus showing information or the information being supplied to user and the terminal 200 inputted by user.Display device 230, can adopt liquid crystal display (Liquid Crystal Display, hereinafter referred to as LCD), and the forms such as Organic Light Emitting Diode (Organic Light-Emitting Diode, hereinafter referred to as OLED) configure.

Processor 240 is control centers of terminal 200, utilize the various piece of various interface and the whole terminal of connection, software program in storer 220 and/or module is stored in by running or performing, and call the data be stored in storer 220, perform various function and the process data of terminal 200, thus integral monitoring is carried out to terminal 200.Optionally, processor 240 can comprise one or more processing unit; Preferably, processor 240 accessible site application processor and modem processor, wherein, application processor mainly processes operating system, user interface and application program etc., and modem processor mainly processes radio communication.Be understandable that, above-mentioned modem processor also can not be integrated in processor 240.

Terminal 200 also comprises the communication module 250 of carrying out with other-end communicating, and this communication module 250 can be bluetooth module, WiFi module etc.By this communication module 250, terminal 200 obtained information can be sent to other-end, also can from other-end obtaining information.

Terminal 200 also comprises the power supply 260 (such as battery) of powering to all parts, preferably, power supply can be connected with processor 240 logic by power-supply management system, thus realizes the functions such as management charging, electric discharge and power managed by power-supply management system.

Terminal 200 also comprises physical message mark 270, the corresponding terminal of physical message mark identified this terminal.This physical message mark 270 can for being arranged at the Sign Board comprising identifiable design symbol around terminal 200, also can for sending and receiving the communicator of identification information, can also be that the position of terminal 200, shape etc. can carry out by modes such as images the structure that identifies.

Although not shown, structure and/or the modules such as all right input equipment of terminal 200, do not repeat them here.

In the embodiment of the present invention, this storer 220, processor 240 and communication module 250 included by terminal 200, also has following functions:

Action recognition device 210, for gathering the gesture operation in its coverage performed by user, and sends to processor 240 to carry out resolving and processing by obtained gesture operation.

Storer 220, for storing the Trigger message received, the very first time receiving the Trigger message that transmitting terminal sends, receiving the second time sending gesture operation; In this storer 220, also store Preset Time difference, determine target gesture operation pending, send gesture operation.Wherein determine target gesture operation pending, comprise transmitting terminal and select operation, data selection operation and targeting operations; Send gesture operation, comprise receiving end and select operation, display position selection operation and send notice operation.Display device 230, for showing data.

Communication module 250, for notify as transmitting terminal terminal broadcast Trigger message, outwards broadcast Trigger message, Trigger message that receiving end/sending end is broadcasted, notify to send feedback message as the terminal of receiving end, receive feedback message that the terminal as receiving end sends, to the data sent as the needs of the terminal transmission of transmitting terminal as the terminal transmission feedback message of transmitting terminal, transmission and reception.

Using described, processor 240, for obtaining the determination target gesture operation pending that user performs, determines that terminal corresponding to target gesture operation pending is as transmitting terminal; Obtain the transmission gesture operation that user performs, using the terminal corresponding to described transmission gesture operation as receiving end; Described transmitting terminal is made to be sent to described receiving end by needing the data sent.

In embodiments of the present invention, optionally, processor 240, making described transmitting terminal be sent in the process of described receiving end by needing the data sent in execution, sending Trigger message specifically for making described transmitting terminal to described receiving end; Make described receiving end send feedback message according to described Trigger message to described transmitting terminal, described feedback message is for notifying that described transmitting terminal sends the described data needing to send to described receiving end; Make the transmitting terminal receiving described feedback message that the described data sent that need are sent to described receiving end.

In embodiments of the present invention, optionally, processor 240, is performing the determination target gesture operation to be sent of described acquisition user execution, using described determine the terminal corresponding to target gesture operation to be sent as transmitting terminal process after, also for make described transmitting terminal broadcast Trigger message.

Described processor 240, performing the transmission gesture operation of described acquisition user execution, using the terminal corresponding to described transmission gesture operation as receiving end process after, also for making the receiving end receiving described Trigger message, send feedback message according to described Trigger message to described transmitting terminal.

In embodiments of the present invention, concrete, processor 240, be sent in the process of described receiving end making described transmitting terminal described in carrying out by needing the data sent, specifically for making the transmitting terminal receiving described feedback message that the described data sent that need are sent to described receiving end, described feedback message is for notifying that described transmitting terminal sends the described data needing to send to described receiving end.

In embodiments of the present invention, processor 240, after performing the process making described transmitting terminal broadcast Trigger message, also broadcasts the very first time of described Trigger message for recording described transmitting terminal; Processor 240, the transmission gesture operation performing described acquisition user and perform, using the terminal corresponding to described transmission gesture operation as receiving end process after, also send the second time of gesture operation for recording to obtain; Processor 240, the receiving end receiving described Trigger message is made described in execution, send in the process of feedback message according to described Trigger message to described transmitting terminal, specifically for when the time difference of the described very first time and described second time is not more than Preset Time difference, then the transmitting terminal making described receiving end be not more than described Preset Time difference to described time difference sends feedback message; Described processor 240, performing the reception gesture operation of described acquisition user execution, using the terminal corresponding to described transmission gesture operation as receiving end process after, also for when the time difference of the described very first time and described second time is greater than Preset Time difference, then the transmitting terminal stopping described receiving end to be greater than described Preset Time difference to described time difference sends feedback message.

In embodiments of the present invention, concrete, processor 240, at the determination target gesture operation to be sent that described acquisition user performs, determine that terminal corresponding to target gesture operation to be sent is as in the process of transmitting terminal using described, specifically for obtaining described the first physical message mark determining the terminal selected by target gesture operation to be sent, wherein, a corresponding terminal of physical message mark; Inquire about according to described first physical message mark, using the terminal corresponding to described first physical message mark as described transmitting terminal.Processor 240, performing the transmission gesture operation of described acquisition user execution, using the terminal corresponding to described transmission gesture operation as in the process of receiving end, specifically for obtaining the second physical message mark of the terminal selected by described transmission gesture operation; Inquire about according to described second physical message mark, using the terminal corresponding to described second physical message mark as described receiving end.

In embodiments of the present invention, processor 240, execution described according to described first physical message mark inquire about, using described first physical message mark corresponding to terminal as described transmitting terminal process after, also for determining target gesture operation to be sent according to described, obtain in described transmitting terminal the data needing to send.

In embodiments of the present invention, processor 240, execution described according to described second physical message mark inquire about, using the terminal corresponding to described second physical message mark as receiving end process after, also for obtaining described transmission gesture operation display position selected on described receiving end.Processor 240, makes described transmitting terminal by needing after the data sent are sent to the process of described receiving end, also for making described receiving end in the described data needing to send of described display position display performing.

In another embodiment of the present invention, as shown in figure 22, additionally provide a kind of structure of server 300, comprise the parts such as action recognition device 310, storer 320, display device 330, processor 340, communication module 350, power supply 360.This server 300 gathers the terminal in the coverage of this action recognition device 310 respectively by action recognition device 310, and user is to the gesture operation performed by this terminal, and by structure similar processing modes such as above-mentioned storer 220, processor 240, communication modules 250, the data interaction between terminal is controlled.Wherein, server 300 determines the execution object of gesture operation by the physical message mark be arranged in terminal.

A kind of terminal that the embodiment of the present invention provides, by user to the target gesture operation pending of the determination performed by different terminals and transmission gesture operation, transmitting terminal and receiving end is determined in multiple terminal, transmitting terminal is made to be transferred to receiving end by needing the data sent, transmitting terminal and receiving end is selected respectively with the gesture operation higher by hommization degree, and by the data transmission between this gesture operation triggering terminal, thus avoid loaded down with trivial details, the mechanical operation that user carries out in terminal, improve convenient degree and the hommization degree of data interaction between terminal.

The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; change can be expected easily or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should described be as the criterion with the protection domain of claim.

Claims

1. based on a data interactive method for gesture operation, it is characterized in that, comprising:

Obtain the determination target gesture operation to be sent that user performs, described transmission is determined terminal corresponding to target gesture operation to be sent is as transmitting terminal;

Described transmitting terminal is made to be sent to described receiving end by needing the data sent.

2. method according to claim 1, is characterized in that, described in make described transmitting terminal by need send data be sent to described receiving end, comprising:

3. method according to claim 1, is characterized in that, at the determination target gesture operation to be sent that described acquisition user performs, determines that terminal corresponding to target gesture operation to be sent is as after transmitting terminal, also comprises using described:

Described transmitting terminal is made to broadcast Trigger message;

4. method according to claim 3, is characterized in that, described in make described transmitting terminal by need send data be sent to described receiving end, be specially:

5. method according to claim 3, is characterized in that, after making described transmitting terminal broadcast Trigger message, also comprises:

Record obtains the second time receiving gesture operation;

6. the method according to any one of claim 1-5, is characterized in that, the determination target gesture operation to be sent that described acquisition user performs, and determines that terminal corresponding to target gesture operation to be sent is as transmitting terminal, comprising using described:

7. method according to claim 6, is characterized in that, inquires about according to described first physical message mark described, using the terminal corresponding to described first physical message mark as after described transmitting terminal, also comprises:

8. method according to claim 7, is characterized in that, determines target gesture operation to be sent described according to described, after obtaining in described transmitting terminal the data needing to send, also comprises:

Mark needing the data sent described in described transmitting terminal.

9. method according to claim 6, is characterized in that, describedly inquires about according to described second physical message mark, using the terminal corresponding to described second physical message mark as after receiving end, also comprises:

10. based on a data interaction device for gesture operation, it is characterized in that, comprising:

Receiving end selection unit, for obtaining the transmission gesture operation that user performs, using the terminal corresponding to described transmission gesture operation as receiving end;

11. devices according to claim 10, is characterized in that, described data transmission unit, comprising:

12. devices according to claim 10, is characterized in that, described device, also comprises:

13. devices according to claim 12, is characterized in that, described data transmission unit, specifically for making the transmitting terminal receiving described feedback message, the described data sent that need are sent to described receiving end.

14. devices according to claim 12, is characterized in that, described device, also comprises:

Described device, also comprises:

15. devices according to any one of claim 10-14, it is characterized in that, described transmitting terminal selection unit, comprising:

Described receiving end selection unit, comprising:

16. devices according to claim 15, is characterized in that, described transmitting terminal selection unit, also comprises:

17. devices according to claim 16, is characterized in that, described device, also comprises:

18. devices according to claim 15, is characterized in that, described receiving end selection unit, also comprises:

Described device, also comprises: