CN104281395A - Mutual information processing method and electronic device - Google Patents

Mutual information processing method and electronic device Download PDF

Info

Publication number
CN104281395A
CN104281395A CN201310284811.4A CN201310284811A CN104281395A CN 104281395 A CN104281395 A CN 104281395A CN 201310284811 A CN201310284811 A CN 201310284811A CN 104281395 A CN104281395 A CN 104281395A
Authority
CN
China
Prior art keywords
gesture
touch
display screen
touch display
screen curtain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310284811.4A
Other languages
Chinese (zh)
Other versions
CN104281395B (en
Inventor
谢晓辉
曾志伟
卢睿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN201310284811.4A priority Critical patent/CN104281395B/en
Publication of CN104281395A publication Critical patent/CN104281395A/en
Application granted granted Critical
Publication of CN104281395B publication Critical patent/CN104281395B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a mutual information processing method and an electronic device. The mutual information processing method is applied to the electronic device provided with a touch display screen. The mutual information processing method includes the steps that a first gesture on the touch display screen of a user is detected; the maximum gesture range of the user is determined according to the first gesture, and the maximum gesture range is smaller than the range of the touch display screen; the mapping relation for mapping the operation gesture within the maximum gesture range to the full screen body of the touch display screen is determined, and therefore the full screen body can be operated through the operation gesture within the maximum gesture range. By means of the mutual information processing method and the electronic device, a user can operate the whole screen body through the operation gesture within the maximum gesture range, and therefore the user can conveniently operate large-screen electronic devices.

Description

Mutual information processing method and electronic equipment
Technical field
The present invention relates to a kind of mutual information processing method and electronic equipment, and be specifically related to be applied to the mutual information processing method of the electronic equipment with touch display screen curtain and corresponding electronic equipment.
Background technology
At present, the giant-screen electronic equipment of such as intelligent desktop develops by leaps and bounds.Under the interactive environment of giant-screen, the interactive mode much in the small screen of such as normal procedure intelligent mobile phone becomes infeasible or natural not.When the small screen, user usually can easily touch screen optional position and carry out mutual.But when giant-screen, user is positioned at giant-screen touch screen, and the hand of user cannot or be inconvenient to touch whole screen usually very much, therefore user is difficult to manipulate by directly touching on screen from the target away from user.
In order to user can handle from the target away from it on screen, usually can adopt in two ways.First kind of way is that user goes to and needs the target location controlled to operate, but this mode is usually very inconvenient, and it not only needs user ceaselessly shift position, but also may affect the use of other user.Another kind of mode is for user provides mouse, but this mode needs to provide multiple mouse to multiple users of giant-screen on the one hand, is lost the various advantages of touch screen on the other hand.
Summary of the invention
In view of the defect of prior art, the present invention visualizes the technical scheme that a kind of user of enabling is operated whole screen by the operating gesture in screen regional scope, thus user can be manipulated giant-screen electronic equipment easily.
According to a first aspect of the invention, provide a kind of mutual information processing method, be applied to the electronic equipment with touch display screen curtain, described method comprises: detect the first gesture of user on described touch display screen curtain; Determine the maximum gesture scope of described user according to described first gesture, wherein said maximum gesture scope is less than the scope of described touch display screen curtain; And determine to make it possible to the mapping relations that are mapped to by the operating gesture in described maximum gesture scope on the full screen of described touch display screen curtain be operated described full screen by the operating gesture in described maximum gesture scope.
Utilize above-mentioned mutual information processing method, user can be made to be operated whole screen by the operating gesture in screen regional scope, thus user can be manipulated such as giant-screen electronic equipment easily.
Preferably, above-mentioned mutual information processing method can also comprise: for the operating gesture in described maximum gesture scope, described touch display screen curtain shows virtual mapped shape, and described mapped shape corresponds to the mapped that described operating gesture is mapped on described full screen according to described mapping relations.
By above-mentioned preferred steps, when user carries out gesture operation in maximum opereating specification, virtual mapped shape can be seen on touch display screen curtain, thus can operate by the object of control operation gesture exactly to desired operation.Therefore, this preferred exemplary can greatly user friendly operation.
Preferably, above-mentioned mutual information processing method can also comprise: reduce the interface of the full screen showing described touch display screen curtain corresponding in the regional area of described maximum gesture scope of described touch display screen curtain, wherein, determine that described mapping relations comprise the position coordinates be mapped to by the position coordinates in described regional area in described touch display screen curtain, make the operation that the operation of described user to the object in described regional area is confirmed as the corresponding object on described full screen.
By above-mentioned preferred steps, not only can by realizing the operation to whole touch display screen curtain to the operation in maximum opereating specification, and the interface of touch display screen curtain and the mapping body of operand can be seen in maximum opereating specification, thus greatly facilitate the operation of user.
According to a second aspect of the invention, provide a kind of electronic equipment with touch display screen curtain, described electronic equipment comprises: detecting unit, is configured to detect the first gesture of user on described touch display screen curtain; Gesture scope determining unit, be configured to the maximum gesture scope determining described user according to described first gesture, wherein said maximum gesture scope is less than the scope of described touch display screen curtain; And mapping relations determining unit, determine the mapping relations be mapped to by the operating gesture in described maximum gesture scope on the full screen of described touch display screen curtain, make it possible to be operated described full screen by the operating gesture in described maximum gesture scope.
Preferably, above-mentioned electronic equipment can also comprise: map shape display unit, be configured to for the operating gesture in described maximum gesture scope, described touch display screen curtain shows virtual mapped shape, and described mapped shape corresponds to the mapped that described operating gesture is mapped on described full screen according to described mapping relations.
Preferably, above-mentioned electronic equipment can also comprise: regional area display unit, be configured to reduce the interface of the full screen showing described touch display screen curtain corresponding in the regional area of described maximum gesture scope of described touch display screen curtain, wherein, mapping relations determining unit is configured to the position coordinates be mapped to by the position coordinates in described regional area in described touch display screen curtain, makes the operation that the operation of described user to the object in described regional area is confirmed as the corresponding object on described full screen.
The above-mentioned advantage of a first aspect of the present invention is applicable to second aspect too.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme of the embodiment of the present invention, be briefly described to the accompanying drawing used required in the description of embodiment below.Certainly, accompanying drawing described below is only exemplary embodiment of the present invention.
Fig. 1 shows the process flow diagram of the mutual information processing method according to the first embodiment of the present invention;
Fig. 2 shows the schematic diagram of the preferred exemplary for illustration of the first embodiment of the present invention;
Fig. 3 shows the schematic diagram of another preferred exemplary for illustration of the first embodiment of the present invention;
Fig. 4 shows the schematic diagram for illustration of the example embodiment determining mapping relations;
Fig. 5 shows the schematic block diagram of electronic equipment according to a second embodiment of the present invention;
Fig. 6 shows the schematic block diagram of the preferred exemplary of electronic equipment according to a second embodiment of the present invention; And
Fig. 7 shows the schematic block diagram of another preferred exemplary of electronic equipment according to a second embodiment of the present invention.
Embodiment
Hereinafter, the preferred embodiments of the present invention are described in detail with reference to accompanying drawing.Note, in the present description and drawings, substantially identical step and the same or analogous Reference numeral of element represent, and will be omitted the repeat specification of these steps and element.
In following examples of the present invention, electronic equipment is preferably the giant-screen electronic equipment with touch display screen curtain of such as intelligent desktop, and here, giant-screen represents that single the hand of a usual people is difficult to cover whole screen.But, electronic equipment of the present invention is not limited to above-mentioned giant-screen electronic equipment, it can refer to any electronic equipment with touch display screen curtain, and concrete form includes but not limited to personal computer, intelligent television, panel computer, mobile phone, digital camera, personal digital assistant, portable computer, game machine etc.The particular type of electronic equipment does not form limitation of the invention.The electronic equipment of common the small screen can be suitable for the present invention equally, as long as user can by manipulating whole screen to the operation of screen regional scope.
Fig. 1 shows the process flow diagram of the mutual information processing method according to the first embodiment of the present invention.This mutual information processing method is applied to the electronic equipment with touch display screen curtain, and as mentioned above, this electronic equipment can be any electronic equipment with touch display screen curtain, but preference is as the giant-screen electronic equipment of intelligent desktop.
In step S101, detect the first gesture of user on described touch display screen curtain.Here first gesture can be any operation of user to touch display screen curtain, and such as, user can pass through one or more finger touch display screen, or by pointing paddling on the display screen, such as, draw a close-shaped figure, etc.
In step s 102, determine the maximum gesture scope of described user according to described first gesture, wherein said maximum gesture scope is less than the scope of described touch display screen curtain.After first gesture being detected, electronic equipment determines that user may carry out the maximum gesture scope of gesture operation, here maximum gesture scope refers to the magnitude range that user's gesture may be movable, it is less than the full frame scope of touch display screen curtain, thus user can be made to operate full frame scope within the scope of the gesture being less than screen ranges.It should be noted that, here maximum gesture scope might not refer to the limit of power of user's gesture maximum energy striking, namely the gesture exceeding this scope user will not reach, and only represent that user only will can carry out gesture operation to manipulate screen within the scope of this, it can be the limit of power of user's gesture maximum energy striking, also can be the scope being less than this limit of power.The determination of maximum gesture scope can have various ways, and such as, electronic equipment can preset a scope, directly triggers the scope that this is preset when the first gesture of user being detected; Or, this maximum gesture scope is determined according to the corresponding information obtained from the first gesture of user, the shape such as formed according to the touch coordinate of multiple finger determines this scope, or draw according to the first gesture of user close-shapedly determine this scope; Or can the parameter that presets of combined electrical subset and the information that obtains from the first gesture of user to determine this maximum gesture scope, such as, electronic equipment presets this maximum gesture scope for square, obtain the information of the square length of side simultaneously from the first gesture of user, and then determine this maximum gesture scope both combining.Certainly, the determination mode of maximum gesture scope is not limited to above-mentioned way of example, and those skilled in the art can design concrete determination mode according to actual needs.It should be noted that, maximum gesture scope is here not limited to the fixing regional area on display screen, also only can represent the maximum extension amount that gesture can stretch, and not limit the absolute position residing for gesture.
In step s 103, determine the mapping relations be mapped to by the operating gesture in described maximum gesture scope on the full screen of described touch display screen curtain, make it possible to be operated described full screen by the operating gesture in described maximum gesture scope.After determining maximum gesture scope, in order to operate the object away from user on display screen, user only can make operating gesture in described maximum gesture scope, operating gesture in maximum gesture scope is mapped on the full screen of touch display screen curtain by specific mapping relations by electronic equipment, to realize the operation to the object away from user, thus can by the operation of operating gesture realization to the full screen of display screen in maximum gesture scope.Mapping relations specifically determine that mode can set according to practical application scene.Such as, can the coordinate within the scope of maximum gesture is proportional (or other funtcional relationship) correspond to the coordinate of full screen, thus the operation to position a certain on full screen can be corresponded to the operation of position a certain within the scope of maximum gesture.Or and for example, when referring to that (at least three such as singlehanded fingers) operate more, first the maximum extension amount referred to can be mapped to more the border of touch display screen curtain, then determine that this many finger operates the position that should the be mapped to side-play amount relative to display screen border according to the actual span referring to operate relative to the side-play amount of maximum extension amount more, thus determine the mapping position of gesture operation on touch display screen curtain, hereafter also by describe in detail mapping relations preferably determine mode.It should be noted that, the determination mode of mapping relations is not limited to these examples, those skilled in the art can according to the needs of practical application design map relation specifically determine mode, as long as the determination mode of this mapping relations makes it possible to be operated by the full screen of operating gesture to touch display screen curtain in described maximum gesture scope.
Known according to above explanation, by the first embodiment of the present invention, user can be enable to be operated whole screen by the operating gesture in screen regional scope, thus user can be manipulated such as giant-screen electronic equipment easily.
The mutual information processing method of the first embodiment of the present invention is further described below by preferred exemplary.
Fig. 2 shows the schematic diagram of a preferred exemplary for illustration of the first embodiment of the present invention, illustrated therein is the touch display screen curtain 201 of electronic equipment, this touch display screen curtain 201 has operand 21A, 22A and 23A, and operand 21A, 22A and 23A can be file, file, application software icon etc.In addition, Fig. 2 also show the maximum gesture scope 202 be presented on touch display screen curtain 201, in this example, maximum gesture scope 202 is consistent with the shape of touch display screen curtain 201 on touch display screen curtain 201 but the regional area reduced, and reduce the interface of the full screen showing touch display screen curtain 201 in this regional area, wherein operand 21A, 22A and 23A is shown as pseudo operation object 21B, 22B and 23B respectively.Here, the mode (i.e. mapping mode) reducing display is preferably the coordinate in touch display screen curtain 201 and the coordinate one_to_one corresponding pro rata in maximum gesture scope 202, but it is also limited to this proportional mode, also can by the coordinate disproportionately one_to_one corresponding in the coordinate in touch display screen curtain 201 and maximum gesture scope 202, that is, the interface deformation of touch display screen curtain 201 is presented in maximum gesture scope 202.It should be noted that, the shape of maximum gesture scope 202 also can be different from the shape of touch display screen curtain 201, in this case, the interface deformation of touch display screen curtain 201 can be presented in maximum gesture scope 202.
In this preferred exemplary, electronic equipment determines above-mentioned maximum gesture scope 202 by detecting the first gesture (such as touching screen) of user's input.Determine that the mode of maximum gesture scope 202 can such as: the position obtaining first gesture, and determine the maximum gesture scope 202 with shape (preferably identical with display screen 201 shape) and the size preset in this position.Certainly, this example is not limited to this and determines mode, and it also can example alternate manner as already described above.After determining maximum gesture scope 202, as mentioned above, the interface reducing the full screen showing described touch display screen curtain in the regional area of described maximum gesture scope 202 is corresponded to, as which form the interface display shown in Fig. 2 at described touch display screen curtain 201.When user needs to operate operand 21A, 22A and the 23A on touch display screen curtain 201, only need pseudo operation object 21B, 22B and 23B of correspondingly operating in maximum gesture scope 202, operating gesture in this maximum gesture scope 202 can be mapped on the full screen of touch display screen curtain 201 by electronic equipment, be about to the operation map of pseudo operation object 21B, 22B and 23B on operand 21A, 22A and 23A, and then achieve the operation to operand 21A, 22A and 23A.Therefore, in this example, determine that described mapping relations comprise the position coordinates be mapped to by the position coordinates in described regional area in described touch display screen curtain, make the operation that the operation of described user to the object in described regional area is confirmed as the corresponding object on described full screen.
According to this preferred exemplary of the first embodiment of the present invention, not only can by realizing the operation to whole touch display screen curtain to the operation in maximum opereating specification, and the interface of touch display screen curtain and the mapping body of operand can be seen in maximum opereating specification, thus greatly facilitate the operation of user.
Fig. 3 shows the schematic diagram of another preferred exemplary for illustration of the first embodiment of the present invention.In this example, different from a upper preferred exemplary, it does not show the interface of touch display screen curtain in maximum opereating specification, but on touch display screen curtain, show virtual mapped shape, corresponds to the position on touch display screen curtain with the practical operation gesture of indicating user.In other words, in this preferred exemplary, mutual information processing method according to the first embodiment of the present invention also comprises: for the operating gesture in described maximum gesture scope, described touch display screen curtain shows virtual mapped shape, and described mapped shape corresponds to the mapped that described operating gesture is mapped on described full screen according to described mapping relations.As shown in Figure 3, the operating gesture 302 of user in maximum gesture scope (this maximum gesture scope can be user point open maximum scope) is the touches to touch display screen curtain 301 of user's right hand, operating gesture 302 is shown on touch display screen curtain 301 according to corresponding mapping relations by electronic equipment, and on touch display screen curtain 301, show virtual mapped shape 303, this mapped shape 303 corresponds to the mapped that user wishes to operate touch display screen curtain 301, namely be equivalent to user to be operated by mapped shape 303 pairs of touch display screen curtains 301.It should be noted that, although mapped shape 303 is here shown as the shape of virtual staff, but it is not limited thereto, and can be the geometric configuration that can indicate arbitrarily operation information, such as, only the position display circle pointed and map can touched, several finger touch is had then to show several circle, when the practical operation pointed is moved, shown circle also correspondingly moves, thus can indicate position and mode that gesture wants operation equally.In addition, as mentioned above, practical operation gesture can be varied to the mode of mapped, and this example does not limit concrete mapping mode, and it can use the mapping mode of any appropriate.After determining practical operation gesture to the mapping relations of mapped, can easily determine according to the position of mapped and pattern and show mapped shape 303.Such as, when only needing, when touching the position display circle that finger maps, directly to show sizeable circle at the finger position place mapped, when needing to show virtual staff, the shape of virtual staff can be determined in conjunction with another parameter according to the finger position mapped, this another parameter can be the wrist position of hand, the center of the wrist of the wrist of virtual staff and actual staff is such as made to overlap, or this another parameter can be the position, the centre of the palm of actual staff, such as make virtual finger position, corresponding actual finger position and position, the described centre of the palm are on the same line, " the actual centre of the palm " of " centre of the palm " here not necessarily staff, and can be the centre of the palm gone out according to the touch location calculation of finger, such as when at least three finger touch screens, the centre of form of the geometric configuration that the touch location that at least three are pointed can be formed is as " centre of the palm " here, other the centre of the palm can certainly be selected according to actual needs to determine mode, determine that the content of mode can also see another Chinese patent application No.201310062469.3 of the applicant about the centre of the palm.
Known according to above explanation, in this preferred exemplary of the first embodiment of the present invention, when user carries out gesture operation in maximum opereating specification, virtual mapped shape 303 can be seen on touch display screen curtain, thus can operate by the object of control operation gesture exactly to desired operation.Therefore, this preferred exemplary not only can by realizing the operation to whole touch display screen curtain to the operation in maximum opereating specification, and can greatly user friendly operation.
Further describe the preferred implementation for above preferred exemplary below, it should be noted that, preferred implementation described below is only example, and the present invention is not limited to these embodiments.
In a preferred embodiment, described first gesture can be that at least three of the one hand of described user point when maximum opening to the touch of described touch display screen curtain, and described maximum gesture scope is determined by first touch locations of described at least three fingers in described first gesture.Here, user performs first gesture by many finger operations of singlehanded at least three fingers (such as 3,4 or 5 fingers), and electronic equipment can detect these at least three touch locations pointed, thus determines maximum gesture scope.It should be noted that, described here " maximum open " might not refer to that the hand of user can open at utmost, but represents that user wishes or may open at utmost in subsequent operation, and such as user feels more comfortable maximum stretching degree.
In a preferred embodiment, described mutual information processing method can also comprise second gesture of the described user of detection on described touch display screen curtain before determining described mapping relations, wherein said second gesture is described at least three and points when minimum opening to the touch of described touch display screen curtain, and its touch location is the second touch location.Described mapping relations can be determined based on described first touch location and described second touch location.In order to implement a kind of preferred mapping relations defining method, electronic equipment is after the touch of expression at least three finger under maximum splayed condition being detected, point the touch at minimum splayed condition at least three described in can detecting, and its touch location is defined as the second touch location.It should be noted that equally, described here " minimum open " might not refer to the limit that the hand of user can shrink, but represents the minimum degree that user wishes or may open in subsequent operation, and such as user feels more comfortable minimum stretching degree.Obviously, minimum stretching degree is less than maximum stretching degree.After first gesture and the second gesture being detected, determine that the step of described mapping relations can preferably include: the border at least one in described first touch location being mapped to described touch display screen curtain; Described second touch location is mapped to itself; And described operating gesture is mapped on described touch display screen curtain relative to the gesture side-play amount of described first touch location and described second touch location according to the touch location of described at least three fingers in described operating gesture.
In order to the above-mentioned preferred defining method of mapping relations is described better, Fig. 4 shows an example of this preferred defining method.In the diagram, for singlehanded three touches of finger to touch display screen curtain 401, obviously also can be four or five fingers.Round dot 41A, 42A and 43A are the positions of the actual touch point of first gesture, three the first touch locations that namely three fingers are corresponding; Round dot 41B, 42B and 43B are the positions of the actual touch point of the second gesture, three the second touch locations that namely three fingers are corresponding.Because the first touch location is the touch location of finger under maximum splayed condition, such as, so in order to handle the picture on whole screen as far as possible, preferably the first touch location is mapped to the highest distance position of screen, the border of screen.According to the needs of practical application can by the first touch location, two or be all mapped to the border of screen, that is, at least one in described first touch location is mapped to the border of described touch display screen curtain.For the first touch location not being mapped to screen border, can according to the position needing to be mapped to any appropriate on screen of application.In the example depicted in fig. 4, three first touch locations 41A, 42A and 43A are all mapped in screen border, corresponding mapping position (hereinafter referred to as the first mapping position) is 41C, 42C and 43C.In addition, because the second touch location is the touch location of finger under minimum splayed condition, therefore preferred second touch location is mapped to itself, namely the mapping position of second touch location 41B, 42B and 43B remains second touch location 41B, 42B and 43B itself.In addition, in the example depicted in fig. 4, in order to finally limit the first mapping position 41C, 42C and 43C, second touch location 41B, 42B and 43B, first touch location 41A, 42A and 43A and the first mapping position 41C, 42C and 43C are laid respectively on straight line.Certainly, the present invention is not limited to this setup, also the mode of other any appropriate can be adopted finally to limit the first mapping position, such as, a position, the centre of the palm (computing method of position, the centre of the palm as described above) can be gone out according to the first touch location calculation, and position, the centre of the palm, the first touch location and corresponding first mapping position are located along the same line.Determine finger maximum open with the mapping position of the touch location under minimum splayed condition after, the touch location (hereinafter referred to as operating touch location) of the specific operation gesture can carried out according to user carrys out the mapping position of determination operation touch location on touch display screen curtain 401 (hereinafter referred to as operation map position) relative to the gesture side-play amount of the first touch location and the second touch location, namely, described operating gesture is mapped on described touch display screen curtain relative to the gesture side-play amount of described first touch location and described second touch location according to the touch location of described at least three fingers in described operating gesture.As shown in Figure 4, assuming that a certain operating gesture has operation touch location 41D, 42D and 43D, operation touch location 41D, 42D and 43D has skew relative to the first touch location of correspondence and the second touch location, can come determination operation mapping position 41E, 42E and 43E according to corresponding side-play amount.Fig. 4 shows a kind of example of determination operation mapping position, below for the operation map position of its correspondence of operation touch location 41D(wherein for 41E) be described.In this example defining method, make operation map position 41E, operation touch location 41D and the second touch location 41B on the same line, that is, each the first touch location in described first gesture, the touch location in described operating gesture and mapping position thereof in described at least three fingers are on same straight line.In addition, to carry out the particular location of determination operation mapping position 41E relative to the ratio of the distance of the first touch location 41A and the second touch location 41B according to the distance of operation touch location 41D and the second touch location 41B, particularly, the ratio of line segment 41B-41E and line segment 41B-41D can be made to equal the ratio of line segment 41B-41C and line segment 41B-41A.Uniquely determine the mapping position of operation touch location thus, thus determine the mapping relations be mapped to by operating gesture on display screen.It should be noted that, here specifically described example is only the example of determination operation mapping position, the present invention is not limited thereto, described operating gesture can be mapped on described touch display screen curtain relative to the gesture side-play amount of described first touch location and described second touch location according to the touch location of described at least three fingers in described operating gesture according to the needs of practical application by those skilled in the art.Such as can also go out a position, the centre of the palm (computing method of position, the centre of the palm as described above) according to operation touch location calculation, and position, the centre of the palm, operation touch location and operation map position are located along the same line.
After determining operation map position, mapped shape can be shown.The mapping position that described in described mapped shape embodies, the touch location of at least three fingers is mapped on described touch display screen curtain according to described mapping relations.
In a preferred embodiment, the step showing virtual mapped shape can comprise: the touch locations according to described at least three fingers determine a position, the centre of the palm computing method of the position, the centre of the palm (can as described above), makes each touch location in position, the described centre of the palm, described at least three fingers and mapping position on same straight line; And according to described at least three mapping position pointed and position, the described centre of the palm, described mapped shape is shown as a virtual staff.In this preferred implementation, show a virtual staff, the shadow of its similar actual staff, thus can make to operate whole display screen more intuitively.In addition, this virtual staff can also upgrade according to the change of user's gesture, thus the operating position of display user expectation in real time and mode.Such as, when described operating gesture is for expansion or at least three fingers described at least three fingers, translation described in shrinking or described in rotating relative to the described centre of the palm during at least three fingers, position and the direction of the virtual finger of described virtual staff can be redefined respectively according to the side-play amount in the expansion of described operating gesture or amount of contraction, the described centre of the palm or described at least three rotation amounts pointed.
By above preferred exemplary and preferred implementation, electronic equipment by the operation map of user within the scope of maximum gesture on the full screen of display screen, thus can realize the various operations to whole screen.Such as, user can realize clicking, double-clicks, pull etc. operation.Exemplarily, several operating gesture form is described below, it should be noted that following several gesture is only example, the present invention can be applied to all gestures in essence.If described operating gesture for described in described at least three finger touch during touch display screen curtain one of them finger lift and carry out click action, then judge that described operating gesture is according to the single-click operation of the mapping position of described mapping relations for a described finger.If described operating gesture for described in described at least three finger touch during touch display screen curtain one of them finger lift and carry out double-click action, then judge that described operating gesture is according to the double click operation of the mapping position of described mapping relations for a described finger.If described operating gesture is for described in described at least three finger touch during touch display screen curtain, one of them finger is only made to keep touching and lift other fingers all, and a described finger carries out drag kick, then judge that described operating gesture is for being positioned at a described finger according to the drag operation of the Action Target at the mapping position place of described mapping relations.
According to the first embodiment of the present invention, user can be made to be operated whole screen by the operating gesture in screen regional scope, thus user can be manipulated such as giant-screen electronic equipment easily.In addition, according to various preferred exemplary and preferred implementation, user can also perceive the various operations to whole screen intuitively.
Referring to Fig. 5, electronic equipment 500 is according to a second embodiment of the present invention described.The function performed by correlation unit in electronic equipment described is below corresponding with the operation processing method of above embodiment, about the electronic equipment that the various aspects described by operation processing method are equally applicable to here, therefore, no longer to its detailed description.
Fig. 5 shows the schematic block diagram of electronic equipment 500 according to a second embodiment of the present invention.As mentioned above, electronic equipment 500 is preferably the giant-screen electronic equipment with touch display screen curtain of such as intelligent desktop.But, electronic equipment of the present invention is not limited to giant-screen electronic equipment, it can refer to any electronic equipment with touch display screen curtain, and concrete form includes but not limited to personal computer, intelligent television, panel computer, mobile phone, digital camera, personal digital assistant, portable computer, game machine etc.The particular type of electronic equipment does not form limitation of the invention.Electronic equipment 500 comprises: detecting unit 501, is configured to detect the first gesture of user on described touch display screen curtain; Gesture scope determining unit 502, be configured to the maximum gesture scope determining described user according to described first gesture, wherein said maximum gesture scope is less than the scope of described touch display screen curtain; And mapping relations determining unit 503, determine the mapping relations be mapped to by the operating gesture in described maximum gesture scope on the full screen of described touch display screen curtain, make it possible to be operated described full screen by the operating gesture in described maximum gesture scope.
Those skilled in the art will appreciate that the detecting unit 501 of the electronic equipment 500 of above-described embodiment, gesture scope determining unit 502 and mapping relations determining unit 503 can be respective independently unit, also can form assembled unit together with other unit.Similarly, the unit in preferred version hereinafter described also can be independently unit or form assembled unit together with other unit separately.Further, unit illustrated in fig. 5 can be only the unit of electronic equipment 500, and electronic equipment 500 also may comprise other unit, such as CPU (central processing unit), storage unit, etc.
A preferred exemplary (electronic equipment 600) of described electronic equipment 500 can also comprise mapping shape display unit 604, be configured to for the operating gesture in described maximum gesture scope, described touch display screen curtain shows virtual mapped shape, and described mapped shape corresponds to the mapped that described operating gesture is mapped on described full screen according to described mapping relations.This preferred exemplary represents in figure 6.
Preferably, described first gesture is that at least three of the one hand of described user point when maximum opening to the touch of described touch display screen curtain, and described maximum gesture scope is determined by first touch locations of described at least three fingers in described first gesture.
Preferably, described first gesture is that at least three of the one hand of described user point when maximum opening to the touch of described touch display screen curtain, and described maximum gesture scope is determined by first touch locations of described at least three fingers in described first gesture; Described gesture scope determining unit is also configured to detect second gesture of described user on described touch display screen curtain, wherein said second gesture is described at least three and points when minimum opening to the touch of described touch display screen curtain, and its touch location is the second touch location; Described mapping relations are determined based on described first touch location and described second touch location.Described mapping relations determining unit is configured to: the border at least one in described first touch location being mapped to described touch display screen curtain; Described second touch location is mapped to itself; And described operating gesture is mapped on described touch display screen curtain relative to the gesture side-play amount of described first touch location and described second touch location according to the touch location of described at least three fingers in described operating gesture.Further, the mapping position that described in described mapped shape embodiment, the touch location of at least three fingers is mapped on described touch display screen curtain according to described mapping relations.
Preferably, described mapping relations determining unit is also configured to: determine described mapping relations, and each the first touch location in described first gesture, the touch location in described operating gesture and mapping position thereof at least three fingers described in making are on same straight line.
Preferably, described mapping shape display unit is also configured to: according to described at least three finger touch locations determine a position, the centre of the palm, make position, the described centre of the palm, described at least three finger in each touch location and mapping position on same straight line; And according to described at least three mapping position pointed and position, the described centre of the palm, described mapped shape is shown as a virtual staff.
Preferably, when described operating gesture is for expansion or at least three fingers described at least three fingers, translation described in shrinking or described in rotating relative to the described centre of the palm during at least three fingers, redefine position and the direction of the virtual finger of described virtual staff respectively according to the side-play amount in the expansion of described operating gesture or amount of contraction, the described centre of the palm or described at least three rotation amounts pointed.
Preferably, if described operating gesture for described in described at least three finger touch during touch display screen curtain one of them finger lift and carry out click action, then judge that described operating gesture is according to the single-click operation of the mapping position of described mapping relations for a described finger.
Preferably, if described operating gesture for described in described at least three finger touch during touch display screen curtain one of them finger lift and carry out double-click action, then judge that described operating gesture is according to the double click operation of the mapping position of described mapping relations for a described finger.
Preferably, if described operating gesture is for described in described at least three finger touch during touch display screen curtain, one of them finger is only made to keep touching and lift other fingers all, and a described finger carries out drag kick, then judge that described operating gesture is for being positioned at a described finger according to the drag operation of the Action Target at the mapping position place of described mapping relations.
Another preferred exemplary (electronic equipment 700) of described electronic equipment 500 can also comprise: regional area display unit 704, be configured to reduce the interface of the full screen showing described touch display screen curtain corresponding in the regional area of described maximum gesture scope of described touch display screen curtain, wherein, mapping relations determining unit is configured to the position coordinates be mapped to by the position coordinates in described regional area in described touch display screen curtain, make the operation that the operation of described user to the object in described regional area is confirmed as the corresponding object on described full screen.This preferred exemplary represents in the figure 7.
By the electronic equipment of the second embodiment of the present invention, user can be made to be operated whole screen by the operating gesture in screen regional scope, thus user can be manipulated such as giant-screen electronic equipment easily.In addition, according to various preferred exemplary and preferred implementation, user can also perceive the various operations to whole screen intuitively.
Those of ordinary skill in the art can recognize, in conjunction with unit and the algorithm steps of each example of embodiment disclosed herein description, can realize with electronic hardware, computer software or the combination of the two.And software module can be placed in the computer-readable storage medium of arbitrary form.In order to the interchangeability of hardware and software is clearly described, generally describe composition and the step of each example in the above description according to function.These functions perform with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Those skilled in the art can use distinct methods to realize described function to each specifically should being used for, but this realization should not thought and exceeds scope of the present invention.
It should be appreciated by those skilled in the art that and can be dependent on design requirement and other factors carries out various amendment, combination, incorporating aspects and replacement to the present invention, as long as they are in claims or its equivalent scope.

Claims (22)

1. a mutual information processing method, is applied to the electronic equipment with touch display screen curtain, and described method comprises:
Detect the first gesture of user on described touch display screen curtain;
Determine the maximum gesture scope of described user according to described first gesture, wherein said maximum gesture scope is less than the scope of described touch display screen curtain; And
Determine the mapping relations be mapped to by the operating gesture in described maximum gesture scope on the full screen of described touch display screen curtain, make it possible to be operated described full screen by the operating gesture in described maximum gesture scope.
2. mutual information processing method as claimed in claim 1, also comprises:
For the operating gesture in described maximum gesture scope, described touch display screen curtain shows virtual mapped shape, described mapped shape corresponds to the mapped that described operating gesture is mapped on described full screen according to described mapping relations.
3. mutual information processing method as claimed in claim 1, wherein
Described first gesture is that at least three of the one hand of described user point when maximum opening to the touch of described touch display screen curtain, and described maximum gesture scope is determined by first touch locations of described at least three fingers in described first gesture.
4. mutual information processing method as claimed in claim 2, wherein
Described first gesture is that at least three of the one hand of described user point when maximum opening to the touch of described touch display screen curtain, and described maximum gesture scope is determined by first touch locations of described at least three fingers in described first gesture;
Described mutual information processing method also comprises second gesture of the described user of detection on described touch display screen curtain before determining described mapping relations, wherein said second gesture is described at least three and points when minimum opening to the touch of described touch display screen curtain, and its touch location is the second touch location;
Described mapping relations are determined based on described first touch location and described second touch location;
Determine that described mapping relations comprise:
At least one in described first touch location is mapped to the border of described touch display screen curtain;
Described second touch location is mapped to itself; And
Relative to the gesture side-play amount of described first touch location and described second touch location, described operating gesture is mapped on described touch display screen curtain according to the touch location of described at least three fingers in described operating gesture; And
The mapping position that described in described mapped shape embodies, the touch location of at least three fingers is mapped on described touch display screen curtain according to described mapping relations.
5. mutual information processing method as claimed in claim 4, wherein determine described mapping relations, each the first touch location in described first gesture, the touch location in described operating gesture and mapping position thereof at least three fingers described in making are on same straight line.
6. mutual information processing method as claimed in claim 4, wherein shows virtual mapped shape and also comprises:
According to described at least three finger touch locations determine a position, the centre of the palm, make position, the described centre of the palm, described at least three finger in each touch location and mapping position on same straight line; And
According to described at least three mapping position pointed and position, the described centre of the palm, described mapped shape is shown as a virtual staff.
7. mutual information processing method as claimed in claim 6, wherein
When described operating gesture is for expansion or at least three fingers described at least three fingers, translation described in shrinking or described in rotating relative to the described centre of the palm during at least three fingers, redefine position and the direction of the virtual finger of described virtual staff respectively according to the side-play amount in the expansion of described operating gesture or amount of contraction, the described centre of the palm or described at least three rotation amounts pointed.
8. the mutual information processing method as described in any one in claim 4-7, wherein
If described operating gesture for described in described at least three finger touch during touch display screen curtain one of them finger lift and carry out click action, then judge that described operating gesture is according to the single-click operation of the mapping position of described mapping relations for a described finger.
9. the mutual information processing method as described in any one in claim 4-7, wherein
If described operating gesture for described in described at least three finger touch during touch display screen curtain one of them finger lift and carry out double-click action, then judge that described operating gesture is according to the double click operation of the mapping position of described mapping relations for a described finger.
10. the mutual information processing method as described in any one in claim 4-7, wherein
If described operating gesture is for described in described at least three finger touch during touch display screen curtain, one of them finger is only made to keep touching and lift other fingers all, and a described finger carries out drag kick, then judge that described operating gesture is for being positioned at a described finger according to the drag operation of the Action Target at the mapping position place of described mapping relations.
11. mutual information processing methods as claimed in claim 1, also comprise:
The interface of the full screen showing described touch display screen curtain is reduced corresponding in the regional area of described maximum gesture scope of described touch display screen curtain,
Wherein, determine that described mapping relations comprise the position coordinates be mapped to by the position coordinates in described regional area in described touch display screen curtain, make the operation that the operation of described user to the object in described regional area is confirmed as the corresponding object on described full screen.
12. 1 kinds of electronic equipments with touch display screen curtain, described electronic equipment comprises:
Detecting unit, is configured to detect the first gesture of user on described touch display screen curtain;
Gesture scope determining unit, be configured to the maximum gesture scope determining described user according to described first gesture, wherein said maximum gesture scope is less than the scope of described touch display screen curtain; And
Mapping relations determining unit, determines the mapping relations be mapped to by the operating gesture in described maximum gesture scope on the full screen of described touch display screen curtain, makes it possible to be operated described full screen by the operating gesture in described maximum gesture scope.
13. electronic equipments as claimed in claim 12, also comprise:
Map shape display unit, be configured to for the operating gesture in described maximum gesture scope, described touch display screen curtain shows virtual mapped shape, and described mapped shape corresponds to the mapped that described operating gesture is mapped on described full screen according to described mapping relations.
14. electronic equipments as claimed in claim 12, wherein
Described first gesture is that at least three of the one hand of described user point when maximum opening to the touch of described touch display screen curtain, and described maximum gesture scope is determined by first touch locations of described at least three fingers in described first gesture.
15. electronic equipments as claimed in claim 13, wherein
Described first gesture is that at least three of the one hand of described user point when maximum opening to the touch of described touch display screen curtain, and described maximum gesture scope is determined by first touch locations of described at least three fingers in described first gesture;
Described gesture scope determining unit is also configured to detect second gesture of described user on described touch display screen curtain, wherein said second gesture is described at least three and points when minimum opening to the touch of described touch display screen curtain, and its touch location is the second touch location;
Described mapping relations are determined based on described first touch location and described second touch location;
Described mapping relations determining unit is configured to:
At least one in described first touch location is mapped to the border of described touch display screen curtain;
Described second touch location is mapped to itself; And
Relative to the gesture side-play amount of described first touch location and described second touch location, described operating gesture is mapped on described touch display screen curtain according to the touch location of described at least three fingers in described operating gesture; And
The mapping position that described in described mapped shape embodies, the touch location of at least three fingers is mapped on described touch display screen curtain according to described mapping relations.
16. electronic equipments as claimed in claim 15, wherein said mapping relations determining unit is also configured to: determine described mapping relations, and each the first touch location in described first gesture, the touch location in described operating gesture and mapping position thereof at least three fingers described in making are on same straight line.
17. electronic equipments as claimed in claim 15, wherein said mapping shape display unit is also configured to:
According to described at least three finger touch locations determine a position, the centre of the palm, make position, the described centre of the palm, described at least three finger in each touch location and mapping position on same straight line; And
According to described at least three mapping position pointed and position, the described centre of the palm, described mapped shape is shown as a virtual staff.
18. electronic equipments as claimed in claim 17, wherein
When described operating gesture is for expansion or at least three fingers described at least three fingers, translation described in shrinking or described in rotating relative to the described centre of the palm during at least three fingers, redefine position and the direction of the virtual finger of described virtual staff respectively according to the side-play amount in the expansion of described operating gesture or amount of contraction, the described centre of the palm or described at least three rotation amounts pointed.
19. electronic equipments as described in any one in claim 15-18, wherein
If described operating gesture for described in described at least three finger touch during touch display screen curtain one of them finger lift and carry out click action, then judge that described operating gesture is according to the single-click operation of the mapping position of described mapping relations for a described finger.
20. electronic equipments as described in any one in claim 15-18, wherein
If described operating gesture for described in described at least three finger touch during touch display screen curtain one of them finger lift and carry out double-click action, then judge that described operating gesture is according to the double click operation of the mapping position of described mapping relations for a described finger.
21. electronic equipments as described in any one in claim 15-18, wherein
If described operating gesture is for described in described at least three finger touch during touch display screen curtain, one of them finger is only made to keep touching and lift other fingers all, and a described finger carries out drag kick, then judge that described operating gesture is for being positioned at a described finger according to the drag operation of the Action Target at the mapping position place of described mapping relations.
22. electronic equipments as claimed in claim 12, also comprise:
Regional area display unit, is configured to reduce the interface of the full screen showing described touch display screen curtain corresponding in the regional area of described maximum gesture scope of described touch display screen curtain,
Wherein, mapping relations determining unit is configured to the position coordinates be mapped to by the position coordinates in described regional area in described touch display screen curtain, makes the operation that the operation of described user to the object in described regional area is confirmed as the corresponding object on described full screen.
CN201310284811.4A 2013-07-08 2013-07-08 Mutual information processing method and electronic equipment Active CN104281395B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310284811.4A CN104281395B (en) 2013-07-08 2013-07-08 Mutual information processing method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310284811.4A CN104281395B (en) 2013-07-08 2013-07-08 Mutual information processing method and electronic equipment

Publications (2)

Publication Number Publication Date
CN104281395A true CN104281395A (en) 2015-01-14
CN104281395B CN104281395B (en) 2018-04-27

Family

ID=52256320

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310284811.4A Active CN104281395B (en) 2013-07-08 2013-07-08 Mutual information processing method and electronic equipment

Country Status (1)

Country Link
CN (1) CN104281395B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106371642A (en) * 2015-07-21 2017-02-01 阿里巴巴集团控股有限公司 Touch screen device processing method and apparatus
WO2017075986A1 (en) * 2015-11-06 2017-05-11 乐视控股(北京)有限公司 Method and device for interface zooming and terminal device
CN108027673A (en) * 2015-09-25 2018-05-11 英特尔公司 Extending user touch input
CN108762574A (en) * 2018-06-07 2018-11-06 武汉华星光电半导体显示技术有限公司 Electronic equipment display control method, processor, storage medium and electronic equipment
CN110147180A (en) * 2019-05-24 2019-08-20 深圳秋田微电子股份有限公司 Touch control display apparatus, touch control display method, display and terminal
CN110362265A (en) * 2019-07-16 2019-10-22 深圳雷曼光电科技股份有限公司 Control method, device, computer equipment and the storage medium of display interface
CN110502172A (en) * 2019-08-09 2019-11-26 深圳传音控股股份有限公司 The setting method and intelligent terminal that screen is shown
CN111142775A (en) * 2019-12-27 2020-05-12 王友位 Gesture interaction method and device
CN111475098A (en) * 2020-04-09 2020-07-31 四川长虹教育科技有限公司 Windowing operation method and device for intelligent interactive large screen
CN113050868A (en) * 2021-04-07 2021-06-29 中国科学院软件研究所 Control method capable of triggering edge gesture in screen

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002196739A (en) * 2000-12-27 2002-07-12 Fuji Xerox Co Ltd Image display system
CN101436115B (en) * 2007-11-13 2011-06-01 夏普株式会社 Information display apparatus, method for displaying information
US20110134047A1 (en) * 2009-12-04 2011-06-09 Microsoft Corporation Multi-modal interaction on multi-touch display
CN102662511A (en) * 2012-03-24 2012-09-12 上海量明科技发展有限公司 Method and terminal for carrying out control operation through touch screen

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002196739A (en) * 2000-12-27 2002-07-12 Fuji Xerox Co Ltd Image display system
CN101436115B (en) * 2007-11-13 2011-06-01 夏普株式会社 Information display apparatus, method for displaying information
US20110134047A1 (en) * 2009-12-04 2011-06-09 Microsoft Corporation Multi-modal interaction on multi-touch display
CN102662511A (en) * 2012-03-24 2012-09-12 上海量明科技发展有限公司 Method and terminal for carrying out control operation through touch screen

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106371642A (en) * 2015-07-21 2017-02-01 阿里巴巴集团控股有限公司 Touch screen device processing method and apparatus
CN108027673A (en) * 2015-09-25 2018-05-11 英特尔公司 Extending user touch input
WO2017075986A1 (en) * 2015-11-06 2017-05-11 乐视控股(北京)有限公司 Method and device for interface zooming and terminal device
CN108762574A (en) * 2018-06-07 2018-11-06 武汉华星光电半导体显示技术有限公司 Electronic equipment display control method, processor, storage medium and electronic equipment
CN110147180A (en) * 2019-05-24 2019-08-20 深圳秋田微电子股份有限公司 Touch control display apparatus, touch control display method, display and terminal
CN110362265A (en) * 2019-07-16 2019-10-22 深圳雷曼光电科技股份有限公司 Control method, device, computer equipment and the storage medium of display interface
CN110362265B (en) * 2019-07-16 2021-08-31 深圳雷曼光电科技股份有限公司 Display interface control method and device, computer equipment and storage medium
CN110502172A (en) * 2019-08-09 2019-11-26 深圳传音控股股份有限公司 The setting method and intelligent terminal that screen is shown
CN111142775A (en) * 2019-12-27 2020-05-12 王友位 Gesture interaction method and device
CN111475098A (en) * 2020-04-09 2020-07-31 四川长虹教育科技有限公司 Windowing operation method and device for intelligent interactive large screen
CN113050868A (en) * 2021-04-07 2021-06-29 中国科学院软件研究所 Control method capable of triggering edge gesture in screen

Also Published As

Publication number Publication date
CN104281395B (en) 2018-04-27

Similar Documents

Publication Publication Date Title
CN104281395A (en) Mutual information processing method and electronic device
US9811186B2 (en) Multi-touch uses, gestures, and implementation
US9529523B2 (en) Method using a finger above a touchpad for controlling a computerized system
Ni et al. Design and evaluation of freehand menu selection interfaces using tilt and pinch gestures
CN104317452B (en) Method for controlling large-screen intelligent device
KR20160046150A (en) Apparatus and method for drawing and solving a figure content
KR20100041006A (en) A user interface controlling method using three dimension multi-touch
US10180714B1 (en) Two-handed multi-stroke marking menus for multi-touch devices
US10671269B2 (en) Electronic device with large-size display screen, system and method for controlling display screen
CN105117056A (en) Method and equipment for operating touch screen
JP2018067068A (en) Drawing processing method, drawing processing program and drawing processing device
KR20130137069A (en) Method of simulating the touch screen operation by means of a mouse
KR20130099570A (en) System and method for implemeting 3-dimensional user interface
US11693556B2 (en) Creating tables using gestures
US20130100059A1 (en) Content display engine for touch-enabled devices
KR101421369B1 (en) Terminal setting touch lock layer and method thereof
CN105630375A (en) Auxiliary implementation method and system of information input on the basis of graphical interface
Rekimoto Organic interaction technologies: from stone to skin
CN104216644A (en) System and method for mapping blocked area
CN109564496A (en) Interactive display superimposition system and correlation technique
JP2012022458A (en) Information processing apparatus and control method thereof
CN104820584B (en) Construction method and system of 3D gesture interface for hierarchical information natural control
Herrlich et al. Integrated rotation and translation for 3D manipulation on multi-touch interactive surfaces
WO2013047023A1 (en) Display apparatus, display method, and program
JP6863918B2 (en) Control programs, control methods and information processing equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant