CN104656944A - Information processing method and electronic device - Google Patents

Information processing method and electronic device Download PDF

Info

Publication number
CN104656944A
CN104656944A CN201310578185.XA CN201310578185A CN104656944A CN 104656944 A CN104656944 A CN 104656944A CN 201310578185 A CN201310578185 A CN 201310578185A CN 104656944 A CN104656944 A CN 104656944A
Authority
CN
China
Prior art keywords
described
operation
display unit
coordinate
parameter
Prior art date
Application number
CN201310578185.XA
Other languages
Chinese (zh)
Other versions
CN104656944B (en
Inventor
张晶
於星明
陈云凯
Original Assignee
联想(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 联想(北京)有限公司 filed Critical 联想(北京)有限公司
Priority to CN201310578185.XA priority Critical patent/CN104656944B/en
Priority claimed from CN201310578185.XA external-priority patent/CN104656944B/en
Priority claimed from US14/451,977 external-priority patent/US9691357B2/en
Publication of CN104656944A publication Critical patent/CN104656944A/en
Application granted granted Critical
Publication of CN104656944B publication Critical patent/CN104656944B/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1438Digital output to display device; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using more than one graphics controller

Abstract

The invention discloses an information processing method applied to the electronic device, the electronic device can synchronously display the first multimedia data in a first display unit and a second display unit; the method comprises the following steps: obtaining the first parameter of the first display unit and the second parameter of the second display unit; obtaining the first operation to the first multimedia data on the second display unit; analyzing the first operation to obtain the first coordinate of the first operation; transforming the first coordinate of the first operation according to the first parameter and the second parameter to obtain the second coordinate of the first operation to the first multimedia data on the first display unit; and executing the first operation based on the second coordinate of the first operation. The electronic device is also disclosed, according to the technical scheme, the host screen can process and respond the input operation on the expanded screen.

Description

A kind of information processing method and electronic equipment

Technical field

The present invention relates to the information processing technology, particularly relate to a kind of information processing method and electronic equipment.

Background technology

Along with the development of smart mobile phone, realizing colour display and multi-screen by mobile phone micro-throwing technology and Wireless Display (wifi display) technology, to share the display mode of displaying contents more and more general.But, this display mode can only carry out touch control operation to displaying contents in main frame screen, and extended screen or changed accordingly by the content that the content of the shared screen of wifi display just follows main frame screen, user directly can not manipulate extended screen.Along with the appearance of gesture input operation, or the appearance of the expansion equipment such as bluetooth mouse, keyboard, extended screen also can realize input operation.But extended screen is the mirrored content display of main frame screen, due to the difference of different display screen display resolution, how allows main frame screen processing also respond the input operation in extended screen, become the problem needing solution badly.

Summary of the invention

In view of this, the fundamental purpose of the embodiment of the present invention is to provide a kind of information processing method and electronic equipment, can make main frame screen processing and the input operation of response in extended screen, promote the experience of user.

For achieving the above object, the technical scheme of the embodiment of the present invention is achieved in that

A kind of information processing method, be applied in electronic equipment, described electronic equipment can by the first multi-medium data simultaneous display in the first display unit and the second display unit, and described first display unit is arranged in described electronic equipment; Described method comprises:

Obtain the first parameter of described first display unit, and the second parameter of described second display unit;

Obtain the first operation to described first multi-medium data on described second display unit;

Resolve described first operation, obtain the first coordinate of described first operation;

According to described first parameter and the second parameter, the first coordinate to described first operation converts, and obtains the second coordinate to the first operation of described first multi-medium data on described first display unit;

Based on the second coordinate of described first operation, perform described first operation.

A kind of electronic equipment, described electronic equipment can by the first multi-medium data simultaneous display in the first display unit and the second display unit, and described first display unit is arranged in described electronic equipment; Described electronic equipment comprises: the first acquiring unit, second acquisition unit, resolution unit, the first converter unit and performance element; Wherein,

Described first acquiring unit, for obtaining the first parameter of described first display unit, and the second parameter of described second display unit;

Described second acquisition unit, for obtaining the first operation to described first multi-medium data on described second display unit;

Described resolution unit, for resolving described first operation, obtains the first coordinate of described first operation;

Described first converter unit, for the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit;

Described performance element, for the second coordinate based on described first operation, performs described first operation.

Technical scheme in the embodiment of the present invention, obtains the first parameter of the first display unit, and the second parameter of the second display unit; According to described first parameter and described second parameter, the first coordinate to the first operation on the second display unit converts, and obtains the second coordinate of the first operation; Based on the second coordinate of described first operation, perform described first operation.So, achieve when extended screen is different from the resolution of main frame screen, the input operation of extended screen be synchronized with on main frame screen, main frame screen can process and respond the input operation in extended screen, improves the experience of user.

Accompanying drawing explanation

Fig. 1 is the schematic flow sheet of the information processing method of the embodiment of the present invention one;

Fig. 2 is the schematic flow sheet of the information processing method of the embodiment of the present invention two;

Fig. 3 is the schematic flow sheet of the information processing method of the embodiment of the present invention three;

Fig. 4 is the schematic flow sheet of the information processing method of the embodiment of the present invention four;

Fig. 5 is the schematic flow sheet of the information processing method of the embodiment of the present invention five;

Fig. 6 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention one;

Fig. 7 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention two;

Fig. 8 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention three;

Fig. 9 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention four;

Figure 10 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention five;

Figure 11 is the schematic diagram that the second display unit of the embodiment of the present invention erects screen display and shows the first multi-medium data;

Figure 12 is the schematic diagram that the horizontal screen display of the second display unit of the embodiment of the present invention shows the first multi-medium data.

Embodiment

In order to more at large understand feature of the present invention and technology contents, below in conjunction with accompanying drawing, realization of the present invention is described in detail, the use of appended accompanying drawing explanation only for reference, is not used for limiting the present invention.

Fig. 1 is the schematic flow sheet of the information processing method of the embodiment of the present invention one, information processing method in this example is applied in electronic equipment, described electronic equipment can by the first multi-medium data simultaneous display in the first display unit and the second display unit, and described first display unit is arranged in described electronic equipment; In a preferred embodiment of the invention, described information processing method comprises the following steps:

Step 101: the first parameter obtaining described first display unit, and the second parameter of described second display unit.

In the present embodiment, the first display unit refers to the display device in electronic equipment, such as touching display screen, and the first display unit is also main frame screen; First parameter of the first display unit refers to the screen resolution of the first display unit.Second display unit is also extended screen, and the second display unit can be the projecting cell that have employed micro-throwing technology, also can be the display device that have employed wifi display technology; Second parameter of the second display unit refers to the screen resolution of the second display unit.

Here, because the first display unit is arranged in described electronic equipment, therefore, the first parameter of the first display unit can directly be obtained; When the second display unit is the projecting cell that have employed micro-throwing technology, the second display unit is also arranged in described electronic equipment, therefore, also directly can obtain the second parameter of the second display unit; When the second display unit is the display device that have employed wifi display technology, second display unit is independent of outside described electronic equipment, second display unit is undertaken alternately by wifi network and described electronic equipment, therefore, electronic equipment can obtain the second parameter of described second display unit by wifi network.

The first multi-medium data in the present embodiment refers to the multi-medium data shown by desktop of described electronic equipment, and such as, when desktop played in full screen video, the first multi-medium data is video data.

Step 102: obtain the first operation to described first multi-medium data on described second display unit.

User can operate described first multi-medium data on the second display unit, is called the first operation; Such as, when the second display unit is touching display screen, user can the second display unit described in touch-control, and what realize with the first multi-medium data is mutual.

Process to enable the electronic equipment in this example and respond described first operation, described electronic equipment needs to obtain the first operation to described first multi-medium data on described second display unit.Particularly, when the second display unit is the projecting cell that have employed micro-throwing technology, described electronic equipment can obtain described first operation by the mode of depth detection; When the second display unit is the display device that have employed wifi display technology, second display unit is independent of outside described electronic equipment, second display unit is undertaken alternately by wifi network and described electronic equipment, therefore, electronic equipment can obtain described first operation by wifi network.

Here, the first operation can be touch control operation, also can be button operation, can also be gesture operation or voice operating etc.

Step 103: resolve described first operation, obtains the first coordinate of described first operation.

Here, the first operation corresponds to a coordinate information, and this coordinate information is for characterizing the positional information that described first operates in the second display unit; Therefore, described first coordinate is the coordinate of the first operation relative to the second display unit.

Step 104: the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit.

Here, the first coordinate of the first operation is two-dimensional coordinate, such as x1 coordinate and y1 coordinate; According to the first parameter and the second parameter, x1 coordinate and y1 coordinate are converted respectively, x2 coordinate and y2 coordinate can be obtained; X2 coordinate and y2 coordinate are the second coordinate of the first operation, and the second coordinate is the coordinate that the first operation corresponds to the first display unit.

Step 105: based on the second coordinate of described first operation, performs described first operation.

The second coordinate due to the first operation is the coordinate relative to the first display unit, and therefore, described electronic equipment can process and respond the first operation.

Fig. 2 is the schematic flow sheet of the information processing method of the embodiment of the present invention two, and the information processing method in this example is applied in electronic equipment, and described electronic equipment can by the first multi-medium data simultaneous display in the first display unit and the second display unit; Described first multi-medium data full screen display is on described first display unit and described second display unit; Described first display unit is arranged in described electronic equipment; In another preferred embodiment of the present invention, described information processing method comprises the following steps:

Step 201: the first parameter obtaining described first display unit, and the second parameter of described second display unit.

In the present embodiment, the first display unit refers to the display device in electronic equipment, such as touching display screen, and the first display unit is also main frame screen; First parameter of the first display unit refers to the screen resolution of the first display unit.Second display unit is also extended screen, and the second display unit can be the projecting cell that have employed micro-throwing technology, also can be the display device that have employed wifi display technology; Second parameter of the second display unit refers to the screen resolution of the second display unit.

Here, because the first display unit is arranged in described electronic equipment, therefore, the first parameter of the first display unit can directly be obtained; When the second display unit is the projecting cell that have employed micro-throwing technology, the second display unit is also arranged in described electronic equipment, therefore, also directly can obtain the second parameter of the second display unit; When the second display unit is the display device that have employed wifi display technology, second display unit is independent of outside described electronic equipment, second display unit is undertaken alternately by wifi network and described electronic equipment, therefore, electronic equipment can obtain the second parameter of described second display unit by wifi network.

The first multi-medium data in the present embodiment refers to the multi-medium data shown by desktop of described electronic equipment, and such as, when desktop played in full screen video, the first multi-medium data is video data.

Step 202: obtain the first operation to described first multi-medium data on described second display unit.

User can operate described first multi-medium data on the second display unit, is called the first operation; Such as, when the second display unit is touching display screen, user can the second display unit described in touch-control, and what realize with the first multi-medium data is mutual.

Process to enable the electronic equipment in this example and respond described first operation, described electronic equipment needs to obtain the first operation to described first multi-medium data on described second display unit.Particularly, when the second display unit is the projecting cell that have employed micro-throwing technology, described electronic equipment can obtain described first operation by the mode of depth detection; When the second display unit is the display device that have employed wifi display technology, second display unit is independent of outside described electronic equipment, second display unit is undertaken alternately by wifi network and described electronic equipment, therefore, electronic equipment can obtain described first operation by wifi network.

Here, the first operation can be touch control operation, also can be button operation, can also be gesture operation or voice operating etc.

Step 203: resolve described first operation, obtains the first coordinate of described first operation.

Here, the first operation corresponds to a coordinate information, and this coordinate information is for characterizing the positional information that described first operates in the second display unit; Therefore, described first coordinate is the coordinate of the first operation relative to the second display unit.

Step 204: according to described first parameter and described second parameter, determine the first conversion parameter.

Because described first multi-medium data full screen display is on described first display unit and described second display unit, therefore, directly the first conversion parameter can be determined according to described first parameter and described second parameter; Particularly, suppose that the screen resolution of the second display unit is M × N, the screen resolution of the first display unit is P × Q, then the first conversion parameter is: P × M and Q × N.

Step 205: converted by first coordinate of described first conversion parameter to described first operation, obtain the second coordinate of the first operation.

Particularly, suppose that the first coordinate is (x 1, y 1), after being converted by first coordinate of described first conversion parameter to described first operation, the second coordinate obtained is (x 2, y 2), so, carrying out conversion by first coordinate of the first conversion parameter to described first operation can be realized by following formula (1):

x 2=P×M/x 1(1)

y 2=Q×N/y 1

Here, the second coordinate is the coordinate that the first operation corresponds to the first display unit.

Step 206: based on the second coordinate of described first operation, performs described first operation.

The second coordinate due to the first operation is the coordinate relative to the first display unit, and therefore, described electronic equipment can process and respond the first operation.

Fig. 3 is the schematic flow sheet of the information processing method of the embodiment of the present invention three, and the information processing method in this example is applied in electronic equipment, and described electronic equipment can by the first multi-medium data simultaneous display in the first display unit and the second display unit; Described first multi-medium data full screen display is shown on described second display unit in described first display unit, non-fully screen display; Described first display unit is arranged in described electronic equipment; In another preferred embodiment of the present invention, described information processing method comprises the following steps:

Step 301: the first parameter obtaining described first display unit, and the second parameter of described second display unit.

In the present embodiment, the first display unit refers to the display device in electronic equipment, such as touching display screen, and the first display unit is also main frame screen; First parameter of the first display unit refers to the screen resolution of the first display unit.Second display unit is also extended screen, and the second display unit can be the projecting cell that have employed micro-throwing technology, also can be the display device that have employed wifi display technology; Second parameter of the second display unit refers to the screen resolution of the second display unit.

Here, because the first display unit is arranged in described electronic equipment, therefore, the first parameter of the first display unit can directly be obtained; When the second display unit is the projecting cell that have employed micro-throwing technology, the second display unit is also arranged in described electronic equipment, therefore, also directly can obtain the second parameter of the second display unit; When the second display unit is the display device that have employed wifi display technology, second display unit is independent of outside described electronic equipment, second display unit is undertaken alternately by wifi network and described electronic equipment, therefore, electronic equipment can obtain the second parameter of described second display unit by wifi network.

The first multi-medium data in the present embodiment refers to the multi-medium data shown by desktop of described electronic equipment, and such as, when desktop played in full screen video, the first multi-medium data is video data.

Step 302: obtain the first operation to described first multi-medium data on described second display unit.

User can operate described first multi-medium data on the second display unit, is called the first operation; Such as, when the second display unit is touching display screen, user can the second display unit described in touch-control, and what realize with the first multi-medium data is mutual.

Process to enable the electronic equipment in this example and respond described first operation, described electronic equipment needs to obtain the first operation to described first multi-medium data on described second display unit.Particularly, when the second display unit is the projecting cell that have employed micro-throwing technology, described electronic equipment can obtain described first operation by the mode of depth detection; When the second display unit is the display device that have employed wifi display technology, second display unit is independent of outside described electronic equipment, second display unit is undertaken alternately by wifi network and described electronic equipment, therefore, electronic equipment can obtain described first operation by wifi network.

Here, the first operation can be touch control operation, also can be button operation, can also be gesture operation or voice operating etc.

Step 303: resolve described first operation, obtains the first coordinate of described first operation.

Here, the first operation corresponds to a coordinate information, and this coordinate information is for characterizing the positional information that described first operates in the second display unit; Therefore, described first coordinate is the coordinate of the first operation relative to the second display unit.

Step 304: according to described first parameter and described second parameter, determines the viewing area of described first multi-medium data on described second display unit; Described viewing area is determined by the first frontier point and the second boundary point.

When the first multi-medium data non-fully screen display is shown on the second display unit, need consideration first multi-medium data to be that perpendicular screen display is shown on the second display unit, or horizontal screen display is shown on the second display unit; With reference to Figure 11, Figure 11 is the schematic diagram that the second display unit erects screen display and shows the first multi-medium data, and wherein, the second display unit is projecting cell, shadow region represents the region not showing the first multi-medium data, and white portion represents the region of display first multi-medium data.Suppose that the width of left side dash area is D1, the width of the right dash area is D2, and the width on whole projecting plane is D; First frontier point characterizes the intersection of left side dash area and white portion, and the coordinate of the first frontier point is (X1,0); The second boundary point characterizes the intersection of the right dash area and white portion, and the coordinate of the second boundary point is (X2,0); The horizontal ordinate of the first frontier point can be determined by following formula (2), determined the horizontal ordinate of the second boundary point by formula (3):

X l=M×Dl/D (2)

X2=M×(D-D2)/D (3)

Wherein, the relation of D and D1, D2 can draw as follows:

Suppose that the height of white portion is H, width is W, then have H/W=N/M, H/D=P/Q, then draws formula (4):

W=(P×M×D)//g×N) (4)

Due to W=Dl+D2+D3, and hypothesis D1=D2, therefore, D1 can pass through formula (5) and draw:

D1={(P×M×D)/(Q×N)-D}/2 (5)

Formula (5) is substituted in formula (2) and formula (3), perpendicular first frontier point of screen and the horizontal ordinate of the second boundary point can be drawn, as formula (6) and formula (7):

X1=M×{(P×M)/(Q×N)-1}/2 (6)

X2=M×[1-{(P×M)/(Q×N)-1}]/2 (7)

So, according to described first parameter and described second parameter, define the first frontier point and Section Point, and then define the viewing area of the first multi-medium data on described second display unit.

With reference to Figure 12, Figure 12 is the schematic diagram that the horizontal screen display of the second display unit shows the first multi-medium data, and wherein, the second display unit is projecting cell, shadow region represents the region not showing the first multi-medium data, and white portion represents the region of display first multi-medium data.Suppose that the height of dash area is above H1, below the height of dash area be H2, the width on whole projecting plane is H; First frontier point characterizes the intersection of left side dash area and white portion, and the coordinate of the first frontier point is (0, Y1); The second boundary point characterizes the intersection of the right dash area and white portion, and the coordinate of the second boundary point is (0, Y2); The ordinate of the first frontier point can be determined by following formula (8), determined the ordinate of the second boundary point by formula (9):

Y1=N×Hl/H (8)

Y2=N×(H-H2)/H (9)

Wherein, with perpendicular screen situation in like manner, the relation of H and H1, H2 can as formula (10):

H1=H2={(P×N×H)/(Q×M)-H}/2 (10)

Formula (10) is substituted in formula (8) and formula (9), the first frontier point of horizontal screen and the ordinate of the second boundary point can be drawn, as formula (11) and formula (12):

Y1=N×{(P×N)/(Q×M)-1}/2 (11)

Y2=N×[1-{(P×N)/(Q×M)-1}]/2 (12)

So, according to described first parameter and described second parameter, define the first frontier point and Section Point, and then define the viewing area of the first multi-medium data on described second display unit.

Step 305: according to the first coordinate of described first operation, judges that the coordinate of described first operation is whether between described first frontier point and the second boundary point, obtains the first judged result.

Suppose that the first the first coordinate operated is (x 1, y 1), judge whether the coordinate of described first operation is specially between described first frontier point and the second boundary point:

When the first multi-medium data erect screen display be shown on the second display unit time, whether judgment formula (13) is set up:

X1≤x 1≤X2 (13)

When formula (13) is set up, then show that the coordinate of the first operation is between described first frontier point and the second boundary point.

When the horizontal screen display of the first multi-medium data is shown on the second display unit, whether judgment formula (14) is set up:

Y1≤y 1≤Y2 (14)

When formula (14) is set up, then show that the coordinate of the first operation is between described first frontier point and the second boundary point.

Step 306: when described first judged result shows that described first operation is between described first frontier point and the second boundary point, according to the coordinate of described first parameter, described second parameter and described first frontier point and the second boundary point, determine the second conversion parameter.

When the first multi-medium data erect screen display be shown on the second display unit time, second conversion parameter be-X1 × P/M, Q/N.

When the horizontal screen display of the first multi-medium data is shown on the second display unit, the second conversion parameter is P/M ,-Y1 × Q/N.

Step 307: converted by first coordinate of described second conversion parameter to described first operation, obtain the second coordinate of the first operation.

Suppose that the first the second coordinate operated is (x 2, y 2), then first coordinate of described second conversion parameter to described first operation carries out conversion and is specially:

When the first multi-medium data erect screen display be shown on the second display unit time, obtained the second coordinate of the first operation by formula (15):

x 2=(x 1-Xl)×P/M (15)

y 2=y 1×Q/N

When the horizontal screen display of the first multi-medium data is shown on the second display unit, obtained the second coordinate of the first operation by formula (16):

x 2=x 1×P/M (16)

y 2=(y 1-Y1)×Q/N

Step 308: based on the second coordinate of described first operation, performs described first operation.

The second coordinate due to the first operation is the coordinate relative to the first display unit, and therefore, described electronic equipment can process and respond the first operation.

Fig. 4 is the schematic flow sheet of the information processing method of the embodiment of the present invention four, information processing method in this example is applied in electronic equipment, described electronic equipment can by the first multi-medium data simultaneous display in the first display unit and the second display unit, and described first display unit is arranged in described electronic equipment; In another preferred embodiment of the present invention, described information processing method comprises the following steps:

Step 401: the first parameter obtaining described first display unit, and the second parameter of described second display unit.

In the present embodiment, the first display unit refers to the display device in electronic equipment, such as touching display screen, and the first display unit is also main frame screen; First parameter of the first display unit refers to the screen resolution of the first display unit.Second display unit is also extended screen, and the second display unit can be the projecting cell that have employed micro-throwing technology, also can be the display device that have employed wifi display technology; Second parameter of the second display unit refers to the screen resolution of the second display unit.

Here, because the first display unit is arranged in described electronic equipment, therefore, the first parameter of the first display unit can directly be obtained; When the second display unit is the projecting cell that have employed micro-throwing technology, the second display unit is also arranged in described electronic equipment, therefore, also directly can obtain the second parameter of the second display unit; When the second display unit is the display device that have employed wifi display technology, second display unit is independent of outside described electronic equipment, second display unit is undertaken alternately by wifi network and described electronic equipment, therefore, electronic equipment can obtain the second parameter of described second display unit by wifi network.

The first multi-medium data in the present embodiment refers to the multi-medium data shown by desktop of described electronic equipment, and such as, when desktop played in full screen video, the first multi-medium data is video data.

Step 402: obtain the first operation to described first multi-medium data on described second display unit.

User can operate described first multi-medium data on the second display unit, is called the first operation; Such as, when the second display unit is touching display screen, user can the second display unit described in touch-control, and what realize with the first multi-medium data is mutual.

Process to enable the electronic equipment in this example and respond described first operation, described electronic equipment needs to obtain the first operation to described first multi-medium data on described second display unit.Particularly, when the second display unit is the projecting cell that have employed micro-throwing technology, described electronic equipment can obtain described first operation by the mode of depth detection; When the second display unit is the display device that have employed wifi display technology, second display unit is independent of outside described electronic equipment, second display unit is undertaken alternately by wifi network and described electronic equipment, therefore, electronic equipment can obtain described first operation by wifi network.

Here, the first operation can be touch control operation, and also can be button operation, can also be gesture operation or voice operating etc.

Step 403: resolve described first operation, obtains the first coordinate of described first operation.

Here, the first operation corresponds to a coordinate information, and this coordinate information is for characterizing the positional information that described first operates in the second display unit; Therefore, described first coordinate is the coordinate of the first operation relative to the second display unit.

Step 404: the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit.

Here, the first coordinate of the first operation is two-dimensional coordinate, such as x1 coordinate and y1 coordinate; According to the first parameter and the second parameter, x1 coordinate and y1 coordinate are converted respectively, x2 coordinate and y2 coordinate can be obtained; X2 coordinate and y2 coordinate are the second coordinate of the first operation, and the second coordinate is the coordinate that the first operation corresponds to the first display unit.

Step 405: when described first display unit rotates an angle in the horizontal direction, based on the anglec of rotation, determines the 3rd conversion parameter.

Here, when the first display unit rotates in the horizontal direction, can half-twist, 180 °, 270 °; When the first display unit does not rotate, the 3rd conversion parameter is 1 0 0 1 ; When the first display unit half-twist, the 3rd conversion parameter is 0 1 1 0 ; When the first display unit rotates 180 °, the 3rd conversion parameter is P Q ; When the first display unit rotates 270 °, the 3rd conversion parameter is Q P .

Step 406: converted by second coordinate of described 3rd conversion parameter to described first operation.

Suppose that the second coordinate after converting is (x 20, y 20), when the first display unit does not rotate, converted by second coordinate of described 3rd conversion parameter to described first operation and realize by formula (17):

x 20 y 20 = 1 0 0 1 × x 2 y 2 - - - ( 17 )

When the first display unit half-twist, converted by second coordinate of described 3rd conversion parameter to described first operation and realize by formula (18):

x 20 y 20 = 0 1 1 0 × x 2 y 2 - - - ( 17 )

When the first display unit rotates 180 °, converted by second coordinate of described 3rd conversion parameter to described first operation and realize by formula (19):

x 20 y 20 = P Q - x 2 y 2 - - - ( 19 )

When the first display unit rotates 270 °, converted by second coordinate of described 3rd conversion parameter to described first operation and realize by formula (20):

x 20 y 20 = Q P - y 2 x 2 - - - ( 19 )

Step 407: based on the second coordinate after described conversion, performs described first operation.

Due to the coordinate that the second coordinate after the conversion of the first operation is relative to the first display unit, therefore, described electronic equipment can process and respond the first operation.

Fig. 5 is the schematic flow sheet of the information processing method of the embodiment of the present invention five, information processing method in this example is applied in electronic equipment, described electronic equipment can by the first multi-medium data simultaneous display in the first display unit and the second display unit, and described first display unit and described second display unit are arranged in described electronic equipment; Described electronic equipment to be projected out described first multi-medium data by described second display unit, and described electronic equipment also comprises image acquisition units; In another preferred embodiment of the present invention, described information processing method comprises the following steps:

Step 501: the first parameter obtaining described first display unit, and the second parameter of described second display unit.

In the present embodiment, the first display unit refers to the display device in electronic equipment, such as touching display screen, and the first display unit is also main frame screen; First parameter of the first display unit refers to the screen resolution of the first display unit.Second display unit is also extended screen, and the second display unit can be the projecting cell that have employed micro-throwing technology, also can be the display device that have employed wifi display technology; Second parameter of the second display unit refers to the screen resolution of the second display unit.

Here, because the first display unit is arranged in described electronic equipment, therefore, the first parameter of the first display unit can directly be obtained; When the second display unit is the projecting cell that have employed micro-throwing technology, the second display unit is also arranged in described electronic equipment, therefore, also directly can obtain the second parameter of the second display unit; When the second display unit is the display device that have employed wifi display technology, second display unit is independent of outside described electronic equipment, second display unit is undertaken alternately by wifi network and described electronic equipment, therefore, electronic equipment can obtain the second parameter of described second display unit by wifi network.

The first multi-medium data in the present embodiment refers to the multi-medium data shown by desktop of described electronic equipment, and such as, when desktop played in full screen video, the first multi-medium data is video data.

Step 502: the first information and the second information that are gathered destination object by described image acquisition units; The described first information characterizes the two dimensional surface information of described destination object, the one dimension depth information of destination object described in described second information representation.

Here, image acquisition units can be depth transducer, user carries out touch control operation in the viewing area that the second display unit projects out, and image acquisition units will gather the three-dimensional information of the hand of user, and this three-dimensional information comprises two dimensional surface information and one dimension depth information.

Step 503: obtain the display region information that described first multi-medium data projects out.

Here, according to parameters such as the distances of the focal length parameter of the second display unit and the second display unit and projection screen, the display region information that the first multi-medium data projects out can be calculated.

Step 504: resolve the described first information, the second information and described display region information, obtains the position coordinates of described destination object in described viewing area, and as the first coordinate.

Here, after determining the three-dimensional coordinate information of destination object, also need to determine the coordinate of this three-dimensional coordinate relative to viewing area.

Step 505: resolve described first operation, obtains the first coordinate of described first operation.

Here, the first operation corresponds to a coordinate information, and this coordinate information is for characterizing the positional information that described first operates in the second display unit; Therefore, described first coordinate is the coordinate of the first operation relative to the second display unit.

Step 506: the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit.

Here, the first coordinate of the first operation is two-dimensional coordinate, such as x1 coordinate and y1 coordinate; According to the first parameter and the second parameter, x1 coordinate and y1 coordinate are converted respectively, x2 coordinate and y2 coordinate can be obtained; X2 coordinate and y2 coordinate are the second coordinate of the first operation, and the second coordinate is the coordinate that the first operation corresponds to the first display unit.

Step 507: based on the second coordinate of described first operation, performs described first operation.

The second coordinate due to the first operation is the coordinate relative to the first display unit, and therefore, described electronic equipment can process and respond the first operation.

Fig. 6 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention one, electronic equipment in this example can by the first multi-medium data simultaneous display in the first display unit 60 and the second display unit 61, and described first display unit 60 is arranged in described electronic equipment; It is characterized in that, described electronic equipment comprises: the first acquiring unit 62, second acquisition unit 63, resolution unit 64, first converter unit 65 and performance element 66; Wherein,

Described first acquiring unit 62, for obtaining the first parameter of described first display unit 60, and the second parameter of described second display unit 61;

Described second acquisition unit 63, for obtaining the first operation to described first multi-medium data on described second display unit 61;

Described resolution unit 64, for resolving described first operation, obtains the first coordinate of described first operation;

Described first converter unit 65, for the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit 60;

Described performance element 66, for the second coordinate based on described first operation, performs described first operation.

It will be appreciated by those skilled in the art that the practical function of each unit in the electronic equipment shown in Fig. 6 can refer to the associated description of aforementioned information disposal route and understands.

Fig. 7 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention two, electronic equipment in this example can by the first multi-medium data simultaneous display in the first display unit 60 and the second display unit 61, and described first display unit 60 is arranged in described electronic equipment; It is characterized in that, described electronic equipment comprises: the first acquiring unit 62, second acquisition unit 63, resolution unit 64, first converter unit 65 and performance element 66; Wherein,

Described first acquiring unit 62, for obtaining the first parameter of described first display unit 60, and the second parameter of described second display unit 61;

Described second acquisition unit 63, for obtaining the first operation to described first multi-medium data on described second display unit 61;

Described resolution unit 64, for resolving described first operation, obtains the first coordinate of described first operation;

Described first converter unit 65, for the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit 60;

Described performance element 66, for the second coordinate based on described first operation, performs described first operation.

Preferably, described first converter unit 65 comprises: first determines subelement 651, first varitron unit 652; Wherein,

Described first determines subelement 651, for according to described first parameter and described second parameter, determines the first conversion parameter;

Described first varitron unit 652, for converting by first coordinate of described first conversion parameter to described first operation.

It will be appreciated by those skilled in the art that the practical function of each unit in the electronic equipment shown in Fig. 7 can refer to the associated description of aforementioned information disposal route and understands.

Fig. 8 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention three, electronic equipment in this example can by the first multi-medium data simultaneous display in the first display unit 60 and the second display unit 61, and described first display unit 60 is arranged in described electronic equipment; It is characterized in that, described electronic equipment comprises: the first acquiring unit 62, second acquisition unit 63, resolution unit 64, first converter unit 65 and performance element 66; Wherein,

Described first acquiring unit 62, for obtaining the first parameter of described first display unit 60, and the second parameter of described second display unit 61;

Described second acquisition unit 63, for obtaining the first operation to described first multi-medium data on described second display unit 61;

Described resolution unit 64, for resolving described first operation, obtains the first coordinate of described first operation;

Described first converter unit 65, for the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit 60;

Described performance element 66, for the second coordinate based on described first operation, performs described first operation.

Preferably, described first converter unit 65 comprises: second determines that subelement 653, judgment sub-unit 654, the 3rd determine subelement 655, second varitron unit 656; Wherein,

Described second determines subelement 653, for according to described first parameter and described second parameter, determines the viewing area of described first multi-medium data on described second display unit 61; Described viewing area is determined by the first frontier point and the second boundary point;

Described judgment sub-unit 654, for the first coordinate according to described first operation, judges that the coordinate of described first operation is whether between described first frontier point and the second boundary point, obtains the first judged result;

Described 3rd determines subelement 655, during for showing that when described first judged result described first operation is between described first frontier point and the second boundary point, according to the coordinate of described first parameter, described second parameter and described first frontier point and the second boundary point, determine the second conversion parameter;

Described second varitron unit 656, for converting by first coordinate of described second conversion parameter to described first operation.

It will be appreciated by those skilled in the art that the practical function of each unit in the electronic equipment shown in Fig. 8 can refer to the associated description of aforementioned information disposal route and understands.

Fig. 9 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention four, electronic equipment in this example can by the first multi-medium data simultaneous display in the first display unit 60 and the second display unit 61, and described first display unit 60 is arranged in described electronic equipment; It is characterized in that, described electronic equipment comprises: the first acquiring unit 62, second acquisition unit 63, resolution unit 64, first converter unit 65 and performance element 66; Wherein,

Described first acquiring unit 62, for obtaining the first parameter of described first display unit 60, and the second parameter of described second display unit 61;

Described second acquisition unit 63, for obtaining the first operation to described first multi-medium data on described second display unit 61;

Described resolution unit 64, for resolving described first operation, obtains the first coordinate of described first operation;

Described first converter unit 65, for the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit 60;

Described performance element 66, for the second coordinate based on described first operation, performs described first operation.

Preferably, described electronic equipment also comprises: determining unit 67, second converter unit 68;

Described determining unit 67, for based on the anglec of rotation, determines the 3rd conversion parameter;

Described second converter unit 68, for converting by second coordinate of described 3rd conversion parameter to described first operation;

Described performance element 66, also for based on the second coordinate after described conversion, performs described first operation.

It will be appreciated by those skilled in the art that the practical function of each unit in the electronic equipment shown in Fig. 9 can refer to the associated description of aforementioned information disposal route and understands.

Figure 10 is the structure composition schematic diagram of the electronic equipment of the embodiment of the present invention five, electronic equipment in this example can by the first multi-medium data simultaneous display in the first display unit 60 and the second display unit 61, and described first display unit 60 is arranged in described electronic equipment; It is characterized in that, described electronic equipment comprises: the first acquiring unit 62, second acquisition unit 63, resolution unit 64, first converter unit 65 and performance element 66; Wherein,

Described first acquiring unit 62, for obtaining the first parameter of described first display unit 60, and the second parameter of described second display unit 61;

Described second acquisition unit 63, for obtaining the first operation to described first multi-medium data on described second display unit 61;

Described resolution unit 64, for resolving described first operation, obtains the first coordinate of described first operation;

Described first converter unit 65, for the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit 60;

Described performance element 66, for the second coordinate based on described first operation, performs described first operation.

Preferably, described electronic equipment also comprises: image acquisition units 69;

Described image acquisition units 69, for gathering the first information and second information of destination object; The described first information characterizes the two dimensional surface information of described destination object, the one dimension depth information of destination object described in described second information representation;

Described second acquisition unit 63, also for obtaining the display region information that described first multi-medium data projects out;

Described resolution unit 64, also for resolving the described first information, the second information and described display region information, obtains the position coordinates of described destination object in described viewing area.

It will be appreciated by those skilled in the art that the practical function of each unit in the electronic equipment shown in Figure 10 can refer to the associated description of aforementioned information disposal route and understands.

In several embodiments that the application provides, should be understood that disclosed equipment and method can realize by another way.Apparatus embodiments described above is only schematic, such as, the division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, and as: multiple unit or assembly can be in conjunction with, maybe can be integrated into another system, or some features can be ignored, or do not perform.In addition, the coupling each other of shown or discussed each ingredient or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of equipment or unit or communication connection can be electrical, machinery or other form.

The above-mentioned unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, also can be distributed in multiple network element; Part or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.

In addition, each functional unit in various embodiments of the present invention can all be integrated in a processing unit, also can be each unit individually as a unit, also can two or more unit in a unit integrated; Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form that hardware also can be adopted to add SFU software functional unit realizes.

One of ordinary skill in the art will appreciate that: all or part of step realizing said method embodiment can have been come by the hardware that programmed instruction is relevant, aforesaid program can be stored in a computer read/write memory medium, this program, when performing, performs the step comprising said method embodiment; And aforesaid storage medium comprises: movable storage device, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various can be program code stored medium.

Or, if the above-mentioned integrated unit of the present invention using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.Based on such understanding, the technical scheme of the embodiment of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium, comprises some instructions and performs all or part of of method described in each embodiment of the present invention in order to make a computer equipment (can be personal computer, server or the network equipment etc.).And aforesaid storage medium comprises: movable storage device, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various can be program code stored medium.

The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; change can be expected easily or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection domain of described claim.

The above, be only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.

Claims (10)

1. an information processing method, is applied in electronic equipment, and described electronic equipment can by the first multi-medium data simultaneous display in the first display unit and the second display unit, and described first display unit is arranged in described electronic equipment; It is characterized in that, described method comprises:
Obtain the first parameter of described first display unit, and the second parameter of described second display unit;
Obtain the first operation to described first multi-medium data on described second display unit;
Resolve described first operation, obtain the first coordinate of described first operation;
According to described first parameter and the second parameter, the first coordinate to described first operation converts, and obtains the second coordinate to the first operation of described first multi-medium data on described first display unit;
Based on the second coordinate of described first operation, perform described first operation.
2. information processing method according to claim 1, it is characterized in that, when described first multi-medium data full screen display is on described first display unit and described second display unit, described according to described first parameter and the second parameter, the first coordinate to described first operation converts, and comprising:
According to described first parameter and described second parameter, determine the first conversion parameter;
Converted by first coordinate of described first conversion parameter to described first operation.
3. information processing method according to claim 1, it is characterized in that, when described first multi-medium data full screen display is shown on described second display unit in described first display unit, non-fully screen display, described according to described first parameter and the second parameter, the first coordinate to described first operation converts, and comprising:
According to described first parameter and described second parameter, determine the viewing area of described first multi-medium data on described second display unit; Described viewing area is determined by the first frontier point and the second boundary point;
According to the first coordinate of described first operation, judge that the coordinate of described first operation is whether between described first frontier point and the second boundary point, obtains the first judged result;
When described first judged result shows that described first operation is between described first frontier point and the second boundary point, according to the coordinate of described first parameter, described second parameter and described first frontier point and the second boundary point, determine the second conversion parameter;
Converted by first coordinate of described second conversion parameter to described first operation.
4. the information processing method according to any one of claims 1 to 3, is characterized in that, when described first display unit rotates an angle in the horizontal direction, described the second coordinate based on described first operation, performs described first operation, comprising:
Based on the anglec of rotation, determine the 3rd conversion parameter;
Converted by second coordinate of described 3rd conversion parameter to described first operation;
Based on the second coordinate after described conversion, perform described first operation.
5. the information processing method according to any one of claims 1 to 3, it is characterized in that, when described second display unit is arranged in described electronic equipment, described electronic equipment by described second display unit project out described first multi-medium data time, described electronic equipment also comprises image acquisition units; Described acquisition operates first of described first multi-medium data on described second display unit; Resolve described first operation, obtain the first coordinate of described first operation, comprising:
The first information and second information of destination object is gathered by described image acquisition units; The described first information characterizes the two dimensional surface information of described destination object, the one dimension depth information of destination object described in described second information representation;
Obtain the display region information that described first multi-medium data projects out;
Resolve the described first information, the second information and described display region information, obtain the position coordinates of described destination object in described viewing area.
6. an electronic equipment, described electronic equipment can by the first multi-medium data simultaneous display in the first display unit and the second display unit, and described first display unit is arranged in described electronic equipment; It is characterized in that, described electronic equipment comprises: the first acquiring unit, second acquisition unit, resolution unit, the first converter unit and performance element; Wherein,
Described first acquiring unit, for obtaining the first parameter of described first display unit, and the second parameter of described second display unit;
Described second acquisition unit, for obtaining the first operation to described first multi-medium data on described second display unit;
Described resolution unit, for resolving described first operation, obtains the first coordinate of described first operation;
Described first converter unit, for the first coordinate to described first operation converts according to described first parameter and the second parameter, obtains the second coordinate to the first operation of described first multi-medium data on described first display unit;
Described performance element, for the second coordinate based on described first operation, performs described first operation.
7. electronic equipment according to claim 6, is characterized in that, described first converter unit comprises: first determines subelement, the first varitron unit; Wherein,
Described first determines subelement, for according to described first parameter and described second parameter, determines the first conversion parameter;
Described first varitron unit, for converting by first coordinate of described first conversion parameter to described first operation.
8. electronic equipment according to claim 6, is characterized in that, described first converter unit comprises: second determines that subelement, judgment sub-unit, the 3rd determine subelement, the second varitron unit; Wherein,
Described second determines subelement, for according to described first parameter and described second parameter, determines the viewing area of described first multi-medium data on described second display unit; Described viewing area is determined by the first frontier point and the second boundary point;
Described judgment sub-unit, for the first coordinate according to described first operation, judges that the coordinate of described first operation is whether between described first frontier point and the second boundary point, obtains the first judged result;
Described 3rd determines subelement, during for showing that when described first judged result described first operation is between described first frontier point and the second boundary point, according to the coordinate of described first parameter, described second parameter and described first frontier point and the second boundary point, determine the second conversion parameter;
Described second varitron unit, for converting by first coordinate of described second conversion parameter to described first operation.
9. the electronic equipment according to any one of claim 6 to 8, is characterized in that, described electronic equipment also comprises: determining unit, the second converter unit;
Described determining unit, for based on the anglec of rotation, determines the 3rd conversion parameter;
Described second converter unit, for converting by second coordinate of described 3rd conversion parameter to described first operation;
Described performance element, also for based on the second coordinate after described conversion, performs described first operation.
10. the electronic equipment according to any one of claim 6 to 8, is characterized in that, described electronic equipment also comprises: image acquisition units;
Described image acquisition units, for gathering the first information and second information of destination object; The described first information characterizes the two dimensional surface information of described destination object, the one dimension depth information of destination object described in described second information representation;
Described second acquisition unit, also for obtaining the display region information that described first multi-medium data projects out;
Described resolution unit, also for resolving the described first information, the second information and described display region information, obtains the position coordinates of described destination object in described viewing area.
CN201310578185.XA 2013-11-18 A kind of information processing method and electronic equipment CN104656944B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310578185.XA CN104656944B (en) 2013-11-18 A kind of information processing method and electronic equipment

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201310578185.XA CN104656944B (en) 2013-11-18 A kind of information processing method and electronic equipment
US14/451,977 US9691357B2 (en) 2013-08-09 2014-08-05 Information processing method and electronic device thereof, image calibration method and apparatus, and electronic device thereof
DE102014111243.1A DE102014111243A1 (en) 2013-08-09 2014-08-07 Method and electronic device for processing information, method and device and electronic device for image calibration

Publications (2)

Publication Number Publication Date
CN104656944A true CN104656944A (en) 2015-05-27
CN104656944B CN104656944B (en) 2018-08-31

Family

ID=

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105426178A (en) * 2015-11-02 2016-03-23 广东欧珀移动通信有限公司 Terminal display system and display method of terminal system
CN105786235A (en) * 2014-12-26 2016-07-20 联想(北京)有限公司 Data processing method and electronic device
WO2018133357A1 (en) * 2017-01-18 2018-07-26 中兴通讯股份有限公司 Multi-screen interaction touch display method, apparatus, storage medium and terminal

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1952851A (en) * 2006-10-13 2007-04-25 广东威创日新电子有限公司 Electronic installation and method for realizing interactive display
CN101324804A (en) * 2007-06-14 2008-12-17 深圳市巨龙科教高技术股份有限公司 Large-screen interactive electronic white board and interactive method thereof
CN102419657A (en) * 2010-09-27 2012-04-18 南京芒冠光电科技股份有限公司 Interactive projector system
US20130162607A1 (en) * 2011-12-27 2013-06-27 Seiko Epson Corporation Projector and method of controlling projector

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1952851A (en) * 2006-10-13 2007-04-25 广东威创日新电子有限公司 Electronic installation and method for realizing interactive display
CN101324804A (en) * 2007-06-14 2008-12-17 深圳市巨龙科教高技术股份有限公司 Large-screen interactive electronic white board and interactive method thereof
CN102419657A (en) * 2010-09-27 2012-04-18 南京芒冠光电科技股份有限公司 Interactive projector system
US20130162607A1 (en) * 2011-12-27 2013-06-27 Seiko Epson Corporation Projector and method of controlling projector

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105786235A (en) * 2014-12-26 2016-07-20 联想(北京)有限公司 Data processing method and electronic device
CN105426178A (en) * 2015-11-02 2016-03-23 广东欧珀移动通信有限公司 Terminal display system and display method of terminal system
CN105426178B (en) * 2015-11-02 2019-03-08 Oppo广东移动通信有限公司 Display system, the display methods of terminal system of terminal
WO2018133357A1 (en) * 2017-01-18 2018-07-26 中兴通讯股份有限公司 Multi-screen interaction touch display method, apparatus, storage medium and terminal

Similar Documents

Publication Publication Date Title
US8730309B2 (en) Projectors and depth cameras for deviceless augmented reality and interaction
US10261594B2 (en) Systems and methods of creating a realistic displacement of a virtual object in virtual reality/augmented reality environments
US9069386B2 (en) Gesture recognition device, method, program, and computer-readable medium upon which program is stored
Bowman et al. New directions in 3d user interfaces
KR101351162B1 (en) Terminal apparatus and method for supporting list selection using flicking
CN102576268B (en) Interactive surface with a plurality of input detection technologies
JP2004199496A (en) Information processor and method, and program
KR20100041006A (en) A user interface controlling method using three dimension multi-touch
US20160283054A1 (en) Map information display device, map information display method, and map information display program
US20110074719A1 (en) Gesture detecting method for touch panel
KR100783552B1 (en) Input control method and device for mobile phone
US20140129990A1 (en) Interactive input system having a 3d input space
US20100241999A1 (en) Canvas Manipulation Using 3D Spatial Gestures
JP2006268840A (en) Automatic layout of item along embedded one-manifold path
KR20140098904A (en) Operating Method of Multi-Tasking and Electronic Device supporting the same
JP4752921B2 (en) Information processing apparatus, animation adding method, and program
US9652115B2 (en) Vertical floor expansion on an interactive digital map
CN104011629B (en) For enhanced target selecting method, equipment and the system of the user interface that can carry out the input based on touch
KR20040081854A (en) Motion recognition system using a imaginary writing plane and method thereof
US9940013B2 (en) Display device for controlling displaying of a window and method of controlling the same
RU2524836C2 (en) Information processor, processing method and programme
CZ20021778A3 (en) Three-dimensional windows of graphic user interface
TWI539357B (en) Compact control menu for touch-enabled command execution
JP4957857B2 (en) Document folding display device and program
CN101730874A (en) Touchless gesture based input

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
GR01 Patent grant
GR01 Patent grant