Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
Method embodiment one
Shown in accompanying drawing 1, the embodiment of the invention provides a kind of method of computer operation portable terminal, and this method may further comprise the steps:
Step 11 receives the interface image on the display screen of the said portable terminal that said portable terminal sends;
At first, portable terminal and computing machine need be set up data communication; In the art, because the usb data communication transfer rate is high, and USB interface is very general in computing machine and mobile terminal configuration, therefore, is as the preferred mode of data communication in embodiments of the present invention.
Secondly, preferred, the embodiment of the invention provides two kinds of portable terminals that the interface image on the display screen is sent to computer method:
Method one, portable terminal are initiatively sent image information to computing machine according to the image refreshing situation on the display screen;
Preferably, concrete steps can comprise: the image in the monitoring video memory; When the image in monitoring said video memory has renewal, the image of said renewal is sent to said computing machine; The process of concrete realization repeats no more at this: such as with there being the image of renewal to read out in the portable terminal video memory, form picture, with picture compression, be sent to computing machine or the like.When the image in the video memory was in continuous Flushing status, portable terminal can such as 1/24,1/30 second, send image to computing machine at a certain time interval continuously.
Method two, portable terminal is sent to computing machine according to the request that the computing machine that receives sends with the picture information on the mobile terminal display screen.
Preferably, concrete steps can comprise: the request of the image on the video memory that obtains said portable terminal that sends with receiving said computer cycle property; According to the described request that receives, the image in the video memory is sent to said computing machine.Such as, computing machine is for example set per second and is sent 24 or 30 applications according to the frequency of setting; Send image on one's own initiative and obtain application to portable terminal; After portable terminal receives that image obtains application, after the packing of the view data in the current video memory, through sending to computing machine such as USB.The process of concrete realization repeats no more at this.
Step 12, said computer screen show the interface image on the display screen of said portable terminal;
Preferably; Interface image on the display screen of the said portable terminal that said computer screen demonstration receives can comprise: with the display resolution of said portable terminal, the interface dimensions of the image of the interface on the said mobile terminal display screen is amplified the back on computer screen, show.Because it is the image with portable terminal original resolution that portable terminal sends to the image of computing machine, if directly be presented on the computer display, it is very little to seem.Therefore, computing machine can amplify the back such as equal proportion with the interface dimensions of image and show, to guarantee better user experience.Relate to concrete procedure for displaying therebetween, repeat no more at this: the visual decompress(ion) such as computing machine will receive, be pushed in the display chip and handle, on display screen, show or the like then.
Preferably; When the interface on the display screen of computer screen demonstration portable terminal is visual; In order not influence the application program that operational computations machine self is installed; Can the above-mentioned image that shows be set to an interfaces windows, this window is such as the operating function that is provided with " minimizing ", " closing ", " reduction ", and the user can operate this interfaces windows as required like this.Such as, the user can temporarily minimize to this interfaces windows on the taskbar, thus other application programs of can operational computations machine self installing.
Step 13 is obtained the input equipment Action Events;
This Action Events is the incident at the interface on the display screen of operating the said portable terminal that shows on the said computer screen through the input equipment on the said computing machine.The input equipment of computing machine comprises mouse, keyboard, touch-screen input etc.Below, be that example is described with mouse, keyboard:
One of which, when input equipment was mouse, the then said input equipment Action Events that obtains comprised the mouse action incident of obtaining, preferred, the said mouse action incident of obtaining specifically comprises:
Show in the interface image of the said portable terminal that the mouse pointer that shows in the said operation system of computer is shown in said computer screen.Because in the interface image on the mobile terminal display screen that computer screen shows; Can not demonstrate mouse pointer; Then need show in the image with the portable terminal of the mouse pointer that shows in the operation system of computer on display screen, could utilize mouse action like this.
Obtain the coordinate of certain point of clicking in the interface image of the said portable terminal that said mouse shows in said computer screen.Such as, this point is the icon of certain application program in the image of the portable terminal on the computer display.
Its two, when input equipment was keyboard, the then said input equipment Action Events that obtains comprised the keyboard operation incident of obtaining, the said keyboard operation incident of obtaining specifically comprises: obtain the physics key assignments that the button operation of said keyboard produces.
Computing machine to use windows operating system is example, and definition has the button value table of computer keyboard on it, has write down the button of keyboard and the corresponding relation of physics key assignments.Such as, the user pushes button 1, can produce a physics key assignments, and such as being 0xAB, computing machine receives 0xAB, promptly gets access to the keyboard operation incident.
Preferably, in order to prevent maloperation, computing machine obtains mouse and/or the keyboard operation incident comprises following optimization:
1. when the visual interfaces windows in the interface on the corresponding mobile terminal display screen is activated demonstration on computer screen when, just obtain corresponding mouse and/or KeyEvent;
2. the mouse pointer on computer display when moving within the interface image that shows mobile terminal display screen, just obtains mouse event;
3. for KeyEvent; When the user was carrying out click within the interface image corresponding to portable terminal on the computer display; To work as the application program of self installing of pre-editing from the computer operating system operation; Move on to corresponding to after the application program on the portable terminal, computing machine is just collected corresponding KeyEvent.
Like this; If the user in the process of operating mobile terminal that uses a computer, temporarily with on the computer display corresponding to the interfaces windows of the interface image of portable terminal, such as narrowing down on the taskbar; And during the application program that operational computations machine self is installed; Perhaps on computer screen, there are two interfaces windows simultaneously--a interfaces windows for the interface image of portable terminal, one is the interfaces windows of the application program of computer operating system self installation, the user is when two interfaces windows blocked operations; Mouse and/or keyboard operation incident that the user carries out to the application program that computing machine self is installed can not collected by computing machine.
Step 14 sends to said portable terminal with said input equipment Action Events, operates accordingly so that said portable terminal responds said input equipment Action Events.
Computing machine is with the form of the input equipment Action Events that gets access to packet, through being sent to portable terminal such as USB interface.
Mobile terminal of touch screen to support the touch-screen input is an example, should convert said input equipment Action Events into Action Events that mobile terminal of touch screen can be discerned, is that example is described with mouse and keyboard still below:
One of which converts the Action Events that portable terminal can be discerned into about the mouse action incident, and it mainly comprises the steps:
1. said mouse is become the coordinate on the display screen at said portable terminal at the coordinate transformation of certain point of the said click on the computer screen;
With reference to figure 2, the flow process that specifically converts can for:
1) obtain the coordinate of current mouse pointer M loca N, be made as (x, y);
2) under the interfaces windows W of the current activation of computer display P, obtain the coordinate of four jiaos of A/B/C/D of mobile terminal display screen image E, be made as respectively (Xa, Ya), (Xb, Yb), (Xc, Yc), (Xd, Yd);
3) obtain the resolution information of mobile terminal display screen, be made as L * H;
4), calculate the mouse pointer position corresponding to point coordinate Px, Py on the touch-screen of portable terminal according to as above information:
Px=L×(x-Xa)/(Xc-Xa)
Py=H×(y-Ya)/(Yb-Ya)
2. convert the click operation into touch operation;
Convert click operation into touch operation, essence be with left mouse button (is that the custom operator is an example with the right hand) press and lift action, convert the click of touch-screen into and lift action.
Like this, on computer display, mouse pointer moves to certain point and when pressing, and computing machine can be according to above-described switch process, converts the touch operation that need send to portable terminal and the concrete coordinate on touch-screen to.
3. the said touch operation that is converted into after coordinate on the display screen of said portable terminal and said conversion is sent to said portable terminal.
Its two, convert the Action Events that portable terminal can be discerned into about the keyboard operation incident:
Usually, support the mobile terminal of touch screen of touch-screen input, its keyboard is generally dummy keyboard, such as touch key-press.
It mainly comprises the steps:
1. the concrete button of the physics key assignments inquiry keyboard that produces according to the button operation of said keyboard;
As stated, Computer Storage has the button of keyboard and the corresponding relation of physics key assignments, and according to this corresponding relation, computing machine can inquire concrete button.Such as, computing machine receives 0xAB, through inquiry, can know it is button 1.
2. inquire about the physics key assignments of the button of said concrete button correspondence on said portable terminal keyboard according to said concrete button;
Also store the button value table of the keyboard on the said portable terminal on the computing machine, it has write down button and the corresponding relation of physics key assignments of the keyboard of portable terminal.According to this corresponding relation, computing machine can inquire the physics key assignments of the button that the concrete button correspondence on the keyboard of computing machine can discern at portable terminal.Such as, computing machine inquires according to button 1, and the physics key assignments of corresponding key 1 is 0xab on portable terminal.Like this, if portable terminal receives 0xab, be equivalent on portable terminal, supress button 1 the user.
3. the physics key assignments with the button of said concrete button on said portable terminal is sent to said portable terminal.
At last, after portable terminal receives the input equipment Action Events from said computing machine transmission, operate accordingly.
Though more than be to be that example is described obtaining and sending of input equipment Action Events with mouse and keyboard; But be based on above description; Those skilled in the art can realize supporting the obtaining and sending of touch screen operation incident of the computing machine of touch-screen input fully; Can comprise such as its process: obtain the coordinate of touch point, changing this coordinate is the coordinate on the mobile terminal display screen, sends coordinate after the said conversion or the like.
Further, portable terminal can also be provided with a computer operating modes, such as; Increase the option of a computer operating modes, after portable terminal and computing machine are set up data communication, if after the user selects this option; Computer operating modes promptly is activated, and portable terminal will (be accomplished the operation to portable terminal such as, mobile terminal receive keyboard, touch-screen incoming event from normal mode of operation; Be presented on the display screen of portable terminal) switch to computer operating modes, under this pattern, portable terminal is incoming event such as mobile terminal receive keyboard no longer; But receive the input equipment Action Events that sends from the computer-side of setting up usb data communication; Preferably, the display screen of portable terminal can be closed, and reaches purpose of power saving; It will be appreciated by those skilled in the art that; The option that on portable terminal, increases computer operating modes neither be necessary; When portable terminal is communicated with computing machine; Daemon software on portable terminal and the computing machine can automatically switch to computer operating modes after setting up and communicating by letter, and perhaps points out the user whether need activate computer operating modes.
In the present embodiment; Behind the interface image on the display screen of the said portable terminal that the computing machine mobile terminal receive sends; It is shown on computer screen, be sent to portable terminal after the Action Events at the interface of the portable terminal on the input equipment operational computations machine display screen is obtained, so that portable terminal is operated after receiving accordingly; Can realize operation at common computing machine like this, thereby improve user experience portable terminal.
Method embodiment two
As, shown in the accompanying drawing 3, the embodiment of the invention provides a kind of computer operation method of portable terminal.This method is corresponding with the method for announcement among the method embodiment one.Similarly step is not described in detail.
Said method comprises:
Step 21 is sent interface image on the display screen of said portable terminal to said computing machine, so that said computing machine shows the interface image on the display screen of said portable terminal after receiving on said computer screen;
Step 22 receives the input equipment Action Events that sends from said computing machine; Wherein, said Action Events is the incident at the interface on the display screen of operating the said portable terminal that shows on the said computer screen through the input equipment on the said computing machine;
Step 23 responds said input equipment Action Events and operates accordingly.
Wherein, the image of the interface on the display screen of the said portable terminal of said transmission to said computing machine can be specially: the image in the monitoring video memory; When the image in monitoring said video memory has renewal, the image of said renewal is sent to said computing machine;
The request of the image on the video memory that obtains said portable terminal that perhaps, sends with receiving said computer cycle property; According to the described request that receives, the image in the video memory is sent to said computing machine.
In the embodiment of the invention; Portable terminal is sent to computing machine with the interface image on the display screen; So that computing machine shows it after receiving said image on computer screen; Computing machine is sent to portable terminal after the Action Events at the interface of the portable terminal on the input equipment operational computations machine display screen is obtained, move receive said Action Events after, operate accordingly.Can realize operation at common computing machine like this, thereby improve user experience portable terminal.
Apparatus embodiments one
Shown in accompanying drawing 4, the embodiment of the invention provides a kind of computing machine 3, and said computing machine comprises:
Image receiving element 31 is used to receive the interface image on the display screen of the said portable terminal that said portable terminal sends;
Visual display unit 32 is used for the image on the display screen that said computer screen shows the said portable terminal that receives;
Acquiring unit 33 is used to obtain the input equipment Action Events, and wherein, this Action Events is the incident at the interface on the display screen of operating the said portable terminal that shows on the said computer screen through the input equipment on the said computing machine;
Transmitting element 34 is used for said input equipment Action Events is sent to said portable terminal, operates accordingly so that said portable terminal responds said input equipment Action Events;
Further, said visual display unit 32 also comprises: the enlarged and displayed unit, be used for display resolution with said portable terminal, and the interface dimensions of the image of the interface on the said mobile terminal display screen is amplified the back on computer screen, show;
Further, said acquiring unit 33 also comprises: mouse action incident acquiring unit is used to obtain the mouse action incident; Said mouse action incident acquiring unit comprises:
The mouse display unit shows in the interface image of the said portable terminal that the mouse pointer that is used for that said operation system of computer is shown shows in said computer screen;
The coordinate acquiring unit is used for obtaining the coordinate of certain point that said mouse clicks in the interface image of the said portable terminal that said computer screen shows.
Said transmitting element 34 comprises mouse action incident transmitting element, is used for the mouse action incident is sent to said portable terminal; When said portable terminal was supported touch screen operation, said mouse action incident transmitting element comprised:
Coordinate transformation unit is used for said mouse is become the coordinate on the display screen at said portable terminal at the coordinate transformation of certain point of the said click on the computer display;
The operation converting unit is used for converting said click operation into touch operation;
The conversion transmitting element is used for the said touch operation that is converted into after coordinate on the display screen of said portable terminal and said conversion is sent to said portable terminal.
Further, said acquiring unit 33 also comprises keyboard operation incident acquiring unit, is used to obtain the keyboard operation incident; Said keyboard operation incident acquiring unit comprises: physics key assignments acquiring unit is used to obtain the physics key assignments that the button operation of said keyboard produces.
Further, said computing machine also comprises storage unit 35, is used to store the corresponding relation of the physics key assignments of concrete button of said computer keyboard and button, and the corresponding relation of the physics key assignments of said portable terminal keyboard and button;
Said transmitting element 34 comprises keyboard operation incident transmitting element; When said portable terminal was supported touch screen operation, said keyboard operation incident transmitting element also comprised:
Query unit; The physics key assignments that is used for producing according to the button operation of said keyboard inquires the concrete button of said keyboard from said storage unit, and from said storage unit, inquires the physics key assignments of the button of said concrete button correspondence on said portable terminal keyboard according to the concrete button of said keyboard;
Physics key assignments transmitting element is used for the physics key assignments of the button of said concrete button correspondence on said portable terminal keyboard is sent to said portable terminal.
In the embodiment of the invention; Behind the interface image on the display screen of the said portable terminal that the said portable terminal of image receiving element 31 receptions sends; Visual display unit 32 shows the interface image on the display screen of said portable terminal at said computer screen; Acquiring unit 33 obtains the input equipment Action Events then; Transmitting element 34 sends to said portable terminal with said operation of input equipment incident, operates accordingly so that said portable terminal responds said input equipment Action Events.Can realize operation at common computing machine like this, thereby improve user experience portable terminal.
Apparatus embodiments two
Shown in accompanying drawing 4, the embodiment of the invention also provides a kind of portable terminal 4, and said portable terminal comprises:
Image transmitting element 41 is used for said portable terminal and sends the visual extremely said computing machine in interface on the display screen, so that said computing machine shows the interface image on the display screen of said portable terminal after receiving on said computer screen;
Receiving element 42 is used for said portable terminal and receives the input equipment Action Events that sends from said computing machine; Wherein, said Action Events is the incident at the interface on the display screen of operating the said portable terminal that shows on the said computer screen through the input equipment on the said computing machine;
Operating unit 43 is used to respond said input equipment Action Events and operates accordingly.
Further, said visual transmitting element 41 also comprises: monitoring unit is used for monitoring the image of video memory; First transmitting element is used for when image that said monitoring unit monitors said video memory has renewal, and the image of said renewal is sent to said computing machine;
Perhaps, said visual transmitting element 41 also comprises: receiving element, the request of the image on the video memory that obtains said portable terminal that is used to send with receiving said computer cycle property; Second transmitting element is used for according to the described request that receives the image in the video memory being sent to said computing machine.
Further, said portable terminal is a mobile phone, and said mobile phone also comprises: radio circuit, microphone, loudspeaker, power supply;
Said radio circuit is used to set up communicating by letter of mobile phone and wireless network, realizes the Data Receiving and the transmission of mobile phone and wireless network;
Said microphone is used to obtain sound and the sound that obtains is converted into voice data, so that said mobile phone sends said voice data through said radio circuit to wireless network;
Said loudspeaker is used for said mobile phone is passed through said radio circuit from the voice data that wireless network receives, and is reduced to sound and plays this sound to the user;
Said power supply is used to each circuit or the device power supply of said mobile phone.
In the embodiment of the invention; Interface image on the display screen of image transmitting element 41 transmission portable terminals is to said computing machine; Said computing machine shows the interface image on the display screen of said portable terminal on said computer screen; After receiving element 42 received the input equipment Action Events that sends from said computing machine, the said input equipment Action Events of operating unit 43 responses was operated accordingly.Can realize operation at common computing machine like this, thereby improve user experience portable terminal.
One of ordinary skill in the art will appreciate that all or part of flow process that realizes in the foregoing description method; Be to instruct relevant hardware to accomplish through computer program; Described program can be stored in the computer read/write memory medium; This program can comprise the flow process like the embodiment of above-mentioned each side method when carrying out.Wherein, described storage medium can be disk, CD, read-only storage memory body (Read-Only Memory, ROM) or at random store memory body (Random Access Memory, RAM) etc.
In a word, the above is merely preferred embodiment of the present invention, is not to be used to limit protection scope of the present invention.All within spirit of the present invention and principle, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.