CN102073376B - Portable wireless operation system and method - Google Patents

Portable wireless operation system and method Download PDF

Info

Publication number
CN102073376B
CN102073376B CN2010105840750A CN201010584075A CN102073376B CN 102073376 B CN102073376 B CN 102073376B CN 2010105840750 A CN2010105840750 A CN 2010105840750A CN 201010584075 A CN201010584075 A CN 201010584075A CN 102073376 B CN102073376 B CN 102073376B
Authority
CN
China
Prior art keywords
human
module
computer interaction
interaction interface
mobile wireless
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN2010105840750A
Other languages
Chinese (zh)
Other versions
CN102073376A (en
Inventor
谢翔
李国林
邓仰东
谷荧柯
孙天佳
王丹
胡军
王志华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN2010105840750A priority Critical patent/CN102073376B/en
Publication of CN102073376A publication Critical patent/CN102073376A/en
Application granted granted Critical
Publication of CN102073376B publication Critical patent/CN102073376B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Position Input By Displaying (AREA)

Abstract

The invention discloses a portable wireless operation system which comprises a portable wireless operation device and a remote service device conducting wireless communication with the portable wireless operation device, wherein the portable wireless operation device is used for receiving human-machine interaction interface data of the remote service device, projecting the human-machine interaction interface on a plane to obtain user operation action data on the projected human-machine interaction interface, and sending the user operation action data to the remote service device; and the remote service device is used for receiving the user operation action data from the portable wireless operation device, resolving the user operation action data into an operating command, executing the operating command, and sending the human-machine interaction interface data of the execution result to the portable wireless operation device. The invention realizes the operation of the remote service device by using the portable wireless operation device, thereby facilitating observation and operation of the remote service device.

Description

Portable mobile wireless operating system and method
Technical field
The present invention relates to wireless communication technology field, particularly a kind of portable mobile wireless operating system and method.
Background technology
Use a computer easily whenever and wherever possible, electronic equipment such as mobile phone comes work, leisure, amusement, is that people want an important goal realizing always.But existing solution does not reach good effect always, on the one hand, though existing mobile phone has had the computer function of part, because handset size is too small, causes display screen little, is not suitable for the people and observes; Cause keyboard little, inconvenient user's operation; On the other hand, existing notebook computer can be carried, but because size and weight are excessive, very inconvenient, if notebook designs very for a short time, then can cause occurring the situation the same with existing mobile phone, still inconvenient user uses.
In addition; The most existing electronic equipment all exists external control panel and display panel; These control panels and display panel are in fact concerning the reliability and stability of equipment; Can affect greatly, simultaneously also can be owing to external control panel and display panel make the size of equipment become greatly.When particularly equipment is worked under some special rugged surroundings; Operating personnel are not suitable for physically control panel and the display panel near equipment, and there is very big drawback in this direct control method to equipment, even remote-controlled equipment; For easy to operate; Observe comfortablely, the volume and weight of this controllable device also can be bigger, and is not portable.
In sum, existing electronic equipment has disadvantage:
1, control panel or size of display panels are little, are not suitable for observing and operation;
2, it is bigger to have the electronic equipment volume and the weight of control panel or display panel, is inconvenient to carry;
3, it is poor to have reliability and stability of electronic equipment of control panel or display panel, can not adapt under some special rugged surroundings and work.
Summary of the invention
The technical matters that (one) will solve
The technical matters that the present invention will solve is, to above-mentioned defective, how a kind of portable mobile wireless operating system and method is provided, the convenient observation and operating electronic equipment, and electronic equipment can be adapted under some special rugged surroundings work.
(2) technical scheme
For solving the problems of the technologies described above, the invention provides a kind of portable mobile wireless operating system, said portable mobile wireless operating system comprises:
The portable mobile wireless operating means with carry out the remote service device that radio communication is connected with said portable mobile wireless operating means; Wherein,
Said portable mobile wireless operating means is used for the human-computer interaction interface data of receiving remote service unit; And be projected in this human-computer interaction interface on the plane; Obtain the user's operational motion data on the human-computer interaction interface of institute's projection, and send to said remote service device to these user's operational motion data;
After said remote service device is used for receiving user's operational motion data from said portable mobile wireless operating means; With the data parsing of said user's operational motion is operational order; Carry out this operational order, and send to said portable mobile wireless operating means to the human-computer interaction interface data of execution result.
Preferably, said portable mobile wireless operating means is further used for sending the service startup command to the remote service device;
Said remote service device is further used for returning the human-computer interaction interface data according to the said service startup command that receives to said portable mobile wireless operating means.
Preferably, said remote service device comprises service module, interface processing module and second radio receiving transmitting module; Wherein,
Said second radio receiving transmitting module is used for the user's operational motion data that are received from said portable mobile wireless operating means are sent to said interface processing module; The human-computer interaction interface data that are received from said interface processing module are sent to said portable mobile wireless operating means;
Said interface processing module, being used for the user's operational motion data parsing that is received from said second radio receiving transmitting module is to be sent to said service module after the operational order; Be sent to said second radio receiving transmitting module after the human-computer interaction interface data that are received from said service module are compressed;
Said service module is used to carry out the operational order that is received from said interface processing module, and is sent to said interface processing module to the human-computer interaction interface data of execution result.
Preferably, said portable mobile wireless operating means comprises one or more projection modules, one or more image sensing module, image processing module and first radio receiving transmitting module; Wherein,
Said first radio receiving transmitting module is used for the human-computer interaction interface data that are received from said remote service device are sent to said graphics processing unit; The user's operational motion data that are received from said graphics processing unit are sent to said remote service device;
Said graphics processing unit is used for sending to said projection module after the human-computer interaction interface data decompression that is received from said first radio receiving transmitting module; The user's operational motion data that are received from said image sensing module are handled, obtaining user's operational motion data, and said user's operational motion data are sent to said first radio receiving transmitting module;
Said one or more projection module is used to receive the human-computer interaction interface data from said graphics processing unit, and to one or more planes, forms images this human-computer interaction interface data projection;
Said one or more image sensing module is used to gather the image information data that the user operates to human-computer interaction interface, and sends it to said graphics processing unit.
Preferably, said user's operational motion data comprise the track that the relative coordinate in the human-computer interaction interface zone and finger were slided when the user passed through the action data in finger manipulation human-computer interaction interface zone, finger manipulation at least in the human-computer interaction interface zone; Said image sensing module comprises two-dimensional image information sensor, picture depth sensor or the combination of the two; Said image information data comprises the three-dimensional image information of two-dimensional image information, picture depth information or the two combination; Said human-computer interaction interface is that last user operates the human-computer interaction interface of reservation when withdrawing from or preset human-computer interaction interface; Said human-computer interaction interface data are static or dynamic images; Data transmit-receive mode between said portable mobile wireless operating means and the said remote service device comprises the radio magnetic wave mode, optical communication mode, or other communication; Said plane is metope, desktop or paper surface; Said projection module is a plurality of, and each projection module carries out projection with the part of received human-computer interaction interface to Different Plane or conplane zones of different.
Preferably, said interface processing module comprises computing machine or the computer network system that has handled software, and said service module comprises computing machine or the computer network system that has corresponding execution process software; Or,
First radio receiving transmitting module in the said portable mobile wireless operating means is the radio receiving transmitting module in the mobile phone; Said projection module, image sensing module and image processing module are integrated in the mobile phone; And second radio receiving transmitting module of said remote service device is the wireless communication system in the base station, and interface processing module and service module are the computer network system that has handled software.
For solving the problems of the technologies described above, the present invention also provides a kind of method of operating of above-mentioned portable mobile wireless operating system, and said method of operating comprises:
Steps A: the human-computer interaction interface data of portable mobile wireless operating means receiving remote service unit; And be projected in this human-computer interaction interface on the plane; Obtain the user's operational motion data on the human-computer interaction interface of institute's projection, and send to said remote service device to these user's operational motion data;
Step B: the remote service device is an operational order with the user's operational motion data parsing that receives, and carries out this operational order, and sends to said portable mobile wireless operating means to the human-computer interaction interface data of execution result.
Preferably, before the steps A, said method of operating further comprises:
Step: A0: the portable mobile wireless operating means sends the service startup command to the remote service device, and said remote service device returns the human-computer interaction interface data according to the said service startup command that receives to said portable mobile wireless operating means.
Preferably, said step B specifically comprises:
Step B1: after user's operational motion data parsing that the interface processing module will be received from second radio receiving transmitting module is the executable operational order of service module, send to service module;
Step B2: service module is carried out the operational order be received from said interface processing module, and compresses the human-computer interaction interface data of execution result through said interface processing module and then to send to the portable mobile wireless operating means by said second radio receiving transmitting module.
Preferably, said steps A specifically comprises:
After decompressing through graphics processing unit, the human-computer interaction interface data that 1: the first radio receiving transmitting module of steps A will be received from said remote service device are sent to projection module;
Steps A 2: projection module is with forming images on human-computer interaction interface data projection to a plane that receives;
Steps A 3: image sensing module is gathered the image information data that the user operates to human-computer interaction interface, and said image information data is sent to said remote service device via said graphics processing unit and said first radio receiving transmitting module.
(3) beneficial effect
The present invention proposes a kind of portable mobile wireless operating system and method,, and be projected in this interface on the plane through the user interface data of portable mobile wireless operating means receiving remote service unit; Obtain the operating gesture information of user on the projection operation interface, and be transferred to the remote service device to this operating gesture information wireless, through the remote service device this operating gesture is resolved to operational order at last; And carry out should order, and returns the portable mobile wireless operating means to a user interface data wireless transmission of carrying out the result that the back obtained, to upgrade the user interface of projection; Reach the user and on the portable mobile wireless operating means, accomplish operation the remote service device; Based on this scheme can realize the user at any time with any place, utilize the portable mobile wireless operating means to realize operation, the convenient observation and operation remote service device to the remote service device; And the remote service device can be adapted under some special rugged surroundings work; And, therefore improved the reliability and stability of its work greatly because the remote service device can need not control panel and display panel, such as; Afloat remote service device; Need waterproof, anti-salt fog, protection against the tide,, will make that its three anti-characteristic is better if do not have control panel and display panel.
Description of drawings
Fig. 1 is the structural representation of the portable mobile wireless operating system of the embodiment of the invention;
Fig. 2 is the flow chart of portable mobile wireless operating system in the embodiment of the invention;
Fig. 3 is the method flow diagram of steps A in the method for operating shown in Figure 2;
Fig. 4 is the method flow diagram of step B in the method for operating shown in Figure 2.
Embodiment
Below in conjunction with accompanying drawing and embodiment, specific embodiments of the invention describes in further detail.Following examples are used to explain the present invention, but are not used for limiting scope of the present invention.
Fig. 1 is the structural representation of the portable mobile wireless operating system of the embodiment of the invention; Of Fig. 1, portable mobile wireless operating system of the present invention comprises the portable mobile wireless operating means and carries out the remote service device that radio communication is connected with said portable mobile wireless operating means; Wherein, Said portable mobile wireless operating means is used for the human-computer interaction interface data of receiving remote service unit; And be projected in this human-computer interaction interface on the plane; Obtain the user's operational motion data on the human-computer interaction interface of institute's projection, and send to said remote service device to these user's operational motion data; After said remote service device is used for receiving user's operational motion data from said portable mobile wireless operating means; With the data parsing of said user's operational motion is operational order; Carry out this operational order, and send to said portable mobile wireless operating means to the human-computer interaction interface data of execution result.
Said portable mobile wireless operating means is further used for sending the service startup command to the remote service device; Said remote service device is further used for returning human-computer interaction interface data (said human-computer interaction interface can be the human-computer interaction interface of last user's operation when withdrawing from, and also can be the human-computer interaction interface of presetting) according to the said service startup command that receives to said portable mobile wireless operating means.The remote service device generally is in the wait accepting state; In the time of after the portable mobile wireless operating means starts, maybe need starting service to the remote service device send have the service startup command of respective identification after; This remote service device identifies after the said service startup command according to this sign and returns corresponding human-computer interaction interface data to said portable mobile wireless operating means (said human-computer interaction interface can be the human-computer interaction interface that last user's operation keeps when withdrawing from; Also can be the human-computer interaction interface of presetting), said human-computer interaction interface data can be static or dynamic images.Data transmit-receive mode between said portable mobile wireless operating means and the said remote service device can comprise the radio magnetic wave mode, optical communication mode, or other communication.
Said portable mobile wireless operating means comprises projection module, image sensing module, image processing module and first radio receiving transmitting module;
Said first radio receiving transmitting module is used for the human-computer interaction interface data that are received from said remote service device are sent to said graphics processing unit; The user's operational motion data that are received from said graphics processing unit are sent to said remote service device;
Said graphics processing unit is used for behind the human-computer interaction interface data decompression that is received from said first radio receiving transmitting module or directly send to said projection module; The user's operational motion data that are received from said image sensing module are handled; To obtain user's operational motion data; And after the data compression of user's operational motion or directly be sent to said first radio receiving transmitting module, said user's operational motion data comprise the track that the relative coordinate in the human-computer interaction interface zone and finger were slided when the user passed through the action data in finger manipulation human-computer interaction interface zone, finger manipulation at least in the human-computer interaction interface zone;
Said projection module is used to receive the human-computer interaction interface data from said graphics processing unit, and forming images on this human-computer interaction interface data projection to a plane, such as metope, desktop, paper surface etc.;
Said image sensing module is used to gather the image information data that the user operates to human-computer interaction interface, and sends it to said graphics processing unit; Said image sensing module can comprise two-dimensional image information sensor, picture depth sensor or the combination of the two.
When carrying out gesture operation on the human-computer interaction interface zone that the user is projecting; Said image sensing module will be gathered the image information data of user's everything in the human-computer interaction interface zone of projection; According to the difference that adopts image sensing module, this image information data can comprise the three-dimensional image information of two-dimensional image information, picture depth information or the two combination.
In the present embodiment; The human-computer interaction interface data that said first radio receiving transmitting module receives comprise keyboard interface viewing area and content interface viewing area of a similar computing machine; Form a virtual keyboard area and content area through said projection module; Wherein said projection module can be one or more; To accomplish projection to human-computer interaction interface, promptly can be divided into received human-computer interaction interface several parts, every part interface is carried out projection by different projection modules to Different Plane or conplane zones of different.
Said image sensing module is pointed the real time video image that knocks keyboard in the dummy keyboard zone through obtaining the user, and by said graphics processing unit this video image information is handled, to obtain the action data of user's operation keyboard; In addition; When in the user utilizes the content interface viewing area of finger in projection, sliding; Said image sensing module also will obtain the real time video image that user's finger slides in the interface of projection; Also this video image information is handled, to obtain the relevant path coordinate (with the action of the mouse move operation in the analog computer) that user's finger slides in the content interface viewing area of projection by image processing module; Equally; Said image sensing module can be gathered the realtime graphic (operation that the mouse in the analog computer is double-clicked and clicked) of operations such as the user adopts that finger is double-clicked or clicked on the content interface viewing area; By said image processing module this application drawing is looked like to carry out real-time analysis; To obtain the action of finger manipulation content interface viewing area; And the relative coordinate in this interface zone during finger manipulation, send to said remote service device to above-mentioned these user's operational motion data through said first radio receiving transmitting module at last.
Equally, for multi-angle, more accurately and stably judge that gesture motion, said image sensing module also can be one or more, that is, and by a plurality of image sensing module multi-angles, reflect the operation that the user carries out at many levels on the human-computer interaction interface zone.
Said remote service device comprises service module, interface processing module and second radio receiving transmitting module;
Said second radio receiving transmitting module is used for the user's operational motion data that are received from said portable mobile wireless operating means are sent to said interface processing module; The human-computer interaction interface data that are received from said interface processing module are sent to said portable mobile wireless operating means;
Said interface processing module, being used for the user's operational motion data parsing that is received from said second radio receiving transmitting module is to decompress after the operational order or directly be sent to said service module; With after the human-computer interaction interface data compression that is received from said service module or directly be sent to said second radio receiving transmitting module;
In the present embodiment; Said interface processing module will be received from the human-computer interaction interface metadata cache of said service module; In conjunction with the user's operational motion data that receive from said second radio receiving transmitting module; The operation purpose of judges, and be the executable order of said service module with the data parsing of said user's operational motion, simultaneously; Reference frame when the human-computer interaction interface data of buffer memory also can be used as the human-computer interaction interface data compression of next renewal from said service module is to improve the compression efficiency to the human-computer interaction interface data of need transmission.
In the present embodiment, said interface processing module can comprise computing machine or the computer network system that has handled software.When unique identifier being set for the portable mobile wireless operating means; Said interface processing module can also be accomplished the identification to a plurality of portable mobile wireless operating means, and said then service module will be handled according to the different operating demand of different portable mobile wireless operating means.
Said service module is used to carry out the operational order that is received from said interface processing module, and is sent to said interface processing module to the human-computer interaction interface data of execution result;
In the present embodiment, said service module can comprise computing machine or the computer network system that has corresponding execution process software.
The user can pass through the portable mobile wireless operating means like this, realizes the operated from a distance of computing machine easily or computer network, also supports the multi-user to realize the virtual a plurality of computing machines or the operated from a distance of computer network through a plurality of portable mobile wireless operating means.
In another embodiment; First radio receiving transmitting module in the said portable mobile wireless operating means can be the radio receiving transmitting module in the mobile phone; Other projection module, image sensing module and image processing module are integrated in the mobile phone, and second radio receiving transmitting module of said remote service device is the wireless communication system in the base station; Interface processing module and service module are the computer network system that has handled software; Then can be through the integrated mobile phone of portable mobile wireless operating means; The projection human-computer interaction interface is on the jobbie plane; And through to being projected in the identification of the user's operational motion data on the human-computer interaction interface zone, realizing the operated from a distance of computing machine easily or computer network, and other complicated operations softwares and configuration additional hardware need be installed in the mobile phone; The function that only needs mobile phone to serve as wireless channel is accomplished actual complicated calculations and processing by remote computer or computer network fully.
In another embodiment, the service module of said remote service device is preferably any equipment of the output interface with the input interface that receives operational order and sender's machine interactive interface data.And second radio receiving transmitting module of said remote service device and interface processing module embed one and work in strong electromagnetic radiation, highfield influence, high temperature; Or rugged surroundings such as marine high salt fog, humidity; Or, can realize that then the user only adopts the portable mobile wireless operating means because of the installation site is difficult for the equipment in the approaching environmental baseline of people, can realize complicacy control easily to the said equipment; Also being easy to simultaneously the user clearly observes the said equipment and needs images displayed or graphical content originally; Because the said equipment does not need external control panel and display panel yet, with making that the three anti-characteristics of the said equipment are better, such as; Afloat equipment needs waterproof, anti-salt fog, protection against the tide.With second radio receiving transmitting module and the interface processing module embedding existing equipment of said remote service device is that those skilled in the art realize easily, and is not emphasis of the present invention, is not described in detail in this.
Fig. 2 is the flow chart of portable mobile wireless operating system in the embodiment of the invention; Referring to Fig. 2, among the present invention, said method of operating comprises:
Steps A: the human-computer interaction interface data of portable mobile wireless operating means receiving remote service unit; And be projected in this human-computer interaction interface on the plane; Obtain the user's operational motion data on the human-computer interaction interface of institute's projection, and send to said remote service device to these user's operational motion data;
Before steps A, said method of operating further comprises:
Step: A0: the portable mobile wireless operating means sends the service startup command to the remote service device, and said remote service device returns the human-computer interaction interface data according to the said service startup command that receives to said portable mobile wireless operating means.
In this step; The remote service device generally is in the wait accepting state; In the time of after the portable mobile wireless operating means starts, maybe need starting service to the remote service device send have the service startup command of respective identification after; This remote service device identifies after the said service startup command according to this sign and returns corresponding human-computer interaction interface data to said portable mobile wireless operating means (said human-computer interaction interface can be the human-computer interaction interface of last user's operation when withdrawing from; Also can be the human-computer interaction interface of presetting), said human-computer interaction interface data can be static or dynamic images.Data transmit-receive mode between said portable mobile wireless operating means and the said remote service device can comprise the radio magnetic wave mode, optical communication mode, or other communication.
Fig. 3 is the method flow diagram of steps A in the method for operating shown in Figure 2; Referring to Fig. 3, the steps A of said method of operating specifically comprises:
After decompressing through graphics processing unit, the human-computer interaction interface data that 1: the first radio receiving transmitting module of steps A will be received from said remote service device are sent to projection module;
In this step, said graphics processing unit can be with behind the human-computer interaction interface data decompression that is received from said first radio receiving transmitting module or directly send to said projection module.
Steps A 2: projection module is with forming images on human-computer interaction interface data projection to a plane that receives;
In this step, said plane can comprise, such as metope, desktop, paper etc.;
Wherein said projection module can be one or more, to accomplish the projection to human-computer interaction interface, promptly can be divided into received human-computer interaction interface several parts, and projection is carried out by different projection modules in every part interface.
Steps A 3: image sensing module is gathered the image information data that the user operates to human-computer interaction interface, and said image information data is sent to said remote service device via said graphics processing unit and said first radio receiving transmitting module.
In this step, said image sensing module can comprise two-dimensional image information sensor, picture depth sensor or the combination of the two.
Said image processing module can be handled the user's operational motion data that are received from said image sensing module; To obtain user's operational motion data; And after the data compression of user's operational motion or directly be sent to said first radio receiving transmitting module, said user's operational motion data comprise the track that the relative coordinate in the human-computer interaction interface zone and finger were slided when the user passed through the action data in finger manipulation human-computer interaction interface zone, finger manipulation at least in the human-computer interaction interface zone.In addition; Said user's operational motion data comprise that also the user points the real time video image that in the interface of projection, slides; Also this video image information is handled, to obtain the relevant path coordinate (with the action of the mouse move operation in the analog computer) that user's finger slides in the content interface viewing area of projection by image processing module; Equally; Said image sensing module can be gathered the realtime graphic (operation that the mouse in the analog computer is double-clicked and clicked) of operations such as the user adopts that finger is double-clicked or clicked on the content interface viewing area; By said image processing module this application drawing is looked like to carry out real-time analysis; To obtain the action of finger manipulation content interface viewing area; And the relative coordinate in this interface zone during finger manipulation, send to said remote service device to above-mentioned these user's operational motion data through said first radio receiving transmitting module at last.
When carrying out gesture operation on the human-computer interaction interface zone that the user is projecting; Said image sensing module will be gathered the image information data of user's everything in the human-computer interaction interface zone of projection; According to the difference that adopts image sensing module, this image information data can comprise the three-dimensional image information of two-dimensional image information, picture depth information or the two combination.
Equally, for multi-angle, more accurately and stably judge that gesture motion, said image sensing module also can be one or more, that is, and by a plurality of image sensing module multi-angles, reflect the operation that the user carries out at many levels on the human-computer interaction interface zone.
Step B: the remote service device is an operational order with the user's operational motion data parsing that receives, and carries out this operational order, and sends to said portable mobile wireless operating means to the human-computer interaction interface data of execution result.
Fig. 4 is the method flow diagram of step B in the method for operating shown in Figure 2; Referring to Fig. 4, the step B of said method of operating specifically comprises:
Step B1: after user's operational motion data parsing that the interface processing module will be received from second radio receiving transmitting module is the executable operational order of service module, send to service module;
In this step, the interface processing module can be to decompress after the operational order or directly be sent to said service module with the user's operational motion data parsing that is received from said second radio receiving transmitting module; When unique identifier being set for the portable mobile wireless operating means; Said interface processing module can also be accomplished the identification to a plurality of portable mobile wireless operating means, and said then service module will be handled according to the different operating demand of different portable mobile wireless operating means.
Step B2: service module is carried out the operational order be received from said interface processing module, and compresses the human-computer interaction interface data of execution result through said interface processing module and then to send to said portable mobile wireless operating means by said second radio receiving transmitting module.
In this step, if operational order is service the finish command, then service module keeps original human-computer interaction interface state; Wait for user's operation next time; Be that the remote service device keeps the wait accepting state, the portable mobile wireless operating means that sends this service the finish command finishes the whole operation process, and next time is in the time of need operating; Need the portable mobile wireless operating means to send service startup command, resume operations earlier; If operational order is other non-service the finish commands, then service module is carried out said operational order, and sends to said portable mobile wireless operating means to the human-computer interaction interface data of execution result via said interface processing module and said second radio receiving transmitting module
In this step, said interface processing module can be with after the human-computer interaction interface data compression that is received from said service module or directly be sent to said second radio receiving transmitting module; Said interface processing module will be received from the human-computer interaction interface metadata cache of said service module; Reference frame when the human-computer interaction interface data of buffer memory also can be used as the human-computer interaction interface data compression of next renewal from said service module; To improve compression efficiency, to reduce the bandwidth of wireless transmission to the human-computer interaction interface data of need transmission.
In said method of operating; When unique identifier being set for the portable mobile wireless operating means; Unique identifier that in the service startup command, will comprise corresponding portable mobile wireless operating means is so that service module can be carried out different operation according to user's operational motion data that different portable mobile wireless operating means sends; In addition; Unique identifier that in user's operational motion data and human-computer interaction interface data, also can comprise corresponding portable mobile wireless operating means; Realizing simultaneously returning different human-computer interaction interface data to the corresponding operating of a plurality of portable mobile wireless operating means, and final work when realizing supporting many portable mobile wireless operating means user.
Use portable mobile wireless operating system of the present invention and method and have following advantage:
1, realize the user at any time with any place, utilize the portable mobile wireless operating means to realize operation, the convenient observation and operation remote service device, and the remote service device can be adapted under some special rugged surroundings work to the remote service device;
2, because the remote service device can need not control panel and display panel; Therefore the reliability and stability of its work have been improved greatly; Such as, afloat remote service device needs waterproof, anti-salt fog, protection against the tide; If do not have control panel and display panel, will make that its three anti-characteristic is better.
Above embodiment only is used to explain the present invention; And be not limitation of the present invention; The those of ordinary skill in relevant technologies field under the situation that does not break away from the spirit and scope of the present invention, can also be made various variations and modification; Therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.

Claims (8)

1. a portable mobile wireless operating system is characterized in that, said portable mobile wireless operating system comprises:
The portable mobile wireless operating means with carry out the remote service device that radio communication is connected with said portable mobile wireless operating means; Wherein,
Said portable mobile wireless operating means is used for the human-computer interaction interface data of receiving remote service unit; And be projected in this human-computer interaction interface on the plane; Obtain the user's operational motion data on the human-computer interaction interface of institute's projection, and send to said remote service device to these user's operational motion data;
After said remote service device is used for receiving user's operational motion data from said portable mobile wireless operating means; With the data parsing of said user's operational motion is operational order; Carry out this operational order, and send to said portable mobile wireless operating means to the human-computer interaction interface data of execution result;
Said portable mobile wireless operating means is further used for sending the service startup command to the remote service device;
Said remote service device is further used for returning the human-computer interaction interface data according to the said service startup command that receives to said portable mobile wireless operating means; Said remote service device comprises service module, interface processing module and second radio receiving transmitting module; Wherein,
Said second radio receiving transmitting module is used for the user's operational motion data that are received from said portable mobile wireless operating means are sent to said interface processing module; The human-computer interaction interface data that are received from said interface processing module are sent to said portable mobile wireless operating means;
Said interface processing module, being used for the user's operational motion data parsing that is received from said second radio receiving transmitting module is to be sent to said service module after the operational order; Be sent to said second radio receiving transmitting module after the human-computer interaction interface data that are received from said service module are compressed;
Said service module is used to carry out the operational order that is received from said interface processing module, and is sent to said interface processing module to the human-computer interaction interface data of execution result.
2. portable mobile wireless operating system according to claim 1 is characterized in that, said portable mobile wireless operating means comprises one or more projection modules, one or more image sensing module, image processing module and first radio receiving transmitting module; Wherein,
Said first radio receiving transmitting module is used for the human-computer interaction interface data that are received from said remote service device are sent to said graphics processing unit; The user's operational motion data that are received from said graphics processing unit are sent to said remote service device;
Said graphics processing unit is used for sending to said projection module after the human-computer interaction interface data decompression that is received from said first radio receiving transmitting module; The user's operational motion data that are received from said image sensing module are handled, obtaining user's operational motion data, and said user's operational motion data are sent to said first radio receiving transmitting module;
Said one or more projection module is used to receive the human-computer interaction interface data from said graphics processing unit, and to one or more planes, forms images this human-computer interaction interface data projection;
Said one or more image sensing module is used to gather the image information data that the user operates to human-computer interaction interface, and sends it to said graphics processing unit.
3. portable mobile wireless operating system according to claim 2; It is characterized in that said user's operational motion data comprise the track that the relative coordinate in the human-computer interaction interface zone and finger were slided when the user passed through the action data in finger manipulation human-computer interaction interface zone, finger manipulation at least in the human-computer interaction interface zone; Said image sensing module comprises two-dimensional image information sensor, picture depth sensor or the combination of the two; Said image information data comprises the three-dimensional image information of two-dimensional image information, picture depth information or the two combination; Said human-computer interaction interface is that last user operates the human-computer interaction interface of reservation when withdrawing from or preset human-computer interaction interface; Said human-computer interaction interface data are static or dynamic images; Data transmit-receive mode between said portable mobile wireless operating means and the said remote service device comprises the radio magnetic wave mode, optical communication mode, or other communication; Said plane is metope, desktop or paper surface; Said projection module is a plurality of, and each projection module carries out projection with the part of received human-computer interaction interface to Different Plane or conplane zones of different.
4. portable mobile wireless operating system according to claim 2; It is characterized in that; Said interface processing module comprises computing machine or the computer network system that has handled software, and said service module comprises computing machine or the computer network system that has corresponding execution process software; Or,
First radio receiving transmitting module in the said portable mobile wireless operating means is the radio receiving transmitting module in the mobile phone; Said projection module, image sensing module and image processing module are integrated in the mobile phone; And second radio receiving transmitting module of said remote service device is the wireless communication system in the base station, and interface processing module and service module are the computer network system that has handled software.
5. the method for operating of each described portable mobile wireless operating system among the claim 1-4 is characterized in that said method of operating comprises:
Steps A: the human-computer interaction interface data of portable mobile wireless operating means receiving remote service unit; And be projected in this human-computer interaction interface on the plane; Obtain the user's operational motion data on the human-computer interaction interface of institute's projection, and send to said remote service device to these user's operational motion data;
Step B: the remote service device is an operational order with the user's operational motion data parsing that receives, and carries out this operational order, and sends to said portable mobile wireless operating means to the human-computer interaction interface data of execution result.
6. method of operating according to claim 5 is characterized in that, before the steps A, said method of operating further comprises:
Step: A0: the portable mobile wireless operating means sends the service startup command to the remote service device, and said remote service device returns the human-computer interaction interface data according to the said service startup command that receives to said portable mobile wireless operating means.
7. method of operating according to claim 6 is characterized in that, said step B specifically comprises:
Step B 1: after user's operational motion data parsing that the interface processing module will be received from second radio receiving transmitting module is the executable operational order of service module, send to service module;
Step B2: service module is carried out the operational order be received from said interface processing module, and compresses the human-computer interaction interface data of execution result through said interface processing module and then to send to the portable mobile wireless operating means by said second radio receiving transmitting module.
8. method of operating according to claim 7 is characterized in that, said steps A specifically comprises:
After decompressing through graphics processing unit, the human-computer interaction interface data that 1: the first radio receiving transmitting module of steps A will be received from the remote service device are sent to projection module;
Steps A 2: projection module is with forming images on human-computer interaction interface data projection to a plane that receives;
Steps A 3: image sensing module is gathered the image information data that the user operates to human-computer interaction interface, and said image information data is sent to said remote service device via said graphics processing unit and said first radio receiving transmitting module.
CN2010105840750A 2010-12-07 2010-12-07 Portable wireless operation system and method Active CN102073376B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010105840750A CN102073376B (en) 2010-12-07 2010-12-07 Portable wireless operation system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010105840750A CN102073376B (en) 2010-12-07 2010-12-07 Portable wireless operation system and method

Publications (2)

Publication Number Publication Date
CN102073376A CN102073376A (en) 2011-05-25
CN102073376B true CN102073376B (en) 2012-11-14

Family

ID=44031939

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010105840750A Active CN102073376B (en) 2010-12-07 2010-12-07 Portable wireless operation system and method

Country Status (1)

Country Link
CN (1) CN102073376B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103226843A (en) * 2013-04-23 2013-07-31 苏州华漫信息服务有限公司 Wireless 3D photographic system and realization method
CN103581727A (en) * 2013-10-17 2014-02-12 四川长虹电器股份有限公司 Gesture recognition interactive system based on smart television platform and interactive method thereof
CN104270195A (en) * 2014-09-30 2015-01-07 中国科学院半导体研究所 Visible light communication device based on LED projection
CN104777991B (en) * 2015-04-22 2019-03-29 深圳市华拓科技有限公司 A kind of remote interaction optical projection system based on mobile phone

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101102322A (en) * 2007-08-24 2008-01-09 华为技术有限公司 A method, system and client for realizing remote control via GUI
CN101137080A (en) * 2006-08-29 2008-03-05 三星电子株式会社 Remote management system and method for portable electronic devices
CN101707649A (en) * 2009-09-29 2010-05-12 宇龙计算机通信科技(深圳)有限公司 Method and system for interactively operating projection information and mobile terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101137080A (en) * 2006-08-29 2008-03-05 三星电子株式会社 Remote management system and method for portable electronic devices
CN101102322A (en) * 2007-08-24 2008-01-09 华为技术有限公司 A method, system and client for realizing remote control via GUI
CN101707649A (en) * 2009-09-29 2010-05-12 宇龙计算机通信科技(深圳)有限公司 Method and system for interactively operating projection information and mobile terminal

Also Published As

Publication number Publication date
CN102073376A (en) 2011-05-25

Similar Documents

Publication Publication Date Title
CN111417028B (en) Information processing method, information processing device, storage medium and electronic equipment
CN102662498B (en) A kind of wireless control method of projection demonstration and system
CN108282677A (en) Realize that content throws method, throwing screen device and the system of screen by client
CN111432265B (en) Method for processing video pictures, related device and storage medium
CN108513671B (en) Display method and terminal for 2D application in VR equipment
CN105204797A (en) Screen sharing method and device using same
CN107071035B (en) Mobile terminal remote control method and device and corresponding mobile terminal
CN106445340B (en) Method and device for displaying stereoscopic image by double-screen terminal
CN102073376B (en) Portable wireless operation system and method
JP2015158748A (en) Control apparatus, information processing apparatus, control method, information processing method, information processing system and wearable device
CN109891388A (en) A kind of image processing method and device
CN105988711B (en) Large-screen interactive system and its exchange method
CN110795007A (en) Method and device for acquiring screenshot information
CN101196804A (en) Remote access device and its operation metho
CN105278662A (en) Interactive control method and apparatus for electronic whiteboard system and system
CN113115101B (en) LED display screen, distributed information display system and control method
CN105335434B (en) Log management method and device and electronic equipment
CN105631059B (en) Data processing method, data processing device and data processing system
CN111447598B (en) Interaction method and display device
CN103200237B (en) A kind of method and apparatus keeping remote desktop synchronization
CN201556194U (en) Interaction operation input system
CN109542218B (en) Mobile terminal, human-computer interaction system and method
CN111625170B (en) Animation display method, electronic equipment and storage medium
CN107291834A (en) A kind of data inputting method based on code-reading, equipment and terminal
CN114935973A (en) Interactive processing method, device, equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant