CN102073376B - Portable wireless operation system and method - Google Patents
Portable wireless operation system and method Download PDFInfo
- Publication number
- CN102073376B CN102073376B CN2010105840750A CN201010584075A CN102073376B CN 102073376 B CN102073376 B CN 102073376B CN 2010105840750 A CN2010105840750 A CN 2010105840750A CN 201010584075 A CN201010584075 A CN 201010584075A CN 102073376 B CN102073376 B CN 102073376B
- Authority
- CN
- China
- Prior art keywords
- module
- human
- interaction interface
- computer interaction
- portable wireless
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 31
- 230000003993 interaction Effects 0.000 claims abstract description 139
- 230000009471 action Effects 0.000 claims abstract description 77
- 238000004891 communication Methods 0.000 claims abstract description 15
- 238000012545 processing Methods 0.000 claims description 80
- 238000011017 operating method Methods 0.000 claims description 7
- 238000003384 imaging method Methods 0.000 claims description 6
- 230000003287 optical effect Effects 0.000 claims description 4
- 230000003068 static effect Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 150000003839 salts Chemical class 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005684 electric field Effects 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004148 unit process Methods 0.000 description 1
Images
Landscapes
- Position Input By Displaying (AREA)
Abstract
The invention discloses a portable wireless operation system which comprises a portable wireless operation device and a remote service device conducting wireless communication with the portable wireless operation device, wherein the portable wireless operation device is used for receiving human-machine interaction interface data of the remote service device, projecting the human-machine interaction interface on a plane to obtain user operation action data on the projected human-machine interaction interface, and sending the user operation action data to the remote service device; and the remote service device is used for receiving the user operation action data from the portable wireless operation device, resolving the user operation action data into an operating command, executing the operating command, and sending the human-machine interaction interface data of the execution result to the portable wireless operation device. The invention realizes the operation of the remote service device by using the portable wireless operation device, thereby facilitating observation and operation of the remote service device.
Description
Technical Field
The present invention relates to the field of wireless communications technologies, and in particular, to a portable wireless operating system and a method thereof.
Background
Electronic equipment such as computers, mobile phones and the like can be conveniently used at any time and any place for work, leisure and entertainment, and an important target which people want to realize is always achieved. On one hand, although the existing mobile phone has partial computer functions, the display screen is small due to the fact that the mobile phone is too small in size, and the mobile phone is not suitable for being observed by people; the keyboard is small, and the operation is inconvenient for users; on the other hand, the existing notebook computer can be carried about, but is very inconvenient due to overlarge size and weight, and if the notebook computer is designed to be very small, the situation same as that of the existing mobile phone can be caused, so that the notebook computer is still inconvenient for users to use.
In addition, most of the existing electronic devices have external control panels and display panels, which can actually cause great influence on the reliability and stability of the devices, and meanwhile, the size of the devices is increased due to the external control panels and display panels. Especially, when the equipment works in some special severe environments, an operator is not suitable for physically approaching an operation panel and a display panel of the equipment, and the direct operation method of the equipment has great disadvantages.
In summary, the conventional electronic device has the following drawbacks:
1. the size of the control panel or the display panel is small, and the control panel or the display panel is not suitable for observation and operation;
2. the electronic equipment with the control panel or the display panel has larger volume and weight and is inconvenient to carry;
3. electronic devices with control panels or display panels have poor reliability and stability and cannot be adapted to work in some special harsh environments.
Disclosure of Invention
Technical problem to be solved
The technical problem to be solved by the present invention is to provide a portable wireless operating system and method for conveniently observing and operating an electronic device, and to enable the electronic device to be adapted to work in some special harsh environments, aiming at the above-mentioned defects.
(II) technical scheme
To solve the above technical problem, the present invention provides a portable wireless operating system, including:
a portable wireless operation device and a remote service device which is connected with the portable wireless operation device in a wireless communication way; wherein,
the portable wireless operation device is used for receiving the human-computer interaction interface data of the remote service device, projecting the human-computer interaction interface on a plane, acquiring the user operation action data on the projected human-computer interaction interface and sending the user operation action data to the remote service device;
the remote service device is used for analyzing the user operation action data into an operation command after receiving the user operation action data from the portable wireless operation device, executing the operation command and sending the man-machine interaction interface data of the execution result to the portable wireless operation device.
Preferably, the portable wireless operation device is further used for sending a service start command to a remote service device;
the remote service device is further used for returning human-computer interaction interface data to the portable wireless operation device according to the received service starting command.
Preferably, the remote service device comprises a service module, an interface processing module and a second wireless transceiver module; wherein,
the second wireless receiving and sending module is used for sending the user operation action data received from the portable wireless operation device to the interface processing module; sending the human-computer interaction interface data received from the interface processing module to the portable wireless operation device;
the interface processing module is used for analyzing the user operation action data received from the second wireless transceiver module into an operation command and then sending the operation command to the service module; compressing the human-computer interaction interface data received from the service module and then sending the compressed human-computer interaction interface data to the second wireless transceiver module;
and the service module is used for executing the operation command received from the interface processing module and sending the man-machine interaction interface data of the execution result to the interface processing module.
Preferably, the portable wireless operation device comprises one or more projection modules, one or more image sensing modules, an image processing module and a first wireless transceiving module; wherein,
the first wireless transceiving module is used for sending the man-machine interaction interface data received from the remote service device to the image processing unit; transmitting user operation action data received from the image processing unit to the remote service apparatus;
the image processing unit is used for decompressing the human-computer interaction interface data received from the first wireless transceiver module and then sending the decompressed data to the projection module; processing the user operation action data received from the image sensing module to obtain user operation action data, and sending the user operation action data to the first wireless transceiving module;
the one or more projection modules are used for receiving the human-computer interaction interface data from the image processing unit and projecting the human-computer interaction interface data onto one or more planes for imaging;
the image sensing modules are used for acquiring image information data of a user operating on a human-computer interaction interface and sending the image information data to the image processing unit.
Preferably, the user operation action data at least comprises action data of a user operating the human-computer interaction interface area through fingers, relative coordinates in the human-computer interaction interface area during finger operation and a sliding track of the fingers in the human-computer interaction interface area; the image sensing module comprises a two-dimensional plane image information sensor, an image depth sensor or a combination of the two; the image information data comprises two-dimensional plane image information, image depth information or three-dimensional image information combined by the two information; the human-computer interaction interface is a human-computer interaction interface reserved when the user operates and quits last time or a preset human-computer interaction interface; the human-computer interaction interface data is static or dynamic images; the data receiving and sending modes between the portable wireless operation device and the remote service device comprise a wireless electromagnetic wave mode, an optical communication mode or other wireless communication modes; the plane is a wall surface, a desktop or a paper surface; the number of the projection modules is multiple, and each projection module projects a part of the received human-computer interaction interface to different planes or different areas of the same plane.
Preferably, the interface processing module comprises a computer or computer network system with corresponding processing software, and the service module comprises a computer or computer network system with corresponding executing processing software; or,
the first wireless transceiving module in the portable wireless operating device is a wireless transceiving module in a mobile phone, the projection module, the image sensing module and the image processing module are integrated in the mobile phone, the second wireless transceiving module of the remote service device is a wireless communication system in a base station, and the interface processing module and the service module are computer network systems with corresponding processing software.
In order to solve the above technical problem, the present invention further provides an operating method of the above portable wireless operating system, where the operating method includes:
step A: the portable wireless operation device receives the human-computer interaction interface data of the remote service device, projects the human-computer interaction interface on a plane, acquires the user operation action data on the projected human-computer interaction interface, and sends the user operation action data to the remote service device;
and B: the remote service device analyzes the received user operation action data into an operation command, executes the operation command, and transmits the man-machine interaction interface data of the execution result to the portable wireless operation device.
Preferably, before step a, the operating method further comprises:
the method comprises the following steps: a0: and the portable wireless operation device sends a service starting command to a remote service device, and the remote service device returns the human-computer interaction interface data to the portable wireless operation device according to the received service starting command.
Preferably, the step B specifically includes:
step B1: the interface processing module analyzes the user operation action data received from the second wireless transceiving module into an operation command executable by the service module and then sends the operation command to the service module;
step B2: the service module executes the operation command received from the interface processing module, compresses the man-machine interaction interface data of the execution result by the interface processing module and then sends the data to the portable wireless operation device by the second wireless receiving and sending module.
Preferably, the step a specifically includes:
step A1: the first wireless transceiving module decompresses the human-computer interaction interface data received from the remote service device through the image processing unit and then sends the decompressed human-computer interaction interface data to the projection module;
step A2: the projection module projects the received human-computer interaction interface data to a plane for imaging;
step A3: the image sensing module collects image information data operated by a user aiming at a human-computer interaction interface and sends the image information data to the remote service device through the image processing unit and the first wireless transceiving module.
(III) advantageous effects
The invention provides a portable wireless operation system and a method, which receive user interface data of a remote service device through a portable wireless operation device, project the interface on a plane, acquire operation gesture information of a user on the projected operation interface, wirelessly transmit the operation gesture information to the remote service device, finally analyze the operation gesture into an operation command through the remote service device, execute the command, and wirelessly transmit user interface data of a result obtained after execution back to the portable wireless operation device to update the projected user interface so as to achieve the purpose that the user completes the operation of the remote service device on the portable wireless operation device, based on the scheme, the user can realize the operation of the remote service device by utilizing the portable wireless operation device at any time and any place, thereby facilitating the observation and the operation of the remote service device, the remote service device can adapt to work in some special severe environments, and the remote service device can be free from controlling the panel and the display panel, so that the reliability and the stability of the work are greatly improved.
Drawings
FIG. 1 is a schematic diagram of a portable wireless operating system according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of operation of the portable wireless operating system in an embodiment of the present invention;
FIG. 3 is a method flow diagram of step A of the method of operation shown in FIG. 2;
fig. 4 is a method flowchart of step B of the method of operation shown in fig. 2.
Detailed Description
The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
FIG. 1 is a schematic diagram of a portable wireless operating system according to an embodiment of the present invention; as shown in fig. 1, the portable wireless operating system according to the present invention includes a portable wireless operating device and a remote service device wirelessly connected to the portable wireless operating device; the portable wireless operation device is used for receiving human-computer interaction interface data of a remote service device, projecting the human-computer interaction interface on a plane, acquiring user operation action data on the projected human-computer interaction interface and sending the user operation action data to the remote service device; the remote service device is used for analyzing the user operation action data into an operation command after receiving the user operation action data from the portable wireless operation device, executing the operation command and sending the man-machine interaction interface data of the execution result to the portable wireless operation device.
The portable wireless operating device is further used for sending a service starting command to a remote service device; the remote service device is further used for returning human-computer interaction interface data to the portable wireless operation device according to the received service starting command (the human-computer interaction interface can be a human-computer interaction interface when the user operates and quits last time, and can also be a preset human-computer interaction interface). The remote service device is generally in a waiting receiving state until the portable wireless operation device is started or a service starting command with a corresponding identifier is sent to the remote service device when the service needs to be started, the remote service device identifies the service starting command according to the identifier and returns corresponding human-computer interaction interface data to the portable wireless operation device (the human-computer interaction interface can be a human-computer interaction interface reserved when a user operates and quits last time, and can also be a preset human-computer interaction interface), and the human-computer interaction interface data can be static or dynamic images. The data transmission and reception mode between the portable wireless operation device and the remote service device can comprise a wireless electromagnetic wave mode, an optical communication mode or other wireless communication modes.
The portable wireless operating device comprises a projection module, an image sensing module, an image processing module and a first wireless transceiving module;
the first wireless transceiving module is used for sending the man-machine interaction interface data received from the remote service device to the image processing unit; transmitting user operation action data received from the image processing unit to the remote service apparatus;
the image processing unit is used for decompressing the human-computer interaction interface data received from the first wireless transceiving module or directly sending the decompressed data to the projection module; processing the user operation action data received from the image sensing module to obtain user operation action data, compressing the user operation action data or directly sending the user operation action data to the first wireless transceiving module, wherein the user operation action data at least comprises action data of a human-computer interaction interface area operated by a user through a finger, relative coordinates in the human-computer interaction interface area during finger operation and a sliding track of the finger in the human-computer interaction interface area;
the projection module is used for receiving the human-computer interaction interface data from the image processing unit and projecting the human-computer interaction interface data onto a plane for imaging, such as a wall surface, a desktop, a paper surface and the like;
the image sensing module is used for acquiring image information data operated by a user aiming at a human-computer interaction interface and sending the image information data to the image processing unit; the image sensing module may include a two-dimensional planar image information sensor, an image depth sensor, or a combination of both.
When the user performs gesture operation on the projected human-computer interaction interface area, the image sensing module collects image information data of all actions of the user in the projected human-computer interaction interface area, and the image information data can comprise two-dimensional plane image information, image depth information or three-dimensional image information combined with the two-dimensional plane image information and the image depth information according to different image sensing modules.
In this embodiment, the human-computer interaction interface data received by the first wireless transceiver module includes a keyboard interface display area and a content interface display area similar to a computer, and a virtual keyboard area and a content area are formed by the projection module, where the number of the projection modules may be one or more, so as to complete projection of the human-computer interaction interface, that is, the received human-computer interaction interface may be divided into several parts, and each part of the interface is projected to different areas of different planes or the same plane by different projection modules.
The image sensing module acquires a real-time video image of a keyboard knocked by a finger of a user in a virtual keyboard area, and the image processing unit processes the video image information to acquire action data of the keyboard operated by the user; in addition, when the user slides in the display area of the projected content interface by using a finger, the image sensing module also acquires a real-time video image of the sliding of the user finger in the projected interface, and the image processing module also processes the video image information to acquire a relative track coordinate of the sliding of the user finger in the display area of the projected content interface (so as to simulate the movement operation action of a mouse in a computer); similarly, the image sensing module can acquire a real-time image of double-click or single-click operation of a user on a content interface display area by using a finger (simulating double-click and single-click operation of a mouse in a computer), the image processing module analyzes the operation image in real time to acquire the action of the finger on the content interface display area and the relative coordinate of the finger in the interface area during operation, and finally the operation action data of the user are sent to the remote service device through the first wireless transceiving module.
Similarly, for multi-angle, more accurate and stable judgment of gesture actions, the number of the image sensing modules can also be one or more, that is, the operations performed by the user on the human-computer interaction interface area are reflected by multiple image sensing modules in multi-angle and multi-level.
The remote service device comprises a service module, an interface processing module and a second wireless transceiving module;
the second wireless receiving and sending module is used for sending the user operation action data received from the portable wireless operation device to the interface processing module; sending the human-computer interaction interface data received from the interface processing module to the portable wireless operation device;
the interface processing module is used for analyzing the user operation action data received from the second wireless transceiver module into an operation command and then decompressing or directly sending the operation command to the service module; compressing the human-computer interaction interface data received from the service module or directly sending the data to the second wireless transceiver module;
in this embodiment, the interface processing module caches the human-computer interaction interface data received from the service module, determines an operation purpose of a user by combining the user operation action data received from the second wireless transceiver module, and analyzes the user operation action data into a command executable by the service module, and meanwhile, the cached human-computer interaction interface data can also be used as a reference frame for compressing the next updated human-computer interaction interface data from the service module, so as to improve the compression efficiency of the human-computer interaction interface data to be transmitted.
In this embodiment, the interface processing module may include a computer or a computer network system with corresponding processing software. When a unique identification number is set for the portable wireless operating device, the interface processing module can also complete the identification of a plurality of portable wireless operating devices, and then the service module can process according to different operation requirements of different portable wireless operating devices.
The service module is used for executing the operation command received from the interface processing module and sending the man-machine interaction interface data of the execution result to the interface processing module;
in this embodiment, the service module may comprise a computer or a computer network system with corresponding execution processing software.
Therefore, a user can realize convenient remote operation of the computer or the computer network through the portable wireless operating device, and also support multiple users to realize remote operation of multiple virtual computers or computer networks through multiple portable wireless operating devices.
In another embodiment, the first wireless transceiver module in the portable wireless operation device may be a wireless transceiver module in a mobile phone, the other projection module, the image sensing module and the image processing module are integrated in the mobile phone, and the second wireless transceiver module of the remote service device is a wireless communication system in a base station; the interface processing module and the service module are computer network systems with corresponding processing software, so that a human-computer interaction interface can be projected on a certain object plane through a mobile phone integrated with a portable wireless operating device, convenient remote operation of a computer or a computer network is realized by identifying user operation action data projected on a human-computer interaction interface area, other complex operating software is not required to be installed in the mobile phone, additional hardware is not required to be configured, the mobile phone is only required to serve as a wireless channel, and actual complex calculation and processing are completely completed by the remote computer or the computer network.
In another embodiment, the service module of the remote service device is preferably any device having an input interface for receiving operation commands and an output interface for transmitting human-machine interface data. And the second wireless transceiver module and the interface processing module of the remote service device are embedded into a device which works in severe environments such as strong electromagnetic radiation, strong electric field influence, high temperature, or high salt fog, moist and the like at sea, or environmental conditions that people are not easy to approach because of the installation position, so that a user can conveniently realize complex control on the device only by adopting a portable wireless operating device, and can easily and clearly observe the image or graphic content which needs to be displayed originally by the device. The second wireless transceiver module and the interface processing module of the remote service device are embedded in the existing equipment, which is easily implemented by those skilled in the art, and are not the focus of the present invention, and will not be described in detail herein.
FIG. 2 is a flow chart of a method of operation of the portable wireless operating system in an embodiment of the present invention; referring to fig. 2, in the present invention, the operation method includes:
step A: the portable wireless operation device receives the human-computer interaction interface data of the remote service device, projects the human-computer interaction interface on a plane, acquires the user operation action data on the projected human-computer interaction interface, and sends the user operation action data to the remote service device;
prior to step a, the method of operation further comprises:
the method comprises the following steps: a0: and the portable wireless operation device sends a service starting command to a remote service device, and the remote service device returns the human-computer interaction interface data to the portable wireless operation device according to the received service starting command.
In this step, the remote service device is generally in a waiting state for receiving, and after a service start command with a corresponding identifier is sent to the remote service device after the portable wireless operation device is started or when the service needs to be started, the remote service device returns corresponding human-machine interaction interface data (the human-machine interaction interface may be a human-machine interaction interface when the user exits from the last operation or a preset human-machine interaction interface) to the portable wireless operation device according to the identifier after recognizing the service start command, and the human-machine interaction interface data may be a static or dynamic image. The data transmission and reception mode between the portable wireless operation device and the remote service device can comprise a wireless electromagnetic wave mode, an optical communication mode or other wireless communication modes.
FIG. 3 is a method flow diagram of step A of the method of operation shown in FIG. 2; referring to fig. 3, step a of the operating method specifically includes:
step A1: the first wireless transceiving module decompresses the human-computer interaction interface data received from the remote service device through the image processing unit and then sends the decompressed human-computer interaction interface data to the projection module;
in this step, the image processing unit may decompress the human-computer interaction interface data received from the first wireless transceiving module or directly send the decompressed human-computer interaction interface data to the projection module.
Step A2: the projection module projects the received human-computer interaction interface data to a plane for imaging;
in this step, the plane may include, for example, a wall surface, a table top, paper, etc.;
the number of the projection modules can be one or more, so as to complete projection of the human-computer interaction interface, that is, the received human-computer interaction interface can be divided into a plurality of parts, and each part of the interface is projected by different projection modules.
Step A3: the image sensing module collects image information data operated by a user aiming at a human-computer interaction interface and sends the image information data to the remote service device through the image processing unit and the first wireless transceiving module.
In this step, the image sensing module may include a two-dimensional planar image information sensor, an image depth sensor, or a combination of both.
The image processing module can process the user operation action data received from the image sensing module to obtain the user operation action data, and compress the user operation action data or directly send the user operation action data to the first wireless transceiving module, wherein the user operation action data at least comprises action data of a user operating a human-computer interaction interface area through a finger, relative coordinates of the user in the human-computer interaction interface area during finger operation and a sliding track of the user in the human-computer interaction interface area. In addition, the user operation action data also comprises a real-time video image of the sliding of the finger of the user in the projected interface, and the video image information is processed by the image processing module to obtain the relative track coordinate of the sliding of the finger of the user in the display area of the projected content interface (so as to simulate the mouse movement operation action in the computer); similarly, the image sensing module can acquire a real-time image of double-click or single-click operation of a user on a content interface display area by using a finger (simulating double-click and single-click operation of a mouse in a computer), the image processing module analyzes the operation image in real time to acquire the action of the finger on the content interface display area and the relative coordinate of the finger in the interface area during operation, and finally the operation action data of the user are sent to the remote service device through the first wireless transceiving module.
When the user performs gesture operation on the projected human-computer interaction interface area, the image sensing module collects image information data of all actions of the user in the projected human-computer interaction interface area, and the image information data can comprise two-dimensional plane image information, image depth information or three-dimensional image information combined with the two-dimensional plane image information and the image depth information according to different image sensing modules.
Similarly, for multi-angle, more accurate and stable judgment of gesture actions, the number of the image sensing modules can also be one or more, that is, the operations performed by the user on the human-computer interaction interface area are reflected by multiple image sensing modules in multi-angle and multi-level.
And B: the remote service device analyzes the received user operation action data into an operation command, executes the operation command, and transmits the man-machine interaction interface data of the execution result to the portable wireless operation device.
FIG. 4 is a method flow diagram of step B of the method of operation shown in FIG. 2; referring to fig. 4, step B of the operating method specifically includes:
step B1: the interface processing module analyzes the user operation action data received from the second wireless transceiving module into an operation command executable by the service module and then sends the operation command to the service module;
in this step, the interface processing module may parse the user operation action data received from the second wireless transceiving module into an operation command, and then decompress the operation command or directly send the operation command to the service module; when a unique identification number is set for the portable wireless operating device, the interface processing module can also complete the identification of a plurality of portable wireless operating devices, and then the service module can process according to different operation requirements of different portable wireless operating devices.
Step B2: the service module executes the operation command received from the interface processing module, compresses the man-machine interaction interface data of the execution result by the interface processing module and then sends the data to the portable wireless operation device by the second wireless receiving and sending module.
In this step, if the operation command is a service end command, the service module reserves the state of the original human-computer interaction interface, waits for the next operation of the user, that is, the remote service device continues to be in a state of waiting for reception, and the portable wireless operation device which sends the service end command ends the whole operation process, and when the operation is needed next time, the portable wireless operation device is required to send a service start command first and restart the operation; if the operation command is other non-service ending command, the service module executes the operation command and sends the man-machine interaction interface data of the execution result to the portable wireless operation device through the interface processing module and the second wireless transceiver module
In this step, the interface processing module may compress the human-computer interaction interface data received from the service module or directly send the compressed human-computer interaction interface data to the second wireless transceiver module; the interface processing module caches the human-computer interaction interface data received from the service module, and the cached human-computer interaction interface data can also be used as a reference frame when the next updated human-computer interaction interface data from the service module is compressed, so that the compression efficiency of the human-computer interaction interface data to be transmitted is improved, and the wireless transmission bandwidth is reduced.
In the operation method, when the unique identification number is set for the portable wireless operation device, the unique identification number corresponding to the portable wireless operation device is included in the service starting command, so that the service module can execute different operations according to user operation action data sent by different portable wireless operation devices; in addition, the user operation action data and the human-computer interaction interface data can also comprise unique identification numbers corresponding to the portable wireless operation devices, so that different human-computer interaction interface data can be returned for corresponding operations of a plurality of portable wireless operation devices at the same time, and the simultaneous work of users of the plurality of portable wireless operation devices is finally supported.
The portable wireless operating system and the method have the following advantages that:
1. the user can operate the remote service device at any time and any place by using the portable wireless operating device, so that the remote service device is convenient to observe and operate, and the remote service device can adapt to work under some special severe environments;
2. because the remote service device can be without controlling panel and display panel, therefore has improved reliability and stability of its work greatly, for example, at marine remote service device, need waterproof, prevent salt fog, dampproofing, if do not control panel and display panel, will make its three prevent the characteristic better.
The above embodiments are only for illustrating the invention and are not to be construed as limiting the invention, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention, therefore, all equivalent technical solutions also belong to the scope of the invention, and the scope of the invention is defined by the claims.
Claims (8)
1. A portable wireless operating system, the portable wireless operating system comprising:
a portable wireless operation device and a remote service device which is connected with the portable wireless operation device in a wireless communication way; wherein,
the portable wireless operation device is used for receiving the human-computer interaction interface data of the remote service device, projecting the human-computer interaction interface on a plane, acquiring the user operation action data on the projected human-computer interaction interface and sending the user operation action data to the remote service device;
the remote service device is used for analyzing the user operation action data into an operation command after receiving the user operation action data from the portable wireless operation device, executing the operation command and sending the man-machine interaction interface data of the execution result to the portable wireless operation device;
the portable wireless operating device is further used for sending a service starting command to a remote service device;
the remote service device is further used for returning human-computer interaction interface data to the portable wireless operation device according to the received service starting command; the remote service device comprises a service module, an interface processing module and a second wireless transceiving module; wherein,
the second wireless receiving and sending module is used for sending the user operation action data received from the portable wireless operation device to the interface processing module; sending the human-computer interaction interface data received from the interface processing module to the portable wireless operation device;
the interface processing module is used for analyzing the user operation action data received from the second wireless transceiver module into an operation command and then sending the operation command to the service module; compressing the human-computer interaction interface data received from the service module and then sending the compressed human-computer interaction interface data to the second wireless transceiver module;
and the service module is used for executing the operation command received from the interface processing module and sending the man-machine interaction interface data of the execution result to the interface processing module.
2. The portable wireless operating system according to claim 1, wherein the portable wireless operating device comprises one or more projection modules, one or more image sensing modules, an image processing module, and a first wireless transceiving module; wherein,
the first wireless transceiving module is used for sending the man-machine interaction interface data received from the remote service device to the image processing unit; transmitting user operation action data received from the image processing unit to the remote service apparatus;
the image processing unit is used for decompressing the human-computer interaction interface data received from the first wireless transceiver module and then sending the decompressed data to the projection module; processing the user operation action data received from the image sensing module to obtain user operation action data, and sending the user operation action data to the first wireless transceiving module;
the one or more projection modules are used for receiving the human-computer interaction interface data from the image processing unit and projecting the human-computer interaction interface data onto one or more planes for imaging;
the image sensing modules are used for acquiring image information data of a user operating on a human-computer interaction interface and sending the image information data to the image processing unit.
3. The portable wireless operating system according to claim 2, wherein the user operation action data at least includes action data of a user operating the human-computer interaction interface area through a finger, relative coordinates in the human-computer interaction interface area when the finger is operated, and a track of the finger sliding in the human-computer interaction interface area; the image sensing module comprises a two-dimensional plane image information sensor, an image depth sensor or a combination of the two; the image information data comprises two-dimensional plane image information, image depth information or three-dimensional image information combined by the two information; the human-computer interaction interface is a human-computer interaction interface reserved when the user operates and quits last time or a preset human-computer interaction interface; the human-computer interaction interface data is static or dynamic images; the data receiving and sending modes between the portable wireless operation device and the remote service device comprise a wireless electromagnetic wave mode, an optical communication mode or other wireless communication modes; the plane is a wall surface, a desktop or a paper surface; the number of the projection modules is multiple, and each projection module projects a part of the received human-computer interaction interface to different planes or different areas of the same plane.
4. The portable wireless operating system of claim 2, wherein the interface processing module comprises a computer or computer network system with corresponding processing software, and the service module comprises a computer or computer network system with corresponding executing processing software; or,
the first wireless transceiving module in the portable wireless operating device is a wireless transceiving module in a mobile phone, the projection module, the image sensing module and the image processing module are integrated in the mobile phone, the second wireless transceiving module of the remote service device is a wireless communication system in a base station, and the interface processing module and the service module are computer network systems with corresponding processing software.
5. A method of operating a portable wireless operating system according to any of claims 1-4, characterized in that the method of operation comprises:
step A: the portable wireless operation device receives the human-computer interaction interface data of the remote service device, projects the human-computer interaction interface on a plane, acquires the user operation action data on the projected human-computer interaction interface, and sends the user operation action data to the remote service device;
and B: the remote service device analyzes the received user operation action data into an operation command, executes the operation command, and transmits the man-machine interaction interface data of the execution result to the portable wireless operation device.
6. The method of operation of claim 5, wherein prior to step A, the method of operation further comprises:
step A0: and the portable wireless operation device sends a service starting command to a remote service device, and the remote service device returns the human-computer interaction interface data to the portable wireless operation device according to the received service starting command.
7. The operating method according to claim 6, wherein the step B specifically comprises:
step B1: the interface processing module analyzes the user operation action data received from the second wireless transceiving module into an operation command executable by the service module and then sends the operation command to the service module;
step B2: the service module executes the operation command received from the interface processing module, compresses the man-machine interaction interface data of the execution result by the interface processing module and then sends the data to the portable wireless operation device by the second wireless receiving and sending module.
8. The operating method according to claim 7, wherein the step a specifically comprises:
step A1: the first wireless transceiving module decompresses the human-computer interaction interface data received from the remote service device through the image processing unit and then sends the decompressed human-computer interaction interface data to the projection module;
step A2: the projection module projects the received human-computer interaction interface data to a plane for imaging;
step A3: the image sensing module collects image information data operated by a user aiming at a human-computer interaction interface and sends the image information data to the remote service device through the image processing unit and the first wireless transceiving module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105840750A CN102073376B (en) | 2010-12-07 | 2010-12-07 | Portable wireless operation system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105840750A CN102073376B (en) | 2010-12-07 | 2010-12-07 | Portable wireless operation system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102073376A CN102073376A (en) | 2011-05-25 |
| CN102073376B true CN102073376B (en) | 2012-11-14 |
Family
ID=44031939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010105840750A Active CN102073376B (en) | 2010-12-07 | 2010-12-07 | Portable wireless operation system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102073376B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103226843A (en) * | 2013-04-23 | 2013-07-31 | 苏州华漫信息服务有限公司 | Wireless 3D photographic system and realization method |
| CN103581727A (en) * | 2013-10-17 | 2014-02-12 | 四川长虹电器股份有限公司 | Gesture recognition interactive system based on smart television platform and interactive method thereof |
| CN104270195A (en) * | 2014-09-30 | 2015-01-07 | 中国科学院半导体研究所 | Visible light communication device based on LED projection |
| CN104777991B (en) * | 2015-04-22 | 2019-03-29 | 深圳市华拓科技有限公司 | A kind of remote interaction optical projection system based on mobile phone |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101102322A (en) * | 2007-08-24 | 2008-01-09 | 华为技术有限公司 | A method, system and client for realizing remote control via GUI |
| CN101137080A (en) * | 2006-08-29 | 2008-03-05 | 三星电子株式会社 | Remote management system and method for portable electronic devices |
| CN101707649A (en) * | 2009-09-29 | 2010-05-12 | 宇龙计算机通信科技(深圳)有限公司 | Method and system for interactively operating projection information and mobile terminal |
-
2010
- 2010-12-07 CN CN2010105840750A patent/CN102073376B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101137080A (en) * | 2006-08-29 | 2008-03-05 | 三星电子株式会社 | Remote management system and method for portable electronic devices |
| CN101102322A (en) * | 2007-08-24 | 2008-01-09 | 华为技术有限公司 | A method, system and client for realizing remote control via GUI |
| CN101707649A (en) * | 2009-09-29 | 2010-05-12 | 宇龙计算机通信科技(深圳)有限公司 | Method and system for interactively operating projection information and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102073376A (en) | 2011-05-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220020339A1 (en) | Display method and apparatus | |
| US20170068417A1 (en) | Information processing apparatus, program, information processing method, and information processing system | |
| CN110795949A (en) | Card swiping method and device, electronic equipment and medium | |
| CN108513671B (en) | Display method and terminal for 2D application in VR equipment | |
| CN109523253B (en) | Payment method and device | |
| CN110602389B (en) | Display method and electronic equipment | |
| WO2018006841A1 (en) | Qr code information transmission method, device and apparatus | |
| CN109521978B (en) | Content display method and terminal equipment | |
| CN106445339A (en) | Three-dimensional image display method and device for double-screen terminal | |
| CN109992125A (en) | Data inputting method, device and system | |
| CN102073376B (en) | Portable wireless operation system and method | |
| CN109891388A (en) | A kind of image processing method and device | |
| CN110096203B (en) | Screenshot method and mobile terminal | |
| CN111399819B (en) | Data generation method, device, electronic equipment and storage medium | |
| CN105988711A (en) | Large-screen interaction system and interaction method | |
| US20220375092A1 (en) | Target object controlling method, apparatus, electronic device, and storage medium | |
| CN113115101B (en) | LED display screen, distributed information display system and control method | |
| CN112486567B (en) | Method and device for sending merging request of codes, electronic equipment and storage medium | |
| CN111447598B (en) | Interaction method and display device | |
| CN111178306B (en) | Display control method and electronic equipment | |
| CN109542218B (en) | Mobile terminal, human-computer interaction system and method | |
| CN201556194U (en) | Interaction operation input system | |
| CN108811177B (en) | Communication method and terminal | |
| CN109521981B (en) | Graphic code display method and terminal | |
| CN108063884B (en) | Image processing method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |