CN111541866A - Remote assistance device and method based on 5G - Google Patents

Abstract

The invention provides a remote assistance device and a method based on 5G, wherein the device comprises: the device comprises an image acquisition device, a display device, a laser, a voice playing device, a directional pickup and a 5G Internet of things edge calculation module, wherein the image acquisition device, the display device, the laser, the voice playing device and the directional pickup are all connected with the 5G Internet of things edge calculation module; and the 5G Internet of things edge computing module is in communication connection with a remote client. The invention can solve the field problem in a remote mode in an all-round way, greatly reduces the working difficulty of field engineers, improves the solving efficiency of the field problem, and simultaneously, by the invention, more engineers can be better cultivated and exercised in a first visual angle operation mode, and the working capacity level is rapidly improved.

Description

Remote assistance device and method based on 5G

Technical Field

The invention belongs to the technical field of 5G, and particularly relates to a remote assistance device and method based on 5G.

Background

At present, when the service type work of industrial equipment, such as maintenance, field technical service, or higher labor skills and more technical barriers, is carried out, technical service personnel and engineers are required to go to the field service, high-grade service personnel with high labor skills and strong technical capabilities are scarce, and the time and the energy for providing the field service are limited.

Disclosure of Invention

In view of the above-mentioned deficiencies of the prior art, the present invention provides a remote assistance device and method based on 5G, so as to solve the above-mentioned technical problems.

The invention provides a remote assistance device based on 5G, which comprises:

the device comprises an image acquisition device, a display device, a laser, a voice playing device, a directional pickup and a 5G Internet of things edge calculation module, wherein the image acquisition device, the display device, the laser, the voice playing device and the directional pickup are all connected with the 5G Internet of things edge calculation module; and the 5G Internet of things edge computing module is in communication connection with a remote client.

Further, the apparatus further comprises:

and the 5G Internet of things edge computing module is in communication connection with the remote client through the cloud platform.

Further, the image acquisition device comprises a wearable camera device.

Further, wearing type camera device includes sensors such as acceleration sensor and gyroscope, just wearing type camera device includes the viewing angle controller.

Further, the display device is a glasses display.

Further, the image acquisition device and the laser are fixed on the same wearing body.

Further, the device further comprises an emergency button, wherein the emergency button is used for generating an emergency alarm signal, and the emergency alarm signal is sent to the remote client by the 5G Internet of things edge calculation module.

The invention also provides a remote assistance method based on 5G, which comprises the following steps:

uploading image information acquired by an image acquisition device and audio information acquired by a directional sound pickup to a cloud platform, and forwarding the image information and the audio information to a remote client by the cloud platform;

receiving instructions, data and voice information of a remote client forwarded by a cloud platform;

controlling the display device to display the data;

controlling the voice playing device to play voice information;

and controlling the image acquisition device or the laser to execute the instruction.

Further, the method further comprises:

the real-time images acquired by the image acquisition device are processed by the cloud server and are sent to the corresponding remote client in a channel grouping mode.

Further, the controlling the image capturing device or the laser to execute the instructions includes:

adjusting the lens visual angle of the image acquisition device according to the control instruction;

calculating the rotation angle of the laser according to the laser target point in the control instruction, the relative position of the laser and the image acquisition device and the visual angle of the image acquisition device;

and adjusting the laser according to the rotation angle.

The beneficial effect of the invention is that,

the invention provides a remote assistance device and a remote assistance method based on 5 G.A 5G Internet of things edge calculation module is utilized to transmit image information and audio information acquired by outdoor operation in real time to a remote client in real time, so that information interaction between the outdoor operation and the remote client is realized. The invention can solve the field problem in a remote mode in an all-round way, greatly reduces the working difficulty of field engineers, improves the solving efficiency of the field problem, and simultaneously, by the invention, more engineers can be better cultivated and exercised in a first visual angle operation mode, and the working capacity level is rapidly improved.

In addition, the invention has reliable design principle, simple structure and very wide application prospect.

Drawings

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of an apparatus according to an embodiment of the present application.

Detailed Description

In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.

In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art through specific situations.

The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.

Example 1

Referring to fig. 1, the present embodiment relates to a remote assistance method, device, and system based on a 5G technology, and as shown in fig. 1, the remote assistance method, device, and system includes a 1-terminal service system connected to a 2-cloud platform, and a field terminal device connected to a 3-5G internet of things edge computing module in the system through a 5G base station and the 2-cloud platform, and sending and receiving data of the 2-cloud platform. The 4-glasses display screen is connected with the 3-5G Internet of things edge computing module and used for receiving and displaying data transmitted from the cloud platform; the 5-sound pickup is connected with the 3-5G Internet of things edge computing module and transmits directional audio and vibration frequency data to the cloud platform through the edge computing module; the 6-wearable camera device is connected with the 3-5G Internet of things edge calculation module, collects a field video or an AR scene video of a required visual angle, and receives a cloud instruction to adjust the visual angle and the focal length of the 6-wearable camera device; the 7-laser is connected with the 3-5G Internet of things edge calculation module, receives a control instruction from the cloud, and adjusts the laser direction and feeds back information; the 8-earphone headset is connected with the 3-5G Internet of things edge computing module and provides audio communication between a field engineer and a remote engineer through audio I/O data transmission.

The 1-terminal service system has switching control and connection of 1 or more channels/sites, has an audio/video I/O function, simultaneously has operation control keys, is not limited to physical keys or virtual keys, and has main operation contents including audio/video playing, 5G live broadcast connection, remote engineer screen sharing, remote control of a 6-wearable camera device and a 7-laser.

The field terminal device and the system are integrally worn on a field engineer and form omnibearing interaction with a remote engineer through a 5G base station and a 2-cloud platform;

the 5G-based remote assistance device, method, and system workflow of the present embodiment are described as follows: the field engineer transmits the field scene and the sound/frequency to the remote engineer in real time by using the 5-sound pick-up and the 6-wearable camera device, the remote engineer observes and knows the problems to be processed on the field through the data transmitted back on the field and sends corresponding operation instructions to the field terminal device and the system, for example, the field engineer is guided by a remote control 7-laser, the field engineer is communicated with the field engineer through audio interaction, and further required video data is acquired through the remote control 6-wearable camera device. Aiming at the file data and the like required by the field engineer, the remote engineer can share the screen and send the file data to the 4-glass display screen to help the field engineer to quickly solve the problems.

Example 2

The embodiment provides a remote assistance method based on 5G, which comprises the following steps:

the method comprises the steps of uploading image information collected by an image collecting device and audio information collected by a directional sound pickup to a cloud platform, and forwarding the image information and the audio information to a remote client by the cloud platform.

The method comprises the steps of receiving an instruction, data and voice information of a remote client forwarded by a cloud platform, controlling a display device to display the data, controlling a voice playing device to play the voice information, and controlling an image acquisition device or a laser to execute the instruction.

Wherein controlling the image acquisition device or the laser to execute the instructions comprises: adjusting the lens visual angle of the image acquisition device according to the control instruction, establishing a coordinate system for the video picture, extracting a laser target point in the control instruction, acquiring the coordinate of the target point in the coordinate system, and acquiring the relative position of the laser and the image acquisition device. And calculating the rotation angle of the laser according to the lens visual angle and the coordinates of the target point of the image acquisition device and the relative position of the laser and the image acquisition device, and adjusting the laser according to the rotation angle to enable the laser to be shot on the target point.

Although the present invention has been described in detail by referring to the drawings in connection with the preferred embodiments, the present invention is not limited thereto. Various equivalent modifications or substitutions can be made on the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and these modifications or substitutions are within the scope of the present invention/any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. A 5G-based remote assistance apparatus, the apparatus comprising:

the device comprises an image acquisition device, a display device, a laser, a voice playing device, a directional pickup and a 5G Internet of things edge calculation module, wherein the image acquisition device, the display device, the laser, the voice playing device and the directional pickup are all connected with the 5G Internet of things edge calculation module; and the 5G Internet of things edge computing module is in communication connection with a remote client.

2. The apparatus of claim 1, further comprising:

and the 5G Internet of things edge computing module is in communication connection with the remote client through the cloud platform.

3. The device of claim 1, wherein the image capture device comprises a wearable camera device.

4. The apparatus according to claim 1, wherein the wearable imaging device includes sensors such as an acceleration sensor and a gyroscope, and the wearable imaging device includes a viewing angle controller.

5. The device of claim 1, wherein the display device is an eyewear display.

6. The device of claim 1, wherein the image capture device and the laser are secured to the same wearing body.

7. The apparatus of claim 1, further comprising an emergency button to generate an emergency alert signal, the emergency alert signal to be sent by the 5G internet of things edge computing module to a remote client.

8. A5G-based remote assistance method, characterized in that the method comprises:

uploading image information acquired by an image acquisition device and audio information acquired by a directional sound pickup to a cloud platform, and forwarding the image information and the audio information to a remote client by the cloud platform;

receiving instructions, data and voice information of a remote client forwarded by a cloud platform;

controlling the display device to display the data;

controlling the voice playing device to play voice information;

and controlling the image acquisition device or the laser to execute the instruction.

9. The method of claim 8, further comprising:

the real-time images acquired by the image acquisition device are processed by the cloud server and are sent to the corresponding remote client in a channel grouping mode.

10. The method of claim 8, wherein the controlling the image capture device or the laser to execute the instructions comprises:

adjusting the lens visual angle of the image acquisition device according to the control instruction;

calculating the rotation angle of the laser according to the laser target point in the control instruction, the relative position of the laser and the image acquisition device and the visual angle of the image acquisition device;

and adjusting the laser according to the rotation angle.

Images