WO2022017192A1

WO2022017192A1 - Edge computing device, and edge computing method and system

Info

Publication number: WO2022017192A1
Application number: PCT/CN2021/105308
Authority: WO
Inventors: 陈颀潇
Original assignee: 西门子（中国）有限公司
Priority date: 2020-07-24
Filing date: 2021-07-08
Publication date: 2022-01-27
Also published as: CN113973162A

Abstract

The present invention relates to an edge computing device, and an edge computing method and system. The edge computing device comprises: a first network interface (111) capable of receiving a data packet; a second network interface (112) capable of outputting an unprocessed data packet or a processed data packet; a network offloading module (120) that is coupled to the first network interface (111) and receives the data packet; and a processing module (140) that is coupled to the network offloading module (120) and processes the data packet.

Description

Edge computing device and edge computing method and system

technical field

The present invention relates to an edge computing device, and an edge computing method and system, especially for a camera.

Background technique

With the development of cities and the increasing demand for smart city management, people are more and more inclined to upgrade the layout of various cameras compared to configuring image processing algorithms or software on server rooms or NVR (Network Video Record). The ability to perform edge computing on images at a location. This is because image processing based on edge computing can bring advantages such as more flexible installation and configuration, simpler maintenance, and shorter latency.

From the installation point of view, the image processing capability of edge computing is especially suitable for some preset scenarios, such as traffic cameras for the Internet of Vehicles (Car2X) set at intersections, security surveillance cameras with point number/behavior analysis functions, Traffic cameras and the like based on traffic light adjustments are particularly beneficial.

In order to realize the development of smart cities, it may be necessary to replace the existing traditional cameras with smart cameras (these smart cameras are equipped with DSP, GPU or CPU with image processing computing capabilities; or configure image processing software for the back-end server room, Then return the processed image to the location where the camera is located. These two configuration methods will cause great waste or high requirements for network transmission.

SUMMARY OF THE INVENTION

In view of this, the present invention first proposes an edge computing device. The edge computing device includes: a first network interface capable of receiving one data packet; a second network interface capable of outputting unprocessed data packets or processed data packets; a network offloading module coupled to the first network interface , and receive the data packet; a processing module, which is coupled with the network distribution module, and processes the data packet.

The edge computing device performs customized processing on the data packets through the processing module on the edge side through the network offloading module without affecting the original data transmission, and uses the processed data for data sharing on the edge side, actuator control, etc. . In addition, when the second network interface outputs the processed data packets, the data processed at the edge can be directly input to the terminal for display or further processing.

Coupling in the present invention refers to any form of connection, communication, transfer of information and/or data, and the like. Including but not limited to wireless communication, wired communication, wired data transmission carrying electricity, etc.

A data packet may be any form of data, information, signal, or the like.

The data collection device may be a camera, a radio device, a handwriting input device, or other data collection devices.

According to an advantageous embodiment, the first network interface is coupled to the second network interface. As a result, it can be ensured that the data between the first network interface and the second network interface is transmitted without any influence. The characteristics of the network distribution module further ensure that it is "transparent" relative to the network itself.

According to an advantageous embodiment, the processing module is coupled to the second network interface. The processed data can thus be output via the second network interface.

According to an advantageous embodiment, the processing module is provided with a wired or wireless data output port.

According to an advantageous embodiment, the processing module is coupled to a wireless network communication module. Thereby, processed data and information can be sent to information receiving terminals such as mobile devices and vehicles through the wireless network communication module, or executable instructions and the like can be sent to execution agencies.

According to an advantageous embodiment, the processing module is coupled to an actuator and can issue execution instructions to the actuator. Therefore, the processing module can also directly send executable instructions to the executing mechanism through, for example, a wired manner.

According to an advantageous embodiment, at least one executable data processing program is preset in the processing module. The data processing program may be preset in the processing module by means of pre-installation, and may also be updated or installed at a later stage by means of push.

According to an advantageous embodiment, the data acquisition device is a camera, and the network interface is an Ethernet interface. With the edge computing device according to the present invention, a traditional camera can be upgraded to an intelligent network camera at a lower cost.

The present invention also provides an edge computing system, which includes: the edge computing device according to any one of the foregoing embodiments, wherein the edge computing device is coupled with the at least one data acquisition device; and edge computing The device is coupled to a data switching device or data processing terminal. Preferably the edge computing device is coupled to at least one actuator.

When the edge computing system includes a plurality of edge computing devices, it is preferred that the edge computing devices are connected to a data switching device, such as a router, and then connected to a data processing terminal. Of course, the edge computing device can be directly coupled with the data processing terminal. Here, the data processing terminal may be a computer, a server, a mobile phone, a large data processing center, an industrial computer, and the like.

The present invention also proposes a computing device method, comprising:

Obtain data packets via a network splitting module through a network interface;

Process the data packets by an executable data processing program in the processing module;

Output processed data packets or generate executable instructions.

According to an advantageous embodiment, when the data processing program generates executable instructions, the executable instructions are output to the execution mechanism.

Advantageously, the processing module outputs unprocessed data packets via a second network interface.

According to an advantageous embodiment, the processed data packets or executable instructions are sent via a wireless communication module coupled to the processing module. Alternatively, it can also be directly sent to the terminal through a network cable or the like coupled with the edge processing device.

It can be seen from the above solutions that, thanks to the present invention, a traditional data acquisition device, such as a traditional camera, is upgraded to a smart camera network without configuring the entire camera network.

This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary section is not intended to identify key features or essential features of the disclosure, nor is it intended to limit the scope of the disclosure.

Description of drawings

The above-mentioned and other features and advantages of the present invention will be more apparent to those of ordinary skill in the art by describing the preferred embodiments of the present invention in detail below with reference to the accompanying drawings, in which:

FIG. 1 shows a schematic diagram of a monitoring system according to the prior art.

FIG. 2 schematically shows a schematic diagram of a monitoring system according to an embodiment of the present invention.

FIG. 3 schematically shows a schematic diagram of an edge computing device according to the present invention.

FIG. 4 schematically shows the steps of the edge image calculation method according to the present invention.

Among them, the reference numerals are as follows:

10 cameras 20 routers 30 monitors

50, 60 network cable, Ethernet cable 100 edge computing device 200 wireless communication module

111, 112 network interface 120 network shunt unit 140 processing unit

300 actuators, actuators

detailed description

The principles of the present disclosure will be described below with reference to several example embodiments illustrated in the accompanying drawings. Although preferred embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that these embodiments are described only to enable those skilled in the art to better understand and implement the present disclosure, and not to limit the scope of the present disclosure in any way.

As used herein, the term "including" and variations thereof mean open-ended inclusion, ie, "including but not limited to". The term "or" means "and/or" unless specifically stated otherwise. The term "based on" means "based at least in part on". The terms "one example embodiment" and "one embodiment" mean "at least one example embodiment." The term "another embodiment" means "at least one additional embodiment." The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

In order to make the objectives, technical solutions and advantages of the present invention clearer, the following examples are used to further describe the present invention in detail.

FIG. 1 exemplarily shows a data acquisition network arrangement according to the prior art, and in this embodiment, the camera network arrangement is taken as an example for description. The multiple cameras 10 arranged in various places transmit the captured images and videos to the Ethernet router 20 through the Ethernet cable 50 respectively, and then send the signals to the server 30 or the computer host 30 for monitoring through the router 20 . In order to realize constant communication at the edge, such as in the case of autonomous driving, the traffic information provided to the accessory vehicle by the cameras arranged on the roadside requires computing power on edge devices, such as these cameras.

According to the present invention, an embodiment such as that shown in FIG. 2 is provided. Taking the arrangement of cameras 10 in one location as an example, according to this embodiment provided by the present invention, an edge computing device 100 according to the present invention is arranged between the traditional camera 10 and the router 20, so as to change the traditional camera "into" "Smart camera with image processing capabilities. The edge computing device 100 itself will not change or destroy the normal signal transmission from the camera 10 to the router 20 . It collects a part of the video signal from the video signal transmitted from the camera 10 to the router 20, and performs image or video calculation and analysis on the edge computing device 100; on the other hand, the raw output of the camera 10 passes through the The edge computing device 100 communicates with the router 20 normally without being affected. It should be noted that the router 20 is not necessary here. When the number of cameras 10 is small, the edge computing device 100 may also be directly connected with terminal devices such as the computer host 30 . Although not shown, it is conceivable that the edge computing device 100 may also be coupled to the mobile terminal in a wireless manner for communication. Of course, when the network system is provided with a large number of cameras 10 or other data collection devices 10, these data collection devices 10 are preferably coupled with a data switching device 20, such as a router 20, and then through the router 20 The data is transmitted to a terminal device for display or processing.

FIG. 3 further shows a specific embodiment of the edge computing device 100 according to the present invention. As shown in FIG. 3 , the edge computing device 100 is provided with a first network interface 111 and a second network interface 112 . The first network interface and the second network interface may be Ethernet interfaces, or network interfaces in other network environments. Although not specifically shown, the edge computing device 100 may also be provided with additional network interfaces according to specific requirements. The first network interface 111 is connected to a data acquisition device, such as the camera 10 , through a network cable (in an Ethernet environment, the network cable is an Ethernet network cable). The edge computing device 100 is provided with a network distribution unit 120, which is connected to the first network interface 111 through a network cable in this embodiment. According to the present invention, the network distribution unit 120 may be a hardware network distribution device (Network Probe), a sniffer (Sniffer), a port forwarding device, or the like. When the network tap unit 120 is a sniffer, it can be implemented in accordance with the present invention as both hardware or software, for example. The network offloading unit 120 does not bring any influence on the load of the existing network equipment, and is connected between the first network interface 111 and the second network interface 112 . However, it may be transparent with respect to the first network interface 111 and the second network interface 112 , that is to say, after accessing the network distribution unit, it has no impact on all devices in the current network. The network distribution unit 120 sends the data to the processing unit 140 connected to it for image, video and audio analysis.

The processing unit 140 and the network distribution unit 120 are connected in series between the first network interface 111 and the second network interface 112 . Data packets received via the first network interface 111 can be output unchanged by the second network interface 112 to a router 20 connected thereto or directly to a computer 30 after passing through the network splitting unit 120 and the processing unit 140 . One or more data processing programs may be preset in the processing unit 140, and these data processing programs may include image processing programs, video processing programs, audio processing programs, and the like. In addition, the data processing program in the processing unit 140 may also be a program installed by remote push.

Although not specifically shown, it is understood that, in the case where the

network cables

50 and 60 do not carry electricity, an additional power supply device or power supply may be connected in series with the network shunt unit 120 and the processing unit 140 .

In particular, the first network interface 111 and the second network interface 112 of the edge computing device 100 may also be directly connected through a network cable, so that the first network interface 111 and the second network interface 112 are directly coupled.

The edge computing device 100 according to the present invention will be further described below through specific examples.

scene one:

As shown in FIG. 2, the camera 10 is provided at the roadside for roadside traffic monitoring purposes. According to an embodiment of the present invention, software (program) for identifying illegal parking is preset in the edge computing device 100 . When a car drives into the monitoring range of the camera 10, the image data captured by the camera 10 is transmitted to the first network interface 111 through the Ethernet cable 50, and then captured by the network distribution unit 120 and then transmitted to the processing unit 140. The image processing software preset in the processing unit 140 can identify the vehicle appearing in the image, and capture the license plate information in the image. In this way, the processing unit 140 parses the information that a vehicle photographed with a license plate enters a roadside area where parking cannot be performed. In this embodiment, with reference to FIG. 3 , the processing unit 140 further communicates with a display screen 300 disposed on the roadside. The processing unit 140 sends the text message "the vehicle with the license plate number of XXXXXX illegally parked" to the display screen, and the display screen 300 receives the message and displays the warning message on it. On the other hand, the roadside image captured by the camera 10 is still transmitted to the computer 30 in the monitoring room through the Ethernet cable via the router 20 without being affected.

Scenario two:

As shown in FIG. 2 , the camera 10 is installed at the intersection for the purpose of monitoring traffic conditions at the intersection. According to an embodiment of the present invention, the installation file pushed to the processing unit 140 in the edge computing device 100 through a wireless network communication interface 200 coupled to the processing unit 140 in the edge computing device 100 is loaded with a file for identifying traffic. Status software (program). The camera 10 transmits the captured real-time image to the first network interface 111 through the Ethernet cable 50 , and is further captured by the network distribution unit 120 and then transmitted to the processing unit 140 . The traffic situation analysis software in the processing unit 140 determines whether there is traffic congestion according to the traffic flow on the screen, and marks the traffic congestion areas in red on the built-in map. In addition, the processing unit 140 also pushes the image marked with the traffic jam area to the nearby smart phone through the wireless network communication interface 200 which communicates with it. The processing unit 140 may also communicate with, for example, the traffic lights 300 at the intersection, and output control signals to the traffic lights based on the analyzed traffic flow information, thereby controlling the duration of red and green lights in real time. On the other hand, the intersection image captured by the camera 10 is still transmitted to the computer 30 in the monitoring room via the router 20 through the Ethernet cable without being affected.

Scenario three:

As shown in FIG. 2 , the camera 10 is installed near the self-service teller machine of the bank for monitoring. According to an embodiment of the present invention, software for identifying sensitive groups or sensitive behaviors is preset in the edge computing device 100 . The camera 10 transmits the captured real-time image to the first network interface 111 through the Ethernet cable 50 , and is further captured by the network distribution unit 120 and then transmitted to the processing unit 140 . For example, when a person holding a dagger appears in the picture, the dangerous situation analysis software in the processing unit 140 recognizes the dagger, circles the dagger in red in the image, and marks the picture of the dagger through the wireless network communication interface 200 It is transmitted to the mobile phone of the police officer at the annexed police station. On the other hand, the picture marked with the dagger can be transmitted via the second network interface 112 to the computer 30 located in the monitoring room.

Scenario four:

As shown in FIG. 2, a camera 10 or a smoke detector 10 is installed in a factory to monitor abnormal conditions of the factory. When the camera 10 is a data acquisition device, according to an embodiment of the present invention, software (program) for identifying smoke in an image is preset in the edge computing device 100 . The camera 10 transmits the captured real-time image to the first network interface 111 through the local area network cable 50 , and further transmits it to the processing unit 140 through the network distribution unit 120 . For example, when abnormal smoke such as equipment, such as boiler accessories, appears in the picture, the picture analysis software in the processing unit 140 recognizes the abnormal smoke, highlights the house in the image, and generates a control command. The control command is transmitted to the factory siren through the wireless network communication interface 200 to cause an alarm. At the same time, because the processing unit also transmits the picture highlighting the abnormal smoke to the mobile terminal of the on-duty staff through the wireless network communication interface 200 . More advantageously, the alarm information or the picture highlighting the abnormal smoke can be transmitted to the computer 30 located in the monitoring room through the second network interface 112 .

Although the above scenarios respectively describe the various implementations of the system, method, and components of the present invention, it should be noted that the various implementations of these systems, methods, and components proposed in the above-mentioned various scenarios are not fixed in the usage scenario, but It is an implementation mode that can be flexibly recombined in required scenarios to realize new scenarios, new systems, methods, and components. It is not repeated here. FIG. 4 schematically shows the working steps of the edge computing device 100 according to the present invention. in

Step S1: the edge computing device 100 obtains the data packets from the network cable 50 through a network interface 111 via a network distribution module 120;

Step S2: process the data packet S2 through an executable data processing program in the processing module 140;

Step S3: Output the processed data packets or generate executable instructions.

Among them, when producing executable instructions according to the data processing program, it also includes

Step S4: outputting the executable instruction to the executing mechanism.

From the foregoing descriptions of various scenarios, it can be known that when outputting executable instructions to the execution mechanism, it can be performed through a wireless network interface 200 coupled to the edge computing device 100 . In addition, when the edge computing device 100 outputs the data packets, the processed data packets or the unprocessed data packets may be selectively output through the second network interface 112 .

It should be understood that although several devices or sub-devices of the apparatus are mentioned in the above detailed description, this division is merely exemplary and not mandatory. Indeed, according to embodiments of the present disclosure, the features and functions of two or more devices described above may be embodied in one device. Conversely, the features and functions of one apparatus described above may be further divided into being embodied by multiple apparatuses.

The above descriptions are only optional embodiments of the present disclosure, and are not intended to limit the present disclosure. For those skilled in the art, the present disclosure may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure shall be included within the protection scope of the present disclosure.

Claims

An edge computing device (100), characterized in that the edge computing device (100) includes:

a first network interface (111) capable of receiving one data packet;

a second network interface (112) capable of outputting unprocessed data packets or processed data packets;

a network offloading module (120), which is coupled to the first network interface (111) and receives the data packets;

A processing module (140), which is coupled with the network offloading module (120), and processes the data packets.
The edge computing device (100) according to claim 1, characterized in that:

The first network interface (111) is coupled with the second network interface (112).
The edge computing device (100) according to any one of claims 1 to 2, characterized in that,

The processing module (140) is coupled to the second network interface (112).
The edge computing device (100) according to claim 1, characterized in that:

The processing module (140) is coupled to a wireless network communication module (200).
The edge computing device (100) according to claim 1, characterized in that:

The processing module (140) is coupled to an execution mechanism (300) and can send execution instructions to the execution mechanism (300).
The edge computing device (100) according to claim 1, characterized in that:

The processing module (140) is provided with at least one executable data processing program.
An edge computing system, characterized in that the edge computing system includes:

at least one data acquisition device (10);

The edge computing device (100) according to any one of claims 1 to 6, wherein the edge computing device (100) is coupled with the at least one data acquisition device (10);

And the edge computing device (100) is coupled with a data switching device (20) or a data processing terminal (30).
The edge computing system according to claim 7, wherein,

The edge computing device (100) is coupled with at least one actuator (300).
The edge computing device system according to claim 7, wherein:

The data acquisition device (10) is a camera;

The network interface is an Ethernet interface.
An edge computing device method, comprising:

Acquire data packets (S1) via a network distribution module (120) through a first network interface (111);

Process the data packet (S2) by an executable data processing program in the processing module (140);

The processed data packets are output or executable instructions are generated (S3).
The edge computing device method according to claim 10, wherein:

The executable instructions (S4) are output to at least one actuator (300).
The edge computing device method according to claim 10 or 11, wherein:

The processing module (140) outputs unprocessed data packets via a second network interface (112).
The edge computing device method according to claim 10 or 11, wherein:

The processing module (140) outputs processed data packets or generates executable instructions (S3) via a second network interface (112).
The edge computing device method according to claim 10, wherein:

The processed data packets or executable instructions are sent through a wireless communication module (200) coupled to the processing module (140).