CN113162991A

CN113162991A - Multilayer network structure applied to Von Neumann expansion structure in Internet of things

Info

Publication number: CN113162991A
Application number: CN202110353600.6A
Authority: CN
Inventors: 俞剑明; 王祚栋; 毛蔚; 白昀
Original assignee: Fei Ang Innovation Technology Nantong Co ltd
Current assignee: Fei Ang Innovation Technology Nantong Co ltd
Priority date: 2021-04-01
Filing date: 2021-04-01
Publication date: 2021-07-23
Anticipated expiration: 2041-04-01
Also published as: CN113162991B

Abstract

The multilayer network structure of an extended Von Neumann structure applied to the Internet of things is a structure which expands input devices and output devices in a classic Von Neumann structure in a computer architecture into an input-output device network and expands a storage device and an arithmetic unit controller into a storage network and an arithmetic control network. The extended Von Neumann structure maps the module units in the computer into various electronic devices of families or enterprises, and conforms to the concept of internet of things interconnection. The structure of the multilayer network breaks through the physical limitation of equipment in family and enterprise life, abstracts and virtualizes the equipment distributed at different geographic positions, and enables users to use equipment resources at different geographic positions to freely combine systems.

Description

Multilayer network structure applied to Von Neumann expansion structure in Internet of things

Technical Field

The invention belongs to the field of Internet of things. The invention provides a brand new remote control mode of equipment for virtualization, and particularly provides a novel remote control mode of equipment for realizing abstraction and virtualization of the equipment to users, breaking through the physical limitation of the equipment and realizing reconfigurable connection of the equipment at any position in a family or an enterprise by applying a reconfigurable interconnection method of the family or enterprise equipment.

Background

With the continuous development of network technology, the technology of ipv6 is becoming mature, and the wide application of rfid technology pushes the continuous development of internet of things. The technologies of intelligent home, intelligent building, intelligent office and the like are continuously promoted along with the development of the technology of interconnecting everything. Companies such as millet, Baidu, Hua and Ali baba propose respective intelligent solutions and even intelligent ecology, more and more intelligent devices appear in the life of people, and the Wifi technology, the zigbee technology and the low-power Bluetooth technology are main interconnection means of the intelligent devices. However, with the continuous development of the technology, the transmission bandwidth of the input/output device and the display device is continuously increased, the usb4.0 has a transmission rate of 20Gbps, the HDMI2.1 has a highest transmission rate of 48Gbps, and the DP2.0 has a highest transmission rate close to 80 Gbps. The high transmission rates of these devices make it difficult to interconnect them using existing wireless technologies, while the use of wired networks to interconnect these devices faces the problems of complex protocol conversion and high bandwidth consumption.

The remote control of the equipment is also an important subject of the technology of the internet of things, and the equipment intelligence which is interconnected by the existing Wifi technology, the zigbee technology and the low-power-consumption Bluetooth technology provides simple function control, such as remote switch, remote gear shifting, remote video and voice and the like. The proposed architecture aims at a more deep level of remote control and even remote login of any device (like remote control of a computer).

Some solutions exist for reconfigurable display connections:

1. provided is a wireless screen projection technology of a mobile phone. The technology uses wifi as a transmission medium, and uses technologies such as DLNA or Air play to mirror the display of a mobile phone screen to a television or a box supporting wireless screen projection, and the technology is limited by the bandwidth of wireless connection and is difficult to realize display of more than 2 k. In addition, only devices with wireless screen projection technology can achieve this function, and thus cannot adapt to diverse device choices in home and business applications.

Hdmi to wireless module. The technology consists of an hdmi transmitting module and an hdmi receiving module. The computer is connected with an hdmi transmitting module to convert the hdmi signals into wireless signals, and the display is connected with an hdmi receiving module to convert the received wireless signals back to the hdmi signals and send the hdmi signals to an hdmi interface of the display. This video transmission scheme is also limited in wireless bandwidth and difficult to achieve 4k display. The scheme has transmission distance limitation, can reliably transmit the video only within a certain position range, and mainly supports point-to-point communication. The use of wireless channels by this scheme also complicates the wireless communication environment of the home, and may interfere with each other and other wireless communications.

Hdmi one-in-multiple-out or multiple-in-one-out distributors. The structure can realize the connection of the display to a plurality of display sources or the connection of one display source to a plurality of displays. The main application of this architecture is currently the implementation of a hub only, and does not implement the concept of a network.

Some solutions exist for reconfigurable input-output:

1. the input devices such as a mouse and a keyboard are generally connected by using Bluetooth, and in some existing implementations, the input devices can select the devices connected with the input devices by using Bluetooth, but the connection mode is limited by the distance of Bluetooth communication, and the number of the devices which can be selected and interconnected is limited.

Some solutions exist for remote control of devices:

1. the intelligent housekeeper passes through wifi connecting network, carries out limited regulation to the smart machine through remote access intelligent housekeeper. Firstly, the intelligent device is necessary to use the scheme, and the control of the non-device-only device can switch the device only through the intelligent switch. And compatibility between intelligent caretakers and intelligent devices between different common manufacturers is limited. In addition, the currently supported remote control functions are mainly limited to remote switches, remote gear shifting, remote video and voice and the like.

2. Remote login of a computer. Currently, the mainstream operating systems support remote login in the local area network of the computer, and companies such as teamviewer and the like also provide a cross-platform internet remote login scheme. However, such telnet control is mainly limited to computer systems, and the privacy of internet telnet is difficult to be guaranteed.

Disclosure of Invention

The invention provides a multilayer network which is used for solving the problems and expanding the Fenoerman structure in the Internet of things, abstracts and virtualizes household or enterprise equipment and provides a deeper remote control scheme.

One aspect of the present invention is to provide a multi-layer network structure of an extended von neumann structure applied in the internet of things, which divides home or business devices into multi-layer network structures according to device attributes and communication types;

the multi-layer network structure includes a network of input devices, a network of output devices, and a computing and control network,

the multi-layer network layer division limits the equipment communication between adjacent layers, the communication between the equipment does not share the communication bandwidth, the input equipment network layer is connected with the calculation and control network layer through the cross switch, the output equipment network layer is connected with the calculation and control network layer through the cross switch, the equipment enables the communication between the equipment not to be limited by a common shared wireless network, and high-definition videos and other high-speed information are transmitted between the equipment in parallel.

Preferably, the multi-layer network abstracts all output devices in a home or business to a user as a von neumann computer including input devices, output devices and computing control devices;

all display equipment is abstracted into a display, all input equipment is abstracted into a set of input equipment for a user, and all calculation and control equipment is abstracted into a host for the user; the layers of the multilayer network use a cross-bar switch structure to carry out physical communication exchange, and the connection between the equipment and the switch uses an optical fiber active cable to connect, so that the high-speed communication between any equipment is not limited by physical distance.

Preferably, the physical communication exchange is carried out between the layers of the multilayer network by using a cross-bar switch structure, the cross-bar switch can be realized by selecting an optical switch when active optical cables are used for interconnection, and the cross-bar switch only carries out data exchange at the physical layer and does not relate to high-layer protocol analysis.

Preferably, the multi-layer network architecture further comprises a virtual input output device, a virtual display and a remote control agent device,

the remote computer selects a calculation and control unit requiring remote control, controls the calculation and control unit using the virtual input-output device, and outputs a display to the virtual display.

Preferably, the remote control agent device receives control information in a specific network packet format through the Ethernet, the virtual input/output device analyzes the control information and sends the control information to the input/output device network according to the communication protocol of the input/output device to complete remote input, and the virtual input/output device is selected in the cross bar switch configuration to be connected with the controlled computing and control unit.

Preferably, the selected computing and control unit in the crossbar configuration is connected with the virtual display, the virtual display receives display data sent to the display network by the controlled computing and control unit and converts the display data into a network data packet with a specific format, and the network data packet is transmitted back to the remote control computer by the remote control agent device to complete remote display.

Another aspect of the present invention is to provide a multi-layer network structure of an extended von neumann structure applied to the internet of things, wherein home or business devices are divided into the multi-layer network structure according to device attributes and communication types;

the multi-layer network structure comprises a peripheral network, a calculation and control network and a display network, wherein the peripheral network comprises a sensor network, an input equipment network, an output equipment network and a storage network;

the multi-layer network layer is divided, the device communication is limited between adjacent layers, the communication between the devices does not share the communication bandwidth, the input device network layer is connected with the calculation and control network layer through a cross switch, and the output device network layer is connected with the calculation and control network layer through the cross switch.

High-definition videos (4K and 8K) can be transmitted in parallel between the computer and control network layer and the display network layer, and when the number of display devices is n, the number of the computer and control devices is m, and 8K60hz videos are output, the highest transmission bandwidth is up to 48 m n Gbps. Similar high bandwidth parallel communication between computers and peripheral networks may also be achieved.

Preferably, physical communication exchanges between layers of the multi-layer network are performed using a crossbar architecture, which may be implemented with selective optical switches when interconnected using active optical cables. The crossbar switch only needs to exchange data at the physical layer and does not involve high-level protocol analysis.

Preferably, when the usb or thunderbolt interface is used for both the display device interface and the peripheral interface, the interfaces of the switch and the active optical cable device are unified, so that the multilayer network can be realized by using the unified interface, and convenience is provided for multilayer network layout and device interface layout in homes and enterprises.

Preferably, in an intelligent system using an intelligent housekeeping, since all devices are abstracted to a user as one host (one intelligent housekeeping), the scheme realizes a simple human-computer interaction interface of all enterprise or home devices to the user;

the intelligent housekeeper obtains the user's instruction (audio, gesture, etc.) from the sensing network, the input device network, and after obtaining the needed information through the storage device network or the Ethernet network, the feedback information is sent to the user through the output device network or the display network.

The multi-layer network can realize the interconnection of any input device, any operation control unit and any output device. The combined structure is abstracted to the user as a computer with input devices, output devices and an arithmetic control unit.

Due to the adoption of a cross switch structure, the multilayer network can realize the interconnection of a plurality of sets of any input equipment, any operation control unit and any output equipment, and provides parallel support for the access of a plurality of users.

The device abstraction of the multilayer network structure of the invention enables any device to be accessed at any position, and breaks through the geographical position limitation of the device use.

In the multilayer network structure, different devices are divided into different networks, the communication of the input and output devices is only limited in the input device network and the output device network, and the display communication data is only limited in the display network.

In the intelligent system using the intelligent housekeeper, the intelligent housekeeper acquires the user instruction from any audio/video acquisition unit, can acquire the environment information of a family or an enterprise from any sensor equipment, and can acquire the user demand information through the Ethernet, and then the intelligent housekeeper automatically selects the display closest to the user and the audio equipment closest to the user to interact with the user, thereby realizing the man-machine interface which can be personified anytime and anywhere.

The interfaces among the multi-layer networks are realized by using a physical exchange form of a cross switch, so that multiple users can use the interfaces simultaneously, and bandwidth limitation cannot occur when the multiple users use different equipment combinations. Taking the display network as an example, if the port number N of the display network is N, the maximum bandwidth of the display network can reach N × the maximum data bandwidth of a single display. Compared with a wireless screen projection scheme limited by wireless network bandwidth, the method has obvious advantages.

In one embodiment of the present invention, a unified intelligent housekeeper is used as the computing and control unit and the system is composed of the display network, the input network, the output network and the sensor network, which are connected as shown in fig. 12. The realization utilizes the advantage of multilayer network structure for intelligent housekeeper can show corresponding information to the user in the position that has the display wantonly in family or enterprise. The voice acquisition system in the input network can enable a client to talk with the intelligent housekeeper at any position, and the sensor network can collect the environmental information of a family or an enterprise and give the information to the intelligent housekeeper for processing. Therefore, the abstract intelligent housekeeper is really realized to interact with the user at any position, corresponding data is returned, and corresponding information is displayed. Compared with the implementation mode of one intelligent housekeeper in most of rooms at present, the implementation mode is more flexible and friendly.

The invention provides a household or enterprise equipment interconnection structure of a multilayer network, which carries out cross interconnection of a physical layer according to equipment attributes and an original interface protocol, thereby realizing flexible interconnection of household equipment. All devices in a family can be abstracted into a computer with a von Neumann-like structure for a user, and which device is used as an arithmetic control unit, which is used as an input device, and which is used as an output device can be flexibly configured.

The multilayer network structure of the extended Von Neumann structure provided by the invention expands the mainstream flat connection mode of wireless interconnection of the smart home at present into a multilayer network connected according to the device characteristics in a classified manner, and breaks through the bandwidth limitation of wireless network connection. Wherein the display network is capable of reconfigurable transmission of more than 4k and even 8k of display information between any display source device and any display device. The display network can be connected in a copper wire connection mode or an active optical fiber interconnection mode, the maximum coverage range can realize the interconnection of equipment within the range of 300 meters in radius, and the geographic limitation of the use of the equipment is broken through. The input and output peripheral network used in the multilayer network can be connected in a copper wire connection mode or an active optical fiber interconnection mode, and connection between input and output equipment and operation control equipment in a large range can be achieved. And because of using the topological structure of network cross interconnection, the degree of freedom of connection combination between the input and output equipment and the operation control equipment is greatly expanded, and data communication between any input and output equipment and any operation control equipment can be realized. In addition, the device abstraction and virtualization scheme provided by the invention provides a brand new device remote control method, a user only needs to log in an external network interface remotely, a virtual input and output device is used for connecting any device in the operation control network, and the display output of the device in the operation control network is transmitted to a virtual display device so as to monitor the display content remotely.

Drawings

Fig. 1 is a computer architecture of a classical von neumann architecture.

Fig. 2 is a main topology of existing device interconnections.

Fig. 3 is a hierarchical network structure 1 that extends a device with a von neumann structure.

Fig. 4 is a specific topology example of the multilayer network structure 1.

Fig. 5 is a hierarchical network structure 2 that extends a device with a von neumann structure.

Fig. 6 is a concrete topology example of the hierarchical network structure 2.

Fig. 7 shows a concrete structure of the network.

Fig. 8 is a specific structure of the peripheral network.

Fig. 9 is a remote control scheme based on a multi-layer network structure.

Fig. 10 is a cross bar switch implementation.

Fig. 11 is a detailed embodiment 1 of a multi-layer network structure.

Fig. 12 is a multi-layer network architecture implementation 2.

Fig. 13 shows the coverage and connection options of the network.

Fig. 14 is a device abstraction of a multi-layer network.

Fig. 15 shows the coverage and connection mode of the input/output network.

Fig. 16 shows the selection of the multi-layer network coverage and connection mode of the full usb interface.

Detailed Description

The multi-level architecture proposed by the present invention extends the classical von neumann architecture shown in fig. 1. As shown in fig. 1, the classical von neumann architecture mainly includes an arithmetic unit, a controller, a memory device, an input device, and an output device, and is widely used in computer architectures. Fig. 2 shows a conventional topology for interconnecting devices, in which input and output devices are only interconnected with local devices, and the operator control devices are interconnected in a local area network manner, the flat interconnection structure enables only a limited degree of ethernet interconnection between the devices, and the computing and control devices are physically separated from each other, so that interfaces provided for users are scattered and physically separated. The invention popularizes the classical von Neumann structure to more macroscopic applications such as intelligent families, intelligent enterprises and the like.

The multi-layer network architecture 1 shown in fig. 3 is an extension of the classic von neumann architecture, abstracting all input devices in homes and businesses into a pool or network of input devices and output devices into a pool or network of output devices. The invention provides a multilayer network structure of an extended Von Neumann structure applied to the Internet of things, which divides household or enterprise equipment into the multilayer network structure according to equipment attributes and communication types; the multi-layer network architecture includes a network of input devices, a network of output devices, and a computing and control network. The physical exchange communication is carried out between the multilayer networks by using a cross-bar switch structure, and any input port in the cross-bar switch structure can reach any output port through configuration.

The multi-layer network layer division limits the equipment communication between adjacent layers, the communication between the equipment does not share the communication bandwidth, the input equipment network layer is connected with the calculation and control network layer through a cross switch, the output equipment network layer is connected with the calculation and control network layer through the cross switch, the equipment enables the communication between the equipment not to be limited by a common shared wireless network, and high-definition videos and other high-speed information are transmitted between the equipment in parallel.

A multi-layer network abstracts all output devices in a home or business to a user as a von neumann computer that contains input devices, output devices, and computing control devices.

All display equipment is abstracted into a display, all input equipment is abstracted into a set of input equipment for a user, and all calculation and control equipment is abstracted into a host for the user; the layers of the multi-layer network are switched by using a cross-bar switch structure, and the devices are connected with the switches by using optical fiber active cables, so that high-speed communication between any devices is not limited by physical distance.

The computation and control units of a macroscopic application are usually integrated in the same device, all computation and control devices being abstracted in fig. 2 as a computation and control network. Fig. 4 provides a specific connection topology example of the multi-layer network architecture 1. In fig. 4, the input device includes a mouse, a keyboard, a digital camera, a video camera, a scanner, a joystick, a remote controller, etc. which are commonly found in homes and enterprises, and the operation control unit includes a desktop computer, a tablet computer, a television box, a set-top box, a mobile phone, etc. The output devices mainly include a display, a television, a printer, and the like. In the topology, different connection modes are used according to different device attributes, for example, in fig. 4, an input device is connected with an input device switch, and the switch only performs cross-connection of a physical layer, that is, performs controllable interconnection of an arbitrary input port to an arbitrary output port. The switch output is connected with a common input port of the arithmetic control device (for example, usb, thunderbolt interface), and the structure can realize the interconnection of any input device to any arithmetic control device under different input switch configuration states.

The cross-bar switch is built by combining a plurality of devices and a plurality of devices, or is realized by an integrated or discrete microwave switch array, or can be realized by selecting an optical switch when active optical cables are used for interconnection. The connections between the crossbar and the devices may be made using copper connections or using active optical cables, with copper connections being selected when the connection distance is within a range of several meters, and active cable connections being selected when the connection distance is several hundred meters. The active cable is an active cable of a corresponding protocol, and comprises a hdmi active cable, a displayport active cable or a usb type active cable which are used in a display network, and a usb type active cable which is used in a peripheral network. The communication protocols of the input device network and the output device network comprise usb protocol, I2C, SPI, CAN and thunderbolt peripheral buses.

Similar to fig. 4, the operation control unit and the output device are interconnected in a physical layer cross manner through the switch, so that controllable interconnection from any operation control unit to any output device is realized. The interconnection between the operation control units still maintains the existing wired or wireless local area network interconnection mode, and an access interface of an external network is provided at the layer. The multi-level network architecture of fig. 4 generalizes the input and output devices of the classical von neumann architecture to an input device network and an output device network, and generalizes the arithmetic control unit to a computation and control network, providing device abstraction compared to the flat interconnection scheme of fig. 2, thereby providing any combination of the input device, the arithmetic control unit, and the output device regardless of the device geographical location. Meanwhile, the input data stream in the multilayer network is limited to the input network, the output data stream is limited to the output network, and the bandwidth of a local area network in the operation control network card is not occupied. Therefore, compared with the existing schemes such as wireless screen projection and the like, the multilayer network structure has the advantages of not being limited to the bandwidth of a wireless network, and can carry out display transmission with 4k and 8k resolutions on a plurality of displays in parallel under different combinations without causing any consumption on the bandwidth of the wireless network.

The display device in the output device can use common display data transmission protocols such as hdmi, displayport, vga, dvi and the like, and the output device network can contain common output devices such as a display, a television, a projector, a printer, an audio output device and the like. Unified interfaces, such as a usb interface (usb typeC interface and usb4 protocol propose support for displayport video transport) can be used in a multi-layer network.

The layered network structure 2 in fig. 5 is a further reconstruction of the layered network structure 1 in fig. 3 on the basis of the layered network shown in fig. 3. The invention relates to a multilayer network structure of an extended Von Neumann structure applied to the Internet of things, which divides household or enterprise equipment into the multilayer network structure according to equipment attributes and communication types.

The multi-layer network structure comprises a peripheral network, a computing and control network and a display network, wherein the peripheral network comprises a sensor network, an input device network, an output device network and a storage network.

High-definition videos (4K and 8K) can be transmitted in parallel between the computer and control network layer and the display network layer, and when the number of display devices is n, the number of the computer and control devices is m, and 8K60hz videos are output, the highest transmission bandwidth is up to 48 m n Gbps. Similar high bandwidth parallel communication between computers and peripheral networks may also be achieved. The multilayer network adopts a cross switch structure, realizes the interconnection of any peripheral, any computation and control unit and any display equipment, and provides parallel support for the access of a plurality of users.

Physical communication exchange is carried out between layers of the multilayer network by using a cross-bar switch structure, and the cross-bar switch can be realized by selecting an optical switch when active optical cables are used for interconnection. The crossbar switch only needs to exchange data at the physical layer and does not involve high-level protocol analysis.

Different from a computer system structure, the definitions of input equipment and output equipment in a macroscopic world are fuzzy, peripherals such as a mobile hard disk are input equipment and output equipment, and in addition, display equipment has a larger transmission bandwidth requirement compared with other output equipment, and generally uses special transmission interfaces such as DVI, VGA, HDMI and Displayport.

Based on these features the multi-layer network architecture 2 shown in fig. 5 divides the network into a peripheral network, a calculation and control network and a display network. The peripheral network may be subdivided into an input device network, an output device network, a storage device network, and a sensor network.

Fig. 6 shows a specific topology example of the multi-layer network structure 2, in which the input/output device performs physical layer switching with the operation and control unit through the switch of the input/output device, and in the structure shown in fig. 8, any input device can be connected with any computation and control unit through the switch. Similarly, the arithmetic and control unit in fig. 6 performs physical layer switching with the display through the switch.

The cross-bar switch is built by combining a plurality of devices and a plurality of devices, or is realized by an integrated or discrete microwave switch array, or can be realized by selecting an optical switch when active optical cables are used for interconnection.

The connections between the crossbar and the devices may be made using copper connections or using active optical cables, with copper connections being selected when the connection distance is within a range of several meters, and active cable connections being selected when the connection distance is several hundred meters. The active cable is an active cable of a corresponding protocol, and comprises a hdmi active cable, a displayport active cable or a usb type active cable which are used in a display network, and a usb type active cable which is used in a peripheral network.

The advantage of the multi-layer network structure 2 in fig. 6 is that the mainstream interfaces used by the devices of the peripheral network are usb interfaces, while the mainstream interfaces used in the display network are hdmi and displayport interfaces, and the uniformity of the protocols in the networks of each layer can simplify the implementation of the switch and the network.

When the usb or thunderbolt interface is used for both the display device interface and the peripheral interface, the interfaces of the switch and the active optical cable device are unified, so that the multilayer network can be realized by using the unified interface, and convenience is provided for multilayer network layout and device interface layout in families and enterprises.

The input and output devices of the present invention include common input and output devices, such as a keyboard, a mouse, an audio receiving device, an audio playing device, a camera, a scanner, a printer, a mobile hard disk, etc

The calculation and control unit in the invention comprises a desktop computer, a mobile tablet, a mobile phone, a television set-top box, a television box, an intelligent housekeeper device, a game machine and the like.

The display unit in the invention mainly comprises a display, a television, a projector and the like.

The sensor network in the invention can comprise common sensor equipment such as a temperature sensor, a humidity sensor, a distance sensor, a smoke sensor and the like.

The storage network in the invention mainly comprises common storage equipment such as a USB flash disk, a mobile hard disk and the like. The peripheral network usually uses usb as the main communication protocol, but is not limited to usb protocol, and other common peripheral buses such as I2C, SPI, CAN, etc. may also be used. The display device can use common display data transmission protocols such as hdmi, displayport, vga, dvi and the like, the specific structure of the multi-layer network-based remote control scheme proposed by the present invention is shown in fig. 9, a remote control agent device 1 is added to a topology structure of a multi-layer network structure 2 shown in fig. 8 to be connected to a computing and control network, and the unit is connected with an external network. The multi-layer network structure according to the present invention further includes a virtual input output device, a virtual display and a remote control agent device, the virtual input output device and the virtual display are added in fig. 9, and a virtual input output unit is directly connected to the remote control agent device 1 or may be physically implemented inside the remote control agent device 1, and the virtual input output unit converts a special ethernet request received by the remote control agent device into an input output request (e.g., usb communication) and transmits the input output request to an input output network, thereby simulating an input output device.

The remote control agent device receives control information in a specific network packet format through the Ethernet, the virtual input and output device analyzes the control information and sends the control information to the input and output device network by using a communication protocol of the input and output device to complete remote input, and the virtual input and output device is selected in the cross switch configuration and connected with the controlled computing and control unit.

The selected computing and control unit is selected in the cross switch configuration to be connected with the virtual display, the virtual display receives display data sent to a display network by the controlled computing and control unit and converts the display data into a network data packet with a specific format, and the network data packet is transmitted back to the remote control computer by the remote control agent device to complete remote display.

The virtual display device added in fig. 9 is directly connected to the remote control agent device 1 or implemented inside the remote control agent device 1, and the display information obtained from the display network is converted into a special ethernet packet by the virtual display and sent to the remote control access terminal of the external network through the remote control agent device 1.

As shown in fig. 9, the remote control calculation and control unit 2 is configured such that the calculation and control unit 2 is input/output using a virtual input/output device, and display information of the calculation and control unit 2 is transmitted to the telnet computer through the virtual display device 1 and the remote control agent device 1. Similarly, the remote control of any calculation and control unit can be realized through the configuration. For a remote control end user, the remotely accessed device is abstracted to a simple computer. The remote control does not depend on the remote control service of a third party such as teamviewer, and the access security can be ensured by adding login authority setting in the remote control agent device.

The remote login mode provided by the invention provides deep equipment control, for example, a remote controller can be remotely simulated to control a television, any equipment can be remotely logged in to carry out complex keyboard or mouse control, the remote login equipment copies or stores required data information, and any video monitoring equipment can be remotely controlled to transmit videos. Compared with the functions of simple switching, gear shifting and audio and video transmission of specific equipment of the existing intelligent home, the remote control mode has more deep control degree.

The remote control scheme provided by the invention has no specific interface requirement on the controlled equipment. Existing remote control of devices typically requires that the devices have bluetooth or wireless interfaces, and for devices without these interfaces, additional bluetooth or wireless switches are used to implement switching of the devices. The multi-layer network structure of the invention reserves the support for the original input/output interface and display interface of the equipment, and has better support for some equipment which does not support Bluetooth or wireless.

The connection mode of the equipment and the switch can select copper wire connection and active optical cable connection, for example, as shown in fig. 13, between the peripheral network and the peripheral switch, and between the peripheral switch and the calculation and control network, usb copper wire connection or usb active optical cable connection can be used, wherein the former is mainly used for the application with the transmission distance of several meters, and the latter can cover the geographical range of 300-400 meters in radius. As shown in fig. 11, between the calculation and control unit and the display network switch, an hdmi copper wire/displayport copper wire or an hdmi active optical cable/displayport active optical cable may be used between the display network switch and the display network. The former is mainly used for the application of transmission distance several meters, and the geographical range that the latter can cover can reach 300 ~ 400 meters radius. For the application of families and enterprises, the scheme of the active optical cable has better application prospect due to the advantages of long coverage distance, good signal quality, flexible wiring and the like.

The protocol used for input and output in the present invention is not limited to the usb protocol, and is applicable to all input and output protocols such as uart, SPI, I2C, GPIB, etc. For the usb protocol, the present invention may use typeA, typeB, typeC and all usb interface forms for input and output applications.

The protocol used by the display network is not limited to HDMI and Displayport protocols, and can support all common display protocols such as VGA, DVI and the like.

Since the concept of dp-alt mode is proposed in the usb typeC protocol, the usb interface of typeC can be used for transmission of video signals. In the latest usb4 protocol, a tunnel protocol for performing a display port protocol on the basis of the physical layer of usb4 is proposed, so that transmission of display port display signals can be realized on the basis of the physical connection of usb4, and therefore, the display network in the multi-layer network in the invention can also adopt an usb type c interface. Therefore, in such an application, the main interfaces of the multi-layer network can be unified into a usb interface, as shown in fig. 15, and usb copper wire connection or usb active optical cable connection can be selected for the structure, the former is mainly used for applications with transmission distances of several meters, and the latter can cover a geographic range of 300-400 meters in radius.

The basic structure of the cross-bar switch in the multi-layer network of the invention is shown in fig. 10, and can be realized by selecting and combining the existing equipment with multiple selection of 1 and 1 minute, selecting and forming a switch array by microwave switches, or selecting multiple paths by using optical switches when active optical cables are used.

The multi-layer network structure provided by the invention realizes the abstraction of equipment, and as shown in fig. 14, the multi-layer network structure provides the selection freedom degrees of selecting any input equipment, any output equipment, any calculation and control unit and any display equipment, and simultaneously, the interface for a user is a simple abstract computer, and a human-computer interface is simple.

In a specific embodiment 1, as shown in fig. 11, display devices such as a television, a monitor, and a projector are distributed in each room of a home, and the display devices are connected to a display device switch in a device room through an active HDMI cable or an active DP cable. The desktop host, the television box, the blue-ray player, the game machine and other equipment which are also distributed at different physical positions are connected with a display equipment switch in the equipment room through an active HDMI optical cable or an active DP optical cable. The keyboard, the mouse, the remote controller, the game handle and other equipment distributed at different physical positions are connected with the input and output equipment switch in the equipment room through the usb active optical cable. The desktop host, the television box, the blue-ray player, the game machine and other equipment are connected with an input and output equipment switch in the equipment room through an active usb optical cable. The multilayer network structure is constructed in such a connection mode, and the interconnection of any input and output device, any computation and control unit and any display can be realized. For example, a game can be played in a living room using a game pad and a television without moving a game host. And for example, when the position of the user needs to be moved, originally watched television content is routed to the vicinity of the moved display to be continuously watched. As shown in fig. 14, the device seen by the user is always an abstract computer, and the input/output device, the display device and the operation control unit of the abstract device can be mapped arbitrarily in the device pool of the home or enterprise.

In another embodiment 2, as shown in fig. 12, the computing and controlling unit is an intelligent housekeeping device, and in an intelligent system using the intelligent housekeeping device, since all devices are abstracted to the user as one host (one intelligent housekeeping), the solution implements a simple human-computer interaction interface for all enterprise or home devices to the user;

The intelligent housekeeper device is connected with the display device switch in the equipment room by using an active HDMI optical cable or an active DP optical cable. The display devices such as televisions, displays, projectors and the like distributed at different physical positions in a home or an enterprise are connected with the display device switch in the device room through the active HDMI optical cable or the active DP optical cable, and the display devices and the intelligent housekeeper device form a display network. The peripheral equipment switch in intelligent butler equipment and the equipment room uses active usb optical cable to connect. And audio acquisition equipment, video acquisition equipment and audio output equipment which are positioned at different positions in a home or an enterprise are used as main input and output equipment and are connected with a peripheral equipment switch in the equipment room through an active usb optical cable. They and the intelligent housekeeper form an input-output network. The temperature and humidity sensors, the distance sensors, the smoke sensors and other sensors located in different geographic positions are connected with the sensing information collecting host through a zigbee network, and the sensing information collecting host is connected with a peripheral equipment switch in the equipment room through an active usb optical cable. They form a sensor network with the intelligent housekeeper. The intelligent housekeeper automatically acquires audio and video information of the audio and video acquisition equipment to acquire instructions of a user, then acquires sensor network information for processing or accesses information required by the user through Ethernet, automatically selects a display close to the user to display after processing the information, and outputs language information at the nearby audio frequency of the client. Therefore, the user and the intelligent housekeeper are not limited to the interaction of physical positions anytime and anywhere, and the personified communication interface with the intelligent housekeeper anytime and anywhere is really realized.

In another embodiment 3, as shown in FIG. 9. In embodiment 1 or embodiment 2, a virtual input device, a virtual display and a remote control proxy device 1 are added, and a specific virtual input device is a hardware device capable of outputting mouse and keyboard communication packets on a usb interface according to the remote control proxy device 1. The virtual input device is accessed to the input network in embodiment 1 or embodiment 2. The virtual display is a hardware device that has edid information and can accept the display data of the display network in embodiment 1 or embodiment 2 and convert it into ethernet packets of a specific format. The remote control agent device 1 parses a specific ethernet packet to control the virtual input device to issue keyboard and mouse communications, and sends a display data packet sent from the virtual display to the remote computer through the ethernet. The connection mode in fig. 9 is selected in the multi-layer network connection configuration, the virtual input device 1 is used as an input, the remote control agent device 1 is used as a host, and the virtual display device 1 is used as a display, so that the remote computer can completely control the remote control agent device 1 through remote access. The remote control scheme can realize remote control without a remote control server of a third party such as a teamviewer and the like, can realize complex control combination, and can realize remote control with higher bandwidth because the remote control method does not need to be transmitted by the third party server and complex upper-layer protocol conversion.

In another specific embodiment 4, as shown in fig. 16, usb interfaces are applied to all interfaces in the multilayer network structure, so as to implement interface unification of the multilayer network.

Many modifications and other embodiments of the invention will come to the mind of one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the inventions are not to be limited to the specific embodiments disclosed and that modifications and embodiments are intended to be included within the scope of the appended claims. It is also to be understood that other embodiments of the present invention may be practiced in the absence of elements/steps not specifically disclosed herein.

Claims

1. A multilayer network structure of an extended Von Neumann structure applied to the Internet of things is characterized in that household or enterprise equipment is divided into a multilayer network structure according to equipment attributes and communication types;

2. The architecture of claim 1, wherein the multi-layer network abstracts all output devices in a home or business to a user into one von neumann computer that contains input devices, output devices, and computing control devices;

3. The fabric of claim 1, wherein the physical communication switching between the multiple network layers is performed using a crossbar fabric, wherein the crossbar is implemented using an optical switch that is selectable when interconnected using an active optical cable, and wherein the crossbar switches data switching only at the physical layer and does not involve higher layer protocol resolution.

4. The architecture of claim 1, wherein the multi-layer network architecture further comprises a virtual input output device, a virtual display, and a remote control agent device,

5. The architecture of claim 4, wherein the remote control agent device receives control information in a specific network packet format via the Ethernet, the virtual I/O device parses the control information and sends the control information to the I/O device network in the communication protocol of the I/O device to perform remote input, and the crossbar is configured to select the virtual I/O device to connect to the controlled computing and control unit.

6. The structure of claim 5, wherein selected computing and control units in the crossbar configuration are connected to the virtual display, and the virtual display receives display data sent by the controlled computing and control unit to the display network and converts the display data into network data packets of a specific format, and the network data packets are sent back to the remote control computer by the remote control agent device to complete the remote display.

7. A multilayer network structure of an extended Von Neumann structure applied to the Internet of things is characterized in that household or enterprise equipment is divided into a multilayer network structure according to equipment attributes and communication types;

High-definition videos can be transmitted in parallel between the computer and control network layer and the display network layer, and when the number of display devices is n, the number of computers and control devices is m, and 8k60hz videos are output, the highest transmission bandwidth is up to 48 m n Gbps. Similar high bandwidth parallel communication between computers and peripheral networks may also be achieved.

8. The fabric of claim 7, wherein the physical communication switching between the multiple network layers is performed using a crossbar fabric, the crossbar being implemented using selectable optical switches when interconnected using active optical cables, the crossbar switching data switching only at the physical layer.

9. The structure of claim 7, wherein when usb or thunderbolt interface is used for both the display device interface and the peripheral interface, the interfaces of the switch and the active optical cable device are unified, so that a unified interface is used for the multi-layer network.

10. The architecture of claim 7, wherein in an intelligent system using intelligent housekeeping, the solution enables a simple human-machine interaction interface for all enterprise or home devices to the user, since all devices are abstracted to the user as one host;

the intelligent housekeeper obtains the instruction of the user from the sensing network and the input device network, obtains the required information through the storage device network or the Ethernet network, and feeds back the information to the user through the output device network or the display network.