CN109660595B - Remote operation method and device for real-time street view - Google Patents

Remote operation method and device for real-time street view Download PDF

Info

Publication number
CN109660595B
CN109660595B CN201811327525.0A CN201811327525A CN109660595B CN 109660595 B CN109660595 B CN 109660595B CN 201811327525 A CN201811327525 A CN 201811327525A CN 109660595 B CN109660595 B CN 109660595B
Authority
CN
China
Prior art keywords
instruction
information system
geographic information
cursor
graphic workstation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811327525.0A
Other languages
Chinese (zh)
Other versions
CN109660595A (en
Inventor
王艳辉
亓娜
庾少华
杨春晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Visionvera Information Technology Co Ltd
Original Assignee
Visionvera Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visionvera Information Technology Co Ltd filed Critical Visionvera Information Technology Co Ltd
Priority to CN201811327525.0A priority Critical patent/CN109660595B/en
Publication of CN109660595A publication Critical patent/CN109660595A/en
Application granted granted Critical
Publication of CN109660595B publication Critical patent/CN109660595B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computing Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Computer Graphics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The embodiment of the application provides a remote operation method of real-time street view and a corresponding remote operation device of real-time street view, the method and the device are applied to the video network which comprises a video network server, a graphic workstation and a geographic information system, the graphic workstation is connected with the geographic information system in a remote communication way, the graphic workstation is used for reconstructing a plurality of paths of monitoring pictures sent by the video network server into a three-dimensional picture, the geographic information system is used for converting first operation data into a second operation instruction received by the graphic workstation, after the graphic workstation receives the second operation instruction, the three-dimensional picture is zoomed or translated according to the second operation instruction, and the zooming or translating of the three-dimensional picture in the graphic workstation is controlled by performing corresponding operation in the geographic information system, so that the remote operation of the monitoring picture in the graphic workstation is realized.

Description

Remote operation method and device for real-time street view
Technical Field
The application relates to the technical field of video networking, in particular to a remote operation method and device for real-time street view.
Background
The graphic workstation is a general name of a high-grade special computer which professionally engages in graphic, image (static), image (dynamic) and video work, and is widely applied to the fields of video monitoring, plane advertisement design, three-dimensional picture reconstruction and the like.
At present, in the aspect of video monitoring of a video network, the graphic workstation is adopted for viewing monitoring pictures, the graphic workstation performs three-dimensional reconstruction on a plurality of monitoring pictures and then displays the monitoring pictures on a display, and if a user wants to move the three-dimensional pictures to view pictures in different areas or needs to realize functions of amplifying or reducing the three-dimensional pictures, the user can only operate the three-dimensional pictures through an instruction format in the graphic workstation. With the development of network technology, the demand of users for remote monitoring and operation of three-dimensional images is increasing, and thus, a technology capable of remotely controlling a graphic workstation to remotely operate three-dimensional images is urgently needed in the prior art.
Disclosure of Invention
In view of the above problems, embodiments of the present application are proposed to provide a remote operation method of real-time street view and a corresponding remote operation apparatus of real-time street view that overcome or at least partially solve the above problems.
In order to solve the above problem, the present application discloses a remote operation method of real-time street view, which is applied to a video network, the video network includes a video network server, the video network server is further connected with a graphic workstation in a communication manner, the graphic workstation is used for reconstructing multiple monitoring pictures sent by the video network server into a three-dimensional stereo picture, the graphic workstation further establishes a remote communication connection with a geographic information system based on a TCP/IP protocol, and the method includes:
the geographic information system generating first operation data, the first operation data being generated by respective operations occurring in the geographic information system, the respective operations including a cursor translation operation, a cursor scroll operation;
the geographic information system converts the first operation data into a second operation instruction, and the second operation instruction adopts an instruction format accepted by the graphic workstation;
the geographic information system sends the second operation instruction to the graphic workstation, and the graphic workstation is further used for zooming or translating the three-dimensional stereo picture relative to the reference coordinate according to the second operation instruction; the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional picture.
Preferably, the first operation data includes a first action identifier and a first action numerical value, the first action identifier is an identifier of the cursor translation operation and an identifier of the cursor scroll operation, and the first action numerical value includes a translation distance of the cursor translation operation and a scroll cycle number of the cursor scroll operation.
Preferably, the step of the geographic information system converting the first operation data into the second operation instruction comprises:
the geographic information system acquires the first action identifier from the first operation data;
the geographic information system determines a target conversion protocol in preset conversion protocols aiming at the first action identifier;
the geographic information system converts the first operation data into a second operation instruction according to the target conversion protocol, wherein the second operation instruction comprises a second action instruction and a second operand value, the second action instruction comprises a translation instruction corresponding to the cursor translation operation and a zoom instruction corresponding to the cursor scroll operation, and the second operand value comprises translation distance data corresponding to the translation distance and zoom multiple data corresponding to the scroll week number.
The application also discloses a remote operation method of the real-time street view, which is applied to a video network, wherein the video network comprises a video network server, the video network server is also in communication connection with a graphic workstation, the graphic workstation is used for reconstructing multiple paths of monitoring pictures sent by the video network server into a three-dimensional stereo picture, and the graphic workstation establishes remote communication connection with a geographic information system based on a TCP/IP protocol, and the method comprises the following steps:
the graphic workstation receives a second operation instruction sent by the geographic information system, wherein the second operation instruction adopts an instruction format accepted by the graphic workstation; the second operation instruction is generated by the geographic information system after converting first operation data, the first operation data is generated by the geographic information system according to corresponding operations occurring in the geographic information system, and the corresponding operations comprise cursor translation operation and cursor rolling operation;
the graphic workstation zooms or translates the three-dimensional picture relative to a reference coordinate aiming at the second operation instruction; the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional picture.
Preferably, the first operation data includes a first action identifier and a first action numerical value, the first action identifier is an identifier of the cursor translation operation and an identifier of the cursor scroll operation, and the first action numerical value includes a translation distance of the cursor translation operation and a scroll cycle number of the cursor scroll operation.
Preferably, the second operation instruction includes a second action instruction, a second operand value, the second action instruction includes a translation instruction corresponding to the cursor translation operation, and a zoom instruction corresponding to the cursor scroll operation, and the second operand value includes translation distance data corresponding to the translation distance, and zoom multiple data corresponding to the scroll cycle number.
Preferably, the step of the graphics workstation scaling or translating the three-dimensional stereoscopic picture relative to the reference coordinate for the second operation instruction includes:
the graphic workstation extracts the second action instruction and the second operand value from the second operation instruction;
the graphic workstation extracts the translation instruction and the zooming instruction from the second action instruction, and extracts the translation distance data and the zooming multiple data from the second operand value;
the graphic workstation translates the three-dimensional picture relative to the reference coordinate according to the translation distance data aiming at the translation instruction;
and the graphic workstation scales the three-dimensional picture relative to the reference coordinate according to the scaling multiple data aiming at the scaling instruction.
In order to solve the above problem, the present application further discloses a corresponding remote operation device for real-time street view, the device is applied to a video network, the video network includes a video network server, a graphic workstation in communication connection with the video network server, and a geographic information system in communication connection with the graphic workstation, the graphic workstation is used for reconstructing multiple monitoring pictures sent by the video network server into a three-dimensional stereoscopic picture, and the device is located in the geographic information system, and includes:
the operation panel module is used for carrying out cursor translation operation and cursor rolling operation;
the operation data generation module is used for generating first operation data according to the cursor translation operation and the cursor rolling operation;
the format conversion module is used for converting the first operation data into a second operation instruction, wherein the second operation instruction adopts an instruction format received by the graphic workstation;
the communication module is used for sending the second operation instruction to the graphic workstation based on a TCP/IP protocol; the second operation instruction is used for triggering the graphic workstation to zoom or translate the three-dimensional stereo picture relative to the reference coordinate according to the second operation instruction; the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional picture.
Preferably, the format conversion module includes:
the operation data acquisition submodule is used for receiving the first operation data;
the conversion protocol storage submodule is used for storing a preset conversion protocol, and the conversion protocol comprises a plurality of target conversion protocols;
and the conversion submodule is used for determining a target conversion protocol in the preset conversion protocols according to the first operation data and converting the first operation data into a second operation instruction according to the target conversion protocol.
In order to solve the above problem, the present application further discloses another corresponding remote operation device for real-time street view, the device is applied to a video network, the video network includes a video network server, a graphic workstation in communication connection with the video network server, and a geographic information system in communication connection with the graphic workstation, the graphic workstation is used for reconstructing multiple monitoring pictures sent by the video network server into a three-dimensional stereo picture, and the device is located in the graphic workstation and includes:
an operation instruction obtaining module, configured to obtain a second operation instruction sent by the geographic information system, where the second operation instruction is in an instruction format accepted by the graphics workstation; the second operation instruction is generated by the geographic information system after converting first operation data, the first operation data is generated by the geographic information system according to corresponding operations occurring in the geographic information system, and the corresponding operations comprise cursor translation operation and cursor rolling operation;
and the picture operation module is used for executing the operation of zooming or translating the three-dimensional picture relative to a reference coordinate aiming at the second operation instruction, wherein the reference coordinate is the three-dimensional coordinate of a certain point in the three-dimensional picture.
Compared with the prior art, the embodiment of the application has the following advantages:
firstly, the embodiment of the application applies the characteristics of the video network to remotely communicate and connect the graphic workstation and the geographic information system, the operations of cursor translation, cursor rolling and the like performed on the geographic information system are firstly converted into the operation instruction format accepted by the graphic workstation, then the operation instruction formed after the conversion is remotely sent to the graphic workstation, and the graphic workstation executes the operation of translating or zooming the three-dimensional picture after receiving the operation instruction. The method and the device control the zooming and the translation of the three-dimensional picture on the graphic workstation through cursor translation and cursor rolling operations carried out on the in-ground information system, solve the technical problem that the monitoring picture can be checked and the monitoring picture can only be operated through the graphic workstation in the aspect of video monitoring, achieve the purpose of carrying out remote monitoring and operation on the three-dimensional picture, and meet the requirement that a user can remotely control the graphic workstation and further carry out remote indirect operation on the three-dimensional picture.
And secondly, cursor operation generated in the geographic information system is converted into an instruction format accepted by the graphic workstation, and the graphic workstation can directly control the three-dimensional picture according to the accepted instruction format, so that the compatibility of the geographic system and the graphic workstation in remote communication is improved, and the problem that remote control cannot be realized due to incompatibility of the instruction generated in the geographic information system and the graphic workstation when the graphic workstation is remotely controlled through the geographic information system is solved.
Finally, the conversion protocol is prestored in the geographic information system, the conversion protocol also comprises a target conversion protocol, the geographic information system can pointedly convert cursor translation operation into translation of a three-dimensional picture in the graphic workstation and convert cursor rolling operation into scaling operation of the three-dimensional picture in the graphic work, so that the conversion protocol in the instruction format can pointedly correspond to different operations of the cursor, and the accuracy and the precision of the operation instruction conversion of the geographic information system are improved.
Drawings
FIG. 1 is a networking schematic of a video network of the present application;
FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present application;
fig. 3 is a schematic diagram of a hardware architecture of an access switch of the present application;
fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present application;
FIG. 5 is a flowchart illustrating steps of embodiment 1 of a real-time street view remote operation method according to the present application;
FIG. 6 is a flowchart illustrating the steps of embodiment 2 of a real-time street view remote operation method according to the present application;
fig. 7 is a block diagram illustrating a configuration of an embodiment 3 of a real-time street view remote control apparatus according to the present invention;
fig. 8 is a block diagram of a preferred structure of a format conversion module according to embodiment 3 of the present application, which is a real-time street view remote operation device;
fig. 9 is a block diagram illustrating a configuration of the screen operating module in embodiment 3 of the real-time street view remote control device according to the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.
The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.
The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.
To better understand the embodiments of the present application, the following description refers to the internet of view:
some of the technologies applied in the video networking are as follows:
network technology (network technology)
Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.
Switching Technology (Switching Technology)
The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.
Server technology (Servertechnology)
The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.
Storage Technology (Storage Technology)
The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.
Network Security Technology (Network Security Technology)
The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.
Service Innovation Technology (Service Innovation Technology)
The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.
Networking of the video network is as follows:
the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.
As shown in fig. 1, the video network is divided into an access network and a metropolitan network.
The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.
The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.
Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.
The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.
The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.
Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.
The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.
Video networking device classification
1.1 devices in the video network of the embodiment of the present application can be mainly classified into 3 types: servers, switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.
1.2 wherein the devices of the access network part can be mainly classified into 3 types: node servers, access switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.).
The specific hardware structure of each access network device is as follows:
a node server:
as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;
the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.
The access switch:
as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;
wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 204 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.
The switching engine module 303 polls all packet buffer queues, which in this embodiment is divided into two cases:
if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate operation module;
if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.
The rate operation module 208 is configured by the CPU module 204, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.
The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate operation module 308.
Ethernet protocol conversion gateway：
As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a code rate operation module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.
Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;
the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type, and sends the packet.
The other modules in the ethernet protocol gateway function similarly to the access switch.
A terminal:
the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.
1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.
2. Video networking packet definition
2.1 Access network packet definition
The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.
As shown in the following table, the data packet of the access network mainly includes the following parts:
DA SA Reserved Payload CRC
wherein:
the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;
the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);
the reserved byte consists of 2 bytes;
the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;
the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.
2.2 metropolitan area network packet definition
The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present application: a label to uniquely describe a metropolitan area network device.
In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.
As shown in the following table, the data packet of the metro network mainly includes the following parts:
DA SA Reserved label (R) Payload CRC
Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.
Based on the characteristics of the video network, one of the core concepts of the embodiment of the application is provided, a geographic information system and a graphic workstation are connected in a remote communication mode according to a protocol of the video network, the geographic information system generates first operation data according to corresponding operations performed on the geographic information system, the geographic information system converts the first operation data into a second operation instruction, the second operation instruction formed after conversion is consistent with an instruction format for controlling a three-dimensional picture in the graphic workstation, and the graphic workstation zooms or translates the three-dimensional picture relative to a reference coordinate according to the second operation instruction. The technical means of remotely controlling the operation of the three-dimensional picture by the graphic workstation through the geographic information system is adopted, and the problem that the user can only operate the three-dimensional picture through the graphic workstation at present is solved.
Example one
Referring to fig. 5, a flowchart illustrating steps of embodiment 1 of a remote operation method for real-time street view according to the present application is shown, in this embodiment, the video network may include a video network server, the video network server is further communicatively connected to a graphics workstation, the graphics workstation may be configured to reconstruct multiple monitoring pictures sent by the video network server to form a three-dimensional stereoscopic picture, and the graphics workstation may further establish a remote communication connection with a geographic information system based on a TCP/IP protocol.
In practice, the TCP/IP protocol may preferably be a web socket protocol (webscolet protocol), which may be understood as a new network protocol based on TCP, and it implements full-duplex communication between the browser and the server, allowing the server to actively send information to the client, and using the web socket protocol, the client can still maintain real-time smooth communication even when the operation is frequent; in practice, the multiple paths of monitoring pictures processed by the graphic workstation are derived from video pictures acquired by a monitoring camera in a region where the graphic workstation is responsible for, and the video pictures are sent to the graphic workstation through the video networking server.
The embodiment of the application specifically comprises the following steps:
in step 501, the geographic information system generates first operation data, where the first operation data may be generated by a corresponding operation occurring in the geographic information system, and the corresponding operation may include a cursor translation operation and a cursor scroll operation performed in the geographic information system.
In practice, the geographic information system can be understood as a specific and very important spatial information system, which is a technical system for collecting, storing, managing, operating, analyzing, displaying and describing relevant geographic distribution data in the whole or part of the earth surface layer (including the atmosphere) space under the support of a computer hardware and software system, and can analyze and process spatial information. After the geographic information system establishes remote communication connection with the graphic workstation based on a TCP/IP protocol, the geographic information system and the graphic workstation can communicate with each other, a picture formed on the geographic information system can be a two-dimensional map picture of a monitoring area which is responsible for the graphic workstation, and in practice, the first operation data can be understood as an operation data packet generated when the two-dimensional map picture is subjected to cursor translation operation and cursor rolling operation in the geographic information system.
In practice, the cursor may also be understood as a mouse, a cursor translation operation performed by the cursor in the geographic information system may be understood as an operation in which the left button is pressed by the mouse and the cursor is not dragged, and a cursor scroll operation may be understood as an operation in which a scroll bar of the mouse is scrolled up and down.
In a preferred embodiment of the present application, the first operation data may include a first action identifier and a first action numerical value, the first action identifier is an identifier of the cursor translation operation and an identifier of the cursor scrolling operation, and the first action numerical value may include a translation distance of the cursor translation operation and a scrolling cycle number of the cursor scrolling operation.
For example, when the mouse generates a mark "p" during cursor translation, the first action mark is "p", when the mouse generates a mark "G" during scrolling, the first action mark is "G", and thus the operation of the mouse can be recognized by reading "p" and "G" in the geographic information system.
Step 502, the geographic information system converts the first operation data into a second operation instruction, and the second operation instruction adopts an instruction format accepted by the graphic workstation.
The first operation data is an operation data packet generated when a cursor translation operation and a cursor rolling operation are performed on a two-dimensional map picture in a geographic information system, a three-dimensional picture is processed in a graphic workstation, and if the first operation data for processing the two-dimensional map picture is directly sent to the graphic workstation to process the three-dimensional picture, the first operation data and the three-dimensional picture are incompatible due to different instruction formats and cannot be remotely controlled, so that the first operation data needs to be converted into an operation instruction consistent with the instruction format in the graphic workstation. After the first operation data is converted into the second operation instruction, the graphic workstation can directly control the three-dimensional picture according to the received instruction format, compatibility of the geographic system and the graphic workstation in remote communication is improved, and the problem that remote control cannot be achieved due to incompatibility of the instruction generated in the geographic information system and the graphic workstation when the graphic workstation is remotely controlled through the geographic information system is solved.
In a preferred embodiment of the present application, the step 502 may specifically include the following sub-steps:
sub-step S1, the geographic information system obtains the first action identification from the first operation data.
The first action identifier is obtained, and whether cursor translation operation or cursor rolling operation is performed in the geographic information system can be judged.
And a substep S2, the geographic information system determines a target conversion protocol among preset conversion protocols for the first action identifier.
The target conversion protocol of the conversion protocol can be multiple, and each target conversion protocol is used for different first action identifications. In practice, the translation distance of the cursor translation operation is measured in length, the number of the scrolling cycles of the cursor scrolling operation is measured in cycles, the data measurement modes of the cursor translation operation and the data measurement modes of the scrolling cycles are different, and during conversion, a specific target conversion protocol needs to be determined according to the action identifier. When the first action identifier identifies cursor translation operation, a target conversion protocol with a translation conversion function can be started, and the cursor translation operation is converted into translation of a three-dimensional picture in the graphic workstation in a targeted manner; when the first action identification identifies that the cursor scrolling operation is performed, a target conversion protocol with a scrolling conversion function can be started, and the cursor scrolling operation can be converted into a zooming operation of a three-dimensional picture in the graphic work. The operation data is converted in a targeted manner according to different operations of the cursor, so that the accuracy and the precision of the geographic information system for converting the operation instruction are improved.
In sub-step S3, the geographic information system converts the first operation data into a second operation command according to the target conversion protocol, where the second operation command includes a second action command and a second operand value, the second action command includes a translation command corresponding to the cursor translation operation and a zoom command corresponding to the cursor scroll operation, and the second operand value includes translation distance data corresponding to the translation distance and zoom factor data corresponding to the scroll cycle number.
Elaborating on the basis of the first action identifier:
in the first case: the first action identifier is an identifier of cursor translation operation, the geographic information system may convert the first operation data into second operation data according to a target conversion protocol having a translation conversion function, the second operation data may also include a second action instruction and a second operand value, the second action instruction is a translation instruction corresponding to the cursor translation operation, and the second operand value corresponds to translation distance data of the translation distance. For example, if the first action numerical value is 3cm, which indicates that the cursor has moved 3cm in translation, and the second operand numerical value is 20m after the conversion, it can be understood that the movement of the cursor by 3cm in the geographic information system corresponds to the movement of the three-dimensional stereoscopic screen in the control graphics workstation by 20 m.
In the second case: the geographic information system may convert the first operation data into second operation data according to a target conversion protocol having a function of scaling conversion, where the second operation data may also include a second action instruction and a second operand value, the second action instruction corresponds to a scaling instruction of the cursor scrolling operation, and the second operand value is scaling multiple data corresponding to the number of scrolling cycles of the cursor. For example, the first action value is +1 week, which means that the mouse scroll key has scrolled upwards for 1 week, and after the conversion, the second operand value is +1.5, which means that the mouse has scrolled upwards for 1 week, which means that the three-dimensional picture in the graphics workstation has been enlarged by 1.5 times, or that the three-dimensional picture has been zoomed in by 30m, so that the details can be seen clearly.
Step 503, the geographic information system sends the second operation instruction to the graphics workstation, and the graphics workstation is further configured to execute an operation of zooming or translating the three-dimensional stereoscopic picture relative to the reference coordinate according to the second operation instruction; the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional picture.
In practice, the geographic information system and the graphics workstation have established a communication connection based on a TCP/IP protocol, so that a second operation instruction can be sent to the graphics workstation based on the TCP/IP protocol, the second operation instruction is an operation instruction in accordance with an instruction format in the graphics workstation, the graphics workstation can translate or zoom the three-dimensional stereoscopic picture directly according to the second operation instruction, the translation of the three-dimensional stereoscopic picture can be understood as moving the three-dimensional stereoscopic picture from a current position to a next position so as to observe different positions in the three-dimensional stereoscopic picture, the zooming of the three-dimensional stereoscopic picture can be understood as amplifying or zooming out the three-dimensional picture, details of the three-dimensional stereoscopic picture can be viewed during amplifying, and the whole three-dimensional picture can be better viewed during zooming out. The reference coordinate may be understood as a three-dimensional coordinate of a certain point in the three-dimensional stereoscopic picture, and in practice, when the graphics workstation models the three-dimensional stereoscopic picture, the three-dimensional coordinate of a point in the three-dimensional stereoscopic picture, which is located in the middle of the three-dimensional stereoscopic picture, may be used as the reference coordinate, and of course, may also be the three-dimensional coordinate of a certain point randomly calculated by the graphics workstation.
In a preferred embodiment of the present invention, the second operation command may include a second action command and a second operand value, and the following details are described according to the second action command:
if the second motion instruction is a translation instruction, the graphics workstation may perform an operation of translating the three-dimensional stereoscopic picture with respect to the reference coordinate according to the translation distance data.
For example, if the translation distance data is 20m, the three-dimensional stereoscopic picture is translated by 20m with respect to the reference coordinates.
The second motion instruction is a zoom instruction, and the graphics workstation may perform an operation of zooming the three-dimensional stereoscopic picture with respect to the reference coordinate according to the zoom factor data.
For example, if the scaling factor data is 1.5, the three-dimensional stereoscopic picture is scaled by 1.5 times with respect to the reference coordinate.
In practice, the graphics workstation may further be in communication connection with a display, and perform zooming or translating operation on the three-dimensional stereoscopic picture according to the second operation instruction, and the translated or zoomed three-dimensional stereoscopic picture may be displayed by the display, and the user may view the three-dimensional stereoscopic picture by using the display.
A remote operation method of a real-time street view according to embodiment 1 of the present application is described below by way of a specific example:
the graphic workstation is in communication connection with the video networking server through a video networking protocol, 3 monitoring cameras are arranged in a monitoring area which is responsible for the graphic workstation, video pictures collected by the 3 monitoring cameras are sent to the graphic workstation through the video networking server, the graphic workstation carries out three-dimensional reconstruction on 3 paths of monitoring video pictures to form a three-dimensional picture, the graphic workstation is also in communication connection with a geographic information system through a network socket protocol (websocket protocol), operation instructions sent by the geographic information system are received, and the graphic workstation is further connected to a display for a user to watch the three-dimensional picture conveniently.
This example is explained in detail below in terms of the flow direction of the data stream:
firstly, carrying out cursor translation operation and then carrying out cursor rolling operation in a geographic information system; in operation data generated according to cursor translation operation, the action identifier is a translation identifier, specifically, the action identifier is translated leftwards and is represented by '-P', the action numerical value is 3cm, and the action numerical value is represented by translating leftwards by 3 cm; in the operation data generated according to the cursor scrolling operation, the action identifier is a scrolling identifier, specifically, scrolling upwards, and G is used——"indicates that the action number is" 1 ", indicating that the mouse has scrolled up for 1 week;
then, the geographic information system enables a target conversion protocol with a translation conversion function according to the translation identifier '-P', and the translation identifier is converted into a translation identifierIdentifying 'P' and converting into a translation instruction '-1', and converting an action numerical value '3 cm' into an operand '20 m'; according to rolling identification' G——"Enable target conversion protocol with scroll conversion function, identify scroll" G——"convert to zoom instruction" 0～", the action value" 1 "is converted into an operand value" 1.5 ". The shift instruction "-1", the operand "20 m", and the zoom instruction "0～"and operand values" 1.5 "are consistent with the instruction format in the graphics workstation.
Next, the geographic information system sends a pan command "-1", an operand value "20 m", and a zoom command "0～", operand value" 1.5 ", is sent to the graphics workstation.
Finally, the graphic workstation translates the three-dimensional picture leftwards by 20m relative to the reference coordinate according to the translation instruction '-1' and the operand '20 m'; according to the zoom instruction' 0～"and operand" 1.5 ", the three-dimensional picture is enlarged by 1.5 times relative to the reference coordinate, and after the three-dimensional picture is enlarged by 1.5 times, it can be understood from the three-dimensional picture that a part of the picture is viewed by being zoomed up by 30 m.
If the cursor in the geographic information system is operated by clicking the right button again, a 'reset' operation data is generated, the 'reset' operation data is transmitted to the graphic workstation after being converted according to a certain conversion protocol, and the graphic workstation resets the three-dimensional picture to the initial three-dimensional picture when the multi-path monitoring picture is reconstructed for the first time.
According to the embodiment of the application, the graphic workstation is in remote communication connection with the geographic information system, cursor translation, cursor rolling and other operations performed on the geographic information system are firstly converted into the operation instruction format accepted by the graphic workstation, then the operation instruction formed after conversion is remotely sent to the graphic workstation, and the graphic workstation executes the operation of translating or zooming the three-dimensional picture after receiving the operation instruction, so that the purpose of remotely controlling the graphic workstation to operate the three-dimensional picture is achieved, and the requirements of a user on remote video picture monitoring and remote video picture operation are met.
It should be noted that the operation of the present embodiment may be a cursor translation operation and a cursor scroll operation, and does not mean that the operation of the present application in the geographic information system is limited to the cursor translation operation and the cursor scroll operation, and in fact, the operation of the present application in the geographic information system may also be a right click operation.
Example two
Referring to fig. 6, there is shown a flow chart of the steps of embodiment 2 of the remote operation method of a real-time street view of the present application, in the embodiment of the application, the video network can comprise a video network server which is also connected with a graphic workstation in a communication way, the graphic workstation can be used for reconstructing the multi-channel monitoring pictures sent by the video network server to form three-dimensional stereo pictures, the graphics workstation may also establish a telecommunication connection with the geographic information system based on the TCP/IP protocol, in practice, the TCP/IP protocol may preferably be a web socket protocol (webscolet protocol), which may be understood as a new TCP-based network protocol that enables full duplex communication between the browser and the server, allowing the server to actively send information to the client, and by using which smooth real-time communication can be maintained even in the case of frequent operations.
The embodiment may specifically include the following steps:
601, the graphic workstation receives a second operation instruction sent by the geographic information system, wherein the second operation instruction adopts an instruction format accepted by the graphic workstation; the second operation instruction is generated by the geographic information system after converting first operation data, the first operation data is generated by the geographic information system according to corresponding operations generated in the geographic information system, and the corresponding operations comprise cursor translation operation and cursor rolling operation.
In practice, the graphics workstation processes a three-dimensional stereoscopic picture, the geographic information system processes a two-dimensional map picture, and therefore, when the two are processing pictures, the used instruction formats are different, the second operation instruction received by the graphics workstation is the instruction format for processing the three-dimensional stereoscopic picture, and the first operation instruction is the instruction format for the two-dimensional map picture, so that the first operation instruction can be firstly converted into the instruction format suitable for the graphics workstation in the geographic information system, and the specific generation process of the first operation instruction can refer to the relevant description of step 501 in embodiment 1, which is not discussed in detail herein.
In a preferred embodiment of the present application, the first operation data may include a first action identifier and a first action numerical value, the first action identifier is an identifier of the cursor translation operation and an identifier of the cursor scrolling operation, and the first action numerical value includes a translation distance of the cursor translation operation and a number of scrolling cycles of the cursor scrolling operation.
In practice, different actions of the mouse generate different operation data corresponding to the action, and in order to distinguish the different operation data, the operation data are distinguished by using the action identifier, so that the second operation data received by the graphic workstation are pertinently corresponding to different operations of the cursor. For example, if the mouse performs cursor translation, and the translation distance is 2cm, the first action identifier of the generated first operation data is "p", the first action numerical value is "2", that is, "p" indicates that the first action numerical value "2" is the translation distance generated by the cursor translation operation; and (3) performing a rolling operation on the mouse, and rolling upwards for one circle, wherein the first action identifier of the generated first operation data is 'G', the first operand value is '1', namely 'G' indicates that the first action value '1' is the rolling week number generated by the cursor rolling operation, and the geographic information system can immediately execute corresponding conversion according to the action identifier.
In a case where the first operation data may include a first motion identifier and a first motion numerical value, the second operation instruction may include a second motion instruction and a second operand value, the second motion instruction includes a translation instruction corresponding to the cursor translation operation and a zoom instruction corresponding to the cursor scroll operation, and the second operand value includes translation distance data corresponding to the translation distance and zoom factor data corresponding to the scroll cycle number.
That is, the second operation instruction received by the graphics workstation includes the second action instruction converted according to the first action identifier in the first operation data, and the second operation numerical value converted according to the first action numerical value, where the second action instruction and the second operation data are the instruction and data used by the graphics workstation to process the three-dimensional stereoscopic picture, and the graphics workstation may determine to translate or zoom the three-dimensional picture according to the second action instruction, and may determine the translation distance and the zoom multiple of the three-dimensional stereoscopic picture according to the second operation data.
Step 602, the graphics workstation zooms or translates the three-dimensional stereoscopic picture relative to the reference coordinate for the second operation instruction; the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional picture.
In a preferred embodiment of the present application, step 602 may accordingly comprise the following sub-steps:
and a substep C1, the graphics workstation obtaining the second action command and the second operand value from the second operation command.
The obtaining of the second action instruction may determine whether to translate or zoom the three-dimensional stereoscopic image, and the obtaining of the second operand value may determine how much distance to translate or zoom the three-dimensional stereoscopic image.
And a substep C2, obtaining, by the graphics workstation, the panning command and the zooming command from the second motion command, and obtaining, by the graphics workstation, the panning distance data and the zooming factor data from the second operand value.
And a substep C3, wherein the graphics workstation executes an operation of translating the three-dimensional stereoscopic picture relative to the reference coordinate according to the translation distance data, according to the translation instruction.
And a substep C4, wherein the graphics workstation executes an operation of scaling the three-dimensional stereoscopic picture relative to the reference coordinate according to the scaling factor data for the scaling instruction.
A remote operation method of a real-time street view according to embodiment 2 of the present application is described below by way of a specific example:
the method comprises the steps that a graphic workstation is in communication connection with a geographic information system through a network socket protocol (websocket protocol), the graphic workstation is also in communication connection with a video networking server through the video networking protocol, then the graphic workstation receives multiple paths of monitoring video pictures sent by the video networking server, the monitoring video pictures are monitoring pictures collected by all monitoring cameras in a monitoring area which is in charge of the graphic workstation, the graphic workstation carries out three-dimensional reconstruction on the multiple paths of monitoring video pictures to form three-dimensional pictures, and the graphic workstation is further connected to a display for the convenience of watching of a user.
Firstly, the graphic workstation receives an operation instruction sent by a geographic information system, wherein the operation instruction is converted by the geographic information system according to operation data generated by cursor translation operation and cursor rolling operation; in this example, the operation data generated by the geographic information system according to the cursor translation operation includes an action identifier and an action numerical value, where the action identifier is a translation identifier and is represented by "P-", and the action numerical value is 3cm and represents a rightward translation by 3 cm; in the operation data generated according to the cursor scrolling operation, the action identifier is a scrolling identifier, specifically, scrolling upwards, and G is used——"indicates that the action number is" 1 ", indicating that the mouse has scrolled downward for 1 week; after conversion, the action commands in the second operation received by the graphic workstation are ' 1- ' and ' 0～", the corresponding operand values are" 30m "and" 1.5 ".
Finally, the graphic workstation translates the three-dimensional picture to the right by 30m relative to the reference coordinate according to the action command '1-' and the operand '30 m'; according to the action command' 0～", operand" 1.5 ", the three-dimensional picture is reduced by 1.5 times relative to the reference coordinate, and after the three-dimensional picture is reduced by 1.5 times, the three-dimensional picture is drawn from the three-dimensional pictureThe face view can be understood as that a part of the picture is zoomed out by 30m for viewing.
It is also noted that, for simplicity of explanation, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the embodiments. Further, those skilled in the art will also appreciate that the embodiments described in the specification are presently preferred and that no particular act is required of the embodiments of the application.
EXAMPLE III
As shown in fig. 7, compared with the processing method of embodiment 1, the apparatus for remote operation of real-time street view according to embodiment 3 of the present application may be applied to a video network, where the video network may include a video network server, a graphic workstation capable of being connected to the video network server in communication, and a geographic information system capable of being connected to the graphic workstation in communication, and the graphic workstation may be configured to reconstruct multiple monitoring pictures sent by the video network server into a three-dimensional stereoscopic picture, and the apparatus is located in the geographic information system, and specifically may include:
an operation panel module 701, which may be located in the geographic information system and may be used to perform cursor translation operation and cursor scrolling operation;
an operation data generating module 702, which may be located in the geographic information system, and may be configured to generate first operation data according to the cursor translation operation and the cursor scrolling operation;
a format conversion module 703, which may be located in the geographic information system, and may be configured to convert the first operation data into a second operation instruction, where the second operation instruction is in an instruction format received by the graphics workstation;
a communication module 704, which may be configured to send the second operation instruction to the graphics workstation based on a TCP/IP protocol; the second operation instruction is used for triggering the graphic workstation to zoom or translate the three-dimensional stereo picture relative to the reference coordinate according to the second operation instruction; the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional picture.
In this embodiment, the operation panel module 701 may be understood as a software panel for performing a translation and a scroll operation on a mouse in the geographic information system. The operation data generating module 702 is in communication connection with the operation panel module 701, and is configured to generate first operation data according to a corresponding action of the mouse when the corresponding action of the mouse occurs on the operation panel module 701, by the operation data generating module 702. The format conversion module 703 is in communication connection with the operation data generation module 702, and after the first operation data is generated, the format conversion module 703 acquires the first operation data and converts the first operation data into a format conversion instruction used by the graphics workstation according to a target conversion protocol pre-stored in the format conversion module. The communication module 704 is communicatively connected to the format conversion module 703, and sends the second operation instruction to the graphics workstation based on a TCP/IP protocol, which may be a websocket protocol.
As a preferred embodiment of the present application, as shown in fig. 8, the format conversion module may include:
an operation data obtaining sub-module 801, configured to receive the first operation data;
a conversion protocol storage sub-module 802, configured to store a preset conversion protocol, where the conversion protocol includes multiple target conversion protocols;
the conversion sub-module 803 is configured to determine a target conversion protocol in the preset conversion protocol according to the first operation data, and convert the first operation data into a second operation instruction according to the target conversion protocol.
In practice, there are a plurality of target conversion protocols, each corresponding to a conversion function, for example, one of the target conversion protocols may convert data generated by a cursor translation operation into a translation operation instruction of a three-dimensional stereoscopic picture in the graphics workstation, and may convert data generated by a cursor scroll operation into a zoom operation instruction of the three-dimensional stereoscopic picture in the graphics workstation. Therefore, targeted conversion can be realized, and when the cursor performs translation operation and scrolling operation simultaneously, data generated by each operation can be converted orderly according to the operation target conversion protocol without generating a pause phenomenon in the data conversion process.
The remote operation device of the real-time street view can convert operations such as cursor translation, cursor rolling and the like performed on a geographic information system into an operation instruction format which can be accepted by a graphic workstation, remotely transmits an operation instruction formed after conversion to the graphic workstation, and the graphic workstation executes operations of translating or zooming a three-dimensional picture after receiving the operation instruction. The technical problem that in the aspect of video monitoring, monitoring pictures can be checked and operated only through a graphic workstation is solved, the purpose of remotely monitoring and operating three-dimensional pictures is achieved, and the requirement that a user can remotely control the graphic workstation to remotely and indirectly operate the three-dimensional pictures is met.
Example four
As shown in fig. 9, a remote operation device of a real-time street view according to embodiment 4 of the present application, compared with the processing method of embodiment 2, the device may be applied to a video network, where the video network may include a video network server, a graphic workstation capable of being connected to the video network server in a communication manner, and a geographic information system capable of being connected to the graphic workstation in a communication manner, and the graphic workstation may be configured to reconstruct multiple monitoring pictures sent by the video network server into a three-dimensional stereoscopic picture, and the device is located in the graphic workstation, and specifically may include:
an operation instruction obtaining module 901, configured to obtain a second operation instruction sent by the geographic information system, where the second operation instruction is in an instruction format accepted by the graphics workstation; the second operation instruction is generated by the geographic information system after converting first operation data, the first operation data is generated by the geographic information system according to corresponding operations occurring in the geographic information system, and the corresponding operations comprise cursor translation operation and cursor rolling operation;
a picture operation module 902, configured to, for the second operation instruction, execute an operation of scaling or translating the three-dimensional stereoscopic picture relative to a reference coordinate, where the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional stereoscopic picture.
In this embodiment, the second operation instruction may include an action instruction and action data, the operation instruction obtaining module 901 may be in communication connection with the screen operation module 902, after receiving the second operation instruction from the geographic information system, the operation instruction obtaining module 901 extracts the action instruction and the action data in the second operation instruction, and the screen operation module 902 determines, according to the action instruction, that the three-dimensional stereoscopic screen is scaled or translated, and determines, according to the action data, a multiple of scaling or a distance of translation of the three-dimensional stereoscopic screen.
The remote operation device of the real-time street view can receive the converted operation instruction sent by the geographic information system, and can perform translation or scaling operation on the three-dimensional picture according to the operation instruction. The technical problem that in the aspect of video monitoring, monitoring pictures can be checked and operated only through a graphic workstation is solved, the purpose of remotely monitoring and operating three-dimensional pictures is achieved, and the requirement that a user can remotely control the graphic workstation to remotely and indirectly operate the three-dimensional pictures is met.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one of skill in the art, embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The method for remotely operating a real-time street view and the corresponding device for remotely operating a real-time street view provided by the application are described in detail above, and specific examples are applied to explain the principle and the implementation manner of the application, and the description of the above embodiments is only used to help understand the method and the core idea of the application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (10)

1. A remote operation method of real-time street view is applied to a video network, the video network comprises a video network server, the video network server is also in communication connection with a graphic workstation, the graphic workstation is used for reconstructing multiple monitoring pictures sent by the video network server into three-dimensional stereo pictures, the graphic workstation is also in remote communication connection with a geographic information system based on a TCP/IP protocol, the TCP/IP protocol is a network socket protocol, and the method comprises the following steps:
the geographic information system generating first operation data, the first operation data being generated by respective operations occurring in the geographic information system, the respective operations including a cursor translation operation, a cursor scroll operation;
the geographic information system converts the first operation data into a second operation instruction, and the second operation instruction adopts an instruction format accepted by the graphic workstation;
the geographic information system sends the second operation instruction to the graphic workstation, and the graphic workstation is further used for zooming or translating the three-dimensional stereo picture relative to the reference coordinate according to the second operation instruction; the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional picture.
2. The method according to claim 1, wherein the first operation data includes a first action identifier and a first action numerical value, the first action identifier is an identifier of the cursor translation operation and the cursor scroll operation, and the first action numerical value includes a translation distance of the cursor translation operation and a scroll cycle number of the cursor scroll operation.
3. The method of claim 2, wherein the step of the geographic information system converting the first operational data into the second operational instructions comprises:
the geographic information system acquires the first action identifier from the first operation data;
the geographic information system determines a target conversion protocol in preset conversion protocols aiming at the first action identifier;
the geographic information system converts the first operation data into a second operation instruction according to the target conversion protocol, wherein the second operation instruction comprises a second action instruction and a second operand value, the second action instruction comprises a translation instruction corresponding to the cursor translation operation and a zoom instruction corresponding to the cursor scroll operation, and the second operand value comprises translation distance data corresponding to the translation distance and zoom multiple data corresponding to the scroll week number.
4. A remote operation method of real-time street view is applied to a video network, the video network comprises a video network server, the video network server is also in communication connection with a graphic workstation, the graphic workstation is used for reconstructing multiple monitoring pictures sent by the video network server into three-dimensional stereo pictures, the graphic workstation is also in remote communication connection with a geographic information system based on a TCP/IP protocol, the TCP/IP protocol is a network socket protocol, and the method comprises the following steps:
the graphic workstation receives a second operation instruction sent by the geographic information system, wherein the second operation instruction adopts an instruction format accepted by the graphic workstation; the second operation instruction is generated by the geographic information system after converting first operation data, the first operation data is generated by the geographic information system according to corresponding operations occurring in the geographic information system, and the corresponding operations comprise cursor translation operation and cursor rolling operation;
the graphic workstation zooms or translates the three-dimensional picture relative to a reference coordinate aiming at the second operation instruction; the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional picture.
5. The method according to claim 4, wherein the first operation data includes a first action identifier and a first action numerical value, the first action identifier is an identifier of the cursor translation operation and the cursor scroll operation, and the first action numerical value includes a translation distance of the cursor translation operation and a scroll cycle number of the cursor scroll operation.
6. The method according to claim 5, wherein the second operation instruction comprises a second action instruction, a second operand value, the second action instruction comprises a translation instruction corresponding to the cursor translation operation, and a zoom instruction corresponding to the cursor scroll operation, and the second operand value comprises translation distance data corresponding to the translation distance, and zoom factor data corresponding to the scroll cycle number.
7. The method according to claim 6, wherein the step of the graphics workstation scaling or translating the three-dimensional stereoscopic picture with respect to the reference coordinates for the second operation instruction comprises:
the graphic workstation extracts the second action instruction and the second operand value from the second operation instruction;
the graphic workstation extracts the translation instruction and the zooming instruction from the second action instruction, and extracts the translation distance data and the zooming multiple data from the second operand value;
the graphic workstation translates the three-dimensional picture relative to the reference coordinate according to the translation distance data aiming at the translation instruction;
and the graphic workstation scales the three-dimensional picture relative to the reference coordinate according to the scaling multiple data aiming at the scaling instruction.
8. A remote operation device of real-time street view is applied to a video network, the video network comprises a video network server, a graphic workstation in communication connection with the video network server, and a geographic information system in communication connection with the graphic workstation based on a TCP/IP protocol, the TCP/IP protocol is a network socket protocol, the graphic workstation is used for reconstructing a plurality of monitoring pictures sent by the video network server into a three-dimensional stereo picture, and the device is positioned in the geographic information system and comprises:
the operation panel module is used for carrying out cursor translation operation and cursor rolling operation;
the operation data generation module is used for generating first operation data according to the cursor translation operation and the cursor rolling operation;
the format conversion module is used for converting the first operation data into a second operation instruction, wherein the second operation instruction adopts an instruction format received by the graphic workstation;
the communication module is used for sending the second operation instruction to the graphic workstation based on a TCP/IP protocol; the second operation instruction is used for triggering the graphic workstation to zoom or translate the three-dimensional stereo picture relative to the reference coordinate according to the second operation instruction; the reference coordinate is a three-dimensional coordinate of a certain point in the three-dimensional picture.
9. The apparatus of claim 8, wherein the format conversion module comprises:
the operation data acquisition submodule is used for receiving the first operation data;
the conversion protocol storage submodule is used for storing a preset conversion protocol, and the conversion protocol comprises a plurality of target conversion protocols;
and the conversion submodule is used for determining a target conversion protocol in the preset conversion protocols according to the first operation data and converting the first operation data into a second operation instruction according to the target conversion protocol.
10. A remote operation device of real-time street view is applied to a video network, the video network comprises a video network server, a graphic workstation in communication connection with the video network server, and a geographic information system in communication connection with the graphic workstation based on a TCP/IP protocol, the TCP/IP protocol is a network socket protocol, the graphic workstation is used for reconstructing a plurality of monitoring pictures sent by the video network server into a three-dimensional stereo picture, and the device is positioned in the graphic workstation and comprises:
an operation instruction obtaining module, configured to obtain a second operation instruction sent by the geographic information system, where the second operation instruction is in an instruction format accepted by the graphics workstation; the second operation instruction is generated by the geographic information system after converting first operation data, the first operation data is generated by the geographic information system according to corresponding operations occurring in the geographic information system, and the corresponding operations comprise cursor translation operation and cursor rolling operation;
and the picture operation module is used for executing the operation of zooming or translating the three-dimensional picture relative to a reference coordinate aiming at the second operation instruction, wherein the reference coordinate is the three-dimensional coordinate of a certain point in the three-dimensional picture.
CN201811327525.0A 2018-11-08 2018-11-08 Remote operation method and device for real-time street view Active CN109660595B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811327525.0A CN109660595B (en) 2018-11-08 2018-11-08 Remote operation method and device for real-time street view

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811327525.0A CN109660595B (en) 2018-11-08 2018-11-08 Remote operation method and device for real-time street view

Publications (2)

Publication Number Publication Date
CN109660595A CN109660595A (en) 2019-04-19
CN109660595B true CN109660595B (en) 2021-08-13

Family

ID=66110160

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811327525.0A Active CN109660595B (en) 2018-11-08 2018-11-08 Remote operation method and device for real-time street view

Country Status (1)

Country Link
CN (1) CN109660595B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112951228A (en) * 2021-02-02 2021-06-11 上海市胸科医院 Method and equipment for processing control instruction

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101033960A (en) * 2007-02-05 2007-09-12 武汉大学 Imaging detecting system and method of ultrahigh resolution camera
CN101435708A (en) * 2008-12-05 2009-05-20 四川长虹电器股份有限公司 Real time roaming and scaling method of vector map in mobile navigation equipment
CN102156779A (en) * 2011-04-13 2011-08-17 北京石油化工学院 Subsurface flow simulating and predictive analysis method
CN102214368A (en) * 2010-04-07 2011-10-12 北京国遥新天地信息技术有限公司 Implementation method of three dimensional full-dimension digital globe
CN102750724A (en) * 2012-04-13 2012-10-24 广州市赛百威电脑有限公司 Three-dimensional and panoramic system automatic-generation method based on images
CN102792322A (en) * 2009-09-30 2012-11-21 天宝导航有限公司 Visual organization of information via associated geospatial data
CN102938899A (en) * 2012-04-19 2013-02-20 中通服网优技术有限公司 Optimization system for wifi communication at rail transit stations
CN103295258A (en) * 2013-04-18 2013-09-11 于连庆 Novel multifunctional atmospheric science data graphic rendering engine
CN103439945A (en) * 2013-08-27 2013-12-11 国家电网公司 Large-size screen displaying system for power operation monitoring center
CN103700133A (en) * 2013-12-20 2014-04-02 广东威创视讯科技股份有限公司 Three-dimensional scene distributed rendering synchronous refreshing method and system
CN107995231A (en) * 2016-10-26 2018-05-04 北京视联动力国际信息技术有限公司 A kind of method and apparatus of remote control equipment
CN108419041A (en) * 2017-02-09 2018-08-17 北京视联动力国际信息技术有限公司 A kind of method and apparatus of video data processing

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101033960A (en) * 2007-02-05 2007-09-12 武汉大学 Imaging detecting system and method of ultrahigh resolution camera
CN101435708A (en) * 2008-12-05 2009-05-20 四川长虹电器股份有限公司 Real time roaming and scaling method of vector map in mobile navigation equipment
CN102792322A (en) * 2009-09-30 2012-11-21 天宝导航有限公司 Visual organization of information via associated geospatial data
CN102214368A (en) * 2010-04-07 2011-10-12 北京国遥新天地信息技术有限公司 Implementation method of three dimensional full-dimension digital globe
CN102156779A (en) * 2011-04-13 2011-08-17 北京石油化工学院 Subsurface flow simulating and predictive analysis method
CN102750724A (en) * 2012-04-13 2012-10-24 广州市赛百威电脑有限公司 Three-dimensional and panoramic system automatic-generation method based on images
CN102938899A (en) * 2012-04-19 2013-02-20 中通服网优技术有限公司 Optimization system for wifi communication at rail transit stations
CN103295258A (en) * 2013-04-18 2013-09-11 于连庆 Novel multifunctional atmospheric science data graphic rendering engine
CN103439945A (en) * 2013-08-27 2013-12-11 国家电网公司 Large-size screen displaying system for power operation monitoring center
CN103700133A (en) * 2013-12-20 2014-04-02 广东威创视讯科技股份有限公司 Three-dimensional scene distributed rendering synchronous refreshing method and system
CN107995231A (en) * 2016-10-26 2018-05-04 北京视联动力国际信息技术有限公司 A kind of method and apparatus of remote control equipment
CN108419041A (en) * 2017-02-09 2018-08-17 北京视联动力国际信息技术有限公司 A kind of method and apparatus of video data processing

Also Published As

Publication number Publication date
CN109660595A (en) 2019-04-19

Similar Documents

Publication Publication Date Title
CN110489042B (en) Method and system for simulating dragging based on video network
CN109819214B (en) Video split-screen method and device
CN109547731B (en) Video conference display method and system
CN109194915B (en) Video data processing method and system
CN108989837A (en) A kind of method and apparatus of picture interception
CN109246135B (en) Method and system for acquiring streaming media data
CN111124333A (en) Method, device, equipment and storage medium for synchronizing display contents of electronic whiteboard
CN110557612B (en) Control method of monitoring equipment and video networking system
CN109544879B (en) Alarm data processing method and system
CN109802952B (en) Monitoring data synchronization method and device
CN109743555B (en) Information processing method and system based on video network
CN110830763A (en) Monitoring video inspection method and device
CN108989850B (en) Video playing control method and control system
CN111212255B (en) Monitoring resource obtaining method and device and computer readable storage medium
CN109660595B (en) Remote operation method and device for real-time street view
CN110572363B (en) Product display method and device based on video network, electronic equipment and storage medium
CN109768964B (en) Audio and video display method and device
CN110519554B (en) Monitoring detection method and device
CN110858887A (en) Method and device for playing monitoring data
CN108574655B (en) Conference monitoring and broadcasting method and device
CN109309787B (en) Operation method and system of panoramic video data
CN110830185B (en) Data transmission method and device
CN110896461B (en) Unmanned aerial vehicle shooting video display method, device and system
CN109379553B (en) Audio and video data display method and system
CN110795008B (en) Picture transmission method and device and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant