CN115795699A - Method and device for establishing digital twin model of spacecraft launching field - Google Patents

Method and device for establishing digital twin model of spacecraft launching field Download PDF

Info

Publication number
CN115795699A
CN115795699A CN202310068903.2A CN202310068903A CN115795699A CN 115795699 A CN115795699 A CN 115795699A CN 202310068903 A CN202310068903 A CN 202310068903A CN 115795699 A CN115795699 A CN 115795699A
Authority
CN
China
Prior art keywords
data
data frame
sensor
field
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310068903.2A
Other languages
Chinese (zh)
Other versions
CN115795699B (en
Inventor
焦翔
蒯亮
赵文策
周淦
杜超
周宇
李林峰
杜兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
6th Research Institute of China Electronics Corp
Original Assignee
6th Research Institute of China Electronics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 6th Research Institute of China Electronics Corp filed Critical 6th Research Institute of China Electronics Corp
Priority to CN202310068903.2A priority Critical patent/CN115795699B/en
Publication of CN115795699A publication Critical patent/CN115795699A/en
Application granted granted Critical
Publication of CN115795699B publication Critical patent/CN115795699B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Image Analysis (AREA)

Abstract

The application provides a method and a device for establishing a digital twin model of a spacecraft launching field, wherein the method comprises the following steps: acquiring sensor data uploaded by each sensor in a launching field of a target spacecraft; performing re-framing processing on each original data frame in the sensor data uploaded by each sensor to obtain a reconstructed data frame corresponding to the original data frame; and mapping the target spacecraft launching field based on the recombined data frame to establish a digital twin model of the target spacecraft launching field. By the establishing method and the establishing device, the digital twin model of the spacecraft launching field with uniform pictures can be established, so that the follow-up emergency treatment of multi-level linkage and coordination uniformity can be realized.

Description

Method and device for establishing digital twin model of spacecraft launching field
Technical Field
The application relates to the technical field of digital twins, in particular to a method and a device for establishing a digital twins model of a spacecraft launching field.
Background
The digital twin is a simulation process integrating multidisciplinary, multi-physical quantity, multi-scale and multi-probability by fully utilizing data such as a physical model, sensor updating, operation history and the like, and mapping is completed in a virtual space, so that the full life cycle process of corresponding entity equipment is reflected. In order to monitor various operating conditions in the whole spacecraft launching field in real time, multiple types of sensors are generally arranged at multiple places to be monitored in the spacecraft launching field, and a digital twin model of the spacecraft launching field is established by receiving sensor data uploaded by the multiple types of sensors.
At present, when a digital twin model of a spacecraft launching field is established, good fusion cannot be realized in the face of multi-source heterogeneous data resources uploaded by various sensors, so that the established digital twin model of the spacecraft launching field cannot realize good image unification, and therefore, multi-level linkage and coordinated unified emergency treatment cannot be realized in the spacecraft launching field subsequently.
Disclosure of Invention
In view of the above, an object of the present application is to provide a method and an apparatus for establishing a digital twin model of a spacecraft launching field, which can establish a digital twin model of a spacecraft launching field with a uniform picture, thereby ensuring that subsequent emergency treatment with multi-level linkage and coordination and unification can be realized.
In a first aspect, an embodiment of the present application provides a method for establishing a digital twin model of a spacecraft launching field, where the method includes:
(A) Acquiring sensor data uploaded by each sensor in a launching field of a target spacecraft;
(B) Performing framing again on each original data frame in the sensor data uploaded by each sensor to obtain a reconstructed data frame corresponding to the original data frame;
(C) And mapping the target spacecraft launching field based on the recombined data frame to establish a digital twin model of the target spacecraft launching field.
Optionally, the step of performing framing again on each original data frame in the sensor data uploaded by each sensor to obtain a reconstructed data frame corresponding to the original data frame includes:
analyzing identification information of each original data frame in the sensor data uploaded by each sensor;
acquiring configuration information corresponding to the identification information from a preset data mapping table;
and performing framing again on the original data frame based on the configuration information to obtain a recombined data frame corresponding to the original data frame.
Optionally, when the configuration information includes data source information, data type information, a data field start byte, a data field occupied byte number, and an analysis manner, the step of performing framing again on the original data frame based on the configuration information to obtain a reconstructed data frame corresponding to the original data frame includes:
storing the data source information and the system time at the current moment into a frame header of a recombined data frame;
analyzing the original data frame based on the initial byte of the data domain and the byte number occupied by the data domain according to the analyzing mode to obtain real data in the data domain;
acquiring a protocol format corresponding to the data type information from a preset data mapping table;
recombining the real data according to the protocol format to obtain recombined real data, and storing the recombined real data into a data field of a recombined data frame;
and obtaining a recombined data frame corresponding to the original data frame based on the frame header of the recombined data frame and the data field of the recombined data frame.
Optionally, after establishing the digital twin model of the target spacecraft launch field, the establishing method further comprises:
aiming at the image data sent by each video sensor in each monitoring area of the launching field of the target spacecraft, carrying out content identification processing on the image data sent by the video sensor by using a pre-trained content identification model to obtain a content identification result of the image data sent by the video sensor;
visually displaying the content identification result at a corresponding position on the digital twin model of the target spacecraft launching field;
wherein the content recognition model is trained by:
acquiring a plurality of training video frames with set labels;
the content recognition model is trained using a plurality of tagged training video frames.
Optionally, after establishing the digital twin model of the target spacecraft launch field, the establishing method further comprises:
responding to a command task starting instruction triggered by a user, and acquiring task type information;
determining commander information corresponding to the task type information by using a preset task mapping table;
acquiring a command password file corresponding to the task category information;
marking the command password file by using the commander information to obtain a marked command password file;
inputting the marked command password file into a voice synthesis model corresponding to the commander information to obtain a synthesized voice output by the voice synthesis model aiming at the marked command password file;
playing the synthesized speech in a digital twin model of the target spacecraft launch site;
wherein the speech synthesis model is trained by:
acquiring command password voice training sets of a plurality of commanders;
and respectively training a voice synthesis model corresponding to each commander by utilizing a command password voice training set of each commander and utilizing a voice recognition algorithm.
Optionally, after establishing the digital twin model of the target spacecraft launch field, the establishing method further comprises:
acquiring a target starting point and a target end point in a target spacecraft launching field, which are input by a user;
determining candidate roads between the target starting point and the target end point;
determining a target sensor corresponding to each candidate road;
for a target sensor corresponding to each candidate road, screening road measurement data corresponding to the candidate road from sensor data uploaded by the target sensor; the road measurement data represents an operating condition of a candidate road;
determining the weight of each candidate road by using a preset weight marking algorithm according to the road measurement data of each candidate road;
screening out a candidate road with the highest weight from all candidate roads, and determining the candidate road with the highest weight as the optimal road between the target starting point and the target ending point;
marking the optimal road on the digital twin model of the target spacecraft launch field.
In a second aspect, an embodiment of the present application provides an apparatus for establishing a digital twin model of a spacecraft launching field, where the apparatus includes:
the acquisition module is used for acquiring sensor data uploaded by each sensor in a launching field of the target spacecraft;
the recombination module is used for performing re-framing processing on each original data frame in the sensor data uploaded by each sensor to obtain a recombined data frame corresponding to the original data frame;
and the modeling module is used for mapping the target spacecraft launching field based on the recombined data frame so as to establish a digital twin model of the target spacecraft launching field.
Optionally, the restructuring module is specifically configured to:
analyzing identification information of each original data frame in the sensor data uploaded by each sensor;
acquiring configuration information corresponding to the identification information from a preset data mapping table;
and performing framing again on the original data frame based on the configuration information to obtain a recombined data frame corresponding to the original data frame.
In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of the method as described above.
In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the method for establishing a digital twin model of a spacecraft launch field as described above.
According to the method and the device for establishing the digital twin model of the spacecraft launching field, the original data frames in the sensor data uploaded by each sensor are subjected to framing again, so that the digital twin model of the spacecraft launching field with a uniform picture can be established, and the follow-up multi-level linkage and coordinated and uniform emergency treatment can be realized.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
FIG. 1 illustrates a flow chart of a method for establishing a digital twin model of a spacecraft launch field provided by an exemplary embodiment of the present application;
FIG. 2 is a schematic structural diagram illustrating an apparatus for establishing a digital twin model of a spacecraft launch site according to an exemplary embodiment of the present application;
fig. 3 shows a schematic structural diagram of an electronic device according to an exemplary embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. Every other embodiment that can be obtained by a person skilled in the art without making creative efforts based on the embodiments of the present application falls within the protection scope of the present application.
At present, when a digital twin model of a spacecraft launching field is established, good fusion cannot be realized in the face of multi-source heterogeneous data resources uploaded by various sensors, so that the established digital twin model of the spacecraft launching field cannot realize good image unification, and therefore, multi-level linkage and coordinated unified emergency treatment cannot be realized in the spacecraft launching field subsequently.
Based on the above, the embodiment of the application provides a method for establishing a digital twin model of a spacecraft launching field, which can establish the digital twin model of the spacecraft launching field with a uniform picture, so as to ensure that the follow-up emergency treatment with multi-level linkage and coordination and uniformity can be realized.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for establishing a digital twin model of a spacecraft launch site according to an exemplary embodiment of the present application.
As shown in fig. 1, a method for establishing a digital twin model of a spacecraft launch field according to an embodiment of the present application includes the following steps:
s101, acquiring sensor data uploaded by each sensor in a launching field of the target spacecraft.
Generally speaking, the target spacecraft launch field comprises a plurality of physical entities constituting the target spacecraft launch field, each physical entity corresponding to at least one sensor for monitoring the physical entity. As an example, in the target spacecraft launch site, the physical entities may include physical entities related to rocket launch, physical entities related to weather environment, physical entities related to secured resources, and the like, for example, the physical entities related to rocket launch may be filling lines during rocket launch, towers during rocket launch, rocket bodies, and the like, the physical entities related to weather environment may be weather conditions, such as wind, cloud, fog, rain, snow, frost, lightning, sand storm, and the like, and the physical entities related to secured resources may be power distribution stations, roads, office areas, and the like.
As an example, when the physical entity is a filling line in a rocket launching process, the sensor for monitoring the filling line may be a pressure sensor, a speed sensor, a flow sensor, a temperature sensor, and the like, wherein the pressure sensor is used for monitoring the real-time pressure of the filling line, the flow sensor is used for monitoring the liquid flow speed of the filling line, the flow sensor is used for monitoring the liquid level change of the filling line, and the temperature sensor is used for monitoring the temperature change of the oxidant and the combustion agent; when the physical entity is a tower in the rocket launching process, the sensors for monitoring the tower can be a video sensor, an equipment sensor and the like, wherein the video sensor is used for monitoring the action condition of the tower, for example, the action can be that the tower is opened, a swing rod swings open, a rocket is pushed out and the like; when the physical entity is a rocket body, the sensors for monitoring the rocket body can be a motion sensor, an attitude sensor and the like, wherein the motion sensor is used for monitoring the flying position of the rocket after being launched, namely information is integrated and calculated, the current position and the speed position are continuously updated, and the attitude sensor is used for monitoring the real-time attitude of the rocket in the flying process.
As an example, when the physical entity is a physical entity related to a weather environment, the sensor for monitoring the weather environment may be a temperature sensor, an air quality sensor, and the like.
As an example, when the physical entity is a distribution substation, the sensor for monitoring the distribution substation may be a smoke sensor, a humidity sensor, or the like, when the physical entity is a road, the sensor for monitoring the road may be a video sensor, and when the physical entity is an office area, the sensor for monitoring the office area may be a video sensor.
It can be understood that the types of the sensors are different, so that the sensor data acquired by the sensors of different types are multi-source heterogeneous data, and the multi-source heterogeneous data are data with different sources and different structure types.
Here, the sensor data uploaded by each sensor in the launch site of the target spacecraft may be obtained through a plurality of different communication modes, for example, the communication modes may include UDP multicast, webSocket, TCP, serial ports, and the like, and here, the corresponding communication mode may be determined by a device type of each sensor.
S102, performing re-framing processing on each original data frame in the sensor data uploaded by each sensor to obtain a re-framed data frame corresponding to the original data frame.
As an example, this step may include:
s1021, analyzing identification information of each original data frame in the sensor data uploaded by each sensor;
here, the identification information is a unique identification describing each original data frame, and for example, the identification information may be: the data type identifier, where the data type identifier may represent the data type of each original data frame. Here, the data type identifier may be a digital ID, for example, when the data type identifier is a digital ID, the digital ID is 1 to 1000, which may indicate that the data type of the original data frame is a measurement and issuance instruction, and the digital ID is 2000 to 5000, which may indicate that the data type of the original data frame is a measurement and control telemetry parameter, and the like.
S1022, acquiring configuration information corresponding to the identification information from a preset data mapping table;
here, the preset data mapping table includes at least one identification information and configuration information corresponding to each identification information, where the configuration information includes at least: data source information, data type information, data field start byte, byte number occupied by the data field and an analysis mode.
Here, the data source information is related to the sensor that transmits the raw data frame, and for example, the data source information may include a data source identifier, a destination source identifier, a task number identifier, and the like.
The data type information indicates a data type of each data frame, and for example, the data type information may include: the configuration information may include, for example, when the identification information is 1, data type information in the configuration information corresponding to the identification information may be a telemetry type;
the data field start byte represents the start byte of the data field part of each data frame, and the data field occupied byte number represents the occupied byte number of the data field part of each data frame;
the parsing manner is a preset manner for parsing the original data frame, for example, the parsing manner may include: converting hexadecimal time into yyy-MM-dd hh MM: ss, and converting a geodetic coordinate system into a rectangular coordinate system and the like;
s1023, based on the configuration information, the original data frame is subjected to framing again, and a recombined data frame corresponding to the original data frame is obtained.
As an example, in the step, when the configuration information includes data source information, data type information, a data field start byte, a data field occupied byte number, and an analysis mode, first, the data source information and the system time at the current time may be stored in a frame header of a reassembled data frame, then, according to the analysis mode, the original data frame may be analyzed based on the data field start byte and the data field occupied byte number to obtain real data in the data field, then, a protocol format corresponding to the data type information is obtained from a preset data mapping table, then, the real data may be reassembled according to the protocol format to obtain reassembled real data, and the reassembled real data may be stored in the data frame header of the reassembled data frame, and finally, based on the data field of the reassembled data frame and the data field of the reassembled data frame, the reassembled data frame corresponding to the original data frame may be obtained.
Here, the system time is the time on the establishing device of the current digital twin model.
S103, mapping the target spacecraft launching field based on the recombined data frame to establish a digital twin model of the target spacecraft launching field.
According to the method for establishing the digital twin model of the spacecraft launching field, the original data frames in the sensor data uploaded by each sensor are subjected to framing processing again, so that the digital twin model of the spacecraft launching field with a uniform picture can be established, and the follow-up multi-level linkage and coordinated and uniform emergency processing can be realized.
Furthermore, after establishing the digital twin model of the target spacecraft launch field, the establishing method may further include:
s211, aiming at the image data sent by each video sensor in each monitoring area of the launching field of the target spacecraft, performing content recognition processing on the image data sent by the video sensor by using a pre-trained content recognition model to obtain a content recognition result of the image data sent by the video sensor.
In this step, each video frame in the image data sent by each video sensor may be input to a content recognition model trained in advance, and a content recognition result output by the content recognition model for each video frame may be obtained.
Here, the content recognition model may be a YOLOv5l neural network model.
Here, the content recognition result may include: the detection frame and the label of the object to be detected can comprise at least one of the following items: characters, vehicles, and helmets.
Here, the content recognition model may be trained by:
firstly, a plurality of labeled training video frames are obtained, and then the content recognition model is trained by using the plurality of labeled training video frames.
As an example, a plurality of tagged training video frames may be obtained by: firstly, obtaining a plurality of original training video frames, then carrying out image preprocessing on the plurality of original training video frames to obtain a plurality of training video frames, and finally setting labels on the plurality of training video frames to obtain a plurality of labeled training video frames. Accordingly, the tag may include at least one of: characters, vehicles and safety helmets.
Here, the manner of image preprocessing may include at least one of: the image preprocessing method comprises the steps of radial transformation, random clipping, turning operation, brightness adjustment, fuzzy processing, normalization and the like, and a person skilled in the art can randomly combine the image preprocessing modes according to actual conditions.
In addition, when the content recognition result is a preset content recognition result, an early warning may be issued, for example, the preset content recognition result may include: presence of personnel in a pre-set danger zone, etc.
S212, visually displaying the content recognition result at a corresponding position on the digital twin model of the target spacecraft launching field.
By the method, the corresponding content recognition result can be displayed on the digital twin model of the target spacecraft launching field in real time, so that the condition in the target spacecraft launching field is prompted.
Furthermore, after establishing the digital twin model of the target spacecraft launch field, the establishing method may further include:
s221, responding to a command task starting instruction triggered by a user, and acquiring task type information. For example, the task category information may include a rocket launch task, a satellite launch task, and the like.
S222, determining the director information corresponding to the task type information by using a preset task mapping table. Here, the preset task mapping table includes a plurality of types of task category information and director information corresponding to each type of task category information.
And S223, acquiring a command password file corresponding to the task type information.
As an example, when the task kind information is a rocket launching task, the command password file may be "3, 2, 1, rocket launch". When the task category information is a satellite transmission task, the command password file can be '3, 2, 1, satellite transmission'.
S224, the command password file is marked by utilizing the commander information to obtain a marked command password file.
S225, inputting the marked command password file into a voice synthesis model corresponding to the commander information to obtain the synthesized voice output by the voice synthesis model aiming at the marked command password file.
Wherein the speech synthesis model may be trained by:
firstly, command password voice training sets of a plurality of commanders are obtained, and then a voice synthesis model corresponding to each commander is trained by utilizing a voice recognition algorithm by utilizing the command password voice training set of each commander.
As an example, a command password voice training set for a plurality of commanders may be obtained by: firstly, original command password voice training sets of a plurality of commanders are obtained, and then voice preprocessing is carried out on the original command password voice training set of each commander to obtain a command password voice training set of each commander.
Here, the manner of the voice preprocessing may include at least one of: word segmentation, volume gain, anti-aliasing filtering, endpoint detection, etc., and those skilled in the art can randomly combine the above speech preprocessing modes according to actual situations.
Here, the speech recognition algorithm is an HMM algorithm.
S226, playing the synthetic voice in the digital twin model of the target spacecraft launching field.
Through the mode, when the command task is transmitted in the target spacecraft launching field, the command can be automatically broadcasted through the machine voice without manually issuing the command, so that the digital twin model of the target spacecraft launching field is more intelligent.
Furthermore, after establishing the digital twin model of the target spacecraft launch field, the establishing method may further include:
and S231, acquiring a target starting point and a target end point in the target spacecraft launching field input by the user.
Here, the user can enter a target starting point planned out and a target ending point planned to arrive in the target spacecraft launch field at any one time on a device communicatively connected to the digital twin model of the spacecraft launch field. In one example, when a worker is faced with an emergency mission and needs to arrive at the emergency mission location as soon as possible, the target destination may be the mission location indicated by the mission.
And S232, determining a candidate road between the target starting point and the target end point.
As an example, the candidate roads between the target start point and the target end point may be determined by any means in the prior art.
And S233, determining the target sensor corresponding to each candidate road.
The target sensor corresponding to each candidate road may be determined by any means in the prior art, which is not limited in the present application.
S234, aiming at the target sensor corresponding to each candidate road, screening road measurement data corresponding to the candidate road from sensor data uploaded by the target sensor; the road measurement data indicates the running condition of the candidate road, for example, the road measurement data may include the distance of the candidate road, the speed limit data of the candidate road, the road occupancy data of the candidate road, the forbidden state of the candidate road, the congestion degree of the candidate road, and the like.
And S235, determining the weight of each candidate road by using a preset weight marking algorithm according to the road measurement data of the candidate road.
Here, the preset weight marking algorithm is determined according to actual conditions.
S236, screening out the candidate road with the highest weight from all the candidate roads, and determining the candidate road with the highest weight as the optimal road between the target starting point and the target ending point.
And S237, marking the optimal road on the digital twin model of the target spacecraft launching field.
By the method, when an emergency launching task is faced, an optimal road can be planned according to the input target starting point and target end point of the emergency launching task, so that workers can arrive at a launching site according to the optimal road to complete the launching task.
Referring to fig. 2, fig. 2 is a schematic structural diagram of an apparatus for establishing a digital twin model of a spacecraft launch field according to an exemplary embodiment of the present application. As shown in fig. 2, the establishing means 200 includes:
an obtaining module 210, configured to obtain sensor data uploaded by each sensor in a launch field of the target spacecraft;
the reassembly module 220 is configured to perform reassembly processing on each original data frame in the sensor data uploaded by each sensor, to obtain a reassembled data frame corresponding to the original data frame;
a modeling module 230, configured to map the target spacecraft launch field based on the reorganized data frame to establish a digital twin model of the target spacecraft launch field.
Optionally, the restructuring module 220 is specifically configured to:
analyzing identification information of each original data frame in the sensor data uploaded by each sensor;
acquiring configuration information corresponding to the identification information from a preset data mapping table;
and performing framing again on the original data frame based on the configuration information to obtain a recombined data frame corresponding to the original data frame.
Optionally, under the condition that the configuration information includes data source information, data type information, a data field start byte, a data field occupied byte number, and an analysis manner, the reassembly module 220 is specifically configured to: storing the data source information and the system time at the current moment into a frame header of a recombined data frame;
analyzing the original data frame based on the initial byte of the data field and the byte number occupied by the data field according to the analyzing mode to obtain real data in the data field;
acquiring a protocol format corresponding to the data type information from a preset data mapping table;
recombining the real data according to the protocol format to obtain recombined real data, and storing the recombined real data into a data field of a recombined data frame;
and obtaining a recombined data frame corresponding to the original data frame based on the frame header of the recombined data frame and the data field of the recombined data frame.
Optionally, the establishing apparatus 200 further includes: a content identification module 240 (not shown in the figure), where the content identification module 240 is specifically configured to:
aiming at the image data sent by each video sensor in each monitoring area of a launching field of a target spacecraft, carrying out content identification processing on the image data sent by the video sensor by using a pre-trained content identification model to obtain a content identification result of the image data sent by the video sensor;
visually displaying the content identification result at a corresponding position on the digital twin model of the target spacecraft launching field;
wherein the content recognition model is trained by:
acquiring training video frames with a plurality of set labels;
the content recognition model is trained using a plurality of tagged training video frames.
Optionally, the establishing apparatus 200 further includes: voice broadcast module 250 (not shown in the figure), voice broadcast module 250 is specifically used for:
responding to a command task starting instruction triggered by a user, and acquiring task type information;
determining commander information corresponding to the task type information by using a preset task mapping table;
acquiring a command password file corresponding to the task category information;
marking the command password file by using the commander information to obtain a marked command password file;
inputting the marked command password file into a voice synthesis model corresponding to the commander information to obtain a synthesized voice output by the voice synthesis model aiming at the marked command password file;
playing the synthesized speech in a digital twin model of the target spacecraft launch site;
wherein the speech synthesis model is trained by:
acquiring command password voice training sets of a plurality of commanders;
and respectively training a voice synthesis model corresponding to each commander by utilizing a command password voice training set of each commander and utilizing a voice recognition algorithm.
Optionally, the establishing apparatus 200 further includes: a road planning module 260 (not shown in the figure), wherein the road planning module 260 is specifically configured to:
acquiring a target starting point and a target end point in a target spacecraft launching field input by a user;
determining candidate roads between the target starting point and the target end point;
determining a target sensor corresponding to each candidate road;
for a target sensor corresponding to each candidate road, screening road measurement data corresponding to the candidate road from sensor data uploaded by the target sensor; the road measurement data represents an operating condition of a candidate road;
determining the weight of each candidate road by using a preset weight marking algorithm according to the road measurement data of each candidate road;
screening out a candidate road with the highest weight from all candidate roads, and determining the candidate road with the highest weight as the optimal road between the target starting point and the target ending point;
marking the optimal road on the digital twin model of the target spacecraft launch field.
According to the device for establishing the digital twin model of the spacecraft launching field, provided by the embodiment of the application, the digital twin model of the spacecraft launching field with a uniform picture can be established by framing each original data frame in the sensor data uploaded by each sensor again, and the follow-up multi-level linkage and coordinated and uniform emergency treatment can be realized.
Referring to fig. 3, fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in fig. 3, the electronic device 300 includes a processor 310, a memory 320, and a bus 330.
The memory 320 stores machine-readable instructions executable by the processor 310, when the electronic device 300 runs, the processor 310 communicates with the memory 320 through the bus 330, and when the machine-readable instructions are executed by the processor 310, the steps of the method for establishing the digital twin model of the spacecraft launch site in the above method embodiment may be executed.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method for establishing a digital twin model of a spacecraft launch field in the foregoing method embodiment may be executed.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solutions of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: those skilled in the art can still make modifications or changes to the embodiments described in the foregoing embodiments, or make equivalent substitutions for some features, within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the exemplary embodiments of the present application, and are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. A method for establishing a digital twin model of a spacecraft launching field is characterized by comprising the following steps:
(A) Acquiring sensor data uploaded by each sensor in a launching field of a target spacecraft;
(B) Performing re-framing processing on each original data frame in the sensor data uploaded by each sensor to obtain a reconstructed data frame corresponding to the original data frame;
(C) And mapping the target spacecraft launching field based on the recombined data frame to establish a digital twin model of the target spacecraft launching field.
2. The establishing method according to claim 1, wherein the step of performing a reframing process on each original data frame in the sensor data uploaded by each sensor to obtain a reframing data frame corresponding to the original data frame comprises:
analyzing identification information of each original data frame in the sensor data uploaded by each sensor;
acquiring configuration information corresponding to the identification information from a preset data mapping table;
and performing framing again on the original data frame based on the configuration information to obtain a recombined data frame corresponding to the original data frame.
3. The establishing method according to claim 2, wherein, when the configuration information includes data source information, data type information, a data field start byte, a data field occupied byte number and an analysis mode, the step of performing framing processing on the original data frame based on the configuration information to obtain a reconstructed data frame corresponding to the original data frame includes:
storing the data source information and the system time at the current moment into a frame header of a recombined data frame;
analyzing the original data frame based on the initial byte of the data field and the byte number occupied by the data field according to the analyzing mode to obtain real data in the data field;
acquiring a protocol format corresponding to the data type information from a preset data mapping table;
recombining the real data according to the protocol format to obtain recombined real data, and storing the recombined real data into a data field of a recombined data frame;
and obtaining a recombined data frame corresponding to the original data frame based on the frame header of the recombined data frame and the data domain of the recombined data frame.
4. The method of building of claim 1, wherein after building the digital twin model of the target spacecraft launch field, the method of building further comprises:
aiming at the image data sent by each video sensor in each monitoring area of the launching field of the target spacecraft, carrying out content identification processing on the image data sent by the video sensor by using a pre-trained content identification model to obtain a content identification result of the image data sent by the video sensor;
visually displaying the content recognition result at a corresponding position on the digital twin model of the target spacecraft launching field;
wherein the content recognition model is trained by:
acquiring training video frames with a plurality of set labels;
the content recognition model is trained using a plurality of tagged training video frames.
5. The method of building of claim 1, wherein after building the digital twin model of the target spacecraft launch field, the method of building further comprises:
responding to a command task starting instruction triggered by a user, and acquiring task type information;
determining commander information corresponding to the task type information by using a preset task mapping table;
acquiring a command password file corresponding to the task category information;
marking the command password file by using the commander information to obtain a marked command password file;
inputting the marked command password file into a voice synthesis model corresponding to the commander information to obtain a synthesized voice output by the voice synthesis model aiming at the marked command password file;
playing the synthesized speech in a digital twin model of the target spacecraft launch site;
wherein the speech synthesis model is trained by:
acquiring command password voice training sets of a plurality of commanders;
and respectively training a voice synthesis model corresponding to each commander by utilizing a command password voice training set of each commander and utilizing a voice recognition algorithm.
6. The method of building of claim 1, wherein after building the digital twin model of the target spacecraft launch field, the method of building further comprises:
acquiring a target starting point and a target end point in a target spacecraft launching field input by a user;
determining candidate roads between the target starting point and the target end point;
determining a target sensor corresponding to each candidate road;
for a target sensor corresponding to each candidate road, screening road measurement data corresponding to the candidate road from sensor data uploaded by the target sensor; the road measurement data represents an operating condition of a candidate road;
determining the weight of each candidate road by using a preset weight marking algorithm according to the road measurement data of each candidate road;
screening out a candidate road with the highest weight from all candidate roads, and determining the candidate road with the highest weight as the optimal road between the target starting point and the target ending point;
marking the optimal road on the digital twin model of the target spacecraft launch field.
7. An apparatus for establishing a digital twin model of a spacecraft launch field, the apparatus comprising:
the acquisition module is used for acquiring sensor data uploaded by each sensor in a launching field of the target spacecraft;
the recombination module is used for performing re-framing processing on each original data frame in the sensor data uploaded by each sensor to obtain a recombined data frame corresponding to the original data frame;
and the modeling module is used for mapping the target spacecraft launching field based on the recombined data frame so as to establish a digital twin model of the target spacecraft launching field.
8. The establishing device of claim 7, wherein the restructuring module is specifically configured to:
analyzing identification information of each original data frame in the sensor data uploaded by each sensor;
acquiring configuration information corresponding to the identification information from a preset data mapping table;
and performing framing again on the original data frame based on the configuration information to obtain a recombined data frame corresponding to the original data frame.
9. An electronic device, comprising: processor, memory and bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over the bus when the electronic device is run, the machine-readable instructions when executed by the processor performing the steps of the set-up method of any one of claims 1 to 6.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, performs the steps of the set-up method according to one of claims 1 to 6.
CN202310068903.2A 2023-02-06 2023-02-06 Method and device for establishing digital twin model of spacecraft launching field Active CN115795699B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310068903.2A CN115795699B (en) 2023-02-06 2023-02-06 Method and device for establishing digital twin model of spacecraft launching field

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310068903.2A CN115795699B (en) 2023-02-06 2023-02-06 Method and device for establishing digital twin model of spacecraft launching field

Publications (2)

Publication Number Publication Date
CN115795699A true CN115795699A (en) 2023-03-14
CN115795699B CN115795699B (en) 2023-04-18

Family

ID=85430030

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310068903.2A Active CN115795699B (en) 2023-02-06 2023-02-06 Method and device for establishing digital twin model of spacecraft launching field

Country Status (1)

Country Link
CN (1) CN115795699B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117272619A (en) * 2023-09-14 2023-12-22 北京航天朝亿科技有限公司 Digital twin body system of spaceflight launching field
CN117994637A (en) * 2024-04-07 2024-05-07 中国科学院西安光学精密机械研究所 High-precision space spacecraft domain self-adaptive detection method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210201584A1 (en) * 2019-12-31 2021-07-01 VIRNECT inc. System and method for monitoring field based augmented reality using digital twin
CN113805550A (en) * 2021-09-30 2021-12-17 上海卫星装备研究所 Spacecraft assembly process control method and system based on digital twins
CN115563680A (en) * 2022-10-09 2023-01-03 阿里云计算有限公司 Digital twin object processing method and system
CN115687494A (en) * 2022-09-14 2023-02-03 上海智能制造功能平台有限公司 Digital twin monitoring system of manufacturing system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210201584A1 (en) * 2019-12-31 2021-07-01 VIRNECT inc. System and method for monitoring field based augmented reality using digital twin
CN113805550A (en) * 2021-09-30 2021-12-17 上海卫星装备研究所 Spacecraft assembly process control method and system based on digital twins
CN115687494A (en) * 2022-09-14 2023-02-03 上海智能制造功能平台有限公司 Digital twin monitoring system of manufacturing system
CN115563680A (en) * 2022-10-09 2023-01-03 阿里云计算有限公司 Digital twin object processing method and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
唐文虎;陈星宇;钱瞳;刘刚;李梦诗;李立?;: "面向智慧能源系统的数字孪生技术及其应用" *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117272619A (en) * 2023-09-14 2023-12-22 北京航天朝亿科技有限公司 Digital twin body system of spaceflight launching field
CN117994637A (en) * 2024-04-07 2024-05-07 中国科学院西安光学精密机械研究所 High-precision space spacecraft domain self-adaptive detection method
CN117994637B (en) * 2024-04-07 2024-08-09 中国科学院西安光学精密机械研究所 High-precision space spacecraft domain self-adaptive detection method

Also Published As

Publication number Publication date
CN115795699B (en) 2023-04-18

Similar Documents

Publication Publication Date Title
CN115795699B (en) Method and device for establishing digital twin model of spacecraft launching field
CN110443969B (en) Fire detection method and device, electronic equipment and storage medium
CN112990262B (en) Integrated solution system for monitoring and intelligent decision of grassland ecological data
US20180267538A1 (en) Log-Based Vehicle Control System Verification
CN114362367A (en) Cloud edge cooperation-oriented power transmission line monitoring system and method, and cloud edge cooperation-oriented power transmission line identification system and method
Pérez et al. Ground vehicle detection through aerial images taken by a UAV
CN113022540B (en) Real-time remote driving system and method for monitoring multiple vehicle states
CN112668847A (en) Unmanned aerial vehicle autonomous inspection comprehensive management system for distribution network line
CN115187742B (en) Method, system and related device for generating automatic driving simulation test scene
Tripolitsiotis et al. Dronesourcing: a modular, expandable multi-sensor UAV platform for combined, real-time environmental monitoring
CN112634663B (en) General aviation flight plan and monitoring target association method
CN110910440A (en) Power transmission line length determination method and system based on power image data
CN117351521B (en) Digital twinning-based power transmission line bird detection method, system, medium and equipment
CN115079710A (en) Multi-unmanned aerial vehicle power inspection intelligent scheduling method and system
CN115766861A (en) Automatic driving data closed loop system, method and medium for vehicle software upgrade
CN114338430B (en) Data visual display method and system
CN115082813A (en) Detection method, unmanned aerial vehicle, detection system and medium
CN113783930B (en) Air-ground network system based on field deployable 5G vehicle-mounted platform and construction method
KR102087889B1 (en) A deep-learning eduacation system using arrow images
CN115083229B (en) Intelligent recognition and warning system of flight training equipment based on AI visual recognition
CN116931596A (en) Unmanned aerial vehicle flight system with flight program automatically arranged
CN114663818B (en) Airport operation core area monitoring and early warning system and method based on vision self-supervision learning
CN117095512A (en) Landslide multi-field data fusion scheduling monitoring system and method
CN105450953A (en) Display information insertion system for unmanned aerial vehicle and information insertion method thereof
CN116259165A (en) Monitoring data processing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant