CN116192822A

CN116192822A - Screen display communication control method and device, 5G firefighting intercom mobile phone and medium

Info

Publication number: CN116192822A
Application number: CN202310189193.9A
Authority: CN
Inventors: 李学广
Original assignee: Shenzhen Aoqi Optical Technology Co Ltd
Current assignee: Shenzhen Aoqi Optical Technology Co Ltd
Priority date: 2023-03-02
Filing date: 2023-03-02
Publication date: 2023-05-30

Abstract

The application relates to a screen display communication control method, a device, a 5G fire-fighting intercom mobile phone and a medium, and relates to the technical field of production detection, comprising the following steps: the method comprises the steps of obtaining remote sensing image information and real-time image information, preprocessing the remote sensing image information to obtain spectrum image information, inputting the spectrum image information into a classification model for training to obtain engineering image information and labeling vector information, correspondingly binding the labeling vector information with the engineering image information to obtain a labeling vector file, carrying out vector grid conversion processing on the labeling vector file, taking image pixel values and the engineering image information as training samples, carrying out feature fusion processing on the training samples to obtain edge fusion features, training a preset network model based on the edge fusion features to obtain a trained identification network model, and inputting the real-time image information into the trained identification network model for training to obtain waste slag field identification information. The method and the device have the effect of improving the identification efficiency of the waste slag field.

Description

Screen display communication control method and device, 5G firefighting intercom mobile phone and medium

Technical Field

The application relates to the field of screen display control, in particular to a screen display communication control method and device, a 5G firefighting intercom mobile phone and a medium.

Background

The fire protection mainly comprises personnel rescue, important facility equipment, rescue of cultural relics, safety protection and rescue of important property, fire extinguishing and the like in a fire scene. The purpose is to reduce the damage degree caused by fire disaster and reduce casualties and property loss.

At present, with the rapid development of Chinese economy, urban complexes, high-rise buildings, underground passages, chemical enterprises and large-scale buildings are continuously increased, and the complex building structure brings great challenges to fire extinguishment and rescue work of fire control. Meanwhile, when a fire disaster occurs indoors, smoke is diffused, the visibility is low, sound sources are numerous, the order is disordered, when a firefighter enters an indoor environment to extinguish and rescue, the specific position of the firefighter cannot be judged, and the firefighter is difficult to travel to a designated target position to rescue. Therefore, once the firefighters are injured and other accidents occur, the firefighters cannot timely report the disaster conditions inside the building and the accurate position information of the firefighters to the outdoor commander by means of common firefighting interphone equipment and other equipment, so that the optimal self-rescue and rescue time is missed.

In order to effectively solve the technical problems in the prior art, the 5G firefighting intercom mobile phone is integrated by adopting various technologies such as wireless communication, base station positioning, inertial navigation and thermal imaging, so as to achieve a mode of mastering indoor position information and environmental information, thereby acquiring real-time position information of personnel and things and indoor surrounding environment information. Firefighters save oneself or rescue according to things or person position pictures presented by the 5G firefighting intercom mobile phone display screen and thermal imaging pictures of surrounding environments, but because firefighting, rescue, disaster relief and other events occur suddenly, base points may not be arranged in advance or signal interference factors such as electromagnetism and high temperature exist in disaster places, so that fluctuation exists in position information and thermal imaging information presented on the 5G firefighting intercom mobile phone screen, and the risk of firefighting rescue is increased.

Disclosure of Invention

In order to improve the recognition efficiency of a waste slag field, the application provides a screen display communication control method and device, a 5G firefighting intercom handset and a medium.

In a first aspect, the present application provides a method for controlling on-screen display communication, which adopts the following technical scheme:

A screen display communication control method comprises the following steps:

acquiring screen picture information and communication channel information, wherein the screen picture information is screen picture receiving information of a 5G firefighting intercom mobile phone, and the communication channel information is used for representing communication channels of different frequency bands which can be communicated with the 5G firefighting intercom mobile phone;

determining picture receiving parameters and picture integrity according to the screen picture information;

judging whether the picture integrity meets a preset integrity condition, if not, carrying out associated data retrieval on the picture receiving parameters and the communication channel information to obtain picture receiving rate and a real-time communication channel corresponding to the picture receiving rate;

judging whether the picture receiving rate meets the picture receiving standard, if not, carrying out channel communication simulation combination based on the communication channel information and the real-time communication channel to obtain a combined communication channel;

and updating the real-time communication information based on the combined communication channel.

In another possible implementation manner, the performing channel communication analog combination based on the communication channel information and the real-time communication channel to obtain a combined communication channel includes:

Determining a communication channel group based on the communication channel information and the real-time communication channel, wherein the communication channel group is a channel group formed by dividing the communication channel information into the real-time communication channels;

respectively carrying out picture data transmission test on channels in the communication channel group to obtain data receiving rate corresponding to each channel respectively;

screening, combining and analyzing the data receiving rate to obtain receiving group information;

and carrying out channel recombination according to the receiving sequence corresponding to each data receiving rate in the receiving group information and the communication channel to obtain a combined communication channel.

In another possible implementation manner, the screening and combining analysis on the data receiving rate is performed to obtain receiving group information, which includes:

comparing the data receiving rate of each channel with the receiving rate of the picture receiving standard, and determining the receiving interval of each channel meeting the receiving rate;

acquiring signal node information, wherein the signal node information is different node information in the process of receiving signals by the 5G firefighting intercom handset;

determining queuing channel information and execution channel information according to the signal node information and the receiving interval;

And combining the queued channel information and the execution channel information to obtain receiving group information.

In another possible implementation, the method further includes:

acquiring remote sensing image information, wherein the remote sensing image information is used for representing satellite remote sensing image information in a preset range of the 5G firefighting intercom mobile phone position center;

preprocessing the remote sensing image information to obtain spectrum image information;

the spectrum image information is input into a trained classification model for recognition, so that building type image information and labeling vector information corresponding to the building type image information are obtained, the building type image information is used for representing building image information of different types at the 5G firefighting intercom mobile phone, and the labeling vector information is used for representing three-dimensional geographic coordinate information corresponding to the building type image information;

judging whether a preset inflammable building type exists in the building type image information or not, and if so, marking the building type based on the marking vector information.

In another possible implementation manner, the preprocessing the remote sensing image information to obtain spectral image information includes:

Performing geometric correction processing on the remote sensing image information to obtain corrected image information;

performing image fusion processing on the corrected image information and the multispectral image to obtain fusion image information;

and performing image mosaic processing on the fused image information to obtain spectrum image information.

In another possible implementation manner, the inputting the spectral image information into the trained classification model for identification, to obtain building category image information and labeling vector information corresponding to the building category image information, includes:

performing overlapped slicing processing on the spectrum image information to obtain cut image information;

constructing a DSM model based on the cut image information, and retrieving DSM data in the DSM model;

and inputting the cutting image information and the DSM data into the classification model for recognition to obtain building category image information and labeling vector information corresponding to the building category image information.

In another possible implementation manner, the labeling the building category based on the labeling vector information further includes:

detecting whether the position information of the 5G firefighting intercom mobile phone changes, and if so, updating the remote sensing head portrait information in real time to obtain real-time positioning point information;

And determining displacement route information according to the real-time positioning point information, and binding the displacement route information with the remote sensing image information to obtain track remote sensing image information.

In a second aspect, the present application provides a screen display communication control device, which adopts the following technical scheme:

a screen display communication control device, comprising:

the information acquisition module is used for acquiring screen picture information and communication channel information, wherein the screen picture information is screen picture receiving information of the 5G firefighting intercom mobile phone, and the communication channel information is used for representing communication channels of different frequency bands which can be communicated with the 5G firefighting intercom mobile phone;

the picture determining module is used for determining picture receiving parameters and picture integrity according to the screen picture information;

the data calling module is used for judging whether the picture integrity meets a preset integrity condition, if not, carrying out associated data calling on the picture receiving parameters and the communication channel information to obtain picture receiving rate and a real-time communication channel corresponding to the picture receiving rate;

the simulation combination module is used for judging whether the picture receiving rate meets the picture receiving standard, if not, carrying out channel communication simulation combination based on the communication channel information and the real-time communication channel to obtain a combined communication channel;

And the communication updating module is used for updating the real-time communication information based on the combined communication channel.

In one possible implementation manner, the analog combination module is specifically configured to, when performing channel communication analog combination based on the communication channel information and the real-time communication channel to obtain a combined communication channel:

In another possible implementation manner, the analog combination module is specifically configured to, when performing screening and combination analysis on the data reception rate to obtain the reception group information:

In another possible implementation, the apparatus further includes: the system comprises an image acquisition module, an image processing module, a classification and identification module and a building labeling module, wherein,

the image acquisition module is used for acquiring remote sensing image information, and the remote sensing image information is used for representing satellite remote sensing image information in a preset range of the 5G firefighting intercom mobile phone position center;

the image processing module is used for preprocessing the remote sensing image information to obtain spectrum image information;

the classification recognition module is used for inputting the spectrum image information into a trained classification model for recognition to obtain building category image information and labeling vector information corresponding to the building category image information, wherein the building category image information is used for representing building image information of different categories at the 5G firefighting intercom mobile phone, and the labeling vector information is used for representing three-dimensional geographic coordinate information corresponding to the building category image information;

The building labeling module is used for judging whether a preset inflammable building type exists in the building type image information, and labeling the building type based on the labeling vector information if the preset inflammable building type exists.

In another possible implementation manner, the image processing module is specifically configured to, when preprocessing the remote sensing image information to obtain spectral image information:

In another possible implementation manner, the classification recognition module is specifically configured to, when inputting the spectral image information into the trained classification model to perform recognition to obtain building category image information and labeling vector information corresponding to the building category image information:

In another possible implementation, the apparatus further includes: a site update module, and a bitmap binding module, wherein,

the location updating module is used for detecting whether the position information of the 5G firefighting intercom mobile phone changes, and if so, the remote sensing head portrait information is updated in real time to obtain real-time location point information;

and the bitmap binding module is used for determining displacement route information according to the real-time positioning point information, and binding the displacement route information with the remote sensing image information to obtain track remote sensing image information.

In a third aspect, the present application provides a 5G firefighting intercom handset, which adopts the following technical scheme:

a 5G firefighting intercom handset comprising: casing, set up in the display screen of casing surface and set up copper foil graphite heat conduction membrane and camera in casing one side that deviates from the display screen, still include: one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to: the on-screen communication control method according to any one of claims 1 to 7 is performed.

In a fourth aspect, the present application provides a computer readable storage medium, which adopts the following technical scheme:

a computer-readable storage medium, comprising: a computer program capable of being loaded and executed by a processor implementing a method of on-screen communication control as shown in any one of the possible implementations of the first aspect is stored.

In summary, the present application includes at least one of the following beneficial technical effects:

by adopting the technical scheme, when firefighters rescue by adopting the 5G firefighting intercom mobile phone, according to the obtained screen picture information of the 5G firefighting intercom mobile phone and communication channels in different frequency bands which can be communicated with the 5G firefighting intercom mobile phone, picture receiving parameters and picture integrity of the current screen picture information are determined, then whether the picture integrity meets the preset integrity condition is judged, if not, relevant data are called for the picture receiving parameters and the communication channel information, so that picture receiving rate and a real-time communication channel corresponding to the picture receiving rate are obtained, then whether the picture receiving rate meets the picture receiving standard is judged, if not, channel communication simulation combination is carried out based on the communication channel information and the real-time communication channel, so that a combined communication channel is obtained, then the real-time communication information is updated based on the combined communication channel, and fluctuation of position information and thermal imaging information displayed by a screen of the 5G firefighting intercom mobile phone is avoided, so that the risk of firefighting rescue is reduced.

Drawings

Fig. 1 is a schematic flow chart of a screen display communication control method according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a 5G firefighting intercom handset according to an embodiment of the present application;

fig. 3 is another schematic structural diagram of a 5G firefighting intercom handset according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of a screen display communication control device according to an embodiment of the present application.

The accompanying drawings: 1. a housing; 2. a display screen; 3. copper foil graphite heat conducting film; 4. a camera; 5. a processor; 6. a memory; 7. a bus; 8. a transceiver.

Detailed Description

The present application is described in further detail below in conjunction with figures 1-4.

Modifications of the embodiments which do not creatively contribute to the invention may be made by those skilled in the art after reading the present specification, but are protected by patent laws only within the scope of claims of the present application.

For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

In addition, the term "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In this context, unless otherwise specified, the term "/" generally indicates that the associated object is an "or" relationship.

Embodiments of the present application are described in further detail below with reference to the drawings attached hereto.

The embodiment of the application provides a screen display communication control method, which is executed by a 5G firefighting intercom mobile phone, as shown in fig. 1, and comprises the following steps:

step S10, screen picture information and communication channel information are acquired.

The screen picture information is screen picture receiving information of the 5G firefighting intercom mobile phone, and the communication channel information is used for representing communication channels of different frequency bands which can be communicated with the 5G firefighting intercom mobile phone.

In this embodiment of the present application, as shown in fig. 2, the screen image information includes three kinds of image, the first kind of image is an infrared image, the first kind of image is acquired by the camera 4 at the back of the 5G firefighting intercom handset, the second kind of image is a satellite remote sensing image, the satellite remote sensing detects the reflection of the earth surface object to the electromagnetic wave and the electromagnetic wave emitted by the object in space through the satellite to extract the information of the ground image, and the third kind of image is a two-dimensional navigation image, and the two-dimensional navigation cambered surface image is obtained through map software and SDK positioning. The three picture images are simultaneously presented in the screen picture, and after a user click command is detected, the picture image selected by the user click command is amplified according to a preset proportion, and the other two picture images are reduced according to the preset proportion.

Specifically, the preset ratio is set according to the transverse direction and the vertical direction of the screen, when the screen is transverse, the preset ratio is 1:7, and when the screen is vertical, the preset ratio is 1:2.

Step S11, determining picture receiving parameters and picture integrity according to the screen picture information.

For the embodiment of the present application, the picture integrity indicates whether there is a jam in the enlarged picture image in the current screen picture information, that is, the picture synchronization rate, for example: the enlarged picture determined by the click command of the user is a two-dimensional navigation picture image, at this time, although the picture is complete in whole, the actual position of the picture display stands still along with the movement of firefighters, namely, the current picture image is blocked, and the synchronization rate cannot meet 100%. The picture receiving parameter is used for representing the picture receiving rate (ms) of a channel communicated with the current 5G firefighting intercom handset, namely network channel delay.

And step S12, judging whether the picture integrity meets a preset integrity condition, if not, carrying out associated data retrieval on the picture receiving parameters and the communication channel information to obtain picture receiving rate and a real-time communication channel corresponding to the picture receiving rate.

Specifically, the preset integrity condition is a synchronization rate of 100%.

And S13, judging whether the picture receiving rate meets the picture receiving standard, and if not, carrying out channel communication simulation combination based on the communication channel information and the real-time communication channel to obtain a combined communication channel.

For the embodiment of the present application, the picture receiving criteria include: the good and good picture receiving rate is 1-30ms, the good and good picture receiving rate is 31-50ms, and if the current picture receiving rate is not satisfied with the good and good picture receiving standards, the current picture receiving rate is not satisfied with the picture receiving standard.

And step S14, updating the real-time communication information based on the combined communication channel.

Specifically, the real-time communication information is updated, that is, the communication channel in the current real-time communication information is switched to the combined communication information, so that the picture receiving rate of the 5G fire-fighting intercom mobile phone communication meets the picture receiving standard.

In the embodiment of the application, when a firefighter uses a 5G firefighting intercom handset to rescue, according to acquired screen picture information of the 5G firefighting intercom handset and communication channels in different frequency bands which can be communicated with the 5G firefighting intercom handset, picture receiving parameters and picture integrity of the current screen picture information are determined, then whether the picture integrity meets preset integrity conditions is judged, if not, relevant data are called for the picture receiving parameters and the communication channel information, so that picture receiving rate and a real-time communication channel corresponding to the picture receiving rate are obtained, then whether the picture receiving rate meets picture receiving standards is judged, if not, channel communication simulation combination is carried out based on the communication channel information and the real-time communication channel, so that a combined communication channel is obtained, then the real-time communication information is updated based on the combined communication channel, and fluctuation of position information and thermal imaging information displayed by a 5G firefighting intercom handset screen is avoided, so that the firefighting rescue risk is reduced.

In one possible implementation manner of the embodiment of the present application, step S13 specifically includes step S131 (not shown in the figure), step S132 (not shown in the figure), step S133 (not shown in the figure), and step S134 (not shown in the figure), where,

step S131, determining a communication channel group based on the communication channel information and the real-time communication channel.

Wherein the communication channel group is a channel group formed by dividing the real-time communication channel in the communication channel information.

And step S132, respectively performing picture data transmission test on the channels in the communication channel group to obtain the data receiving rate corresponding to each channel.

In the embodiment of the application, the data receiving rate is an important technical index for describing a data receiving system of the 5G firefighting intercom mobile phone, and the data receiving rate is equal to the number of binary bits transmitted per second to form a data code, and the unit is bits/second (bps) and is recorded as bps. For binary data, the data reception rate is s=1/T (bps), where T is the time required for each bit to occur. For example: if the time required to receive a bit 0, 1 signal on the communication channel is 0.001ms, the data reception rate of the channel is 1000000bps.

And step S133, screening and combining analysis is carried out on the data receiving rate, so as to obtain receiving group information.

Step S134, channel reorganization is carried out according to the receiving sequence corresponding to each data receiving rate in the receiving group information and the communication channels, and the combined communication channels are obtained.

In one possible implementation manner of the embodiment of the present application, step S133 (not shown in the figure) specifically includes step S31 (not shown in the figure), step S32 (not shown in the figure), step S33 (not shown in the figure), and step S34 (not shown in the figure), where,

and S31, comparing the data receiving rate of each channel with the receiving rate of the picture receiving standard, and determining the receiving interval of each channel meeting the receiving rate.

Specifically, as is known from the explanation of the picture reception standard in step S13, the picture reception rate is preferably 1 to 30ms, the picture reception rate is preferably 31 to 50ms, and the reception interval corresponding to the channel is known by comparing the data reception rate T of the channel with the picture reception rates of two different levels.

Step S32, obtaining signal node information.

The signal node information is different node information in the process of receiving signals by the 5G firefighting intercom handset.

In the embodiment of the present application, the signal node information is used to characterize that, in a process of communicating with the 5G firefighting intercom handset through a single channel, if the receiving interval changes, the position of the changing position is changed into node information, for example: when the data receiving rate test is carried out on the channel A, after the communication signal of the channel A is transmitted to the area a, the receiving rate is changed from the optimal to the good, and the receiving rate is changed from the good to the good until the communication signal reaches the area b, so that the signal node information of the channel A is the area a position-the area b position.

Step S33, determining queued channel information and execution channel information according to the signal node information and the receiving section.

Specifically, a node with a signal transmission sequence and a receiving rate which are optimal and correspond to each channel is obtained according to signal node information, a multi-corresponding optimal and good receiving interval of each channel is obtained according to a receiving interval, then the node with the optimal receiving rate is screened out, the receiving interval corresponding to the optimal receiving rate is determined, and then the queuing channel information and the execution channel information are determined according to the channel transmission sequence. For example: the communication channels with A, B, C different frequency bands are respectively arranged at the same position, the communication signals of the A communication channel are from the initial section to the a region position, the receiving rate is excellent, the signal receiving rate is excellent from the a region position to the end, the signal receiving rate of the B communication channel is excellent from the initial section to the a region position, the signal receiving rate is excellent from the a region position to the B region position, the signal receiving rate is excellent from the B region position to the end, the signal receiving rate of the C communication channel is excellent from the initial section to the a region position, the signal receiving rate is excellent from the a region position to the B region position, the signal receiving rate is excellent from the B region position to the end, the queue channels of the A, B, C three communication channels are B, C communication channels, and the execution channel information is the A communication channel.

And step S34, combining the queued channel information and the execution channel information to obtain receiving group information.

In this embodiment of the present application, the channel switching technology is adopted to switch the communication channels of the above-mentioned three different frequency bands A, B, C, and channel switching (handover or hand-off) is also called channel switching. The mobile station switches from one radio channel to another radio channel without interrupting the communication during the communication process in order to ensure the communication quality.

Specifically, the signal starting end is communicated with the position of the area a by adopting an A communication channel, when the signal starting end reaches the position node of the area a, the channel conversion is carried out, the A channel of the original communication is converted into a B channel to continue the communication, and when the signal starting end reaches the position node of the area B, the secondary channel conversion is carried out, and the B channel is converted into a C channel to continue the communication.

In one possible implementation manner of the embodiment of the present application, step S14 further includes step S15 (not shown in the figure), step S16 (not shown in the figure), step S17 (not shown in the figure), and step S18 (not shown in the figure), where,

and S15, acquiring remote sensing image information.

The remote sensing image information is used for representing satellite remote sensing image information in a preset range of the 5G firefighting intercom mobile phone position center.

Specifically, the satellite remote sensing image is also called a satellite image, the remote sensing refers to remote sensing, the satellite remote sensing extracts information of the ground by detecting the reflection of an earth surface object on electromagnetic waves and electromagnetic waves emitted by the electromagnetic waves in space by a satellite, and therefore the remote recognition of the ground object is completed, and the image obtained by converting and recognizing the electric wave information is the satellite remote sensing image.

Specifically, the remote sensing image information and the real-time image information are composed of pixel points, and the richer the pixel points are, the smaller the size of the detail recognized by photographing is. The density of pixels on an image photograph is often represented by a number of lines per millimeter, with more lines representing higher image quality. For example, the satellite images are arranged 250 lines per square millimeter, i.e., within each square millimeter: 62500 pixels, the distance between two adjacent pixels is only 4 microns, which is related to the focal length of the camera and the flying height of the satellite. If the focal length is 2 meters and the flying height is 150 km, the ground distance is 0.3 meters according to the geometric relation. This length is the ground resolution of the image.

And S16, preprocessing the remote sensing image information to obtain spectrum image information.

In an embodiment of the present application, the preprocessing includes: geometric correction, image fusion and image mosaic are affected by various imaging factors, so that the position, shape, size, azimuth and other features of the ground feature in the remote sensing image information deviate from the corresponding features of the real ground feature, and therefore the geometric correction of the image is required. And then fusing the corrected remote sensing image information by using the full-color and multispectral images, so that the fused remote sensing image information has new spatial and spectral resolution.

And S17, inputting the spectral image information into a trained classification model for recognition to obtain building category image information and labeling vector information corresponding to the building category image information.

The building category image information is used for representing building image information of different categories at the 5G firefighting intercom mobile phone, and the annotation vector information is used for representing three-dimensional geographic coordinate information corresponding to the building category image information.

And S18, judging whether a preset inflammable building type exists in the building type image information, and if so, marking the building type based on the marking vector information.

For the embodiments of the present application, the preset flammable building types include: plexiglas, textile mills, printing mills, wood roof trusses, etc.

In one possible implementation manner of the embodiment of the present application, step S16 (not shown in the figure) specifically includes step S61 (not shown in the figure), step S62 (not shown in the figure), and step S63 (not shown in the figure), where,

step S61, performing geometric correction processing on the remote sensing image information to obtain corrected image information.

Specifically, the geometric distortion of the remote sensing image is geometrically corrected. The geometric distortion is two kinds of (1) distortion caused by the self performance of the remote sensing instrument, including scale distortion, skew distortion, center shift distortion, scanning nonlinear distortion, radial distortion, orthogonal distortion and the like. (2) The distortion caused by the flight attitude of the vehicle (airplane or satellite), the former including projection distortion caused by the inclination of the flight attitude of the vehicle and scale error caused by the change in altitude, and the latter including distortion caused by the relief of the topography and the curvature of the earth. Geometric corrections are typically made using electronic computers and optical instruments. The principle is that the element of one distorted image is transformed from the original position to another correct image through a certain coordinate transformation. The geometric correction of the image also comprises the steps of painting a coordinate grid, registering the multispectral image and transforming the remote sensing image obtained by certain projection into map projection.

And step S62, performing image fusion processing on the corrected image information and the multispectral image to obtain fused image information.

In particular, multispectral images refer to images that contain many bands, sometimes only 3 bands (color images are one example) but sometimes much more, even hundreds. Each band is a gray scale image representing scene brightness derived from the sensitivity of the sensor used to generate the band. In such an image, each pixel is associated with a string of values in different bands, i.e. a vector, by the pixel. This series is called a spectral signature of the pixel.

And step S63, performing image mosaic processing on the fused image information to obtain spectrum image information.

In the embodiment of the present application, the manner of performing the image mosaic processing on the fused image information includes: and selecting one image with uniform brightness and color from the image information to be fused as a reference image of mosaic, and performing mosaic on other images from near to far according to the reference image.

One possible implementation manner of the embodiment of the present application, step S17 (not shown in the figure) further includes step S71 (not shown in the figure), step S72 (not shown in the figure), and step S73 (not shown in the figure), where,

And step S71, performing overlapped slicing processing on the spectrum image information to obtain cut image information.

For the embodiment of the application, a plurality of different intervals are adopted for overlapped slice segmentation in the slicing process to increase the number of samples and improve the generalization capability of the model.

Step S72, building a DSM model based on the cutting image information and retrieving DSM data in the DSM model.

In the embodiment of the application, the DSM model is an ASPP-Aug-HED-DSM model, which is obtained by introducing an integral edge detection network (Holisically-Nested Edge Detection, HED) as a ground object boundary feature detection sub-network into an ASPP-Aug multi-scale expansion convolution classification network to classify images, and introducing DSM (Digital Surface Model, chinese digital surface model) elevation data as network training auxiliary data while fully playing the high accuracy advantage of the HED integral edge feature detection sub-network in ground object boundary detection.

Specifically, because the high-resolution remote sensing data contains abundant ground object information and has a larger image size, even if overlapping slicing processing is performed on an image pair, the high-resolution remote sensing image can lead to that the same classified target ground object is distributed in different slices, which is not beneficial to the learning of the convolution network on the integral characteristics of the target ground object. Furthermore, since CNN requires a large amount of training data to obtain a high-precision classification result, if the amount of training data is insufficient, it will result in a high bias of network parameters toward training its data. The image may typically be subjected to enhancement processing including random cropping, flipping, and random perturbation of the image in terms of brightness, saturation, hue, and contrast. However, the enhancement method cannot be used for enhancing certain ground features in a targeted manner. While using Object Proposal methods, areas containing potential features can be found in the image, such as Selective Search for Selective Search and edgeBox, etc.

In the embodiment of the application, a graph theory segmentation method is adopted to segment the high-resolution remote sensing image into a plurality of small areas. Based on the segmentation results described above, the Selective Search method is then used to generate the bounding box of the potential target as an enhancement of the sample data, so that more valuable training data can be obtained using the method of unsupervised image segmentation than using simple image enhancement. According to the method, potential ground objects and labels thereof are extracted from image data and used as supplement of training data, so that classification accuracy and model generalization capability are improved, and an ASPP-Aug multi-scale expansion convolution classification network is formed.

Specifically, the HED network utilizes a multi-output network architecture for edge detection. The HED network is based on a VGG-16 network structure, a convolutional layer before each pooling layer of VGG-16 outputs an edge output (Side-output) characteristic diagram, and the receptive fields of convolution operations corresponding to the 5 edge output characteristic diagrams are 5, 14, 40, 92 and 196 respectively. In the training stage, the 5 Side-output feature maps respectively calculate losses by taking edge images generated by the classification samples as label data and then respectively perform back propagation. Unlike a traditional CNN that contains only one forward-backward propagation stream, the HED network has multiple forward-feedback streams whose gradients are equal to the weighted fusion of the gradients returned by subsequent layers when traveling backward. Because of the difference of the receptive fields, the receptive fields of the Side-output feature map close to the input image are small, and the local features of the image can be extracted more; the rear Side-output feature map has large receptive field, and can extract high-level semantic features. Finally, the 5 Side-output feature graphs are weighted and fused into an output layer, and the output layer and the tag data calculate loss and are back-propagated.

Specifically, the HED global edge detection network has the following feature points relative to the conventional edge detection method:

1. for integral image training and prediction, the image-to-image edge detection can be realized based on FCN (Fully Convolutional Networks, full convolution network), the input of the algorithm is a multichannel high-resolution remote sensing image, and the output of the algorithm is 5 edge detection intensity images. And nesting multi-level feature learning in a network based on the FCN (fuzzy c-means) multi-level structure, taking all the 5 scale feature layers as internal edge layers to generate edge detection results with different scales, and respectively connecting deconvolution layers to the 5 edge detection feature images to restore the feature images to the original size.

2. In the high-resolution remote sensing image, due to the existence of shadow, the characteristics of the target in the shadow area on the image are sharply reduced, so that the characteristics are lost in the characteristic extraction process, and the classification accuracy is directly reduced. The elevation information of the ground object in the image can be not influenced by the shadow of the image, the data representing the height characteristics of the ground object is added as the classification auxiliary information of the original image in the characteristic extraction process, and adverse influence of factors such as the shadow on the classification result is reduced.

Specifically, the digital elevation model (Digital Elevation Model, DEM) refers to a data set representing planar coordinates (X, Y) and elevations (Z) of regular lattice points within a certain range, and is mainly formed by describing spatial distribution of the morphology of a target research area, acquiring elevation data through contour lines or similar three-dimensional models, and then interpolating the data. DEM is a branch of digital terrain model DTM (Digital Terrain Model). DTM represents the spatial distribution of linear or nonlinear combinations of various topographical factors including elevation, such as slope and grade. The digital surface model (Digital Surface Model, DSM) is a ground elevation model that includes ground level information of ground trees, buildings, and the like. The DSM further includes altitude information of other ground manifestations other than the ground on the basis of the DEM. For example, in forest areas, the DSM may be used to detect forest growth, and in urban areas, the DSM may be used to check urban building construction.

And step S73, inputting the cutting image information and the DSM data into the classification model for recognition to obtain building category image information and labeling vector information corresponding to the building category image information.

A possible implementation manner of the embodiment of the present application, step S18 (not shown in the figure) further includes step S81 (not shown in the figure) and step S82 (not shown in the figure), where,

step S81, detecting whether the position information of the 5G firefighting intercom handset changes, and if so, updating the remote sensing head portrait information in real time to obtain real-time positioning point information.

And S82, determining displacement route information according to the real-time positioning point information, and binding the displacement route information with the remote sensing image information to obtain track remote sensing image information.

In the embodiment of the application, according to the position movement of the 5G firefighting intercom mobile phone, displacement route drawing is carried out, meanwhile, the displacement route at the drawing position is bound with remote sensing image information to obtain track remote sensing image information, and then the initial remote sensing image information is updated according to the track remote sensing image information, so that after firefighters rescue people in fire, safe withdrawal is realized according to the displacement route in the track remote sensing image information.

The above embodiments describe a method for controlling on-screen communication from the viewpoint of a method flow, and the following embodiments describe an apparatus for controlling on-screen communication from the viewpoint of a virtual module or a virtual unit, which will be described in detail below.

The embodiment of the present application provides a screen display communication control device, as shown in fig. 4, the screen display communication control device 20 may specifically include: an information acquisition module 21, a picture determination module 22, a data retrieval module 23, an analog combination module 24 and a communication update module 25, wherein,

the information acquisition module 21 is configured to acquire screen image information and communication channel information, where the screen image information is screen image receiving information of a 5G firefighting intercom handset, and the communication channel information is used to represent communication channels of different frequency bands that can be communicated with the 5G firefighting intercom handset;

a frame determining module 22, configured to determine a frame receiving parameter and a frame integrity according to the screen frame information;

the data retrieving module 23 is configured to determine whether the integrity of the picture meets a preset integrity condition, and if not, retrieve associated data of the picture receiving parameter and the communication channel information to obtain a picture receiving rate and a real-time communication channel corresponding to the picture receiving rate;

the analog combination module 24 is configured to determine whether the picture receiving rate meets a picture receiving standard, and if not, perform channel communication analog combination based on the communication channel information and the real-time communication channel to obtain a combined communication channel;

And the communication updating module 25 is configured to update the real-time communication information based on the combined communication channel.

In one possible implementation manner of this embodiment of the present application, when the analog combination module 24 performs channel communication analog combination based on the communication channel information and the real-time communication channel, the analog combination module is specifically configured to:

In another possible implementation manner of this embodiment of the present application, when the analog combination module 24 performs screening and combination analysis on the data reception rate to obtain the reception group information, the method is specifically used for:

In another possible implementation manner of the embodiment of the present application, the apparatus 20 further includes: the system comprises an image acquisition module, an image processing module, a classification and identification module and a building labeling module, wherein,

In another possible implementation manner of this embodiment of the present application, when the image processing module performs preprocessing on the remote sensing image information to obtain spectral image information, the image processing module is specifically configured to:

In another possible implementation manner of this embodiment of the present application, when the classification recognition module inputs the spectral image information into the trained classification model to perform recognition, the classification recognition module is specifically configured to:

In another possible implementation manner of the embodiment of the present application, the apparatus 20 further includes: a site update module, and a bitmap binding module, wherein,

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

The embodiment of the application provides a 5G fire control intercom mobile phone, as shown in fig. 2 and fig. 3, the 5G fire control intercom mobile phone includes: casing 1, set up in the display screen 2 of casing 1 surface and set up in the copper foil graphite heat conduction membrane 3 and the camera 4 of casing 1 side that deviates from display screen 2, still include: a processor 5 and a memory 6. Wherein the processor 5 is coupled to a memory 6, e.g. via a bus 7. Optionally, the 5G firefighting intercom handset may also include a transceiver 8. It should be noted that, in practical applications, the transceiver 8 is not limited to one, and the structure of the 5G firefighting intercom 30 is not limited to the embodiment of the present application.

The processor 5 may be a CPU (Central Processing Unit ), general purpose processor, DSP (Digital Signal Processor, data signal processor), ASIC (Application Specific Integrated Circuit ), FPGA (Field Programmable Gate Array, field programmable gate array) or other programmable logic device, transistor logic device, hardware components, or any combination thereof. Which may implement or perform the various exemplary logic blocks, modules, and circuits described in connection with this disclosure. The processor 5 may also be a combination for performing computing functions, e.g. comprising one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

Bus 7 may include a path to transfer information between the aforementioned components. Bus 7 may be a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus, or an EISA (Extended Industry Standard Architecture ) bus, among others. The bus 7 may be classified into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in fig. 3, but not only one bus or one type of bus.

The Memory 6 may be, but is not limited to, a ROM (Read Only Memory) or other type of static storage device that can store static information and instructions, a RAM (Random Access Memory ) or other type of dynamic storage device that can store information and instructions, an EEPROM (Electrically Erasable Programmable Read Only Memory ), a CD-ROM (Compact Disc Read Only Memory, compact disc Read Only Memory) or other optical disk storage, optical disk storage (including compact discs, laser discs, optical discs, digital versatile discs, blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

The memory 6 is used for storing application program codes for executing the present application and is controlled to be executed by the processor 5. The processor 5 is arranged to execute application code stored in the memory 6 for implementing what has been shown in the previous method embodiments.

Wherein, 5G fire control intercom cell-phone includes, but is not limited to: mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. But may also be a server or the like. The 5G firefighting intercom handset illustrated in fig. 3 is merely an example and should not impose any limitation on the functionality and scope of use of embodiments of the present disclosure.

The present application provides a computer readable storage medium having a computer program stored thereon, which when run on a computer, causes the computer to perform the corresponding method embodiments described above. Compared with the related art, in the embodiment of the application, when firefighters rescue by using the 5G firefighting intercom mobile phone, according to the obtained screen picture information of the 5G firefighting intercom mobile phone and communication channels in different frequency bands which can be communicated with the 5G firefighting intercom mobile phone, picture receiving parameters and picture integrity of the current screen picture information are determined, then whether the picture integrity meets the preset integrity condition is judged, if not, relevant data retrieval is carried out on the picture receiving parameters and the communication channel information, so that picture receiving rate and a real-time communication channel corresponding to the picture receiving rate are obtained, then whether the picture receiving rate meets the picture receiving standard is judged, if not, channel communication simulation combination is carried out on the basis of the communication channel information and the real-time communication channel, so that a combined communication channel is obtained, then the real-time communication information is updated on the basis of the combined communication channel, and fluctuation of the position information and thermal imaging information displayed on the screen of the 5G firefighting intercom mobile phone is avoided, and accordingly the risk of firefighting rescue is reduced.

It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the flowcharts of the figures may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily being sequential, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.

The foregoing is only a partial embodiment of the present application and it should be noted that, for a person skilled in the art, several improvements and modifications can be made without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims

1. A screen display communication control method is characterized by comprising the following steps:

2. The method of claim 1, wherein the performing channel communication analog combination based on the communication channel information and the real-time communication channel to obtain a combined communication channel comprises:

3. The method of claim 2, wherein the screening and combining analysis is performed on the data reception rate to obtain the reception group information, and the method comprises:

4. The method of on-screen communication control according to claim 1, further comprising:

5. The method of claim 4, wherein preprocessing the remote sensing image information to obtain spectral image information comprises:

6. The method for controlling on-screen communication according to claim 5, wherein the step of inputting the spectral image information into the trained classification model for recognition to obtain building class image information and labeling vector information corresponding to the building class image information comprises:

7. The method for controlling on-screen communication according to claim 4, wherein the labeling the building category based on the labeling vector information further comprises:

8. A screen display communication control device, comprising:

9. The 5G fire-fighting intercom mobile phone is characterized by comprising: casing (1), set up in display screen (2) on casing (1) surface and set up copper foil graphite heat conduction membrane (3) and camera (4) in casing (1) deviating from display screen (2) one side, still include: one or more processors (5); a memory (6); one or more applications, wherein the one or more applications are stored in the memory (6) and configured to be executed by the one or more processors (5), the one or more applications configured to: the on-screen communication control method according to any one of claims 1 to 7 is performed.

10. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when executed by a processor (5), implements the on-screen communication control method according to any one of claims 1 to 7.