CN115017174A - Display content monitoring method and system of passenger information system and electronic equipment - Google Patents

Display content monitoring method and system of passenger information system and electronic equipment Download PDF

Info

Publication number
CN115017174A
CN115017174A CN202210442146.6A CN202210442146A CN115017174A CN 115017174 A CN115017174 A CN 115017174A CN 202210442146 A CN202210442146 A CN 202210442146A CN 115017174 A CN115017174 A CN 115017174A
Authority
CN
China
Prior art keywords
information
display content
detected
monitoring
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210442146.6A
Other languages
Chinese (zh)
Inventor
汪晓臣
黄志威
赵伟慧
田源
孙同庆
张馨
宫玉昕
李帅
王越彤
高凡
吴跃
刘小满
周超
赵俊华
李樊
杜呈欣
阚庭明
张铭
王志飞
孟宇坤
蔡晓蕾
吴卉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Academy of Railway Sciences Corp Ltd CARS
Institute of Computing Technologies of CARS
Beijing Jingwei Information Technology Co Ltd
Original Assignee
China Academy of Railway Sciences Corp Ltd CARS
Institute of Computing Technologies of CARS
Beijing Jingwei Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Academy of Railway Sciences Corp Ltd CARS, Institute of Computing Technologies of CARS, Beijing Jingwei Information Technology Co Ltd filed Critical China Academy of Railway Sciences Corp Ltd CARS
Priority to CN202210442146.6A priority Critical patent/CN115017174A/en
Publication of CN115017174A publication Critical patent/CN115017174A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/242—Query formulation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Abstract

The invention provides a method, a system and electronic equipment for monitoring display contents of a passenger information system, wherein the method comprises the following steps: acquiring a display content image displayed by a display terminal in the PIS; identifying target display content information to be detected in the display content image, wherein the target display content information to be detected comprises at least one of train running state information to be detected, operation announcement information to be detected and time information to be detected; comparing the target display content information to be detected with the reference display content information to obtain a comparison result; and responding to the comparison result that the comparison fails, and outputting prompt information of abnormal display contents of the display terminal. The technical scheme provided by the embodiment of the invention realizes the real-time monitoring of the display content of the PIS, can find the PIS fault in time and improves the reliability of the operation of the PIS.

Description

Display content monitoring method and system of passenger information system and electronic equipment
Technical Field
The invention relates to the technical field of rail transit, in particular to a method and a system for monitoring display contents of a passenger information system and electronic equipment.
Background
Passenger Information Systems (PIS) in the rail transit System can provide passengers with accurate train arrival Information, operation announcement Information and the like by means of display screens distributed at stations, platforms, halls, trains, transfer passages and the like, so that guidance of passengers for taking a bus is realized, and operation of rail transit is influenced once Information display faults occur.
The PIS fault discovery mainly depends on the patrol of personnel and the report of passengers, but because the distribution positions of the display terminals are wide and large in quantity, the faults are difficult to discover in time by the patrol of personnel and the report of passengers, and the influence is brought to the operation of the rail transit.
Disclosure of Invention
The invention provides a method and a system for monitoring display contents of a passenger information system and electronic equipment, which are used for solving the defect that PIS display faults cannot be found in time in the prior art and realizing real-time monitoring of PIS display contents.
The invention provides a display content monitoring method of a passenger information system, which comprises the following steps:
acquiring a display content image displayed by a display terminal in a passenger information system PIS;
identifying target display content information to be detected in the display content image, wherein the target display content information to be detected comprises at least one of train running state information to be detected, operation announcement information to be detected and time information to be detected;
comparing the target display content information to be detected with reference display content information to obtain a comparison result;
and responding to the comparison result that the comparison fails, and outputting prompt information of abnormal display contents of the display terminal.
According to the display content monitoring method of the passenger information system provided by the invention, the target display content information to be detected comprises the running state information of the train to be detected, the reference display content information comprises the running state information of the reference train, and the comparison of the target display content information to be detected and the reference display content information to obtain the comparison result comprises the following steps:
acquiring train running state data from an automatic train monitoring (ATS) system to obtain first reference train running state information;
acquiring train running state data from the PIS to obtain second reference train running state information;
comparing the running state information of the train to be tested, the running state information of the first reference train and the running state information of the second reference train;
if the first reference train running state information is consistent with the second reference train running state information but is inconsistent with the train running state information to be detected, the comparison is failed;
and if the second reference train running state information is consistent with the train running state information to be detected but not consistent with the first reference train running state information, the comparison is failed.
According to the method for monitoring the display content of the passenger information system provided by the invention, the target display content information to be detected comprises to-be-detected operation announcement information, the reference display content information comprises reference operation announcement information, and the comparison of the target display content information to be detected and the reference display content information to obtain a comparison result comprises the following steps:
acquiring operation announcement information which is currently sent by the PIS to the display terminal for displaying from the PIS to obtain the reference operation announcement information;
and carrying out fuzzy matching on the to-be-detected operation announcement information serving as a keyword and the reference operation announcement information, and if the information identical to the reference operation announcement information is not matched, the comparison is failed.
According to the display content monitoring method of the passenger information system provided by the invention, after the display content information to be detected of the target in the display content image is identified, the display content monitoring method of the passenger information system further comprises the following steps:
and carrying out fuzzy matching on the to-be-detected operation announcement information and a set illegal keyword database, and if at least one keyword is matched, comparing the to-be-detected operation announcement information and the set illegal keyword database and failing to pass the comparison.
According to the display content monitoring method of the passenger information system provided by the invention, the target display content information to be detected comprises time information to be detected, the reference display content information comprises reference time information, and the comparison of the target display content information to be detected and the reference display content information to obtain a comparison result comprises the following steps:
acquiring time information from a clock system to obtain the reference time information;
and comparing the time information to be measured with the reference time information, and if the time information to be measured is different from the reference time information, the comparison is failed.
According to the display content monitoring method of the passenger information system provided by the invention, the step of identifying the target display content information to be detected in the display content image comprises the following steps:
and identifying target display content information from the display content image by adopting a target detection algorithm model to obtain target display content information to be detected, wherein the target detection algorithm model is used for identifying the target display content information of the input display content image and outputting the identified target display content information.
According to the method for monitoring the display content of the passenger information system, before the display content image displayed by the display terminal in the passenger information system PIS is obtained, the method for monitoring the display content of the passenger information system further comprises the following steps:
acquiring a display content sample image;
labeling a detection area and a detection object corresponding to the detection area in the display content sample image to obtain a labeled display content sample image;
and training a neural network model for image target detection based on the marked display content sample image to obtain the target detection algorithm model.
The invention also provides a display content monitoring system of the passenger information system, which comprises a monitoring platform and a monitoring client end in communication connection with the monitoring platform, wherein the monitoring platform is deployed in a line control center, and the monitoring client end is deployed in the line control center, a station passenger information system PIS play controller or a vehicle-mounted controller;
the monitoring client is used for acquiring a display content image displayed by a display terminal in a passenger information system PIS, identifying target display content information to be detected in the display content image and sending the target display content information to be detected to the monitoring platform, wherein the target display content information to be detected comprises at least one of train running state information to be detected, operation announcement information to be detected and time information to be detected;
the monitoring platform is used for comparing the target display content information to be detected with the reference display content information to obtain a comparison result, and outputting prompt information of abnormal display content of the display terminal in response to the comparison result that the comparison is failed.
The invention also provides an electronic device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the computer program to realize the display content monitoring method of the passenger information system.
The present invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method of display content monitoring for a passenger information system as described in any one of the above.
According to the method, the system and the electronic equipment for monitoring the display content of the passenger information system, the display content image displayed by the display terminal in the passenger information system PIS is obtained, at least one of the running state information of the train to be detected, the operation announcement information to be detected, the time information to be detected and the like in the display content image is identified, the identified information is compared with the reference display content information, abnormal display information appears on the display terminal when the comparison fails, the prompt information of abnormal display content is output to prompt the abnormality, the real-time monitoring of the PIS display content is realized, the PIS fault can be found in time, and the reliability of the PIS running is improved.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic view of an application scenario of a display content monitoring method of a passenger information system provided by the invention;
FIG. 2 is a schematic diagram of a display monitoring system for a passenger information system according to the present invention;
FIG. 3 is a schematic flow diagram of a method for monitoring display content of a passenger information system in accordance with the present invention;
FIG. 4 is one of the schematic diagrams of a display content image provided by the present invention;
FIG. 5 is a second schematic diagram of a display content image provided by the present invention;
FIG. 6 is a schematic flow chart diagram of a method for generating an object detection algorithm model provided by the present invention;
fig. 7 is a schematic structural diagram of an electronic device provided by the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The accuracy and the legality of information display of a passenger information system PIS of rail transit play an important role in rail transit operation, and once a display terminal has an information display fault or error, the rail transit operation is seriously affected.
The failure of the PIS is finally presented as a display content error, and common failure types can include at least one of the following: the display screen is black, the desktop of the system is displayed, at least one of train arrival information, clock information and operation notice information is displayed wrongly, illegal information is displayed, and the like. In the related technology, the PIS fault is mainly found by means of personnel inspection, passenger reporting and the like, but the display terminals are wide in distribution position and large in quantity, so that on one hand, inspection of PIS related equipment consumes a large amount of manpower and material resources, on the other hand, faults are difficult to find in time through the inspection or passenger reporting mode, guidance and operation order of passenger riding are affected, and passenger riding experience is reduced. Therefore, it is urgently needed to realize the fast and reliable monitoring of the abnormality of the display content of the PIS by means of an intelligent means.
Based on this, in the embodiment of the present invention, the display content image displayed by the display terminal in the PIS is obtained in real time, at least one of the running state information of the train to be detected, the operation announcement information to be detected, and the time information to be detected in the display content image is identified, the identified information is compared with the reference display content information, and when the comparison fails, the prompt information that the display content of the display terminal is abnormal is output.
For example, fig. 1 illustrates an application scenario diagram of the display content monitoring method of the passenger information system according to the embodiment of the present invention, and as shown in fig. 1, the application scenario may include a line control center 110, a station control system 120, and a train 130. The line control center 110 may deploy an Automatic Train Supervision (ATS) system, a PIS, a clock system, and a display monitoring system of the passenger information system, which may be deployed in one or more servers of the line control center 110, for example, in fig. 1, the ATS system may be deployed in the first server 111, the PIS may be deployed in the second server 112, the clock system may be deployed in the third server 113, and the display monitoring system of the passenger information system may be deployed in the monitoring server 114. It should be noted that the present invention is only illustrative and not limited thereto. The display monitoring systems of the passenger information systems are communicatively coupled to the ATS system, the PIS system, and the clock system, respectively, and the display monitoring systems of the ATS system, the PIS system, the clock system, and the passenger information systems may be coupled to the network 140 via the gateway device 115.
The station control system 120 may include a station PIS play controller 121 and a station network connection device 122, and the station network connection device 122 may be, for example, an exchange. The station PIS player controller 121 may be communicatively connected to the network 140 via the station network connection device 122, and may be communicatively connected to one or more display terminals of the station, such as the display terminal 123 and the display terminal 124 in fig. 1, to control the display contents of these display terminals. The train 130 is provided with an on-board controller 131, the on-board controller 131 can access the network 140 through an on-board wireless network device 132, and can be in communication connection with a plurality of display terminals (such as the display terminal 133 and the display terminal 134) of the train compartment, wherein the on-board wireless network device 132 can be, for example, an on-board wireless switch. In an exemplary embodiment of the present invention, the Display terminal may be, for example, a Liquid Crystal Display (LCD), a Cathode Ray Tube (CRT) Display, or the like.
The ATS system is used as a core system for train operation and can provide uniform train operation state data; the PIS can communicate with the ATS system to acquire train running state data, and an operation user can issue operation announcement information data to be displayed through the PIS; the station PIS player controller 121 and the vehicle-mounted controller 131 can acquire data of the PIS through the network 140, and synthesize and display passenger information and output the data through the display terminal, wherein the data can include but is not limited to train operation state data, operation notice information and the like.
Based on the application scenario shown in fig. 1, in the embodiment of the present invention, a display content monitoring system of a passenger information system may obtain a display content image displayed by a display terminal in a PIS, identify target to-be-detected display content information in the display content image, where the target to-be-detected display content information may include at least one of train running state information to be detected, operation announcement information to be detected, and time information to be detected, compare the target to-be-detected display content information with reference display content information to obtain a comparison result, and output prompt information indicating that the display content of the display terminal is abnormal in response to the comparison result being that the comparison fails.
In an exemplary embodiment of the present invention, fig. 2 illustrates a schematic structural diagram of a display content monitoring system of a passenger information system provided in an embodiment of the present invention, and referring to fig. 2, a display content monitoring system 200 of the passenger information system may include a monitoring platform 210 and a monitoring client communicatively connected to the monitoring platform 210, for example, one or more monitoring clients communicatively connected to the monitoring platform 210 may correspond to one or more display terminals, and fig. 2 illustrates an example where the monitoring platform 210 is connected to one monitoring client 220, but is not limited to the present invention. The monitoring platform 210 may be deployed in a line control center; the monitoring client 220 may be deployed in a line control center, or may be deployed in a station PIS play controller or a vehicle-mounted controller. The station PIS playing controller is arranged at a station and can be in communication connection with a plurality of display terminals of a train station. The vehicle-mounted controller is arranged in a train carriage and can be in communication connection with a plurality of display terminals on the train.
In the embodiment of the present invention, the monitoring client 220 may be configured to obtain a display content image displayed by a display terminal in the PIS, identify target to-be-detected display content information in the display content image, and send the target to-be-detected display content information to the monitoring platform 210, where the target to-be-detected display content information may include at least one of train running state information to be detected, operation announcement information to be detected, and time information to be detected; the train operation state information may include at least one of a train operation direction, station information of a station where the train is located, first-class train time, last-class train time, next-train arrival time, second-train arrival time, and the like. The monitoring platform 210 may be configured to compare the target display content information to be detected with the reference display content information to obtain a comparison result, and output a prompt message indicating that the display content of the display terminal is abnormal in response to the comparison result indicating that the comparison fails.
The reference display content information may include at least one of reference train operation status information, reference operation announcement information, and reference time information, and may be acquired by the monitoring platform 210 from an ATS system, a PIS system, and a time system. Illustratively, the monitoring platform 210 may obtain train operation state data from the ATS system and the PIS, respectively, to obtain first reference train operation state information and second reference train operation state information; the monitoring platform 210 can obtain the operation announcement information currently sent by the PIS to the display terminal for displaying from the PIS to obtain the reference operation announcement information; the reference time information may be obtained by the monitoring platform 210 from a clock system.
In an example embodiment, as shown in fig. 2, the monitoring client 220 may include an image acquisition module 221 and an information identification module 222, and the monitoring platform 210 may include an information comparison module 211 and a monitoring and pre-warning module 212. The image obtaining module 221 may be configured to obtain a display content image displayed in a screen of a display terminal in the PIS, for example, obtain the display content image in a screen shot manner. For example, the image obtaining module 221 may also obtain an Internet Protocol (IP) address of the display terminal when obtaining the display content image. The information identifying module 222 may be configured to identify target display content information to be detected in the display content image, and send the target display content information to be detected to the monitoring platform 210, where the target display content information to be detected includes at least one of train running state information to be detected, operation announcement information to be detected, and time information to be detected. For example, the monitoring client 220 may further include a first communication module, which may be configured to communicate with an external device or system, for example, the target display content information to be monitored, which is identified by the information identification module 222, may be sent to the monitoring platform 210 through the first communication module. The information comparison module 211 may be configured to compare the target to-be-detected display content information with the reference display content information, and determine, through comparison, accuracy of information such as train running state information to be detected and time information to be detected in the target to-be-detected display content information, and accuracy and validity of the to-be-detected operation announcement information. The monitoring and early warning module 212 may be configured to output a prompt message indicating that the display content of the display terminal is abnormal in response to the comparison failing. Illustratively, the monitoring platform 210 may also include a second communication module, which may be used to communicate with an external device or system.
In an example embodiment, the monitoring platform 210 may further include an algorithm training module, and the algorithm training module may perform labeling on a detection region and a detection object corresponding to the detection region according to the sample image, and generate and train a target detection algorithm model. Since the interface layout of the passenger information display terminal has diversity, the algorithm training model of the monitoring platform 210 has a function of self-learning according to the characteristic picture. Specifically, the algorithm training module may be configured to obtain a display content sample image, label a detection area and a detection object corresponding to the detection area in the display content sample image to obtain a labeled display content sample image, and train a neural network model for image target detection based on the labeled display content sample image to obtain a target detection algorithm model. After obtaining the target detection algorithm model, the information identification module 222 may invoke the target detection algorithm model to identify target display content information from the display content images obtained in real time. The neural network model for image target detection may be, for example, a YOLO algorithm model, and the YOLO algorithm model may be obtained by training the image with the labeled display content sample image.
In an example embodiment, the monitoring platform 210 may further include an early warning query module, and the early warning query module may be configured to determine a query address according to a query operation for querying the abnormal display content, read abnormal display content data from the database based on the query address, and then output the abnormal display content data. For example, the database may store a corresponding relationship between an IP address of the display terminal and display content abnormal data, a user may query abnormal display content in a visual operation interface, for example, the abnormal display content of the display terminal a needs to be queried, the display terminal a may be selected in the visual operation interface, a query task is triggered, the query address may be determined to be the IP address of the display terminal a according to the operation, and then the display content abnormal data of the display terminal a may be queried in the database based on the IP address of the display terminal a and then displayed on the interface. The abnormal display content data can be obtained by comparing the target display content information to be detected with the reference display content information, and when the comparison fails, data causing the comparison failure in the target display content information to be detected can be recorded in the database, and the abnormal display content data can comprise error data, illegal data and the like. For example, the identified target display content information to be detected may also be stored as monitoring data, and the monitoring data may be comprehensively displayed and queried through a visual operation interface.
Based on the application scenario corresponding to the embodiment in fig. 1 and the display content monitoring system of the passenger information system corresponding to the embodiment in fig. 2, the following describes the display content monitoring method of the passenger information system provided by the present invention. The method for monitoring the display content of the passenger information system can be applied to the display content monitoring system of the passenger information system corresponding to the embodiment shown in fig. 2, and can also be applied to electronic equipment such as a server, a computer and the like.
Taking the example that the display content monitoring method of the passenger information system is applied to the display content monitoring system of the passenger information system corresponding to the embodiment in fig. 2 as an example, fig. 3 exemplarily shows a flow chart of the display content monitoring method of the passenger information system provided by the embodiment of the present invention, and as shown in fig. 3, the display content monitoring method of the passenger information system may include the following steps 310 to 340.
In step 310, a display content image displayed on a display terminal in the passenger information system PIS is acquired.
The display content image displayed on the screen of the display terminal is the final presentation result after the PIS information is processed, and the monitoring client can acquire the display content image displayed in the screen of the display terminal by using a picture screen capturing mode. Compared with the mode of collecting data through data returning, state reporting and the like of the display terminal, the mode of utilizing the picture screen capturing can effectively monitor the display terminal, and can also effectively monitor whether the process of accurately synthesizing and outputting various passenger information can be carried out after the passenger information is received by the display terminal, so that the accuracy of monitoring the display content of the passenger information system is improved.
In step 320, the target to-be-detected display content information in the display content image is identified, wherein the target to-be-detected display content information includes at least one of train running state information to be detected, operation announcement information to be detected, and time information to be detected.
After a display content image displayed on a screen of a display terminal in the PIS is acquired, the monitoring client can identify target display content information from the display content image by adopting a target detection algorithm model to obtain target display content information to be detected, wherein the target detection algorithm model can be used for identifying the target display content information of the input display content image and outputting the identified target display content information.
The display content image displayed on the screen of the display terminal in the PIS may be displayed according to a partition, for example, fig. 4 exemplarily shows one of schematic diagrams of the display content image provided by the embodiment of the present invention, and as shown in fig. 4, the display content image 400 may include, for example, a video area 410, a train operation state information area 420, and an operation announcement information area 430. Wherein, video information can be displayed in the video area 410; at least one of train running state information such as a train running direction, a current station, first-class train time, last-class train time, first-train arrival time, second-train arrival time and clock information can be displayed in the train running state information area 420; the operation advertisement information area 430 may display operation advertisement information, which may be distributed by an operation user through a PIS, for example. After the area division of the display content image and the object displayed by each partition are set, the updating and the distribution of passenger information can be realized by updating the information content in the area, and the display areas of various information contents are relatively fixed. Therefore, the target detection algorithm model can be adopted to extract and identify key information of the passenger information interface image finally output by the display terminal, and further the concerned passenger information content, namely the target display content information, can be obtained.
When an emergency occurs, the display content image displayed on the screen of the display terminal may be switched to a full screen mode, for example, fig. 5 exemplarily shows a second schematic diagram of the display content image provided by the embodiment of the present invention, and referring to fig. 5, the operation announcement information area 530 in the display content image 500 displays emergency operation announcement information in a full screen mode to prompt the passenger to pay attention. Similarly, the target detection algorithm model may be used to extract and identify the information in the operation announcement information area 530, so as to obtain the target display content information.
In an exemplary embodiment, before acquiring a display content image displayed in a screen of a display terminal in the PIS, the display content monitoring method of the passenger information system may further include a step of generating a target detection algorithm model, which may specifically include: acquiring a display content sample image; labeling a detection area and a detection object corresponding to the detection area in the display content sample image to obtain a labeled display content sample image; and training a neural network model for image target detection based on the marked display content sample image to obtain a target detection algorithm model. The Neural network model for image object detection may be, for example, a YOLO series algorithm model, a regional Convolutional Neural network (R-CNN), or the like.
The method comprises the steps of marking a display content sample image, establishing a neural network model for image target detection, learning and training the neural network model, finally obtaining a target detection algorithm model capable of detecting the display content image, identifying a detection object marked in an image area by using the target detection algorithm model, and mapping the detection object with a corresponding information content field. For example, taking the partition manner of fig. 4 as an example, the detection and mapping may be performed according to a train driving direction display area, a first trip arrival time display area, a second trip arrival time display area, a clock information display area, and an operation announcement information area.
Due to the fact that screen interface layout layouts of the display terminals are diverse, for example, different layouts like fig. 4 and 5 can appear on the same display terminal, and different display terminals can also have different interface layouts, the monitoring platform needs to have a function of self-learning according to the characteristic pictures.
For example, taking the neural network model for image object detection as an example, selecting the object detection algorithm YOLOv5 in the YOLO series of algorithms, fig. 6 exemplarily shows a flow chart of the method for generating the object detection algorithm model provided by the embodiment of the present invention, and referring to fig. 6, the method may include the following steps 610 to 670.
In step 610, a sample image of the display content is obtained.
The display content sample images can be selected from a wide variety of sample images, such as a large number of different partition layouts, different font formats, and the like. And when the neural network model is trained, the display content sample images are sent to a monitoring platform.
In step 620, the display content sample image is labeled to obtain a labeled display content sample image.
For the displayed content sample image, the monitoring platform may label a detection area to be monitored for displaying the content sample image and a detection object corresponding to the detection area, and the detection object may be determined according to key information to be monitored, for example, train operation state information, operation announcement information, time information and the like to be monitored are used as the detection object.
In step 630, target extraction information is defined.
After the detection area is marked, the monitoring platform may define extraction key information corresponding to the detection area, and define a mapping relationship between the extracted target extraction information and the information field type, for example, the target extraction information is mapped to time information, a train driving direction, first train arrival time or second train arrival time, and the like.
In step 640, model training is performed based on the annotated display content sample image.
In this exemplary embodiment, taking the image target detection YOLOv5 neural network model as an example, the monitoring platform may input the labeled display content sample image into the YOLOv5 neural network model, train the YOLOv5 neural network model, perform recognition detection on the reference display content image by using the trained model, and execute step 650.
In step 650, it is determined whether the recognition accuracy meets the accuracy evaluation index.
The monitoring platform can define an accuracy evaluation index in the neural network model training process, after one round of training is carried out on the YOLOv5 neural network model, the trained model is used for carrying out identification detection on a reference display content image, the identification accuracy is calculated according to the identification detection result, and then the identification accuracy is compared with the defined accuracy evaluation index to judge whether the accuracy evaluation index is met. If not, go to step 660; if so, go to step 670.
In step 660, model parameters are adjusted.
When the recognition accuracy rate does not meet the accuracy rate evaluation index, the monitoring platform adjusts and optimizes the model parameters of the YOLOv5 neural network model, then the step 640 is returned, model training is carried out on the YOLOv5 neural network model after model parameter adjustment again, and the steps are repeated until the recognition accuracy rate meets the accuracy rate evaluation index. Through adjustment and optimization of the model parameters, the identification precision and accuracy of the characteristic information can be improved.
In step 670, the trained target detection algorithm model is applied.
It should be noted that, the present exemplary embodiment is described by taking the YOLOv5 neural network model as an example, but the present invention is not limited thereto, and the neural network model of the present invention may also be other neural network models that can be used for image target detection, such as YOLOv4, R-CNN model, and the like. The neural network model may be a new neural network model generated by improving the neural network models, for example, at least one of a feature fusion network, a loss function, a non-maximum suppression method, and the like of the YOLOv5 neural network model may be improved.
In step 330, the target display content information to be tested is compared with the reference display content information to obtain a comparison result.
The target display content information to be detected may include at least one of train running state information to be detected, operation announcement information to be detected, and time information to be detected. Accordingly, the reference display content information may correspondingly include at least one of reference train operation state information, reference operation announcement information, and reference time information.
For the train running state information to be detected, train running state data can be respectively obtained through the ATS system and the PIS, and the train running state data is compared with the train running state information to be detected, which is identified by a display content monitoring system of the passenger information system, so that the accuracy of the passenger information content displayed by the display terminal is judged. Specifically, the method can comprise the following steps: acquiring train running state data from an ATS system to obtain first reference train running state information; acquiring train running state data from the PIS to obtain second reference train running state information; comparing the running state information of the train to be tested, the running state information of the first reference train and the running state information of the second reference train; if the first reference train running state information is consistent with the second reference train running state information but is inconsistent with the train running state information to be detected, the comparison is failed, and the train running state information displayed by the display terminal is wrong; if the second reference train running state information is consistent with the train running state information to be detected but not consistent with the first reference train running state information, the comparison is failed, the PIS data processing error is indicated, and the train running state information displayed by the display terminal is abnormal; if the first reference train running state information, the second reference train running state information and the train running state information to be detected are consistent, the train running state information displayed by the display terminal is correct. When the comparison fails, step 340 is performed.
For example, the monitoring platform may search, in the terminal mapping table, location information of the display terminal according to an IP address of the display terminal to obtain target location information, where the target location information may include, for example, a platform direction and a platform Identity Identification (ID), and then obtain, through the ATS system and the PIS, train operation state data of the display terminal corresponding to the location information, respectively. The terminal mapping table can store the corresponding relation between the IP address of the display terminal and the position information such as the train running direction, the station identification, the platform identification number, the station track number and the like.
For the operation notice information to be detected, the operation notice information which should be displayed by the current display terminal can be obtained through the PIS, fuzzy matching is carried out on the operation notice information and the operation notice information identified by the display content monitoring system of the passenger information system, and the accuracy of the operation notice information displayed by the display terminal is judged. Specifically, the method can comprise the following steps: acquiring operation announcement information which is currently sent to a display terminal by the PIS for displaying from the PIS to obtain reference operation announcement information; the operation notice information to be detected is used as a keyword, fuzzy matching is carried out on the operation notice information to be detected and the reference operation notice information, if the operation notice information is not matched with the reference operation notice information, the comparison is failed, and the fact that the content of the operation notice information displayed by the display terminal is wrong is indicated; if at least one piece of information which is the same as the reference operation announcement information can be matched, the comparison is passed, and the content of the operation announcement information displayed by the display terminal is indicated to be accurate. When the comparison fails, step 340 is performed.
In an example embodiment, because the operation announcement information may be displayed in a manner of scrolling left and right or scrolling up and down, the detection accuracy can be improved by performing fuzzy matching on the operation announcement information to be detected, for example, a fuzzy matching rule may be set in a manner of regular expression, and the information display accuracy can be verified as long as the target can be matched for 1 time. For example, the operation announcement information displayed by the display terminal B in the PIS is "It's raining today. However, since the operator bulletin information is displayed in a scrolling manner, It may be displayed as "It's raining today on the final screen presentation. It's raining today. It's training tod. "or as" raining today. It's raining today. It's ", and the like. Therefore, if the complete information "It's training today can be detected at least once for a set number of detections, It is raining today. ", it can be determined that the information is displayed accurately.
In an example embodiment, the display content monitoring system of the passenger information system may also verify the validity of the operation notice information to be tested. Specifically, the method can comprise the following steps: fuzzy matching is carried out on the operation announcement information to be detected and a set illegal keyword database, if at least one keyword is matched, the comparison is failed, and illegal information exists in the operation announcement information displayed by the terminal; if the keywords are not matched, the comparison is passed, and the operation announcement information displayed by the display terminal is legal. When the comparison fails, step 340 is performed.
For the time information to be detected, the display content monitoring system of the passenger information system can acquire the time information from the clock system to obtain reference time information, then the time information to be detected is compared with the reference time information, if the time information to be detected is different from the reference time information, the comparison is not passed, and the time information displayed by the display terminal is inaccurate. When the comparison fails, step 340 is performed.
In step 340, in response to that the comparison result is that the comparison fails, a prompt message indicating that the display content of the display terminal is abnormal is output.
When the comparison result is that the comparison fails, the display content monitoring system of the passenger information system can output prompt information of abnormal display content of the display terminal to prompt an abnormal early warning. For example, one or more of an abnormality prompt message, an abnormality prompt sound, an early warning indicator light triggered on, and the like can be displayed on the display interface.
In an exemplary embodiment, the display content monitoring system of the passenger information system may provide a visual monitoring interface, and may store the error data and the illegal data identified in step 330 and the target display content information to be detected monitored in real time, or may perform a real-time comprehensive display on the monitoring interface. For example, a query function menu may be provided in the monitoring interface, and a user may query data such as monitoring data, error data, illegal data, and the like through the query function menu.
According to the method for monitoring the display content of the passenger information system, provided by the embodiment of the invention, the display content image of the display terminal in the PIS is obtained, at least one of the running state information of the train to be detected, the operation announcement information to be detected, the time information to be detected and the like in the display content image is identified, the identified information is compared with the reference display content information, abnormal display information appears on the display terminal when the comparison fails, and the prompt information of the abnormal display content is output to prompt the abnormality.
Fig. 7 illustrates a physical structure diagram of an electronic device, and as shown in fig. 7, the electronic device 700 may include: a processor (processor)710, a communication Interface (Communications Interface)720, a memory (memory)730, and a communication bus 740, wherein the processor 710, the communication Interface 720, and the memory 730 communicate with each other via the communication bus 740. The processor 710 may invoke logic instructions in the memory 730 to perform the steps of the display content monitoring method of the passenger information system provided by the above embodiments, which may include, for example: acquiring a display content image displayed in a screen of a display terminal in a passenger information system PIS; identifying target display content information to be detected in the display content image, wherein the target display content information to be detected comprises at least one of train running state information to be detected, operation announcement information to be detected and time information to be detected; comparing the target display content information to be detected with the reference display content information to obtain a comparison result; and responding to the comparison result that the comparison fails, and outputting prompt information of abnormal display contents of the display terminal.
In addition, the logic instructions in the memory 730 can be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product, the computer program product including a computer program, the computer program being storable on a non-transitory computer-readable storage medium, the computer program being capable of executing, when executed by a processor, the display content monitoring method of a passenger information system provided by the above embodiments, the method including: acquiring a display content image displayed in a screen of a display terminal in a passenger information system PIS; identifying target display content information to be detected in the display content image, wherein the target display content information to be detected comprises at least one of train running state information to be detected, operation announcement information to be detected and time information to be detected; comparing the target display content information to be detected with the reference display content information to obtain a comparison result; and responding to the comparison result that the comparison fails, and outputting prompt information of abnormal display content of the display terminal.
In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, where the computer program is executed by a processor to implement the display content monitoring method of the passenger information system provided in the above embodiments, and the method may include: acquiring a display content image displayed in a screen of a display terminal in a passenger information system PIS; identifying target display content information to be detected in the display content image, wherein the target display content information to be detected comprises at least one of train running state information to be detected, operation announcement information to be detected and time information to be detected; comparing the target display content information to be detected with the reference display content information to obtain a comparison result; and responding to the comparison result that the comparison fails, and outputting prompt information of abnormal display contents of the display terminal.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A method for monitoring display content of a passenger information system, comprising:
acquiring a display content image displayed by a display terminal in a passenger information system PIS;
identifying target display content information to be detected in the display content image, wherein the target display content information to be detected comprises at least one of train running state information to be detected, operation announcement information to be detected and time information to be detected;
comparing the target display content information to be detected with reference display content information to obtain a comparison result;
and responding to the comparison result that the comparison fails, and outputting prompt information of abnormal display content of the display terminal.
2. The method for monitoring display content of a passenger information system according to claim 1, wherein the target display content information to be detected includes train operation state information to be detected, the reference display content information includes reference train operation state information, and comparing the target display content information to be detected with the reference display content information to obtain a comparison result includes:
acquiring train running state data from an automatic train monitoring (ATS) system to obtain first reference train running state information;
acquiring train running state data from the PIS to obtain second reference train running state information;
comparing the running state information of the train to be tested, the running state information of the first reference train and the running state information of the second reference train;
if the first reference train running state information is consistent with the second reference train running state information but is inconsistent with the train running state information to be detected, the comparison is failed;
and if the second reference train running state information is consistent with the train running state information to be detected but not consistent with the first reference train running state information, the comparison is failed.
3. The method for monitoring display content of a passenger information system according to claim 1, wherein the target to-be-detected display content information includes to-be-detected operation announcement information, the reference display content information includes reference operation announcement information, and comparing the target to-be-detected display content information with the reference display content information to obtain a comparison result includes:
acquiring operation announcement information which is currently sent to the display terminal by the PIS for displaying from the PIS to obtain the reference operation announcement information;
and carrying out fuzzy matching on the to-be-detected operation announcement information serving as a keyword and the reference operation announcement information, and if the information identical to the reference operation announcement information is not matched, the comparison is failed.
4. The passenger information system display content monitoring method of claim 3, wherein after the identifying the target display content information to be detected in the display content image, the passenger information system display content monitoring method further comprises:
and carrying out fuzzy matching on the to-be-detected operation announcement information and a set illegal keyword database, and if at least one keyword is matched, comparing the to-be-detected operation announcement information and the set illegal keyword database and failing to pass the comparison.
5. The method as claimed in claim 1, wherein the target display content information to be detected includes time information to be detected, the reference display content information includes reference time information, and comparing the target display content information to be detected with the reference display content information to obtain a comparison result includes:
acquiring time information from a clock system to obtain the reference time information;
and comparing the time information to be measured with the reference time information, and if the time information to be measured is different from the reference time information, the comparison is failed.
6. The method of claim 1, wherein the identifying the target display content information to be detected in the display content image comprises:
and identifying target display content information from the display content image by adopting a target detection algorithm model to obtain target display content information to be detected, wherein the target detection algorithm model is used for identifying the target display content information of the input display content image and outputting the identified target display content information.
7. The method for monitoring display contents of a passenger information system according to claim 6, wherein before the acquiring of the display content image displayed by the display terminal in the passenger information system PIS, the method for monitoring display contents of a passenger information system further comprises:
acquiring a display content sample image;
labeling a detection area and a detection object corresponding to the detection area in the display content sample image to obtain a labeled display content sample image;
and training a neural network model for image target detection based on the marked display content sample image to obtain the target detection algorithm model.
8. A display content monitoring system of a passenger information system is characterized by comprising a monitoring platform and a monitoring client end in communication connection with the monitoring platform, wherein the monitoring platform is deployed in a line control center, and the monitoring client end is deployed in the line control center, a station passenger information system PIS play controller or a vehicle-mounted controller;
the monitoring client is used for acquiring a display content image displayed by a display terminal in a passenger information system PIS, identifying target display content information to be detected in the display content image and sending the target display content information to be detected to the monitoring platform, wherein the target display content information to be detected comprises at least one of train running state information to be detected, operation announcement information to be detected and time information to be detected;
the monitoring platform is used for comparing the target display content information to be detected with the reference display content information to obtain a comparison result, and outputting prompt information of abnormal display content of the display terminal in response to the comparison result that the comparison is failed.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor, when executing the computer program, implements a display content monitoring method of a passenger information system according to any one of claims 1 to 7.
10. A non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the display content monitoring method of a passenger information system according to any one of claims 1 to 7.
CN202210442146.6A 2022-04-25 2022-04-25 Display content monitoring method and system of passenger information system and electronic equipment Pending CN115017174A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210442146.6A CN115017174A (en) 2022-04-25 2022-04-25 Display content monitoring method and system of passenger information system and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210442146.6A CN115017174A (en) 2022-04-25 2022-04-25 Display content monitoring method and system of passenger information system and electronic equipment

Publications (1)

Publication Number Publication Date
CN115017174A true CN115017174A (en) 2022-09-06

Family

ID=83067074

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210442146.6A Pending CN115017174A (en) 2022-04-25 2022-04-25 Display content monitoring method and system of passenger information system and electronic equipment

Country Status (1)

Country Link
CN (1) CN115017174A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116419008A (en) * 2023-03-15 2023-07-11 苏州匠数科技有限公司 Real-time detection method and system for operation playing video and electronic equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116419008A (en) * 2023-03-15 2023-07-11 苏州匠数科技有限公司 Real-time detection method and system for operation playing video and electronic equipment

Similar Documents

Publication Publication Date Title
CN106327605A (en) Inspection method
CN112613569B (en) Image recognition method, training method and device for image classification model
JP2017043348A (en) Method for specifying position of train event on railway network
CN111797725A (en) Equipment state detection method, device and system
CN107705472B (en) Time-space positioning module for billing, cloud billing system and method
CN108270646B (en) Method and device for detecting electronic class board network
CN115017174A (en) Display content monitoring method and system of passenger information system and electronic equipment
CN108599989B (en) MVB bus detection method and device
WO2019137052A1 (en) Method and device for network operation and maintenance
CN116189079A (en) Abnormality detection method and device for monitoring equipment
CN112381958A (en) ETC portal system state online monitoring method and system
CN112233428A (en) Traffic flow prediction method, traffic flow prediction device, storage medium and equipment
CN103913150B (en) Intelligent electric energy meter electronic devices and components consistency detecting method
CN114460519A (en) On-site and terminal fusion management system and method based on power transformer inspection
CN110211412A (en) Parking stall data processing method, system and equipment
CN113987001A (en) Rail transit signal system fault analysis method and device and electronic equipment
CN117037289A (en) Personnel operation behavior recognition method and system based on machine vision
CN115913349B (en) Optical cable equipment abnormality positioning method and device, storage medium and terminal
CN115185792A (en) Fault hardware processing method, device and system
CN109405174A (en) A kind of fault message reports method and device for repairment
CN113434411A (en) TIAS function test method and system
CN105847978B (en) A kind of formation gathering method and system based on smart television
CN114861830A (en) Automatic fault diagnosis method for vehicle-mounted equipment of subway signal system
CN113989743A (en) Garbage overflow detection method, detection equipment and system
CN112819988A (en) Unmanned aerial vehicle power station intelligent inspection method and system based on 5G and network side server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination