CN111143631B - Data processing method and device, storage medium and electronic equipment - Google Patents
Data processing method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN111143631B CN111143631B CN201911268205.7A CN201911268205A CN111143631B CN 111143631 B CN111143631 B CN 111143631B CN 201911268205 A CN201911268205 A CN 201911268205A CN 111143631 B CN111143631 B CN 111143631B
- Authority
- CN
- China
- Prior art keywords
- real
- data
- operation index
- index data
- time video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title abstract description 10
- 238000012544 monitoring process Methods 0.000 claims abstract description 49
- 238000000034 method Methods 0.000 claims abstract description 40
- 230000005540 biological transmission Effects 0.000 claims description 22
- 238000012545 processing Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 6
- 230000009471 action Effects 0.000 claims description 5
- 230000006870 function Effects 0.000 description 20
- 238000004891 communication Methods 0.000 description 12
- 230000008859 change Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 8
- 230000005236 sound signal Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000010248 power generation Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- KLDZYURQCUYZBL-UHFFFAOYSA-N 2-[3-[(2-hydroxyphenyl)methylideneamino]propyliminomethyl]phenol Chemical compound OC1=CC=CC=C1C=NCCCN=CC1=CC=CC=C1O KLDZYURQCUYZBL-UHFFFAOYSA-N 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 201000001098 delayed sleep phase syndrome Diseases 0.000 description 1
- 208000033921 delayed sleep phase type circadian rhythm sleep disease Diseases 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/90335—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/7837—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9038—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
- G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisions for transferring data to distant stations, e.g. from a sensing device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Library & Information Science (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure relates to a data processing method and device, a storage medium and an electronic device, wherein the method comprises the following steps: acquiring a real-time video; determining electronic equipment in the real-time video according to the display content of the real-time video; acquiring operation index data of the electronic equipment from a data monitoring platform; and overlaying the operation index data into the real-time video to display the operation index data of the electronic equipment in the real-time video.
Description
Technical Field
The present disclosure relates to the field of data monitoring, and in particular, to a data processing method and apparatus, a storage medium, and an electronic device.
Background
At present, the functions of the electronic devices are gradually perfected, the electronic devices are used for completing works such as manufacturing, processing, calculating and simulating in many scenes such as factories and laboratories, the running states and running results of the electronic devices are required to be reflected by running index data, and at present, the running index data of each electronic device are automatically collected and summarized to a data monitoring platform under most conditions, so that the staff of the data monitoring platform can check the running states of the electronic devices.
However, the operation index data of the electronic equipment is not visual enough under the scheme, and various data are mixed when the number of the electronic equipment is too large, so that inconvenience is caused for checking the operation index data.
Disclosure of Invention
The disclosure aims to provide a data processing method and device, a storage medium and an electronic device, so as to solve the technical problems.
To achieve the above object, a first aspect of the present disclosure provides a data processing method, including: acquiring a real-time video; determining electronic equipment in the real-time video according to the display content of the real-time video; acquiring operation index data of the electronic equipment from a data monitoring platform; and overlaying the operation index data into the real-time video to display the operation index data of the electronic equipment in the real-time video.
Optionally, the determining the electronic device in the real-time video according to the display content of the real-time video includes: extracting object features in the real-time video; determining the equipment number of the electronic equipment matched with the object feature from a feature resource library; the obtaining operation index data of the electronic equipment from the data monitoring platform comprises the following steps: and acquiring operation index data corresponding to the equipment number stored by the data monitoring platform according to the equipment number.
Optionally, the method further comprises: acquiring operation index data of the electronic equipment after the change, which is monitored by the data monitoring platform; and replacing the original operation index data with the changed operation index data, and overlapping the operation index data into the real-time video.
Optionally, when there are a plurality of the devices in the real-time video, the method further comprises: establishing a data transmission channel for each electronic device; the obtaining the operation index data of the electronic equipment after the change, which is monitored by the data monitoring platform, comprises the following steps: and acquiring the changed operation index data of the electronic equipment through the data transmission channel of the electronic equipment.
Optionally, the method further comprises: and displaying the real-time video after the operation index data are overlapped.
Optionally, the acquiring real-time video includes: acquiring a real-time video transmitted by a mobile terminal; after said superimposing said operation index data into said real-time video, said method further comprises: and sending the real-time video after the operation index data are overlapped to the mobile terminal so that the mobile terminal displays the real-time video after the operation index data are overlapped.
Optionally, the mobile terminal includes a virtual reality VR wearable device, and the method further includes: acquiring indication information of a user, wherein the indication information comprises at least one of gesture indication information, voice indication information and eye action information; when the object indicated by the indication information is an electronic device, displaying operation index data of the electronic device; and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which are the same as the operation index data.
In a second aspect of the present disclosure, a data processing apparatus is provided, including a video acquisition module configured to acquire real-time video; the device determining module is used for determining the electronic devices in the real-time video according to the display content of the real-time video; the data acquisition module is used for acquiring the operation index data of the electronic equipment from the data monitoring platform; and the data superposition module is used for superposing the operation index data into the real-time video so as to display the operation index data of the electronic equipment in the real-time video.
Optionally, the device determining module is configured to extract object features in the real-time video; determining the equipment number of the electronic equipment matched with the object feature from a feature resource library; the data acquisition module is used for acquiring the operation index data corresponding to the equipment number stored by the data monitoring platform according to the equipment number.
Optionally, the device further comprises a data updating module, which is used for acquiring the running index data of the electronic equipment after the change, which is monitored by the data monitoring platform; and replacing the original operation index data with the changed operation index data, and overlapping the operation index data into the real-time video.
Optionally, the data updating module is further configured to establish a data transmission channel for each of the device electronic devices; and acquiring the changed operation index data of the electronic equipment through the data transmission channel of the electronic equipment.
Optionally, the device further comprises a video display module, which is used for displaying the real-time video after the operation index data are overlapped.
Optionally, the video acquisition module is configured to acquire a real-time video sent by the mobile terminal; the device also comprises a video sending module which is used for sending the real-time video after the operation index data are overlapped to the mobile terminal so that the mobile terminal can display the real-time video after the operation index data are overlapped.
Optionally, the apparatus is applied to a virtual reality VR wearable device, and the apparatus further includes an instruction acquisition module configured to acquire instruction information of a user, where the instruction information includes at least one of gesture instruction information, voice instruction information, and eye motion information; the device also comprises an indication display module, a display module and a display module, wherein the indication display module is used for displaying the operation index data of the electronic equipment when the object indicated by the indication information is the electronic equipment; and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which are the same as the operation index data.
In a third aspect of the present disclosure, a computer readable storage medium is disclosed, having stored thereon a computer program which, when executed by a processor, implements the steps of the method according to any of the first aspects of the present disclosure.
In a fourth aspect of the present disclosure, an electronic device is disclosed, comprising: a memory having a computer program stored thereon; a processor for executing the computer program in the memory to implement the steps of the method of any one of the first aspects of the present disclosure.
According to the technical scheme, the electronic equipment is determined from the acquired real-time video, the operation index data of the electronic equipment is acquired from the data monitoring platform, and the operation index data is superimposed into the real-time video, so that the operation index data can be displayed in the real-time video, and is intuitively displayed in the field of view of a user, instead of the user searching for required data in a plurality of data by himself, and the user can intuitively and conveniently view the operation index data of the electronic equipment.
Additional features and advantages of the present disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification, illustrate the disclosure and together with the description serve to explain, but do not limit the disclosure. In the drawings:
FIG. 1 is a flow chart illustrating a method of data processing according to an exemplary disclosed embodiment.
FIG. 2 is a schematic diagram illustrating the superposition of operational metric data to real-time video according to an exemplary disclosed embodiment.
FIG. 3 is a flow chart illustrating a method of data processing according to an exemplary disclosed embodiment.
FIG. 4 is a block diagram of a data processing apparatus according to an exemplary disclosed embodiment.
Fig. 5 is a block diagram of an electronic device, according to an exemplary disclosed embodiment.
Detailed Description
Specific embodiments of the present disclosure are described in detail below with reference to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating and illustrating the disclosure, are not intended to limit the disclosure.
First, an implementation scenario of the present disclosure will be described. The method disclosed by the invention can be applied to mobile terminals, such as mobile phones, tablet computers, intelligent wearable devices and VR (Virtual Reality) devices, and can also be applied to other types of terminals with computing capability, such as computers, servers and the like. In the present disclosure, the data monitoring platform is in communication connection with the electronic device, and may periodically and actively obtain operation index data of the electronic device from the monitored electronic device, and may also receive and store operation index data uploaded by the electronic device. It should be noted that the data monitoring platform may be a console or a monitoring platform with an entity display function, or may be a device with a data storage or transfer function.
FIG. 1 is a flow chart illustrating a method of data processing according to an exemplary disclosed embodiment. As shown in fig. 1, the method comprises the steps of:
s11, acquiring real-time video.
The real-time video is a real-time picture shot by a camera or other terminals with shooting functions, and it is worth to be noted that, when a certain time difference exists in video shooting, and the display delay caused by the time difference does not affect the timeliness of the equipment state viewed by the user, the acquired video can be used as the real-time video in the disclosure.
The real-time video may be obtained directly from the apparatus, terminal or device performing the method, or may be obtained from other apparatuses and synchronized to the apparatus, terminal or device performing the method, which is not limited in this embodiment.
And S12, determining the electronic equipment in the real-time video according to the display content of the real-time video.
An identifier which can uniquely determine the identity of the electronic device, such as a two-dimensional code, a bar code, a digital code and the like, can exist on the electronic device, and the identity of the electronic device in the real-time video can be determined by analyzing information in the two-dimensional code, the bar code and the digital code.
When a plurality of electronic devices exist in the real-time video, the identities of all the electronic devices in the video can be determined according to the identification of each electronic device.
In one possible implementation, no identification may be present on the electronic device, but the electronic device matching the object feature is determined from a feature repository by extracting the object feature in the real-time video.
In general, different electronic devices are different in appearance, color, material, and the like, and by comparing device features of the electronic devices in a video (or in a frame of a video) with device features pre-stored in a feature resource library, a matched electronic device can be determined from the feature resource library.
The feature resource library is a resource library pre-stored with object features of various electronic devices, and can be stored in a device, a terminal or a device for executing the method, or can be stored in other devices in communication connection with the device, the terminal or the device for executing the method so as to acquire information from the device, the terminal or the device in time.
In one possible implementation, the electronic device in real-time video may also be identified by a pre-trained image recognition model.
In one possible implementation manner, determining the electronic device may refer to determining a device number of the electronic device, through which a single electronic device may be determined from a plurality of devices, and further, it is convenient to search data of the electronic device.
S13, acquiring operation index data of the electronic equipment from a data monitoring platform.
The operation index data refers to data capable of reflecting the operation state, the operation progress, the operation result and the like of the electronic equipment, for example, the operation index data can comprise electric quantity data, working time data, operation numerical value data, fault information data and the like, the operation index data can also comprise values of water inlet pressure value, water outlet pressure value, conductivity, water flow rate, recovery rate and the like for one water treatment equipment, and the operation index data can also comprise values of direct current voltage, direct current power, alternating current voltage, alternating current power, conversion power, built-in temperature, accumulated power generation quantity and the like for an inverter of one power station. That is, the operation index data here is data that can be acquired and quantized from the electronic device.
The data monitoring platform can collect the operation index data of a plurality of electronic devices, can be in one-to-one association with the electronic devices with pre-stored object features in the feature resource library, and can directly acquire the operation index data associated with the electronic devices from the data monitoring platform when the electronic devices matched with the object features in the feature resource library are identified in the real-time video.
In a possible implementation manner, the operation index data corresponding to the equipment number stored by the data monitoring platform can be obtained according to the equipment number. For example, the feature resource library has object features of four electronic devices with device numbers A, B, C, D, and the object features in the real-time video are matched with the object features of the B electronic device, so that the operation index data of the B electronic device can be obtained from the data monitoring platform through the device number "B" of the electronic device.
And S14, the operation index data are overlapped into the real-time video, so that the operation index data of the electronic equipment are displayed in the real-time video.
The operation index data can be superimposed into the real-time video in any mode such as characters, line diagrams, pie charts and the like, and the operation index data displayed in the real-time video can be the operation index data of the current moment or all the operation index data in a preset time range.
The operation index data is visually superimposed into the real-time video, and different kinds of data can be displayed differently by using different colors (for example, operation time related data is displayed in blue, electric quantity related data is displayed in green, and fault related data is displayed in red). Fig. 2 is a schematic diagram of superimposing operation index data on a real-time video, as shown in fig. 2, the operation index data may be superimposed around an electronic device in the real-time video, for example, the index data may be superimposed in a display manner around the electronic device 1 and the electronic device 2, and operation status data related to a specific function may be displayed near a function key or a function panel for controlling the electronic device to execute the function, for example, the data may be more intuitively displayed, for example, the index data may be superimposed in a display manner around the electronic device 2. The position of the function key or the function panel for controlling the electronic device to execute the specific function can be pre-stored in the data monitoring platform or the characteristic resource library.
It should be noted that, if there may be multiple electronic devices in one real-time video frame, the operation status data of each electronic device may be displayed around each electronic device, so as to effectively distinguish the operation status data of the multiple electronic devices.
In a possible implementation manner, the operation index data of the electronic device after the change, which is monitored by the data monitoring platform, may be obtained, and the operation index data after the change is replaced with the original operation index data and is superimposed into the real-time video.
The obtained changed operation index data may be actively sent by the data monitoring platform when the data is changed, or may be periodically queried for the data monitoring platform, or may be updated synchronously with the data monitoring platform in real time, which is not limited in the present disclosure.
Preferably, a data transmission channel may be established for each electronic device, and the operation index data after the change of the electronic device is obtained through the data transmission channel of the electronic device. Therefore, the operation index data of each electronic device are transmitted through the special data transmission channel, so that the data are updated orderly and timely, the data transmission channel can be associated with the display area of the superimposed operation index data in the real-time video, the real-time data acquired through the data transmission channel are directly displayed in the display area, and the intuitiveness and convenience of the method are further improved.
After the operation index data is superimposed on the real-time video, the real-time video on which the operation index data is superimposed may be displayed, or the real-time video may be transmitted to other terminals and displayed by the other terminals. For example, a real-time video may be obtained from the VR device, and the operation index data is superimposed on the real-time video and then sent to the VR device, so that the VR device displays the real-time video on which the operation index data is superimposed.
In a possible implementation manner, when the terminal executing the method is a VR wearable device, indication information of a user may also be obtained, where the indication information includes at least one of gesture indication information, voice indication information, and eye motion information; when the object indicated by the indication information is an electronic device, displaying operation index data of the electronic device; and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which are the same as the operation index data.
For example, when the eye motion of the user points to an electronic device in the VR wearable device display field of view (e.g., when the pupil direction of the user points to an electronic device), the operation index data of the electronic device may be highlighted (e.g., the display text is thickened, highlighted, or placed at the topmost layer or the middle of the display field of view, etc.), when the user clicks one type of operation index data, the operation index data of the same type of operation index data may be highlighted, and when the user clicks one operation index data, the historical operation index data of the index may also be centrally displayed.
The user can screen the operation index data to be displayed through gestures, voices, eye actions and the like, and can control the working state of the electronic equipment through virtual keys associated with the electronic equipment. For example, when a user finds that an electronic device is abnormal in operation, the user can call out a virtual control panel of the electronic device through a preset gesture, click a virtual key for stopping operation through a gesture action, and the VR device can generate a control instruction for controlling the electronic device to stop operation according to the gesture action, and send the control instruction to the electronic device directly or send the control instruction to the electronic device through a data monitoring platform, so that the electronic device stops operation.
According to the technical scheme, the electronic equipment is determined from the acquired real-time video, the operation index data of the electronic equipment is acquired from the data monitoring platform, and the operation index data is superimposed into the real-time video, so that the operation index data can be displayed in the real-time video, and is intuitively displayed in the field of view of a user, instead of the user searching for required data in a plurality of data by himself, and the user can intuitively and conveniently view the operation index data of the electronic equipment.
FIG. 3 is a flow chart illustrating a method of data processing according to an exemplary disclosed embodiment. As shown in fig. 3, the method comprises the steps of:
s31, acquiring real-time video sent by the mobile terminal.
The real-time video is a real-time picture shot by a camera or other terminals with shooting functions, and it is worth to be noted that, when a certain time difference exists in video shooting, and the display delay caused by the time difference does not affect the timeliness of the equipment state viewed by the user, the acquired video can be used as the real-time video in the disclosure.
The mobile terminal can be a terminal with a video acquisition function such as a mobile phone, a tablet personal computer, intelligent wearable equipment, VR equipment and the like, and is in communication connection with equipment, a terminal or a device for executing the method.
S32, determining the electronic equipment in the real-time video according to the display content of the real-time video.
An identifier which can uniquely determine the identity of the electronic device, such as a two-dimensional code, a bar code, a digital code and the like, can exist on the electronic device, and the identity of the electronic device in the real-time video can be determined by analyzing information in the two-dimensional code, the bar code and the digital code.
When a plurality of electronic devices exist in the real-time video, the identities of all the electronic devices in the video can be determined according to the identification of each electronic device.
In one possible implementation, no identification may be present on the electronic device, but the electronic device matching the object feature is determined from a feature repository by extracting the object feature in the real-time video.
In general, different electronic devices are different in appearance, color, material, and the like, and by comparing device features of the electronic devices in a video (or in a frame of a video) with device features pre-stored in a feature resource library, a matched electronic device can be determined from the feature resource library.
The feature resource library is a resource library pre-stored with object features of various electronic devices, and can be stored in a device, a terminal or a device for executing the method, or can be stored in other devices in communication connection with the device, the terminal or the device for executing the method so as to acquire information from the device, the terminal or the device in time.
In one possible implementation, the electronic device in real-time video may also be identified by a pre-trained image recognition model.
In one possible implementation manner, determining the electronic device may refer to determining a device number of the electronic device, through which a single electronic device may be determined from a plurality of devices, and further, it is convenient to search data of the electronic device.
S33, acquiring operation index data of the electronic equipment from a data monitoring platform.
The operation index data refers to data capable of reflecting the operation state, the operation progress, the operation result and the like of the electronic equipment, for example, the operation index data can comprise electric quantity data, working time data, operation numerical value data, fault information data and the like, the operation index data can also comprise values of water inlet pressure value, water outlet pressure value, conductivity, water flow rate, recovery rate and the like for one water treatment equipment, and the operation index data can also comprise values of direct current voltage, direct current power, alternating current voltage, alternating current power, conversion power, built-in temperature, accumulated power generation quantity and the like for an inverter of one power station. That is, the operation index data here is data that can be acquired and quantized from the electronic device.
The data monitoring platform can collect the operation index data of a plurality of electronic devices, can be in one-to-one association with the electronic devices with pre-stored object features in the feature resource library, and can directly acquire the operation index data associated with the electronic devices from the data monitoring platform when the electronic devices matched with the object features in the feature resource library are identified in the real-time video.
In a possible implementation manner, the operation index data corresponding to the equipment number stored by the data monitoring platform can be obtained according to the equipment number. For example, the feature resource library has object features of four electronic devices with device numbers A, B, C, D, and the object features in the real-time video are matched with the object features of the B electronic device, so that the operation index data of the B electronic device can be obtained from the data monitoring platform through the device number "B" of the electronic device.
And S34, the operation index data are overlapped into the real-time video, so that the operation index data of the electronic equipment are displayed in the real-time video.
The operation index data can be superimposed into the real-time video in any mode such as characters, line diagrams, pie charts and the like, and the operation index data displayed in the real-time video can be the operation index data of the current moment or all the operation index data in a preset time range.
The operation index data is visually superimposed into the real-time video, and different kinds of data can be displayed differently by using different colors (for example, operation time related data is displayed in blue, electric quantity related data is displayed in green, and fault related data is displayed in red). Fig. 2 is a schematic diagram of superimposing operation index data on a real-time video, as shown in fig. 2, the operation index data may be superimposed around an electronic device in the real-time video, for example, the index data may be superimposed in a display manner around the electronic device 1 and the electronic device 2, and operation status data related to a specific function may be displayed near a function key or a function panel for controlling the electronic device to execute the function, for example, the data may be more intuitively displayed, for example, the index data may be superimposed in a display manner around the electronic device 2. The position of the function key or the function panel for controlling the electronic device to execute the specific function can be pre-stored in the data monitoring platform or the characteristic resource library.
It should be noted that, if there may be multiple electronic devices in one real-time video frame, the operation status data of each electronic device may be displayed around each electronic device, so as to effectively distinguish the operation status data of the multiple electronic devices.
In a possible implementation manner, the operation index data of the electronic device after the change, which is monitored by the data monitoring platform, may be obtained, and the operation index data after the change is replaced with the original operation index data and is superimposed into the real-time video.
The obtained changed operation index data may be actively sent by the data monitoring platform when the data is changed, or may be periodically queried for the data monitoring platform, or may be updated synchronously with the data monitoring platform in real time, which is not limited in the present disclosure.
Preferably, a data transmission channel may be established for each electronic device, and the operation index data after the change of the electronic device is obtained through the data transmission channel of the electronic device. Therefore, the operation index data of each electronic device are transmitted through the special data transmission channel, so that the data are updated orderly and timely, the data transmission channel can be associated with the display area of the superimposed operation index data in the real-time video, the real-time data acquired through the data transmission channel are directly displayed in the display area, and the intuitiveness and convenience of the method are further improved.
And S35, sending the real-time video after the operation index data are overlapped to the mobile terminal so that the mobile terminal displays the real-time video after the operation index data are overlapped.
After the operation index data is superimposed on the real-time video, the real-time video may be transmitted to other terminals and displayed by the other terminals. For example, a real-time video may be obtained from the VR device, and the operation index data is superimposed on the real-time video and then sent to the VR device, so that the VR device displays the real-time video on which the operation index data is superimposed.
According to the technical scheme, the electronic equipment is determined from the acquired real-time video, the operation index data of the electronic equipment is acquired from the data monitoring platform, and the operation index data is superimposed into the real-time video, so that the operation index data can be displayed in the real-time video, and is intuitively displayed in the field of view of a user, instead of the user searching for required data in a plurality of data by himself, and the user can intuitively and conveniently view the operation index data of the electronic equipment.
FIG. 4 is a block diagram of a data processing apparatus according to an exemplary disclosed embodiment. As shown in fig. 4, the apparatus 400 includes a video acquisition module 410, a device determination module 420, a data acquisition module 430, and a data superposition module 440.
Wherein, the video acquisition module 410 is configured to acquire real-time video.
The device determining module 420 is configured to determine an electronic device in the real-time video according to the display content of the real-time video.
The data obtaining module 430 is configured to obtain operation index data of the electronic device from the data monitoring platform.
And the data superposition module 440 is configured to superimpose the operation index data onto the real-time video, so as to display the operation index data of the electronic device in the real-time video.
Optionally, the device determining module is configured to extract object features in the real-time video; determining the equipment number of the electronic equipment matched with the object feature from a feature resource library; the data acquisition module is used for acquiring the operation index data corresponding to the equipment number stored by the data monitoring platform according to the equipment number.
Optionally, the device further comprises a data updating module, which is used for acquiring the running index data of the electronic equipment after the change, which is monitored by the data monitoring platform; and replacing the original operation index data with the changed operation index data, and overlapping the operation index data into the real-time video.
Optionally, the data updating module is further configured to establish a data transmission channel for each of the device electronic devices; and acquiring the changed operation index data of the electronic equipment through the data transmission channel of the electronic equipment.
Optionally, the device further comprises a video display module, which is used for displaying the real-time video after the operation index data are overlapped.
Optionally, the video acquisition module is configured to acquire a real-time video sent by the mobile terminal; the device also comprises a video sending module which is used for sending the real-time video after the operation index data are overlapped to the mobile terminal so that the mobile terminal can display the real-time video after the operation index data are overlapped.
Optionally, the apparatus is applied to a virtual reality VR wearable device, and the apparatus further includes an instruction acquisition module configured to acquire instruction information of a user, where the instruction information includes at least one of gesture instruction information, voice instruction information, and eye motion information; the device also comprises an indication display module, a display module and a display module, wherein the indication display module is used for displaying the operation index data of the electronic equipment when the object indicated by the indication information is the electronic equipment; and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which are the same as the operation index data.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.
According to the technical scheme, the electronic equipment is determined from the acquired real-time video, the operation index data of the electronic equipment is acquired from the data monitoring platform, and the operation index data is superimposed into the real-time video, so that the operation index data can be displayed in the real-time video, and is intuitively displayed in the field of view of a user, instead of the user searching for required data in a plurality of data by himself, and the user can intuitively and conveniently view the operation index data of the electronic equipment.
Fig. 5 is a block diagram of an electronic device 500, according to an example embodiment. As shown in fig. 5, the electronic device 500 may include: a processor 501, a memory 502. The electronic device 500 may also include one or more of a multimedia component 503, an input/output (I/O) interface 504, and a communication component 505.
Wherein the processor 501 is configured to control the overall operation of the electronic device 500 to perform all or part of the steps of the data processing method described above. The memory 502 is used to store various types of data to support operation at the electronic device 500, which may include, for example, instructions for any application or method operating on the electronic device 500, as well as application-related data. The Memory 502 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as static random access Memory (Static Random Access Memory, SRAM for short), electrically erasable programmable Read-Only Memory (Electrically Erasable Programmable Read-Only Memory, EEPROM for short), erasable programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM for short), programmable Read-Only Memory (Programmable Read-Only Memory, PROM for short), read-Only Memory (ROM for short), magnetic Memory, flash Memory, magnetic disk, or optical disk. The multimedia component 503 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen, the audio component being for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may be further stored in the memory 502 or transmitted through the communication component 505. The audio assembly further comprises at least one speaker for outputting audio signals. The I/O interface 504 provides an interface between the processor 501 and other interface modules, which may be a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 505 is used for wired or wireless communication between the electronic device 500 and other devices. Wireless communication, such as Wi-Fi, bluetooth, near field communication (Near Field Communication, NFC for short), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or one or a combination of more of them, is not limited herein. The corresponding communication component 505 may thus comprise: wi-Fi module, bluetooth module, NFC module, etc.
In an exemplary embodiment, the electronic device 500 may be implemented by one or more application specific integrated circuits (Application Specific Integrated Circuit, abbreviated as ASIC), digital signal processors (Digital Signal Processor, abbreviated as DSP), digital signal processing devices (Digital Signal Processing Device, abbreviated as DSPD), programmable logic devices (Programmable Logic Device, abbreviated as PLD), field programmable gate arrays (Field Programmable Gate Array, abbreviated as FPGA), controllers, microcontrollers, microprocessors, or other electronic components for performing the data processing methods described above.
In another exemplary embodiment, a computer readable storage medium is also provided, comprising program instructions which, when executed by a processor, implement the steps of the data processing method described above. For example, the computer readable storage medium may be the memory 502 described above including program instructions executable by the processor 501 of the electronic device 500 to perform the data processing method described above.
The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the present disclosure is not limited to the specific details of the above embodiments, and various simple modifications may be made to the technical solutions of the present disclosure within the scope of the technical concept of the present disclosure, and all the simple modifications belong to the protection scope of the present disclosure.
In addition, the specific features described in the foregoing embodiments may be combined in any suitable manner, and in order to avoid unnecessary repetition, the present disclosure does not further describe various possible combinations.
Moreover, any combination between the various embodiments of the present disclosure is possible as long as it does not depart from the spirit of the present disclosure, which should also be construed as the disclosure of the present disclosure.
Claims (8)
1. A method of data processing, the method comprising:
acquiring a real-time video;
determining electronic equipment in the real-time video according to the display content of the real-time video;
acquiring operation index data of the electronic equipment from a data monitoring platform;
the operation index data are overlapped to the real-time video, so that the operation index data of the electronic equipment are displayed in the real-time video;
when there are a plurality of the devices in the real-time video, the method further comprises:
establishing a data transmission channel for each electronic device at a data output end of a data monitoring platform, wherein the data transmission channel is associated with a display area in the real-time video, on which the operation index data are superimposed;
acquiring the changed operation index data of the electronic equipment through the data transmission channel of the electronic equipment;
and replacing the original operation index data with the changed operation index data, and overlapping the operation index data into the real-time video.
2. The method of claim 1, wherein the determining the electronic device in the real-time video according to the display content of the real-time video comprises:
extracting object features in the real-time video;
determining the equipment number of the electronic equipment matched with the object feature from a feature resource library;
the obtaining operation index data of the electronic equipment from the data monitoring platform comprises the following steps:
and acquiring operation index data corresponding to the equipment number stored by the data monitoring platform according to the equipment number.
3. The method according to claim 1 or 2, characterized in that the method further comprises:
and displaying the real-time video after the operation index data are overlapped.
4. The method according to claim 1 or 2, wherein the acquiring real-time video comprises:
acquiring a real-time video transmitted by a mobile terminal;
after said superimposing said operation index data into said real-time video, said method further comprises:
and sending the real-time video after the operation index data are overlapped to the mobile terminal so that the mobile terminal displays the real-time video after the operation index data are overlapped.
5. The method of claim 3, wherein the method is applied to a virtual reality, VR, wearable device, the method further comprising:
acquiring indication information of a user, wherein the indication information comprises at least one of gesture indication information, voice indication information and eye action information;
when the object indicated by the indication information is an electronic device, displaying operation index data of the electronic device;
and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which are the same as the operation index data.
6. A data processing apparatus, the apparatus comprising:
the video acquisition module is used for acquiring real-time video;
the device determining module is used for determining the electronic devices in the real-time video according to the display content of the real-time video;
the data acquisition module is used for acquiring the operation index data of the electronic equipment from the data monitoring platform;
the data superposition module is used for superposing the operation index data into the real-time video so as to display the operation index data of the electronic equipment in the real-time video;
the apparatus further comprises:
the data updating module is used for establishing a data transmission channel for each electronic device at the data output end of the data monitoring platform, and the data transmission channel is associated with a display area in the real-time video, on which the operation index data are superimposed; acquiring the changed operation index data of the electronic equipment through the data transmission channel of the electronic equipment; and replacing the original operation index data with the changed operation index data, and overlapping the operation index data into the real-time video.
7. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the steps of the method according to any one of claims 1-5.
8. An electronic device, comprising:
a memory having a computer program stored thereon;
a processor for executing the computer program in the memory to implement the steps of the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911268205.7A CN111143631B (en) | 2019-12-11 | 2019-12-11 | Data processing method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911268205.7A CN111143631B (en) | 2019-12-11 | 2019-12-11 | Data processing method and device, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111143631A CN111143631A (en) | 2020-05-12 |
| CN111143631B true CN111143631B (en) | 2023-09-15 |
Family
ID=70517959
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911268205.7A Active CN111143631B (en) | 2019-12-11 | 2019-12-11 | Data processing method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111143631B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111988573A (en) * | 2020-08-27 | 2020-11-24 | 浙江中控技术股份有限公司 | Industrial control information display method, device and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2989962A1 (en) * | 2013-04-25 | 2016-03-02 | Olympus Corporation | Image sensor, imaging device, endoscope, endoscope system and driving method of image sensor |
| CN106154553A (en) * | 2016-08-01 | 2016-11-23 | 全球能源互联网研究院 | A kind of electric inspection process intelligent helmet Binocular displays system and its implementation |
| CN106875081A (en) * | 2016-12-22 | 2017-06-20 | 国网浙江省电力公司杭州供电公司 | A kind of enhancing virtual reality method for electricity substation |
| CN107333111A (en) * | 2017-08-07 | 2017-11-07 | 国家电网公司 | A kind of method of inspecting substation equipment, apparatus and system |
| CN110048509A (en) * | 2019-04-22 | 2019-07-23 | 国网陕西省电力公司宝鸡供电公司 | A kind of substation inspection system and method based on MR intelligent safety helmet |
-
2019
- 2019-12-11 CN CN201911268205.7A patent/CN111143631B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2989962A1 (en) * | 2013-04-25 | 2016-03-02 | Olympus Corporation | Image sensor, imaging device, endoscope, endoscope system and driving method of image sensor |
| CN106154553A (en) * | 2016-08-01 | 2016-11-23 | 全球能源互联网研究院 | A kind of electric inspection process intelligent helmet Binocular displays system and its implementation |
| CN106875081A (en) * | 2016-12-22 | 2017-06-20 | 国网浙江省电力公司杭州供电公司 | A kind of enhancing virtual reality method for electricity substation |
| CN107333111A (en) * | 2017-08-07 | 2017-11-07 | 国家电网公司 | A kind of method of inspecting substation equipment, apparatus and system |
| CN110048509A (en) * | 2019-04-22 | 2019-07-23 | 国网陕西省电力公司宝鸡供电公司 | A kind of substation inspection system and method based on MR intelligent safety helmet |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111143631A (en) | 2020-05-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108595137B (en) | Wireless screen projection method and device and screen projector | |
| CN105824875B (en) | A kind of photo be shared method and mobile terminal | |
| US20190051147A1 (en) | Remote control method, apparatus, terminal device, and computer readable storage medium | |
| KR20220133858A (en) | Task scheduling method and apparatus, electronic device, storage medium and program product | |
| CN110673769A (en) | Information processing method and electronic equipment | |
| CN108965611B (en) | Shooting interface switching method, device, equipment and storage medium | |
| CN110233742A (en) | A kind of group's method for building up, system, terminal and server | |
| CN111367402B (en) | Task triggering method, interaction equipment and computer equipment | |
| CN112016465A (en) | Scene recognition method, device and system | |
| CN108171222B (en) | Real-time video classification method and device based on multi-stream neural network | |
| CN110889544B (en) | Method and device for predicting operation indexes of power distribution network | |
| CN108205455B (en) | Application function implementation method and device and terminal | |
| CN111143631B (en) | Data processing method and device, storage medium and electronic equipment | |
| CN104427285B (en) | A kind of prompt message generation method and device | |
| CN115202599A (en) | Screen projection display method and related device | |
| CN111651106A (en) | Unread message prompting method, unread message prompting device, unread message prompting equipment and readable storage medium | |
| CN113347306B (en) | Business name display method and device, electronic equipment and storage medium | |
| CN105786321B (en) | A kind of function switching method and device | |
| CN105573747A (en) | User interface test method and apparatus | |
| CN110768843B (en) | Network problem analysis method, device, terminal and storage medium | |
| CN112286611A (en) | Icon display method and device and electronic equipment | |
| CN105611051A (en) | Communication method and electronic device | |
| CN113222337B (en) | Remote vulnerability assessment method and device and storage medium | |
| CN104423672B (en) | Electronic equipment and its input method | |
| CN107463471B (en) | Method and device for diagnosing terminal screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |