CN111143631A - Data processing method and device, storage medium and electronic equipment - Google Patents

Data processing method and device, storage medium and electronic equipment Download PDF

Info

Publication number
CN111143631A
CN111143631A CN201911268205.7A CN201911268205A CN111143631A CN 111143631 A CN111143631 A CN 111143631A CN 201911268205 A CN201911268205 A CN 201911268205A CN 111143631 A CN111143631 A CN 111143631A
Authority
CN
China
Prior art keywords
real
operation index
time video
data
index data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911268205.7A
Other languages
Chinese (zh)
Other versions
CN111143631B (en
Inventor
许力
贾璐
葛东
邢铁军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dongsoft Group Dalian Co ltd
Neusoft Corp
Original Assignee
Dongsoft Group Dalian Co ltd
Neusoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dongsoft Group Dalian Co ltd, Neusoft Corp filed Critical Dongsoft Group Dalian Co ltd
Priority to CN201911268205.7A priority Critical patent/CN111143631B/en
Publication of CN111143631A publication Critical patent/CN111143631A/en
Application granted granted Critical
Publication of CN111143631B publication Critical patent/CN111143631B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/90335Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7837Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/9038Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Library & Information Science (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present disclosure relates to a data processing method and apparatus, a storage medium, and an electronic device, wherein the method includes: acquiring a real-time video; determining the electronic equipment in the real-time video according to the display content of the real-time video; acquiring operation index data of the electronic equipment from a data monitoring platform; and overlaying the operation index data into the real-time video so as to display the operation index data of the electronic equipment in the real-time video.

Description

Data processing method and device, storage medium and electronic equipment
Technical Field
The present disclosure relates to the field of data monitoring, and in particular, to a data processing method and apparatus, a storage medium, and an electronic device.
Background
At present, the functions of electronic equipment are gradually improved, the electronic equipment completes the work such as manufacturing, processing, calculation, simulation and the like in many scenes such as factories, laboratories and the like, the running state, the running result and the like of the electronic equipment are required to be embodied by running index data, and at present, the running index data of each electronic equipment is automatically collected and summarized to a data monitoring platform under most conditions, so that the staff of the data monitoring platform can check the running state of the electronic equipment.
However, the operation index data of the electronic device under the scheme is not intuitive, and when the number of the electronic devices is too large, various data are mixed, so that inconvenience is caused for checking the operation index data.
Disclosure of Invention
An object of the present disclosure is to provide a data processing method and apparatus, a storage medium, and an electronic device, so as to solve the above technical problems.
In order to achieve the above object, a first aspect of the present disclosure provides a data processing method including: acquiring a real-time video; determining the electronic equipment in the real-time video according to the display content of the real-time video; acquiring operation index data of the electronic equipment from a data monitoring platform; and overlaying the operation index data into the real-time video so as to display the operation index data of the electronic equipment in the real-time video.
Optionally, the determining, according to the display content of the real-time video, the electronic device in the real-time video includes: extracting object features in the real-time video; determining the equipment number of the electronic equipment matched with the object characteristics from a characteristic resource library; the obtaining of the operation index data of the electronic device from the data monitoring platform includes: and acquiring operation index data corresponding to the equipment number and stored by the data monitoring platform according to the equipment number.
Optionally, the method further comprises: acquiring operation index data of the electronic equipment after the change, which is monitored by the data monitoring platform; and replacing the original operation index data with the changed operation index data, and overlapping the changed operation index data into the real-time video.
Optionally, when there are a plurality of the devices in the real-time video, the method further includes: establishing a data transmission channel for each electronic device; the acquiring of the operation index data of the changed electronic device monitored by the data monitoring platform includes: and acquiring the changed operation index data of the electronic equipment through the data transmission channel of the electronic equipment.
Optionally, the method further comprises: and displaying the real-time video after the operation index data is superposed.
Optionally, the acquiring the real-time video includes: acquiring a real-time video transmitted by a mobile terminal; after the overlaying the operational metric data into the real-time video, the method further comprises: and sending the real-time video superposed with the operation index data to the mobile terminal so that the mobile terminal displays the real-time video superposed with the operation index data.
Optionally, the mobile terminal includes a virtual reality VR wearable device, and the method further includes: acquiring indication information of a user, wherein the indication information comprises at least one of gesture indication information, voice indication information and eye action information; when the object indicated by the indication information is electronic equipment, displaying operation index data of the electronic equipment; and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which is of the same type as the operation index data.
In a second aspect of the present disclosure, a data processing apparatus is provided, which includes a video obtaining module, configured to obtain a real-time video; the equipment determining module is used for determining the electronic equipment in the real-time video according to the display content of the real-time video; the data acquisition module is used for acquiring the operation index data of the electronic equipment from the data monitoring platform; and the data superposition module is used for superposing the operation index data to the real-time video so as to display the operation index data of the electronic equipment in the real-time video.
Optionally, the device determining module is configured to extract object features in the real-time video; determining the equipment number of the electronic equipment matched with the object characteristics from a characteristic resource library; and the data acquisition module is used for acquiring the operation index data which is stored by the data monitoring platform and corresponds to the equipment number according to the equipment number.
Optionally, the apparatus further includes a data updating module, configured to obtain operation index data of the changed electronic device monitored by the data monitoring platform; and replacing the original operation index data with the changed operation index data, and overlapping the changed operation index data into the real-time video.
Optionally, the data updating module is further configured to establish a data transmission channel for each of the electronic devices; and acquiring the changed operation index data of the electronic equipment through the data transmission channel of the electronic equipment.
Optionally, the device further includes a video display module, configured to display the real-time video after the operation index data is superimposed.
Optionally, the video obtaining module is configured to obtain a real-time video sent by the mobile terminal; the device further comprises a video sending module, wherein the video sending module is used for sending the real-time video overlapped with the operation index data to the mobile terminal so that the mobile terminal displays the real-time video overlapped with the operation index data.
Optionally, the apparatus is applied to a virtual reality VR wearable device, and the apparatus further includes an indication obtaining module, configured to obtain indication information of a user, where the indication information includes at least one of gesture indication information, voice indication information, and eye movement information; the device also comprises an indication display module, a display module and a display module, wherein the indication display module is used for displaying the operation index data of the electronic equipment when the object indicated by the indication information is the electronic equipment; and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which is of the same type as the operation index data.
In a third aspect of the disclosure, a computer-readable storage medium is disclosed, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of the first aspect of the disclosure.
In a fourth aspect of the present disclosure, an electronic device is disclosed, comprising: a memory having a computer program stored thereon; a processor for executing the computer program in the memory to implement the steps of the method of any one of the first aspect of the present disclosure.
Through the technical scheme, the electronic equipment is determined from the acquired real-time video, the operation index data of the electronic equipment is acquired from the data monitoring platform, and the operation index data is superposed into the real-time video, so that the operation index data can be displayed in the real-time video and can be visually displayed in the visual field of a user, rather than the user searching for required data in numerous data, and the user can more visually and conveniently check the operation index data of the electronic equipment.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure without limiting the disclosure. In the drawings:
FIG. 1 is a flow chart illustrating a method of data processing according to an exemplary disclosed embodiment.
FIG. 2 is a schematic diagram illustrating the overlay of performance metric data to a real-time video according to an exemplary disclosed embodiment.
FIG. 3 is a flow chart illustrating a method of data processing according to an exemplary disclosed embodiment.
FIG. 4 is a block diagram illustrating a data processing apparatus according to an exemplary disclosed embodiment.
FIG. 5 is a block diagram illustrating an electronic device according to an exemplary disclosed embodiment.
Detailed Description
The following detailed description of specific embodiments of the present disclosure is provided in connection with the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating the present disclosure, are given by way of illustration and explanation only, not limitation.
First, an implementation scenario of the present disclosure will be explained. The method disclosed by the invention can be applied to mobile terminals, such as mobile phones, tablet computers, intelligent wearable devices and VR (Virtual Reality) devices, and can also be applied to other types of terminals with computing capability, such as computers and servers. In the disclosure, the data monitoring platform is in communication connection with the electronic device, and can periodically and actively acquire the operation index data of the electronic device from the monitored electronic device, and also can receive and store the operation index data uploaded by the electronic device. It should be noted that the data monitoring platform may be a console or a monitoring console with an entity display function, or may be a device with a data storage or transfer function.
FIG. 1 is a flow chart illustrating a method of data processing according to an exemplary disclosed embodiment. As shown in fig. 1, the method comprises the steps of:
and S11, acquiring the real-time video.
The real-time video refers to a real-time picture obtained by shooting by a camera or other terminals with shooting functions, and it is worth explaining that a certain time difference exists in video shooting, and under the condition that the display delay caused by the time difference does not affect the timeliness of the equipment state viewed by a user, the obtained video can be used as the real-time video in the disclosure.
The real-time video may be directly acquired by a device, a terminal, or an apparatus executing the method, or may be acquired by other devices and synchronized to the device, the terminal, or the apparatus executing the method, which is not limited in this embodiment.
S12, determining the electronic equipment in the real-time video according to the display content of the real-time video.
An identifier which can uniquely determine the identity of the electronic equipment, such as a two-dimensional code, a bar code, a digital code and the like, can exist on the electronic equipment, and the identity of the electronic equipment in the real-time video can be determined by analyzing information in the two-dimensional code, the bar code and the digital code.
When a plurality of electronic devices exist in the real-time video, the identities of all the electronic devices in the video can also be determined according to the identity of each electronic device.
In a possible implementation manner, the electronic device may not have the identifier, and the electronic device matching the object feature is determined from the feature resource library by extracting the object feature in the real-time video.
Generally speaking, different electronic devices are different in appearance, color, material, and the like, and by comparing the device characteristics of the electronic device in a video (or in a frame of a video) with the device characteristics pre-stored in the feature resource library, a matched electronic device can be determined from the feature resource library.
The characteristic resource library is a resource library pre-stored with object characteristics of various electronic devices, and the characteristic resource library can be stored in a device, a terminal or a device executing the method, and also can be stored in other devices in communication connection with the device, the terminal or the device executing the method so as to obtain information from the device, the terminal or the device in time.
In one possible implementation, the electronic device in the real-time video may also be identified by a pre-trained image recognition model.
In a possible implementation manner, determining the electronic device may refer to determining a device number of the electronic device, and by the device number, a single electronic device may be determined from a plurality of devices, which is also convenient for subsequently searching data of the electronic device.
And S13, acquiring the operation index data of the electronic equipment from the data monitoring platform.
The operation index data may include values such as a water inlet pressure value, a water outlet pressure value, an electrical conductivity, a water flow rate, a recovery rate, and the like for one water treatment device, and may include values such as a direct current voltage, a direct current power, an alternating current voltage, an alternating current power, a converted power, an internal temperature, an accumulated power generation amount, and the like for an inverter of one power station. That is, the operation index data herein is data that can be acquired from the electronic device and quantized.
The data monitoring platform can collect operation index data of a plurality of electronic devices, can be in one-to-one association with the electronic devices with pre-stored object characteristics in the characteristic resource library, and can directly acquire the operation index data associated with the electronic devices from the data monitoring platform when the electronic devices matched with the object characteristics in the characteristic resource library are identified in the real-time video.
In a possible implementation manner, the operation index data corresponding to the device number and stored by the data monitoring platform may be obtained according to the device number. For example, the feature resource library has object features of A, B, C, D four electronic devices with device numbers, respectively, and the object features in the real-time video match with the object features of the B electronic device, so that the operation index data of the B electronic device can be acquired from the data monitoring platform through the device number "B" of the electronic device.
And S14, overlaying the operation index data into the real-time video to display the operation index data of the electronic equipment in the real-time video.
The operation index data can be superimposed into the real-time video in any mode such as characters, line graphs and pie charts, and the operation index data displayed in the real-time video can be the operation index data at the current moment or all the operation index data within a preset time range.
The operation index data is visually superimposed into the real-time video, and different kinds of data can be displayed in different colors (for example, operation time related data is displayed in blue, power related data is displayed in green, and fault related data is displayed in red). Fig. 2 is a schematic diagram illustrating the operation index data superimposed on the real-time video, and as shown in fig. 2, the operation index data may be superimposed around the electronic device in the real-time video, such as in a manner of displaying around the electronic device 1 and the electronic device 2, and the operation status data related to a specific function may be displayed beside a function key or a function panel for controlling the electronic device to execute the function, so as to more intuitively display the data, such as in a manner of displaying around the electronic device 2. The position of the function key or the function panel for controlling the electronic device to execute the specific function can be prestored in the data monitoring platform or the feature resource library.
It should be noted that, a plurality of electronic devices may exist in a real-time video frame, and the operation status data of each electronic device may be displayed around the electronic device, so as to effectively distinguish the operation status data of the plurality of electronic devices.
In a possible implementation manner, the changed operation index data of the electronic device monitored by the data monitoring platform may be acquired, and the changed operation index data replaces the original operation index data and is superimposed on the real-time video.
The obtained changed operation index data may be actively sent by the data monitoring platform when the data changes, may be inquired to the data monitoring platform at regular time, and may also be updated synchronously with the data monitoring platform in real time, which is not limited by the present disclosure.
Preferably, a data transmission channel may be established for each electronic device, and the changed operation index data of the electronic device may be acquired through the data transmission channel of the electronic device. Therefore, the operation index data of each electronic device is transmitted through the respective special data transmission channel, so that the data updating is more orderly and timely, the data transmission channel can be also associated with the display area in which the operation index data are overlapped in the real-time video, the real-time data acquired through the data transmission channel is directly displayed in the display area, and the intuitiveness and the convenience of the method are further improved.
After the operation index data is superposed on the real-time video, the real-time video superposed with the operation index data can be displayed, and the real-time video can be sent to other terminals to be displayed by the other terminals. For example, a real-time video may be acquired from the VR device, and the operation index data is superimposed on the real-time video and then transmitted to the VR device, so that the VR device displays the real-time video on which the operation index data is superimposed.
In a possible implementation manner, when the terminal executing the method is a VR wearable device, the indication information of the user may also be obtained, where the indication information includes at least one of gesture indication information, voice indication information, and eye movement information; when the object indicated by the indication information is electronic equipment, displaying operation index data of the electronic equipment; and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which is of the same type as the operation index data.
For example, when the eye movement of the user points to one electronic device in the display field of the VR wearable device (for example, when the pupil direction of the user points to one electronic device), the operation index data of the electronic device may be highlighted (for example, display text is bold and highlighted, or display text is placed at the topmost layer or the middle of the display field, etc.), when the user clicks one type of operation index data, the same type of operation index data may be highlighted, and when the user clicks one operation index data, the historical operation index data of the index may be displayed in a centralized manner.
The user can also screen the operation index data needing to be displayed through gestures, voice, eye actions and the like, and can also control the working state of the electronic equipment through virtual keys associated with the electronic equipment. For example, when a user finds that one electronic device is abnormal in operation, the user can call out a virtual control panel of the electronic device through a predetermined gesture, and click a "stop work" virtual key through a gesture motion, and the VR device generates a control instruction for controlling the electronic device to stop working according to the gesture motion, and directly sends the control instruction to the electronic device or sends the control instruction to the electronic device through a data monitoring platform, so that the electronic device stops operating.
Through the technical scheme, the electronic equipment is determined from the acquired real-time video, the operation index data of the electronic equipment is acquired from the data monitoring platform, and the operation index data is superposed into the real-time video, so that the operation index data can be displayed in the real-time video and can be visually displayed in the visual field of a user, rather than the user searching for required data in numerous data, and the user can more visually and conveniently check the operation index data of the electronic equipment.
FIG. 3 is a flow chart illustrating a method of data processing according to an exemplary disclosed embodiment. As shown in fig. 3, the method comprises the steps of:
and S31, acquiring the real-time video transmitted by the mobile terminal.
The real-time video refers to a real-time picture obtained by shooting by a camera or other terminals with shooting functions, and it is worth explaining that a certain time difference exists in video shooting, and under the condition that the display delay caused by the time difference does not affect the timeliness of the equipment state viewed by a user, the obtained video can be used as the real-time video in the disclosure.
The mobile terminal can be a mobile phone, a tablet computer, intelligent wearable equipment, VR equipment and other terminals with video acquisition functions, and is in communication connection with the equipment, the terminal or the device executing the method.
S32, determining the electronic equipment in the real-time video according to the display content of the real-time video.
An identifier which can uniquely determine the identity of the electronic equipment, such as a two-dimensional code, a bar code, a digital code and the like, can exist on the electronic equipment, and the identity of the electronic equipment in the real-time video can be determined by analyzing information in the two-dimensional code, the bar code and the digital code.
When a plurality of electronic devices exist in the real-time video, the identities of all the electronic devices in the video can also be determined according to the identity of each electronic device.
In a possible implementation manner, the electronic device may not have the identifier, and the electronic device matching the object feature is determined from the feature resource library by extracting the object feature in the real-time video.
Generally speaking, different electronic devices are different in appearance, color, material, and the like, and by comparing the device characteristics of the electronic device in a video (or in a frame of a video) with the device characteristics pre-stored in the feature resource library, a matched electronic device can be determined from the feature resource library.
The characteristic resource library is a resource library pre-stored with object characteristics of various electronic devices, and the characteristic resource library can be stored in a device, a terminal or a device executing the method, and also can be stored in other devices in communication connection with the device, the terminal or the device executing the method so as to obtain information from the device, the terminal or the device in time.
In one possible implementation, the electronic device in the real-time video may also be identified by a pre-trained image recognition model.
In a possible implementation manner, determining the electronic device may refer to determining a device number of the electronic device, and by the device number, a single electronic device may be determined from a plurality of devices, which is also convenient for subsequently searching data of the electronic device.
And S33, acquiring the operation index data of the electronic equipment from the data monitoring platform.
The operation index data may include values such as a water inlet pressure value, a water outlet pressure value, an electrical conductivity, a water flow rate, a recovery rate, and the like for one water treatment device, and may include values such as a direct current voltage, a direct current power, an alternating current voltage, an alternating current power, a converted power, an internal temperature, an accumulated power generation amount, and the like for an inverter of one power station. That is, the operation index data herein is data that can be acquired from the electronic device and quantized.
The data monitoring platform can collect operation index data of a plurality of electronic devices, can be in one-to-one association with the electronic devices with pre-stored object characteristics in the characteristic resource library, and can directly acquire the operation index data associated with the electronic devices from the data monitoring platform when the electronic devices matched with the object characteristics in the characteristic resource library are identified in the real-time video.
In a possible implementation manner, the operation index data corresponding to the device number and stored by the data monitoring platform may be obtained according to the device number. For example, the feature resource library has object features of A, B, C, D four electronic devices with device numbers, respectively, and the object features in the real-time video match with the object features of the B electronic device, so that the operation index data of the B electronic device can be acquired from the data monitoring platform through the device number "B" of the electronic device.
And S34, overlaying the operation index data into the real-time video to display the operation index data of the electronic equipment in the real-time video.
The operation index data can be superimposed into the real-time video in any mode such as characters, line graphs and pie charts, and the operation index data displayed in the real-time video can be the operation index data at the current moment or all the operation index data within a preset time range.
The operation index data is visually superimposed into the real-time video, and different kinds of data can be displayed in different colors (for example, operation time related data is displayed in blue, power related data is displayed in green, and fault related data is displayed in red). Fig. 2 is a schematic diagram illustrating the operation index data superimposed on the real-time video, and as shown in fig. 2, the operation index data may be superimposed around the electronic device in the real-time video, such as in a manner of displaying around the electronic device 1 and the electronic device 2, and the operation status data related to a specific function may be displayed beside a function key or a function panel for controlling the electronic device to execute the function, so as to more intuitively display the data, such as in a manner of displaying around the electronic device 2. The position of the function key or the function panel for controlling the electronic device to execute the specific function can be prestored in the data monitoring platform or the feature resource library.
It should be noted that, a plurality of electronic devices may exist in a real-time video frame, and the operation status data of each electronic device may be displayed around the electronic device, so as to effectively distinguish the operation status data of the plurality of electronic devices.
In a possible implementation manner, the changed operation index data of the electronic device monitored by the data monitoring platform may be acquired, and the changed operation index data replaces the original operation index data and is superimposed on the real-time video.
The obtained changed operation index data may be actively sent by the data monitoring platform when the data changes, may be inquired to the data monitoring platform at regular time, and may also be updated synchronously with the data monitoring platform in real time, which is not limited by the present disclosure.
Preferably, a data transmission channel may be established for each electronic device, and the changed operation index data of the electronic device may be acquired through the data transmission channel of the electronic device. Therefore, the operation index data of each electronic device is transmitted through the respective special data transmission channel, so that the data updating is more orderly and timely, the data transmission channel can be also associated with the display area in which the operation index data are overlapped in the real-time video, the real-time data acquired through the data transmission channel is directly displayed in the display area, and the intuitiveness and the convenience of the method are further improved.
And S35, sending the real-time video superposed with the operation index data to the mobile terminal so that the mobile terminal displays the real-time video superposed with the operation index data.
After the operation index data is superimposed on the real-time video, the real-time video can be sent to other terminals and displayed by the other terminals. For example, a real-time video may be acquired from the VR device, and the operation index data is superimposed on the real-time video and then transmitted to the VR device, so that the VR device displays the real-time video on which the operation index data is superimposed.
Through the technical scheme, the electronic equipment is determined from the acquired real-time video, the operation index data of the electronic equipment is acquired from the data monitoring platform, and the operation index data is superposed into the real-time video, so that the operation index data can be displayed in the real-time video and can be visually displayed in the visual field of a user, rather than the user searching for required data in numerous data, and the user can more visually and conveniently check the operation index data of the electronic equipment.
FIG. 4 is a block diagram illustrating a data processing apparatus according to an exemplary disclosed embodiment. As shown in fig. 4, the apparatus 400 includes a video acquisition module 410, a device determination module 420, a data acquisition module 430, and a data superposition module 440.
The video obtaining module 410 is configured to obtain a real-time video.
And the device determining module 420 is configured to determine the electronic device in the real-time video according to the display content of the real-time video.
The data obtaining module 430 is configured to obtain operation index data of the electronic device from a data monitoring platform.
A data overlaying module 440, configured to overlay the operation index data into the real-time video, so as to display the operation index data of the electronic device in the real-time video.
Optionally, the device determining module is configured to extract object features in the real-time video; determining the equipment number of the electronic equipment matched with the object characteristics from a characteristic resource library; and the data acquisition module is used for acquiring the operation index data which is stored by the data monitoring platform and corresponds to the equipment number according to the equipment number.
Optionally, the apparatus further includes a data updating module, configured to obtain operation index data of the changed electronic device monitored by the data monitoring platform; and replacing the original operation index data with the changed operation index data, and overlapping the changed operation index data into the real-time video.
Optionally, the data updating module is further configured to establish a data transmission channel for each of the electronic devices; and acquiring the changed operation index data of the electronic equipment through the data transmission channel of the electronic equipment.
Optionally, the device further includes a video display module, configured to display the real-time video after the operation index data is superimposed.
Optionally, the video obtaining module is configured to obtain a real-time video sent by the mobile terminal; the device further comprises a video sending module, wherein the video sending module is used for sending the real-time video overlapped with the operation index data to the mobile terminal so that the mobile terminal displays the real-time video overlapped with the operation index data.
Optionally, the apparatus is applied to a virtual reality VR wearable device, and the apparatus further includes an indication obtaining module, configured to obtain indication information of a user, where the indication information includes at least one of gesture indication information, voice indication information, and eye movement information; the device also comprises an indication display module, a display module and a display module, wherein the indication display module is used for displaying the operation index data of the electronic equipment when the object indicated by the indication information is the electronic equipment; and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which is of the same type as the operation index data.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Through the technical scheme, the electronic equipment is determined from the acquired real-time video, the operation index data of the electronic equipment is acquired from the data monitoring platform, and the operation index data is superposed into the real-time video, so that the operation index data can be displayed in the real-time video and can be visually displayed in the visual field of a user, rather than the user searching for required data in numerous data, and the user can more visually and conveniently check the operation index data of the electronic equipment.
Fig. 5 is a block diagram illustrating an electronic device 500 in accordance with an example embodiment. As shown in fig. 5, the electronic device 500 may include: a processor 501 and a memory 502. The electronic device 500 may also include one or more of a multimedia component 503, an input/output (I/O) interface 504, and a communication component 505.
The processor 501 is configured to control the overall operation of the electronic device 500, so as to complete all or part of the steps in the data processing method. The memory 502 is used to store various types of data to support operations at the electronic device 500, such as instructions for any application or method operating on the electronic device 500 and application-related data. The Memory 502 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk or optical disk. The multimedia component 503 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may further be stored in the memory 502 or transmitted through the communication component 505. The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 504 provides an interface between the processor 501 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 505 is used for wired or wireless communication between the electronic device 500 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or a combination of one or more of them, which is not limited herein. The corresponding communication component 505 may thus comprise: Wi-Fi module, Bluetooth module, NFC module, etc.
In an exemplary embodiment, the electronic Device 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components for executing the above-mentioned data Processing method.
In another exemplary embodiment, there is also provided a computer readable storage medium comprising program instructions which, when executed by a processor, implement the steps of the data processing method described above. For example, the computer readable storage medium may be the memory 502 described above comprising program instructions that are executable by the processor 501 of the electronic device 500 to perform the data processing method described above.
The preferred embodiments of the present disclosure are described in detail with reference to the accompanying drawings, however, the present disclosure is not limited to the specific details of the above embodiments, and various simple modifications may be made to the technical solution of the present disclosure within the technical idea of the present disclosure, and these simple modifications all belong to the protection scope of the present disclosure.
It should be noted that, in the foregoing embodiments, various features described in the above embodiments may be combined in any suitable manner, and in order to avoid unnecessary repetition, various combinations that are possible in the present disclosure are not described again.
In addition, any combination of various embodiments of the present disclosure may be made, and the same should be considered as the disclosure of the present disclosure, as long as it does not depart from the spirit of the present disclosure.

Claims (10)

1. A method of data processing, the method comprising:
acquiring a real-time video;
determining the electronic equipment in the real-time video according to the display content of the real-time video;
acquiring operation index data of the electronic equipment from a data monitoring platform;
and overlaying the operation index data into the real-time video so as to display the operation index data of the electronic equipment in the real-time video.
2. The method of claim 1, wherein determining the electronic device in the real-time video according to the display content of the real-time video comprises:
extracting object features in the real-time video;
determining the equipment number of the electronic equipment matched with the object characteristics from a characteristic resource library;
the obtaining of the operation index data of the electronic device from the data monitoring platform includes:
and acquiring operation index data corresponding to the equipment number and stored by the data monitoring platform according to the equipment number.
3. The method of claim 1, further comprising:
acquiring operation index data of the electronic equipment after the change, which is monitored by the data monitoring platform;
and replacing the original operation index data with the changed operation index data, and overlapping the changed operation index data into the real-time video.
4. The method of claim 3, wherein when there are a plurality of said devices in said real-time video, said method further comprises:
establishing a data transmission channel for each electronic device;
the acquiring of the operation index data of the changed electronic device monitored by the data monitoring platform includes:
and acquiring the changed operation index data of the electronic equipment through the data transmission channel of the electronic equipment.
5. The method according to any one of claims 1-4, further comprising:
and displaying the real-time video after the operation index data is superposed.
6. The method of any one of claims 1-4, wherein said obtaining real-time video comprises:
acquiring a real-time video transmitted by a mobile terminal;
after the overlaying the operational metric data into the real-time video, the method further comprises:
and sending the real-time video superposed with the operation index data to the mobile terminal so that the mobile terminal displays the real-time video superposed with the operation index data.
7. The method of claim 5, applied to a Virtual Reality (VR) wearable device, further comprising:
acquiring indication information of a user, wherein the indication information comprises at least one of gesture indication information, voice indication information and eye action information;
when the object indicated by the indication information is electronic equipment, displaying operation index data of the electronic equipment;
and when the object indicated by the indication information is operation index data, displaying the operation index data of each electronic device, which is of the same type as the operation index data.
8. A data processing apparatus, characterized in that the apparatus comprises:
the video acquisition module is used for acquiring a real-time video;
the equipment determining module is used for determining the electronic equipment in the real-time video according to the display content of the real-time video;
the data acquisition module is used for acquiring the operation index data of the electronic equipment from the data monitoring platform;
and the data superposition module is used for superposing the operation index data to the real-time video so as to display the operation index data of the electronic equipment in the real-time video.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
10. An electronic device, comprising:
a memory having a computer program stored thereon;
a processor for executing the computer program in the memory to carry out the steps of the method of any one of claims 1 to 7.
CN201911268205.7A 2019-12-11 2019-12-11 Data processing method and device, storage medium and electronic equipment Active CN111143631B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911268205.7A CN111143631B (en) 2019-12-11 2019-12-11 Data processing method and device, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911268205.7A CN111143631B (en) 2019-12-11 2019-12-11 Data processing method and device, storage medium and electronic equipment

Publications (2)

Publication Number Publication Date
CN111143631A true CN111143631A (en) 2020-05-12
CN111143631B CN111143631B (en) 2023-09-15

Family

ID=70517959

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911268205.7A Active CN111143631B (en) 2019-12-11 2019-12-11 Data processing method and device, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN111143631B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111988573A (en) * 2020-08-27 2020-11-24 浙江中控技术股份有限公司 Industrial control information display method, device and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2989962A1 (en) * 2013-04-25 2016-03-02 Olympus Corporation Image sensor, imaging device, endoscope, endoscope system and driving method of image sensor
CN106154553A (en) * 2016-08-01 2016-11-23 全球能源互联网研究院 A kind of electric inspection process intelligent helmet Binocular displays system and its implementation
CN106875081A (en) * 2016-12-22 2017-06-20 国网浙江省电力公司杭州供电公司 A kind of enhancing virtual reality method for electricity substation
CN107333111A (en) * 2017-08-07 2017-11-07 国家电网公司 A kind of method of inspecting substation equipment, apparatus and system
CN110048509A (en) * 2019-04-22 2019-07-23 国网陕西省电力公司宝鸡供电公司 A kind of substation inspection system and method based on MR intelligent safety helmet

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2989962A1 (en) * 2013-04-25 2016-03-02 Olympus Corporation Image sensor, imaging device, endoscope, endoscope system and driving method of image sensor
CN106154553A (en) * 2016-08-01 2016-11-23 全球能源互联网研究院 A kind of electric inspection process intelligent helmet Binocular displays system and its implementation
CN106875081A (en) * 2016-12-22 2017-06-20 国网浙江省电力公司杭州供电公司 A kind of enhancing virtual reality method for electricity substation
CN107333111A (en) * 2017-08-07 2017-11-07 国家电网公司 A kind of method of inspecting substation equipment, apparatus and system
CN110048509A (en) * 2019-04-22 2019-07-23 国网陕西省电力公司宝鸡供电公司 A kind of substation inspection system and method based on MR intelligent safety helmet

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111988573A (en) * 2020-08-27 2020-11-24 浙江中控技术股份有限公司 Industrial control information display method, device and system

Also Published As

Publication number Publication date
CN111143631B (en) 2023-09-15

Similar Documents

Publication Publication Date Title
CN105824875B (en) A kind of photo be shared method and mobile terminal
CN110233742B (en) Group establishing method, system, terminal and server
CN110673769A (en) Information processing method and electronic equipment
CN103596027A (en) Method and device for retrieving keyboards under different scenes of intelligent television
CN104426990A (en) Control method and control device
CN112416200A (en) Display method, display device, electronic equipment and readable storage medium
CN112148168B (en) Icon moving method and device and electronic equipment
CN104427285B (en) A kind of prompt message generation method and device
CN111143631B (en) Data processing method and device, storage medium and electronic equipment
US20140215347A1 (en) Portable device and control method thereof
CN112286611B (en) Icon display method and device and electronic equipment
CN107911388B (en) Method and system for supervising mobile terminal application
CN103873943A (en) OSD (on-screen display) interaction interface display method and system, and terminals
CN103354089B (en) A kind of voice communication management method and device thereof
CN105573747A (en) User interface test method and apparatus
CN112416199A (en) Control method and device and electronic equipment
CN105611051A (en) Communication method and electronic device
CN116229188A (en) Image processing display method, classification model generation method and equipment thereof
CN113222337B (en) Remote vulnerability assessment method and device and storage medium
CN112099626B (en) Interface display method, interface display device and electronic equipment
KR20150042454A (en) Calling Apparatus and Method for Mobile
CN104423672B (en) Electronic equipment and its input method
CN103036978B (en) Data transmission set and method
CN104656881B (en) A kind of method and external input device of external input
CN105808239A (en) IT network management system construction method based on components and IT network management system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant