CN110955739B - Plotting processing method, shared image plotting method, and plot reproducing method - Google Patents

Plotting processing method, shared image plotting method, and plot reproducing method Download PDF

Info

Publication number
CN110955739B
CN110955739B CN201910305269.3A CN201910305269A CN110955739B CN 110955739 B CN110955739 B CN 110955739B CN 201910305269 A CN201910305269 A CN 201910305269A CN 110955739 B CN110955739 B CN 110955739B
Authority
CN
China
Prior art keywords
information
plot
plotting
image
window
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910305269.3A
Other languages
Chinese (zh)
Other versions
CN110955739A (en
Inventor
谭登峰
其他发明人请求不公开姓名
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zen Ai Technology Co ltd
Original Assignee
Beijing Zen Ai Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zen Ai Technology Co ltd filed Critical Beijing Zen Ai Technology Co ltd
Priority to CN201910305269.3A priority Critical patent/CN110955739B/en
Publication of CN110955739A publication Critical patent/CN110955739A/en
Application granted granted Critical
Publication of CN110955739B publication Critical patent/CN110955739B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Abstract

The invention relates to a plotting processing method, which comprises the following steps: receiving images in a video stream from two or more signal sources; drawing images of two or more signal sources corresponding to the identifiers in each window, and plotting the images drawn in each window; storing all plotting information and scene information, wherein the scene information comprises window position information of each window and window signal information of each window, and the window signal information comprises a network flow address of each image; the plot information and scene information are adapted to be re-read to enable loading of images and loading of plots. The invention protects the plotting information from being exposed easily by a network or a dump storage tool, and also avoids the problems of bandwidth occupation on a network path between a plotting sender and a plotting receiver or low transmission efficiency and the like; images from multiple signal sources and plots on the images are shared to others in a convenient and efficient manner.

Description

Plotting processing method, shared image plotting method, and plot reproducing method
Technical Field
The present invention relates to an information processing method, and more particularly, to a plot processing method, a shared image plotting method, a plot reproducing method, and corresponding apparatuses, devices, and computer program products and computer-readable storage media.
Background
In the prior art, in order to share plotting information on a picture in real time, a screenshot operation needs to be performed first, plotting is performed on a screenshot, and then an object subjected to plotting is sent to another receiving party or a plotting sharing party on a network in a screenshot picture manner, for example, a QQ chat tool adopts the plotting sharing manner.
Due to network security problems, once the plotted picture flows to the network, the plotted picture is very easy to steal or peep by others, so that the related plotting information on the picture is completely leaked.
Also, since the pictures to be transmitted are shared for such plotting, the amount of high definition pictures with plotting information is large, which results in a high bandwidth occupation on the shared network path.
In addition, the prior art has not been able to share images and plots on images from multiple signal sources to others in a convenient and efficient manner.
Disclosure of Invention
In view of the above-described problems, the inventors propose a plot processing method, a shared image plotting method, a plot reproducing method, and corresponding apparatuses, devices, and computer program products and computer-readable storage media.
According to an embodiment of the plot processing method of the first aspect of the present invention, the plot processing method includes:
receiving images in a video stream from two or more signal sources; drawing images of two or more signal sources corresponding to the identifiers in each window, and plotting the images drawn in each window;
storing all plotting information and scene information, wherein the scene information comprises window position information of each window and window signal information of each window, and the window signal information comprises a network flow address of each image; the plot information and scene information are adapted to be re-read to enable loading of images and loading of plots.
According to some embodiments of the invention, the network flow address of the image comprises an rtsp flow address; the plotting information comprises line information, geometric shape information, flow chart information, marking information, character information and color information; the window signal information comprises a signal source name, a signal source resolution and a signal source IP address.
According to some embodiments of the present invention, storing all of the plot information and the scene information includes storing the plot information and the scene information in one file in a custom format, or includes storing the plot information and the scene information independently in two or more files.
According to some embodiments of the invention, the method comprises: and displaying the identifiers corresponding to the signal sources in a list mode, and drawing the images of the signal sources corresponding to the identifiers in each window by performing click operation or drag operation on the identifiers.
According to some embodiments of the invention, the method further comprises: before plotting an image, making an area containing the image enter an editable mode to be an editable area; the editable area is predefined to cover all windows for displaying the image or the area of one window or cover the full screen.
According to some embodiments of the invention, the method further comprises: the area of the image being plotted or after being plotted or before being plotted is subjected to screen capture operation to form a static screenshot for the operator to view for plotting.
An embodiment of a method of sharing image plots according to the second aspect of the present invention comprises:
the image plotting sender transmits the plotting information and the scene information saved according to the plotting processing method to an image plotting sharing party;
the image plotting sharing party reads the plotting information and the scene information, and performs plotting of an image and loading of the plotting according to the plotting information and the scene information.
According to some embodiments of the invention, the method further comprises: the transfer is realized by means of a network, and by means of various types of trans-storage media.
An embodiment of a plot rendering method according to the third aspect of the present invention, the method comprising:
reading the plotting information and the scene information saved in the plotting processing method, or reading the scene information and the plotting information transmitted according to the shared image plotting method, plotting each image in a corresponding window according to the scene information, and completing the loading of the plotting according to the plotting information.
According to some embodiments of the present invention, an image plot sharing party removes the plots loaded on the image by hiding or closing the plot layer to which the plots correspond.
An embodiment of an apparatus for plot processing according to the fourth aspect of the present invention, the apparatus comprising a memory and a processor, wherein the memory is to store executable program code; the processor is used for reading executable program codes stored in the memory to execute the plotting processing method.
An embodiment of the computer program product according to the fifth aspect of the present invention comprising instructions which, when run on a computer, cause the computer to perform the plot processing method or the plot rendering method.
By the invention, the plotting information can be effectively protected from being easily exposed to light by a network or a dump storage tool, and even if one of the plotting information and the sub-scene information is leaked, the substantial leakage of the plotting information can not be caused, because the light has the plotting information and does not know the specific plotting position, and the substantial significance of the plotting can not be understood by a third party. Further, in the related art, for example, the QQ chat tool, when sharing plot information in chat, it is necessary to implement transmission of a picture with a plot itself, and thus in addition to the aforementioned easy exposure of the plot, there are problems such as an occupation of bandwidth on a network path between a sender and a receiver related to transmission of the plot picture (especially when the plot information is complicated and the picture is super large), or low transmission efficiency. In addition, the invention also realizes that the images from a plurality of signal sources and the plotting on the images are shared to other people in a convenient and efficient way, so that the information interaction efficiency is greatly improved.
Drawings
Fig. 1 schematically shows a flowchart of a plot processing method according to a first embodiment of the present invention;
FIG. 2a schematically shows a computer screenshot taken when a plot processing method according to a first embodiment of the present invention is implemented on a computer;
FIG. 2b schematically shows a computer screenshot taken when the plotting processing method according to the first embodiment of the present invention is implemented on a computer, with the area where the overlay window is located in an editable mode;
fig. 3a schematically shows a flow chart of a plot processing method according to a second embodiment of the present invention;
FIG. 3b schematically shows a computer screenshot taken when a plot processing method according to a second embodiment of the present invention is implemented on a computer;
FIG. 4 is a schematic block diagram of one embodiment of a plot processing apparatus provided in accordance with yet another aspect of the present application;
FIG. 5 is a schematic diagram of an embodiment of a plot rendering apparatus provided in accordance with yet another aspect of the present application;
FIG. 6 is a schematic block diagram of an apparatus for plot processing according to one embodiment of the present invention;
fig. 7 is a schematic configuration diagram of an apparatus for plot reproduction according to an embodiment of the present invention.
Detailed Description
Throughout this application, references to network implementations are intended to encompass both wired and wireless network connections implemented through necessary firmware or software, such as switches, routers, and the like, as well as wired and wireless network connections implemented through some intermediary, such as servers or other computers. Furthermore, since the transmission of signals over a network (including encoding the signals into a video stream of a certain format, such as an rtsp stream, etc.) is well known, the encoding and transmission of this part will not be explained in detail in this application.
Fig. 1 schematically shows a flowchart of a plot processing method according to a first embodiment of the present invention.
A plot processing method according to a first embodiment of the present invention includes:
s1, receiving an image from a signal source, and drawing the image in a window;
s2, plotting the image;
s3, storing the plotting information and the sub-scene information; the sub-scene information comprises window position information and window signal information, the window signal information comprises a network stream address of the image, wherein the plot information and the sub-scene information are suitable to be re-read to enable loading of the image and loading of the plot.
This first embodiment is described in detail below.
The computer is connected with other signal sources through a network, and the signal sources can comprise computers, mobile phones, cameras and other devices.
The computer receives the video frame from the signal source and draws the image of the video frame on a window of the computer. In this process, the window may be formed at a different position and the image may be displayed in the window at a different position by the drag operation. In some cases, the server may be notified according to the scene information to send a windowing command to the local client (the computer), and the computer may then perform windowing in response to the command and draw an image within the window. The foregoing list of cases enables the image of the signal source to be finally drawn in the window, and is also within the scope of the present application. The computer then further plots the image drawn on the window in response to the customer's plotting operation, including drawing lines on the image, adding geometry diagrams, flow charts, annotating, adding text, coloring, etc., as shown schematically in FIG. 2a, and labels or buttons for plotting, arrows, drawing lines, graphics, saving labels or buttons, and possibly adding labels or buttons for screen recording, dismissing, clearing, etc.
For the plotted image, the computer saves the corresponding sub-scene information (or called node information) and the plotting information according to the saving operation (such as click saving) of the client. The sub-scene information includes window signal information and window position information. The window signal information includes a network stream address of the image. The plot information and the sub-scene information are adapted to be re-read to enable loading of the image (by network stream address in the window signal information of the sub-scene information) and loading of the plot on the image. The network flow address may comprise, for example, an rtsp flow address. According to the actual control requirement on the signal source and the control requirement on a plurality of images in one signal source or a plurality of images in a plurality of signal sources, the consideration of different screen resolutions and the like in the environment is implemented, and the window signal information can further comprise information such as a signal source name, a signal source resolution, a signal source IP address and the like. The window position information may include absolute position information and/or relative position information of the window in the display screen. The plotting information comprises line information, geometric shape information, flow chart information, marking information, character information and color information. Here, by way of example only, other plot information is within the scope of the present invention. Further, the computer may also update and save the sub-scene information in real time according to the generation, movement, enlargement, reduction, and the like of the window for displaying the image, and update and save the plot information in real time according to the generation of the plot.
In practice, since the resolution of the display screen displaying the image may be different, in order to facilitate the display of the plot information and the sub-scene information under each display screen, a coordinate transformation may be introduced, for example, when the save button is clicked, the above window position information and the plot information are subjected to relative position conversion, for example, conversion into corresponding information under a resolution of 1920 × 1080 (common display screen resolution), and at the same time, the converted information is written into a custom file, such as a json file, and the suffix of the file is changed into a custom format. Due to the fact that the user-defined format cannot be acquired by others in advance, the plotting information and the sub-scene information can be further effectively protected in the transmission process and the reloading and reading process, and the plotting information and the sub-scene information are prevented from being easily known by others; moreover, the plotting information and the sub-scene information have practical significance only when being used together, if other people only obtain one of the information, for example, the plotting information, which may be, for example, circle information, the practical significance of the circle cannot be known because other people cannot really know what content the circle is on, and therefore, in the present invention, if only one of the plotting information and the sub-scene information is accidentally obtained and read by other people, the real leakage of the plotting cannot be caused. Further, the plot information and the sub-scene information may be independently stored in two files, and may be read when the information is read. Further, in the related art, for example, the QQ chat tool, when sharing plot information in chat, it is necessary to implement transmission of a picture with a plot itself, and thus, in addition to easy exposure of the plot, there are problems of bandwidth occupation on a network path between a sender and a receiver, or low transmission efficiency, which are related to transmission of the plot picture (especially when the plot information is complicated and the picture is super large). The plotting process is stored into the plotting information and the sub-scene information (or the scene information below), so that the plotting image can be prevented from being directly transmitted between the plotting sharing party and the receiving party, and the problem of congestion or bandwidth occupation on a network path between the plotting sharing party and the receiving party is also avoided.
In addition, a start plotting button for starting the editable mode may be set in advance. For example, before the plotting, the computer may set the region where the image is located to an editable mode to be an editable region in accordance with the operation of the start plotting button (also referred to as an editing button) by the client; upon entering the editable mode, a mouse event is captured and interpreted as performing a plotting operation on the editable area. The editable area may also be predefined to cover the area in which the window for displaying the image is located (as shown in fig. 2 b) or to cover the full screen or only an area as large as the window. In addition, it is also possible to first cause the window to be displayed in full screen by a full screen button or shortcut, after the start plotting button is operated, the computer enters a full screen editable mode, and the plotting operation thereafter is made available on the entire screen. The computer may also save the image containing the plotting information at a certain time as an overall image (i.e., a screenshot) as additional reference data according to the operation of a screenshot saving operation button by the client.
Further, in some other embodiments, the computer may also cause the window or associated area to automatically enter an editable mode upon recognizing that the customer is clicking the plot button.
In some cases, if the image is a dynamic image changing in real time in a video stream from a signal source, when plotting the image, a screen capture operation may be started first to provide a static screenshot for an operator to view for plotting (i.e. a background image, which is convenient for the operator to know where the operator is plotting). Plot information and sub-scene information may be saved at the end of the plot, or as the plot progresses, as previously described. In addition, as an additional operation, according to actual needs, at a certain time in the plotting process or before the plotting is finished or performed, a screen capture operation may be performed on the plotted interface, and the image containing the plotting information or the initial image may be saved as an overall image (i.e., a screen capture) to be used as an additional reference. Taking a camera monitoring scene as an example, if a certain specific part in a monitoring picture is desired to be monitored, a certain specific area in a monitoring area can be circled at a certain initial time through plotting operation to plot, corresponding plotting information and sub-scene information are stored, and when a file containing the plotting information and the sub-scene information is reloaded later, a user can very conveniently notice the circled area and perform important monitoring on the circled area, so that tracking monitoring on the specific area in the monitoring area is realized. In addition, after the screenshot with the plotting information is saved as an image, the image can be used as a comparison reference to observe the change of the same area from the beginning to the current state.
Fig. 3a schematically shows a flow chart of a plot processing method according to a second embodiment of the present invention; fig. 3b schematically shows a computer screenshot obtained when a second embodiment of a plot processing method according to the present invention is implemented on a computer.
A plot processing method according to a second embodiment of the present invention includes:
s21, receiving images in the video stream from two or more signal sources;
s22, drawing two or more images of signal source corresponding to the mark in each window, and plotting the images drawn in each window;
s23, storing all plotting information and scene information, wherein the scene information comprises window position information of each window and window signal information of each window, and the window signal information comprises network flow addresses of each image; the plot information and scene information are adapted to be re-read to enable loading of images and loading of plots.
In this embodiment, the computer is connected to a plurality of signal sources, each of which may be arranged in an identified manner on one side of the screen, as shown in fig. 3b, wherein the plurality of signal sources are arranged in a sequence in the area of the display window near the left side in the manner of one frame image. In addition, a plurality of signal sources can be sequentially listed in the area close to the left of the display window in a manner of identification such as signal source name or IP address.
By predefining a command corresponding to the dragging operation, the identifier can be dragged and released at a certain position on a screen, so that the image of the signal source corresponding to the identifier is displayed on a window at the position; in addition, by defining the display position corresponding to each signal source in advance, a plurality of signal sources can be displayed on the window at the corresponding display position through clicking operation.
The computer may be responsive to a customer's plotting operation to sequentially plot each image drawn on each window, including drawing lines on the images, adding geometry diagrams, flow charts, annotating, adding text, coloring, and the like.
For the plotted image, the computer saves the corresponding plot information and scene information according to the saving operation of the client (for example, clicking a saving button). The scene information includes window signal information and window position information of all windows on which the image is drawn. The window signal information includes the network flow addresses of the images in all the windows, and according to the network flow addresses of the images, the computer can acquire the images corresponding to the network flow addresses again through the network. The plotting information and the scene information are adapted to be re-read to enable the acquisition and loading of the respective images (by network stream addresses in the window signal information of the scene information) and the loading of the plots on the respective images, i.e. to complete the plotting of the images.
In this embodiment, before the customer plots the images, the computer may put the regions where the respective images are located into the editable mode in advance according to the plotting action of the customer. Or, depending on the signal source, for example, especially when the signal source is a dynamic real-time changing signal source, a screenshot can be initiated to form a static screenshot for the operator to view for plotting. After plotting is finished, besides the aforementioned stored plotting information and scene information, the final picture with the plotting information can be subjected to screen capture in response to the operation of the client to obtain the screenshot.
The present embodiment is different from the foregoing embodiments mainly in that, in the present embodiment, when plotting images, plotting of images corresponding to a plurality of signal sources is involved, and window signal information and window position information corresponding to all images, and plot information are saved. As previously described. It will be apparent to those skilled in the art after reading this application that many of the foregoing descriptions of the first embodiment described with respect to fig. 1 and 2, and other embodiments mentioned herein, apply mutatis mutandis to the embodiment of fig. 3, for example, the network stream addresses of the images comprise respective rtsp stream addresses; the plotting information comprises line information, geometric shape information, flow chart information, marking information, character information and color information; the window signal information comprises a signal source name, a signal source resolution and a signal source IP address; storing the plotting information and the scene information in a custom format in one file, or independently storing the plotting information and the scene information in two or more files. In addition, a start plotting button for starting the editable mode may be set in advance. For example, before the plotting, the computer may cause the region in which the image is located to enter an editable mode to become an editable region in accordance with the operation of the start plotting button by the client; upon entering the editable mode, a mouse event is captured and interpreted as performing a plotting operation on the editable area. The editable area may also be predefined to cover all windows (as shown in fig. 3) for displaying the image or the area where one of the windows is located or cover the full screen, or the position and size of one or more of the windows may be determined according to actual conditions, and then the area where the one or more windows are located is set as the editable area. For the sake of brevity, further description will not be provided herein.
The present application further provides a method of shared image plotting, comprising: and the image plotting sender transmits the plotting information and the sub-scene information saved according to the plotting processing method to an image plotting sharing party, and the image plotting sharing party reads the plotting information and the sub-scene information and performs drawing of the image and loading of the plotting according to the plotting information and the sub-scene information.
According to yet another embodiment of the method of shared image plotting of the present application, the method comprises: and the image plotting sender transmits the plot information saved according to the plotting processing method and the scene information to an image plotting sharing party, and the image plotting sharing party reads the plotting information and the scene information and carries out drawing of each image and loading of plotting according to the plotting information and the scene information.
According to some embodiments of the present invention, in the aforementioned two method embodiments of shared image plotting, the transmitting may be implemented by way of a network, and the transmitting may be implemented by way of various dump storage media. The network mode includes downloading the plot information and/or sub-scene information (or scene information) through a network. The dump storage medium may be, for example, a flash memory, an optical disc, a magnetic disc, or a combination of two or more of these; a dump storage media may also include removable or non-removable media; the dump storage medium may be internal or external to the device; the storage medium may be a non-volatile solid-state memory, a read-only memory, an erasable prom (eprom), or a combination of two or more of these.
Yet another aspect of the present application also provides a plot rendering method. According to a first embodiment of a plot reproduction method, the method includes reading sub-scene information and plot information saved in the aforementioned image plot processing method, or reading sub-scene information and plot information transmitted according to the aforementioned shared image plot method, and drawing the image in a corresponding window according to the sub-scene information (i.e., according to a network stream address of an image or images in the sub-scene information, a computer may retrieve an image corresponding to each network stream address through a network and draw it in a corresponding window), and completing loading of the plot according to the plot information (i.e., completing the plot).
According to still another embodiment of a plot rendering method, the method comprises: reading scene information and plotting information saved by the plotting processing method, or reading scene information and plotting information transmitted according to the shared image plotting method, wherein the scene information comprises window position information of each window and window signal information of each window, and the window signal information comprises a network stream address of each image; loading the images within respective windows according to the scene information, and loading plots on respective images according to plot information. That is, network stream addresses of each image in the scene information are read, and images corresponding to the addresses are loaded into corresponding windows according to the network stream addresses; and loading the plot on the corresponding image.
The network flow address of the image comprises an rtsp flow address; the plotting information comprises line information, geometric shape information, flow chart information, marking information, character information and color information; the window signal information comprises a signal source name, a signal source resolution and a signal source IP address.
It is mentioned that the plotting information and the sub-scene information can be stored in a custom format in one file or in two files, where the reading and loading of the information takes place in a corresponding manner. Similarly, the plotting information and the scene information can be stored in a file in a custom format, or stored in two or more files, and the information is read and loaded in a corresponding manner when being read and loaded.
According to some embodiments of the present invention, the plotting reproduction method may further include, after the plotting is loaded, performing a screen capture operation on the area where the image is located to form a static screenshot for an operator to view for plotting, and although the plotting information and the image information are finally stored instead of a screenshot information, the screenshot facilitates a still image to be referred to when plotting, and particularly, when the image loaded according to the network stream address changes in real time, a still image is obtained to plot, which has a practical reference meaning. According to some embodiments of the present invention, after the plotting is loaded, the region where the image is located may enter an editable mode, so that the image may be further plotted.
According to some embodiments of the present invention, the plot reproduction method may further include, after the plot is loaded, removing the plot loaded on the image by hiding or closing a plot layer corresponding to the plot, for an operator to restart the plot on an image without a plot mark. According to some embodiments of the present invention, the data of the corresponding window can be directly cleared in the memory to clear the content of the related signal source. Alternatively, in the case where all signal sources are involved in establishing a connection through the server, the server may also be notified to execute a flush command to flush all signals or images.
Fig. 4 is a schematic structural diagram of an embodiment of a plot processing apparatus provided according to still another aspect of the present application, which includes an image drawing unit 41, a plotting unit 42, and a saving unit 43, as shown in fig. 4.
The image drawing unit 41 is used to draw an image of a video frame on one window of the computer. The plotting unit 42 is used for plotting the image drawn on the window, and the plotting includes drawing lines on the image, adding geometric structure diagrams, flow charts, labeling, adding characters, coloring and the like. The storage unit 43 is used for storing sub-scene information (or node information) and plotting information. The sub-scene information includes window signal information and window position information. The window signal information includes a network stream address of the image. And according to the network flow address of the image, the image corresponding to the network flow address can be obtained again through the network. The network flow address may comprise, for example, an rtsp flow address. The window signal information may further include information such as a signal source name, a signal source resolution, a signal source IP address, and the like. The window position information may include absolute position information and relative position information of the window in the display screen. The plotting information comprises line information, geometric shape information, flow chart information, marking information, character information and color information. Here, by way of example only, other plot information is within the scope of the present invention. Further, it is also possible to update and save the sub-scene information in real time in accordance with the generation, movement, enlargement, reduction, and the like of the window for displaying the image, and update and save the plot information in real time in accordance with the generation of the plot.
Since the resolutions of the display screens are different in practical applications, in order to facilitate the plotting to be reasonably displayed on different display screens, according to some embodiments of the present invention, the storing unit 43 may further include a scaling unit for performing relative position scaling on the above window position information and the plotting information, for example, to obtain the corresponding information at a resolution of 1920 × 1080 (the common display screen resolution). After that, the saving unit further writes the converted information into a custom file, such as a json file, and changes the suffix of the file into a custom format. Further, the plot information and the sub-scene information may be independently stored in two files, and may be read when the information is read.
Fig. 5 is a schematic structural diagram of an embodiment of a plot reproduction apparatus provided according to still another aspect of the present application, and as shown in fig. 5, the apparatus includes a reading unit 51 and a loading unit 54.
The reading unit 51 is configured to read sub-scene information (or scene information) and plot information saved in the aforementioned image plot processing method, or read sub-scene information (or scene information) and plot information transmitted according to the aforementioned shared image plot method. The loading unit 54 is configured to display the image in one window (or multiple windows) according to the sub-scene information (or scene information), and perform plotting on the image according to the plotting information. The plot information and the sub-scene information (or scene information) may be stored locally, acquired through a dump storage medium, or acquired through a network.
It will be understood by those skilled in the art that the details of the embodiments described above with respect to fig. 1-3 may be implemented by adding corresponding functions to the units described above with respect to fig. 4 and 5 or by adding new units, which will not be described herein again.
Fig. 6 is a schematic configuration diagram of an apparatus for plot processing according to an embodiment of the present invention. As shown in fig. 6, the apparatus 600 for plotting processing includes a processor 61, a memory 62, and a bus 63.
In some instances, the apparatus 600 for plot processing may also include an input device 601, an input port 602, an output port 603, and an output device 604. The input port 602, the processor 61, the memory 62, and the output port 603 are connected to each other via the bus 63, and the input device 601 and the output device 604 are connected to the bus 63 via the input port 602 and the output port 603, respectively, and further connected to other components of the apparatus 600 for plotting processing. It should be noted that the output interface and the input interface can also be represented by I/O interfaces.
The input device 601 receives input information from the outside, such as an input video stream or an input image from another signal source, or a keyboard input, and the input device 601 transmits the input information to the processor 61 through the input port 602; processor 61 processes or responds to input information based on computer-executable instructions stored in memory 62 to generate output information and stores the output information temporarily or permanently in memory 62, and then transmits the output information to output device 604 via output port 603; the output device 604 outputs output information to the outside of the device 600 as needed. The input information may include input video streams or input images from other signal sources or keyboard input or mouse input (such as a mouse click save command), and the output information includes sub-scene information and plot information, or includes scene information and plot information, and may also include information such as screenshots. The process of the processor 61 processing or responding to input information to generate output information based on computer executable instructions stored in the memory 62 can be understood in conjunction with the aforementioned plot processing method, that is, the details described in the foregoing description for the plot processing method are applicable here and will not be repeated here for the sake of brevity.
Fig. 7 is a schematic configuration diagram of an apparatus for plot reproduction according to an embodiment of the present invention. As shown in fig. 7, the apparatus 700 for plot reproduction includes a processor 71, a memory 72, and a bus 73.
In some examples, the apparatus for plot rendering 700 may also include an input device 701, an input port 702, an output port 703, and an output device 704. The input port 702, the processor 71, the memory 72, and the output port 703 are connected to each other via a bus 73, and the input device 701 and the output device 704 are connected to the bus 73 via the input port 702 and the output port 703, respectively, and further connected to other components of the apparatus 700 for plot reproduction. It should be noted that the output interface and the input interface can also be represented by I/O interfaces.
The input device 701 receives input information from the outside, such as plot information and sub-scene information, or plot information and scene information, and the input device 701 transmits the input information to the processor 71 through the input port 702; processor 71 processes or responds to input information based on computer-executable instructions stored in memory 72 to generate output information, and stores the output information temporarily or permanently in memory 72, and then transmits the output information to output device 604 via output port 704; the output device 604 outputs output information to the outside of the device 700 as needed. The output information is an image and a plot, or a plot mark, and the output information may further include a screenshot with the plot. The process of processing or responding to input information by processor 71 to generate output information based on computer-executable instructions stored in memory 72 may be understood in conjunction with the aforementioned plot rendering method, i.e., the details described above with respect to the plot rendering method apply here and, for the sake of brevity, are not repeated here.
The memories described above with reference to fig. 6 and 7 may be various types of memories, such as flash memory, optical disc, magnetic disc, or a combination of two or more of these, according to actual needs; removable or non-removable media may also be included; may be internal or external to the device; may be non-volatile solid-state memory, read-only memory, erasable prom (eprom), or a combination of two or more of these. The bus includes hardware, software, or both that couple the components of device 600 to each other or couple the components of device 700 to each other.
The present application also provides a computer-readable storage medium that may include instructions that, when executed on a computer, may cause the computer to perform the plot processing method or the plot reproduction method described above.
The present application also provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the plot processing method or the plot rendering method described above.
Through the embodiment of the invention, the plotting information can be effectively protected from being easily exposed by a network or a dump storage tool; moreover, even if one of the plot information and the sub-scene information is leaked, the substantial leakage of the plot information is not caused; in addition, the problems of bandwidth occupation or low transmission efficiency and the like on a network path between a plotting sender and a plotting receiver are avoided; the invention also makes the information exchange, transmission and sharing between signal sources more convenient and faster.

Claims (11)

1. A plot processing method, the method comprising:
receiving images in a video stream from two or more signal sources; drawing images of two or more signal sources corresponding to the identifiers in each window, and plotting the images drawn in each window;
storing all plotting information and scene information, wherein the scene information comprises window position information of each window and window signal information of each window, and the window signal information comprises a network flow address of each image; the plot information and scene information are adapted to be re-read to enable loading of images and loading of plots;
the plotting information comprises line information, geometric shape information, flow chart information, marking information, character information and color information;
saving all of the plot information and the scene information includes independently saving the plot information and the scene information in two or more files.
2. The plot processing method of claim 1, wherein the network flow address of the image comprises an rtsp flow address; the window signal information comprises a signal source name, a signal source resolution and a signal source IP address.
3. The plot processing method according to claim 1, comprising: and displaying the identifiers corresponding to the signal sources in a list mode, and drawing the images of the signal sources corresponding to the identifiers in each window by performing click operation or drag operation on the identifiers.
4. The plot processing method of claim 1, wherein the method further comprises: before plotting an image, making an area containing the image enter an editable mode to be an editable area; the editable area is predefined to cover all windows for displaying the image or the area where one window is located or cover the full screen; or according to the actual situation, the position and the size of one or more windows are determined, and then the area where the window or the windows are located is set as the editable area.
5. The plot processing method according to one of claims 1 to 4, wherein the method further includes: the area of the image being plotted or after being plotted or before being plotted is subjected to screen capture operation to form a static screenshot for the operator to view for plotting.
6. A method of shared image plotting, comprising:
an image plot sender transmits plot information and scene information saved by the plot processing method according to one of claims 1 to 5 to an image plot sharer;
the image plotting sharing party reads the plotting information and the scene information, and performs plotting of an image and loading of the plotting according to the plotting information and the scene information.
7. The method of shared image plotting of claim 6, comprising: the transfer is realized by means of a network, and by means of various types of trans-storage media.
8. A plot rendering method, the method comprising:
reading the plot information and the scene information saved in the plot processing method of one of claims 1 to 5, or reading the scene information and the plot information transmitted by the method of sharing image plots according to claim 6 or 7, drawing the respective images within the respective windows according to the scene information, and completing the loading of the plots according to the plot information.
9. The plot rendering method of claim 8, an image plot sharing party removing a plot loaded on an image by hiding or closing a plot layer to which the plot corresponds.
10. An apparatus for plot processing, the apparatus comprising a memory and a processor, wherein the memory is to store executable program code; the processor is configured to read executable program code stored in the memory to perform the plot processing method of one of claims 1 to 5.
11. A computer program product containing instructions for causing a computer to execute the plot processing method according to one of claims 1 to 5 or the plot rendering method according to one of claims 8 to 9 when the computer program product is run on a computer.
CN201910305269.3A 2019-04-16 2019-04-16 Plotting processing method, shared image plotting method, and plot reproducing method Active CN110955739B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910305269.3A CN110955739B (en) 2019-04-16 2019-04-16 Plotting processing method, shared image plotting method, and plot reproducing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910305269.3A CN110955739B (en) 2019-04-16 2019-04-16 Plotting processing method, shared image plotting method, and plot reproducing method

Publications (2)

Publication Number Publication Date
CN110955739A CN110955739A (en) 2020-04-03
CN110955739B true CN110955739B (en) 2020-07-03

Family

ID=69976162

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910305269.3A Active CN110955739B (en) 2019-04-16 2019-04-16 Plotting processing method, shared image plotting method, and plot reproducing method

Country Status (1)

Country Link
CN (1) CN110955739B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112037545B (en) * 2020-08-31 2022-05-17 腾讯科技(深圳)有限公司 Information management method, information management device, computer equipment and storage medium
CN112256372B (en) * 2020-10-20 2023-12-26 北京字跳网络技术有限公司 Information processing method and device and electronic equipment
CN115185435A (en) * 2021-09-30 2022-10-14 红科网安(武汉)科技有限公司 Method for controlling display of key drawing plotting special elements

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102207924A (en) * 2010-03-31 2011-10-05 卡西欧计算机株式会社 Information display apparatus and information display method
CN109144439A (en) * 2017-08-15 2019-01-04 北京仁光科技有限公司 More scene synchronous method, device, equipment and storage medium in screen plotting

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7324664B1 (en) * 2003-10-28 2008-01-29 Hewlett-Packard Development Company, L.P. Method of and system for determining angular orientation of an object
KR20080031595A (en) * 2006-10-04 2008-04-10 삼성전자주식회사 Apparatus and method for managing off-screen buffering
CN101393651A (en) * 2008-11-07 2009-03-25 北京航空航天大学 View field driving real-time shadow method
CN101976195B (en) * 2010-10-29 2014-03-19 中兴通讯股份有限公司 Method and device for setting user interface
CN102169506A (en) * 2011-05-17 2011-08-31 山东超越数控电子有限公司 Electronic map posture plotting design method based on Windows CE (consumer electronics)
CN104506621B (en) * 2014-12-24 2018-07-31 北京佳讯飞鸿电气股份有限公司 A method of remote guide is carried out using video labeling
CN106454199B (en) * 2016-10-31 2019-02-15 维沃移动通信有限公司 A kind of video communication method and mobile terminal

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102207924A (en) * 2010-03-31 2011-10-05 卡西欧计算机株式会社 Information display apparatus and information display method
CN109144439A (en) * 2017-08-15 2019-01-04 北京仁光科技有限公司 More scene synchronous method, device, equipment and storage medium in screen plotting

Also Published As

Publication number Publication date
CN110955739A (en) 2020-04-03

Similar Documents

Publication Publication Date Title
CN110955739B (en) Plotting processing method, shared image plotting method, and plot reproducing method
CN106572139B (en) Multi-terminal control method, terminal, server and system
KR101936839B1 (en) Method and apparatus for providing screenshot service on terminal device and storage medium and device
CN107357585B (en) Video acquisition method and device, video equipment and storage medium
EP3822757A1 (en) Method and apparatus for setting background of ui control
CN113368492A (en) Rendering method and device
CN108335342B (en) Method, apparatus and computer program product for multi-person drawing on a web browser
CN114430460A (en) Shooting method and device and electronic equipment
CN111435545B (en) Plotting processing method, shared image plotting method, and plot reproducing method
CN114691063A (en) Screen acquisition method, terminal and storage medium
CN111309221B (en) Page processing method, device and equipment
JP2021124896A (en) Information processing device and method
CN116723353A (en) Video monitoring area configuration method, system, device and readable storage medium
CN114003160B (en) Data visual display method, device, computer equipment and storage medium
JP2012133668A (en) Display device, screen image transfer method, and program
JP6708384B2 (en) Output control device, output control method, setting device, setting method, and program
JP2009188639A (en) Indication system, indication program, and indication device
CN112995711B (en) Frame segmentation and picture processing synthesis method and system for web front-end video
JP6362090B2 (en) How to display the preset position of the network camera
JP2014067311A (en) System, terminal device, and image acquisition method
CN117475039A (en) Data processing method, device, electronic equipment and storage medium
KR102599525B1 (en) Method, device and system for displaying screen by improving visibility of image of interest
CN117857513A (en) Interactive processing method and device for remote operation and maintenance, terminal equipment and storage medium
JP2017130892A (en) Information processing apparatus, information processing method, information processing system, and computer program
CN117354451A (en) Video picture editing method and device based on video call and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant