CN111083036B - Scene linkage method and scene linkage system - Google Patents
Scene linkage method and scene linkage system Download PDFInfo
- Publication number
- CN111083036B CN111083036B CN201910878188.2A CN201910878188A CN111083036B CN 111083036 B CN111083036 B CN 111083036B CN 201910878188 A CN201910878188 A CN 201910878188A CN 111083036 B CN111083036 B CN 111083036B
- Authority
- CN
- China
- Prior art keywords
- scene
- linkage
- client
- server
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/046—Interoperability with other network applications or services
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a scene linkage system.A first client of the system initiates a scene linkage request to a server; the method comprises the steps that a server obtains scene linkage information including a linkage scene ID and a linkage user list; the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client; if the second client agrees to linkage, corresponding feedback is sent to the server; the server searches a scene with a prestored scene ID under the name of the second client as the linkage scene ID and scene information corresponding to the scene and sends the scene information and a windowing command to the second client; the second client receives the scene information and the windowing command, windows correspondingly and draws an image; the method for the first client to initiate the scene linkage request to the server comprises the following steps: and the first client receives and analyzes the data sent by the sensor, and determines whether to initiate a scene linkage request according to an analysis result. The invention can intelligently and efficiently realize simultaneous interaction of multiple parties and save local storage space.
Description
Technical Field
The present invention relates to the field of data interaction, and in particular, to a method and a system for scene linkage, and a corresponding computer program product.
Background
With the development of science and technology, more and more occasions exist for users to perform data interaction through networks. The emergence of network communication tools such as Tencent QQ, WeChat and the like, users can communicate and transmit data with other users through a network at any time and any place.
However, the network communication tool as described above can only perform data interaction unilaterally and the interaction process involves only two interacting parties. In a daily office environment, the work is more and more complicated, and multiple parties often need to interact or respond simultaneously. The simple network communication work and the relatively passive interaction mode cannot meet the requirement of intelligent and efficient interaction for multiple people at the same time.
Disclosure of Invention
In order to solve the problems, the invention provides a scene linkage system and a scene linkage method.
The scene linkage system according to some embodiments of the invention comprises:
the system comprises at least two clients, a sensor and a server, wherein the at least two clients comprise a first client and a second client;
a first client initiates a scene linkage request to a server;
after receiving the scene linkage request data, the server acquires scene linkage information therein, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client in the linkage user list;
after a second client in the user list receives a scene linkage notification, a linkage request initiator ID and a linkage scene ID of the server, if scene linkage is agreed, the second client sends feedback of agreement linkage to the server;
the server searches a scene with a scene ID of the linkage scene ID and scene information corresponding to the scene, which is prestored in the server and is under the name of the second client, according to the feedback, and sends the scene information and a windowing command to the second client, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates;
the second client receives the scene information and the windowing command, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window;
the method for the first client to initiate the scene linkage request to the server comprises the following steps: and the first client receives and analyzes the data sent by the sensor, and determines whether to initiate a scene linkage request according to an analysis result.
According to some embodiments of the invention, the first client initiating the scene linkage request to the server comprises: and the first client receives and analyzes the change condition of the data sent by the sensor, and determines whether to initiate a scene linkage request according to the analysis result.
According to some embodiments of the invention, the sensor comprises an acoustic sensor, a light sensor, an electrical sensor, a force sensor, a thermal sensor or a composite sensor.
Scene linking systems according to further embodiments of the present invention include:
the system comprises at least two clients and a server, wherein the at least two clients comprise a first client and a second client;
a first client initiates a scene linkage request to a server;
after receiving the scene linkage request data, the server acquires scene linkage information therein, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client in the linkage user list;
after a second client in the user list receives a scene linkage notification, a linkage request initiator ID and a linkage scene ID of the server, if scene linkage is agreed, the second client sends feedback of agreement linkage to the server;
the server searches a scene with a scene ID of the linkage scene ID and scene information corresponding to the scene, which is prestored in the server and is under the name of the second client, according to the feedback, and sends the scene information and a windowing command to the second client, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates;
the second client receives the scene information and the windowing command, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window;
the method for the first client to initiate the scene linkage request to the server comprises the following steps: the first client side obtains data of a monitored object through a network, or data change conditions or alarm events triggered after the change conditions exceed risk levels to initiate a scene linkage request.
According to some embodiments of the present invention, the monitoring object includes the number of mobile phones, the number of vehicles, the distribution of people, the distribution of vehicles, the weather condition, and the public opinion condition in the hotspot area.
Scene linking systems according to still further embodiments of the invention include:
the system comprises at least two clients and a server, wherein the at least two clients comprise a first client and a second client;
a first client initiates a scene linkage request to a server;
after receiving the scene linkage request data, the server acquires scene linkage information therein, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client in the linkage user list;
after a second client in the user list receives a scene linkage notification, a linkage request initiator ID and a linkage scene ID of the server, if scene linkage is agreed, the second client sends feedback of agreement linkage to the server;
the server searches a scene with a scene ID of the linkage scene ID and scene information corresponding to the scene, which is prestored in the server and is under the name of the second client, according to the feedback, and sends the scene information and a windowing command to the second client, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates;
the second client receives the scene information and the windowing command, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window;
the method for the first client to initiate the scene linkage request to the server comprises the following steps: the first client side automatically initiates a scene linkage request at a fixed time; or initiate a scene linkage request at predetermined time intervals.
According to some embodiments of the present invention, the system of the previous embodiments further comprises at least two displays, each display connected to a respective client for displaying content on the client; or the system comprises a splicing controller, wherein the output end of each client is connected to each input end of the splicing controller, and the output end of the splicing controller is connected to one or more screens, so that the output of each client is displayed on the screens according to the output layout set in the splicing controller.
The invention also provides a scene linkage method based on the scene linkage system, which comprises the following steps:
a first client initiates a scene linkage request to a server;
after receiving the scene linkage request data, the server acquires scene linkage information therein, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client in the linkage user list;
after a second client in the user list receives a scene linkage notification, a linkage request initiator ID and a linkage scene ID of the server, if scene linkage is agreed, the second client sends feedback of agreement linkage to the server;
the server searches a scene with a scene ID of the linkage scene ID and scene information corresponding to the scene, which is prestored in the server and is under the name of the second client, according to the feedback, and sends the scene information and a windowing command to the second client, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates;
and the second client receives the scene information and the windowing command, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window. According to the invention, multi-party simultaneous interaction can be intelligently and efficiently realized according to various requirements, and each party of interaction can perform real-time rapid linkage sharing on a plurality of scenes or window layouts and the like according to the requirements, so that the interaction efficiency is greatly improved, and because a user of one party does not need to store all scenes and scene information which are possibly used locally in advance, the occupation of a local storage space is greatly saved.
Drawings
FIG. 1 is a schematic view of a scene linkage system according to an embodiment of the invention;
FIG. 2 is one of the client interface screen shots in a scene linkage system according to an embodiment of the invention;
FIG. 3 is one of the screenshots of a scene creation process in a scene linking system according to one embodiment of the invention;
FIG. 4 is one of the screenshots of the scene forming process in the scene linkage system according to one embodiment of the invention
Detailed Description
In order to facilitate understanding of the technical solution of the present invention, the embodiment of the present invention is described by taking a personal computer as an example. Those skilled in the art will appreciate that the devices in which the clients of the present invention are installed may be a variety of electronic devices including, but not limited to, personal computers, server computers, hand-held or laptop devices, mobile devices such as mobile telephones, Personal Digital Assistants (PDAs), media players, and the like, multiprocessor systems, consumer electronics, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
In addition, in the present application, for convenience of description, a first client and a second client are introduced, but the first client and the second client may be essentially replaced with each other in the description of the technical solution; the image signal source mentioned in the present application is intended to cover a device capable of providing an image including a client, the signal source including: a monitoring device (such as a camera) or a computer or other electronic device as previously described on which the client is installed. The client can log in through a password and a user name, and can also directly log in when no password is set.
Fig. 1 shows an embodiment of a scenario linkage system 1 according to a first aspect of the present application, which includes a plurality of clients 10, 11, 12, 13, 14, the clients 10, 11, 12, 13, 14 can be connected via a network, and each client 11, 12, 13, 14 is assigned a network IP address, such as IP0, IP1, IP2, IP3, and IP 4.
Those skilled in the art can understand that the number of the clients may be arbitrarily set according to the needs of the user, and may be more than the above 5, or may include only 2, without considering network throughput and other factors.
The network may include a Wi-fi network, a bluetooth network, a Private Area Network (PAN), a Local Area Network (LAN), a Wide Area Network (WAN), IEEE 802.1x, an intranet, the internet, an extranet, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), cdmaOne, CDMA2000, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), Integrated digital enhanced network (iDEN), WiMAX, LTE advanced, Mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private, such as a VPN.
The client software of the present invention may be installed in all of the clients 10-14.
The scene linkage system 1 further includes a server 2, and all the clients 10-14 on which the client software of the present invention is installed can communicate with the server 2.
Fig. 2 shows a screenshot of one of the clients when the scene linkage system proposed in the first aspect of the present application works, where the right side in the screenshot shows a scene of "plan six", and in this scene, images from three signal sources (or clients) are distributed in a right display area, and are respectively located above the left, above the right, and below the left in the right display area, and each signal source corresponds to one display window. According to actual needs, the image forming part of the scene may be an image from a monitoring device, and the monitoring device only serves as an image source provider. The picture above the left six-numbered pre-arranged plan text is a thumbnail of each display window on the right. According to the actual situation, the position, the size, the overlapping sequence and the like of the display window of each signal source on the right side can be adjusted through dragging operation, and the thumbnail on the left side is correspondingly zoomed and adjusted according to the change of each display window on the right side so as to reflect the layout of the display window on the right side in real time.
The scene linkage system 1 and the scene linkage method performed by the same are described in detail below with reference to fig. 1 and 2.
According to one embodiment of a method of scene linking according to the present invention, the method comprises;
s1, associating each scene ID and scene information to a corresponding user, wherein the scene information comprises each window ID in a scene, each window position in the scene, each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates.
According to some embodiments, the scene information may further include information of a window stacking order, a signal source resolution, and the like.
In some embodiments, associating each scene ID and scene information to a respective user comprises: receiving a scene ID, scene information and a scene forming request sent by a user, if the scene forming request is agreed, indicating the user to form a scene corresponding to the scene information, and storing the scene ID and the scene information under the user name; and if not, forbidding the user to form a scene. Thus, the server may participate in managing the formation and preservation process of the various scenes.
According to some embodiments, said associating each scene ID and scene information to a respective user comprises: and storing the corresponding scene ID and the scene information into the corresponding user name according to the scene ID, the scene information and the scene storage request sent by each user. For example, one of the users or the client thereof sends the scene ID of the "plan with six number" in fig. 2, the scene information corresponding to the scene ID, and the request for saving the scene to the server; the server responds to the scene storage request, stores the scene ID and the scene information corresponding to the scene ID into the user name, and is used for searching the scene ID and the corresponding scene information under the user name at any time.
More specifically, the client user may select a save scene by clicking the "save scene" button at the upper right of fig. 2, and input a scene ID (or a scene name) to be saved, for example, input "plan six". Subsequently, the scene ID is sent to the server along with scene information (three window IDs, three window positions and three window sizes) for the scene, which is stored in the database by the server.
In some embodiments, the corresponding window positions, sizes, and possibly the window stacking order (in the case of overlapping windows) for each scene ID may vary depending on the operation of each client. Therefore, in some embodiments, each client is configured to send scene information changing in real time under each scene ID to the server, and the server is configured to update the scene information therein according to the changed scene information under each scene ID sent in real time by each user, for example, update the changed window position, window size and window stacking order, which may include a window position, window size and window stacking order that may be newly opened.
In some embodiments, the server may also receive a scene ID, a scene information change (a change in window position, size, and the like), and a scene change request sent by the user, and if the scene change is granted, instruct the user to form a scene corresponding to the changed scene information, and store the scene ID and the changed scene information under the user name; and if not, prohibiting the user from changing the scene.
According to some embodiments, the associating one or more scene IDs and scene information to a plurality of users may be further implemented by: the server copies one or more scene IDs and scene information to each user name, and selects the same or different copy objects by copying, so that the scenes and the scene information owned by each user name can be the same or different.
In the naming process, each client can store and name the scenes to be stored according to the role positioning of the client, for example, two clients (set as a client and a client) which are the same fire-fighting unit can name two incompletely identical scenes related to fire handling as a 'fire scene 1', and the 'fire scene 1' to be stored by the client can comprise a fire-fighting equipment library picture, a personnel position picture and a fire scene picture; the 'fire scene 1' to be saved by the client B can comprise images of collapse of buildings at any time in a simulated fire scene and fire suppression indication images. Further, the aforementioned "fire scenario 1" of the clients a and b may each have three windows and two windows, respectively. That is, scenes named the same scene name or having the same scene ID in the respective clients may be substantially different, for example, their window contents may be different and the number of windows may be different.
S2, receiving scene linkage request data, and acquiring scene linkage information in the scene linkage request data, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
in this step, the user of the client triggers the linkage request button and sends linkage information associated with the linkage request to the server. The linkage information comprises a scene ID (linkage scene ID for short) to be linked and a user list (linkage user list for short) to be linked; and after receiving the linkage request data, the server analyzes the linkage request data to acquire scene linkage information in the linkage request data, and sends the linkage notification, the linkage request initiator ID and the linkage scene ID to the users in the user list according to a linkage user list contained in the linkage information. The server can also send the user list to each user at the same time, so that related users can know which users are required to be linked at the same time, or the user list is sent to a plurality of appointed users according to user permission or user requirements.
The linkage information may further include linkage time, which is time for the user to perform linkage. For example, in some security systems, it is necessary to monitor the safety of the road where the important person is driving in real time, and therefore, the cameras at different positions are continuously checked according to the position of the important person to confirm the safety of the surrounding environment. The two or three or more cameras at each position are supposed to be transmitted to the picture on the display to form a scene, the scenes at different positions can be displayed at different times or in a linkage manner by setting linkage time, and the time can be determined according to preset vehicle speed or estimated vehicle speed, so that automatic switching of scene monitoring is realized, or each linkage scene is displayed at each precise moment, and the informatization and automation degree is further improved.
S3, sending a scene linkage notification, a linkage request initiator ID and a linkage scene ID to the users in the linkage user list; and if the first user in the user list agrees to carry out scene linkage, searching a pre-stored matching scene ID matched with the linkage scene ID under the first user name and scene information corresponding to the matching scene ID according to the received feedback that the first user agrees to the scene linkage.
In this step, if a user in the list (assuming that the user is the first user) agrees to perform scene linkage, a feedback agreeing to the scene linkage is sent to the server, and the server receives the feedback and searches for a matching scene ID matching the linkage scene ID and scene information corresponding to the matching scene ID under the first username, which are pre-stored. The matching means that a certain condition set in advance is satisfied. Therefore, the matching scene ID and the linkage scene ID may have the same ID or different IDs. For example, if the linkage scene ID is "plan No. six", the matching scene ID may be "plan No. seven" if matching is defined in advance as a scene with a similar name; further, if the linkage scene ID is "fire plan", the matching scene ID may be the same "fire plan".
And S4, sending scene information corresponding to the matched scene and a windowing command to the first user so that the first user can window in corresponding size and draw corresponding images in each window according to the scene information at corresponding positions.
And after receiving scene information corresponding to the matched scene sent by the server, the first user draws a corresponding window and contents in the window according to the scene information at a corresponding position and in a corresponding size and stacking sequence so as to complete scene linkage. The client of the first user may draw a corresponding video network image within each window, for example, by decoding the RTSP streams of the signal sources of the respective windows.
Similarly, if the client where the first outdoor other user is located also accepts the linkage request, the same process is executed, that is, if the second user in the user list agrees to perform scene linkage, according to the received feedback that the second user agrees to the scene linkage, the server searches the pre-stored matching scene ID matching the linkage scene ID under the second user name and the scene information corresponding to the matching scene ID. And then sending scene information and a scene drawing command corresponding to the matched scene to the second user so that the second user can draw the matched scene according to the scene information corresponding to the matched scene.
As described above, the matching means that a certain preset corresponding relationship is satisfied, and the matching scene ID and the linkage scene ID may have the same ID or different IDs, so that, assuming that a first client requests linkage of the fire scene 1, the second client will finally present a scene that is the same as the fire scene 1 but whose actual scene is not completely the same as the first client, for example, a scene that is named as the fire scene 1 but includes a situation image in which each building in the fire scene may collapse at any time and a scene image indicating fire suppression are called, so as to perform beneficial information supplement or form picture splicing on the fire scene 1 of the first client. Of course, the second client may also eventually present exactly the same scene as the first client.
According to further embodiments of the scene linking methods of the present disclosure, the scene linking method may include;
s1, a server receives scene linkage request data and acquires scene linkage information in the scene linkage request data, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
the scene linkage request data can be sent to the server by a client through a network, or generated after a user logging in the server inputs a corresponding command.
The linkage information includes a scene ID to be linked (linkage scene ID for short) and a user list to be linked (linkage user list for short).
The linkage information may further include linkage time, which is time for the user to perform linkage. For example, in some security systems, it is necessary to monitor the safety of the road where the important person is driving in real time, and therefore, the cameras at different positions are continuously checked according to the position of the important person to confirm the safety of the surrounding environment. The two or three or more cameras at each position are supposed to be transmitted to the picture on the display to form a scene, the scenes at different positions can be displayed at different times or in a linkage manner by setting linkage time, and the time can be determined according to preset vehicle speed or estimated vehicle speed, so that automatic switching of scene monitoring is realized, or each linkage scene is displayed at each precise moment, and the informatization and automation degree is further improved.
And S2, the server sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to the users in the linkage user list.
And after receiving the linkage request data, the server analyzes the linkage request data to acquire scene linkage information in the linkage request data, and sends the linkage notification, the linkage request initiator ID and the linkage scene ID to the users in the user list according to a linkage user list contained in the linkage information. The server may also send the user list to each user simultaneously so that the relevant users know which users are simultaneously required to be linked.
And S3, if the first user in the user list agrees to carry out scene linkage, the server searches a scene with a scene ID under a prestored first user name as the linkage scene ID and scene information corresponding to the scene according to the received feedback that the first user agrees to the scene linkage, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates.
In this step, the server prestores the scene ID corresponding to each user name and the scene information under the ID, the prestoring may be completed through multiple ways, for example, may be completed through a network or a transfer storage medium, may be obtained from other cloud server data or sent by other users, and any way that can complete the establishment and storage of the scene ID corresponding to the user name and the corresponding relationship of the scene information under the ID is within the scope intended to be covered by the present invention, including the various ways listed in a) -e) described above with reference to fig. 1 and 2.
In this step, if a user in the list (assuming that the user is the first user) agrees to perform scene linkage, a feedback agreeing to the scene linkage is sent to the server, and the server receives the feedback and searches for a scene with the scene ID under the first user name as the linkage scene ID and scene information corresponding to the scene ID. For example, if the linkage scene ID is "six-number plan", the server searches for a scene and scene information thereof, which are prestored and of which the scene ID under the first username is also "six-number plan".
According to some embodiments, the scene information may further include a window stacking order and a signal source resolution.
And S4, sending the scene information and a windowing command to the first user so that the first user can window in corresponding size and draw corresponding images in each window according to the scene information at corresponding positions.
And after receiving scene information and a scene drawing command which are sent by the server and correspond to the matched scene, the first user draws a corresponding window and contents in the window according to the corresponding size and the stacking sequence of the scene information at the corresponding position so as to complete scene linkage. The client of the first user may draw a corresponding video network image in each window, for example, by decoding the RTSP stream of the signal source of each window.
In addition, those skilled in the art will appreciate that some of the details previously described with respect to FIGS. 1 and 2 are equally applicable here and will not be described in detail here.
According to further embodiments of the scene linking methods of the present disclosure, the scene linking method includes; the method comprises the steps that a server receives scene linkage request data and obtains scene linkage information in the scene linkage request data, wherein the scene linkage information comprises: linkage scene ID and linkage user list; the method comprises the steps that a server searches for a scene ID which is prestored under each linkage user list name and is a scene of the linkage scene ID and scene information corresponding to the scene, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates; and sending the scene information and a windowing command to the users in the linkage user list so that the users in the linkage user list can window in corresponding sizes and draw corresponding images in the windows according to the scene information at corresponding positions.
Different from the embodiment described above with reference to fig. 1 and 2, in the embodiment herein, after the server receives the linkage request data and analyzes the data information therein, each user does not need to make a selection, and directly searches a scene with a scene ID under the name of each linkage user list and scene information corresponding to the scene according to the linkage user list, and sends the scene information and a windowing command to the users in the linkage user list, so that the users in the linkage user list can window in a corresponding size and draw a corresponding image in each window according to the scene information at a corresponding position.
According to still further embodiments of the scene linking methods of the present invention, the scene linking method comprises: the method comprises the steps that a server receives scene linkage request data and obtains scene linkage information in the scene linkage request data, wherein the scene linkage information comprises: linkage scene ID and linkage user list; the server sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to the users in the linkage user list; if the server receives feedback that a first user in the users agrees to scene linkage, searching a scene with a scene ID under the first user name pre-stored in the server as the linkage scene ID and scene information corresponding to the scene, wherein the scene information comprises each window ID, each window position and each window size in the scene; and sending the scene information and a windowing command to the first user so that the first user can window in a corresponding size at a corresponding position according to the scene information.
Unlike the embodiments described above with respect to fig. 1 and 2, in the embodiments herein, the scene information includes each window ID, each window position, and each window size. Thus, in response to the linkage of the scenes, the scenes presented at the end user end include windows each at a different location and having a different size. The linkage here can realize the linkage of the layout of each window, and each user can draw the corresponding image into each window according to the requirement. According to the embodiment of the invention, the window layout can be conveniently called and shared, and interactive parties can conveniently check information by using the same window layout, especially in the field of engineering psychology, the arrangement of the window layout can influence the visual fatigue degree and the attention concentration degree of people, so that the interaction efficiency is controlled to a certain degree by sharing a reasonable layout.
In the foregoing embodiment, the present application proposes that a user of a client triggers a linkage request button to initiate a scene linkage request, and in addition, the present application also proposes that data of a sensor can be received by the client and analyzed, and whether to initiate a scene linkage request is determined according to an analysis result; or, the first client may receive data sent by the sensor and analyze a change condition of the data, and determine whether to initiate a scene linkage request according to an analysis result. The sensor comprises an acoustic sensor, an optical sensor, an electrical sensor, a force sensor, a thermal sensor, or a composite sensor. For example, the client acquires and analyzes data sent by a smoke alarm, a camera, an infrared correlation sensor, a temperature sensor, a humidity sensor, a sound sensor and the like which are connected, and according to analysis, if the phenomena of smoke exceeding standard, ultrahigh temperature or ultrahigh humidity and the like are found, a scene linkage request is immediately initiated, or if the phenomena of smoke concentration, continuously increased temperature or humidity value are found, a scene linkage request is immediately initiated.
According to some embodiments of the present invention, the initiating, by the first client, the scene linkage request to the server may further include: the first client side obtains data of a monitored object through a network, or data change conditions or alarm events triggered after the change conditions exceed risk levels to initiate a scene linkage request. The monitoring objects comprise the number of mobile phones, the number of vehicles, the distribution situation of people, the distribution situation of vehicles, the weather situation and the public opinion situation in the hotspot area.
According to some embodiments of the present invention, the initiating, by the first client, the scene linkage request to the server may further include: the first client side automatically initiates a scene linkage request at a fixed time; or initiate a scene linkage request at predetermined time intervals.
Fig. 3 and 4 show screenshots of one scene generation process that may be used in the multi-scene linking method of the present invention.
The following describes this process with reference to fig. 1 and fig. 2, the left area of the main interface is the images (therefore, a total of 4 frames) corresponding to 4 clients within the access authority range of the client 10, and here, it may also be a list of IP addresses of all the clients, for example, if the access authority of the client 10 is the clients 11-14, the displayed list is IP1, IP2, IP3, IP4 (as shown in fig. 4). In some embodiments, the list of IP addresses may also contain the client's 10 own IP address.
In some embodiments, if some or all of the clients within the access right range of the client 10 are not accessed into the server 2, the corresponding client identification positions in the list thereof may be presented in a gray inoperable state, which is convenient for the user to be clear to the operable clients.
The user of client 10 may operate on the left IP list, for example if the user wants to access the data of client 11 (set to IP2), a mouse click may be made at the location of IP2 in the list and an action is taken to drag IP2 into the right side of the main interface (where IP2 identifies that no real movement may occur); when the connection with 12 is established for the first time, the instruction corresponding to the aforementioned action is sent to the server 2, if the server agrees to perform the operation, including agreeing to display data of the window size display 11 corresponding to the drag operation at the position corresponding to the drag operation, the server 2 sends the instruction to the client 11, instructs the client 11 to send its data, for example, a desktop, to the client 10, and the client 10 then displays the desktop of the client 11 (assuming that the desktop of the client 11 is a map screen) on the right side in the main interface at the aforementioned position and display window size, as shown in the area on the right side in fig. 3. Similarly, the client 10 may issue a request to the server 2 to open multiple shared clients simultaneously, for example dragging the desktops of the clients 11-14 into the right. The desktop windows of the clients 11-14 may be displayed overlaid.
The above shows a scenario generation manner, that is, the server receives a scenario formation request and corresponding scenario information that are sent by a user (client 10) and require to form a certain scenario, and if the scenario formation request is granted, the user (client 10) is instructed to form a scenario corresponding to the scenario information; after the scene is generated, the server may store the scene ID and the scene information under the user name according to the scene storage request and the scene ID sent by the user, and as described in the foregoing embodiments with reference to fig. 1 and 2, the scene ID and the scene information are uploaded to the server to participate in scene linkage between the clients.
The present application further proposes a scene linkage system, as shown in fig. 1, a scene linkage system 1 according to an embodiment of the present invention includes: at least two clients, and a server; the at least two clients include a first client (e.g., client 10) and a second client 11; the first client and the second client are introduced only for convenience of description. A first client initiates a scene linkage request to a server 2; after receiving the scene linkage request data, the server acquires scene linkage information therein, wherein the scene linkage information comprises: linkage scene ID and linkage user list; the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client in the linkage user list; after a second client in the user list receives a scene linkage notification, a linkage request initiator ID and a linkage scene ID of the server, if scene linkage is agreed, the second client sends feedback of agreement linkage to the server; the server searches a scene with a scene ID of the linkage scene ID and scene information corresponding to the scene, which is prestored in the server and is under the name of the second client, according to the feedback, and sends the scene information and a windowing command to the second client, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates; and the second client receives the scene information and the windowing command, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window.
In the system shown in FIG. 1, the system includes a plurality of displays, each display being connected to a respective client for displaying content on the client; alternatively, the system comprises a splice controller, the output of each client being connected to each input of the splice controller, the output of the splice controller being connected to one or more screens for displaying the output of each client on said screens in accordance with an output layout set in the splice controller, e.g. the content of clients 10-14 may be displayed on said screens sequentially from left to right.
According to some embodiments of the present invention, the first client may initiate a scene linkage request by acquiring, via a network, data of a monitored object, or a data change condition, or an alarm event triggered after the change condition exceeds a risk level. The monitoring objects comprise the number of mobile phones, the number of vehicles, the distribution situation of people, the distribution situation of vehicles, the weather situation and the public opinion situation in the hotspot area.
According to some embodiments of the invention, the first client may automatically initiate a scene linkage request at a fixed time; or initiate a scene linkage request at predetermined time intervals. According to some embodiments of the invention, the system can further comprise a sensor, and the application also provides that the data of the sensor can be received through the client, the data sent by the sensor is analyzed, and whether a scene linkage request is initiated or not is determined according to the analysis result; or, the first client may receive data sent by the sensor and analyze a change condition of the data, and determine whether to initiate a scene linkage request according to an analysis result. The sensor comprises an acoustic sensor, an optical sensor, an electrical sensor, a force sensor, a thermal sensor, or a composite sensor. For example, the client acquires and analyzes data sent by a smoke alarm, a camera, an infrared correlation sensor, a temperature sensor, a humidity sensor, a sound sensor and the like which are connected, and according to analysis, if the phenomena of smoke exceeding standard, ultrahigh temperature or ultrahigh humidity and the like are found, a scene linkage request is immediately initiated, or if the phenomena of smoke concentration, continuously increased temperature or humidity value are found, a scene linkage request is immediately initiated.
The various portions of the scene linkage system, including the server and client therein, have been referred to previously in describing the scene linkage method around FIGS. 1-4. The foregoing description of the server and client also applies here. For the sake of simplicity, no further description is provided herein.
The foregoing embodiments specifically describe the inventive concept of the present invention by taking a personal computer as an example of a client. It will be appreciated by those skilled in the art that the inventive concept of the present invention is not limited to data sharing between personal computers, and that any data of handheld or laptop computers, tablet computers, cellular phones, mobile devices, electronic devices, smart phones, smart televisions are within the scope of the present invention. Also in these embodiments, the clients 11-14 may act as clients 10, depending on the assigned rights.
The present application also provides a computer program product containing instructions which, when run on a computer, cause the computer to perform the above-described method of scene linking.
According to the embodiment of the invention, the interaction and sharing of scenes can be realized more quickly and conveniently at a plurality of clients, and in addition, all scene information can be stored on the server without being permanently reserved in the local, so that the local storage space can be greatly saved; moreover, as for one client, different scenes can be immediately acquired by sending a scene linkage request at any time, and the information acquisition and utilization capacity can be greatly improved.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (8)
1. A scene linkage system comprising:
the system comprises at least two clients, a sensor and a server, wherein the at least two clients comprise a first client and a second client;
a first client initiates a scene linkage request to a server;
after receiving the scene linkage request data, the server acquires scene linkage information therein, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client in the linkage user list;
after a second client in the user list receives a scene linkage notification, a linkage request initiator ID and a linkage scene ID of the server, if scene linkage is agreed, the second client sends feedback of agreement linkage to the server;
the server searches a scene with a scene ID of the linkage scene ID and scene information corresponding to the scene, which is prestored in the server and is under the name of the second client, according to the feedback, and sends the scene information and a windowing command to the second client, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates;
the second client receives the scene information and the windowing command, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window;
the method for the first client to initiate the scene linkage request to the server comprises the following steps: and the first client receives and analyzes the data sent by the sensor, and determines whether to initiate a scene linkage request according to an analysis result.
2. The scene linkage system according to claim 1, wherein the first client initiating a scene linkage request to a server comprises: and the first client receives the data sent by the sensor, analyzes the change condition of the data and determines whether to initiate a scene linkage request according to the analysis result.
3. The scene linkage system of claim 1, wherein the sensor comprises a sound sensor, a light sensor, an electrical sensor, a force sensor, a thermal sensor, or a composite sensor.
4. A scene linkage system comprising:
the system comprises at least two clients and a server, wherein the at least two clients comprise a first client and a second client;
a first client initiates a scene linkage request to a server;
after receiving the scene linkage request data, the server acquires scene linkage information therein, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client in the linkage user list;
after a second client in the user list receives a scene linkage notification, a linkage request initiator ID and a linkage scene ID of the server, if scene linkage is agreed, the second client sends feedback of agreement linkage to the server;
the server searches a scene with a scene ID of the linkage scene ID and scene information corresponding to the scene, which is prestored in the server and is under the name of the second client, according to the feedback, and sends the scene information and a windowing command to the second client, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates;
the second client receives the scene information and the windowing command, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window;
the method for the first client to initiate the scene linkage request to the server comprises the following steps: the first client side obtains data of a monitored object through a network, or data change conditions or alarm events triggered after the change conditions exceed risk levels to initiate a scene linkage request.
5. The scene linkage system according to claim 4, wherein the monitoring objects comprise the number of mobile phones, the number of vehicles, the distribution of people, the distribution of vehicles, the weather condition and the public opinion condition in the hotspot area.
6. A scene linkage system comprising:
the system comprises at least two clients and a server, wherein the at least two clients comprise a first client and a second client;
a first client initiates a scene linkage request to a server;
after receiving the scene linkage request data, the server acquires scene linkage information therein, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client in the linkage user list;
after a second client in the user list receives a scene linkage notification, a linkage request initiator ID and a linkage scene ID of the server, if scene linkage is agreed, the second client sends feedback of agreement linkage to the server;
the server searches a scene with a scene ID of the linkage scene ID and scene information corresponding to the scene, which is prestored in the server and is under the name of the second client, according to the feedback, and sends the scene information and a windowing command to the second client, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates;
the second client receives the scene information and the windowing command, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window;
the method for the first client to initiate the scene linkage request to the server comprises the following steps: the first client side automatically initiates a scene linkage request at a fixed time; or initiate a scene linkage request at predetermined time intervals.
7. The system of any one of claims 1 to 6, wherein the system comprises at least two displays, each display being connected to a respective client for displaying content on the client; or the system comprises a splicing controller, wherein the output end of each client is connected to each input end of the splicing controller, and the output end of the splicing controller is connected to one or more screens, so that the output of each client is displayed on the screens according to the output layout set in the splicing controller.
8. The scene linkage method of the scene linkage system according to claims 1 to 7, comprising:
a first client initiates a scene linkage request to a server;
after receiving the scene linkage request data, the server acquires scene linkage information therein, wherein the scene linkage information comprises: linkage scene ID and linkage user list;
the server then sends a scene linkage notification, a linkage request initiator ID and a linkage scene ID to each client in the linkage user list;
after a second client in the user list receives a scene linkage notification, a linkage request initiator ID and a linkage scene ID of the server, if scene linkage is agreed, the second client sends feedback of agreement linkage to the server;
the server searches a scene with a scene ID of the linkage scene ID and scene information corresponding to the scene, which is prestored in the server and is under the name of the second client, according to the feedback, and sends the scene information and a windowing command to the second client, wherein the scene information comprises each window ID, each window position and each window size in the scene, a video stream address of an image to be displayed in each window, and an IP address and a port number of a signal source from which the image originates;
and the second client receives the scene information and the windowing command, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910878188.2A CN111083036B (en) | 2019-09-17 | 2019-09-17 | Scene linkage method and scene linkage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910878188.2A CN111083036B (en) | 2019-09-17 | 2019-09-17 | Scene linkage method and scene linkage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111083036A CN111083036A (en) | 2020-04-28 |
| CN111083036B true CN111083036B (en) | 2020-09-11 |
Family
ID=70310227
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910878188.2A Active CN111083036B (en) | 2019-09-17 | 2019-09-17 | Scene linkage method and scene linkage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111083036B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112907134B (en) * | 2021-03-26 | 2024-04-19 | 北京赛博云睿智能科技有限公司 | Man-machine visual interaction analysis and control system and method for different business scenes |
| CN115333807B (en) * | 2022-07-29 | 2023-04-07 | 北京联讯星烨科技有限公司 | Method and system for realizing cross-scene data security interaction |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104035647A (en) * | 2014-06-05 | 2014-09-10 | 合一网络技术(北京)有限公司 | Multi-screen linkage based page interactive display method and system |
| CN104184825A (en) * | 2014-09-05 | 2014-12-03 | 国家电网公司 | Mobile terminal control method based on splicing controller echo |
| CN206164723U (en) * | 2016-09-28 | 2017-05-10 | 天津泰达城市轨道投资发展有限公司 | Rail transit construction safety risk is synthesized and is monitored large -size screen monitors |
| CN106935180A (en) * | 2017-05-17 | 2017-07-07 | 南京巨鲨显示科技有限公司 | It is a kind of to control matrix so as to the implementation method for controlling display fast intelligent to open a window |
| CN109697043A (en) * | 2017-10-20 | 2019-04-30 | 北京仁光科技有限公司 | Multi-screen interactive display methods, device, system and computer readable storage medium |
| CN109753208A (en) * | 2017-11-06 | 2019-05-14 | 北京仁光科技有限公司 | A kind of intelligent meeting method and intelligent meeting system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2014178659A (en) * | 2012-07-09 | 2014-09-25 | Ricoh Co Ltd | Screen control system, screen control device, information processing terminal, program and recording medium |
| CN107526560A (en) * | 2017-06-15 | 2017-12-29 | 北京仁光科技有限公司 | A kind of multi-screen touch-control linked system and its touch-control interlock method |
| CN107844285B (en) * | 2017-11-03 | 2020-09-08 | 中广热点云科技有限公司 | Large screen scene picture splicing display method |
| CN109408016A (en) * | 2018-10-09 | 2019-03-01 | 中天智领（北京）科技有限公司 | Signal operated control method and system |
-
2019
- 2019-09-17 CN CN201910878188.2A patent/CN111083036B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104035647A (en) * | 2014-06-05 | 2014-09-10 | 合一网络技术(北京)有限公司 | Multi-screen linkage based page interactive display method and system |
| CN104184825A (en) * | 2014-09-05 | 2014-12-03 | 国家电网公司 | Mobile terminal control method based on splicing controller echo |
| CN206164723U (en) * | 2016-09-28 | 2017-05-10 | 天津泰达城市轨道投资发展有限公司 | Rail transit construction safety risk is synthesized and is monitored large -size screen monitors |
| CN106935180A (en) * | 2017-05-17 | 2017-07-07 | 南京巨鲨显示科技有限公司 | It is a kind of to control matrix so as to the implementation method for controlling display fast intelligent to open a window |
| CN109697043A (en) * | 2017-10-20 | 2019-04-30 | 北京仁光科技有限公司 | Multi-screen interactive display methods, device, system and computer readable storage medium |
| CN109753208A (en) * | 2017-11-06 | 2019-05-14 | 北京仁光科技有限公司 | A kind of intelligent meeting method and intelligent meeting system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111083036A (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7263442B2 (en) | System and method for real-time remote control of mobile applications | |
| CN111049868B (en) | Data interaction system and data interaction method | |
| US20130019186A1 (en) | Managing privacy preferences in a web conference | |
| CN111083036B (en) | Scene linkage method and scene linkage system | |
| WO2015183045A1 (en) | Method and device for tagging chat message | |
| CN111049790B (en) | Data interaction method | |
| US10454976B2 (en) | Confidentiality-based file hosting | |
| CN115053517A (en) | Synchronizing local rooms and remote sharing | |
| US11977805B2 (en) | Systems and methods for displaying facility information | |
| CN110958479B (en) | Multi-signal-source scene on-screen display method and multi-signal-source scene on-screen display system | |
| WO2022111193A1 (en) | Meeting control method, apparatus, device, and medium | |
| US10681300B1 (en) | Split screen for video sharing | |
| CN110928506B (en) | Data interaction system and data interaction method | |
| US20200249902A1 (en) | Information processing system, information processing apparatus, and method of processing information | |
| CN111901219B (en) | Scene linkage method and scene linkage system | |
| JP2019128718A (en) | Program, document display control device, and document display control system | |
| Anumba et al. | Telepresence in concurrent lifecycle design and construction | |
| CN114884914A (en) | Application program same-screen communication method and system | |
| US20200210136A1 (en) | Content server, information sharing system, communication control method, and non-transitory computer-readable medium | |
| US20170168994A1 (en) | Method And Apparatus For Facilitating Visual Presentations | |
| CN115277273B (en) | Resource sharing method and resource sharing device | |
| Laurențiu-Bogdan et al. | Command and Control Systems for Video Sensors Communications Based on Python Application for Mobile Smart Devices | |
| EP3726381A1 (en) | Method and system for shared information browsing | |
| CN116974421A (en) | Desktop assembly operation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |