CN112148245B

CN112148245B - Method and device for monitoring, adjusting and projecting screen, computer equipment, readable storage medium and monitoring, adjusting and projecting screen interaction system

Info

Publication number: CN112148245B
Application number: CN202011346738.5A
Authority: CN
Inventors: 李凌; 陈锡华
Original assignee: Shenzhen Happycast Technology Co Ltd
Current assignee: Shenzhen Happycast Technology Co Ltd
Priority date: 2020-11-26
Filing date: 2020-11-26
Publication date: 2021-03-02
Anticipated expiration: 2040-11-26
Also published as: CN112148245A

Abstract

The invention relates to the technical field of screen projection, and discloses a method and a device for monitoring, adjusting and projecting a screen, computer equipment, a readable storage medium and a monitoring, adjusting and projecting screen interaction system. Through the content of the invention, the user equipment, the monitoring streaming media server and the streaming media presentation equipment which are in a local area network or a wide area network and respectively support the screen projection communication interface can request to return real-time monitoring streaming media data to the monitoring streaming media server and the camera equipment at any time, and play and display are carried out on the selected streaming media presentation equipment, so that the monitoring and watching can be greatly facilitated, the purpose of real-time large-screen watching can be realized, the interactivity and flexibility in the monitoring and watching process can be effectively improved, and the invention is convenient for practical application and popularization.

Description

Method and device for monitoring, adjusting and projecting screen, computer equipment, readable storage medium and monitoring, adjusting and projecting screen interaction system

Technical Field

The invention belongs to the technical field of screen projection, and particularly relates to a screen projection monitoring and adjusting method, a screen projection monitoring and adjusting device, computer equipment, a readable storage medium and a screen projection monitoring and adjusting interaction system.

Background

With the enhancement of safety consciousness, a video monitoring system slowly enters the working life of people, for example, a wide-area coverage monitoring network is formed by utilizing a large number of cameras arranged on small lanes of a street in the skynet project of China, so that the video monitoring system is a legal treasure for public security organs to fight against street crimes, and is a strong back shield for city public security. Although the video monitoring schemes are in a wide range at present, interactivity and flexibility in the monitoring process are weak, that is, when monitoring needs to be monitored, a user either goes to a monitoring room to monitor videos or copies the videos from the monitoring room and stores the videos in a mobile phone, a computer or a television for playing and displaying, so that great inconvenience is brought to monitoring and monitoring, the effect of large-screen monitoring in real time cannot be achieved, and interactivity and flexibility still need to be improved.

Disclosure of Invention

The invention aims to solve the problems of inconvenient adjustment and watching and incapability of performing large-screen adjustment and watching in real time in the existing monitoring and watching process, and provides a monitoring and watching screen-throwing method, a monitoring and watching screen-throwing device, computer equipment, a readable storage medium and a monitoring and watching screen-throwing interactive system.

In a first aspect, the present invention provides an information interaction process of a monitoring, adjusting and viewing screen projection method, including:

sending a monitoring and looking-adjusting request message carrying a target camera identification to a monitoring streaming media server by user equipment;

after receiving the monitoring and looking up request message, the monitoring streaming media server responds to the monitoring and looking up request message, searches for a local area network address of target camera equipment corresponding to the target camera identification, and returns a monitoring and looking up success message carrying a streaming media service request address to the user equipment, wherein the streaming media service request address comprises the local area network address of the target camera equipment;

after receiving the successful monitoring and watching message, the user equipment sends a streaming media request notification message carrying the streaming media service request address to the streaming media presentation equipment;

after receiving the streaming media request notification message, the streaming media presentation device sends a streaming media data request message to the monitoring streaming media server by using the streaming media service request address;

after receiving the streaming media data request message, the monitoring streaming media server forwards the streaming media data request message to the target camera equipment according to the local area network address in the streaming media service request address;

after receiving the streaming media data request message, the target camera equipment responds to the streaming media data request message and returns monitoring streaming media data to the monitoring streaming media server;

after receiving the returned monitoring streaming media data, the monitoring streaming media server forwards the returned monitoring streaming media data from the target camera equipment to the streaming media presentation equipment;

and receiving and displaying the monitoring streaming media data forwarded back by the monitoring streaming media server and coming from the target camera equipment by the streaming media presentation equipment.

Based on the content of the invention, the user equipment, the monitoring streaming media server and the streaming media presentation equipment which are in the local area network and respectively support the screen-casting communication interface can request to return real-time monitoring streaming media data to the monitoring streaming media server and the camera equipment at any time through information interaction among the user equipment, the monitoring streaming media server and the streaming media presentation equipment, and play and display are carried out on the selected streaming media presentation equipment, so that the monitoring and watching can be greatly facilitated, the purpose of real-time large-screen watching can be realized, the interactivity and flexibility in the monitoring and watching process are effectively improved, and the practical application and popularization are facilitated.

In one possible design, the monitoring, adjusting and viewing an information interaction process of the screen projection method further includes:

sending a service query request message to the monitoring streaming media server by the user equipment;

after receiving the service query request message, the monitoring streaming media server responds to the service query request message and returns a service query success message carrying at least one piece of monitoring and watching service information to the user equipment, wherein the monitoring and watching service information comprises a camera identification and camera equipment description information which is in one-to-one correspondence with the camera identification;

after receiving the service inquiry success message, the user equipment displays the at least one piece of monitoring and watching service information on a human-computer interaction interface;

and selecting the target camera identification from the at least one piece of monitoring and watching service information by the user equipment according to the operation instruction from the human-computer interaction interface, and generating the monitoring and watching request message.

Through the design, the camera equipment which can currently provide the monitoring streaming media data can be inquired from the monitoring streaming media server before the monitoring and watching request message is sent, and then the target camera equipment appointed by a user is determined through the display and operation of the human-computer interaction interface, so that the aim of accurately monitoring and watching can be fulfilled.

In a second aspect, the present invention provides another information interaction process for monitoring, adjusting and viewing a screen projection method, including:

after receiving the monitoring and looking up request message, the monitoring streaming media server responds to the monitoring and looking up request message, searches for a local area network address of target camera equipment corresponding to the target camera identification and a wide area network address of a corresponding local area network monitoring and dispatching host, and returns a monitoring and looking up success message carrying a streaming media service request address to the user equipment, wherein the streaming media service request address comprises the local area network address of the target camera equipment and the wide area network address of the local area network monitoring and dispatching host;

after receiving the streaming media data request message, the monitoring streaming media server forwards the streaming media data request message to the local area network monitoring and scheduling host according to the wide area network address in the streaming media service request address;

after receiving the streaming media data request message, the local area network monitoring and scheduling host forwards the streaming media data request message to the target camera equipment according to the local area network address in the streaming media service request address;

after receiving the streaming media data request message, the target camera equipment responds to the streaming media data request message and returns the monitored streaming media data to the local area network monitoring and dispatching host;

after receiving the returned monitoring streaming media data, the local area network monitoring and scheduling host forwards the returned monitoring streaming media data from the target camera equipment to the monitoring streaming media server

Based on the content of the invention, the user equipment, the monitoring streaming media server and the streaming media presentation equipment which are in the wide area network and respectively support the screen-casting communication interface can request to return real-time monitoring streaming media data to the monitoring streaming media server and the camera equipment at any time through information interaction among the user equipment, the monitoring streaming media server and the streaming media presentation equipment, and play and display are carried out on the selected streaming media presentation equipment, so that the monitoring and watching can be greatly facilitated, the purpose of real-time large-screen watching can be realized, the interactivity and flexibility in the monitoring and watching process are effectively improved, and the practical application and popularization are facilitated.

In a third aspect, the present invention provides a monitor, adjustment and projection screen device, which comprises a first sending unit, a first receiving unit and a second sending unit;

the first sending unit is configured to send a monitoring and tuning request message carrying a target camera identifier to a monitoring streaming media server, where the monitoring streaming media server is a local area network monitoring and tuning host connected to at least one camera device through a local area network communication or a wide area network monitoring cloud server connected to the local area network monitoring and tuning host through a wide area network communication, the monitoring and tuning request message is used to request the monitoring streaming media server to search for a local area network address of the target camera device corresponding to the target camera identifier in response to a request, and return a monitoring and tuning success message carrying a streaming media service request address, where the streaming media service request address includes the local area network address of the target camera device;

the first receiving unit is configured to receive the monitoring and watching success message returned by the monitoring streaming media server;

the second sending unit, communicatively connected to the first receiving unit, is configured to send a streaming media request notification message carrying the streaming media service request address to a streaming media presentation device, where the streaming media request notification message is used to notify the streaming media presentation device to request monitoring streaming media data from the monitoring streaming media server by using the streaming media service request address, so that the streaming media presentation device displays the monitoring streaming media data forwarded and returned by the monitoring streaming media server and from the target camera device.

In a possible design, the mobile terminal further comprises an information display unit which is in communication connection with the first receiving unit and a message generating unit which is in communication connection with the information display unit;

the first sending unit is further configured to send a service query request message to the monitoring streaming media server, where the service query request message is used to request the monitoring streaming media server to respond and return a service query success message carrying at least one piece of monitoring and watching service information, and the monitoring and watching service information includes a camera identifier and camera device description information corresponding to the camera identifier one to one;

the first receiving unit is further configured to receive the service query success message returned by the monitoring streaming media server;

the information display unit is used for displaying the at least one piece of monitoring and watching service information on a human-computer interaction interface;

and the message generating unit is used for selecting the target camera identification from the at least one piece of monitoring and watching service information according to the operation instruction from the human-computer interaction interface and generating the monitoring and watching request message.

In a fourth aspect, the present invention provides a computer device comprising a memory, a processor and a transceiver communicatively connected, wherein the memory is used for storing a computer program, the transceiver is used for transceiving a message, and the processor is used for reading the computer program and executing the steps as in any one of the possible designs of the first aspect, the first aspect or the second aspect and executed by a user device, a monitoring streaming media server or a streaming media rendering device.

In a fifth aspect, the present invention provides a readable storage medium having stored thereon instructions which, when executed on a computer, perform the steps as in any one of the possible designs of the first aspect, the first aspect or the second aspect and performed by a user equipment, a monitoring streaming media server or a streaming media rendering device.

In a sixth aspect, the present invention provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the steps as in any one of the possible designs of the first aspect, the first aspect or the second aspect and performed by a user equipment, a monitoring streaming media server or a streaming media rendering device.

In a seventh aspect, the present invention provides a monitoring, adjusting and screen-casting interactive system, which includes a user equipment, a monitoring streaming media server, a streaming media presentation device, and at least one camera device communicatively connected to the monitoring streaming media server through a local area network;

the user equipment is respectively connected with the monitoring streaming media server and the streaming media presenting equipment through local area network communication, and is used for executing the steps executed by the user equipment in the first aspect or any one of the possible designs of the first aspect;

the monitoring streaming media server is connected with the streaming media presentation device through a local area network communication, and is used for executing the steps executed by the monitoring streaming media server in the first aspect or any one of the possible designs of the first aspect;

the streaming media rendering device is configured to perform the steps in the first aspect or any one of the possible designs of the first aspect and performed by the streaming media rendering device.

In an eighth aspect, the present invention provides another monitoring, adjusting and screen-casting interactive system, which includes a user equipment, a monitoring streaming media server, a local area network monitoring and scheduling host, a streaming media presentation device, and at least one camera device communicatively connected to the local area network monitoring and scheduling host through a local area network;

the user equipment is respectively connected with the monitoring streaming media server and the streaming media presenting equipment in a communication mode and used for executing the steps which are executed by the user equipment and are in any one of the possible designs in the second aspect;

the monitoring streaming media server is respectively connected with the streaming media presentation equipment and the local area network monitoring scheduling host through a wide area network in a communication way, and is used for executing the steps which are executed by the monitoring streaming media server and are in any one of the possible designs in the second aspect or the second aspect;

the streaming media rendering device is configured to perform the steps in any one of the possible designs of the second aspect or the second aspect and performed by the streaming media rendering device.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic information interaction flow diagram of a first monitoring, adjusting and screen-projecting method provided by the present invention.

Fig. 2 is a schematic information interaction flow diagram of a second monitoring, adjusting and screen-projecting method provided by the present invention.

Fig. 3 is a schematic structural diagram of a monitor, adjustment and projection screen device provided by the invention.

Fig. 4 is a schematic structural diagram of a computer device provided by the present invention.

Fig. 5 is a schematic structural diagram of a first monitoring, tuning and screen-casting interactive system provided by the present invention.

Fig. 6 is a schematic structural diagram of a second monitoring, tuning and screen-casting interactive system provided by the present invention.

Detailed Description

The invention is further described with reference to the following figures and specific embodiments. It should be noted that the description of the embodiments is provided to help understanding of the present invention, but the present invention is not limited thereto. Specific structural and functional details disclosed herein are merely illustrative of example embodiments of the invention. This invention may, however, be embodied in many alternate forms and should not be construed as limited to the embodiments set forth herein.

It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of example embodiments of the present invention.

It should be understood that, for the term "and/or" as may appear herein, it is merely an associative relationship that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, B exists alone, and A and B exist at the same time; for the term "/and" as may appear herein, which describes another associative object relationship, it means that two relationships may exist, e.g., a/and B, may mean: a exists independently, and A and B exist independently; in addition, for the character "/" that may appear herein, it generally means that the former and latter associated objects are in an "or" relationship.

It will be understood that when an element is referred to herein as being "connected," "connected," or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. Conversely, if a unit is referred to herein as being "directly connected" or "directly coupled" to another unit, it is intended that no intervening units are present. In addition, other words used to describe the relationship between elements should be interpreted in a similar manner (e.g., "between … …" versus "directly between … …", "adjacent" versus "directly adjacent", etc.).

It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments of the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, elements, components, and/or groups thereof.

It should also be noted that, in some alternative designs, the functions/acts noted may occur out of the order noted in the figures. For example, two figures shown in succession may, in fact, be executed substantially concurrently, or the figures may sometimes be executed in the reverse order, depending upon the functionality/acts involved.

It should be understood that specific details are provided in the following description to facilitate a thorough understanding of example embodiments. However, it will be understood by those of ordinary skill in the art that the example embodiments may be practiced without these specific details. For example, systems may be shown in block diagrams in order not to obscure the examples in unnecessary detail. In other instances, well-known processes, structures and techniques may be shown without unnecessary detail in order to avoid obscuring example embodiments.

As shown in fig. 1, the first monitoring, watching and screen-casting method provided in the first aspect of this embodiment is suitable for providing a monitoring and watching service through information interaction between devices in a local area network system (the local area network system further includes at least one camera device communicatively connected to the monitoring streaming media server through a local area network) including a monitoring streaming media server, a streaming media presentation device, and a user device, which respectively support screen-casting communication interfaces, where the screen-casting communication interfaces refer to Development tool sets for establishing application Software for a specific Software package, a Software framework, a hardware platform, and an operating system based on the same screen-casting Software Development Kit (for example, a music-playing screen-casting SDK is a set of program interfaces developed based on a music-linkage protocol and suitable for Android/iOS devices, a developer can easily implement a communication interface protocol for pushing audio and video streaming media such as mp4 and flv and video content of live streaming media such as rtmp, hls and http-flv to the smart television end for playing) by calling the program interface, and mutual information or data interaction can be performed between the supporting devices through the communication interface protocol.

In the local area network system, the monitoring streaming media server is specifically a local area network monitoring and scheduling host, and is configured to collect monitoring streaming media data (which may include, but is not limited to, audio stream data, video stream data, and the like) from the at least one camera device, store the data, forward the data in response to a monitoring request and a data request, and the like, so as to transmit the monitoring streaming media data through a local area network; in particular, the monitoring and watching service (in the published content, the service-related information such as the monitoring and watching service content, the communication address and the communication port may be included) may be published in the local area network, so that the user terminal may discover the monitoring streaming media server and establish a communication connection relationship in advance. The camera Device is used for being arranged in a monitoring place, acquiring and monitoring streaming media data, and returning data in response to a data request, and may be, but is not limited to, a CCD (Charge-Coupled Device) type camera Device or a CMOS (Complementary Metal Oxide Semiconductor) type camera Device. The streaming media presentation device is an electronic device that can be used by a user and integrates functions of video image display, voice playing and the like, and may be, but is not limited to, a smart phone, a television, a computer monitor, a projector, a sound box and/or other devices; a communication connection with the monitoring streaming media server needs to be established in advance based on the screen-casting communication interface; particularly, a two-dimensional code/pin code for scanning a code by the user equipment can be locally presented in the equipment or mDNS service information (multicast Domain Name System ) for discovering by the user equipment is published in the network, where the mDNS service information includes service related information such as screen projection service content, communication address and communication port, so that the user equipment establishes a communication connection with the streaming media presentation equipment by using the two-dimensional code/pin code or the mDNS service information in a conventional interactive manner. The user equipment is terminal equipment held by a user, and can be but is not limited to equipment such as a smart phone, a smart watch or a tablet computer; a communication connection with the monitoring streaming media server needs to be established in advance based on the screen-casting communication interface; and when the screen projection application is started, one or more streaming media presentation devices can be selected to provide monitoring, watching and screen projection services (when a plurality of streaming media presentation devices are selected, the purpose of multi-person sharing audio and video can be achieved), and finally, the two-dimensional code/pin code or the mDNS service information is used in a conventional interactive mode to establish communication connection with the selected streaming media presentation devices.

The information interaction process of the first monitoring, adjusting and screen-projecting method may include, but is not limited to, the following steps S11 to S18.

And S11, sending a monitoring and watching request message carrying the target camera identification to a monitoring streaming media server by the user equipment.

In step S11, the monitoring and tuning request message is used to request, from the network server side, that the user is allowed to tune to the monitored streaming media data collected by the target camera device corresponding to the target camera identifier, where the target camera identifier is used to mark the camera device selected by the user, and may be, but is not limited to, a unique machine code, a unique name, a unique number, or the like of the camera device. In addition to the target camera identifier, the monitoring and tuning request message may also carry information to be verified for user authentication (e.g., an account number and a password), or other related information (e.g., a message type, a message sending timestamp, a user equipment identifier used as a message source address, and a monitoring streaming media server identifier used as a message target address).

And S12, after receiving the monitoring and adjusting request message, the monitoring streaming media server responds to the monitoring and adjusting request message, searches for a local area network address of the target camera equipment corresponding to the target camera identification, and returns a monitoring and adjusting success message carrying a streaming media service request address to the user equipment, wherein the streaming media service request address comprises the local area network address of the target camera equipment.

In step S12, the monitoring and watching successful message is used to inform the user terminal that the monitoring and watching request is successful, and may also carry some other related information (e.g., a message type, a message sending timestamp, a monitoring streaming media server identifier used as a message source address, and a user equipment identifier used as a message destination address, etc.) in addition to the streaming media service request address. Before searching for the local area network address of the target camera device corresponding to the target camera identifier, the user may be authenticated according to the information to be verified, and if the authentication is successful, the local area network address of the target camera device corresponding to the target camera identifier may be searched, wherein the specific manner of authenticating the user may be implemented by using conventional authentication, such as password authentication, fingerprint authentication, temporary check code authentication, or the like. In addition, when the authentication fails or the local area network address of the target camera device corresponding to the target camera identification is not found, a monitoring and watching adjustment failure message can be returned to the user device, so that the user terminal side is informed that the monitoring and watching adjustment request fails.

And S13, after receiving the monitoring and watching success message, the user equipment sends a streaming media request notification message carrying the streaming media service request address to the streaming media presentation equipment.

In step S13, the streaming media request notification message is used to notify the streaming media rendering device to initiate an action of requesting monitoring of streaming media data in time, so as to quickly utilize the streaming media rendering device to display a monitored and tuned real-time video, and may also carry some other related information (e.g., a message type, a message sending timestamp, a user equipment identifier used as a message source address, and a streaming media rendering device identifier used as a message destination address, etc.) in addition to the streaming media service request address.

And S14, after receiving the streaming media request notification message, the streaming media presentation equipment sends a streaming media data request message to the monitoring streaming media server by using the streaming media service request address.

In step S14, the streaming media data request message is used to request to return monitoring streaming media data from the target camera device, and generally carries some related information (e.g., message type, message sending timestamp, identification of streaming media rendering device used as message source address, monitoring streaming media server address used as message destination address, and the streaming media service request address).

And S15, after receiving the streaming media data request message, the monitoring streaming media server forwards the streaming media data request message to the target camera equipment according to the local area network address in the streaming media service request address.

And S16, after receiving the streaming media data request message, the target camera equipment responds to the streaming media data request message and returns the monitored streaming media data to the monitored streaming media server.

And S17, after receiving the returned monitoring streaming media data, the monitoring streaming media server forwards the returned monitoring streaming media data from the target camera equipment to the streaming media presentation equipment.

And S18, receiving and displaying the monitoring streaming media data which is forwarded back by the monitoring streaming media server and comes from the target camera equipment by the streaming media presentation equipment.

Therefore, through the first monitoring, adjusting and viewing screen projection scheme described in the foregoing steps S11 to S18, it is possible to request to return real-time monitoring streaming media data to the monitoring streaming media server and the camera device at any time through information interaction among the user equipment, the monitoring streaming media server and the streaming media presentation device which are in the local area network and respectively support the screen projection communication interface, and play and display the data on the selected streaming media presentation device, so that it is greatly convenient to monitor and adjust, and achieve the purpose of real-time large screen adjustment, effectively improve interactivity and flexibility in the monitoring and adjusting process, and facilitate practical application and popularization.

As shown in fig. 1, this embodiment further specifically proposes a first possible design for implementing accurate monitoring based on the technical solution of the first aspect, that is, before sending a monitoring and monitoring request message carrying a target camera identifier to a monitoring streaming media server, the method further includes, but is not limited to, the following steps S111 to S114.

And S111, sending a service inquiry request message to the monitoring streaming media server by the user equipment.

In step S111, the service query request message is used to query the network server side for the camera devices that can currently provide monitoring streaming media data, so that the user selects one camera device as the target camera device. In the service query request message, some related information (for example, a message type, a message sending timestamp, a user equipment identifier used as a message source address, a monitoring streaming media server address used as a message destination address, the streaming media service request address, and the like) is generally carried.

And S112, after receiving the service query request message, the monitoring streaming media server responds to the service query request message and returns a service query success message carrying at least one piece of monitoring and watching service information to the user equipment, wherein the monitoring and watching service information comprises a camera identification and camera equipment description information in one-to-one correspondence with the camera identification.

In step S112, the service query success message is used to notify the user terminal that the service query request is successful, and may also carry some other related information (for example, a message type, a message sending timestamp, a monitoring streaming media server identifier used as a message source address, and a user equipment identifier used as a message destination address, etc.) in addition to the at least one piece of monitoring and watching service information. The monitoring and watching service information is used for representing that a camera device which can currently provide monitoring streaming media data exists, wherein the camera device description information includes but is not limited to information used for describing the model, the arrangement place position, the device parameters and the like of the corresponding camera device.

And S113, after receiving the service inquiry success message, the user equipment displays the at least one piece of monitoring and watching service information on a human-computer interaction interface.

In the step S113, the human-machine interface may be a physical interface configured by the user equipment, such as a physical keyboard and/or a physical mouse; it may also be a virtual interface presented by the user device in a touch screen, such as a virtual keyboard and/or a virtual mouse, etc. And displaying the at least one piece of monitoring and watching service information to present the camera equipment which can currently provide monitoring streaming media data so that a user can select one camera equipment as the target camera equipment.

S114, selecting the target camera identification from the at least one piece of monitoring and watching service information by the user equipment according to an operation instruction from the human-computer interaction interface, and generating the monitoring and watching request message.

In step S114, the user may generate the operation instruction by operating the human-computer interaction interface, and then select a camera device determined by the user as the target camera device from the at least one camera device.

Therefore, through the possible design one described in the foregoing steps S111 to S114, before sending the monitoring and tuning request message, the monitoring streaming media server may be queried about the camera device that can currently provide the monitoring streaming media data, and then, through the display and operation of the human-computer interaction interface, the target camera device specified by the user is determined, so as to achieve the purpose of accurate monitoring and tuning.

As shown in fig. 2, the second monitoring, adjusting and viewing screen projection method provided in the second aspect of this embodiment is suitable for providing a monitoring, adjusting and viewing service through information interaction between devices in a wide area network system including a monitoring streaming media server, a streaming media presentation device, a user device, and the like, which respectively support screen projection communication interfaces.

In the wide area network system, the monitoring streaming media server is specifically a wide area network monitoring cloud server which is connected with at least one local area network monitoring and scheduling host through wide area network communication, wherein the local area network monitoring and scheduling host is connected with at least one camera device through local area network communication. The monitoring streaming media server can also be used for collecting monitoring streaming media data from the at least one camera device, performing data cloud storage, responding to a watching request and a data request, performing data cloud forwarding and the like, and transmitting the monitoring streaming media data through a wide area network; in particular, the monitoring and watching service (in the published content, the service-related information such as the monitoring and watching service content, the communication address and the communication port may be included) may be published in the wide area network, so that the user terminal may discover the monitoring streaming media server and establish a communication connection relationship in advance. For details of the local area network monitoring and scheduling host, the streaming media presentation device, and the user equipment, reference may be made to the foregoing technical solution of the first aspect, which is not described herein again.

The information interaction process of the second monitoring, watching and screen-projecting method may include, but is not limited to, the following steps S21 to S30.

And S21, sending a monitoring and watching request message carrying the target camera identification to the monitoring streaming media server by the user equipment.

In step S21, for details of the monitoring and looking-tuning request message, reference may be made to the technical solution of the first aspect, which is not described herein again.

And S22, after receiving the monitoring and looking up request message, the monitoring streaming media server responds to the monitoring and looking up request message, searches for a local area network address of the target camera equipment corresponding to the target camera identification and a wide area network address of the local area network monitoring and dispatching host corresponding to the target camera identification, and returns a monitoring and looking up success message carrying a streaming media service request address to the user equipment, wherein the streaming media service request address comprises the local area network address of the target camera equipment and the wide area network address of the local area network monitoring and dispatching host.

In step S22, for a detailed description of the technology for monitoring and looking up the success message, reference may be made to the technical solution of the first aspect, which is not described herein again. In addition, the local area network monitoring and scheduling host corresponding to the target camera identifier refers to a host communicatively connected to the target camera device through a local area network among the at least one local area network monitoring and scheduling host.

And S23, after receiving the monitoring and watching success message, the user equipment sends a streaming media request notification message carrying the streaming media service request address to the streaming media presentation equipment.

In step S23, for details of the streaming media request notification message, reference may be made to the foregoing technical solution of the first aspect, which is not described herein again. .

And S24, after receiving the streaming media request notification message, the streaming media presentation equipment sends a streaming media data request message to the monitoring streaming media server by using the streaming media service request address.

In step S24, for details of the streaming media data request message, reference may be made to the foregoing technical solution of the first aspect, which is not described herein again.

And S25, after receiving the streaming media data request message, the monitoring streaming media server forwards the streaming media data request message to the local area network monitoring and scheduling host according to the wide area network address in the streaming media service request address.

And S26, after receiving the streaming media data request message, the local area network monitoring and scheduling host forwards the streaming media data request message to the target camera equipment according to the local area network address in the streaming media service request address.

And S27, after receiving the streaming media data request message, the target camera equipment responds to the streaming media data request message and returns the monitored streaming media data to the local area network monitoring and dispatching host.

And S28, after receiving the returned monitoring streaming media data, the local area network monitoring and scheduling host forwards the returned monitoring streaming media data from the target camera equipment to the monitoring streaming media server.

And S29, after receiving the returned monitoring streaming media data, the monitoring streaming media server forwards the returned monitoring streaming media data from the target camera equipment to the streaming media presentation equipment.

And S30, receiving and displaying the monitoring streaming media data which is forwarded back by the monitoring streaming media server and comes from the target camera equipment by the streaming media presentation equipment.

Therefore, through the second monitoring, adjusting and viewing screen projection scheme described in the foregoing steps S21 to S30, it is possible to request to return real-time monitoring streaming media data to the monitoring streaming media server and the camera device at any time through information interaction among the user equipment, the monitoring streaming media server and the streaming media presentation device which are in the wide area network and respectively support the screen projection communication interface, and play and display the data on the selected streaming media presentation device, so that it is greatly convenient to monitor and adjust, and achieve the purpose of real-time large screen adjustment, effectively improve interactivity and flexibility in the monitoring and adjusting process, and facilitate practical application and popularization. In addition, as shown in fig. 2, a technical solution may also be designed, before sending the monitoring and tuning request message, the monitoring streaming media server is first queried about the camera device that can currently provide the monitoring streaming media data, and then the target camera device specified by the user is determined through the display and operation of the human-computer interaction interface, so as to achieve the purpose of accurate monitoring and tuning.

As shown in fig. 3, a third aspect of this embodiment provides a virtual device for implementing the steps performed by the user equipment and performed by any one of the possible designs of the first aspect, or the second aspect, where the virtual device includes a first sending unit, a first receiving unit, and a second sending unit;

For the working process, working details and technical effects of the foregoing apparatus provided in the third aspect of this embodiment, reference may be made to any one of the possible designs of the first aspect and the first aspect or the method described in the second aspect, which is not described herein again.

As shown in fig. 4, a fourth aspect of the present embodiment provides a computer device for performing the steps performed by the user equipment, the monitoring streaming media server, or the streaming media rendering device in any one of the possible designs of the first aspect or the second aspect, including a memory, a processor, and a transceiver, which are sequentially and communicatively connected, wherein the memory is used for storing a computer program, the transceiver is used for transceiving a message, and the processor is used for reading the computer program and performing the steps performed by the user equipment, the monitoring streaming media server, or the streaming media rendering device in any one of the possible designs of the first aspect or the second aspect. For example, the Memory may include, but is not limited to, a Random-Access Memory (RAM), a Read-Only Memory (ROM), a Flash Memory (Flash Memory), a First-in First-out (FIFO), and/or a First-in Last-out (FILO), and the like; the processor may not be limited to the use of a microprocessor model number STM32F105 family; the transceiver may be, but is not limited to, a WiFi (wireless fidelity) wireless transceiver, a bluetooth wireless transceiver, a GPRS (General Packet Radio Service) wireless transceiver, and/or a ZigBee (ZigBee protocol, low power local area network protocol based on ieee802.15.4 standard) wireless transceiver, etc. In addition, the computer device may also include, but is not limited to, a power module, a display screen, and other necessary components.

For the working process, working details and technical effects of the foregoing computer device provided in the fourth aspect of this embodiment, reference may be made to the method in any one of the possible designs of the first aspect and the first aspect or the second aspect, which is not described herein again.

A fifth aspect of the present embodiment provides a readable storage medium storing instructions embodied in any one of the possible designs of the first aspect, or the second aspect and executed by a user equipment, a monitoring streaming media server, or a streaming media rendering device, that is, the readable storage medium storing instructions thereon for executing the steps as in any one of the possible designs of the first aspect, or the second aspect and executed by the user equipment, the monitoring streaming media server, or the streaming media rendering device, when the instructions are executed on a computer. The readable storage medium refers to a carrier for storing data, and may include, but is not limited to, a floppy disk, an optical disk, a hard disk, a flash Memory, a flash disk and/or a Memory Stick (Memory Stick), etc., and the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.

The working process, working details and technical effects of the foregoing readable storage medium provided in the fifth aspect of this embodiment may be referred to as any one of the possible designs of the first aspect and the first aspect or the method described in the second aspect, and are not described herein again.

A sixth aspect of the present embodiments provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the steps as in any one of the possible designs of the first aspect, or the second aspect, and performed by a user equipment, a monitoring streaming server, or a streaming rendering device. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable devices.

As shown in fig. 5, a seventh aspect of this embodiment provides a monitoring, tuning and screen-casting interactive system, which includes user equipment, a monitoring streaming media server, streaming media presentation equipment, and at least one camera device connected to the monitoring streaming media server through a local area network;

The working process, working details and technical effects of the foregoing monitoring, tuning and screen-projecting interactive system provided in this embodiment may refer to the method described in the first aspect or any one of the possible designs of the first aspect, which is not described herein again.

As shown in fig. 6, an eighth aspect of this embodiment provides another monitoring, tuning and screen-casting interactive system, which includes a user equipment, a monitoring streaming media server, a local area network monitoring and scheduling host, a streaming media presentation device, and at least one camera device communicatively connected to the local area network monitoring and scheduling host through a local area network;

The working process, working details and technical effects of the foregoing monitoring, tuning and screen-projecting interactive system provided in this embodiment may refer to the method described in any one of the second aspect or the second aspect, which is not described herein again.

The embodiments described above are merely illustrative, and may or may not be physically separate, if referring to units illustrated as separate components; if reference is made to a component displayed as a unit, it may or may not be a physical unit, and may be located in one place or distributed over a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

The above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: modifications may be made to the embodiments described above, or equivalents may be substituted for some of the features described. And such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Finally, it should be noted that the present invention is not limited to the above alternative embodiments, and that various other forms of products can be obtained by anyone in light of the present invention. The above detailed description should not be taken as limiting the scope of the invention, which is defined in the claims, and which the description is intended to be interpreted accordingly.

Claims

1. A method for monitoring, adjusting and projecting screen is characterized by comprising the following steps:

sending a monitoring and adjusting request message carrying a target camera identifier to a monitoring streaming media server, wherein the monitoring streaming media server is a local area network monitoring and adjusting host connected with at least one camera device through a local area network communication or a wide area network monitoring cloud server connected with the local area network monitoring and adjusting host through a wide area network communication, the monitoring and adjusting request message is used for requesting the monitoring streaming media server to respond and search a local area network address of the target camera device corresponding to the target camera identifier, and returning a monitoring and adjusting success message carrying a streaming media service request address, and the streaming media service request address comprises the local area network address of the target camera device;

receiving the monitoring and watching success message returned by the monitoring streaming media server;

and sending a streaming media request notification message carrying the streaming media service request address to streaming media presentation equipment, wherein the streaming media presentation equipment establishes a communication connection with the monitoring streaming media server in advance based on a screen-casting communication interface, and the streaming media request notification message is used for notifying the streaming media presentation equipment to request monitoring streaming media data from the monitoring streaming media server by using the streaming media service request address, so that the streaming media presentation equipment displays the monitoring streaming media data forwarded and returned by the monitoring streaming media server and coming from the target camera equipment.

2. The monitor-and-look screen-casting method according to claim 1, wherein before sending the monitor-and-look request message carrying the target camera id to the monitor streaming media server, the method further comprises:

sending a service query request message to the monitoring streaming media server, wherein the service query request message is used for requesting the monitoring streaming media server to respond and returning a service query success message carrying at least one piece of monitoring and watching service information, and the monitoring and watching service information comprises a camera identification and camera equipment description information in one-to-one correspondence with the camera identification;

receiving the service inquiry success message returned by the monitoring streaming media server;

displaying the at least one piece of monitoring and watching service information on a human-computer interaction interface;

and selecting the target camera identification from the at least one piece of monitoring and watching service information according to the operation instruction from the human-computer interaction interface, and generating the monitoring and watching request message.

3. A screen projection device for monitoring, adjusting and watching is characterized by comprising a first sending unit, a first receiving unit and a second sending unit;

the second sending unit is communicatively connected to the first receiving unit and configured to send a streaming media request notification message carrying the streaming media service request address to a streaming media presentation device, where the streaming media presentation device establishes a communication connection with the monitoring streaming media server in advance based on a screen-casting communication interface, and the streaming media request notification message is used to notify the streaming media presentation device to request monitoring streaming media data from the monitoring streaming media server by using the streaming media service request address, so that the streaming media presentation device displays the monitoring streaming media data forwarded and returned by the monitoring streaming media server and from the target camera device.

4. A method for monitoring, adjusting and projecting screen is characterized by comprising the following steps:

receiving a monitoring and looking-adjusting request message which comes from user equipment and carries a target camera identification;

responding to the monitoring and watching request message, searching a local area network address of target camera equipment which corresponds to the target camera identification and is in communication connection through a local area network, and returning a monitoring and watching success message carrying a streaming media service request address to the user equipment, wherein the streaming media service request address comprises the local area network address of the target camera equipment, the streaming media service request address is used for being carried in a streaming media request notification message when the user equipment sends the streaming media request notification message to the streaming media presentation equipment, the streaming media presentation equipment establishes communication connection with the local equipment on the basis of a screen projection communication interface in advance, and the streaming media request notification message is used for notifying the streaming media presentation equipment to request to monitor streaming media data by using the streaming media service request address;

receiving a streaming media data request message which comes from the streaming media presentation equipment and is sent by using the streaming media service request address;

forwarding the streaming media data request message to the target camera equipment according to the local area network address in the streaming media service request address, so that the target camera equipment responds and returns to monitor streaming media data;

receiving monitoring streaming media data returned by the target camera equipment;

and forwarding the returned monitoring streaming media data from the target camera equipment to the streaming media presentation equipment so that the streaming media presentation equipment can display the returned monitoring streaming media data.

5. A method for monitoring, adjusting and projecting screen is characterized by comprising the following steps:

responding to the monitoring and looking up request message, searching a local area network address of target camera equipment corresponding to the target camera identification and a wide area network address of a local area network monitoring and dispatching host corresponding to and connected through wide area network communication, and returning a monitoring and looking up success message carrying a streaming media service request address to the user equipment, wherein the streaming media service request address comprises the local area network address of the target camera equipment and the wide area network address of the local area network monitoring and dispatching host, the local area network monitoring and dispatching host is connected with the target camera equipment through local area network communication, the streaming media service request address is used for being carried in the streaming media request notification message when the user equipment sends the streaming media request notification message to the streaming media presentation equipment, and the streaming media presentation equipment establishes communication connection with the local equipment based on a screen-casting communication interface in advance, the streaming media request notification message is used for notifying the streaming media presentation equipment to use the streaming media service request address to request to monitor streaming media data;

forwarding the streaming media data request message to the local area network monitoring and scheduling host according to the wide area network address in the streaming media service request address, so that the local area network monitoring and scheduling host continues to forward the streaming media data request message to the target camera equipment according to the local area network address in the streaming media service request address, and receives monitoring streaming media data returned by the target camera equipment in response;

receiving monitoring streaming media data which are forwarded and returned by the local area network monitoring and scheduling host and come from the target camera equipment;

6. A method for monitoring, adjusting and projecting screen is characterized by comprising the following steps:

receiving a streaming media request notification message which comes from user equipment and carries a streaming media service request address, wherein the streaming media service request address is information returned by a monitoring streaming media server when the user equipment requests monitoring and watching, and the process of the user equipment requesting monitoring and watching is as follows: the method comprises the steps that firstly, a monitoring and adjusting request message carrying a target camera identification is transmitted to a monitoring streaming media server by user equipment, then the monitoring streaming media server responds to the monitoring and adjusting request message, searches a local area network address of the target camera equipment corresponding to the target camera identification, and returns a monitoring and adjusting success message carrying the streaming media service request address to the user equipment, wherein the streaming media service request address comprises the local area network address of the target camera equipment, and the monitoring streaming media server is a local area network monitoring and adjusting host which is connected with at least one camera equipment through local area network communication or a wide area network monitoring and adjusting cloud server which is connected with the local area network monitoring and adjusting host through wide area network communication;

using the streaming media service request address to send a streaming media data request message to the monitoring streaming media server, so that the monitoring streaming media server forwards the streaming media data request message to the target camera equipment according to the local area network address in the streaming media service request address, and receives monitoring streaming media data returned by the target camera equipment in response, wherein the local equipment establishes communication connection with the monitoring streaming media server in advance based on a screen-casting communication interface;

and receiving and displaying the monitoring streaming media data which is forwarded back by the monitoring streaming media server and comes from the target camera equipment.

7. A computer device, characterized by: comprising a memory, a processor and a transceiver communicatively connected, wherein the memory is adapted to store a computer program, the transceiver is adapted to transmit and receive messages, and the processor is adapted to read the computer program and perform the method according to any of claims 1-2 or the method according to any of claims 4-6.

8. A readable storage medium, characterized by: the readable storage medium has stored thereon instructions which, when run on a computer, perform the method of any of claims 1-2 or the method of any of claims 4-6.

9. A monitoring, adjusting and screen-casting interactive system is characterized by comprising user equipment, a monitoring streaming media server, streaming media presenting equipment and at least one camera device which is in communication connection with the monitoring streaming media server through a local area network;

the user equipment is respectively connected with the monitoring streaming media server and the streaming media presentation equipment through local area network communication and is used for executing the method of any one of claims 1-2;

the monitoring streaming media server, communicatively connected to the streaming media rendering device via a local area network, for performing the method of claim 4;

the streaming media presentation device for performing the method of claim 6.

10. A monitoring, adjusting, watching and screen-projecting interactive system is characterized by comprising user equipment, a monitoring streaming media server, a local area network monitoring and scheduling host, streaming media presentation equipment and at least one camera device which is in communication connection with the local area network monitoring and scheduling host through a local area network;

the user equipment is respectively connected with the monitoring streaming media server and the streaming media presenting equipment in a communication mode and is used for executing the method of any one of claims 1-2;

the monitoring streaming media server is respectively connected with the streaming media presenting equipment and the local area network monitoring and scheduling host computer in a communication way through a wide area network and is used for executing the method as claimed in claim 5;

the streaming media presentation device for performing the method of claim 6.