CN113489934A - Intelligent housekeeper server, system and screen remote interaction method - Google Patents
Intelligent housekeeper server, system and screen remote interaction method Download PDFInfo
- Publication number
- CN113489934A CN113489934A CN202010859794.2A CN202010859794A CN113489934A CN 113489934 A CN113489934 A CN 113489934A CN 202010859794 A CN202010859794 A CN 202010859794A CN 113489934 A CN113489934 A CN 113489934A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- screen
- intelligent
- server
- recording data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 75
- 230000003993 interaction Effects 0.000 title claims abstract description 43
- 238000012545 processing Methods 0.000 claims description 28
- 230000008569 process Effects 0.000 abstract description 30
- 230000006854 communication Effects 0.000 abstract description 29
- 238000004891 communication Methods 0.000 abstract description 25
- 230000002452 interceptive effect Effects 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 30
- 230000000007 visual effect Effects 0.000 description 17
- 238000004590 computer program Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application provides an intelligent housekeeping server, an intelligent housekeeping system and a screen remote interaction method, and the method is characterized in that a video stream and a screen recording data stream sent by a first intelligent housekeeping server are received, wherein the video stream is content in an acquisition range of a first image acquisition device in the same local area network with the first intelligent housekeeping server, and the screen recording data stream is self-display content recorded by a first mobile terminal in the same local area network with the first intelligent housekeeping server. After receiving the video stream and the screen recording data stream, the second intelligent housekeeping server processes the video stream to obtain first audio data, sends the first audio data to the second intelligent television for playing, and sends the screen recording data stream to the second mobile terminal, so that video information in different local area networks can be mutually transmitted, multi-screen interactive remote communication is realized, and user experience is improved.
Description
Technical Field
The application relates to the technical field of intelligent interaction and video call, in particular to an intelligent housekeeper server, an intelligent housekeeper system and a screen remote interaction method.
Background
With the development of communication technology, communication between people is more and more convenient, and with the development of electronic equipment, people can realize remote communication through video conversation and the like. However, when the user is not only chatting with the other party, but also needs to guide himself in a video mode when the user is working. For example, when a parent calls to ask how to set the playing of a newly bought smart television, the parent is required to align the video call camera with the smart television, and then the child voice guides the parent to operate. And for example, when a parent calls to inquire how to operate the mobile terminal page, the user edits the obtained screenshot through the page screenshot, sends the edited screenshot to the parent and then guides the voice call. Based on the above scenario, the existing reverse screen projection technology can realize that the content displayed in the smart television or the first mobile terminal is projected to the second mobile terminal, and the user inputs an operation at the second mobile terminal to achieve the purpose of controlling the smart television or the first mobile terminal.
However, in the prior art, the control terminal needs to be accessed to the same local area network by the control terminal, the limitation on the communication distance is high, and long-distance communication cannot be realized.
Disclosure of Invention
The application provides an intelligent housekeeper server, an intelligent housekeeper system and a screen remote interaction method, which are used for solving the problems that in the prior art, when multi-screen interaction and conversation are carried out, the limitation on the communication distance is high, and remote communication cannot be realized.
In a first aspect, the present application provides an intelligent housekeeping server, comprising:
a communicator for communicative connection with other devices;
a controller to perform:
the communicator is controlled to receive a video stream and a screen recording data stream sent by a first intelligent housekeeping server, wherein the video stream is acquired by a first image acquisition device in a local area network where the first intelligent housekeeping server is located, and the screen recording data stream is self display content recorded by a first mobile terminal in the local area network where the first intelligent housekeeping server is located;
and processing the video stream to obtain first audio data, controlling the communicator to send the first audio data to a second smart television for playing, and sending the screen recording data stream to a second mobile terminal for displaying.
In a second aspect, the present application provides a smart housekeeping server, the smart housekeeping server comprising:
a communicator for communicative connection with other devices;
a controller to perform:
controlling the communicator to receive a video stream acquired by first image acquisition equipment in a local area network where the communicator is located and a screen recording data stream of self-display content recorded by a first mobile terminal;
and controlling the communicator to send the video stream and the screen recording data stream to a second intelligent housekeeping server.
In a third aspect, the present application provides a method for screen remote interaction, the method comprising:
receiving a video stream and a screen recording data stream sent by a first intelligent housekeeping server, wherein the video stream is acquired by first image acquisition equipment in a local area network where the first intelligent housekeeping server is located, and the screen recording data stream is self display content recorded by a first mobile terminal in the local area network where the first intelligent housekeeping server is located;
and processing the video stream to obtain first audio data, sending the first audio data to a second smart television for playing, and sending the screen recording data stream to a second mobile terminal for displaying.
In a fourth aspect, the present application provides a method for screen remote interaction, the method comprising:
receiving a video stream acquired by first image acquisition equipment in a local area network where the mobile terminal is located and a screen recording data stream of self display content recorded by a first mobile terminal;
and sending the video stream and the screen recording data stream to a second intelligent housekeeping server.
In a fifth aspect, the present application provides an electronic device comprising a processor and a memory, the memory being configured to store program instructions, and the processor being configured to implement the steps of the above-mentioned screen remote interaction method when executing a computer program stored in the memory.
In a sixth aspect, the present application provides a computer-readable storage medium storing a computer program, which when executed by a processor, implements the steps of the above-described screen remote interaction method.
According to the method and the device, the video stream and the screen recording data stream sent by the first intelligent housekeeping server are received, wherein the video stream is the content in the acquisition range of the first image acquisition device which is in the same local area network with the first intelligent housekeeping server, and the screen recording data stream is the self display content recorded by the first mobile terminal which is in the same local area network with the first intelligent housekeeping server. After receiving the video stream and the screen recording data stream, the second intelligent housekeeping server processes the video stream to obtain first audio data, sends the first audio data to the second intelligent television for playing, and sends the screen recording data stream to the second mobile terminal, so that video information in different local area networks can be mutually transmitted, multi-screen interactive remote communication is realized, and user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic view of a service flow of projecting an image of a display screen of an intelligent television to a mobile terminal provided in the prior art;
fig. 2 is a schematic diagram of a communication process of devices in a lan according to the prior art;
fig. 3 is a schematic flowchart of communication, interaction and control between a smart television and a mobile terminal according to the prior art;
fig. 4 is a schematic diagram of a process for establishing a connection between a controlled terminal and a control terminal according to the prior art;
fig. 5 is a schematic structural diagram of an intelligent housekeeping server according to some embodiments of the present application;
fig. 6 is a schematic diagram of a communication process between a family a and a family B in the intelligent interactive system according to some embodiments of the present application;
FIG. 7 is a flowchart illustrating screen interaction implemented by the intelligent interactive system according to some embodiments of the present application;
fig. 8 is a schematic diagram of a decoding process of a socket packet by a second smart housekeeping server according to some embodiments of the present application;
fig. 9 is a schematic structural diagram of an intelligent housekeeping server according to some embodiments of the present application;
FIG. 10 is a process diagram of a method of screen remote interaction provided in some embodiments of the present application;
FIG. 11 is a process diagram of a method of screen remote interaction provided by some embodiments of the present application;
fig. 12 is a schematic structural diagram of an electronic device provided in the present application;
fig. 13 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments that can be derived from the embodiments given herein by a person of ordinary skill in the art are intended to be within the scope of the present disclosure.
Fig. 1 is a schematic flow diagram of a process of displaying a screen projected by a smart television to a mobile terminal in the prior art, fig. 2 is a schematic flow diagram of a device communication process in a local area network provided in the prior art, fig. 3 is a schematic flow diagram of communication, interaction and control between a smart television and a mobile terminal provided in the prior art, fig. 4 is a schematic flow diagram of a process of establishing connection between a controlled terminal and a control terminal provided in the prior art, for convenience of description, the smart television is referred to as a controlled terminal, the mobile terminal is referred to as a control terminal, and the screen projection process is described with reference to fig. 1, fig. 2, fig. 3 and fig. 4:
the control end and the controlled end are connected in the same local area network, namely, data interaction is carried out through the same wireless router. The control end sends a connection request, and the controlled end in the same local area network receives the connection request.
After receiving the connection request sent by the control end, the controlled end records the content on the display screen to generate streaming media data and sends the streaming media data to the control end. The control terminal receives the streaming media data sent by the control terminal and displays the content in the streaming media data on a screen.
And the control terminal determines the coordinate information of the operation according to the operation of the user on the screen and sends the coordinate information to the controlled terminal, so that the control of the content on the display screen of the controlled terminal is realized.
In the application, the first mobile terminal performs screen recording on the content displayed by the display screen of the first mobile terminal, and generates a screen recording data stream. The first mobile terminal sends the screen recording data stream to the first intelligent housekeeping server, and meanwhile, the first image acquisition device sends the video stream acquired by the first intelligent housekeeping server. And after receiving the screen recording data stream and the video stream, the first intelligent housekeeping server sends the screen recording data stream and the video stream to the second intelligent housekeeping server. And after receiving the screen recording data stream and the video stream, the intelligent housekeeping server processes the video stream to obtain first audio data. And sending the first audio data to a second smart television to enable the second smart television to play. And simultaneously, the screen recording data stream is sent to the second mobile terminal, so that the second mobile terminal displays the screen recording data stream.
In order to enable multi-screen interaction not to be limited by a range and improve user experience, the application provides an intelligent housekeeper server, an intelligent housekeeper system and a screen remote interaction method.
Fig. 5 is a schematic structural diagram of an intelligent housekeeping server according to some embodiments of the present application, where the intelligent housekeeping server includes:
a communicator 501 for connecting to other devices;
a controller 502 for performing:
the communicator 501 is controlled to receive a video stream and a screen recording data stream sent by a first intelligent housekeeping server, wherein the video stream is acquired by a first image acquisition device in a local area network where the first intelligent housekeeping server is located, and the screen recording data stream is self display content recorded by a first mobile terminal in the local area network where the first intelligent housekeeping server is located;
and processing the video stream to obtain first audio data, controlling the communicator 501 to send the first audio data to a second smart television for playing, and sending the screen recording data stream to a second mobile terminal for displaying.
In this application, the system for performing remote interaction includes a first intelligent housekeeping server, a first image acquisition device, a first mobile terminal, a second intelligent housekeeping server, a second intelligent television and a second mobile terminal, wherein the first intelligent housekeeping server, the first image acquisition device and the first mobile terminal are located in the same local area network, the second intelligent housekeeping server, the second intelligent television and the second mobile terminal are located in the same local area network, and the two local area networks are different, namely, the first intelligent housekeeping server and the second intelligent housekeeping server are located in two different local area networks.
In this application, the first intelligent housekeeper server and the second intelligent housekeeper server that are located in two different local area networks are the same in the process of realizing the screen interaction, for the convenience of description, describe to the process that the second intelligent housekeeper server realizes the screen interaction in this application, and after first intelligent housekeeper server received the video stream that this second intelligent housekeeper server sent and recorded the screen data stream, the operation of doing is the same with this second intelligent housekeeper server, do not give unnecessary details again.
In the application, when screen interaction is needed, a first mobile terminal and a second mobile terminal can firstly establish the video call, after the video call is established, if the screen interaction is needed, the first mobile terminal and the second mobile terminal start a screen recording function, at the moment, the first mobile terminal and the second mobile terminal carry out screen recording on the content displayed by the display screens of the first mobile terminal and the second mobile terminal, respectively generate screen recording data streams, and respectively send the screen recording data streams to the intelligent housekeeping server of the local area network where the first mobile terminal is located, namely, the first mobile terminal sends the screen recording data streams to the first intelligent housekeeping server, and the second mobile terminal sends the screen recording data streams to the second intelligent housekeeping server.
A first image acquisition device located in the same local area network as the first mobile terminal acquires the content in the acquisition range of the first image acquisition device all the time, and sends the acquired video stream to a first intelligent housekeeping server. And the first intelligent housekeeping server sends the received video stream and the screen recording data stream to the second intelligent housekeeping server.
The same second mobile terminal and the second image acquisition device can also send the second screen recording data stream and the second video stream recorded by the second mobile terminal and the second image acquisition device to the second intelligent housekeeping server, and the second intelligent housekeeping server sends the received second video stream and the second screen recording data stream to the first intelligent housekeeping server.
In order to realize the remote interaction of multiple screens, the second intelligent housekeeping server processes the video stream after receiving the video stream and the screen recording data stream sent by the first intelligent housekeeping server. The processing method comprises the following steps: and separating the audio data from the video data in the video stream, and acquiring the audio data as first audio data. And after the second intelligent housekeeping server acquires the first audio data, the first audio data is sent to the second intelligent television. And after receiving the first audio data, the second smart television plays the first audio data.
In addition, after acquiring the screen recording data stream, the second intelligent housekeeping server sends the screen recording data stream to the second mobile terminal, and after receiving the screen recording data stream, the second mobile terminal displays the screen recording data stream on a display screen of the second mobile terminal.
At the moment, the screen recording data stream of the first mobile terminal in the local area network where the first intelligent housekeeping server is located is displayed at the second mobile terminal, the first audio data in the video stream acquired by the first image acquisition device is played at the second intelligent television, the screen recording data stream of the second mobile terminal in the local area network where the second intelligent housekeeping server is located is displayed at the first mobile terminal, and the audio data in the video stream acquired by the second image acquisition device is played at the first intelligent television, so that remote screen interaction is realized.
According to the method and the device, the video stream and the screen recording data stream sent by the first intelligent housekeeping server are received, wherein the video stream is the content in the acquisition range of the first image acquisition device which is in the same local area network with the first intelligent housekeeping server, and the screen recording data stream is the self display content recorded by the first mobile terminal which is in the same local area network with the first intelligent housekeeping server. After receiving the video stream and the screen recording data stream, the second intelligent housekeeping server processes the video stream to obtain first audio data, sends the first audio data to the second intelligent television for playing, and sends the screen recording data stream to the second mobile terminal, so that video information in different local area networks can be mutually transmitted, multi-screen interactive remote communication is realized, and user experience is improved.
In order to enable the intelligent housekeeping server to accurately process the video stream and the screen recording data stream, on the basis of the above embodiments, in this application, the controller 502 is configured to perform:
and distinguishing the video stream and the screen recording data stream according to real-time streaming protocol (RTSP) address suffixes carried in the video stream and the screen recording data stream.
In this application, the second intelligent housekeeping server receives a video stream and a screen recording data stream, where the video stream and the screen recording data stream are both RTSP data streams, and IP addresses of the video stream and the screen recording data stream from the same local area network are the same, but the RTSP address suffixes are different.
The first image acquisition device and the first mobile terminal send a video stream and a screen recording data stream to the first intelligent television, wherein RTSP address suffixes of the video stream and the screen recording data stream are different.
For example, the RTSP address suffix of a video stream is generally local, and the RTSP address suffix of a video stream is generally callphone, etc. The first intelligent housekeeping server sends a data stream containing the addresses of the suffixes of the RTSP addresses to the second intelligent housekeeping server.
Therefore, the second intelligent housekeeping server distinguishes the video stream and the screen recording data stream according to the received RTSP address suffixes of the video stream and the screen recording data stream, so as to respectively obtain the video stream and the screen recording data stream.
In order to realize the remote interaction of multiple screens, on the basis of the above embodiments, in the present application, the controller 502 is configured to perform:
and processing the screen recording data stream to obtain second video data, and controlling the communicator 501 to send the second video data to the second smart television, so that the second smart television plays the first audio data and displays corresponding content corresponding to the second video data.
In the application, in order to facilitate screen interaction, the display screen of the intelligent television is larger, so that the intelligent television is more convenient to watch, and therefore video data in the screen recording data stream of the mobile terminal can be displayed on the intelligent television.
Therefore, the second intelligent housekeeping server is further configured to obtain second video data in the screen recording data stream of the first mobile terminal, send the second video data to the second intelligent television, and after receiving the second video data, the second intelligent television can play the first audio data and display corresponding content of the second video data, that is, the second intelligent television will play audio data in the video stream acquired by the first image acquisition device at the moment and play the second video data in the screen recording data stream of the first mobile terminal.
For example, when the user 2 using the first image capturing device and the first mobile terminal and using the second smart tv and the second mobile terminal performs screen interaction, the user 2 can watch the content displayed on the display screen of the first mobile terminal of the user 1 on the second smart tv while hearing the audio in the video stream captured by the first image capturing device of the user 1. Meanwhile, the user 1 can also watch the content displayed on the display screen of the second mobile terminal of the user 2 on the first smart television, and can also hear the audio in the video stream acquired by the second image acquisition device of the user 2.
The method and the device for sending the first audio data and the second video data to the second intelligent television through the intelligent housekeeping server can send the first audio data and the second video data to other intelligent televisions which are located in the same local area network with the intelligent housekeeping server. In this application, the intelligent housekeeping server may send data to 6 intelligent tvs at the same time.
Fig. 6 is a schematic view of a communication process between a family a and a family B in the intelligent interactive system provided in some embodiments of the present application, and fig. 7 is a schematic view of a flow of implementing screen interaction in the intelligent interactive system provided in some embodiments of the present application. In this embodiment, the mobile terminal is a smart phone, and the image acquisition device is a visual intelligence sensor. For convenience of description, the smart housekeeper server in the family a is referred to as a first smart housekeeper server, the smart phone in the family a is referred to as a smart phone a, the visual intelligence sensor in the family a is referred to as a first visual intelligence sensor, and the smart television in the family a is referred to as a first smart television; the intelligent housekeeping server in the family B is called a second intelligent housekeeping server, the smart phone in the family B is called a smart phone B, the visual intelligent sensor in the family B is called a second visual intelligent sensor, and the intelligent television in the family B is called a second intelligent television. The screen interaction process between family a and family B will now be described with reference to fig. 6 and 7.
The smart phone A, the first smart television, the first visual intelligent sensor and the first intelligent housekeeper server in the family A are all connected with the router of the family A; and the smart phone B, the second smart television, the second visual intelligent sensor and the second intelligent housekeeper server in the family B are all connected with the router of the family B.
When a user in the family A needs to perform screen interaction with a user in the family B, a video call is established with the smart phone B through the smart phone A. After the video call is established, if screen interaction is needed, the screen recording function of the smart phone A is started, the smart phone A records the content displayed by the display screen of the smart phone A, the data stream after the screen recording is encoded by H.264 or H.265, and then the data stream is encapsulated according to the RTSP.
The smart phone A sends the packaged RTSP data stream to a first smart housekeeper server through a router in the home A, and the first smart housekeeper server receives the RTSP data stream.
In order to distinguish the video stream sent by the first visual smart sensor from the following video stream, in this embodiment, the RTSP data stream sent by the smart phone a is referred to as RTSPA telephone A。
A first visual smart sensor located in the same lan as smartphone a will collect content within its collection range all the time and generate a camera data stream. After the first visual intelligent sensor generates the camera data stream, previewing the camera data stream acquired by the first visual intelligent sensor, synchronizing the audio and the video acquired by the first visual intelligent sensor to form a video stream, and sending the video stream to the first intelligent housekeeping server. In addition, after the first visual intelligent sensor previews the camera data stream acquired by the first visual intelligent sensor, the camera data stream can be sent to the first intelligent television, so that the first intelligent television plays. In order to facilitate the subsequent distinction from the screen recording data stream sent by the smart phone a, in this embodiment, the video stream is referred to as RTSP_Camera。
The first intelligent housekeeper server sends RTSP_CameraAnd RTSPA telephone AAnd sending the two paths of data to a second intelligent housekeeping server.
The second intelligent housekeeping server is pulled from the cloud to the first intelligent housekeeping clothesRTSP stream sent by the server. Although RTSP_CameraAnd RTSPA telephone AFrom the same IP address, but with different RTSP address suffixes, e.g. RTSP_CameraAddress of rtsp://192.168.1.101: 554/local; RTSPA telephone AThe address of (1) is rtsp://192.168.1.101: 554/cellphon. So that the second intelligent housekeeping server distinguishes RTSP according to RTSP address suffix_CameraAnd RTSPA telephone A。
The second intelligent housekeeper server sends the RTSPA telephone AAnd sending the video stream to the smart phone B, so that the smart phone B plays and displays the content of the video stream. Second Intelligent Care Server Pair RTSP_CameraProcessing to obtain first audio data; for the RTSPA telephone AAnd processing to obtain second video data, and sending the first audio data and the second video data to a second smart television to enable the second smart television to play and display.
The second intelligent housekeeping server obtains the video stream from the second visual intelligent sensor in the same local area network, and in order to distinguish the video stream from the video stream sent by the first visual intelligent sensor, the video stream is called RTSP in the embodiment_Camera2And sending the video stream to a second intelligent television to enable the second intelligent television to display second video data and RTSP in a split screen mode_Camera2。
In order to realize the remote interaction of multiple screens, on the basis of the above embodiments, in the present application, the controller 502 is configured to perform:
and processing the video stream to obtain first video data, and controlling the communicator 501 to send the first video data to the second smart television for displaying, so that the second smart television plays the first audio data and displays corresponding content corresponding to the first video data.
In the application, the video stream of the first image acquisition device can be played on the second smart television. In the above embodiments, it has been described that the first audio data of the video stream is transmitted to the second smart tv. In an embodiment, the second intelligent housekeeping server may further process the video stream to obtain first video data, send the first video data to the second intelligent television, and enable the second intelligent television to display and play. At this moment, the second smart television displays and plays the first audio data and the first video data, namely, the video stream of the first image acquisition device is played on the second smart television.
The process of displaying and playing the first audio data and the first video data of the first image capturing device on the display screen of the second smart television is also described with reference to fig. 6 and fig. 7. The scenes are similar and are not repeated, so that the description is convenient, the process of video acquisition and transmission of the intelligent mobile phone A and the first visual intelligent sensor in the family A is not described, the RTSP stream sent by the first intelligent housekeeper server is directly described after the second intelligent housekeeper server receives the RTSP stream, and the RTSP stream is obtained through analysis_CameraAnd RTSPA telephone AThe second intelligent housekeeper server sends RTSP_CameraSending the RTSP to a second intelligent television to enable the second intelligent television to display and play the RTSP_CameraTo transfer RTSPA telephone ASending the RTSP to the smart phone B to enable the smart phone B to display and play the RTSPA telephone A。
In order to implement remote interaction of multiple screens, on the basis of the above embodiments, in the present application, the controller 502 is configured to perform:
controlling the communicator 501 to receive first screen coordinate information and an operation type sent by the second mobile terminal, where the first screen coordinate information and the operation type are determined after the second mobile terminal receives an operation input by a user on a display screen of the second mobile terminal;
determining second screen coordinate information of the operation acting on the display screen of the first mobile terminal according to the first screen coordinate information; and controlling the communicator to send control information carrying the second screen coordinate information and the operation type to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
In the application, not only can the content displayed on the display screen of the first mobile terminal be displayed on the second mobile terminal, but also the content displayed on the display screen of the first mobile terminal can be adjusted through the second mobile terminal.
When there is a need for adjusting content displayed on the display screen of the first mobile terminal, an operation may be input based on the display screen of the second mobile terminal, and after the operation is received by the second mobile terminal, the first screen coordinate information of the input operation and the operation type of the operation may be determined. The second intelligent housekeeping server and the second mobile terminal are in the same local area network, and the second mobile terminal can send a socket data packet carrying the operation type and the position information of the operation to the second intelligent housekeeping server in a TCP communication mode and the like.
The operation may be a click operation or a drag operation. If the operation is a click operation, the first screen coordinate information is the position of the operation action; if the operation is a drag operation, the first screen coordinate information is position change information of an initial position when the operation starts to act and an end position when the operation ends.
And after receiving the socket data packet, the second intelligent housekeeper server acquires the first screen coordinate information and the operation type. The first screen coordinate information is coordinate information when the operation acts on the second mobile terminal, and since the coordinates of the content in the screen recording data stream on the display screens of the first mobile terminal and the second mobile terminal may be affected by factors such as the model of the mobile terminal and the size of the display screen, the second intelligent housekeeping server needs to convert the first screen coordinate information into second screen coordinate information corresponding to the first mobile terminal.
And the second intelligent housekeeper server encapsulates the socket data packet carrying the second screen coordinate information and the control information of the operation type through a Websocket protocol. The second intelligent housekeeper server can send the encapsulated socket data packet to the first intelligent housekeeper server in modes of TCP communication and the like.
In the process of encapsulating, by the second intelligent housekeeper server, the socket data packet carrying the second screen coordinate information and the control information of the operation type through the WebSocket protocol, the following procedures may be referred to:
and the first intelligent housekeeper server receives the encapsulated socket data packet, decodes the socket data packet to obtain control information carrying second screen coordinate information and an operation type, and sends the control information to the first mobile terminal, so that the mobile terminal can adjust according to the control information.
In the process of decoding the socket data packet carrying the second screen coordinate information and the control information of the operation type by the first intelligent housekeeping server, the following procedures may be referred to:
fig. 8 is a schematic diagram of a process of decoding a socket packet by a second intelligent housekeeping server according to some embodiments of the present application. In fig. 8, a schematic diagram of the decoding process performed by the second intelligent housekeeping server is shown.
A process of controlling the first mobile terminal by the second mobile terminal will now be described with reference to fig. 6 and 7 described above. Since the process of screen interaction is the same as the above embodiment, it is not described herein again.
Inputting an operation on a display screen of a smart phone B, and determining first screen coordinate information of the input operation and an operation type of the operation after the smart phone B receives the operation. The smart phone B sends the first coordinate information and the operation type to a second smart housekeeping server in a socket data packet mode through a TCP protocol. The second intelligent housekeeping server converts the first coordinate information into second screen coordinate information corresponding to the smart phone A, packages the socket data packet carrying the second screen coordinate information and the operation type through a Websocket protocol, and sends the packaged socket data packet to the first intelligent housekeeping server.
And the first intelligent housekeeper server receives the encapsulated socket data packet, and decapsulates the socket data packet to obtain the second screen coordinate information and the operation type. And the second intelligent housekeeper server sends the second screen coordinate information and the operation type to the intelligent mobile phone A, so that the intelligent mobile phone A adjusts the content displayed by the display screen.
Fig. 9 is a schematic structural diagram of an intelligent housekeeping server according to some embodiments of the present application, where the intelligent housekeeping server includes:
a communicator 901, configured to be communicatively connected to other devices;
a controller 902 for performing:
controlling the communicator to receive a video stream acquired by first image acquisition equipment in a local area network where the communicator is located and a screen recording data stream of self-display content recorded by a first mobile terminal;
and controlling the communicator to send the video stream and the screen recording data stream to a second intelligent housekeeping server.
In the application, the intelligent housekeeper server, the first image acquisition device and the first mobile terminal are located in a unified local area network.
In the application, when screen interaction is needed, a first mobile terminal and a second mobile terminal can firstly establish the video call, after the video call is established, if the screen interaction is needed, the first mobile terminal and the second mobile terminal start a screen recording function, at the moment, the first mobile terminal and the second mobile terminal carry out screen recording on the content displayed by the display screen of the first mobile terminal and the content displayed by the display screen of the second mobile terminal, respectively generate screen recording data streams, and respectively send the screen recording data streams to the intelligent housekeeping server of the local area network where the first mobile terminal is located, namely the first mobile terminal sends the screen recording data streams to the intelligent housekeeping server, and the second mobile terminal sends the screen recording data streams to the second intelligent housekeeping server.
The first image acquisition equipment which is positioned in the same local area network with the first mobile terminal can always acquire the content in the acquisition range and send the acquired video stream to the intelligent housekeeping server. And the intelligent housekeeping server sends the received video stream and the screen recording data stream to a second intelligent housekeeping server.
In order to implement remote interaction of multiple screens, on the basis of the above embodiments, in the present application, the controller 902 is further configured to perform:
controlling the communicator to receive control information which is sent by the second intelligent housekeeping server and carries second screen coordinate information and an operation type;
and controlling the communicator to send the control information to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
In the application, not only can the content displayed on the display screen of the first mobile terminal be displayed on the second mobile terminal, but also the content displayed on the display screen of the first mobile terminal can be adjusted through the second mobile terminal.
And the intelligent housekeeper server receives the encapsulated socket data packet, decodes the socket data packet to obtain control information carrying second screen coordinate information and an operation type, and sends the control information to the first mobile terminal so that the mobile terminal can adjust according to the control information.
Fig. 10 is a process diagram of a method for screen remote interaction according to some embodiments of the present application, where the process includes the following steps:
s1001: receiving a video stream and a screen recording data stream sent by a first intelligent housekeeping server, wherein the video stream is acquired by first image acquisition equipment in a local area network where the first intelligent housekeeping server is located, and the screen recording data stream is self display content recorded by a first mobile terminal in the local area network where the first intelligent housekeeping server is located;
s1002: processing the received video stream to obtain first audio data, and sending the first audio data to a second smart television for playing; and sending the screen recording data stream to a second mobile terminal for display.
In a possible implementation manner, after the second intelligent housekeeping server receives the video stream and the screen recording data stream sent by the first intelligent housekeeping server, and before processing the received video stream, the method further includes:
and the second intelligent housekeeping server distinguishes the video stream and the screen recording data stream according to a real-time streaming protocol (RTSP) address suffix carried in the video stream and the screen recording data stream.
In one possible embodiment, the method further comprises:
and processing the screen recording data stream to obtain second video data, and sending the second video data to the second smart television, so that the second smart television plays the first audio data and displays corresponding content corresponding to the second video data.
In one possible embodiment, the method further comprises:
and processing the video stream to obtain first video data, sending the first video data to the second smart television for displaying, so that the second smart television plays the first audio data and displays corresponding content corresponding to the first video data.
In a possible implementation manner, after the sending the screen recording data stream to the second mobile terminal for displaying, the method further includes:
receiving first screen coordinate information and an operation type sent by a second mobile terminal;
performing coordinate conversion on the first screen coordinate information, and determining second screen coordinate information of the operation acting on the display screen of the first mobile terminal;
and sending the control information carrying the second screen coordinate information and the operation type to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
Fig. 11 is a process diagram of a method for screen remote interaction according to some embodiments of the present application, where the process includes the following steps:
s1101: the first intelligent housekeeper server receives video streams acquired by the first image acquisition equipment in the local area network where the first intelligent housekeeper server is located and screen recording data streams of self display contents recorded by the first mobile terminal.
S1102: and sending the video stream and the screen recording data stream to a second intelligent housekeeping server.
In a possible implementation manner, after the sending the video stream and the screen recording data stream to the second intelligent housekeeping server, the method further includes:
receiving control information carrying second screen coordinate information and an operation type sent by a second intelligent housekeeping server;
and sending the control information carrying the second screen coordinate information and the operation type to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
Fig. 12 is a schematic structural diagram of an electronic device provided in the present application, and on the basis of the foregoing embodiments, an embodiment of the present application further provides an electronic device, as shown in fig. 12, including: the system comprises a processor 121, a communication interface 122, a memory 123 and a communication bus 124, wherein the processor 121, the communication interface 122 and the memory 123 are communicated with each other through the communication bus 124;
the memory 123 has stored therein a computer program which, when executed by the processor 121, causes the processor 121 to perform the steps of:
receiving a video stream and a screen recording data stream sent by a first intelligent housekeeping server, wherein the video stream is acquired by first image acquisition equipment in a local area network where the first intelligent housekeeping server is located, and the screen recording data stream is self display content recorded by a first mobile terminal in the local area network where the first intelligent housekeeping server is located;
processing the received video stream to obtain first audio data, and sending the first audio data to a second smart television for playing; and sending the screen recording data stream to a second mobile terminal for display.
In a possible implementation manner, after the second intelligent housekeeping server receives the video stream and the screen recording data stream sent by the first intelligent housekeeping server, and before processing the received video stream, the method further includes:
and the second intelligent housekeeping server distinguishes the video stream and the screen recording data stream according to a real-time streaming protocol (RTSP) address suffix carried in the video stream and the screen recording data stream.
In one possible embodiment, the method further comprises:
and processing the screen recording data stream to obtain second video data, and sending the second video data to the second smart television, so that the second smart television plays the first audio data and displays corresponding content corresponding to the second video data.
In one possible embodiment, the method further comprises:
and processing the video stream to obtain first video data, sending the first video data to the second smart television for displaying, so that the second smart television plays the first audio data and displays corresponding content corresponding to the first video data.
In a possible implementation manner, after the sending the screen recording data stream to the second mobile terminal for displaying, the method further includes:
receiving first screen coordinate information and an operation type sent by a second mobile terminal;
performing coordinate conversion on the first screen coordinate information, and determining second screen coordinate information of the operation acting on the display screen of the first mobile terminal;
and sending the control information carrying the second screen coordinate information and the operation type to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
Fig. 13 is a schematic structural diagram of an electronic device provided in the present application, and on the basis of the foregoing embodiments, an embodiment of the present application further provides an electronic device, as shown in fig. 13, including: the system comprises a processor 131, a communication interface 132, a memory 133 and a communication bus 134, wherein the processor 131, the communication interface 132 and the memory 133 complete mutual communication through the communication bus 134;
the memory 133 has stored therein a computer program that, when executed by the processor 131, causes the processor 131 to perform the steps of:
the first intelligent housekeeper server receives video streams acquired by the first image acquisition equipment in the local area network where the first intelligent housekeeper server is located and screen recording data streams of self display contents recorded by the first mobile terminal.
And sending the video stream and the screen recording data stream to a second intelligent housekeeping server.
In a possible implementation manner, after the sending the video stream and the screen recording data stream to the second intelligent housekeeping server, the method further includes:
receiving control information carrying second screen coordinate information and an operation type sent by a second intelligent housekeeping server;
and sending the control information carrying the second screen coordinate information and the operation type to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
The communication interfaces 122 and 132 are used for communication between the above-described electronic devices and other devices.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Alternatively, the memory may be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a central processing unit, a Network Processor (NP), and the like; but may also be a Digital instruction processor (DSP), an application specific integrated circuit, a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the like.
Embodiments of the present application further provide a computer-readable storage medium, in which a computer program executable by a processor is stored, and when the program runs on the processor, the processor is caused to execute the following steps:
receiving a video stream and a screen recording data stream sent by a first intelligent housekeeping server, wherein the video stream is acquired by first image acquisition equipment in a local area network where the first intelligent housekeeping server is located, and the screen recording data stream is self display content recorded by a first mobile terminal in the local area network where the first intelligent housekeeping server is located;
processing the received video stream to obtain first audio data, and sending the first audio data to a second smart television for playing; and sending the screen recording data stream to a second mobile terminal for display.
In a possible implementation manner, after the second intelligent housekeeping server receives the video stream and the screen recording data stream sent by the first intelligent housekeeping server, and before processing the received video stream, the method further includes:
and the second intelligent housekeeping server distinguishes the video stream and the screen recording data stream according to a real-time streaming protocol (RTSP) address suffix carried in the video stream and the screen recording data stream.
In one possible embodiment, the method further comprises:
and processing the screen recording data stream to obtain second video data, and sending the second video data to the second smart television, so that the second smart television plays the first audio data and displays corresponding content corresponding to the second video data.
In one possible embodiment, the method further comprises:
and processing the video stream to obtain first video data, sending the first video data to the second smart television for displaying, so that the second smart television plays the first audio data and displays corresponding content corresponding to the first video data.
In a possible implementation manner, after the sending the screen recording data stream to the second mobile terminal for displaying, the method further includes:
receiving first screen coordinate information and an operation type sent by a second mobile terminal;
performing coordinate conversion on the first screen coordinate information, and determining second screen coordinate information of the operation acting on the display screen of the first mobile terminal;
and sending the control information carrying the second screen coordinate information and the operation type to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
Embodiments of the present application further provide a computer-readable storage medium, in which a computer program executable by a processor is stored, and when the program runs on the processor, the processor is caused to execute the following steps:
the first intelligent housekeeper server receives video streams acquired by the first image acquisition equipment in the local area network where the first intelligent housekeeper server is located and screen recording data streams of self display contents recorded by the first mobile terminal.
And sending the video stream and the screen recording data stream to a second intelligent housekeeping server.
In a possible implementation manner, after the sending the video stream and the screen recording data stream to the second intelligent housekeeping server, the method further includes:
receiving control information carrying second screen coordinate information and an operation type sent by a second intelligent housekeeping server;
and sending the control information carrying the second screen coordinate information and the operation type to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
Since the principle of the computer readable medium for solving the problem is similar to the screen projection method, after the processor executes the computer program in the computer readable medium, the steps implemented may refer to the other embodiments, and repeated parts are not described again.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. An intelligent housekeeping server, comprising:
a communicator for communicative connection with other devices;
a controller to perform:
the communicator is controlled to receive a video stream and a screen recording data stream sent by a first intelligent housekeeping server, wherein the video stream is acquired by a first image acquisition device in a local area network where the first intelligent housekeeping server is located, and the screen recording data stream is self display content recorded by a first mobile terminal in the local area network where the first intelligent housekeeping server is located;
and processing the video stream to obtain first audio data, controlling the communicator to send the first audio data to a second smart television for playing, and sending the screen recording data stream to a second mobile terminal for displaying.
2. The intelligent housekeeping server of claim 1, wherein the controller is configured to perform:
and distinguishing the video stream and the screen recording data stream according to real-time streaming protocol (RTSP) address suffixes carried in the video stream and the screen recording data stream.
3. The intelligent housekeeping server of claim 1, wherein the controller is configured to perform:
and processing the screen recording data stream to obtain second video data, and controlling the communicator to send the second video data to the second smart television, so that the second smart television plays the first audio data and displays corresponding content corresponding to the second video data.
4. The intelligent housekeeping server of claim 1, wherein the controller is configured to perform:
and processing the video stream to obtain first video data, controlling the communicator to send the first video data to the second smart television for displaying, and enabling the second smart television to play the first audio data and display corresponding content corresponding to the first video data.
5. The intelligent housekeeping server of claim 1, 3 or 4, wherein the controller is configured to perform:
controlling the communicator to receive first screen coordinate information and an operation type sent by the second mobile terminal, wherein the first screen coordinate information and the operation type are determined after the second mobile terminal receives an operation input by a user on a display screen of the second mobile terminal;
determining second screen coordinate information of the operation acting on the display screen of the first mobile terminal according to the first screen coordinate information; and controlling the communicator to send control information carrying the second screen coordinate information and the operation type to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
6. An intelligent housekeeping server, comprising:
a communicator for communicative connection with other devices;
a controller to perform:
controlling the communicator to receive a video stream acquired by first image acquisition equipment in a local area network where the communicator is located and a screen recording data stream of self-display content recorded by a first mobile terminal;
and controlling the communicator to send the video stream and the screen recording data stream to a second intelligent housekeeping server.
7. The intelligent housekeeping server of claim 6, wherein the controller is further configured to perform:
controlling the communicator to receive control information which is sent by the second intelligent housekeeping server and carries second screen coordinate information and an operation type;
and controlling the communicator to send the control information to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
8. A method for screen remote interaction, the method comprising:
receiving a video stream and a screen recording data stream sent by a first intelligent housekeeping server, wherein the video stream is acquired by a first image acquisition device in a local area network where the first intelligent housekeeping server is located, and the screen recording data stream is self display content recorded by a first mobile terminal in the local area network where the first intelligent housekeeping server is located;
and processing the video stream to obtain first audio data, sending the first audio data to a second smart television for playing, and sending the screen recording data stream to a second mobile terminal for displaying.
9. The method of claim 8, further comprising:
receiving first screen coordinate information and an operation type sent by the second mobile terminal, wherein the first screen coordinate information and the operation type are determined after the second mobile terminal receives an operation input by a user on a display screen of the second mobile terminal;
determining second screen coordinate information of the operation acting on the display screen of the first mobile terminal according to the first screen coordinate information;
and sending the control information carrying the second screen coordinate information and the operation type to the first mobile terminal, so that the first mobile terminal can adjust according to the control information.
10. A method for screen remote interaction, the method comprising:
receiving a video stream acquired by first image acquisition equipment in a local area network where the mobile terminal is located and a screen recording data stream of self display content recorded by a first mobile terminal;
and sending the video stream and the screen recording data stream to a second intelligent housekeeping server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010859794.2A CN113489934B (en) | 2020-08-24 | 2020-08-24 | Intelligent manager server, intelligent manager system and remote screen interaction method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010859794.2A CN113489934B (en) | 2020-08-24 | 2020-08-24 | Intelligent manager server, intelligent manager system and remote screen interaction method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113489934A true CN113489934A (en) | 2021-10-08 |
| CN113489934B CN113489934B (en) | 2024-07-02 |
Family
ID=77932672
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010859794.2A Active CN113489934B (en) | 2020-08-24 | 2020-08-24 | Intelligent manager server, intelligent manager system and remote screen interaction method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113489934B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115022707A (en) * | 2022-06-21 | 2022-09-06 | 杭州海康威视数字技术股份有限公司 | Computer equipment and screen recording device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070260742A1 (en) * | 2003-12-10 | 2007-11-08 | Clark Evan W | Media Storage and distribution in a Local Area Network |
| US20130326070A1 (en) * | 2012-06-01 | 2013-12-05 | Cisco Technology, Inc. | Cascading architecture for audio and video streams |
| US20150341418A1 (en) * | 2013-06-21 | 2015-11-26 | Tencent Technology (Shenzhen) Company Limited | Method and system for controlling media information display on multiple terminals |
| CN109412886A (en) * | 2018-09-26 | 2019-03-01 | 北京文香信息技术有限公司 | A kind of distribution recording and broadcasting system and its communication check method, recorded broadcast control method |
| CN110620953A (en) * | 2019-10-08 | 2019-12-27 | 赛诺贝斯（北京）营销技术股份有限公司 | Multi-screen interaction method, device and system |
| CN110740285A (en) * | 2019-10-30 | 2020-01-31 | 中车青岛四方机车车辆股份有限公司 | telematics method and device |
| CN110913268A (en) * | 2018-09-18 | 2020-03-24 | 深圳市茁壮网络股份有限公司 | Multi-screen interaction method and device and electronic equipment |
| CN111338592A (en) * | 2020-03-18 | 2020-06-26 | 广州市视云信息科技有限公司 | Remote screen projection method and device |
| CN111428084A (en) * | 2020-04-15 | 2020-07-17 | 海信集团有限公司 | Information processing method, housekeeper server and cloud server |
-
2020
- 2020-08-24 CN CN202010859794.2A patent/CN113489934B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070260742A1 (en) * | 2003-12-10 | 2007-11-08 | Clark Evan W | Media Storage and distribution in a Local Area Network |
| US20130326070A1 (en) * | 2012-06-01 | 2013-12-05 | Cisco Technology, Inc. | Cascading architecture for audio and video streams |
| US20150341418A1 (en) * | 2013-06-21 | 2015-11-26 | Tencent Technology (Shenzhen) Company Limited | Method and system for controlling media information display on multiple terminals |
| CN110913268A (en) * | 2018-09-18 | 2020-03-24 | 深圳市茁壮网络股份有限公司 | Multi-screen interaction method and device and electronic equipment |
| CN109412886A (en) * | 2018-09-26 | 2019-03-01 | 北京文香信息技术有限公司 | A kind of distribution recording and broadcasting system and its communication check method, recorded broadcast control method |
| CN110620953A (en) * | 2019-10-08 | 2019-12-27 | 赛诺贝斯（北京）营销技术股份有限公司 | Multi-screen interaction method, device and system |
| CN110740285A (en) * | 2019-10-30 | 2020-01-31 | 中车青岛四方机车车辆股份有限公司 | telematics method and device |
| CN111338592A (en) * | 2020-03-18 | 2020-06-26 | 广州市视云信息科技有限公司 | Remote screen projection method and device |
| CN111428084A (en) * | 2020-04-15 | 2020-07-17 | 海信集团有限公司 | Information processing method, housekeeper server and cloud server |
Non-Patent Citations (2)
| Title |
|---|
| TAHER ALZAHRANI; K. J. HORADAM: "Analysis of two crime-related networks derived from bipartite social networks", 2014 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM 2014), 16 October 2014 (2014-10-16) * |
| 郑锋;: "基于物联网架构的高清视音频无线投屏智能终端的研发及其应用", 智能建筑, no. 04, 6 April 2015 (2015-04-06) * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115022707A (en) * | 2022-06-21 | 2022-09-06 | 杭州海康威视数字技术股份有限公司 | Computer equipment and screen recording device |
| CN115022707B (en) * | 2022-06-21 | 2024-06-07 | 杭州海康威视数字技术股份有限公司 | Computer equipment and screen recording device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113489934B (en) | 2024-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109327728B (en) | One-to-many same-screen method, device and system, same-screen equipment and storage medium | |
| CN105991962B (en) | Connection method, information display method, device and system | |
| KR102157634B1 (en) | Image capturing method and local endpoint host device | |
| CN107371044B (en) | Electronic equipment interaction method, electronic equipment, user terminal and server | |
| CN105763832B (en) | A kind of video interactive, control method and device | |
| CN104602098A (en) | Video barrage display method and equipment thereof | |
| TWI513315B (en) | Method, system, and tv with picture re-producing function | |
| CN108124172B (en) | Cloud projection method, device and system | |
| JP2014513903A (en) | Networking method, server device, and client device | |
| CN103037244B (en) | The method of handover network video, system and intelligent terminal between multiple intelligent terminal | |
| WO2015176648A1 (en) | Method and device for transmitting data in intelligent terminal to television terminal | |
| CN103596063B (en) | Terminal, television, multi-screen interaction system and method for setting screen capture parameters | |
| WO2016119504A1 (en) | Method and apparatus for sharing media programme | |
| CN105451004B (en) | Intelligent set top box and its medium processing system and method for supporting video communication monitoring | |
| WO2024104423A1 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| CN113286190A (en) | Cross-network and same-screen control method and device and cross-network and same-screen system | |
| EP2696591B1 (en) | Video calling using a remote camera device to stream video to a local endpoint host acting as a proxy | |
| CN202385222U (en) | Remote monitoring system of network liquid crystal display television | |
| CN113489934B (en) | Intelligent manager server, intelligent manager system and remote screen interaction method | |
| CN104580289A (en) | Method, device and system for controlling user equipment | |
| WO2022242328A1 (en) | Method for playback in split screen and display device | |
| CN106303643A (en) | Remote control thereof and device | |
| CN112532719A (en) | Information flow pushing method, device, equipment and computer readable storage medium | |
| CN101883264A (en) | Digital home intelligent video gateway | |
| KR102164833B1 (en) | Apparatus and method for transmitting multimedia contents |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Country or region after: China Address after: 266555, No. 218, Bay Road, Qingdao economic and Technological Development Zone, Shandong Applicant after: Hisense Group Holding Co.,Ltd. Address before: 266555, No. 218, Bay Road, Qingdao economic and Technological Development Zone, Shandong Applicant before: QINGDAO HISENSE ELECTRONIC INDUSTRY HOLDING Co.,Ltd. Country or region before: China |
|
| GR01 | Patent grant |