CN110662100A - Information processing method, device and system and computer readable storage medium - Google Patents
Information processing method, device and system and computer readable storage medium Download PDFInfo
- Publication number
- CN110662100A CN110662100A CN201810691208.0A CN201810691208A CN110662100A CN 110662100 A CN110662100 A CN 110662100A CN 201810691208 A CN201810691208 A CN 201810691208A CN 110662100 A CN110662100 A CN 110662100A
- Authority
- CN
- China
- Prior art keywords
- playing
- video
- client
- information
- video playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 76
- 238000003672 processing method Methods 0.000 title claims abstract description 17
- 238000000034 method Methods 0.000 claims description 29
- 230000005540 biological transmission Effects 0.000 claims description 14
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 abstract description 14
- 238000004590 computer program Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 11
- 230000001360 synchronised effect Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses an information processing method, which comprises the following steps: receiving a first video playing request sent by a first client, wherein the first video playing request carries first playing request information; determining video playing display parameters according to the first playing request information; and converting the acquired video data into video stream data corresponding to the video playing display parameters based on the video playing display parameters, and sending the video stream data to the first client. The embodiment of the invention discloses an information processing device, a video monitoring system and a computer readable storage medium, which can determine the applicable video stream data according to the specific situation of a client, thereby reducing the bandwidth occupancy rate and the resource consumption of a client CPU and a memory.
Description
Technical Field
The present invention relates to the field of video monitoring, and in particular, to an information processing method, apparatus, system, and computer-readable storage medium.
Background
With the continuous enhancement of security awareness of users in various industries, the use of video monitoring is more and more common. A video monitoring interface of a related video monitoring technology commonly used generally has multiple pictures, for example, 1 grid, 4 grids, 9 grids, 16 grids, and the like, and when the number of split screens is switched, the resolution of a video in an original playing window does not change, for example, when the 4 grid is switched to the 16 grid, the playing window of each grid becomes smaller, but the resolution of a video code stream received by a playing end remains unchanged, which may cause a waste of bandwidth and a Central Processing Unit (CPU). Especially, if the resolution of the played small window is very low and decoding is performed locally, the rendered video resolution is still the original resolution, for example, when the video resolution is high definition 720P, 1080P, 4K video and the number of split screens is large, for example, 16 grids are played simultaneously, a large amount of bandwidth is occupied and a large amount of resources such as a CPU are consumed.
With the high-definition video monitoring industry, the high-definition video is more and more popular, and the related video playing technology has certain limitations, such as that the decoding and rendering of the high-definition video requires a CPU and a memory with more enhanced performance, and with the development of the monitoring client, the number of monitoring paths is continuously increased, so that the CPU and the memory occupy a large amount to influence the decoding and rendering speed and quality, and the problems of blockage, low video quality and the like of a user when browsing video pictures are caused; although the current IP cameras have started to widely apply data traffic compression technologies such as h.264 compression and dynamic code stream, these processes are far from meeting the requirements if the transmission terminals need to obtain higher imaging quality, especially when the transmission terminals are put into a wide area network for transmission, it is feared that it is difficult to maintain multi-path high-definition video transmission with the current bandwidth quality, and especially with the recent increasingly wide application of IP cameras and the increasingly high pixel development of the cameras themselves, the transmission lines will certainly face higher pressure.
Disclosure of Invention
In order to solve the existing technical problems, embodiments of the present invention provide an information processing method, apparatus, system and computer readable storage medium, which can determine the applicable video stream data according to the specific situation of the client, thereby reducing the bandwidth occupancy rate and the resource consumption of the CPU and the memory of the client, and solving the problems of large occupation of the multi-channel video monitoring bandwidth and large resource consumption of the CPU and the memory.
In order to achieve the above purpose, the technical solution of the embodiment of the present invention is realized as follows:
the embodiment of the invention provides an information processing method, which comprises the following steps:
receiving a first video playing request sent by a first client, wherein the first video playing request carries first playing request information;
determining video playing display parameters according to the first playing request information;
and converting the acquired video data into video stream data corresponding to the video playing display parameters based on the video playing display parameters, and sending the video stream data to the first client.
Optionally, the first play request information includes: video playing information, wherein the video playing information comprises: the resolution ratio of each playing window of the client display interface;
determining video playing display parameters according to the first playing request information, wherein the determining comprises the following steps:
and determining a first code stream resolution and a first code rate of the video played by each playing window according to the resolution of each playing window, wherein the first code stream resolution and the first code rate of the video played by each playing window are the video playing display parameters.
Optionally, the first play request information further includes: client resource usage information, the client resource usage information comprising: the CPU utilization rate and the memory utilization rate of a central processing unit of the client;
after determining the first code stream resolution and the first code rate of the video played by each playing window, the method further comprises the following steps:
and when the CPU utilization rate of the client is greater than a first threshold or the memory utilization rate is greater than a second threshold, determining a second code stream resolution and a second code rate which are lower than the first code stream resolution and the first code rate by one level as the video playing and displaying parameters in a preset code stream resolution and code rate level table.
Optionally, the first play request information further includes: the number of the first playing windows further includes, before determining the video playing display parameters according to the first playing request information:
when the number of the first playing windows is smaller than that of the second playing windows, the transmission of the videos of the t playing windows is suspended according to a preset rule, the number of the second playing windows is the number of the video playing windows of the client before the first playing request, t is the difference value between the number of the second playing windows and the number of the first playing windows, and t is a positive integer.
Optionally, the method further comprises:
receiving client resource use information sent by the first client at preset time intervals, wherein the client resource use information comprises: the CPU utilization rate and the memory utilization rate of the client;
and when the client resource use information sent at intervals of preset time meets a first preset condition, determining the code stream resolution and the code rate which are lower than the current code stream resolution and code rate by one level as the video playing and displaying parameters in a preset code stream resolution and code rate level table.
Optionally, the method further comprises:
receiving a second video playing request sent by a second client, wherein the second video playing request carries second video playing information;
and when the second video playing information and the first video playing information meet a second preset condition, sending the video stream data to the second client.
An embodiment of the present invention further provides an information processing apparatus, including: a receiving unit, a determining unit, a converting unit and a transmitting unit, wherein,
the receiving unit is used for receiving a first video playing request sent by a first client, wherein the first video playing request carries first playing request information;
the determining unit is used for determining video playing display parameters according to the first playing request information;
the conversion unit is used for converting the collected video data into video stream data corresponding to the video playing and displaying parameters based on the video playing and displaying parameters;
the sending unit is configured to send the video stream data to the first client.
Optionally, the first play request information includes: video playing information, wherein the video playing information comprises: the resolution ratio of each playing window of the client display interface;
the determining unit is specifically configured to determine, according to the resolution of each playing window, a first code stream resolution and a first code rate of the video played by each playing window, where the first code stream resolution and the first code rate of the video played by each playing window are the video playing display parameters.
Optionally, the first play request information further includes: client resource usage information, the client resource usage information comprising: the CPU utilization rate and the memory utilization rate of a central processing unit of the client;
the determining unit is further configured to determine, in a preset code stream resolution and code rate level table, a second code stream resolution and a second code rate that are one level lower than the first code stream resolution and the first code rate as the video playing and displaying parameters when the CPU utilization of the client is greater than a first threshold or the memory utilization is greater than a second threshold.
Optionally, the first play request information further includes: the number of first playing windows;
the device further comprises: and the processing unit is used for pausing the transmission of the videos of t playing windows according to a preset rule when the number of the first playing windows is smaller than that of the second playing windows, wherein the number of the second playing windows is the number of the video playing windows of the client before the first playing request, t is the difference value between the number of the second playing windows and the number of the first playing windows, and t is a positive integer.
An embodiment of the present invention further provides a video monitoring system, including: the information processing apparatus of any one of the above, at least one camera, at least one client, wherein,
the at least one camera is used for collecting video data and sending the collected video data to the information processing device;
the information processing device is used for receiving the video data sent by the at least one camera, receiving a video playing request sent by the at least one client, acquiring video stream data corresponding to the video playing request sent by the at least one client, and sending the video stream data corresponding to the video playing request to the at least one client;
the at least one client is used for sending a video playing request to the information processing device and playing video stream data sent by the information processing device.
Embodiments of the present invention also provide a computer-readable storage medium, which stores one or more programs that are executable by one or more processors to implement the steps of the information processing method according to any one of the above.
The embodiment of the invention provides an information processing method, an information processing device, an information processing system and a computer readable storage medium, wherein the method comprises the following steps: receiving a first video playing request sent by a first client, wherein the first video playing request carries first playing request information; determining video playing display parameters according to the first playing request information; and converting the acquired video data into video stream data corresponding to the video playing display parameters based on the video playing display parameters, and sending the video stream data to the first client. The information processing method, the device, the system and the computer readable storage medium provided by the embodiment of the invention can determine the corresponding video playing display parameters according to the playing request information, so that the video playing display parameters are converted into the video stream data corresponding to the video playing display parameters and sent to the client.
Drawings
In the drawings, which are not necessarily drawn to scale, like reference numerals may describe similar components in different views. Like reference numerals having different letter suffixes may represent different examples of similar components. The drawings illustrate generally, by way of example, but not by way of limitation, various embodiments discussed herein.
FIG. 1 is a schematic flow chart of an information processing method according to an embodiment of the present invention;
FIG. 2 is a first schematic structural diagram of an information processing apparatus according to an embodiment of the present invention;
FIG. 3 is a second schematic structural diagram of an information processing apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a video monitoring system according to an embodiment of the present invention.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
An embodiment of the present invention provides an information processing method, as shown in fig. 1, the method may include the following steps:
And the first video playing request carries first playing request information. The first play request information includes: and the resolution information, the memory occupation, the CPU occupation and other information of each playing window of the client.
Specifically, an execution main body of the information processing method provided by the embodiment of the present invention is an information processing apparatus, that is, the information processing apparatus receives a first video playing request sent by a first client, where the first client may be a video playing end, that is, the video playing end sends a playing request to the information processing apparatus, and the information processing apparatus receives the first video playing request sent by the video playing end.
Here, the display interface of the first client may generally have multiple screens, for example, a display interface of video monitoring, which may be 4 play windows, 9 play windows, and the like. A first video playing request sent by a first client carries resolution information of each playing window.
Here, the information processing apparatus may be specifically a streaming media server, and the main function of the streaming media server is to collect, cache, schedule, transmit and play streaming media content. The video rate is the number of data bits transmitted per unit time during data transmission, and the unit used is bps, i.e. bits per second.
The streaming media refers to a media format played on the Internet in a streaming transmission manner, is a media played while being transmitted, and is a multimedia. Broadcast-while-propagation refers to the "same time" that a media provider transmits media over a network, while a user is constantly receiving and viewing or listening to the transmitted media.
And step 102, determining video playing display parameters according to the first playing request information.
In a possible implementation manner, the first play request information includes: video playing information, wherein the video playing information comprises: the resolution ratio of each playing window of the client display interface;
determining video playing display parameters according to the first playing request information, wherein the determining comprises the following steps:
and determining a first code stream resolution and a first code rate of the video played by each playing window according to the resolution of each playing window, wherein the first code stream resolution and the first code rate of the video played by each playing window are the video playing display parameters.
For example, if a resolution of a play window in the video play information is 640 × 480, a bitstream resolution of 640 × 480, 512kbps may be determined, or a resolution close to 640 × 480 may be selected as the bitstream resolution.
In a possible implementation manner, the first play request information further includes: client resource usage information, the client resource usage information comprising: the CPU utilization rate and the memory utilization rate of a central processing unit of the client;
after determining the first code stream resolution and the first code rate of the video played by each playing window, the method further comprises the following steps:
and when the CPU utilization rate of the client is greater than a first threshold or the memory utilization rate is greater than a second threshold, determining a second code stream resolution and a second code rate which are lower than the first code stream resolution and the first code rate by one level as the video playing and displaying parameters in a preset code stream resolution and code rate level table.
Here, the first threshold and the second threshold are critical values of a CPU usage rate and a memory usage rate that are set in advance, and when the CPU usage rate of the client is greater than the first threshold or the memory usage rate is greater than the second threshold, it indicates that the CPU usage rate and the memory usage rate of the terminal client are very large, and the CPU and memory resource consumption of the client is reduced by reducing the code stream resolution and the code rate.
Optionally, the first play request information further includes: the number of the first playing windows further includes, before determining the video playing display parameters according to the first playing request information:
when the number of the first playing windows is smaller than that of the second playing windows, the transmission of the videos of the t playing windows is suspended according to a preset rule, the number of the second playing windows is the number of the video playing windows of the client before the first playing request, t is the difference value between the number of the second playing windows and the number of the first playing windows, and t is a positive integer.
Illustratively, m split screens of the client are converted into n split screens, that is, m playing windows are switched into n playing windows, where m > n. The current client video playing window plays m paths of videos in real time, the client switches the split screen number to n, the client sends information of the m-n paths of videos which are not displayed in the n split screens to the information processing device, and the information processing device suspends transmission of the m-n paths of videos so as to reduce bandwidth occupation and resource consumption of the client. The client side switches to the size of each path of video window corresponding to the split screen number n, CPU and memory information are sent to the information processing device, the information processing device receives the size of the video window, the CPU and the memory data calculate matched video resolution and code rate, the information processing device obtains matched video streams according to the obtained video resolution and code rate data, if other client sides have requested the video streams corresponding to the calculated code stream resolution and code rate in the information processing device before, the video streams are directly sent to the client side to be played, and if the video streams do not exist, the information processing device carries out transcoding on the video streams in real time, the video streams corresponding to the calculated code stream resolution and code rate are obtained and sent to the client side to be played.
Illustratively, an implementation process of switching m split screens of the client to n split screens, that is, a specific implementation process of switching m play windows to n play windows, where m < n. The current client video playing window plays m paths of videos in real time, receives the operation of a user, and switches the split screen number to n; the client side switches to the size of each path of video window corresponding to the split screen number n, and the CPU and the memory information are sent to the information processing device; the information processing device receives the size of each video window, calculates the matched code stream resolution and code rate after the CPU and the memory data, acquires the matched video stream according to the acquired code stream resolution and code rate, namely carries out transcoding on the video stream in real time according to the acquired code stream resolution and code rate, acquires the video stream corresponding to the calculated code stream resolution and code rate and sends the video stream to the client for playing; and if other clients have requested the video stream corresponding to the calculated code stream resolution and code rate in the information processing device before, directly sending the video stream to the client for playing.
Specifically, when the size of the original playing window of the client is changed, the video playing end sends a video playing request to the information processing device according to the changed actual resolution of each playing window, and the information processing device generates a video stream with a code rate and resolution matched with the video stream according to the request and sends the video stream to the playing end, so that the network bandwidth occupancy rate is reduced, and the pressure of a CPU (central processing unit) and an internal memory of the client is greatly reduced.
Specifically, the information processing apparatus may convert the acquired video data into video stream data corresponding to the video playing display parameter according to an existing video transcoding algorithm. For example, the resolution of the code stream is 640 × 480, and the resolution of the acquired video data is 1280 × 720, and the video data with the resolution of 1280 × 720 may be transcoded into video stream data with the resolution of 640 × 480 according to the existing video transcoding algorithm.
Further, the method further comprises:
receiving client resource use information sent by the first client at preset time intervals, wherein the client resource use information comprises: the CPU utilization rate and the memory utilization rate of the client;
and when the client resource use information sent at intervals of preset time meets a first preset condition, determining the code stream resolution and the code rate which are lower than the current code stream resolution and code rate by one level as the video playing and displaying parameters in a preset code stream resolution and code rate level table.
Specifically, the video playing end uploads CPU and memory use information of the client to the information processing device at regular time, and after receiving the information, the information processing device calculates the video resolution and code rate which can be optimized by each playing window of the video playing end in real time according to the resource consumption condition of the video playing end, so that the video playing end can play normally.
Further, the method further comprises:
receiving a second video playing request sent by a second client, wherein the second video playing request carries second video playing information;
and when the second video playing information and the first video playing information meet a second preset condition, sending the video stream data to the second client.
Here, in the process that the information processing apparatus acquires corresponding video stream data according to the video playing request of the first client and sends the video stream data to the first client, the second client also requests the information processing apparatus to acquire a video, and if the video resources requested to be acquired by the second client and the first client are the same, and the video playing display parameters determined by the information processing apparatus according to the second video playing information are the same as or close to the video playing display parameters of the first client, the video stream data converted according to the video playing display parameters of the first client is directly sent to the second client, so that repeated transcoding work is avoided; here, the proximity of the video playing display parameter determined according to the second video playing information to the video playing display parameter of the first client may be that a difference between the two is smaller than a preset threshold.
Specifically, the information processing device can receive the size change of a client playing window and information of a client CPU and a memory, the code stream resolution and code rate required by the information processing device are obtained through certain calculation according to the received information, the video code stream can be converted into a target video code stream in real time, the information processing device presets video code streams with various common resolution and code rates, the transcoding pressure of a server is reduced, and when the resolution and the code rate of data requested by the client through the information processing device are equal to or close to (namely smaller than a certain threshold value) the preset resolution and code rate, the generated video data stream is directly sent, so that the information processing device is prevented from carrying out repeated transcoding work.
Compared with the prior art, the method provided by the embodiment of the invention can calculate appropriate video stream data according to the client playing window information and the client CPU memory information, greatly reduces the bandwidth occupancy rate, particularly plays high-definition videos in multiple paths, reduces the resource consumption of the client CPU and the memory, and greatly improves the number of paths played simultaneously.
An embodiment of the present invention further provides an information processing apparatus 20, as shown in fig. 2, including: a receiving unit 201, a determining unit 202, a converting unit 203, a transmitting unit 204, wherein,
the receiving unit 201 is configured to receive a first video playing request sent by a first client, where the first video playing request carries first playing request information;
the determining unit 202 is configured to determine a video playing display parameter according to the first playing request information;
the conversion unit 203 is configured to convert the acquired video data into video stream data corresponding to the video playing display parameter based on the video playing display parameter;
the sending unit 204 is configured to send the video stream data to the first client.
Optionally, the first play request information includes: video playing information, wherein the video playing information comprises: the resolution ratio of each playing window of the client display interface;
the determining unit 202 is specifically configured to determine, according to the resolution of each playing window, a first code stream resolution and a first code rate of the video played by each playing window, where the first code stream resolution and the first code rate of the video played by each playing window are the video playing display parameters.
Optionally, the first play request information further includes: client resource usage information, the client resource usage information comprising: the CPU utilization rate and the memory utilization rate of a central processing unit of the client;
the determining unit 202 is further configured to determine, in a preset code stream resolution and code rate level table, a second code stream resolution and a second code rate that are lower than the first code stream resolution and the first code rate by one level as the video playing and displaying parameters when the CPU utilization of the client is greater than a first threshold or the memory utilization is greater than a second threshold.
Optionally, the first play request information further includes: the number of first playing windows;
the device further comprises: a processing unit 205, configured to pause transmission of videos of t playing windows according to a preset rule when the number of the first playing windows is smaller than the number of second playing windows, where the number of the second playing windows is the number of video playing windows of the client before the first playing request, t is a difference between the number of the second playing windows and the number of the first playing windows, and t is a positive integer.
Optionally, the receiving unit 201 is further configured to receive client resource usage information sent by the first client at preset time intervals, where the client resource usage information includes: the CPU utilization rate and the memory utilization rate of the client;
the determining unit 202 is further configured to determine, in a preset code stream resolution and code rate level table, that a code stream resolution and a code rate which are lower than the current code stream resolution and code rate by one level are the video playing display parameters, when the client resource usage information sent at every preset time meets a first preset condition.
Optionally, the receiving unit 201 is further configured to receive a second video playing request sent by a second client, where the second video playing request carries second video playing information;
the sending unit 204 is further configured to send the video stream data to the second client when the second video playing information and the first video playing information meet a second preset condition.
Optionally, the apparatus further comprises: the storage unit is used for storing multiple paths of video data streams, and each path of video data stream is preset with a certain common code rate and resolution.
Specifically, for understanding of the information processing apparatus provided in the embodiment of the present invention, reference may be made to the description of the embodiment of the information processing method, and details of the embodiment of the present invention are not repeated herein.
The information processing device provided by the embodiment of the invention can determine the corresponding video playing display parameters according to the playing request information, so that the video playing display parameters are converted into video stream data corresponding to the video playing display parameters and sent to the client.
An embodiment of the present invention further provides an information processing apparatus 30, as shown in fig. 3, where the information processing apparatus 30 includes a processor 301 and a memory 302; wherein the content of the first and second substances,
the memory 302 for storing a computer program operable on the processor;
the processor 301 is configured to execute the steps of the information processing method when the computer program is executed.
It will be appreciated that the memory 302 can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The memory 302 described in connection with the embodiments of the invention is intended to comprise, without being limited to, these and any other suitable types of memory.
The method disclosed in the above embodiments of the present invention may be applied to the processor 301, or implemented by the processor 301. The processor 301 may be an integrated circuit chip having signal processing capability, and more specifically, having information processing algorithms built therein, i.e., having information processing capability. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 301. The Processor 301 may be a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. Processor 301 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed by the embodiment of the invention can be directly implemented by a hardware decoding processor, or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 302, and the processor 301 reads the information in the memory 302 and performs the steps of the aforementioned methods in conjunction with its hardware.
In an exemplary embodiment, the information processing apparatus may be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, Programmable Logic Devices (PLDs), Complex Programmable Logic Devices (CPLDs), Field-Programmable Gate arrays (FPGAs), general purpose processors, controllers, Micro Controllers (MCUs), microprocessors (microprocessors), or other electronic components for performing the foregoing methods.
In an exemplary embodiment, the embodiment of the present invention further provides a storage medium, which may be embodied as a computer-readable storage medium, such as a memory including a computer program, where the computer program is executable by a processor of an information processing apparatus to perform the steps of the foregoing method. The computer readable storage medium may be Memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface Memory, optical disk, or CD-ROM.
Embodiments of the present invention also provide a computer-readable storage medium storing one or more programs, which are executable by one or more processors to implement the steps of the information processing method as described in any one of the above.
An embodiment of the present invention further provides a video monitoring system, as shown in fig. 4, including: the information processing apparatus of any one of the above, at least one camera, at least one client, wherein,
the at least one camera is used for collecting video data and sending the collected video data to the information processing device;
the information processing device is used for receiving the video data sent by the at least one camera, receiving a video playing request sent by the at least one client, acquiring video stream data corresponding to the video playing request sent by the at least one client, and sending the video stream data corresponding to the video playing request to the at least one client;
the at least one client is used for sending a video playing request to the information processing device and playing video stream data sent by the information processing device.
The video monitoring system provided by the embodiment of the invention can determine the corresponding video playing display parameters according to the playing request information, so that the video playing display parameters are converted into video stream data corresponding to the video playing display parameters and sent to the client.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.
Claims (12)
1. An information processing method characterized by comprising:
receiving a first video playing request sent by a first client, wherein the first video playing request carries first playing request information;
determining video playing display parameters according to the first playing request information;
and converting the acquired video data into video stream data corresponding to the video playing display parameters based on the video playing display parameters, and sending the video stream data to the first client.
2. The method according to claim 1, wherein the first play request information comprises: video playing information, wherein the video playing information comprises: the resolution ratio of each playing window of the client display interface;
determining video playing display parameters according to the first playing request information, wherein the determining comprises the following steps:
and determining a first code stream resolution and a first code rate of the video played by each playing window according to the resolution of each playing window, wherein the first code stream resolution and the first code rate of the video played by each playing window are the video playing display parameters.
3. The method according to claim 2, wherein the first playback request message further comprises: client resource usage information, the client resource usage information comprising: the CPU utilization rate and the memory utilization rate of a central processing unit of the client;
after determining the first code stream resolution and the first code rate of the video played by each playing window, the method further comprises the following steps:
and when the CPU utilization rate of the client is greater than a first threshold or the memory utilization rate is greater than a second threshold, determining a second code stream resolution and a second code rate which are lower than the first code stream resolution and the first code rate by one level as the video playing and displaying parameters in a preset code stream resolution and code rate level table.
4. The method according to claim 1, wherein the first playback request message further comprises: the number of the first playing windows further includes, before determining the video playing display parameters according to the first playing request information:
when the number of the first playing windows is smaller than that of the second playing windows, the transmission of the videos of the t playing windows is suspended according to a preset rule, the number of the second playing windows is the number of the video playing windows of the client before the first playing request, t is the difference value between the number of the second playing windows and the number of the first playing windows, and t is a positive integer.
5. The method according to any one of claims 1 to 4, further comprising:
receiving client resource use information sent by the first client at preset time intervals, wherein the client resource use information comprises: the CPU utilization rate and the memory utilization rate of the client;
and when the client resource use information sent at intervals of preset time meets a first preset condition, determining the code stream resolution and the code rate which are lower than the current code stream resolution and code rate by one level as the video playing and displaying parameters in a preset code stream resolution and code rate level table.
6. The method according to any one of claims 1 to 4, further comprising:
receiving a second video playing request sent by a second client, wherein the second video playing request carries second video playing information;
and when the second video playing information and the first video playing information meet a second preset condition, sending the video stream data to the second client.
7. An information processing apparatus characterized by comprising: a receiving unit, a determining unit, a converting unit and a transmitting unit, wherein,
the receiving unit is used for receiving a first video playing request sent by a first client, wherein the first video playing request carries first playing request information;
the determining unit is used for determining video playing display parameters according to the first playing request information;
the conversion unit is used for converting the collected video data into video stream data corresponding to the video playing and displaying parameters based on the video playing and displaying parameters;
the sending unit is configured to send the video stream data to the first client.
8. The apparatus of claim 7,
the first play request information includes: video playing information, wherein the video playing information comprises: the resolution ratio of each playing window of the client display interface;
the determining unit is specifically configured to determine, according to the resolution of each playing window, a first code stream resolution and a first code rate of the video played by each playing window, where the first code stream resolution and the first code rate of the video played by each playing window are the video playing display parameters.
9. The apparatus of claim 8,
the first play request information further includes: client resource usage information, the client resource usage information comprising: the CPU utilization rate and the memory utilization rate of a central processing unit of the client;
the determining unit is further configured to determine, in a preset code stream resolution and code rate level table, a second code stream resolution and a second code rate that are one level lower than the first code stream resolution and the first code rate as the video playing and displaying parameters when the CPU utilization of the client is greater than a first threshold or the memory utilization is greater than a second threshold.
10. The apparatus of claim 7,
the first play request information further includes: the number of first playing windows;
the device further comprises: and the processing unit is used for pausing the transmission of the videos of t playing windows according to a preset rule when the number of the first playing windows is smaller than that of the second playing windows, wherein the number of the second playing windows is the number of the video playing windows of the client before the first playing request, t is the difference value between the number of the second playing windows and the number of the first playing windows, and t is a positive integer.
11. A video surveillance system, comprising: the information processing apparatus of any of claims 7 to 10, at least one camera, at least one client, wherein,
the at least one camera is used for collecting video data and sending the collected video data to the information processing device;
the information processing device is used for receiving the video data sent by the at least one camera, receiving a video playing request sent by the at least one client, acquiring video stream data corresponding to the video playing request sent by the at least one client, and sending the video stream data corresponding to the video playing request to the at least one client;
the at least one client is used for sending a video playing request to the information processing device and playing video stream data sent by the information processing device.
12. A computer-readable storage medium characterized by storing one or more programs, which are executable by one or more processors, to implement the steps of the information processing method according to any one of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810691208.0A CN110662100A (en) | 2018-06-28 | 2018-06-28 | Information processing method, device and system and computer readable storage medium |
| PCT/CN2019/093270 WO2020001536A1 (en) | 2018-06-28 | 2019-06-27 | Information processing method and apparatus, and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810691208.0A CN110662100A (en) | 2018-06-28 | 2018-06-28 | Information processing method, device and system and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110662100A true CN110662100A (en) | 2020-01-07 |
Family
ID=68986200
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810691208.0A Pending CN110662100A (en) | 2018-06-28 | 2018-06-28 | Information processing method, device and system and computer readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110662100A (en) |
| WO (1) | WO2020001536A1 (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113014858A (en) * | 2021-03-05 | 2021-06-22 | 深圳壹秘科技有限公司 | Method, system and device for changing resolution |
| CN113286111A (en) * | 2020-10-23 | 2021-08-20 | 常熟友乐智能科技有限公司 | Video conference content presentation method, device and system |
| CN113301398A (en) * | 2020-07-27 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Information processing method and system, server device and client device |
| CN113329265A (en) * | 2021-05-26 | 2021-08-31 | 浙江大华技术股份有限公司 | Multimedia information display method, device, storage medium and electronic device |
| CN113411634A (en) * | 2021-05-08 | 2021-09-17 | 青岛海尔科技有限公司 | Video stream operation method and device, storage medium and electronic device |
| CN113891112A (en) * | 2021-09-29 | 2022-01-04 | 北京拙河科技有限公司 | Live broadcast method, device, medium and equipment for billion pixel video |
| CN113891111A (en) * | 2021-09-29 | 2022-01-04 | 北京拙河科技有限公司 | Live broadcast method, device, medium and equipment for billion pixel video |
| CN114286194A (en) * | 2021-12-08 | 2022-04-05 | 北京金山云网络技术有限公司 | Instant messaging video processing method and device, electronic equipment and storage medium |
| CN114302189A (en) * | 2022-01-24 | 2022-04-08 | 上海哔哩哔哩科技有限公司 | Live broadcast definition processing method and device |
| CN114827725A (en) * | 2022-04-21 | 2022-07-29 | 上海哔哩哔哩科技有限公司 | Video playing method and device |
| CN114885182A (en) * | 2022-04-18 | 2022-08-09 | 武汉斗鱼鱼乐网络科技有限公司 | Video live broadcast management method and related equipment |
| WO2024060134A1 (en) * | 2022-09-22 | 2024-03-28 | 京东方科技集团股份有限公司 | Information processing method and apparatus, electronic device, and computer-readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010161632A (en) * | 2009-01-08 | 2010-07-22 | Mitsubishi Electric Corp | Video monitoring system, video information distribution apparatus, and client apparatus |
| CN103220577A (en) * | 2012-01-18 | 2013-07-24 | 腾讯科技（深圳）有限公司 | Method, device and system for video displaying |
| CN103517137A (en) * | 2013-09-30 | 2014-01-15 | 广州华多网络科技有限公司 | Network video transmission method and system, sending/receiving end processing method and device |
| CN105872537A (en) * | 2015-12-14 | 2016-08-17 | 乐视云计算有限公司 | Video playing method, device and system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104780393B (en) * | 2015-04-10 | 2017-10-24 | 天脉聚源（北京）教育科技有限公司 | A kind of method and device for distributing resource |
| WO2018088784A1 (en) * | 2016-11-09 | 2018-05-17 | Samsung Electronics Co., Ltd. | Electronic apparatus and operating method thereof |
-
2018
- 2018-06-28 CN CN201810691208.0A patent/CN110662100A/en active Pending
-
2019
- 2019-06-27 WO PCT/CN2019/093270 patent/WO2020001536A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010161632A (en) * | 2009-01-08 | 2010-07-22 | Mitsubishi Electric Corp | Video monitoring system, video information distribution apparatus, and client apparatus |
| CN103220577A (en) * | 2012-01-18 | 2013-07-24 | 腾讯科技（深圳）有限公司 | Method, device and system for video displaying |
| CN103517137A (en) * | 2013-09-30 | 2014-01-15 | 广州华多网络科技有限公司 | Network video transmission method and system, sending/receiving end processing method and device |
| CN105872537A (en) * | 2015-12-14 | 2016-08-17 | 乐视云计算有限公司 | Video playing method, device and system |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113301398A (en) * | 2020-07-27 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Information processing method and system, server device and client device |
| CN113301398B (en) * | 2020-07-27 | 2022-12-02 | 阿里巴巴集团控股有限公司 | Information processing method and system, server device and client device |
| CN113286111A (en) * | 2020-10-23 | 2021-08-20 | 常熟友乐智能科技有限公司 | Video conference content presentation method, device and system |
| WO2022183520A1 (en) * | 2021-03-05 | 2022-09-09 | 深圳壹秘科技有限公司 | Method, system and apparatus for changing resolution |
| CN113014858A (en) * | 2021-03-05 | 2021-06-22 | 深圳壹秘科技有限公司 | Method, system and device for changing resolution |
| CN113411634A (en) * | 2021-05-08 | 2021-09-17 | 青岛海尔科技有限公司 | Video stream operation method and device, storage medium and electronic device |
| CN113329265A (en) * | 2021-05-26 | 2021-08-31 | 浙江大华技术股份有限公司 | Multimedia information display method, device, storage medium and electronic device |
| CN113891111A (en) * | 2021-09-29 | 2022-01-04 | 北京拙河科技有限公司 | Live broadcast method, device, medium and equipment for billion pixel video |
| CN113891112A (en) * | 2021-09-29 | 2022-01-04 | 北京拙河科技有限公司 | Live broadcast method, device, medium and equipment for billion pixel video |
| CN113891111B (en) * | 2021-09-29 | 2023-11-21 | 北京拙河科技有限公司 | Live broadcasting method, device, medium and equipment of billion pixel video |
| CN113891112B (en) * | 2021-09-29 | 2023-12-05 | 北京拙河科技有限公司 | Live broadcasting method, device, medium and equipment of billion pixel video |
| CN114286194A (en) * | 2021-12-08 | 2022-04-05 | 北京金山云网络技术有限公司 | Instant messaging video processing method and device, electronic equipment and storage medium |
| CN114286194B (en) * | 2021-12-08 | 2024-05-03 | 北京金山云网络技术有限公司 | Instant messaging video processing method and device, electronic equipment and storage medium |
| CN114302189A (en) * | 2022-01-24 | 2022-04-08 | 上海哔哩哔哩科技有限公司 | Live broadcast definition processing method and device |
| CN114302189B (en) * | 2022-01-24 | 2023-10-27 | 上海哔哩哔哩科技有限公司 | Live broadcast definition processing method and device |
| CN114885182A (en) * | 2022-04-18 | 2022-08-09 | 武汉斗鱼鱼乐网络科技有限公司 | Video live broadcast management method and related equipment |
| CN114827725A (en) * | 2022-04-21 | 2022-07-29 | 上海哔哩哔哩科技有限公司 | Video playing method and device |
| WO2024060134A1 (en) * | 2022-09-22 | 2024-03-28 | 京东方科技集团股份有限公司 | Information processing method and apparatus, electronic device, and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020001536A1 (en) | 2020-01-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110662100A (en) | Information processing method, device and system and computer readable storage medium | |
| KR102280134B1 (en) | Video playback methods, devices and systems | |
| US20200366920A1 (en) | Region of Interest (ROI) Request and Inquiry in a Video Chain | |
| US10484446B1 (en) | VBR encoding of live content | |
| CN110636346A (en) | Code rate self-adaptive switching method and device, electronic equipment and storage medium | |
| CN110582012B (en) | Video switching method, video processing device and storage medium | |
| CN105577819A (en) | Sharing system, sharing method and sharing device for virtual desktop | |
| CN111147860B (en) | Video data decoding method and device | |
| CN104918123A (en) | Method and system for playback of motion video | |
| AU2018250308B2 (en) | Video compression using down-sampling patterns in two phases | |
| CN113905257A (en) | Video code rate switching method and device, electronic equipment and storage medium | |
| WO2023040825A1 (en) | Media information transmission method, computing device and storage medium | |
| US10419581B2 (en) | Data cap aware video streaming client | |
| CN111970565A (en) | Video data processing method and device, electronic equipment and storage medium | |
| US20200213640A1 (en) | Method and apparatus for automatic hls bitrate adaptation | |
| US20170118528A1 (en) | System and method for adaptive video streaming | |
| CN116980662A (en) | Streaming media playing method, streaming media playing device, electronic equipment, storage medium and program product | |
| US11622135B2 (en) | Bandwidth allocation for low latency content and buffered content | |
| US10270832B1 (en) | Method and system for modifying a media stream having a variable data rate | |
| CN114025171A (en) | Video processing method and device, terminal equipment and storage medium | |
| KR100899666B1 (en) | Dispersed multistreaming transmission apparatus | |
| CN116781973B (en) | Video encoding and decoding method and device, storage medium and electronic equipment | |
| US11917327B2 (en) | Dynamic resolution switching in live streams based on video quality assessment | |
| US20240187548A1 (en) | Dynamic resolution switching in live streams based on video quality assessment | |
| JP2017175597A (en) | Moving image distribution system, distribution server, receiver, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200107 |
|
| RJ01 | Rejection of invention patent application after publication |