CN117319661B - Image transmission system for visual communication display - Google Patents
Image transmission system for visual communication display Download PDFInfo
- Publication number
- CN117319661B CN117319661B CN202311244901.0A CN202311244901A CN117319661B CN 117319661 B CN117319661 B CN 117319661B CN 202311244901 A CN202311244901 A CN 202311244901A CN 117319661 B CN117319661 B CN 117319661B
- Authority
- CN
- China
- Prior art keywords
- scene
- model
- scenes
- sub
- parameters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 72
- 230000005540 biological transmission Effects 0.000 title claims abstract description 68
- 238000004891 communication Methods 0.000 title claims description 9
- 230000033001 locomotion Effects 0.000 claims abstract description 88
- 230000006835 compression Effects 0.000 claims abstract description 67
- 238000007906 compression Methods 0.000 claims abstract description 67
- 238000012512 characterization method Methods 0.000 claims description 70
- 238000012544 monitoring process Methods 0.000 claims description 30
- 230000009471 action Effects 0.000 claims description 3
- 238000013507 mapping Methods 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 10
- 230000000903 blocking effect Effects 0.000 abstract 1
- 238000000034 method Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- IAZDPXIOMUYVGZ-UHFFFAOYSA-N Dimethylsulphoxide Chemical compound CS(C)=O IAZDPXIOMUYVGZ-UHFFFAOYSA-N 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/142—Detection of scene cut or scene change
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/167—Position within a video image, e.g. region of interest [ROI]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention relates to the field of video data transmission, in particular to an image transmission system for visual transmission display, which is provided with a server module, a data transmission module, a display module and a control module, wherein the control module is used for acquiring control instructions sent by a control end in real time so as to predict a scene where a character model is located, acquiring basic visual parameters in the scene in advance, dividing dynamic movement types of each scene according to the basic visual parameters so as to represent the dynamic movement condition of the model in the scene, further adjusting coding compression parameters of video data corresponding to visual angle pictures of the character model provided by the server when the character model is in different types of scenes, and further reducing bandwidth occupation when the corresponding video data is transmitted on the premise of ensuring visual display effect, and reducing the phenomenon of frame dropping or blocking of pictures displayed by the display module due to visual angle picture switching in the image transmission process.
Description
Technical Field
The invention relates to the field of video data transmission, in particular to an image transmission system for visual communication display.
Background
With the development of computer graphics technology and network technology, various multi-player online games have been developed, and the display of game pictures in the multi-player online games is of great importance, so that the experience of players is directly affected, and therefore, related image transmission systems are valued.
For example, chinese patent publication No.: CN115082002a discloses an image compression method, apparatus and image transmission system, including an input image; dividing the input image into a plurality of image blocks which are not overlapped with each other according to a preset image block size; judging the image type of the image block according to the texture characteristics of the image block; carrying out multi-group prediction on the image block to be compressed according to a preset multi-group prediction method; and judging a final prediction method of the image block to be compressed according to each group of prediction results and the image type of the image block so as to complete the compression of the image block to be compressed. Compared with the existing method, the image block to be compressed of different scenes can improve the image coding compression rate, and further reduce the theoretical limit entropy of compression.
However, the prior art has the following problems:
in the prior art, in a multiplayer online game, models and modeling complexity in different game scenes are different, and the complexity and data amount of video data corresponding to visual angle pictures displayed in different scenes in different time periods are different due to movement and switching of a plurality of players in the scenes, and moreover, due to control instructions of players, a character model moves in the scenes, and the visual angle pictures are continuously switched, so that if coding parameters of the video data corresponding to the visual angle pictures are not adjusted based on the variability of the scenes, bandwidth waste or frame blockage or frame dropping of pictures displayed by a display terminal is caused due to insufficient coding compression rate;
in addition, when the coding compression is adjusted in the prior art, the influence of the dynamic characteristics of the video picture on the look and feel is not considered, and the quality of the video after the coding compression is poor.
Disclosure of Invention
In order to solve the problem that the prior art does not consider that a character model moves in a scene in a multi-player online game, the complexity and the data amount of video data corresponding to the visual angle pictures displayed in different scenes are different due to continuous switching of visual angle pictures, and the coding parameters of the video data corresponding to the visual angle pictures are not adjusted in time, and the problem that the pictures displayed by a display terminal are blocked or dropped due to waste of bandwidth or insufficient coding compression rate is solved, the invention provides an image transmission system for visual transmission display, which comprises the following components:
the server module is connected with the control end and used for loading the scene modeling and the character model, controlling the action of the corresponding character model based on the control instruction of the control end and providing the view angle picture of the character model in the corresponding scene in real time;
the data transmission module is connected with the server module and used for encoding and compressing video data corresponding to the visual angle picture;
the display module is connected with the data transmission module and used for receiving the coded and compressed video data sent by the video transmission module and decoding the coded and compressed video data so as to display corresponding content;
the control module is respectively connected with the server module, the display module and the data transmission module and comprises a monitoring unit and a control unit,
the monitoring unit is used for acquiring a control instruction sent by a control end, predicting a plurality of scenes where the character model is located in a period based on the control instruction, calculating a moving model characterization coefficient based on basic visual parameters in each scene, and dividing the dynamic moving type of each scene based on the moving model characterization coefficient, wherein the basic visual parameters comprise the number of moving models in the scene and the moving speed of the moving models;
the control unit is used for adjusting compression parameters when the data transmission module carries out coding compression on video data, wherein,
for a scene of a first dynamic movement type, adjusting the coding compression rate of the data transmission module to video data corresponding to a visual angle picture provided by a server module based on a movement model characterization coefficient corresponding to the scene;
and dividing the scene of the second dynamic movement type to obtain a plurality of sub-scenes, calculating picture characterization parameters based on basic modeling parameters in the sub-scenes, determining the sub-scenes facing the character model, and adjusting the coding compression rate of the data transmission module to video data corresponding to the visual angle pictures provided by the server module based on the picture characterization parameters facing the sub-scenes.
Further, the monitoring unit predicts a number of scenes in which the character model is pre-positioned in a period based on the manipulation instruction, wherein
The monitoring unit acquires the moving direction of the character model in the control instruction, constructs a virtual vector based on the moving direction by taking the center of the character model as a reference, records a plurality of scenes of the virtual vector path, and determines the recorded scenes as a plurality of scenes of the character model in advance in a period.
Further, the monitoring unit calculates a movement model characterization coefficient according to formula (1) based on the basic visual parameters in each scene, wherein,
in the formula (1), D represents a motion model characterization coefficient, N represents the number of motion models in a scene, N0 represents a preset number threshold, V represents an average motion rate of each motion model in the scene, and V0 represents a preset motion rate threshold.
Further, the monitoring unit divides the dynamic movement type of each scene based on the movement model characterization coefficients, wherein,
the monitoring unit compares the motion model characterization coefficient of the scene with a preset motion model characterization coefficient comparison threshold,
if the preset dividing condition is met, the monitoring unit judges that the scene is of a first dynamic movement type;
if the preset dividing condition is not met, the monitoring unit judges that the scene is of a second dynamic movement type;
the preset dividing condition is that the motion model characterization coefficient is smaller than the motion model characterization coefficient contrast threshold.
Further, the control unit adjusts the coding compression rate of the data transmission module to the video data corresponding to the view angle picture provided by the server module based on the movement model characterization coefficient corresponding to the scene, wherein,
the control unit is internally provided with a plurality of adjustment modes for adjusting the coding compression rate based on the motion model characterization coefficients, and the adjustment amounts of the coding compression rate in the adjustment modes are different.
Further, the control unit divides the scene to obtain a plurality of sub-scenes, wherein,
the volumes of the sub-scenes obtained by dividing by the control unit are the same, and the ratio of the volumes of the sub-scenes to the total volume of the scenes is larger than a preset ratio threshold.
Further, the control unit determines a sub-scene to which the character model is directed, wherein,
the control unit constructs a virtual vector based on the facing direction of the character model with the character model as a reference, and determines the first sub-scene reached by the virtual vector as the sub-scene facing the character model.
Further, the control unit acquires basic modeling parameters in a sub-scene, wherein the basic modeling parameters comprise the average vertex number of each model in the sub-scene and the average map number of each model.
Further, the control unit calculates picture characterization parameters based on basic modeling parameters in the sub-scene, wherein,
the control unit calculates the picture characterizing parameters according to formula (2),
in the formula (2), ne represents the average number of vertices of the model, ne0 represents a preset vertex number threshold, nm represents a preset average number of tiles, nm0 represents a preset number of tiles threshold, and α represents a precision coefficient.
Further, the control unit adjusts the coding compression rate of the data transmission module to the video data corresponding to the view angle picture provided by the server module based on the picture characterization parameter of the sub-scene, wherein,
the control unit is internally provided with a plurality of adjustment modes for adjusting the coding compression rate based on the picture characterization parameters, and the adjustment amounts of the coding compression rate in the adjustment modes are different.
Compared with the prior art, the method has the advantages that the server module, the data transmission module, the display module and the control module are arranged, the control instruction sent by the control end is obtained in real time through the control module, the scene where the character model is located is further predicted, basic visual parameters in the scene are obtained in advance, dynamic movement types of the scenes are divided according to the basic visual parameters to represent dynamic movement conditions of the models in the scene, further, coding compression parameters of video data corresponding to visual angle pictures of the character model provided by the server are conveniently adjusted when the character model is in different types of scenes, further, on the premise of guaranteeing visual display effect, bandwidth occupation when the corresponding video data are transmitted is reduced, and phenomenon that frames of pictures displayed by the display module fall or are blocked due to visual angle picture switching in the image transmission process is reduced.
In particular, in the invention, the setting monitoring unit predicts a plurality of scenes of the character model pre-positioned in the period based on the control instruction in advance, in the practical situation, taking an online game as an example, because a large number of players move in each scene and basic visual parameters in each scene are different, further, when the player is positioned in different scenes, the complexity of the visual angle picture of the character model is also different, further, the fluctuation of data quantity during data transmission is caused, the limitation of transmission bandwidth is added, a picture display terminal, namely a picture displayed by a display module, is caused, the real-time analysis of the visual angle picture consumes a calculated force, and the accurate analysis cannot be performed in the transmission process.
Especially, for the scene of the first dynamic movement type, the encoding compression rate of the data transmission module on the video data corresponding to the visual angle picture provided by the server module is adjusted based on the movement model characterization coefficient corresponding to the scene, the movement model characterization coefficient characterizes the dynamic movement effect of the movement model in the scene, indirectly characterizes the dynamic movement effect of the object in the visual angle picture when the character model is in the corresponding scene, in actual conditions, if most of the object in the visual angle picture is static or is static in whole, the influence of the picture quality on the visual impression is properly reduced, and the bandwidth occupation during the transmission of the corresponding video data can be reduced.
Especially, for the scene of the second dynamic movement type, the invention adjusts the coding compression rate of the data transmission module on the basis of the picture representation parameters of the sub-scene, which are used for adjusting the coding compression rate of the video data corresponding to the visual angle picture provided by the server module, in the actual situation, the scene of the second dynamic movement type represents more moving models and indirectly represents more dynamic objects in the visual angle picture of the character model in the scene, in the actual situation, the influence of the video quality on the visual impression is reduced when the moving objects are more in the visual angle picture, so that comprehensive consideration is needed, the invention divides the scene into the sub-scenes, adjusts the coding compression rate adaptively on the basis of the picture representation parameters of the sub-scene which are used for adjusting the coding compression rate, the picture representation coefficients consider the fineness degree and the dynamic effect of the picture, and further, on the premise of guaranteeing the visual display effect, the bandwidth occupation when the corresponding video data is transmitted is reduced, and the phenomenon that the picture displayed by the display module is dropped or blocked due to the switching of the visual angle picture in the image transmission process is reduced.
Drawings
FIG. 1 is a schematic diagram of an image transmission system for visual communication presentation according to an embodiment of the invention;
FIG. 2 is a schematic diagram of a control module according to an embodiment of the invention;
FIG. 3 is a schematic diagram illustrating a logic determination of a monitor unit according to an embodiment of the invention.
Detailed Description
In order that the objects and advantages of the invention will become more apparent, the invention will be further described with reference to the following examples; it should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are merely for explaining the technical principles of the present invention, and are not intended to limit the scope of the present invention.
Furthermore, it should be noted that, in the description of the present invention, unless explicitly specified and limited otherwise, the term "connected" should be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those skilled in the art according to the specific circumstances.
Referring to fig. 1, fig. 2, and fig. 3, a schematic diagram of an image transmission system for visual transmission display, a schematic diagram of a control module structure, and a logic determination schematic diagram of a monitoring unit according to an embodiment of the invention are shown, respectively, where the image transmission system for visual transmission display of the invention includes:
the server module is connected with the control end and used for loading the scene modeling and the character model, controlling the action of the corresponding character model based on the control instruction of the control end and providing the view angle picture of the character model in the corresponding scene in real time;
the data transmission module is connected with the server module and used for encoding and compressing video data corresponding to the visual angle picture;
the display module is connected with the data transmission module and used for receiving the coded and compressed video data sent by the video transmission module and decoding the coded and compressed video data so as to display corresponding content;
the control module is respectively connected with the server module, the display module and the data transmission module and comprises a monitoring unit and a control unit,
the monitoring unit is used for acquiring a control instruction sent by a control end, predicting a plurality of scenes where the character model is located in a period based on the control instruction, calculating a moving model characterization coefficient based on basic visual parameters in each scene, and dividing the dynamic moving type of each scene based on the moving model characterization coefficient, wherein the basic visual parameters comprise the number of moving models in the scene and the moving speed of the moving models;
the control unit is used for adjusting compression parameters when the data transmission module carries out coding compression on video data, wherein,
for a scene of a first dynamic movement type, adjusting the coding compression rate of the data transmission module to video data corresponding to a visual angle picture provided by a server module based on a movement model characterization coefficient corresponding to the scene;
and dividing the scene of the second dynamic movement type to obtain a plurality of sub-scenes, calculating picture characterization parameters based on basic modeling parameters in the sub-scenes, determining the sub-scenes facing the character model, and adjusting the coding compression rate of the data transmission module to video data corresponding to the visual angle pictures provided by the server module based on the picture characterization parameters facing the sub-scenes.
Specifically, the specific structure of the server module is not limited, and the invention can be a game server, is provided with a loading component for loading scene modeling and a character model, and a picture generating component for generating a character model visual angle picture, and establishes a communication protocol with a control end to realize data interconnection, and responds to a control instruction of the control end, which is the prior art and is not repeated.
In this embodiment, the control instruction is preset instruction information sent by the control end to control the character model to perform functions such as movement and skill release.
Specifically, the specific structure of the data transmission module is not limited, and the data transmission module can be video coding equipment for compressing the view angle picture code generated by the server and transmitting the compressed view angle picture code to the display module.
Specifically, in this embodiment, the display module may be a display terminal, including but not limited to a display, a VR display, or other device capable of displaying a screen.
In particular, the invention is not limited to the specific structure of the control module, and the control module is composed of logic components, and the logic components comprise field programmable components, computers or microprocessors in the computers.
Specifically, in this embodiment, taking a multiplayer online game as an example, the character model is a character model controlled by a player, the scene is a virtual scene in the multiplayer online game, the view angle picture is a picture in the virtual scene corresponding to the front of the character model when the character model is in the scene, and the picture collection mode is widely used in the prior art and is not described herein.
Specifically, the monitoring unit predicts several scenes in which the character model is pre-positioned in a period based on the manipulation instruction, wherein
The monitoring unit acquires the moving direction of the character model in the control instruction, constructs a virtual vector based on the moving direction by taking the center of the character model as a reference, records a plurality of scenes of the virtual vector path, and determines the recorded scenes as a plurality of scenes of the character model in advance in a period.
In the present embodiment, the length L of the virtual vector is determined based on the period T set in the interval [0.5min,1min ] and the moving speed Vg of the character model in the scene, and l=t×vg is set.
In particular, the monitoring unit calculates a movement model characterization coefficient according to formula (1) based on basic visual parameters in each scene, wherein,
in the formula (1), D represents a motion model characterization coefficient, N represents the number of motion models in a scene, N0 represents a preset number threshold, V represents an average motion rate of each motion model in the scene, and V0 represents a preset motion rate threshold.
In the present embodiment, the number threshold N0 and the movement rate threshold V0 are predetermined, wherein basic visual parameters in several scenes are acquired, and the number average value deltan of the movement models in each scene, and the movement rate average value deltav of the movement models are solved,
setting n0=g1×Δn, v0=g1×Δv, and g1 represents a first scale factor, 0.5 < g1 < 0.7.
In particular, the monitoring unit divides the dynamic movement type of each scene based on the movement model characterization coefficients, wherein,
the monitoring unit compares the motion model characterization coefficient of the scene with a preset motion model characterization coefficient comparison threshold,
if the preset dividing condition is met, the monitoring unit judges that the scene is of a first dynamic movement type;
if the preset dividing condition is not met, the monitoring unit judges that the scene is of a second dynamic movement type;
the preset dividing condition is that the motion model characterization coefficient is smaller than the motion model characterization coefficient contrast threshold.
In this embodiment, the movement model characterization coefficient contrast threshold is set in interval [2,2.3 ].
In the invention, a monitoring unit is arranged to predict a plurality of scenes of a character model in a period in advance based on the control instruction, in the practical situation, as an example, a plurality of scenes of the character model in advance are predicted based on the control instruction sent by the control end, the basic visual parameters in each scene are different, and further, when the character model is in different scenes, the complexity of the visual angle picture of the character model is also different, further, the fluctuation of the data quantity in data transmission is caused, the limitation of the transmission bandwidth is added, a picture display terminal, namely, the picture displayed by a display module is caused, the visual angle picture is analyzed in real time and is calculated, the accurate analysis cannot be carried out in the transmission process, therefore, the invention predicts a plurality of scenes of the character model in advance based on the control instruction sent by the control end, loads the scenes in advance, calculates the moving model characterization coefficients corresponding to each scene, and divides the types of the scenes according to the moving model characterization coefficients, and provides data support for the adjustment of the coding compression parameters of video data corresponding to the visual angle picture of the character model provided by a server when the character model is in different types of scenes.
Specifically, the control unit adjusts the coding compression rate of the data transmission module to the video data corresponding to the view angle picture provided by the server module based on the movement model characterization coefficient corresponding to the scene, wherein,
the control unit is internally provided with a plurality of adjustment modes for adjusting the coding compression rate based on the motion model characterization coefficients, and the adjustment amounts of the coding compression rate in the adjustment modes are different.
In this embodiment, at least three adjustment modes for adjusting the coding compression rate based on the motion model characterization coefficients are provided, wherein,
the control unit compares the motion model characterization coefficient with a preset first motion model characterization coefficient adjustment threshold D1 and a second motion model characterization coefficient adjustment threshold D2,
if D > D2, adjusting the coding compression rate to a first coding compression rate P1 by adopting a first adjustment mode, and setting p1=p0×p1;
if D1 is not less than D2 and D is not less than D2, adopting a second adjustment mode to adjust the coding compression rate to a second coding compression rate P2, and setting P2=P0×p2
If D < D1, the encoding compression rate is adjusted to a third encoding compression rate P3 by a third adjustment method, and p3=p0×p3 is set
Wherein, P1 represents a first adjustment coefficient, P2 represents a second adjustment coefficient, P3 represents a third adjustment coefficient, 1.6 > P1 > P2 > P3 > 1.3, P0 represents a reference encoding compression rate, and P0 is selected in the interval [0.9,0.95 ];
the encoding compression rate is 1-the amount of data after compression/the amount of data before compression in this embodiment.
D1 and D2 are set based on the movement model characterization coefficient comparison threshold D0, d1= 0.7D0, d2= 0.9D0.
According to the method, for a scene of a first dynamic movement type, the coding compression rate of the data transmission module on video data corresponding to the visual angle picture provided by the server module is adjusted based on the movement model characterization coefficient corresponding to the scene, the movement model characterization coefficient characterizes the dynamic movement effect of the movement model in the scene, and indirectly characterizes the dynamic movement effect of objects in the visual angle picture when the character model is in the corresponding scene.
In particular, the control unit divides the scene, resulting in a number of sub-scenes, wherein,
the volumes of the sub-scenes obtained by dividing by the control unit are the same, and the ratio of the volumes of the sub-scenes to the total volume of the scenes is greater than a preset ratio threshold, which is set in the interval [0.01,0.02] in the embodiment.
In particular, the control unit determines the sub-scene to which the character model is directed, wherein,
the control unit constructs a virtual vector based on the facing direction of the character model with the character model as a reference, and determines the first sub-scene reached by the virtual vector as the sub-scene facing the character model.
Specifically, the control unit acquires basic modeling parameters in a sub-scene, wherein the basic modeling parameters comprise the average vertex number of each model in the sub-scene and the average map number of each model.
In particular, the control unit calculates picture characterization parameters based on basic modeling parameters in the sub-scene, wherein,
the control unit calculates the picture characterizing parameters according to formula (2),
in the formula (2), ne represents the average vertex number of the model, ne0 represents a preset vertex number threshold, nm represents a preset average map number, nm0 represents a preset map number threshold, and α represents a precision coefficient, 0.01 < α < 0.02.
The vertex number threshold Ne0 and the map number threshold Nm0 are preset, wherein the average vertex number of the model and the average map number of the model in each scene are obtained and recorded, the average value Δne of the average vertex number of each scene model is solved, the average value Δnm of the average map number of each scene model is solved, ne0 = Δne x g2 is set, nm0 = Δnm x g2, g2 represents the second scaling factor, and 0.7 < g2 < 0.9.
In particular, the control unit adjusts the coding compression rate of the data transmission module to the video data corresponding to the view angle picture provided by the server module based on the picture characterization parameter of the sub-scene, wherein,
the control unit is internally provided with a plurality of adjustment modes for adjusting the coding compression rate based on the picture characterization parameters, and the adjustment amounts of the coding compression rate in the adjustment modes are different.
In this embodiment, at least three adjustment modes for adjusting the encoding compression rate based on the picture characterization parameters are provided, wherein,
the control unit compares the picture characterization parameters with a preset first picture characterization parameter comparison threshold L1 and a second picture characterization parameter comparison threshold L2,
if L > L2, adjusting the coding compression rate to a fourth coding compression rate P4, setting p4=p0×p4;
if L1 is equal to or less than L2, the encoding compression rate is adjusted to a fifth encoding compression rate P5, and p5=p0×p5 is set
If L < L1, the encoding compression rate is adjusted to a sixth encoding compression rate P6, and p6=p0×p6 is set
Wherein p4 represents a fourth adjustment coefficient, p5 represents a fifth adjustment coefficient, p6 represents a sixth adjustment coefficient, and 1.3 > p4 > p5 > p6 > 1.1.
L1 and L2 are set based on the screen characterization parameters, where the screen characterization parameters under the conditions of ne=ne 0, nm=nm0, n= [ n0×α ] are calculated, denoted as Le, and l1=0.7le, l2=0.9le are set.
For the scenes of the second dynamic movement type, the data transmission module adjusts the coding compression rate of video data corresponding to the visual angle pictures provided by the server module based on the picture characterization parameters of the sub-scenes, in the actual situation, the scenes of the second dynamic movement type characterize more movement models, indirectly characterize more dynamic objects in the visual angle pictures of the character models in the scenes, in the actual situation, when the moving objects in the visual angle pictures are more, the influence of the video quality on the visual impression is reduced, so that comprehensive consideration is needed, the scenes are divided into the sub-scenes, the coding compression rate is adaptively adjusted based on the picture characterization parameters of the sub-scenes of the character models, the picture characterization coefficients take the fineness degree and the dynamic effect of pictures into consideration, and further, on the premise of guaranteeing the visual display effect, the bandwidth occupation when the corresponding video data are transmitted is reduced, and the phenomenon that the pictures displayed by the display module are dropped or blocked due to the switching of the visual angle pictures in the image transmission process is reduced.
Thus far, the technical solution of the present invention has been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of protection of the present invention is not limited to these specific embodiments. Equivalent modifications and substitutions for related technical features may be made by those skilled in the art without departing from the principles of the present invention, and such modifications and substitutions will be within the scope of the present invention.
Claims (6)
1. An image transmission system for visually conveying presentations, comprising:
the server module is connected with the control end and used for loading the scene modeling and the character model, controlling the action of the corresponding character model based on the control instruction of the control end and providing the view angle picture of the character model in the corresponding scene in real time;
the data transmission module is connected with the server module and used for encoding and compressing video data corresponding to the visual angle picture;
the display module is connected with the data transmission module and used for receiving the coded and compressed video data sent by the data transmission module and decoding the coded and compressed video data so as to display corresponding content;
the control module is respectively connected with the server module, the display module and the data transmission module and comprises a monitoring unit and a control unit,
the monitoring unit is used for acquiring a control instruction sent by a control end, predicting a plurality of scenes where the character model is located in a period based on the control instruction, calculating a moving model characterization coefficient based on basic visual parameters in each scene, and dividing the dynamic moving type of each scene based on the moving model characterization coefficient, wherein the basic visual parameters comprise the number of moving models in the scene and the moving speed of the moving models;
the control unit is used for adjusting compression parameters when the data transmission module carries out coding compression on video data, wherein,
for a scene of a first dynamic movement type, adjusting the coding compression rate of the data transmission module to video data corresponding to a visual angle picture provided by a server module based on a movement model characterization coefficient corresponding to the scene;
dividing the scene of the second dynamic movement type to obtain a plurality of sub-scenes, calculating picture characterization parameters based on basic modeling parameters in the sub-scenes, determining the sub-scenes faced by the character model, and adjusting the coding compression rate of the data transmission module to video data corresponding to the visual angle pictures provided by the server module based on the picture characterization parameters of the faced sub-scenes;
the monitoring unit calculates a movement model characterization coefficient according to formula (1) based on basic visual parameters in each scene, wherein,
，
in the formula (1), D represents a motion model characterization coefficient, N represents the number of motion models in a scene, N0 represents a preset number threshold, V represents the average motion rate of each motion model in the scene, and V0 represents a preset motion rate threshold;
the monitoring unit divides the dynamic movement types of each scene based on the movement model characterization coefficients, wherein,
the monitoring unit compares the motion model characterization coefficient of the scene with a preset motion model characterization coefficient comparison threshold,
if the preset dividing condition is met, the monitoring unit judges that the scene is of a first dynamic movement type;
if the preset dividing condition is not met, the monitoring unit judges that the scene is of a second dynamic movement type;
the preset dividing condition is that the characteristic coefficient of the moving model is smaller than the contrast threshold value of the characteristic coefficient of the moving model;
the control unit acquires basic modeling parameters in a sub-scene, wherein the basic modeling parameters comprise the average vertex number of each model in the sub-scene and the average mapping number of each model;
the control unit calculates picture characterization parameters based on basic modeling parameters in the sub-scene, wherein,
the control unit calculates the picture characterizing parameters according to formula (2),
，
in the formula (2), ne represents the average number of vertices of the model, ne0 represents a preset vertex number threshold, nm represents a preset average number of tiles, nm0 represents a preset number of tiles threshold, α represents a precision coefficient, N represents the number of moving models in the scene, and N0 represents a preset number threshold.
2. The image transmission system for visual communication presentation of claim 1, wherein the monitoring unit predicts a number of scenes in which a character model is pre-positioned within a period based on the manipulation instructions, wherein
The monitoring unit acquires the moving direction of the character model in the control instruction, constructs a virtual vector based on the moving direction by taking the center of the character model as a reference, records a plurality of scenes of the virtual vector path, and determines the recorded scenes as a plurality of scenes of the character model in advance in a period.
3. The image transmission system for visual communication presentation of claim 1, wherein the control unit adjusts a coding compression rate of video data corresponding to a view picture provided by the server module by the data transmission module based on a movement model characterization coefficient corresponding to the scene, wherein,
the control unit is internally provided with a plurality of adjustment modes for adjusting the coding compression rate based on the motion model characterization coefficients, and the adjustment amounts of the coding compression rate in the adjustment modes are different.
4. The image transmission system for visual communication presentation of claim 1, wherein the control unit divides the scene into a number of sub-scenes, wherein,
the volumes of the sub-scenes obtained by dividing by the control unit are the same, and the ratio of the volumes of the sub-scenes to the total volume of the scenes is larger than a preset ratio threshold.
5. The image transmission system for visually communicating a presentation of claim 1, wherein the control unit determines a sub-scene to which the character model is directed, wherein,
the control unit constructs a virtual vector based on the facing direction of the character model with the character model as a reference, and determines the first sub-scene reached by the virtual vector as the sub-scene facing the character model.
6. The image transmission system for visually communicating presentations according to claim 5, wherein the control unit adjusts a coding compression rate of video data corresponding to a view picture provided by the server module by the data transmission module based on picture characterization parameters of the sub-scene oriented, wherein,
the control unit is internally provided with a plurality of adjustment modes for adjusting the coding compression rate based on the picture characterization parameters, and the adjustment amounts of the coding compression rate in the adjustment modes are different.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311244901.0A CN117319661B (en) | 2023-09-26 | 2023-09-26 | Image transmission system for visual communication display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311244901.0A CN117319661B (en) | 2023-09-26 | 2023-09-26 | Image transmission system for visual communication display |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117319661A CN117319661A (en) | 2023-12-29 |
| CN117319661B true CN117319661B (en) | 2024-04-12 |
Family
ID=89296514
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311244901.0A Active CN117319661B (en) | 2023-09-26 | 2023-09-26 | Image transmission system for visual communication display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117319661B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117873736B (en) * | 2024-03-11 | 2024-05-28 | 湖南马栏山视频先进技术研究院有限公司 | GPU virtualization method for rendering |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103152742A (en) * | 2013-03-07 | 2013-06-12 | 河海大学 | Network-coding-based performance prediction method for wireless multicast system |
| CN112800157A (en) * | 2021-01-11 | 2021-05-14 | 武汉旭云智慧交通有限公司 | Dynamic occupying grid model construction method and application architecture design method thereof |
| CN116708789A (en) * | 2023-08-04 | 2023-09-05 | 湖南马栏山视频先进技术研究院有限公司 | Video analysis coding system based on artificial intelligence |
| CN116777730A (en) * | 2023-08-25 | 2023-09-19 | 湖南马栏山视频先进技术研究院有限公司 | GPU efficiency improvement method based on resource scheduling |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3469410B2 (en) * | 1996-11-25 | 2003-11-25 | 三菱電機株式会社 | Wellness system |
| US20090097546A1 (en) * | 2007-10-10 | 2009-04-16 | Chang-Hyun Lee | System and method for enhanced video communication using real-time scene-change detection for control of moving-picture encoding data rate |
| JP5152402B2 (en) * | 2009-02-27 | 2013-02-27 | 富士通株式会社 | Moving picture coding apparatus, moving picture coding method, and moving picture coding computer program |
| US20120281757A1 (en) * | 2011-05-04 | 2012-11-08 | Roncero Izquierdo Francisco J | Scene change detection for video transmission system |
-
2023
- 2023-09-26 CN CN202311244901.0A patent/CN117319661B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103152742A (en) * | 2013-03-07 | 2013-06-12 | 河海大学 | Network-coding-based performance prediction method for wireless multicast system |
| CN112800157A (en) * | 2021-01-11 | 2021-05-14 | 武汉旭云智慧交通有限公司 | Dynamic occupying grid model construction method and application architecture design method thereof |
| CN116708789A (en) * | 2023-08-04 | 2023-09-05 | 湖南马栏山视频先进技术研究院有限公司 | Video analysis coding system based on artificial intelligence |
| CN116777730A (en) * | 2023-08-25 | 2023-09-19 | 湖南马栏山视频先进技术研究院有限公司 | GPU efficiency improvement method based on resource scheduling |
Non-Patent Citations (2)
| Title |
|---|
| Fast And Accurate Homography Estimation Using Extendable Compression Network;Yilei Chen;2021 IEEE International Conference on Image Processing (ICIP);20210823;全文 * |
| 无线多媒体传感器网络中基于多类传感器信息的分布式视频处理;王玉斐;王汝传;黄海平;孙力娟;;中国图象图形学报;20100115(第01期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117319661A (en) | 2023-12-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN117319661B (en) | Image transmission system for visual communication display | |
| US11503313B2 (en) | Systems and methods for rendering and pre-encoded load estimation based encoder hinting | |
| KR100361398B1 (en) | Systems and methods for producing compressed video graphics images, and centralized interactive graphics systems using them | |
| US9491433B2 (en) | Moving image distribution server, moving image playback apparatus, control method, and recording medium | |
| EP2364190B1 (en) | Centralized streaming game server | |
| US6850565B2 (en) | Real time bit rate control system | |
| CN102625106A (en) | Scene self-adaptive screen encoding rate control method and system | |
| CN102938840A (en) | Key frame quantization parameter selecting method applied to multi-viewpoint video coding system | |
| CN110602506A (en) | Video processing method, network device and computer readable storage medium | |
| CN112468806A (en) | Panoramic video transmission optimization method for cloud VR platform | |
| Tizon et al. | ROI based video streaming for 3D remote rendering | |
| Marvie et al. | Remote rendering of massively textured 3D scenes through progressive texture maps | |
| Shi et al. | Towards Full-scene Volumetric Video Streaming via Spatially Layered Representation and NeRF Generation | |
| Deb | RemoteVIS: A Remote Rendering System | |
| JPH04126484A (en) | Picture communication equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |