CN117651105A - Audio and video synchronous playing method for spliced screen - Google Patents
Audio and video synchronous playing method for spliced screen Download PDFInfo
- Publication number
- CN117651105A CN117651105A CN202311359926.5A CN202311359926A CN117651105A CN 117651105 A CN117651105 A CN 117651105A CN 202311359926 A CN202311359926 A CN 202311359926A CN 117651105 A CN117651105 A CN 117651105A
- Authority
- CN
- China
- Prior art keywords
- screen
- sub
- synchronous
- state
- image analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000001360 synchronised effect Effects 0.000 title claims abstract description 176
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000010191 image analysis Methods 0.000 claims abstract description 82
- 238000001514 detection method Methods 0.000 claims abstract description 56
- 230000000694 effects Effects 0.000 claims abstract description 44
- 238000012544 monitoring process Methods 0.000 claims abstract description 31
- 238000004458 analytical method Methods 0.000 claims abstract description 28
- 238000012545 processing Methods 0.000 claims abstract description 28
- 239000000284 extract Substances 0.000 claims abstract description 10
- 230000001105 regulatory effect Effects 0.000 claims abstract description 10
- 238000001816 cooling Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 3
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 238000013527 convolutional neural network Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Landscapes
- Closed-Circuit Television Systems (AREA)
Abstract
The invention relates to the field of image analysis, in particular to an audio and video synchronous playing method of a spliced screen, which comprises the following steps: extracting an occupied screen state of a target screen to determine an analysis mode; in a first analysis mode, detecting the motion activity of a target monitoring body in a target screen by an image analysis unit, and determining whether to adjust the synchronous detection quantity according to the motion activity; in the second analysis mode, the image analysis unit detects the association degree of the sub-screens and determines whether to adjust the synchronous detection quantity according to the association degree of the sub-screens; the synchronization detection quantity is determined, and the synchronization regulating unit sequentially extracts the time stamp of a single sub-screen to be synchronized and determines a synchronization regulating mode according to the time difference state; all the sub-screens to be synchronized are subjected to time adjustment processing, and the time adjustment processing is performed on the non-adjusted sub-screens by taking the time stamp of the standard sub-screen as a standard; the invention improves the video synchronization effect when the spliced screen is applied to security monitoring, and reduces the data processing amount of the same time period.
Description
Technical Field
The invention relates to the field of image analysis, in particular to an audio and video synchronous playing method of a spliced screen.
Background
The spliced screen is a large display system formed by combining a plurality of plane display units. They are seamlessly stitched together to form a continuous large screen that can display larger, higher resolution images or videos. Along with the continuous construction of heavy industry infrastructures and public services such as safe cities, intelligent transportation, smart cities and the like, unified management of huge monitoring videos is important, so that the spliced screen is widely used in security and protection applications, but in the use process, the problem that images are not synchronously played among display units due to parameter differences among the display units and working environments is often caused.
Chinese patent publication No. CN114816286a discloses a method for synchronously displaying a split screen, an electronic device, and a split screen system including an electronic device having a photographing function and a split screen including a plurality of sub-screens, the method comprising: the method comprises the steps that in the process of transmitting video streams to all sub-screens, the electronic equipment adds time marks on a plurality of target video frames of the video streams; each sub-screen synchronously displays a corresponding time mark when displaying the target video frame; then, the electronic equipment shoots a screen image of the spliced screen, determines delay display time of each sub-screen according to a time mark displayed by each sub-screen in the screen image, and then sends corresponding delay display time to each sub-screen; and after each sub-screen receives the delay display time, displaying the video frames to be displayed after the delay display time. However, when the application scene is large-area monitoring security, the technical means for performing delay display time analysis on each sub-screen in the scheme has the problem of large data processing amount, and the improvement of the display effect of effective monitoring information is not obvious.
Disclosure of Invention
Therefore, the invention provides an audio and video synchronous playing method of a spliced screen, which is used for solving the problems that the spliced screen applied to large-area monitoring security in the prior art has large data processing amount and poor security effect due to the technical means of analyzing all sub-screens.
In order to achieve the above object, the present invention provides an audio/video synchronous playing method for a spliced screen, including:
extracting an occupied screen state of a target screen to determine an analysis mode;
in response to the first occupied screen state, adopting a first analysis mode for analyzing the motion activity of the target monitoring body of the target screen;
responding to the second occupied screen state, and adopting a second analysis mode for analyzing the sub-screen association degree of the target screen;
in a first analysis mode, detecting the motion activity of a target monitoring body in a target screen by an image analysis unit, and determining whether to adjust the synchronous detection quantity according to the motion activity;
in the second analysis mode, the image analysis unit detects the association degree of the sub-screens and determines whether to adjust the synchronous detection quantity according to the association degree of the sub-screens;
the synchronization detection quantity is determined, and the synchronization regulating unit sequentially extracts the time stamp of a single sub-screen to be synchronized and determines a synchronization regulating mode according to the time difference state;
responding to a first synchronization adjustment mode, determining a standard sub-screen according to a preset calibration rule when the time difference state is in the first time difference state, and performing timing processing on other sub-screens to be synchronized except the standard sub-screen;
responding to the second synchronous adjustment mode, adopting the first synchronous adjustment mode to perform timing adjustment, and performing adjustment of the cooling device according to the temperature of the sub-screen to be synchronized;
and (3) completing the time adjustment processing of all the sub-screens to be synchronized, and performing the time adjustment processing on the unregulated sub-screens by taking the time stamp of the standard sub-screen as the standard.
Further, the image analysis unit extracts an occupied screen state of the target screen under the first image analysis condition to determine an analysis mode, the analysis mode including:
the motion activity of the target monitor of the target screen with the occupied screen state in the first occupied screen state is analyzed,
or analyzing the sub-screen association degree of the target screen with the occupied screen state in the second occupied screen state;
the first occupied screen state is that the occupied amount of the sub-screen of the target screen is 1, the second occupied screen state is that the occupied amount of the sub-screen of the target screen is greater than 1, and the first image analysis condition is that a target monitor exists in the target screen.
Further, the image analysis unit detects the motion activity of the target monitoring body in the target screen under the second image analysis condition, and determines whether to adjust the synchronous detection quantity according to the motion activity, wherein when the motion activity is in a first preset motion activity range, the image analysis unit judges that the synchronous image detection quantity is the quantity of all the sub-screens;
or when the motion activity is in a second preset motion activity range, the image analysis unit judges that the synchronous image detection quantity is determined according to the difference value between the image duty ratio of the target monitoring body and the preset image duty ratio;
the second image analysis condition is that the occupied screen state of the target screen is in the first occupied screen state.
Further, the image analysis unit calculates the difference between the image duty ratio of the target monitoring body and the preset image duty ratio under the third image analysis condition, marks the difference as the duty ratio difference, the image analysis unit determines the synchronous image detection quantity according to the duty ratio difference,
the detection quantity of the synchronous images and the duty ratio difference value are in positive correlation;
the third image analysis condition is that the image analysis unit judges that the synchronous image detection quantity is determined according to the difference value between the image duty ratio of the target monitoring body and the preset image duty ratio.
Further, the image analysis unit detects the sub-screen association degree under the fourth image analysis condition and determines whether to adjust the synchronization detection number according to the sub-screen association degree, including: the image analysis unit judges that the synchronous detection quantity is not required to be adjusted when the sub-screen association degree is in a first preset association degree state,
when the association degree of the sub-screen is in a second preset association degree state, the image analysis unit judges that the synchronous detection quantity is determined according to the difference value between the association degree of the sub-screen and the preset association degree of the sub-screen;
and the fourth image analysis condition is that the occupied screen state of the target screen is in the second occupied screen state.
Further, the image analysis unit calculates the difference value between the association degree of the sub-screen and the association degree of the preset sub-screen under the fifth image analysis condition, marks the difference value as the association degree difference value, and the image analysis unit increases and adjusts the synchronous detection quantity according to the association degree difference value;
the correlation difference value and the increment of the synchronous detection quantity are in a negative correlation relationship;
and the fifth image analysis condition is that the association degree of the sub-screen is in a second preset association degree state.
Further, the synchronization adjustment unit sequentially extracts time stamps of the single sub-screen to be synchronized under a first synchronization adjustment condition and determines a synchronization adjustment mode according to a time difference state, and the method comprises the following steps:
the first synchronization adjustment mode is used for determining a standard sub-screen according to a preset calibration rule when the time difference state is in the first time difference state, and performing timing processing on other sub-screens to be synchronized except the standard sub-screen;
the second synchronous adjustment mode is adopted to carry out synchronous adjustment when the time difference state is in the second time difference state, and the adjustment treatment of the cooling device is carried out according to the temperature of the sub-screen to be synchronized;
wherein the first synchronization adjustment condition is that a sub-screen to be synchronized exists.
Further, the playing interval time length between at least two sub-screens to be synchronized in the first time difference state is longer than the preset interval time length, the playing interval time length between any two sub-screens to be synchronized in the second time difference state is smaller than or equal to the preset interval time length, and the standard sub-screen is the sub-screen to be synchronized with the largest image occupation ratio of the corresponding target monitoring body in each sub-screen to be synchronized.
Further, the synchronous adjusting unit detects the temperature of each sub-screen to be synchronized under the second synchronous adjusting condition, and performs power increase adjustment on the refrigerating device corresponding to the sub-screen to be synchronized according to the temperature of each sub-screen to be synchronized;
the temperature of a single sub-screen to be synchronized and the power increment of a refrigerating device corresponding to the sub-screen to be synchronized are in positive correlation;
the third synchronous regulation condition is that the time difference state is in a second time difference state.
Further, the synchronization adjusting unit performs timing processing on all the unadjusted sub-screens with respect to the time stamps of the standard sub-screens as a standard under a third synchronization adjusting condition;
the third synchronization adjustment condition is that timing processing for all sub-screens to be synchronized is completed.
Compared with the prior art, the method has the advantages that the analysis mode selection is carried out according to the occupied screen state of the target screen, the analysis mode is single for all screens, the image analysis unit detects the motion activity of the target monitoring body in the target screen under the second image analysis condition and determines whether the synchronous detection quantity is regulated according to the motion activity, so that the synchronous detection quantity is more in line with the actual working scene, the excessive data processing capacity is avoided, and similarly, the image analysis unit detects the sub-screen association degree under the fourth image analysis condition and determines whether the synchronous detection quantity is regulated according to the sub-screen association degree, so that the synchronous detection quantity is accurate under different states, finally, in the second synchronous regulation mode, the first synchronous regulation mode is adopted for synchronous regulation under the second time difference state, the regulation treatment of the cooling device is carried out according to the temperature of the sub-screen to be synchronized, the display delay caused by the reduction of the screen performance is avoided, and the display effect of the spliced screen in the security field is further improved.
Drawings
Fig. 1 is a schematic diagram of an audio and video synchronous playing method of a spliced screen according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating an image analysis unit extracting an occupied screen state of a target screen to determine an analysis mode according to an embodiment of the present invention;
FIG. 3 is a flowchart of an image analysis unit according to an embodiment of the present invention for determining whether to adjust the number of synchronous detections according to the activity level;
fig. 4 is a flowchart of determining a synchronization adjustment mode according to a time difference state by the synchronization adjustment unit according to an embodiment of the present invention.
Detailed Description
In order that the objects and advantages of the invention will become more apparent, the invention will be further described with reference to the following examples; it should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are merely for explaining the technical principles of the present invention, and are not intended to limit the scope of the present invention.
It should be noted that, in the description of the present invention, terms such as "upper," "lower," "left," "right," "inner," "outer," and the like indicate directions or positional relationships based on the directions or positional relationships shown in the drawings, which are merely for convenience of description, and do not indicate or imply that the apparatus or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.
Furthermore, it should be noted that, in the description of the present invention, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those skilled in the art according to the specific circumstances.
Referring to fig. 1, which is a schematic diagram of an audio/video synchronous playing method of a spliced screen according to an embodiment of the present invention, the present invention provides an audio/video synchronous playing method of a spliced screen, including:
extracting an occupied screen state of a target screen to determine an analysis mode;
in response to the first occupied screen state, adopting a first analysis mode for analyzing the motion activity of the target monitoring body of the target screen;
responding to the second occupied screen state, and adopting a second analysis mode for analyzing the sub-screen association degree of the target screen;
in a first analysis mode, detecting the motion activity of a target monitoring body in a target screen by an image analysis unit, and determining whether to adjust the synchronous detection quantity according to the motion activity;
in the second analysis mode, the image analysis unit detects the association degree of the sub-screens and determines whether to adjust the synchronous detection quantity according to the association degree of the sub-screens;
the synchronization detection quantity is determined, and the synchronization regulating unit sequentially extracts the time stamp of a single sub-screen to be synchronized and determines a synchronization regulating mode according to the time difference state;
responding to a first synchronization adjustment mode, determining a standard sub-screen according to a preset calibration rule when the time difference state is in the first time difference state, and performing timing processing on other sub-screens to be synchronized except the standard sub-screen;
responding to the second synchronous adjustment mode, adopting the first synchronous adjustment mode to perform timing adjustment, and performing adjustment of the cooling device according to the temperature of the sub-screen to be synchronized;
and (3) completing the time adjustment processing of all the sub-screens to be synchronized, and performing the time adjustment processing on the unregulated sub-screens by taking the time stamp of the standard sub-screen as the standard.
Specifically, a single target screen is composed of a plurality of sub-screens, each of which is identical in shape and size.
Referring to fig. 1 to 4, the image analysis unit extracts an occupied screen state of a target screen under a first image analysis condition to determine an analysis mode, the analysis mode including:
the motion activity of the target monitor of the target screen with the occupied screen state in the first occupied screen state is analyzed,
or analyzing the sub-screen association degree of the target screen with the occupied screen state in the second occupied screen state;
the first occupied screen state is that the occupied amount of the sub-screen of the target screen is 1, the second occupied screen state is that the occupied amount of the sub-screen of the target screen is greater than 1, and the first image analysis condition is that a target monitor exists in the target screen.
Specifically, the sub-screen occupation amount is the number of sub-screens in which the target monitor exists.
Specifically, the image analysis unit periodically monitors whether a target monitor exists in the target screen, wherein the target monitor is a human body, and the method for identifying whether the human body exists in the image is the prior art, and the method for identifying whether the human body exists in the image includes but is not limited to:
for human body detection, a pre-trained convolutional neural network model, such as Faster R-CNN, can be used for target detection and positioning, and features and modes of a human body can be accurately detected in an image by training on a large-scale data set and learning and identifying the features and modes of the human body, which is understood by those skilled in the art and is not described herein.
Specifically, the image analysis unit detects the motion activity of a target monitoring body in a target screen under a second image analysis condition, and determines whether to adjust the synchronous detection quantity according to the motion activity, wherein when the motion activity is in a first preset motion activity range, the image analysis unit judges that the synchronous image detection quantity is the quantity of all the sub-screens;
or when the motion activity is in a second preset motion activity range, the image analysis unit judges that the synchronous image detection quantity is determined according to the difference value between the image duty ratio of the target monitoring body and the preset image duty ratio;
the second image analysis condition is that the occupied screen state of the target screen is in the first occupied screen state.
Specifically, the motion activity of the single sub-screen is the maximum displacement of a single target monitoring body in the sub-screen in unit time in the sub-screen, the first preset motion activity range and the second preset motion activity range are set in relation to the maximum diagonal length of the single sub-screen, the values in the first preset motion activity range are all greater than 50% of the maximum diagonal length, and the values in the second preset motion activity range are all less than or equal to 50% of the maximum diagonal length.
Specifically, the image analysis unit calculates the difference between the image duty ratio of the target monitoring body and the preset image duty ratio under the third image analysis condition, marks the difference as the duty ratio difference, the image analysis unit determines the synchronous image detection quantity according to the duty ratio difference,
the detection quantity of the synchronous images and the duty ratio difference value are in positive correlation;
the third image analysis condition is that the image analysis unit judges that the synchronous image detection quantity is determined according to the difference value between the image duty ratio of the target monitoring body and the preset image duty ratio.
Specifically, the duty ratio difference is a value obtained by subtracting a preset image duty ratio from an image duty ratio of a target monitoring body, if the duty ratio difference is greater than 0, the detection quantity of the synchronous images is increased and adjusted, and the increase quantity N and the duty ratio difference are in positive correlation; if the difference of the duty ratios is smaller than or equal to 0, no adjustment is needed, and the preset image duty ratio is 50% of the area of the single sub-screen; the method comprises the steps that the detection quantity of synchronous images before adjustment is the quantity of screens to be synchronized, the sub-screens with target monitoring bodies are recorded as the screens to be synchronized, the increase of the detection quantity of the synchronous images is sequentially adjusted according to the increase quantity of each screen to be synchronized, namely, the sub-screens which correspond to a single screen to be synchronized and are adjacent to the screen to be synchronized and are not provided with the target monitoring bodies are recorded as the screens to be synchronized and are supplemented to the detection quantity of the synchronous images until the quantity of the supplemented screens which correspond to the single screen to be synchronized reaches N, wherein the maximum value of N is smaller than or equal to 8, and when the quantity of the supplemented screens which correspond to the single screen to be synchronized reaches N, or the quantity of the sub-screens which correspond to the single screen to be synchronized and are adjacent to the screen to be synchronized and are not provided with the target monitoring bodies is smaller than N, the increase quantity adjustment of the single screen to be synchronized is judged to be completed.
Specifically, the image analysis unit detects the sub-screen association degree under the fourth image analysis condition and determines whether to adjust the synchronization detection number according to the sub-screen association degree, including: the image analysis unit judges that the synchronous detection quantity is not required to be adjusted when the sub-screen association degree is in a first preset association degree state,
when the association degree of the sub-screen is in a second preset association degree state, the image analysis unit judges that the synchronous detection quantity is determined according to the difference value between the association degree of the sub-screen and the preset association degree of the sub-screen;
and the fourth image analysis condition is that the occupied screen state of the target screen is in the second occupied screen state.
Specifically, the calculation formula of the screen association degree K is:
wherein Ki is the number of adjacent sub-screens to be synchronized of the ith sub-screen to be synchronized, i=1, 2,3, … …, imax, imax is the total number of sub-screens to be synchronized, K in the first preset association state is greater than or equal to 6, and K in the second preset association state is less than 6.
Specifically, the image analysis unit calculates the difference value between the association degree of the sub-screen and the association degree of a preset sub-screen under the fifth image analysis condition, marks the difference value as the association degree difference value, and increases and adjusts the synchronous detection quantity according to the association degree difference value;
the correlation difference value and the increment of the synchronous detection quantity are in a negative correlation relationship;
the fifth image analysis condition is that the association degree of the sub-screen is in a second preset association degree state, the preset association degree difference value is 6, and the association degree difference value is a value obtained by subtracting the preset sub-screen association degree from the sub-screen association degree.
Specifically, the synchronization adjustment unit sequentially extracts time stamps of a single sub-screen to be synchronized under a first synchronization adjustment condition and determines a synchronization adjustment mode according to a time difference state, and the method includes:
the first synchronization adjustment mode is used for determining a standard sub-screen according to a preset calibration rule when the time difference state is in the first time difference state, and performing timing processing on other sub-screens to be synchronized except the standard sub-screen;
the second synchronous adjustment mode is adopted to carry out synchronous adjustment when the time difference state is in the second time difference state, and the adjustment treatment of the cooling device is carried out according to the temperature of the sub-screen to be synchronized;
wherein the first synchronization adjustment condition is that a sub-screen to be synchronized exists.
Specifically, each sub-screen corresponds to a time stamp, and is configured to display an acquisition time corresponding to a currently played video in the sub-screen, and determine, by using a computer, a time playing interval duration between the sub-screens to be synchronized, where, for example, the current time stamp in the sub-screen X1 is displayed as a year B, month C, day 11:30, the current timestamp in sub-screen X2 is displayed as A year B month C day 11:31, the interval duration corresponding to the two sub-screens is 1 minute;
the time adjustment processing for other sub-screens to be synchronized except the standard sub-screen is as follows: taking the standard sub-screen as a reference standard, synchronizing the other sub-screens to be synchronized with the playing of the standard sub-screen by adjusting the delay, and synchronizing the playing of one screen with the playing of the other screen by adjusting the delay, which is common knowledge in the art and will not be repeated herein.
Specifically, the play interval time length between at least two sub-screens to be synchronized in the first time difference state is longer than the preset interval time length, the play interval time length between any two sub-screens to be synchronized in the second time difference state is smaller than or equal to the preset interval time length, the play interval time length between at least two sub-screens to be synchronized is not 0, the preset calibration rule is to record the sub-screen to be synchronized with the largest image proportion of the corresponding target monitor in each sub-screen to be synchronized as the standard sub-screen, the value of the preset interval time length can be determined by a user according to the monitoring requirement, the larger the monitoring requirement is, the smaller the preset interval time length is, the value of the preset interval time length is provided, the value of the preset interval time length is 30s, and note that the time adjustment processing only needs to adjust the sub-screen to be synchronized with the interval time length of the standard sub-screen not being 0 is needed.
Specifically, the synchronous adjusting unit detects the temperature of each sub-screen to be synchronized under the second synchronous adjusting condition, and performs power increase adjustment on the refrigerating device corresponding to the sub-screen to be synchronized according to the temperature of each sub-screen to be synchronized;
the temperature of a single sub-screen to be synchronized and the power increment of a refrigerating device corresponding to the sub-screen to be synchronized are in positive correlation;
the third synchronous regulation condition is that the time difference state is in a second time difference state.
Specifically, the synchronization adjustment unit performs timing processing on all the unregulated sub-screens with respect to the time stamps of the standard sub-screens as a standard under a third synchronization adjustment condition;
the third synchronization adjustment condition is that timing processing for all sub-screens to be synchronized is completed.
Specifically, when all the sub-screens realize synchronous playing, audio and video synchronous processing is carried out aiming at the target screen, wherein the audio and video synchronous processing relates to ensuring that audio and video are kept synchronous during playing, and the situation that the audio and the video are not matched or delayed is avoided. An audio and video synchronous processing method is provided, time alignment is realized, and the audio and video can be synchronized when played by adjusting the starting time of the audio and video. The audio and video files may be aligned using specialized video editing software or audio editing software. This is a matter that is easily understood by those skilled in the art and will not be described here in detail.
Thus far, the technical solution of the present invention has been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of protection of the present invention is not limited to these specific embodiments. Equivalent modifications and substitutions for related technical features may be made by those skilled in the art without departing from the principles of the present invention, and such modifications and substitutions will be within the scope of the present invention.
The foregoing description is only of the preferred embodiments of the invention and is not intended to limit the invention; various modifications and variations of the present invention will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. An audio and video synchronous playing method of a spliced screen is characterized by comprising the following steps:
extracting an occupied screen state of a target screen to determine an analysis mode;
in response to the first occupied screen state, adopting a first analysis mode for analyzing the motion activity of the target monitoring body of the target screen;
responding to the second occupied screen state, and adopting a second analysis mode for analyzing the sub-screen association degree of the target screen;
in a first analysis mode, detecting the motion activity of a target monitoring body in a target screen by an image analysis unit, and determining whether to adjust the synchronous detection quantity according to the motion activity;
in the second analysis mode, the image analysis unit detects the association degree of the sub-screens and determines whether to adjust the synchronous detection quantity according to the association degree of the sub-screens;
the synchronization detection quantity is determined, and the synchronization regulating unit sequentially extracts the time stamp of a single sub-screen to be synchronized and determines a synchronization regulating mode according to the time difference state;
responding to a first synchronization adjustment mode, determining a standard sub-screen according to a preset calibration rule when the time difference state is in the first time difference state, and performing timing processing on other sub-screens to be synchronized except the standard sub-screen;
responding to the second synchronous adjustment mode, adopting the first synchronous adjustment mode to perform timing adjustment, and performing adjustment of the cooling device according to the temperature of the sub-screen to be synchronized;
and (3) completing the time adjustment processing of all the sub-screens to be synchronized, and performing the time adjustment processing on the unregulated sub-screens by taking the time stamp of the standard sub-screen as the standard.
2. The audio and video synchronized playback method of a stitched screen of claim 1, wherein the image analysis unit extracts an occupied screen state of the target screen under a first image analysis condition to determine an analysis mode, the analysis mode comprising:
the motion activity of the target monitor of the target screen with the occupied screen state in the first occupied screen state is analyzed,
or analyzing the sub-screen association degree of the target screen with the occupied screen state in the second occupied screen state;
the first occupied screen state is that the occupied amount of the sub-screen of the target screen is 1, the second occupied screen state is that the occupied amount of the sub-screen of the target screen is greater than 1, and the first image analysis condition is that a target monitor exists in the target screen.
3. The audio and video synchronous playing method of a spliced screen according to claim 2, wherein the image analysis unit detects the motion activity of a target monitor in a target screen under a second image analysis condition, and determines whether to adjust the synchronous detection number according to the motion activity, wherein when the motion activity is in a first preset motion activity range, the image analysis unit determines that the synchronous image detection number is the number of all the sub-screens;
or when the motion activity is in a second preset motion activity range, the image analysis unit judges that the synchronous image detection quantity is determined according to the difference value between the image duty ratio of the target monitoring body and the preset image duty ratio;
the second image analysis condition is that the occupied screen state of the target screen is in the first occupied screen state.
4. The audio/video synchronous playing method of the spliced screen according to claim 3, wherein the image analysis unit calculates a difference between the image duty ratio of the target monitor and a preset image duty ratio under a third image analysis condition, marks the difference as a duty ratio difference, the image analysis unit determines the detection number of the synchronous images according to the duty ratio difference,
the detection quantity of the synchronous images and the duty ratio difference value are in positive correlation;
the third image analysis condition is that the image analysis unit judges that the synchronous image detection quantity is determined according to the difference value between the image duty ratio of the target monitoring body and the preset image duty ratio.
5. The method for audio and video synchronous playback of a stitched screen according to claim 4, wherein the image analysis unit detecting a sub-screen association degree under a fourth image analysis condition and determining whether to adjust the synchronous detection amount according to the sub-screen association degree, comprises: the image analysis unit judges that the synchronous detection quantity is not required to be adjusted when the sub-screen association degree is in a first preset association degree state,
when the association degree of the sub-screen is in a second preset association degree state, the image analysis unit judges that the synchronous detection quantity is determined according to the difference value between the association degree of the sub-screen and the preset association degree of the sub-screen;
and the fourth image analysis condition is that the occupied screen state of the target screen is in the second occupied screen state.
6. The audio and video synchronous playing method of the spliced screen according to claim 5, wherein the image analysis unit calculates a difference value between the association degree of the sub-screen and the association degree of a preset sub-screen under a fifth image analysis condition, marks the difference value as an association degree difference value, and the image analysis unit increases and adjusts the synchronous detection quantity according to the association degree difference value;
the correlation difference value and the increment of the synchronous detection quantity are in a negative correlation relationship;
and the fifth image analysis condition is that the association degree of the sub-screen is in a second preset association degree state.
7. The method for synchronously playing audio and video on a spliced screen according to claim 6, wherein the synchronous adjusting unit sequentially extracts time stamps of individual sub-screens to be synchronized under a first synchronous adjusting condition and determines a synchronous adjusting mode according to a time difference state, and the method comprises the steps of:
the first synchronization adjustment mode is used for determining a standard sub-screen according to a preset calibration rule when the time difference state is in the first time difference state, and performing timing processing on other sub-screens to be synchronized except the standard sub-screen;
the second synchronous adjustment mode is adopted to carry out synchronous adjustment when the time difference state is in the second time difference state, and the adjustment treatment of the cooling device is carried out according to the temperature of the sub-screen to be synchronized;
wherein the first synchronization adjustment condition is that a sub-screen to be synchronized exists.
8. The method for synchronously playing audio and video on a spliced screen according to claim 7, wherein a playing interval time length between at least two sub-screens to be synchronized in the first time difference state is longer than a preset interval time length, a playing interval time length between any two sub-screens to be synchronized in the second time difference state is smaller than or equal to the preset interval time length, and the standard sub-screen is a sub-screen to be synchronized with the largest image occupation ratio of a corresponding target monitor in each sub-screen to be synchronized.
9. The audio and video synchronous playing method of the spliced screen according to claim 8, wherein the synchronous adjusting unit detects the temperature of each sub-screen to be synchronized under the second synchronous adjusting condition, and performs power increase adjustment on the refrigerating device corresponding to the sub-screen to be synchronized according to the temperature of each sub-screen to be synchronized;
the temperature of a single sub-screen to be synchronized and the power increment of a refrigerating device corresponding to the sub-screen to be synchronized are in positive correlation;
the third synchronous regulation condition is that the time difference state is in a second time difference state.
10. The audio/video synchronous playing method of a spliced screen according to claim 9, wherein the synchronous adjusting unit performs timing processing on all the unregulated sub-screens with respect to the time stamp of the standard sub-screen as a standard under a third synchronous adjusting condition;
the third synchronization adjustment condition is that timing processing for all sub-screens to be synchronized is completed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311359926.5A CN117651105A (en) | 2023-10-19 | 2023-10-19 | Audio and video synchronous playing method for spliced screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311359926.5A CN117651105A (en) | 2023-10-19 | 2023-10-19 | Audio and video synchronous playing method for spliced screen |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117651105A true CN117651105A (en) | 2024-03-05 |
Family
ID=90046714
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311359926.5A Pending CN117651105A (en) | 2023-10-19 | 2023-10-19 | Audio and video synchronous playing method for spliced screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117651105A (en) |
-
2023
- 2023-10-19 CN CN202311359926.5A patent/CN117651105A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9516225B2 (en) | Apparatus and method for panoramic video hosting | |
| EP3384495B1 (en) | Processing of multiple media streams | |
| CN103971090B (en) | Image processing apparatus, image capture apparatus and image processing method | |
| US20120170905A1 (en) | Systems and Methods for Presenting Incident Information | |
| CN110830756A (en) | Monitoring method and device | |
| US20100313214A1 (en) | Display system, system for measuring display effect, display method, method for measuring display effect, and recording medium | |
| WO2005027533A3 (en) | Computerized method and apparatus for determining field-of-view relationships among multiple image sensors | |
| Goldmann et al. | Temporal synchronization in stereoscopic video: Influence on quality of experience and automatic asynchrony detection | |
| CN103458267A (en) | Video picture quality subjective evaluation method and system | |
| CN101548546B (en) | Output apparatus, output method and program | |
| US20130088574A1 (en) | Detective Adjusting Apparatus for Stereoscopic Image and Related Method | |
| CN111629264B (en) | Web-based separate front-end image rendering method | |
| CN105872760A (en) | Video play monitoring method and device | |
| CN104349163A (en) | Measurement display device and measurement system for end-to-end video transmission delay | |
| KR20180078149A (en) | Method and system for playing back recorded video | |
| WO2018214520A1 (en) | Method and apparatus for synchronizing video data and exercise effect animation | |
| CN107809563A (en) | A kind of writing on the blackboard detecting system, method and device | |
| CN103065379A (en) | Intelligent video passenger-flow analyzing method and system | |
| US11924397B2 (en) | Generation and distribution of immersive media content from streams captured via distributed mobile devices | |
| CN103248855A (en) | Fixed seat-based lesson recording system, video processing device and lesson recording method | |
| CN117651105A (en) | Audio and video synchronous playing method for spliced screen | |
| CN111970484B (en) | Operation and maintenance system and operation and maintenance method suitable for video monitoring equipment | |
| US20230169767A1 (en) | Wireless transmission system and transmitting control device | |
| CN110766574B (en) | Remote teaching system and method | |
| CN116931864A (en) | Screen sharing method and intelligent interaction panel |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |