CN104869385A - Movie theatre multi-subtitle system based on psychological visual modulation display technology and method thereof - Google Patents

Abstract

The invention discloses a movie theatre multi-subtitle system based on the psychological visual modulation display technology and a method thereof. The system comprises a display device and an auxiliary watching device which is matched with the display device. A group of composition bases comprising video contents and different languages of subtitles are arranged according to specific time and space and played by the display device, and the composition bases played in any time and areas are common component parts of multiple images or component parts of one image. Time domain or spatial domain amplitude modulation is performed on the composition bases played by the display device by the auxiliary watching device. The modulated information is finally integrated into the required images in the human brain via a user human eye visual system. According to the characteristics of constantly increasing refresh frequency and spatial resolution of the existing display devices and the limited resolution of human eyes under certain observation distance, the display device and the auxiliary watching device which is matched with the display device and can be customized according to the requirements are adopted so that the movie theatre multi-subtitle system is realized.

Description

Based on the movie theatre multi-subtitle system and method for psycho-visual modulation Display Technique

Technical field

What the present invention relates to is the system of a kind of signal and technical field of image processing, specifically a kind of movie theatre multi-subtitle system and method for the psycho-visual modulation intelligence Display Technique based on Space-time Domain.

Background technology

In the international epoch, increasing international film festival worldwide holds.Foreign language movies just catches on.Different countryspectators' chance of together watching same film become many.Existing solution is the captions of the other Languages such as stacked on top English at native language captions.But there is drawback in this scheme: when the subtitle language quantity needing to show is more simultaneously, stacking captions may cover nearly half screen, affect the experience of spectators.Therefore need the multilingual caption system of movie theatre that a kind of better reservation viewing is experienced.

Along with the develop rapidly of Display Technique, nowadays the use projector equipment of cinema can provide the even higher refresh rate of 120Hz, and has very high resolution.But research display, the Time and place resolution capability of human visual system under certain viewing distance is limited.In time domain, human eye cannot differentiate the optical signalling exceeding critical flicker frequency (about 60Hz), and on spatial domain, under normal viewing distance, it cannot differentiate the image of picture element density more than 200PPI.

Summary of the invention

The present invention is directed to prior art above shortcomings, there is provided a kind of movie theatre multi-subtitle system and method based on psycho-visual modulation Display Technique, the mode of being modulated by spatial domain takes full advantage of the visual redundancy of high-definition display device and the statistic correlation of the display information content.

For achieving the above object, the present invention is by the following technical solutions:

A first aspect of the present invention, provides a kind of movie theatre multi-subtitle system based on psycho-visual modulation Display Technique, and this system comprises display unit and matches and the auxiliary viewing apparatus that can customize according to user's request; Wherein:

Described display unit, comprises video content and different language captions structure by one group figurebase broadcasts with specific Time and place arrangement, the structure that arbitrary time and region are play figurebase is the total part of many sub-pictures or the part of a sub-picture;

Described auxiliary viewing apparatus, to the structure that display unit is play figurebase group carries out time domain or spatial domain amplitude modulation(PAM), and the information after modulation is fused into the image needed for it eventually through user human visual system in human brain.

Preferably, described auxiliary viewing apparatus needs structure according to different user figurebase group is done different modulating and is fused into required captions and image by human visual system again.

Preferably, described auxiliary viewing apparatus, between the display surface and human eye of described display unit, realizes display unit tripe systems by regulating the light intensity delivery rate not in the same time and between region display surface and human eye figurethe time domain of base and spatial domain amplitude modulation(PAM).

Preferably, according to the video comprising different language captions of different user demands, the different auxiliary viewing apparatus of category of language quantity customization according to demand, thus realize the tripe systems to high-definition display device broadcasting figurebase carries out time domain or spatial domain amplitude modulation(PAM), makes the user of different language captions demand can watch from same display unit the video content comprising required language subtitle separately.

Preferably, between each auxiliary viewing apparatus independentground is to structure figurebase group carries out time domain or spatial domain amplitude modulation(PAM) respectively, this auxiliary viewing apparatus by the display surface of described display unit to the light of human eye from entirely intercepting, translucent to full by, i.e. the weighting of adjustment arbitrarily between 0 to 1, realizes structure figurethe amplitude modulation(PAM) of base group.

Preferably, each specific auxiliary viewing apparatus is looked figure, to structure figurethe tripe systems of base group figurebase has identical or different modulation weights.

Second aspect present invention, provides a kind of movie theatre video broadcasting method based on psycho-visual modulation, in the method: display unit broadcasts structure with certain time domain or spatial domain arrangement figurebase group X ₁, X ₂..., X _m, M is a positive integer, these structures figurebase group directly enters human eye after the time domain or spatial domain modulation of correspondence, is fused into required captions and video.

Describedly be fused into required captions and video refers to: the same structure that different user is presented display unit by different time domains or spatial domain modulation weight vectors figurebase group makes different time domains or spatial domain amplitude modulation(PAM) obtains with fusion the captions and video that oneself need, or is directly fused into video content by the user that bore hole is watched when not modulating.

Described structure figurebase group X ₁, X ₂..., X _m, M be more than or equal to 2 positive integer, correspondingly, structure figurethe image I containing different language captions that base group generates after the time domain or spatial domain modulation of the different weight of auxiliary viewing apparatus ₁, I ₂..., I _n, N is positive integer.And for bore hole user, the image that the signal fused of non-modulated becomes is I ₀.

For the user of the modulation glasses worn by demand customization, can weight vectors W be modulated by adjustment time domain or spatial domain and comprise the structure of different language captions and video figurebase group X ₁, X ₂..., X _madjust the content that it is watched.Described modulation weight vectors W, it is the capable M row of N, by M × N number of weights composition, wherein M and N corresponding and structure respectively figurethe quantity of base group quantity and different auxiliary viewing apparatus.Further, for the image I that each finally generates _i, all by structure figuremerging in human eye after different time domains or spatial domain modulation forms all elements in base group.Due to for display unit, the structure of broadcasting figurebase light intensity can not be negative value, namely must meet structure figurebasic matrix X non-negative.Simultaneously for auxiliary viewing apparatus, its index of modulation can only between zero and one, namely from entirely intercepting, translucent to full by.Said process specifically can be expressed as:

$I_i=\underset{j=1}{\overset{M}{\mathrm{\Σ}}}{X}_j{W}_j^i$

Wherein 1≤i≤N; 0≤X _j≤ 255

For the bore hole user without auxiliary viewing apparatus, it is looked figurefor all unmodulated structures figurethe superposition of base group, that is:

$I_0=\underset{j=1}{\overset{M}{\mathrm{\Σ}}}{X}_j$

Wherein 0≤X≤255

Therefore for whole system, see captions and the video content of required language separately by respective auxiliary viewing apparatus, demand solution following matrix nonnegative decomposition problem for making different user:

$\underset{X\·W}{\min }{\left|\right|I-\mathrm{XW}\left|\right|}_F$

Wherein 0≤W≤1; 0≤X≤255

Wherein: I is objective matrix, corresponding to bore hole with wear the target image that auxiliary viewing apparatus user sees, and W and X corresponding above-mentioned modulation weight vectors and structure respectively figurebase group matrix.

By trying to achieve the optimal solution of the problems referred to above, according to given demand image I, solve structure figurebase group X and weight vectors W corresponding with it, finally makes equation

Attain full and complete satisfaction.Wherein: (I ₀, I ₁..., I _n) correspond respectively to bore hole and wear the target image that auxiliary viewing apparatus user sees, and (X ₁, X ₂..., X _m) distinguish corresponding above-mentioned modulation weight vectors and structure figurebase group matrix, represent corresponding to seeing target image I _nuser to structure figurebase X _mmodulation weight.

A third aspect of the present invention, provides a kind of two language subtitle movie theatre Play Systems based on the modulation of spatial domain psycho-visual, the auxiliary viewing apparatus comprising display unit He match; Wherein:

Described display unit, comprises video content and different language captions structure by one group figurebase broadcasts with specific space arrangement, the structure that arbitrary region is play figurebase is the total part of many sub-pictures or the part of a sub-picture;

Described auxiliary viewing apparatus, to the structure that display unit is play figurebase group carries out spatial domain amplitude modulation(PAM), and the information after modulation is fused into the image needed for it eventually through user human visual system in human brain;

Described system realizes the function that multi-user watches simultaneously as required, two language subtitle is play simultaneously.

A fourth aspect of the present invention, provides a kind of three language subtitle movie theatre Play Systems based on temporal psycho-visual modulation, the auxiliary viewing apparatus comprising two projection display equipments He match; Wherein:

Described projection display equipment, comprises video content and different language captions structure by one group figurebase broadcasts with specific Time and place arrangement, the structure that arbitrary time and region are play figurebase is the total part of many sub-pictures or the part of a sub-picture, and the view field of two projection display equipments overlaps and aligns;

Described auxiliary viewing apparatus, to the structure that display unit is play figurebase group carries out time domain and spatial domain amplitude modulation(PAM), and the information after modulation is fused into the image needed for it eventually through user human visual system in human brain.

The function that three language subtitle are play simultaneously is watched as required the while that described system realizing multi-user.

Compared with prior art, the present invention has following beneficial effect:

The present invention combines the mental visual redundancy based on spatial domain, utilize the high refresh rate of modem display devices, high-resolution characteristic simultaneously, the display device of main flow on market is utilized to realize good multi-subtitle Presentation Function, less to hardware device performance requirement, movie theatre three caption playing system provided only needs the display unit of 120Hz to realize.And compared to traditional Subtitle Demonstration mode, the present invention can eliminate multi-subtitle superposition cause cover substance film, thus promote user viewing experience, meet internationalization film market demand.

Accompanying drawing explanation

By reading with reference to following accompanying drawingto the detailed description that non-limiting example is done, other features, objects and advantages of the present invention will become more obvious:

Fig. 1 is one embodiment of the invention schematic diagram;

Fig. 2 is the broadcasting exemplary plot that the zones of different of high refresh rate display unit in one embodiment of the invention plays specific composition base simultaneously.

Embodiment

Below in conjunction with specific embodiment, the present invention is described in detail.Following examples will contribute to those skilled in the art and understand the present invention further, but not limit the present invention in any form.It should be pointed out that to those skilled in the art, without departing from the inventive concept of the premise, some distortion and improvement can also be made.These all belong to protection scope of the present invention.

as Fig. 1shown in, a kind of movie theatre multi-subtitle system based on psycho-visual modulation Display Technique, the auxiliary viewing apparatus comprising display unit He match; Wherein:

Described display unit, comprises video content and different language captions structure by one group figurebase broadcasts with specific Time and place arrangement, the structure that arbitrary time and region are play figurebase is the total part of many sub-pictures or the part of a sub-picture;

Described auxiliary viewing apparatus, to the structure that display unit is play figurebase group carries out time domain or spatial domain amplitude modulation(PAM), and the information after modulation is fused into the image needed for it eventually through user human visual system in human brain.

Described display unit is high refresh rate and high-resolution display unit, and high refresh rate refers to that refreshing frequency is greater than or equal to 120Hz, and high pixel density refers to that picture element density is higher than 200PPI.

Said system of the present invention takes full advantage of the visual redundancy of high-definition display device and the statistic correlation of the display information content by the mode that spatial domain is modulated.

Said system of the present invention comprises video content and different language captions structure by one group figurebase is arranged in a high refresh rate and high-definition display device with specific Time and place and broadcasts.Be different from simple time domain or space-domain multiplexing display mode show multiple complete image simultaneously on screen, the structure that arbitrary time and region are play figurebase is the total part of many sub-pictures or the part of a sub-picture.

Said system of the present invention comprises video content and different language captions structure by one group figurebase is arranged in a high refresh rate and high-definition display device with specific Time and place and broadcasts.Be different from simple time domain or space-domain multiplexing display mode show multiple complete image simultaneously on screen, the structure that arbitrary time and region are play figurebase is the total part of many sub-pictures or the part of a sub-picture.Due to a series of structure comprising video content and different language captions figurebase group carries out different time domains and spatial domain amplitude modulation(PAM) can form different pictures, and multiple user can by the auxiliary viewing apparatus by respective demand customization to these structures figurebase group is done different modulating and is fused into required captions and image by the human visual system of oneself again.

The auxiliary viewing apparatus customized according to required subtitle language, at high refresh rate or between high-resolution display surface and human eye, realizes display unit tripe systems by regulating the light intensity delivery rate not in the same time and between region display surface and human eye figurethe time domain of base and spatial domain amplitude modulation(PAM).According to the video comprising different language captions of different user demands, category of language quantity customization difference can assist viewing apparatus according to demand, thus realize the tripe systems to high-definition display device broadcasting figurebase carries out time domain or spatial domain amplitude modulation(PAM), makes the user of different language captions demand can watch from same display unit the video content comprising required language subtitle separately.

Described auxiliary viewing apparatus in units of pixel or block of pixels, between constituent parts independentground is to structure figurebase group carries out time domain or spatial domain amplitude modulation(PAM) respectively.Further, this auxiliary viewing apparatus by display surface to the light of human eye from complete intercepting, translucent to full by, i.e. the weighting of adjustment arbitrarily between 0 to 1, realizes structure figurethe amplitude modulation(PAM) of base group.Further, each specific auxiliary viewing apparatus is looked figure, to structure figurethe tripe systems of base group figurebase can have different modulation weights.As an optimal way, auxiliary viewing apparatus can be light intensity adjusting device, the active LCD panel of the such as corresponding right and left eyes of two panels difference or passive polarized lenses, described active LCD panel is by realizing wired or wireless synchronous with high speed display unit, and the light simultaneously sent the display unit different pixels matched or block of pixels according to demand carries out the polarization of different directions.This light intensity adjusting device sends polarisation of light direction angulation and LCD panel light transmittance, modulation weight as required by changing with display unit, complete intercept full by between regulate its light transmittance arbitrarily.

As another embodiment, provide a kind of movie theatre video broadcasting method based on psycho-visual modulation, display unit is by broadcasting structure with certain time domain or spatial domain arrangement figurebase group X ₁, X ₂..., X _m, M is a positive integer, these structures figurebase group is through time domain/spatial domain modulation or directly enter human eye, is fused into required captions and video.

In the method, the same structure that different user is presented display unit by different time domains or spatial domain modulation weight vectors figurebase group makes different time domains or spatial domain amplitude modulation(PAM) obtains with fusion the captions and video that oneself need, or is directly fused into video content by the user that bore hole is watched when not modulating.

Described structure figurebase group X ₁, X ₂..., X _m, M be more than or equal to 2 positive integer, correspondingly, structure figurethe image I containing different language captions that base group generates after the time domain or spatial domain modulation of the different weight of auxiliary viewing apparatus ₁, I ₂..., I _n, N is positive integer.And for bore hole user, the image that the signal fused of non-modulated becomes is I ₀.

By adjustment spatial domain modulation weight vectors W and structure figurebase group X1, X2 ..., XM realizes.Described modulation weight vectors W, it is the capable M row of N, is made up of M × N number of weights, wherein M and N corresponding and structure respectively figurethe quantity of base group quantity and different auxiliary viewing apparatus.

For the user of the modulation glasses worn by demand customization, can weight vectors W be modulated by adjustment time domain or spatial domain and comprise the structure of different language captions and video figurebase group X ₁, X ₂..., X _madjust the content that it is watched.Described modulation weight vectors W, it is the capable M row of N, by M × N number of weights composition, wherein M and N corresponding and structure respectively figurethe quantity of base group quantity and different auxiliary viewing apparatus.Further, for the image I that each finally generates _i, all by structure figuremerging in human eye after different time domains or spatial domain modulation forms all elements in base group.Due to for display unit, the structure of broadcasting figurebase light intensity can not be negative value, namely must meet X non-negative.Simultaneously for auxiliary viewing apparatus, its index of modulation can only between zero and one, namely from entirely intercepting, translucent to full by.Said process specifically can be expressed as:

$I_i=\underset{j=1}{\overset{M}{\mathrm{\Σ}}}{X}_j{W}_j^i$

Wherein 1≤i≤N; 0≤X _j≤ 255

For the bore hole user without auxiliary viewing apparatus, it is looked figurefor all unmodulated structures figurethe superposition of base group, that is:

$I_0=\underset{j=1}{\overset{M}{\mathrm{\Σ}}}{X}_j$

Wherein 0≤X≤255

Captions and the video content of required language is separately seen by respective auxiliary viewing apparatus, demand solution following matrix nonnegative decomposition problem for making different user:

$\underset{X\·W}{\min }{\left|\right|\mathrm{sI}-\mathrm{XW}\left|\right|}_F$

Wherein 0≤W≤1; 0≤X≤255

By trying to achieve the optimal solution of the problems referred to above, according to given demand image I, solve structure figurebase group X and weight vectors W corresponding with it, finally makes equation

As another embodiment, there is provided a kind of two language subtitle movie theatre Play Systems based on the modulation of spatial domain psycho-visual, this system comprises: display unit and the auxiliary viewing apparatus matched of high pixel density (picture element density is higher than the equipment of 200PPI); Wherein:

Described display unit, comprises video content and different language captions structure by one group figurebase broadcasts with specific space arrangement, the structure that arbitrary region is play figurebase is the total part of many sub-pictures or the part of a sub-picture;

Described auxiliary viewing apparatus, to the structure that display unit is play figurebase group carries out spatial domain amplitude modulation(PAM), and the information after modulation is fused into the image needed for it eventually through user human visual system in human brain.

Described system realizes the function that multi-user watches two kinds of different language captions movie theatres broadcastings simultaneously as required.

According to based on spatial domain psycho-visual modulation intelligence Display Technique, two language subtitle simultaneously playing function can by the image I comprising different language captions set according to demand ₀, I ₁, solve following matrix nonnegative decomposition problem

$I_i=\underset{j=1}{\overset{2}{\mathrm{\Σ}}}{X}_j{W}_j^i$

Wherein 1≤i≤N; 0≤X _j≤ 255

Wherein: I is objective matrix, corresponding to bore hole with wear the target image that auxiliary viewing apparatus user sees, and W and X corresponding above-mentioned modulation weight vectors and structure respectively figurebase group matrix.W _j ⁱrepresent corresponding to seeing target image I _iuser to structure figurebase X _jmodulation weight.

Structure is determined by calculating figurebase group matrix X=(X ₁, X ₂) and the modulation weight matrix of corresponding each auxiliary viewing apparatus $\left(\begin{array}{cc}{W_1}^0& {W_1}^1\\ {W_2}^0& {W_2}^1\end{array}\right)$ Middle all elements W _j ⁱvalue.The different pixels block of specific high-definition display device is utilized to play tripe systems respectively figurebase, can make the user of the auxiliary viewing apparatus wearing coupling and directly observe corresponding required image I respectively by bore hole simultaneously ₁with I ₀.Therefore above-mentioned matrix nonnegative decomposition problem can be converted into linear system:

$(I_0,I_1)=(X_1,X_2)\left(\begin{array}{cc}{W_1}^0& {W_1}^1\\ {W_2}^0& {W_2}^1\end{array}\right)$

Wherein: I ₀with I ₁for corresponding to bore hole and wearing the target image that auxiliary viewing apparatus user sees, and W and X corresponding above-mentioned modulation weight structure respectively figurebase group matrix.

For this system, make the zones of different of high-definition display device play specific structure simultaneously figurebase group X ₁, X ₂, described modulation weights W _j ⁱ, namely to tripe systems figurescreen area corresponding to base carries out specific spatial domain amplitude modulation(PAM).Preferably, the polarization type similar to passive type 3D Display Technique can be utilized to modulate, the light sent display unit zones of different carries out the Polarization Modulation of different angles, adopts the polarized lenses in different polarization direction as auxiliary viewing apparatus simultaneously.By changing the angle in auxiliary viewing apparatus eyeglass polarization direction and polarisation of light direction, corresponding region, if direction is identical, be full by, i.e. W _j ⁱ=1; If orthogonal thereto direction, be full obstruct, i.e. W _j ⁱ=0.Modulation weights W can be regulated by regulating this angle _j ⁱsize be arbitrary value from 0 to 1.For the polarization type modulating system on market, only provide polarization direction identical and orthogonal two kinds of patterns, even the light of respective regions full by or entirely intercept.Therefore for above-mentioned linear system, directly separate for one group and be:

$\left(\begin{array}{cc}{W_1}^0& {W_1}^1\\ {W_2}^0& {W_2}^1\end{array}\right)=\left(\begin{array}{cc}1& 1\\ 1& 0\end{array}\right)$

Thus obtain Linear least squares minimization problem:

$\underset{X_1,X_2}{\min }\left\{\right||Y_0-X_1-X_2||+||Y_1-X_1|\left|\right\}$

One group solution is:

$\left\{\begin{array}{c}{X}_1=Y_1\\ X_2=Y_0-X_1=Y_0-Y_1\end{array}\right.$

Even structure figurebase X ₁direct display is with a kind of video pictures Y of language subtitle ₁, structure figurebase X ₂the region display Y at place ₀-Y ₁.Wherein, Y ₀for the picture that bore hole user finally sees, Y ₁for wearing the picture that auxiliary viewing apparatus user finally sees.

One specifically plays example as Fig. 2shown in: make structure figurebase X ₁play the video pictures with black Spanish subtitles, with seasonal structure figurebase X ₂play band adularescent English subtitles and the video pictures of Spanish subtitles and subtract each other gained.For bore hole user, the video pictures with English subtitles can be watched.For the user needing Spanish subtitles, can provide for structure figurebase X ₁modulation weights are the modulation glasses of 1.

For avoiding occurring Y ₀-Y ₁the situation of < 0, in practical implementations first by Y ₀picture grey values is interval to [128,255] from original [0,255] range mappings, i.e. Y ₀'=Y ₀/ 2+128, simultaneously by Y ₁the gray value interval that picture is mapped to [0,127], i.e. Y ₁'=Y ₁/ 2.Experiment shows, before and after mapping, the image quality change of image is little.By said method, structure is play in interlacing on the display apparatus figurebase X ₁=Y ₁'=Y ₁/ 2 and X ₂=Y ₀'-Y ₁'=Y ₀/ 2+128-Y ₁/ 2, bore hole user can direct viewing to Y ₀=X ₁+ X ₂picture, and wear right and left eyes eyeglass modulation weight be $W=\left(\begin{array}{c}1\\ 0\end{array}\right)$ The user of auxiliary viewing glasses, can Y be seen ₁=X ₁picture.Finally realize a screen to show more.

As a preferred embodiment, a kind of three language subtitle movie theatre Play Systems based on temporal psycho-visual modulation are provided, comprise: projection display equipment and the auxiliary viewing apparatus matched of two high refresh rates (refreshing frequency is greater than or equal to the equipment of 120Hz); Wherein:

Described projection display equipment, comprises video content and different language captions structure by one group figurebase broadcasts with specific Time and place arrangement, the structure that arbitrary time and region are play figurebase is the total part of many sub-pictures or the part of a sub-picture, and the view field of two projection display equipments overlaps and aligns;

Described auxiliary viewing apparatus, to the structure that display unit is play figurebase group carries out time domain and spatial domain amplitude modulation(PAM), and the information after modulation is fused into the image needed for it eventually through user human visual system in human brain.

Described system can realize the function that multi-user watches the broadcasting of multiple different language captions movie theatre simultaneously as required.

According to based on temporal psycho-visual modulation information display technology, three language subtitle simultaneously playing function can by the image I comprising different language captions set according to demand ₀, I ₁, I ₂, solve following matrix nonnegative decomposition problem

$I_i=\underset{j=1}{\overset{4}{\mathrm{\&Sigma;}}}{X}_j{W}_j^i$

Wherein 0≤i≤3; 0≤X _j≤ 255

Wherein: I is objective matrix, corresponding to bore hole with wear the target image that auxiliary viewing apparatus user sees, and W and X corresponding above-mentioned modulation weight vectors and structure respectively figurebase group matrix.W _j ⁱrepresent corresponding to seeing target image I _iuser to structure figurebase X _jmodulation weight.

Structure is determined by calculating figurebase group matrix X=(X ₁, X ₂, X ₃, X ₄) and corresponding each auxiliary viewing apparatus modulation weight matrix W in all elements W _j ⁱvalue.The different time-gap of specific high refresh rate display unit is utilized to play tripe systems respectively figurebase, can make to wear coupling and the user of synchronous auxiliary viewing apparatus to directly observe corresponding required image I respectively by bore hole simultaneously ₁with I ₀.Therefore above-mentioned matrix nonnegative decomposition problem can be converted into linear system:

$(I_0,I_1,I_2,I_3)=(X_1,X_2,X_3,X_4)\left(\begin{array}{cccc}{W_1}^0& {W_1}^1& {W_1}^2& {W_1}^3\\ {W_2}^0& {W_2}^1& {W_2}^2& {W_2}^3\\ {W_3}^0& {W_3}^1& {W_3}^2& {W_3}^3\\ {W_4}^0& {W_4}^1& {W_4}^2& {W_4}^3\end{array}\right)$

Wherein: I ₀for corresponding to the target image that bore hole user sees, I ₁, I ₂, I ₃for corresponding to the target image worn different auxiliary viewing apparatus user and see, and W and X corresponding above-mentioned modulation weight structure respectively figurebase group matrix.

For this system, make the zones of different of high refresh rate display unit play specific structure simultaneously figurebase group X ₁, X ₂, X ₃, X ₄, described modulation weights W _j ⁱ, namely to tripe systems figurescreen area corresponding to base carries out specific spatial domain amplitude modulation(PAM).Preferably, the synchro-shutter formula similar to active 3D Display Technique can be utilized to modulate, the light sent display unit zones of different carries out the Polarization Modulation of different angles, adopts the polarized lenses in different polarization direction as auxiliary viewing apparatus simultaneously.By changing the angle in auxiliary viewing apparatus eyeglass polarization direction and polarisation of light direction, corresponding region, if direction is identical, be full by, i.e. W _j ⁱ=1; If orthogonal thereto direction, be full obstruct, i.e. W _j ⁱ=0.Modulation weights W can be regulated by regulating this angle _j ⁱsize be arbitrary value from 0 to 1.For the polarization type modulating system on market, only provide polarization direction identical and orthogonal two kinds of patterns, even the light of respective regions full by or entirely intercept.Therefore for above-mentioned linear system, directly separate for one group and be:

$\left(\begin{array}{cccc}{W_1}^0& {W_1}^1& {W_1}^2& {W_1}^3\\ {W_2}^0& {W_2}^1& {W_2}^2& {W_2}^3\\ {W_3}^0& {W_3}^1& {W_3}^2& {W_3}^3\\ {W_4}^0& {W_4}^1& {W_4}^2& {W_4}^3\end{array}\right)=\left(\begin{array}{cccc}1& 1& 0& 0\\ 1& 0& 1& 0\\ 1& 0& 0& 1\\ 1& 0& 0& 0\end{array}\right)$

Thus obtain Linear least squares minimization problem:

$\underset{X_1,X_2,X_3,X_4}{\min }\left\{\right||I_0-X_1-X_2-X_3-X_4||+||I_1-X_1||+||I_2-X_2||+||I_3-X_3|\left|\right\}$

One group solution is:

$\left\{\begin{array}{c}{X}_1=I_1\\ X_2=I_2\\ X_3=I_3\\ X_4=3I_0-I_1-I_2-I_3\end{array}\right.$

Even structure figurebase X ₁, X ₂, X ₃directly show the video pictures Y with a kind of language subtitle respectively ₁, structure figurebase X ₄the region display 3I at place ₀-I ₁-I ₂-I ₃.One specifically plays example as Fig. 2shown in: make structure figurebase X ₁, X ₂, X ₃play the video pictures with black Chinese, English and Korean caption, with seasonal structure figurebase X ₄play with all caption area picture superposition gained.For bore hole user, the clear video pictures without captions can be watched.For the user needing certain language subtitle, can provide for corresponding structure figurebase X _imodulation weights are the modulation glasses of 1.

The present invention improves constantly and the human eye characteristic that resolution capability is limited under certain viewing distance according to current display unit refreshing frequency and spatial resolution, make use of the information display technology modulated based on time domain and spatial domain psycho-visual, have employed two high refresh rates and high-resolution time domain, spatial domain are modulated display unit and match and the auxiliary viewing apparatus that can customize according to demand, achieve Bu Tong assist the user of viewing apparatus to watch the result of different language captions to bore hole with wearing simultaneously, and achieve the practical application of movie theatre multi-subtitle system.

Above specific embodiments of the invention are described.It is to be appreciated that the present invention is not limited to above-mentioned particular implementation, those skilled in the art can make various distortion or amendment within the scope of the claims, and this does not affect flesh and blood of the present invention.

Claims (24)

1., based on a movie theatre multi-subtitle system for psycho-visual modulation Display Technique, it is characterized in that: the auxiliary viewing apparatus comprising display unit He match; Wherein:

Described display unit, one group is comprised video content and different language captions composition base and arrange with specific Time and place and broadcast, the composition base that arbitrary time and region are play is the total part of many sub-pictures or the part of a sub-picture;

Described auxiliary viewing apparatus, carry out time domain or spatial domain amplitude modulation(PAM) to the composition base group that display unit is play, the information after modulation is fused into the image needed for it eventually through user human visual system in human brain.

2. system according to claim 1, is characterized in that: described auxiliary viewing apparatus needs to do different modulating to composition base group according to different user and is fused into required captions and image by human visual system again.

3. system according to claim 1, it is characterized in that: described auxiliary viewing apparatus between the display surface and human eye of described display unit, by regulating the time domain that do not realize from the light intensity delivery rate between region display surface and human eye in the same time the different composition base of display unit and spatial domain amplitude modulation(PAM).

4. the system according to any one of claim 1-3, it is characterized in that: according to the video comprising different language captions of different user demands, the different auxiliary viewing apparatus of category of language quantity customization according to demand, thus the different composition bases realized high-definition display device is play carry out time domain or spatial domain amplitude modulation(PAM), make the user of different language captions demand can watch from same display unit the video content comprising required language subtitle separately.

5. system according to claim 4, it is characterized in that: between each auxiliary viewing apparatus, independently time domain or spatial domain amplitude modulation(PAM) are carried out respectively to composition base group, this auxiliary viewing apparatus by the display surface of described display unit to the light of human eye from full obstruct, translucent to full by, namely the weighting regulated arbitrarily between 0 to 1, realizes the amplitude modulation(PAM) to composition base group.

6. system according to claim 5, is characterized in that: for each specific auxiliary viewing apparatus view, have identical or different modulation weights to the different composition bases of composition base group.

7. based on a movie theatre video broadcasting method for psycho-visual modulation, it is characterized in that: display unit broadcasts composition base group X with certain time domain or spatial domain arrangement ₁, X ₂..., X _m, M is a positive integer, and these composition base groups directly enter human eye after the time domain or spatial domain modulation of correspondence, are fused into required captions and video.

8. method according to claim 7, it is characterized in that: described in be fused into required captions and video, refer to: different user makes to the same composition base group that display unit presents captions and the video that different time domains or spatial domain amplitude modulation(PAM) and fusion obtain oneself needs by different time domains or spatial domain modulation weight vectors, or is directly fused into video content by the user that bore hole is watched when not modulating.

9. method according to claim 7, is characterized in that: described composition base group X ₁, X ₂..., X _m, M be more than or equal to 2 positive integer, correspondingly, the image I containing different language captions that composition base group generates after the time domain or spatial domain modulation of the different weight of auxiliary viewing apparatus ₁, I ₂..., I _n, N is positive integer; And for bore hole user, the image that the signal fused of non-modulated becomes is I ₀.

10. method according to claim 9, is characterized in that: by adjustment spatial domain modulation weight vectors W and composition base group X ₁, X ₂..., X _mrealize, described modulation weight vectors W, it is the capable M row of N, by M × N number of weights composition, wherein M and N is respectively corresponding from composition base group quantity and the quantity of different auxiliary viewing apparatus.

11. methods according to claim 9, is characterized in that: the image I finally generated for each _iall formed by the merging in human eye after different time domains or spatial domain are modulated of all elements in composition base group, for display unit, the composition base light intensity play can not be negative value, namely composition basic matrix X non-negative must be met, simultaneously for auxiliary viewing apparatus, its index of modulation can only between zero and one, namely from entirely intercepting, translucent to full by; For the bore hole user without auxiliary viewing apparatus, its view is the superposition of all unmodulated composition base groups.

12. methods according to claim 9, is characterized in that: see captions and the video content of required language separately by respective auxiliary viewing apparatus, demand solution following matrix nonnegative decomposition problem for making different user:

$\underset{X\&CenterDot;W}{\min }{\left|\right|I-\mathrm{XW}\left|\right|}_F$

Wherein 0≤W≤1; 0≤X≤255

Wherein: I is objective matrix, corresponding to bore hole with wear the target image that auxiliary viewing apparatus user sees, and W and X corresponding above-mentioned modulation weight vectors and composition base group matrix respectively;

By trying to achieve the optimal solution of the problems referred to above, according to given demand image I, solving composition base group matrix X and weight vectors W corresponding with it, finally making equation

Wherein: (I ₀, I ₁..., I _n) correspond respectively to bore hole and wear the target image that auxiliary viewing apparatus user sees, and (X ₁, X ₂..., X _m) distinguish corresponding above-mentioned modulation weight vectors and composition base group matrix, represent corresponding to seeing target image I _nuser to composition base X _mmodulation weight.

13. 1 kinds, based on two language subtitle movie theatre Play Systems of spatial domain psycho-visual modulation, is characterized in that: the auxiliary viewing apparatus comprising display unit He match; Wherein:

Described display unit, comprises video content by one group and different language captions composition base broadcasts with specific space arrangement, and the composition base that arbitrary region is play is the total part of many sub-pictures or the part of a sub-picture;

Described auxiliary viewing apparatus, carry out spatial domain amplitude modulation(PAM) to the composition base group that display unit is play, the information after modulation is fused into the image needed for it eventually through user human visual system in human brain;

Described system realizes the function that multi-user watches simultaneously as required, two language subtitle is play simultaneously.

14. systems according to claim 13, is characterized in that: the realization of the function that two language subtitle is play simultaneously: the image I comprising different language captions set according to demand ₀, I ₁, solve following matrix nonnegative decomposition problem

$I_i=\underset{j=1}{\overset{2}{\mathrm{\&Sigma;}}}{X}_j{W}_j^i$

Wherein $1\&le;i\&le;N;0\&le;W_j^i\&le;1;0\&le;X_j\&le;255$

Wherein: I is objective matrix, corresponding to bore hole with wear the target image that auxiliary viewing apparatus user sees, and W and X corresponding above-mentioned modulation weight vectors and composition base group matrix respectively, W _j ⁱrepresent corresponding to seeing target image I _iuser to composition base X _jmodulation weight.

15. systems according to claim 14, is characterized in that: determine composition base group matrix X=(X by calculating ₁, X ₂) and the modulation weight matrix of corresponding each auxiliary viewing apparatus $\left(\begin{array}{cc}{W_1}^0& {W_1}^1\\ {W_2}^0& {W_2}^1\end{array}\right)$ Middle all elements W _j ⁱvalue; The different pixels block of the display unit described in utilization plays different composition base respectively, makes the user of the auxiliary viewing apparatus wearing coupling and directly observes corresponding required image I respectively by bore hole simultaneously ₁with I ₀, i.e. linear system

$(I_0,I_1)=(X_1,X_2)\left(\begin{array}{cc}{W_1}^0& {W_1}^1\\ {W_2}^0& {W_2}^1\end{array}\right)$

Wherein: I is for corresponding to bore hole and wearing the target image that auxiliary viewing apparatus user sees, W and X corresponding above-mentioned modulation weight composition base group matrix respectively.

16. systems according to claim 15, is characterized in that: the zones of different of described display unit plays specific composition base group X simultaneously ₁, X ₂, described modulation weights W _j ⁱspecific spatial domain amplitude modulation(PAM) is carried out to the screen area corresponding to different composition base.

17. systems according to claim 16, it is characterized in that: the light sent display unit zones of different carries out the Polarization Modulation of different angles, adopt the polarized lenses in different polarization direction as auxiliary viewing apparatus simultaneously, by changing the angle in auxiliary viewing apparatus eyeglass polarization direction and polarisation of light direction, corresponding region, if direction is identical, be full by, i.e. W _j ⁱ=1; If orthogonal thereto direction, be full obstruct, i.e. W _j ⁱ=0, modulation weights W can be regulated by regulating this angle _j ⁱsize be arbitrary value from 0 to 1; For the interlacing polarization type modulating system on market, for the linear system in claim 15, directly separate for one group and be:

$\left\{\begin{array}{c}{X}_1=Y_1\\ X_2=Y_0-X_1=Y_0-Y_1\end{array}\right.$

Wherein, Y ₀for the picture that bore hole user finally sees, Y ₁for wearing the picture that auxiliary viewing apparatus user finally sees.

18. systems according to claim 17, is characterized in that: make composition base X ₁direct display is with a kind of video pictures Y of language subtitle ₁, composition base X ₂the region display Y at place ₀-Y ₁.

19. 1 kinds, based on three language subtitle movie theatre Play Systems of temporal psycho-visual modulation, is characterized in that: the auxiliary viewing apparatus comprising two projection display equipments He match; Wherein:

Described projection display equipment, one group is comprised video content and different language captions composition base to arrange with specific Time and place and broadcast, the composition base that arbitrary time and region are play is the total part of many sub-pictures or the part of a sub-picture, and the view field of two projection display equipments overlaps and aligns;

Described auxiliary viewing apparatus, carry out time domain and spatial domain amplitude modulation(PAM) to the composition base group that display unit is play, the information after modulation is fused into the image needed for it eventually through user human visual system in human brain.

The function that three language subtitle are play simultaneously is watched as required the while that described system realizing multi-user.

20. systems according to claim 19, is characterized in that: the realization of playing function while of three language subtitle: the image I comprising different language captions set according to demand ₀, I ₁, I ₂, solve following matrix nonnegative decomposition problem

$I_i=\underset{j=1}{\overset{4}{\mathrm{\&Sigma;}}}{X}_j{W}_j^i$

$\mathrm{subject\; to}0\&le;i\&le;3;0\&le;W_j^i\&le;1;0\&le;X_j\&le;255$

Wherein: I is objective matrix, corresponding to bore hole with wear the target image that auxiliary viewing apparatus user sees, and W and X corresponding above-mentioned modulation weight vectors and composition base group matrix respectively, W _j ⁱrepresent corresponding to seeing target image I _iuser to composition base X _jmodulation weight.

21. systems according to claim 19, is characterized in that: determine composition base group matrix X=(X by calculating ₁, X ₂, X ₃, X ₄) and corresponding each auxiliary viewing apparatus modulation weight matrix W in all elements W _j ⁱvalue, utilize the different time-gap of display unit to play different composition base respectively, make to wear coupling and the user of synchronous auxiliary viewing apparatus to directly observe corresponding required image I respectively by bore hole simultaneously ₁with I ₀, therefore above-mentioned matrix nonnegative decomposition problem is converted into linear system:

$(I_0,I_1,I_2,I_3)=(X_1,X_2,X_3,X_4)\left(\begin{array}{cccc}{W_1}^0& {W_1}^1& {W_1}^2& {W_1}^3\\ {W_2}^0& {W_2}^1& {W_2}^2& {W_2}^3\\ {W_3}^0& {W_3}^1& {W_3}^2& {W_3}^3\\ {W_4}^0& {W_4}^1& {W_4}^2& {W_4}^3\end{array}\right).$

Wherein: I ₀for corresponding to the target image that bore hole user sees, I ₁, I ₂, I ₃for corresponding to the target image worn different auxiliary viewing apparatus user and see, and W and X corresponding above-mentioned modulation weight composition base group matrix respectively.

22. systems according to claim 21, is characterized in that: the zones of different of described display unit plays specific composition base group X simultaneously ₁, X ₂, X ₃, X ₄, described modulation weights W _j ⁱspecific spatial domain amplitude modulation(PAM) is carried out to the screen area corresponding to different composition base.

23. systems according to claim 22, it is characterized in that: the light sent display unit zones of different carries out the Polarization Modulation of different angles, adopt the polarized lenses in different polarization direction as auxiliary viewing apparatus simultaneously, by changing the angle in auxiliary viewing apparatus eyeglass polarization direction and polarisation of light direction, corresponding region, if direction is identical, be full by, i.e. W _j ⁱ=1; If orthogonal thereto direction, be full obstruct, i.e. W _j ⁱ=0; Modulation weights W can be regulated by regulating this angle _j ⁱsize be arbitrary value from 0 to 1; For the polarization type modulating system on market, only provide polarization direction identical and orthogonal two kinds of patterns, even the light of respective regions full by or entirely intercept, therefore:

For wear coupling auxiliary viewing apparatus user to directly observe corresponding required image I respectively by bore hole simultaneously ₁with I ₀, i.e. linear system

$(I_0,I_1)=(X_1,X_2)\left(\begin{array}{cc}{W_1}^0& {W_1}^1\\ {W_2}^0& {W_2}^1\end{array}\right)$

Directly separate for one group and be:

$\left\{\begin{array}{c}{X}_1=I_1\\ X_2=I_2\\ X_3=I_3\\ X_4=3I_0-I_1-I_2-I_3\end{array}\right..$

24. systems according to claim 23, is characterized in that: make composition base X ₁, X ₂, X ₃directly show the video pictures Y with a kind of language subtitle respectively ₁, composition base X ₄the region display 3I at place ₀-I ₁-I ₂-I ₃.