CN103888753B - Information processing equipment, information processing method and program - Google Patents

Information processing equipment, information processing method and program Download PDF

Info

Publication number
CN103888753B
CN103888753B CN201410081035.2A CN201410081035A CN103888753B CN 103888753 B CN103888753 B CN 103888753B CN 201410081035 A CN201410081035 A CN 201410081035A CN 103888753 B CN103888753 B CN 103888753B
Authority
CN
China
Prior art keywords
video
image
plane
cubic
mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410081035.2A
Other languages
Chinese (zh)
Other versions
CN103888753A (en
Inventor
小林义行
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2010046031A external-priority patent/JP4915459B2/en
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN103888753A publication Critical patent/CN103888753A/en
Application granted granted Critical
Publication of CN103888753B publication Critical patent/CN103888753B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

Enable to change in the case where not changing resolution ratio the information processing equipment, information processing method and program of graphic model for render graphical images etc..Equipment plane for storing figure, video or background image is wherein to be arranged in juxtaposition the storage region in the regions L for storing L images and the Zone R domain for storing R images.The configuration of equipment plane is the whole equipment plane definition for the storage region of the image as two planes.The configuration of equipment plane includes graphic model etc., and configuration mode setting API sets graphic model.Present embodiments can apply to the BD players etc. for reproducing BD.

Description

Information processing equipment, information processing method and program
The application be submit on March 24th, 2010 application No. is 201080001694.0 application for a patent for invention " information The divisional application of processing equipment, information processing method and program ".
Technical field
The present invention relates to information processing equipment, information processing method and program, more particularly to for example can be used to from record Medium suitably plays 3D(It is three-dimensional)Information processing equipment, information processing method and the program of the content of image.
Background technology
For example, two-dimentional(2D)Picture material is the mainstream of the content of such as film etc, but recently, realize stereoscopic viewing Three-dimensional(3D)Image(Figure)Content has attracted attention.
In the presence of for 3D rendering(Also referred to as stereo-picture below)All kinds of methods of display methods, but no matter which kind of uses Method, the data volume of 3D rendering are both greater than the data volume of 2D images.
In addition, the content of the high-definition picture of such as film etc may have prodigious size, and in order to tool There is the form of the 3D rendering of big data quantity to record this large amount of picture material, then needs to provide huge storage capacity recording medium.
The example of this huge storage capacity recording medium includes Blu-Ray(Registered trademark)Disk(It is also referred to as BD below), such as BD(Blu-Ray(Registered trademark))–ROM(Read-only memory)Etc..
In BD, BD-J can be handled(BD Java(Registered trademark)), and according to BD-J, high interactivity can be provided Function(PTL1).
Reference listing
Patent document
PTL1:International publication No.2005/052940
Invention content
Technical problem
By the way, in current BD standards, there are no define how to record or play 3D rendering content.
However, the author for the creation for executing 3D rendering content is allowed to determine how recording or play 3D rendering content may lead 3D rendering content is caused to be not suitable for playing.
The present invention allows for the above problem and makes, and make it possible to it is appropriate from the recording medium of such as BD etc Ground plays 3D rendering content.
Solution to problem
Information processing equipment according to one aspect of the invention is following information processing equipment or so that computer serves as The program of information processing equipment:Wherein it is used to store the graphics plane of graph image and the video plane for store video images In each be a storage region for image corresponding with two screens, which is matched by the regions L and Zone R domain Set, the wherein regions L are the storage regions for storing left eye image corresponding with a screen, Zone R domain be for store with The storage region of the corresponding right eye image of one screen;Wherein, the configuration of the graphics plane and matching for the video plane Set be the entirety and video plane for being directed to the graphics plane respectively all definition, each of which is for two The storage region of the corresponding image of a screen;Wherein, the video mode as the pattern for reproducing the video image, definition Following pattern:Non-cubic video mode, wherein when the video image is the non-cubic image as 2D images, it will be described Non-cubic image is stored in the regions L of the video plane and a storage region in the Zone R domain and stereopsis Frequency pattern will constitute the left side of the stereo-picture wherein when the video image is the stereo-picture as 3D rendering Ophthalmically acceptable image and the right eye are respectively stored in image in the regions L and the Zone R domain of the video plane, wherein institute The configuration for stating video plane includes the video mode.
Information processing method according to one aspect of the invention is following information processing method:It is wherein used to store figure The graphics plane of image and be for figure corresponding with two screens for each in the video plane of store video images One storage region of picture, the storage region are corresponding with a screen for storing by the regions L and Zone R configuration of territory, the wherein regions L Left eye image storage region, Zone R domain is the storage region for storing right eye image corresponding with a screen;Its In, the configuration of the graphics plane and the configuration of the video plane are to be directed to all and described of the graphics plane respectively to regard All definition of frequency plane, each of which is the storage region for image corresponding with two screens;Wherein, as with In the video mode for the pattern for reproducing the video image, following pattern is defined:Non-cubic video mode, wherein being regarded when described When frequency image is the non-cubic image as 2D images, the non-cubic image is stored in the areas L of the video plane In one storage region in domain and the Zone R domain and three-dimensional video-frequency pattern, wherein when the video image is as 3D rendering Stereo-picture when, the left eye image for constituting the stereo-picture and the right eye are respectively stored in image described In the regions L and the Zone R domain of video plane, wherein the configuration of the video plane includes the video mode.
The information processing equipment can be independent equipment, or can be the internal block for constituting an equipment.
In addition, the program can be provided by being provided via some transmission medium, or by recording in the recording medium.
The advantageous effects of the present invention
According to the present invention it is possible to suitably play 3D rendering content.
Description of the drawings
Fig. 1 is the diagram of the summary for describing BDMV formats.
Fig. 2 is the diagram of the supervisory format for describing BD files.
Fig. 3 is the block diagram of the configuration example for the hardware for showing BD players.
Fig. 4 is the diagram of the summary of the 3D rendering processing for describing the progress of 3D compatible layers.
Fig. 5 is the diagram that the generating writing pattern 3D rendering on graphics plane 11 is applied for describing BD-J.
Fig. 6 is the diagram for showing graphic model, in this mode on graphics plane 11 generating writing pattern 3D rendering BD-J Application plays graph image.
Fig. 7 is the block diagram for the functional configuration example for showing 3D compatible layers.
Fig. 8 is the diagram for showing to serve as one of configuration, broadcasting video image video mode.
Fig. 9 is the diagram for showing to serve as one of configuration, broadcasting background image background mode.
Figure 10 be the graphics plane 11 for being shown as equipment plane, PG planes 12, video plane 13 and background plane 14 it Between relationship diagram.
Figure 11 is the picture frame for showing to serve as one of configuration(Resolution ratio)With the diagram of color depth.
Figure 12 is the method for describing to describe using the second plotting method in the case of 3D rendering mismatch 3D rendering Diagram.
Figure 13 is the diagram for describing equipment plane.
Figure 14 is the diagram for the bit field for specified configuration for showing to provide in BD-J obj ect files.
Figure 15 is to show initial_video_mode, initial_graphics_mode and initial_ The diagram of the acquiescence specified value of background_mode.
Figure 16 is point of the video+PG for showing the playback in addition to KEEP_RESOLUTION is reset, BD-J figures and background Resolution(Picture frame)Combination diagram.
Figure 17 is point of the video+PG for showing the playback in addition to KEEP_RESOLUTION is reset, BD-J figures and background Resolution(Picture frame)Combination diagram.
Figure 18 is the exemplary diagram for the change processing for showing configuration.
Figure 19 is the diagram for showing graphic model and the predetermined initial value of background mode.
Figure 20 is the 3D rendering shown playing 1920 × 2160 pixels(Stereo-picture)In the case of the figure to be played With the diagram of background mode.
Figure 21 is for describing since BD-J is using the resolution ratio for serving as configuration caused by the calling of API(Picture frame) Change diagram.
Figure 22 is the diagram of the change for describing graphic model.
Figure 23 is to show graphic model from solid figure pattern to the diagram of the change of offset graphic model.
Figure 24 is the diagram of the change for describing background mode.
Figure 25 is the diagram of the change for describing video mode.
Figure 26 is the block diagram for the functional configuration example for showing 3D compatible layers.
Figure 27 is the diagram for showing selectable PG replay modes and TextST replay modes in each video mode.
Figure 28 is the block diagram for the functional configuration example for showing 3D compatible layers.
Figure 29 is the diagram for describing processing of the 3D compatible layers about PG.
Figure 30 is to be in showing of switching between the playback of 3D rendering and the playback of 2D images for describing 3D compatible layers Figure.
Figure 31 is the position for describing author to the position of video and the setting of size and 3D compatible layers to video Set the diagram with the correction of size.
Figure 32 is the block diagram for the functional configuration example for showing 3D compatible layers.
Figure 33 is the diagram for the graphics plane 11 for showing 1920 × 2160 pixels.
Figure 34 is the block diagram for the functional configuration example for showing 3D compatible layers.
Figure 35 is the flow chart of the graphics process for describing the progress of 3D compatible layers.
Figure 36 is the flow chart of the graphics process for describing the progress of 3D compatible layers.
Figure 37 is the flow chart of the graphics process for describing the progress of 3D compatible layers.
Figure 38 is the exemplary diagram for the GUI for showing to describe on graphics plane 11.
Figure 39 is the diagram for showing the first focus method and the second focus method.
Figure 40 is the flow chart of the focus management for describing 3D compatible layers.
Figure 41 is to show to can be used to check the position of the 3D rendering of cursor shown on screen and cursor in graphics plane 11 On position diagram.
Figure 42 is for describing the matched diagram between the left eye image of figure and right eye image.
Figure 43 is the block diagram for the functional configuration example for showing 3D compatible layers.
Figure 44 is the diagram shown across the image of L graphics plane 11L and R graphics planes 11R.
Figure 45 is showing for the description for showing the left eye image for animation and the description of the right eye image for animation Figure.
Figure 46 is the block diagram for the functional configuration example for showing 3D compatible layers.
Figure 47 is to show the accurate animation of picture frame(Image Frame Accurate Animation)Extension API determine The diagram of justice.
Figure 48 is to show the accurate animation of synchronization frame(Sync Frame Accurate Animation)Extension API determine The diagram of justice.
Figure 49 is the diagram for the sample code for showing the accurate animation of picture frame.
Figure 50 is the diagram for the sample code for showing the accurate animation of picture frame.
Figure 51 is the diagram for the sample code for showing the accurate animation of synchronization frame.
Figure 52 is the diagram for the sample code for showing the accurate animation of synchronization frame.
Label list
10 logic planes
11 graphics planes
11L L graphics planes
11R R graphics planes
12 PG planes
12L L-PG planes
12R R-PG planes
13 video planes
13L L video planes
13R R video planes
14 background planes
14L L background planes
14R R background planes
15 mixers
21 logical screens
101 buses
102 CPU
103 ROM
104 RAM
105 hard disks
106 output units
107 input units
108 communication units
109 drivers
110 input/output interfaces
111 removable recording mediums
201L, 201R, 202L, 202R buffer
211 posterior bumpers
211L, 211R, 212 anterior bumpers
212L, 212R buffer
213 anterior bumpers
213L, 213R buffer
231 frame buffers
232L, 232R pixel transmission equipment
241 graphic memories
242L, 242R pixel transmission equipment
Specific implementation mode
The case where the embodiment of the present invention explained below is applied to BD.
The management structure of BD
Firstly, for current BD, will describe in " Blu-ray Disc Read-Only Format Specified in Ver1.0part3Audio Visual Specifications ", such as it is recorded in BD-ROM as read-only BD In content that is, AV(Audio/video)The management structure of data etc.(It is also referred to as below " BDMV formats ").
For example, passing through such as MPEG(Motion characteristics planning)The coding method of video, mpeg audio etc. encodes And editing AV streams are referred to as according to the bit stream of MPEG2 system multiplexings(Or AV streams).Editing AV streams are by a file system with file Form be recorded in BD, this document system is in " the Blu-ray Disc Read-Only as one of standard about BD Defined in Format part2 ".The file of editing AV streams is referred to as editing AV stream files(Or AV stream files).
Editing AV stream files are the management units in file system, and editing AV stream files(Editing AV stream)Playback Necessary information etc. is recorded in the form of database in BD.The database is in " the Blu-ray as one of BD standards Regulation in Disc Read-Only Format part3 ".
Fig. 1 is the diagram of the summary for describing BDMV formats.
BDMV formats are constituted by four layers.
Lowermost layer is the layer belonging to editing AV streams, and will also be referred to as clip layer in due course below.
Layer of one layer than editing floor height is for the playlist that editing AV streams specify replay position(Movie PlayList)Affiliated layer, and will also be referred to as playlist layer below.
Layer of one layer than playlist floor height is for the electricity that playlist specifies the order of playback order to be constituted Shadow object(Movie Object)Etc. belonging to layer, and will also be referred to as object layer below.
Compare the layer as one layer of floor height(It is top)It is the concordance list institute for managing title that be stored in BD etc. The layer of category, and will also be referred to as index level below.
It will be described with clip layer, playlist layer, object layer and index level.
Editing AV streams, clip information(Clip Information)Etc. belong to clip layer.
Editing AV streams are that the video data for wherein serving as content-data, audio data etc. are converted into TS(MPEG2TS (Transport stream))The stream of format.
Clip information(Clip Information)It is the information about editing AV streams, and is recorded in the form of a file In BD.
Note that editing AV streams include graphical stream, such as subtitle, menu etc. if necessary.
Subtitle(Figure)Stream be referred to as present figure(PG(Presentation Graphics))Stream, and menu (Figure)Stream be referred to as interactive graphics (IG)(IG(Interactive Graphics))Stream.
In addition, editing AV stream files and respective clip information(Related editing is flowed with the editing AV of editing AV stream files Information)File(Clip information file)Set be referred to as editing(Clip).
Editing is the single object being made of editing AV streams and clip information.
When layout flows corresponding content with the editing AV for constituting editing on a timeline, including first and rearmost position (Time point)Multiple positions be set to accessing points.Accessing points are essentially the playlist by upper layer(PlayList)It utilizes What timestamp was specified.
The clip information for constituting editing includes being flowed using the editing AV that the accessing points that timestamp is specified indicate with playlist Position address(Logical address).
Playlist(Movie PlayList)Belong to playlist layer.
Playlist be AV stream files by be played and for specify the AV stream files replay position including weight Decontrol initial point(IN points)With playback end point(OUT points)Playitems playitem inside(PlayItem)It constitutes.
To which playlist is made of a group of playltems mesh.
Now, the playback of playitems playitem means IN points to including using the playitems playitem and OUT points are specified cuts Collect the playback in the section of AV streams.
Movie objects(Movie Object)With BD-J objects(Blue-ray Disc Java(Registered trademark)Object)Belong to In object layer.
Movie objects include by HDMV(High-definition movie)Navigation command program(Navigation command)It is closed with the movie objects The end message that connection gets up.
Navigation command is the order of the playback for controlling playlist.End message includes for allowing user and being used for Play the information of the interactive operation of the BD players of BD.In BD players, the tune of such as menu is controlled based on end message With the user's operation of, title search etc..
BD-J objects are Java(Registered trademark)Program, and can provide a user more advanced than navigation command(It is more complicated) Interactive function.
Concordance list(Index table)Belong to index level.
Concordance list is the highest level table of the title for defining BD-ROM disks.
The entry of concordance list(Field)Corresponding to title, and provide from each entry to mark corresponding with the entry Topic(HDMV titles or BD-J titles)Object(Movie objects or BD-J objects)Link.
Fig. 2 is the management for describing BD files as defined in " Blu-ray Disc Read-Only Format Part3 " The diagram of structure.
In BD, bibliographic structure is utilized to manage file in a hierarchical manner.
Now, in fig. 2, the file under a catalogue(Including catalogue)Refer to the file under the closely catalogue, and a mesh The file that record includes refers to the file under the so-called subdirectory of the file and the catalogue under the closely catalogue.
The highest ranked catalogue of BD is root.
Closely there are catalogue " BDMV " and catalogue " CERTIFICATE " under root.
Information related with copyright(File)It is stored in catalogue " CERTIFICATE ".
The file of BDMV formats described in Fig. 1 is stored in catalogue " BDMV ".
Two files " index.bdmv " and " MovieObject.bdmv " are stored under closely catalogue " BDMV ".Note Meaning, the file in addition to " index.bdmv " and " MovieObject.bdmv "(It does not include catalogue)Closely mesh cannot be stored in It records under " BDMV ".
File " index.bdmv " includes the concordance list described in Fig. 1, serves as letter related with for playing the menu of BD Breath.
For example, BD players are based on file " index.bdmv ", play including such as all the elements of broadcasting BD, only plays Specific chapters and sections, the initial menu for executing the content item reset or show predetermined menus etc repeatedly(Screen).
In addition, the movie objects to be run when each project is selected(Movie Object)It can be set to file " index.bdmv ", and in the case where user selects a project from initial menu screen, the operation of BD players is set Surely the Movie Object orders of file " index.bdmv " are arrived.
File " MovieObject.bdmv " is the file for the information for including Movie Object.MovieObject includes Order for controlling the playback for being recorded in the PlayList in BD, and for example, BD players are recorded in by selection One of Movie Object in BD and it is run, to play the content being recorded in BD(Title).
Closely catalogue " BDMV " have catalogue " PLAYLIST ", " CLIPINF ", " STREAM ", " AUXDATA ", " META ", " BDJO ", " JAR " and " BACKUP ".
The database of playlist is stored in catalogue " PLAYLIST ".Specifically, play list file " xxxxx.mpls " is stored in catalogue " PLAYLIST ".The file being made of 5 bit digitals " xxxxx " and extension name " mpls " Name is used as the filename of play list file " xxxxx.mpls ".
The database of editing is stored in catalogue " CLIPINF ".Specifically, cutting about each editing AV stream files Message file " xxxxx.clip " is collected to be stored in catalogue " CLIPINF ".By 5 bit digitals " xxxxx " and extension name " clpi " The filename of composition is used as the filename of clip information file " xxxxx.clpi ".
Editing AV stream files " xxxxx.m2ts " are stored in catalogue " STREAM ".TS is stored in editing AV stream files In " xxxxx.m2ts ".The filename being made of 5 bit digitals " xxxxx " and extension name " m2ts " is used as editing AV stream files The filename of " xxxxx.m2ts ".
Note that the matching files name in addition to extension name is used as constituting the clip information file of given editing The filename of " xxxxx.clip " and editing AV stream files " xxxxx.m2ts ".It is cut it is thus possible to be easy to specified composition and give The clip information file " xxxxx.clip " and editing AV stream files " xxxxx.m2ts " collected.
The audio files that is shown for menu, font file, fontindex file, bitmap file etc. are stored in catalogue In " AUXDATA ".
In fig. 2, file " sound.bdmv " and the file with extension name " otf " are stored in catalogue In " AUXDATA ".
Scheduled voice data(Audio data)It is stored in file " sound.bdmv "." sound.bdmv " is somebody's turn to do to be consolidated Surely it is used as the filename of file " sound.bdmv ".
For subtitle, BD-J objects(Using)Etc. the character font data of display be stored in extension name " otf " In file.One 5 bit digitals are used as the part in addition to extension name with the filename of the file of extension name " otf ".
Meta data file is stored in catalogue " META ".BD-J obj ect files are stored in catalogue " BDJO " and " JAR " In.The backup for the file being recorded in BD is stored in catalogue " BACKUP ".
The hardware configuration example of BD players
Fig. 3 is the exemplary block diagram of hardware configuration for showing the BD players for playing BD.
BD players in Fig. 3 are configured as executing the playback that wherein record has the BD of 3D rendering content.
Such as CPU(Central processing unit)102 etc. processor(Computer)It is embedded in BD players.It is defeated Enter/output interface 110 is connected to CPU102 via bus 101.
It is inputted by operate etc. to input unit 107 via input/output interface 110 by user when ordering, CPU102 is stored in ROM according to order operation(Read-only memory)Program in 103.Alternatively, CPU102 are recorded in hard disk 105 or the program in the disk 100 on driver 109 be loaded into RAM(Random access storage device)104, and running should Program.
Therefore, all kinds of processing described in CPU102 execution hereafter.Then, for example, CPU102 if necessary via input/ Output interface 110 exports its handling result from output unit 106, either sends from communication unit 108 or is further recorded in In hard disk 105, etc..
Note that input unit 107 is made of keyboard, mouse, microphone etc..In addition, output unit 106 is by LCD(Liquid crystal Display), loud speaker etc. constitutes.Communication unit 108 is made of network card etc..
Now, the program of CPU102 operations, which can be recorded in advance in, serves as the hard of the recording medium being embedded in BD players In disk 105 or ROM103.
Alternatively, program can be stored(Record)In the removable recording medium of such as disk 100 etc..It is this removable Except recording medium can be provided in the form of so-called canned software.Here, can be removed recording medium example include flexible disk, CD-ROM(Compact disc read write)、MO(Magneto-optic)Disk, DVD(Digital versatile disc), disk and semiconductor memory.
Note that in addition to program, from other than this removable recording medium is installed in BD players, program also can be via Communication network or broadcasting network etc. are downloaded to BD players to be mounted in built-in hard disk 105.Specifically, example Such as, program can be transmitted wirelessly from download website to BD players via the artificial satellite for digital satellite broadcasting, or It can be via such as LAN(LAN), internet etc. network BD players are sent to by cable.
In figure 3, disk 100 is, for example, BD, wherein to maintain and the compatibility for the BD to be played at conventional player Mode has recorded 3D rendering content.
To which disk 100 can play at conventional player, be played at BD players that also can be in figure 3, the BD in Fig. 3 Player is the BD players that can play 3D rendering content(It is also referred to as below " 3D compatible layers ").
Now, conventional player is can to play wherein record to have the BD of 2D picture materials but cannot play in 3D rendering The BD players of appearance.
Using conventional player, 2D picture materials can be played from disk 100, but 3D rendering content cannot be played.
On the other hand, using in Fig. 3 as the BD players of 3D compatible layers, not only can from disk 100 play 2D figure As content, also 3D rendering content can be played from disk 100.
In BD players in figure 3, when the disk 100 as BD disks is installed on driver 109, CPU102 passes through Driver 109 is controlled to execute the playback of disk 100.
Description to BD-J applications
BD-J is applied(BD-J titles)(BD-J objects)It is recorded in disk 100(Fig. 3)It is middle to be used as one of 3D rendering content.
In the BD players as 3D compatible layers in figure 3, CPU102 runs Java(Registered trademark)Virtual machine, And in the Java(Registered trademark)On virtual machine, BD-J applications are run.
Fig. 4 is the summary of the 3D rendering processing for describing the progress of 3D compatible layers(The summary of BD-J solid figures)'s Diagram.
3D compatible layers describe 3D rendering on logic plane 10, PG planes 12 or video plane 13.Note that logic is flat The entity in face 10, PG planes 12 and video plane 13 is, for example, the partial memory area domain in the RAM104 in Fig. 3.
The example for the 3D rendering that 3D compatible layers are described is included in BD-J figures, PG specified in BD standards (Figure is presented in Presentation Graphics)、TextST(Text subtitle, text subtitle), video and the back of the body Scape.
Now, in Fig. 4, figure 3D rendering(Solid figure source)It consists of the following parts:As what is observed by left eye The left eye image of image(L(It is left)The ken), and as the right eye image for the image to be observed by right eye(R(It is right)Depending on Domain).
PG3D images(The three-dimensional sources PG), video 3D rendering(Three-dimensional video-frequency source)And background 3D rendering(Stereo background source) By left eye image and right eye image construction.
Note that constitute video 3D rendering etc. left eye image and right eye with image for example using H.264AVC(It is high Grade Video coding)/MVC(More view video codings)Etc. encode.
Now, it in H.264AVC/MVC, defines and is referred to as " the basic ken "(Base View)Image stream, and It is referred to as " the subordinate ken "(Dependent View)Image stream.
For the basic ken, do not allow to encode as the predictive of benchmark image using another stream, but for the subordinate ken, Then allow the predictive coding using the basic ken as benchmark image.For example, among left eye image and right eye image, it is left Ophthalmically acceptable image can be considered as the basic ken, and right eye image can be considered as the subordinate ken.
3D compatible layers depict the 3D figures described on logic plane 10 on graphics plane 11 or background plane 14 Picture.
Graphics plane 11 is by the L graphics planes for storing left eye image(L(It is left)Graphics plane)11L and for storing The R graphics planes of right eye image(R(It is right)Graphics plane)11R is constituted.
The left eye for the composition figure 3D rendering described on logic plane 10 is depicted in image on L graphics planes 11L, And right eye is depicted in image on R graphics planes 11R.
Here, L graphics planes 11L be for store to be observed by left eye be used for L(It is left)Image(Left eye image) The storage region for an image(The regions L).Also, R graphics planes 11R is used for by what right eye was observed for storing R(It is right)Image(Right eye image)The storage region for an image(Zone R domain).
The entity of L graphics plane 11L and R graphics planes 11R, the i.e. entity of graphics plane 11 are and 10 phase of logic plane Partial memory area domain in RAM104 detach, in Fig. 3.
PG planes 12, video plane 13 and background plane 14 are also similarly formed.
PG planes 12 are by the L-PG planes for storing left eye image(L(It is left)PG planes)12L and for storing right eye With the R-PG planes of image(R(It is right)PG planes)12R is constituted.
3D compatible layers describe on L-PG planes 12L constitute PG3D images left eye image image, and Describe right eye image on R-PG planes 12R.
Video plane 13 is by the L video planes for storing left eye image(L(It is left)Video plane)13L and for storing The R video planes of right eye image(R(It is right)Video plane)13R is constituted.
3D compatible layers describe the left eye image for constituting video 3D rendering on L video planes 13L, and are regarded in R Describe right eye image on frequency plane 13R.
Background plane 14 is by the L background planes for storing left eye image(L(It is left)Background plane)14L and for storing The R background planes of right eye image(R(It is right)Background plane)14R is constituted.
The left eye for the composition background 3D rendering described on logic plane 10 is depicted in image on L background planes 14L, And right eye is depicted in image on R background planes 14R.
Describe(Record)Left eye image on graphics plane 11, PG planes 12, video plane 13 and background plane 14 With right eye mixer 15 is provided to image.
Mixer 15 by the figure left eye image from graphics plane 11, the PG left eyes image from PG planes 12, Video left eye image from video plane 13 and the background left eye from background plane 14 are mutually mixed with image(Mixing) (Synthesis), to export the left eye image as the result of the synthesis.
In addition, mixer 15 uses the figure right eye image from graphics plane 11, the PG right eyes from PG planes 12 Image, the video right eye image from video plane 13 and the background right eye from background plane 14 are mutually mixed simultaneously with image Synthesis, to export the right eye image as the result of the synthesis.
The left eye that mixer 15 exports is provided to display not shown in the figure with image, as the display for left side Output(L(It is left)Display output).Also, the right eye that mixer 15 exports is provided to display not shown in the figure with image, As the display output for right side(R(It is right)Display output).
Using display not shown in the figure, by either alternatively or simultaneously showing from the left eye image of mixer 15 and the right side Ophthalmically acceptable image, to show 3D rendering.
Among graphics plane 11, PG planes 12, video plane 13 and background plane 14, BD-J applications can be in graphics plane 11 and background plane 14 on execute image description.
Now, in the present embodiment, let as assume that BD-J applications can only access logic plane 10, and BD-J applications are not Graphics plane 11 and background plane 14 can directly be accessed.
To which BD-J applications can only execute logic plane 10 description of image, but cannot be directly to 11 He of graphics plane Background plane 14 executes the description of image.Therefore, BD-J is applied by logic plane 10, coming image description indirectly will Image description is on graphics plane 11 or background plane 14.
However, hereinafter, for convenience, BD-J apply via logic plane 10 carry out to graphics plane 11 or background The image description of plane 14 will be simply described as image description to graphics plane 11 or background plane 14.
Note that 3D compatible layers can be configured as not including logic plane 10.In the case, BD-J applications directly exist Describe image on graphics plane 11 or background plane 14.
Other than describing image on graphics plane 11 and background plane 14, BD-J applications can also carry out to video and PG Playback control, such as the scaling to video and PG or position(Display location)Control, etc..
Video and PG are come as a set note that BD-J is applied(Generally)Processing.In other words, BD-J is using not area Point(It cannot distinguish between)Video and PG.
BD-J is using the description to graph image
Fig. 5 is applied in graphics plane 11 for describing BD-J(Solid figure plane)The figure 3D rendering of upper progress is retouched The diagram painted.
First plotting method and the second plotting method are used as 3D rendering plotting method.
A in Fig. 5 is the diagram for describing the first plotting method.
In the first plotting method, the author of BD-J applications executes description to 3 D plane.
Specifically, in the first plotting method, the data of figure 3D rendering are used by the data and right eye of left eye image The data of image are constituted, and BD-J is applied and described left eye image and right eye image on logic plane 10.
Then, the left eye being depicted on logic plane 10 image and right eye are depicted in figure without change with image In plane 11.Specifically, the left eye being depicted on logic plane 10 is depicted in L graphics planes without change with image On 11L, and the right eye being depicted on logic plane 10 is depicted in image on R graphics planes 11R without change.
B in Fig. 5 is the diagram for describing the second plotting method.
In the second plotting method, the author of BD-J applications is to non-cubic plane(mono plane)Execute description.In addition, Author provides deviant simultaneously(Graphics plane deviant).3D compatible layers are given birth to based on the deviant from the non-cubic plane At 3 D plane.
That is, in the second plotting method, the data of 3D rendering consist of the following parts:It serves as generating 3D figures The data of the original image in the so-called source of picture, and for by generating left eye from original image to original image application parallax With the data of image and the parallax of right eye image.
BD-J is applied describes original image on logic plane 10.3D compatible layers are respectively in L graphics planes 11L and R Describe the left eye image by being generated to the original image application parallax being depicted on logic plane 10 on graphics plane 11R With right eye image.
Now, if we assume that the data of parallax are deviants(Offset), then from the position of the original image Horizontal direction(The directions x)On the number of pixels to be shifted be used as the deviant.
For L graphics plane 11L, the original image being depicted on logic plane 10 is depicted on such a position: The position is displaced the deviant in the horizontal direction, wherein direction from left to right is positive direction.That is, as in water The image that the result of the displacement for the original image being depicted on logic plane 10 deviant is obtained square upwards is made It is depicted on L graphics planes 11L with image for left eye.
For R graphics plane 11R, the original image being depicted on logic plane 10 is depicted on such a position: The position is displaced the deviant in the horizontal direction, wherein direction from right to left is positive direction.That is, as in water The image that the result of the displacement for the original image being depicted on logic plane 10 deviant is obtained square upwards is made It is depicted on R graphics planes 11R with image for right eye.
Note that the original image being depicted on logic plane 10 is by horizontal shift and is depicted on L graphics planes 11L, To not execute the region of description(Pixel)Appear in the region to be described(The feelings that position in the horizontal direction is not shifted The region of description is executed under condition)It is interior.The region of the description for not executing original image wherein of L graphics planes 11L is by with transparent face Color is described.For R graphics plane 11R, and so.
Now, it in the case where deviant is just, has been seen with the 3D rendering that image is shown using left eye image and right eye Being on the depth direction of the display screen vertical with unshowned display towards the upward emersion of nearside.On the other hand, In the case where deviant is negative, the 3D rendering shown using left eye image and right eye image is looked like in depth direction On it is recessed towards depth side.
Fig. 6 is the figure for showing wherein BD-J and applying on graphics plane 11 generating writing pattern 3D rendering to render graphical images The diagram of shape pattern.
Let us provides, for base decoder model(Reference Decoder Model), 3D compatible layers warp Include perseverance two planes(L graphics plane 11L and R graphics planes 11R), and BD-J is applied and is retouched to the execution of logic plane 10 It paints.
Then, finally, it is depicted in L graphics planes 11L(L graphics planes)On figure left eye image by be depicted in L video planes 13L(L video planes)On video(And PG)Left eye mutually mixed with image.Also, it is flat to be depicted in R figures Face 11R(R graphics planes)On figure right eye image by be depicted in R video planes 13R(R video planes)On video Right eye mutually mixed with image.
A in Fig. 6 shows mono-logical-plane+ deviant patterns, this is the one mode in graphic model Mode#1(It is also referred to as below " offset graphic model ").
In deviating graphic model, BD-J applies the non-cubic figure described on logic plane 10 as figure 2D images Picture.In addition, BD-J, which is applied to 3D compatible layers, provides a deviant.
What 3D compatible layers were provided according to the non-cubic image being depicted on logic plane 10 and from BD-J applications Deviant generates the stereo-picture as figure 3D rendering.In addition, BD players are in L graphics planes 11L(The regions L)Upper description (Storage)The left eye image of the stereo-picture is constituted, and also in R graphics planes 11R(Zone R domain)Upper description(Storage)It constitutes The right eye image of the stereo-picture.
Then, mixer 15 is description(Storage)Figure left eye image on L graphics planes 11L is regarded with L is depicted in Video on frequency plane 13L(And PG)Left eye is mutually mixed with image, and exports mixing result.In addition, mixer 15 is description Figure right eye image on R graphics planes 11R is mutually mixed with the video right eye being depicted on R video planes 13R with image, And export mixing result.
B in Fig. 6 shows stereo-logical-plane patterns, this is the one mode Mode#2 in graphic model (It is also referred to as below " solid figure pattern ").
In solid figure pattern, BD-J applies the stereogram described on logic plane 10 and constituted as figure 3D rendering The left eye of picture image and right eye image.
3D compatible layers depict the left eye image being depicted on logic plane 10 on L graphics planes 11L, and And the right eye image being depicted on logic plane 10 is also depicted on R graphics planes 11R.
Then, the figure left eye image and be depicted in L video planes that mixer 15 is depicted on L graphics planes 11L Video left eye on 13L is mutually mixed with image, and exports mixing result.In addition, mixer 15 is depicted in R graphics planes Figure right eye image on 11R is mutually mixed with the video right eye being depicted on R video planes 13R with image, and is exported mixed And result.
C in Fig. 6 shows forced-mono-logical-plane patterns, this is a kind of mould among graphic model Formula Mode#3(It is also referred to as below " forcing non-cubic graphic model ").
In forcing non-cubic graphic model, BD-J applies the solid described on logic plane 10 as figure 3D rendering Image.
3D compatible layers on one of L graphics plane 11L and R graphics planes 11R, such as only in L graphics planes 11L On, one of L graph images and R graph images of the stereo-picture being depicted on logic plane 10 are depicted, such as only describe Go out L graph images.
Then, the non-cubic image of figure and be depicted in L video planes that mixer 15 is depicted on L graphics planes 11L Video image on 13L mutually mixes, and exports mixing result.
D in Fig. 6 shows flattened-stereo-logical-plane patterns, this is one among graphic model Kind pattern Mode#4(Hereinafter also referred to " planarization solid figure pattern ").
In planarizing solid figure pattern, BD-J is applied to describe on logic plane 10 and be constituted as figure 3D rendering The left eye of stereo-picture image and right eye image.
3D compatible layers are depicted on both L graphics plane 14L and R graphics planes 14R and are depicted in logic plane One of left eye image and right eye image on 10, such as left eye image is only depicted, and abandon other right eye and use Image.
Then, the figure left eye being depicted on L graphics planes 14L is provided to mixer 15 with image, and is depicted in Figure left eye on graphics plane 14R is also supplied to mixer 15 with image(As right eye image).
E in Fig. 6 shows mono-logical-plane patterns, this is the one mode Mode#5 in graphic model (It is also referred to as below " non-cubic graphic model ").
In non-cubic graphic model, BD-J applies the non-cubic figure described on logic plane 10 as figure 2D images Picture.
3D compatible layers on one of L graphics plane 11L and R graphics planes 11R, such as only in L graphics planes 11L On, depict the non-cubic image being depicted on logic plane 10.
Then, the non-cubic image of figure and be depicted in L video planes that mixer 15 is depicted on L graphics planes 11L Video image on 13L mutually mixes, and exports mixing result.
The setting and acquisition of deviant
In 3D compatible layers, deviant can be applied to graphics plane 11 and PG planes 12.
Here, the deviant to be applied to graphics plane 11(Data for providing from parallax to graph image)It also will be by Referred to as graphics plane deviates(Graphics plane offset)Value.In addition, the deviant to be applied to PG planes 12(With In the data for providing parallax to PG images)Also it will be referred to as PG planar offsets(PG plane offset)Value.
Setting/acquisition for graphics plane deviant defines the read/write such as below for being exclusively used in deviant API, to which the special API can perform setting/acquisition of graphics plane deviant.
org.bluray.ui.3D
public void setOffset(int offset)
Default value is 0.
public int getOffset()
Default value is 0.
Note that setOffset () method is for being stored in internal storage areas(Setting)Graphics plane deviant Method, which is the storage region being arranged in the inside of BD players, and getOffset () is for obtaining The method that the graphics plane deviant in the internal storage areas of BD players must be stored in.
In addition, BD players have for storing the PSR with the related information of playback of BD(PlayerSetting Register, player set register), and graphics plane deviant and PG planar offset values are reserved for the biography of PSR System player, for example, can be stored in PSR#21.
Here, the entity of the internal storage areas and PSR are the partial memory area domain of the RAM104 or hard disk 105 in Fig. 3.
By the way, in current BD standards(BD-ROM standards)In, forbid applying to the PSR of BD players from BD-J Middle write-in.
The BD players as 3D compatible layers in Fig. 3 are allowed to apply the execution write-in into PSR that will cause from BD-J It must the current BD standards of wholesale revision.
To in 3D compatible layers, by the way that deviant is defined as general preference(GeneralPreference) Enable the write-in in PSR indirectly.
Specifically, 3D compatible layers include general preference API(Application Programming Interface), for using deviant as Meet the general preference of BD standards(General Preference)A pair be used to store the related information of playback with BD PSR#21 into the read/write of row offset value, the wherein deviant is for being carried to the figure or PG images that meet BD standards For the data of parallax.
Here, PSR#21 is mapped to the general preference of BD standard 3-2 part annex L, and value can be by Org.dvb.user.GeneralPreference API set or obtain.
For the general preference title of general preference API Access PSR(General Preference name)It can be as Get off to define.
Specifically, the general preference title of graphics plane deviant can for example be defined as " graphics offset”.In addition, the general preference title of PG planar offset values can for example be defined as " subtitle offset ".
Now, let as assume that " graphics offset " general preference and " subtitle offset " are general preferred The default value of item is for example all 0.
In addition, setting/acquisition for graphics plane deviant, defines special API such as below, to which this is special API can perform setting/acquisition of graphics plane deviant.
org.bluray.ui.3D
public void setOffset(int offset)
Default value is 0.
public int getOffset()
Default value is 0.
Note that setOffset () is in internal storage areas(Here it is, for example, PSR)Middle storage graphics plane offset The method of value, and getOffset () is inclined for obtaining the graphics plane stored in the internal storage areas of BD players The method of shifting value.
Fig. 7 is shown as executing the figure and PG that meet BD standards(Include hereinafter TextST, unless otherwise It indicates)Deviant read/write 3D compatible layers Fig. 3 in BD players functional configuration example block diagram.
Specifically, the A in Fig. 7 be shown as include the API for the read/write for being exclusively used in deviant 3D compatibility broadcast The block diagram of the functional configuration example of the BD players in Fig. 3 of device is put, which is used for the internal storage region to 3D compatible layers Domain executes the read/write of the deviant of the figure and PG that meet BD standards.
In 3D compatible layers in A in the figure 7, BD-J application requests are exclusively used in the API of the read/write of deviant (General preference API)Read/write(Setting obtains)Deviant.
In response to the request applied from BD-J, the API of the read/write of deviant is exclusively used in by deviant(Figure is flat Face deviant, PG planar offset values)It is set to the internal storage areas of 3D compatible layers, or out of 3D compatible layers Portion's storage region obtains deviant, and is returned to BD-J applications.
Note that in A in the figure 7, according to the deviant for the internal storage areas for being set to 3D compatible layers, reset Control engine(Playback Control Engine)Control is executed, to be depicted in the figure on logic plane 10 from BD-J applications Picture(Original image)It generates(It plays)Right eye image and left eye image.
As described above, defining the API for the read/write for being exclusively used in deviant, this is exclusively used in the read/write of deviant API in response to the request applied from BD-J, the reading of deviant/write is executed to the internal storage areas of 3D compatible layers Enter, which is the data for providing parallax to the figure and PG images for meeting BD standards, for being provided to image The deviant of parallax can set or obtain indirectly from BD-J applications.
B in Fig. 7 is to be shown as including for marking as BD is met using the deviant of the figure and PG that meet BD standards The 3D that accurate one of general preference to execute PSR#21 the general preference API of the read/write of deviant is compatible with broadcasting The block diagram of the functional configuration example of BD players in Fig. 3 of device.
In 3D compatible layers in B in the figure 7, the general preference API read/writes of BD-J application requests(Setting Or it obtains)Deviant.
Specifically, in the case where it is graphics plane deviant to want the deviant of read/write, BD-J application calls one As preference API, wherein general preference title(General Preference name)For " graphics offset ".
In addition, in the case where it is PG planar offset values to want the deviant of read/write, BD-J application calls are generally preferred Item API, wherein general Preference Name is known as " subtitle offset ".
In response to the request applied from BD-J, deviant is set to PSR by general preference API(Player setting is posted Storage)PSR#21, or obtain deviant from PSR#21, and be returned to BD-J applications.
Note that in B in the figure 7, control engine is reset(Playback Control Engine)According to being set to PSR# 21 deviant executes the image for being depicted in from BD-J applications on logic plane 10(Original image)It generates(It plays)Left eye With the control of image and right eye image.
As described above, according to the request applied from BD-J, general preference API is with deviant(It is to meet BD mark Accurate figure and PG images assigns the data of parallax)As one of the general preference for meeting BD standards, to storing the weight with BD The PSR#21 for putting related information executes the read/write of deviant, and the deviant to assign parallax to image can be from BD-J Using indirect setting or obtain.
Configuration
Fig. 8 is the configuration for being shown as video plane 13(configuration)One of, for playing video image The diagram of video mode.
A in Fig. 8 shows mono-video patterns(It is also referred to as below " non-cubic video mode "), this is video screen module One mode Mode#1 among formula.
In non-cubic video mode, 3D compatible layers are in L video planes 13L(The regions L)With R video planes 13R(R Region)One of on, such as only on L video planes 13L, describe(Storage)Non-cubic image as video 2D images.
Then, only description(Storage)The non-cubic image of video on L video planes 13L is supplied to mixer 15.
B in Fig. 8 shows dual-mono-video patterns(It is also referred to as below " double non-cubic video modes "), this It is the one mode Mode#2 among video mode.
In double non-cubic video modes, 3D compatible layers are in L video planes 13L(The regions L)Upper description(Storage)Make For the non-cubic image of video 2D images(As left eye image), and also in R video planes 13R(Zone R domain)Upper description(It deposits Storage)The non-cubic image(As right eye image).
Then, describe(Storage)The non-cubic image of video on L video planes 13L and description(Storage)It is flat in R videos The non-cubic image of video on the 13R of face is provided to mixer 15.
C in Fig. 8 shows stereo-video patterns(It is also referred to as below " three-dimensional video-frequency pattern "), this is video screen module One mode Mode#3 among formula.
In three-dimensional video-frequency pattern, 3D compatible layers describe composition as video 3D rendering on L video planes 13L The left eye image of stereo-picture, and describe the right eye image for constituting the stereo-picture also on R video planes 13R.
Then, describe(Storage)Video left eye image on L video planes 13L and description(Storage)It is flat in R videos Video right eye is supplied to mixer 15 with image on the 13R of face.
D in Fig. 8 shows flattened-stereo-video patterns(It is also referred to as " planarization three-dimensional video-frequency below Pattern "), this is the one mode Mode#4 among video mode.
In planarizing three-dimensional video-frequency pattern, 3D compatible layers are using composition as a left side for the stereo-picture of video 3D rendering One of ophthalmically acceptable image and right eye image(Such as only left eye image)It is depicted in L video plane 13L and R video planes 13R two On person, and abandon other right eye image.
Then, describe(Storage)Video left eye on L video planes 13L is provided to mixer 15 with image, and The video left eye being depicted on R video planes 13R is also supplied to mixer 15 with image(As right eye image).
E in Fig. 8 shows forced-mono-video patterns(It is also referred to as " forcing non-cubic video screen module below Formula "), this is the one mode Mode#5 among video mode.
In forcing non-cubic video mode, 3D compatible layers are in one of L video plane 13L and R video planes 13R On, such as only on L video planes 13L, depict the left eye image for constituting the stereo-picture as video 3D rendering and the right side One of ophthalmically acceptable image, such as left eye image is only depicted, and abandon other right eye image.
Then, only description(Storage)Video left eye on L video planes 13L is supplied to mixer 15 with image.
Fig. 9 is the configuration for being shown as background plane 14(configuration)One of, for playing background image The diagram of background mode.
A in Fig. 9 shows dual-mono-background patterns(It is also referred to as " double non-cubic background moulds below Formula "), this is the one mode Mode#1 among background mode.
In double non-cubic background modes, BD-J, which is applied, to be described on logic plane 10 as the 2D images in background mode Non-cubic image as left eye image and right eye image.
Then, 3D compatible layers are in L background planes 14L(The regions L)On depict(Storage)It is depicted in logic plane Left eye image on 10, and also in R background planes 14R(Zone R domain)On depict(Storage)It is depicted in logic plane 10 On right eye image.
Describe(Storage)Background left eye image on L background planes 14L and the back of the body being depicted on R background planes 14R Scape right eye is supplied to mixer 15 with image.
B in Fig. 9 shows stereo-background patterns(It is also referred to as below " stereo background pattern "), this is One mode Mode#2 among background mode.
In stereo background pattern, BD-J applies the stereogram described on logic plane 10 and constituted as background 3D rendering The left eye of picture image and right eye image.
Then, 3D compatible layers depict the left eye figure being depicted on logic plane 10 on L background planes 14L Picture, and the right eye image being depicted on logic plane 10 is also depicted on R background planes 14R.
The background left eye image being depicted on L background planes 14L and the background right eye being depicted on R background planes 14R It is supplied to mixer 15 with image.
C in Fig. 9 shows flattened-stereo-background patterns(It is also referred to as " planarization solid below Background mode "), this is the one mode Mode#3 among background mode.
In planarizing stereo background pattern, BD-J is applied to describe on logic plane 10 and be constituted as background 3D rendering The left eye of stereo-picture image and right eye image.
Then, 3D compatible layers are one of the left eye image and right eye image being depicted on logic plane 10 (Such as only left eye image)It is depicted on both L background plane 14L and R background planes 14R, and abandons other right eye and use Image.
The background left eye being depicted on L background planes 14L is provided to mixer 15 with image, and is depicted in R backgrounds Background left eye on plane 14R is also supplied to mixer 15 with image(As right eye image).
D in Fig. 9 shows mono-background patterns(It is also referred to as below " non-cubic background mode "), this is One mode Mode#4 among background mode.
In non-cubic background mode, BD-J applies the non-cubic figure described on logic plane 10 as background 2D images Picture.
Then, 3D compatible layers are on one of L background plane 14L and R background planes 14R, such as only in L background planes On 14L, the non-cubic image being depicted on logic plane 10 is depicted.
The non-cubic image of background being depicted on L background planes 14L is provided to mixer 15.
E in Fig. 9 shows forced-mono-background patterns(It is also referred to as " forcing non-cubic background below Pattern "), this is the one mode Mode#5 among background mode.
In forcing non-cubic background mode, BD-J is applied to describe on logic plane 10 and be constituted as background 3D rendering The left eye of stereo-picture image and right eye image.
Then, 3D compatible layers are on one of L background plane 14L and R background planes 14R, such as only in L background planes On 14L, one of the left eye image described on logic plane 10 and right eye image are depicted, such as only depicts left eye use Image, and abandon other right eye image.
The background left eye being depicted on L background planes 14L is provided to mixer 15 with image.
Now, the graphics plane 11 that figure is stored shown in Fig. 4, the video plane 13 for storing video are let as assume that (And the PG planes 12 of storage PG)And the background plane 14 of storage background is also collectively referred to as equipment plane.
In the BD players as 3D compatible layers in figure 3, the configuration of equipment plane is defined as by following four A attribute indicates:(1)Resolution ratio and color depth,(2)Video mode(Video mode),(3)Graphic model(BD-J Graphics mode), and(4)Background mode(Background mode).
Figure 10 show the graphics plane 11 as equipment plane, PG planes 12, video plane 13 and background plane 14 it Between relationship.
Graphics plane 11 is by serving as the L graphics planes 11L as the regions L of the storage region for storing left eye image And it serves as and is constituted as the R graphics planes 11R in the Zone R domain of the storage region for storing right eye image.Then, in figure In plane 11, be arranged side by side L graphics plane 11L and R graphics planes 11R.
Specifically, in Fig. 10, L graphics planes 11L and R graphics plane 11R is arranged to following form by tile vertically: Wherein, it is disposed in upside as the L graphics planes 11L in the regions L, and the R graphics planes 11R as Zone R domain is disposed in Downside, to constitute graphics plane 11.
Other equipment plane, i.e. PG planes 12, video plane 13 and background plane 14, and with identical as graphics plane 11 Mode constitute.
The image being depicted on graphics plane 11, PG planes 12, video plane 13 and background plane 14 proximally rises by figure Shape plane 11, PG planes 12, the sequence of video plane 13 and background plane 14 are applied(It mixes), and obtained as its result The image in the regions L and the image in Zone R domain alternately described(Storage)On logical screen 21, it is abstracted in the logical screen 21 Go out the display screen of display.
Here, the entity of logical screen 21 is the partial memory area domain of RAM104.
In addition, equipment plane is all the regions L by being wherein arranged vertically the storage region individually for two images It is constituted with the storage region in Zone R domain, and thereby is the storage region for two images, but logical screen 21 is to be used for one The storage region of image.
For 3D rendering, the configuration of equipment plane is flat for the equipment as the storage region for two images Face integrally defines.
Figure 11 shows a configuration as equipment plane(1)Picture frame(Resolution ratio, Resolution)And color Depth(color-depth).
In fig. 11, the picture frame of the five-element from top(The number of horizontal pixel × vertical pixel of equipment plane) (Resolution ratio)The picture frame and color depth of 3D rendering, and the remaining five-element are indicated with color depth(The five-element from bottom) Picture frame and color depth indicate the picture frame and color depth of 2D images.
In the case where an image of 2D images is as an image, 3D rendering is by left eye image and right eye image It constitutes, to be two images.In addition, all devices plane is all wherein to be arranged vertically individually to be used for an image The storage region in the regions L and Zone R domain of storage region, to be stored in the image of the 3D rendering in such a equipment plane Frame has by by corresponding 2D images(With with left eye image(Or right eye image)The 2D images of same size)Image Number of pixels in the vertical direction of frame doubles and the size that obtains.
Note that in current BD standards, for 2D images, the figure being stored in graphics plane 11(Image)Image Frame and the background being stored in background plane 14(Image)Picture frame and the video that is stored in video plane 13(Image) Picture frame it is substantially matched.
However, for 2D images, the picture frame of the video in video plane 13 to be stored in is 1920 × 1080 pixels In the case of, the image of the picture frame for the background that be stored in background plane 14 and the video that be stored in video plane 13 Frame is equally 1920 × 1080 pixels, but the picture frame for the figure that be stored in graphics plane 11 may be by handle and deposit Store up the picture frame of video in video plane 13 width and length it is each divided by 2 and 960 × 540 pixels that obtain(In Figure 11 Fourth line from bottom)(Hereinafter, being referred to as " mismatch condition of 2D images ").
In the case, in the width and length of the figure by making 960 × 540 pixels in graphics plane 11 to be stored in Degree respectively doubles 1920 × 1080 pixel phases to make its size with the picture frame as the video in video plane 13 to be stored in After matching, the figure is shown.
For 3D rendering, it is also possible to there is situation corresponding with the mismatch condition of 2D images(It is also referred to as " 3D figures below The mismatch condition of picture ").
For the mismatch condition of 3D rendering, the picture frame of the video in video plane 13 to be stored in is 1920 × 2160 In the case of pixel, the picture frame for the background that be stored in background plane 14 and the video that be stored in video plane 13 Picture frame is equally 1920 × 2160 pixels, but the picture frame for the figure that be stored in graphics plane 11 may be by handle and want Be stored in the picture frame of the video in video plane 13 width and length it is each divided by 2 and 960 × 1080 pixels that obtain(Figure 11 In the third line from top).
Even if under the mismatch condition of 3D rendering, and in the width and length of the figure by making 960 × 1080 pixels Respectively double 1920 × 2160 pixel phases so that its size and the picture frame as the video in video plane 13 to be stored in With later, the figure is shown.
Figure 12 is for describing to utilize the second plotting method in the mismatch condition of 3D rendering(B in Fig. 5)Describe 3D figures The diagram of the method for picture.
In the second plotting method(Such as described in B in Figure 5), serve as the original graph in the source for generating 3D rendering As being depicted on logic plane 10, and then will by original image in the horizontal direction shift offsets value by generate Left eye image and right eye are depicted in image on graphics plane 11.
Now, the second plotting method is also described as such a method:Wherein, by according to deviant horizontal shift Top half and the lower half portion of the longer image of one vertical direction and two images obtaining are as left eye image and right eye It is depicted on graphics plane 11 with image, wherein being arranged vertically original image and original in the longer image of the vertical direction The two images of the copy of beginning image.
In the second plotting method, under the mismatch condition of 3D rendering, by being shifted in the horizontal direction according to deviant In the top half and lower half portion of the figure of 960 × 1080 pixels each and the left eye of 960 × 540 pixels that obtains is used Image and right eye are depicted in image on graphics plane 11, and then in the left eye image and right eye for making graphics plane 11 After respectively being doubled with the width of image and length, the left eye image and right eye that are obtained as its result are horizontally oriented with image Shift amount be deviant twice of image.
To in the case, on the depth direction of the 3D rendering shown using left eye image and right eye image Position is the position different from position expected from author.
Therefore, it under the mismatch condition of 3D rendering, if describing 3D rendering using the second plotting method, is filled by making When the image that the width and length of the original image in the source for generating 3D rendering are respectively doubled and obtained needs to be depicted in logic In plane 10, and then to be given birth to by so that the image being depicted on logic plane 10 is shifted the deviant in the horizontal direction At left eye image and right eye need to be depicted on graphics plane 11 with image.
To which the position on the depth direction of the 3D rendering shown with image using left eye image and right eye is that author is pre- The position of phase.
Figure 13 is the diagram for describing equipment plane.
In current BD standards, the storage region for an image is assumed logical screen 21, and does not assume that Left eye image(Left/Left-eye)With right eye image(Right/Right-eye)It is used for as this by being alternately depicted in On the logical screen 21 of the storage region of one image.
In addition, in current BD standards, it is assumed that there are one-to-one between the configuration and logical screen 21 of equipment plane Relationship.Under this hypothesis, for 3D rendering processing, logical screen for describing left eye image and used for describing right eye The two individual logical screens of the logical screen of image need to be provided as logical screen 21.
Therefore, in the BD players as 3D compatible layers in figure 3, by making the clear of resolution ratio in vertical direction Clear degree doubles the device configuration to utilize an image definition for L/R.Define one describe model, wherein logical screen itself with Traditional approach is considered as an image, and the output for L/R is described on it simultaneously.
That is, the BD players in Fig. 3 include the equipment that storage meets the figure of BD standards, video or background image Plane(Graphics plane 11, video plane 13(PG planes 12)With background plane 14).
Equipment plane is wherein regions L(Store the storage region for an image of left eye image)With Zone R domain(It deposits Store up the storage region for an image of right eye image)It is deposited in this way for what the storage region of two images was arranged side by side Storage area domain, and the configuration of equipment plane is the whole definition for the equipment plane as the storage region for two images 's.
Then, the left eye being stored in equipment plane image and right eye are for example alternately depicted in logical screen with image On 21.
To store left eye image(Image for L)Logical screen and storage right eye image(Figure for R Picture)Logical screen need not be provided separately.
Video mode, graphic model and background mode
It can be by BD-J objects(Object)A bit field for being used for specified configuration is provided in file, to utilize The bit field is specified(Setting)Configuration.
Figure 14 is shown will provide the bit field for carrying out specified configuration in BD-J obj ect files.
Can be provided in BD-J obj ect files initial_configuration_id, initial_graphics_mode, This four fields of initial_video_mode and initial_background_mode carry out specified configuration.
Initial_configuration_id is for specifying(1)The field of picture frame and color depth.If we It is assumed that the value that initial_configuration_id is taken is configuration id, then following values can be defined as configuring id.
HD_1920_1080=1
HD_1280_720=2
SD_720_576=3
SD_720_480=4
QHD_960_540=5
HD_1920_2160=6
HD_1280_1440=7
SD_720_1152=8
SD_720_960=9
QHD_960_1080=10
Note that HD_1920_1080 indicates the picture frame and color depth from top at the 6th row, HD_ in Figure 11 1280_720 indicates that the picture frame and color depth from top at the 8th row in Figure 11, SD_720_576 indicate in Figure 11 from top The picture frame and color depth at the tenth row play in portion, SD_720_480 indicate picture frame in Figure 11 from top at the 9th row and Color depth, QHD_960_540 indicate the picture frame and color depth from top at the 7th row, HD_1920_2160 in Figure 11 Indicate picture frame and color depth from top at the first row in Figure 11, HD_1280_1440 indicates in Figure 11 from top the Picture frame at two rows and color depth, SD_720_1152 indicate the picture frame and color from top at fifth line in Figure 11 Depth, SD_720_960 indicate the picture frame and color depth from top at fourth line in Figure 11, and QHD_960_1080 Indicate picture frame and color depth from top at the third line in Figure 11.
Initial_graphics_mode is for specifying(3)The field of graphic model.
Now, there are five types of patterns as graphic model in total(BD-J Graphics mode), i.e., what is described in figure 6 is inclined Move graphic model(Offset), solid figure pattern(It is three-dimensional), non-cubic graphic model(It is non-cubic(Conventional replay pattern)), force Non-cubic graphic model(It forces non-cubic(Conventional replay pattern))And planarization solid figure pattern(Planarization is three-dimensional).
Let as assume that following values is defined for the initial_graphics_mode of assignment graph pattern.
GRAPHICS_MONO_VIEW=22
GRAPHICS_STEREO_VIEW=23
GRAPHICS_PLANE_OFFSET=24
GRAPHICS_DUAL_MONO_VIEW=25
GRAPHICS_FORCED_MONO_VIEW=26
Note that GRAPHICS_MONO_VIEW indicates that non-cubic graphic model, GRAPHICS_STEREO_VIEW indicate vertical Volume graphic pattern, GRAPHICS_PLANE_OFFSET indicate that offset graphic model, GRAPHICS_DUAL_MONO_VIEW indicate Solid figure pattern is planarized, and GRAPHICS_FORCED_MONO_VIEW indicates to force non-cubic graphic model.
In addition, the case where initial_configuration_id is set to any one of 1,2,3,4 and 5 Under, initial_graphics_mode is ignored.
Initial_video_mode is for specifying(2)The field of video mode.
Now, there are five types of patterns as video mode in total(Video mode), i.e., what is described in fig. 8 double non-cubic regards Frequency pattern(It is double non-cubic), three-dimensional video-frequency pattern(It is three-dimensional), planarization three-dimensional video-frequency pattern(Planarization is three-dimensional), non-cubic video Pattern(It is non-cubic(Conventional replay pattern))And force non-cubic video mode(It forces non-cubic).
Let as assume that following values is defined for the initial_video_mode of designated pattern.
VIDEO_MONO_VIEW=27
VIDEO_STEREO_VIEW=28
VIDEO_FLATTENED_STEREO_VIEW=29
VIDEO_DUAL_MONO_VIEW=30
VIDEO_FORCED_MONO_VIEW=31
Note that VIDEO_MONO_VIEW indicates that non-cubic video mode, VIDEO_STEREO_VIEW indicate three-dimensional video-frequency Pattern, VIDEO_FLATTENED_STEREO_VIEW indicate planarization three-dimensional video-frequency pattern, VIDEO_DUAL_MONO_VIEW tables Show double non-cubic video modes, and VIDEO_FORCED_MONO_VIEW indicates to force non-cubic video mode.
In addition, in the case where initial_configuration_id is set to one of 1,2,3,4 and 5, Initial_video_mode is ignored.
Initial_background_mode is for specifying(4)The field of background mode.
Now, there are five types of patterns as background mode in total(Backgroud mode), i.e., what is described in fig.9 is double non-vertical Body background mode(It is double non-cubic), stereo background pattern(It is three-dimensional), planarization stereo background pattern(Planarization is three-dimensional), it is non-cubic Background mode(It is non-cubic(Conventional replay pattern))And force non-cubic background mode(It forces non-cubic).
Let as assume that following values is defined for the initial_background_mode of specific context pattern.
BACKGROUND_MONO_VIEW=17
BACKGROUND_STEREO_VIEW=18
BACKGROUND_FLATTENED_STEREO_VIEW=19
BACKGROUND_DUAL_MONO_VIEW=20
BACKGROUND_FORCED_MONO_VIEW=21
Note that BACKGROUND_MONO_VIEW indicates non-cubic background mode, BACKGROUND_STEREO_VIEW tables Show that stereo background pattern, BACKGROUND_FLATTENED_STEREO_VIEW indicate planarization stereo background pattern, BACKGROUND_DUAL_MONO_VIEW indicates double non-cubic background modes, and BACKGROUND_FORCED_MONO_VIEW It indicates to force non-cubic background mode.
In addition, in the case where initial_configuration_id is set to one of 1,2,3,4 and 5, Initial_background_mode is ignored.
Now, for BD-J obj ect files, such specification may be used:Wherein, in initial_ Configuration_id, initial_graphics_mode, initial_video_mode and initial_ Among background_mode, initial_configuration_id is only specified.
For BD-J obj ect files, in the case where only specifying initial_configuration_id, it is desirable to provide The acquiescence of initial_video_mode, initial_graphics_mode and initial_background_mode provide Value.
Figure 15 shows initial_video_mode, initial_graphics_mode and initial_ The acquiescence specified value of background_mode.
Note that video mode(initial_video_mode)STEREO_VIEW indicate above-mentioned VIDEO_STEREO_ VIEW or VIDEO_FLATTENED_STEREO_VIEW, and MONO_VIEW indicate above-mentioned VIDEO_MONO_VIEW or VIDEO_DUAL_MONO_VIEW。
In addition, graphic model(initial_graphics_mode)STEREO_VIEW indicate above-mentioned GRAPHICS_ STEREO_VIEW or GRAPHICS_PLANE_OFFSET, and MONO_VIEW indicates above-mentioned GRAPHICS_MONO_VIEW Or GRAPHICS_DUAL_MONO_VIEW.
In addition, background mode(initial_background_mode)STEREO_VIEW indicate above-mentioned BACKGROUND_STEREO_VIEW or BACKGROUND_FLATTENED_STEREO_VIEW, and in MONO_VIEW expressions The BACKGROUND_MONO_VIEW or BACKGROUND_DUAL_MONO_VIEW stated.
The change of configuration
Next, by the change of description configuration.
Configuration can be changed in following timing:Automatic resetting quilt when starting BD-J titles or when broadcasting PlayList When execution(Dynamic changes), or when the API Calls that BD-J applications carry out are performed(Dynamic changes).
It is different when from the conventional replay of non-cubic video+non-cubic figure, even if during the playback of AV, planar configuration Change is also available.
That is, in 3D compatible layers, AV streams can played(Video)When change configuration.
Similar with Mono-view, in the playback in addition to being reset except KEEP_RESOLUTION, 3D compatible layers execute Configuration change processing, so that picture frame is aligned(Make the picture frame pair of video/background and figure when starting BD-J titles Together so that be aligned with the picture frame of video in PlayList playback times figure/background, or to carry out API in BD-J applications When calling, the picture frame of the plane set by API is aligned with the picture frame of the plane not set in addition to the plane).In addition, Error disposal when configuration change depends on 3D compatible layers.
Now, KEEP_RESOLUTION playbacks are a kind of for synthesizing SD(Single-definition)Video and HD(High-resolution Degree)The replay mode of figure and HD backgrounds, and there is regarding for the figure, 720 × 480 pixels for synthesizing 1920 × 1080 pixels Frequently the case where the background of+PG and 1920 × 1080 pixels, and the figure of 1920 × 1080 pixels of synthesis, 720 × 576 pixels The case where background of video+PG and 1920 × 1080 pixels.Note that no matter HD images, reset in KEEP_RESOLUTION In include 1280 × 720 pixels image reproduction.
Figure 16 and 17 shows video+PG, BD-J figures and the background of the playback other than KEEP_RESOLUTION is reset Resolution ratio(Picture frame)Combination.Note that Figure 17 is the figure of hookup 16.
Figure 18 shows the example of configuration change processing.
A in Figure 18 is shown in figure(Graphics plane 11)Configuration(Video mode)From STEREO_VIEW change to The example of the processing of 3D compatible layers in the case of MONO_VIEW.
For example, in 3D compatible layers, in the case where video mode is STEREO_VIEW, figure is depicted in structure On L graphics plane 11L and R graphics planes 11R at the graphics plane 11 of 1920 × 2160 pixels, lets as assume that and do not resetting Graphics plane 11(Serve as the storage region of graphics plane 11)In the case of video mode by from STEREO_VIEW change to MONO_VIEW。
In the case, it in 3D compatible layers, only stores(Describe)In the L graphics planes for constituting graphics plane 11 One of 11L and R graphics planes 11R(Such as L graphics planes 11L)On image be provided to logical screen 21 and show, and deposit The image stored up in the R graphics planes 11R as another is then dropped.
Note that in the case, 3D compatible layers can be terminated with the formal compulsion of mistake(The playback of image).
B in Figure 18 shows that 3D is compatible in the case where video mode is changed from MONO_VIEW to STEREO_VIEW The example of the processing of player.
For example, in 3D compatible layers, in the case where video mode is MONO_VIEW, figure is only depicted in structure On L graphics planes 11L at the graphics plane 11 of 1920 × 1080 pixels, let as assume that in the feelings for not resetting graphics plane 11 Video mode is changed from MONO_VIEW to STEREO_VIEW under condition.
In the case, in 3D compatible layers, it is flat that the figure that is depicted on L graphics planes 11L is copied into R figures Face 11R, the figure being depicted on L graphics planes 11L is provided to logical screen 21 and is used as left eye image, and copies R to The figure of graphics plane 11R is also supplied to logical screen 21 and is used as right eye image.
Note that in the case, 3D compatible layers can be terminated with the formal compulsion of mistake(The playback of image).
The change configured when starting BD-J titles
Three rule #1-1, #1-2 and #1-3 are applied to configuration change when starting BD-J titles in principle below.
Specifically, rule #1-1 is such rule:(Equipment plane)In configuration, figure, video and background Three images resolution ratio(Picture frame)Must be equal resolution always.
Regular #1-2 is such rule:It is reset executing the PlayList in addition to KEEP_RESOLUTION is reset In the case of, in configuration, the resolution ratio of three images of figure, video and background(Picture frame)It must be with the resolution ratio of video Alignment.
Regular #1-3 is such rule:In configuration, in the case where figure is QHD figures, in vertical direction Resolution ratio after doubling and doubling in proportion in the horizontal direction in proportion is considered as the resolution ratio of configuration.
Note that the value of each in video mode, graphic model and background mode is according to BD-J obj ect files The default value of initial_configuration_id provides to determine(Determine video mode, graphic model and background mould Formula).
In addition, in the case where the autostart_first_PlayList_flag of BD-J obj ect files is set to 1b, Default value is not deferred in the change of the configuration of video plane, and defers to the automatic resetting of the playback time of PlayList(Dynamic changes)Rule Then.
Configuration change when executing PlayList-playback-time and resetting automatically(Dynamic changes)
Three rule #2-1, #2-2 and #2-3 are applied to the automatic weight when executing PlayList and playing in principle below Configuration change when setting.
Specifically, rule #2-1 is such rule:(Equipment plane)In configuration, figure, video and background Three images resolution ratio(Picture frame)Must be equal resolution always.
Regular #2-2 is such rule:It is reset executing the PlayList in addition to KEEP_RESOLUTION is reset In the case of, in configuration, the resolution ratio of three images of figure, video and background(Picture frame)It must be with the resolution ratio of video Alignment.
Regular #2-3 is such rule:In configuration, in the case where figure is QHD figures, in vertical direction Resolution ratio after doubling and doubling in proportion in the horizontal direction in proportion is considered as the resolution ratio of configuration.
When the playback of PlayList starts, video plane configuration is aligned with the video attribute of PlayList automatically.
In the case where configuration is aligned with the video attribute of PlayList automatically, it is specified that as BD in current BD standards The necessary function of player side makes graphics plane and background plane are aligned with the attribute of video plane automatically.However, being compatible in 3D In player, from three-dimensional PlayList(Playlist for playing 3D rendering)It is switched to non-cubic PlayList(For Play the playlist of 2D images)When, or when being switched to three-dimensional PlayList from non-cubic PlayList, figure and background Pattern(Graphic model and background mode)It is set to scheduled initial value.
Figure 19 shows graphic model and the predetermined initial value of background mode.
Figure 20 is shown in the 3D rendering for playing 1920 × 2160 pixels(Stereo-picture)In the case of the figure to be played And background image.
The 3D rendering of one 1920 × 2160 pixels is played as figure, and the 3D rendering quilt of one 1920 × 2160 pixels It is played as background.
Configuration change when executing the API Calls carried out by BD-J applications(Dynamic changes)
Three rule #3-1, #3-2 and #3-3 are applied in principle below is executing the API tune carried out by BD-J applications The configuration change of used time.
Specifically, rule #3-1 is such rule:(Equipment plane)In configuration, figure, video and background Three images resolution ratio(Picture frame)Must be equal resolution always.
Regular #3-2 is such rule:In configuration, executing in addition to KEEP_RESOLUTION is reset In the case that PlayList is reset, the resolution ratio of three images of figure, video and background(Picture frame)It must be with point of video Resolution is aligned.
Regular #3-3 is such rule:In configuration, in the case where figure is QHD figures, in vertical direction Resolution ratio after doubling and doubling in proportion in the horizontal direction in proportion is considered as the resolution ratio of configuration.
Figure 21 is for according to the API Calls carried out by BD-J applications, serving as the resolution ratio of configuration(Picture frame)Change Diagram.
In figure 3D rendering(Three-dimensional G), video 3D rendering(Three-dimensional V)With background 3D rendering(Three-dimensional B)Playback during, In the case that the resolution ratio of figure 3D rendering is changed according to API Calls, 3D is compatible with BD players according to above-mentioned rule #3- 1, #3-2 and #3-3 changes the resolution ratio of video 3D rendering and background 3D rendering automatically.
In addition, in figure 3D rendering(Three-dimensional G), video 3D rendering(Three-dimensional V)With background 3D rendering(Three-dimensional B)The playback phase Between, in the case where the resolution ratio of background 3D rendering is changed according to API Calls, 3D is compatible with BD players according to above-mentioned rule Then #3-1, #3-2 and #3-3 change the resolution ratio of figure 3D rendering and video 3D rendering automatically.
In addition, in figure 3D rendering(Three-dimensional G), video 3D rendering(Three-dimensional V)With background 3D rendering(Three-dimensional B)The playback phase Between, in the case where the resolution ratio of video 3D rendering is changed according to API Calls, 3D is compatible with BD players according to above-mentioned rule Then #3-1, #3-2 and #3-3 change the resolution ratio of figure 3D rendering and background 3D rendering automatically.
The change of the pattern of planar configuration(The change of graphic model, video mode and background mode)
3D compatible layers can be in solid figure pattern(Solid figure)With offset graphic model(Deviate figure)Between Seamlessly execute the change of graphic model(Switching).
Figure 22 is the diagram of the change for describing graphic model.
A in Figure 22 shows such a case, that is, the figure 3D rendering in deviating graphic model(Planar offset gfx(Figure)), video(And PG)3D rendering(Three-dimensional video-frequency+PG)And background 3D rendering(Stereo background)Playback during, figure Shape pattern is changed from offset graphic model to solid figure pattern.
In the case, it executes from the figure 3D rendering in offset graphic model(Planar offset gfx), video(And PG)3D Image(Three-dimensional video-frequency+PG)And background 3D rendering(Stereo background)Playback to the figure 3D rendering in solid figure pattern (Three-dimensional gfx(Figure)), video(And PG)3D rendering(Three-dimensional video-frequency+PG)And background 3D rendering(Stereo background)Playback Switching, and the switching can be performed seamlessly.
Inverse switching, i.e., from the figure 3D rendering in solid figure pattern(Three-dimensional gfx), video(And PG)3D rendering(It is three-dimensional Video+PG)And background 3D rendering(Stereo background)Playback to offset graphic model in figure 3D rendering(Planar offset gfx), video(And PG)3D rendering(Three-dimensional video-frequency+PG)And background 3D rendering(Stereo background)The switching of playback also can quilt Seamlessly execute.
B in Figure 22 shows such a case, that is, the figure 3D rendering in solid figure pattern(Three-dimensional gfx)、 Video(And PG)3D rendering(Three-dimensional video-frequency+PG)And background 2D images(Non-cubic background)Playback during, graphic model quilt Change from solid figure pattern to offset graphic model.
In the case, it executes from the figure 3D rendering in solid figure pattern(Three-dimensional gfx), video(And PG)3D rendering (Three-dimensional video-frequency+PG)And background 2D images(Non-cubic background)Playback to offset graphic model in figure 3D rendering(It is flat Face deviates gfx), video(And PG)3D rendering(Three-dimensional video-frequency+PG)And background 2D images(Non-cubic background)Playback cut It changes, and the switching can be performed seamlessly.
Inverse switching, i.e., from the figure 3D rendering in offset graphic model(Planar offset gfx), video(And PG)3D rendering (Three-dimensional video-frequency+PG)And background 2D images(Non-cubic background)Playback to the figure 3D rendering in solid figure pattern(It is vertical Body gfx), video(And PG)3D rendering(Three-dimensional video-frequency+PG)And background 2D images(Non-cubic background)Playback switching It can be performed seamlessly.
Figure 23 shows graphic model from solid figure pattern to the change of offset graphic model.
In graphic model by from solid figure pattern(Three-dimensional gfx)Change to offset graphic model(Planar offset gfx) In the case of, video(L/R(Left/right)Video)And background(L/R(Left/right)Background)Playback continue to.
On the other hand, for figure, playback object is from the figure 3D rendering in solid figure pattern(Three-dimensional gfx)It is switched to Deviate the figure 3D rendering in graphic model(Planar offset gfx).
The realization of the switching method of this playback object depends on individual 3D compatible layers.However, in switching playback object When, it is necessary to prevent so-called blank screen(black-out)And AV(Video)The interruption of playback.
Note that in the case of also changing resolution ratio when changing graphic model, it may occur however that blank screen.
Next, 3D compatible layers can be in stereo background pattern(Stereo background)With non-cubic background mode(It is non-cubic Background)Between seamlessly execute the change of background mode(Switching).
Figure 24 is the diagram of the change for describing background mode.
A in Figure 24 shows such a case, that is, in figure 3D rendering(Three-dimensional gfx), video(And PG)3D rendering (Three-dimensional video-frequency+PG)And the background 3D rendering in stereo background pattern(Stereo background)Playback during, background mode by from Non-cubic background mode has been arrived in the change of stereo background pattern.
In the case, it executes from figure 3D rendering(Three-dimensional gfx), video(And PG)3D rendering(Three-dimensional video-frequency+PG)With And the background 3D rendering in stereo background pattern(Stereo background)Playback to figure 3D rendering(Three-dimensional gfx), video(And PG) 3D rendering(Three-dimensional video-frequency+PG)And the background 2D images in non-cubic background mode(Non-cubic background)Playback switching, And the switching can be performed seamlessly.
Inverse switching can be also performed seamlessly.
B in Figure 24 shows such a case, that is, in figure 3D rendering(Planar offset gfx), video(And PG)3D Image(Three-dimensional video-frequency+PG)And the background 2D images in non-cubic background mode(Non-cubic background)Playback during, background Pattern is changed from non-cubic background mode to stereo background pattern.
In the case, it executes from figure 3D rendering(Planar offset gfx), video(And PG)3D rendering(Three-dimensional video-frequency+ PG)And the background 2D images in non-cubic background mode(Non-cubic background)Playback to figure 3D rendering(Planar offset gfx), video(And PG)3D rendering(Three-dimensional video-frequency+PG)And the background 3D rendering in stereo background pattern(Stereo background)'s The switching of playback, and the switching can be performed seamlessly.
Inverse switching can be also performed seamlessly.
Next, 3D compatible layers can be in three-dimensional video-frequency pattern(Three-dimensional video-frequency), planarization three-dimensional video-frequency pattern(It is flat Change three-dimensional video-frequency)With double non-cubic video modes(Double non-cubic videos)Between seamlessly execute the change of video mode(It cuts It changes).
Figure 25 is the diagram of the change for describing video mode.
A in Figure 25 is for describing in figure 3D rendering(Three-dimensional gfx), background 3D rendering(Stereo background)And video The diagram of the change of video mode in the case that image is played.
It is three-dimensional video-frequency pattern in video mode, and the video in three-dimensional video-frequency pattern(And PG)3D rendering(Stereopsis Frequently+PG)In the case of being just played, when video mode is changed from three-dimensional video-frequency pattern to planarization three-dimensional video-frequency pattern, Video image is by from the video in three-dimensional video-frequency pattern(And PG)3D rendering(Three-dimensional video-frequency+PG)It is switched to planarization three-dimensional video-frequency Video in pattern(And PG)3D rendering(Planarize video+PG), and the switching can be performed seamlessly.
Inverse switching can be also performed seamlessly.
In addition, being planarization three-dimensional video-frequency pattern in video mode, and planarize the video in three-dimensional video-frequency pattern(With PG)3D rendering(Planarize video+PG)In the case of being just played, when video mode is changed from planarization three-dimensional video-frequency pattern When to double non-cubic video modes, video image by from planarization three-dimensional video-frequency pattern in video(And PG)3D rendering(It is flat Change video+PG)The video being switched in double non-cubic video modes(And PG)3D rendering(Double non-cubic video+PG), and should Switching can be performed seamlessly.
Inverse switching can be also performed seamlessly.
B in Figure 25 is for describing in figure 3D rendering(Planar offset gfx), background 2D images(Non-cubic background)With And video image be played in the case of video mode change diagram.
It is double non-cubic video mode in video mode, and the video in double non-cubic video modes(And PG)3D rendering (Double non-cubic video+PG)In the case of being just played, when video mode is changed from double non-cubic video modes to planarization When three-dimensional video-frequency pattern, video image is by from the video in dual-video mode(And PG)3D rendering(Double non-cubic video+PG)It cuts Change to the video in planarization three-dimensional video-frequency pattern(And PG)3D rendering(Planarize video+PG), and the switching can be seamless Ground executes.
Inverse switching can be also performed seamlessly.
In addition, being planarization three-dimensional video-frequency pattern in video mode, and planarize the video in three-dimensional video-frequency pattern(With PG)3D rendering(Planarize video+PG)In the case of being just played, when video mode is changed from planarization three-dimensional video-frequency pattern When to three-dimensional video-frequency pattern, video image by from planarization three-dimensional video-frequency pattern in video(And PG)3D rendering(Planarization regards Frequently+PG)The video being switched in three-dimensional video-frequency pattern(And PG)3D rendering(Three-dimensional video-frequency+PG), and the switching can be seamless Ground executes.
Inverse switching can be also performed seamlessly.
For changing the 3D compatible layers of configuration
In current BD standards, configuration is to utilize resolution ratio(Picture frame)Come with color depth defined.Therefore, configuration Changing means the change of resolution ratio.However, in resolution changing, playback is stopped temporarily, and shows that screen becomes black Screen state.
On the other hand, for example, non-cubic logic plane+deviant replay mode etc. of graphics plane can be specified The configuration of 1920 × 1080/32bpp, but such case for example may be due to being switched to from non-cubic logic plane+deviant Three-dimensional logic plane etc. and lead to blank screen.
Therefore, in 3D compatible layers, planar configuration is unified for two-sided definition(1920 × 2160 pixels, 1280 × 1440 pixels,(960 × 1080 pixels), 720 × 960 pixels or 720 × 1152 pixels configuration), and remove resolution ratio/color Attribute other than depth is defined as mode value.Thus in the case where only change pattern is without changing resolution ratio, it can be not Change configuration in the case of so that display screen is entered black state.In addition, it is similar with conventional player, it can be configured by calling Preference sets API to execute the change of configuration.
Figure 26 is the frame of the functional configuration example for the BD players being shown as in Fig. 3 of such 3D compatible layers Figure.
In 3D compatible layers in fig. 26, the configuration of the equipment plane is defined for the entirety of an equipment plane, In the equipment plane be such a storage region:Wherein be arranged side by side the regions L(It is storage left eye image for one The storage region of a image)With Zone R domain(It is the storage region for an image for storing right eye image)It is used in this way The storage region of two images.
In addition, non-cubic graphic model, solid figure pattern, offset graphic model, the non-cubic graphic model peace of pressure This five kinds of patterns of smoothization solid figure pattern are defined as graphic model.In addition, non-cubic video mode, double non-cubic video screen modules Formula, three-dimensional video-frequency pattern force non-cubic video mode and planarization three-dimensional video-frequency pattern this five kinds of patterns to be defined as video Pattern.In addition, non-cubic background mode, double non-cubic background modes, stereo background pattern, the non-cubic background mode peace of pressure This five kinds of patterns of smoothization stereo background pattern are defined as background mode.
In addition, the configuration of equipment plane is in addition to including(1)Picture frame(Resolution ratio)Further include outside with color depth(2)Video Pattern,(3)Graphic model and(4)Background mode, and(2)Video mode,(3)Graphic model and(4)Background mode is set It is fixed(Change)API can be set by configuration mode to execute.
In 3D compatible layers in fig. 26, in the case where changing video mode, graphic model or background mode, BD-J application call configuration modes set API, and ask the change to video mode, graphic model or background mode(If It is fixed).
Configuration mode sets API according to the request applied from BD-J, and engine is presented in directly or indirectly control (Presentation Engine), Video Decoder(video decoder)And video-stream processor(Display processor)Needed for one, to change(Setting)Video mode, graphic model or background mode.
On the other hand, changing picture frame(Resolution ratio)In the case of color depth, BD-J application call resolution ratio is set API is determined to ask to change(Setting)Resolution ratio etc..
Resolution setting API is controlled, directly or indirectly and engine, Video Decoder is presented according to the request applied from BD-J With one needed for video-stream processor, to change(Setting)Picture frame(Resolution ratio)And color depth.
Note that in fig. 26, engine is presented(Presentation Engine)To weight unshowned, for controlling BD The playback control engine put(Playback Control Engine)There is provided audio, the decoding function of video and HDMV figures and Function is presented(Presentation functions).
In addition, in fig. 26, video encoder(Video decoder)Execute the decoding of image.In addition, video-stream processor (Display processor)It is for by graphics plane, video(Video+PG)Each plane phase in plane and background plane It is superimposed and is then output to the image obtained using the superposition the hardware for the display being connected with BD players.
As described above, the configuration of equipment plane is for the whole of the equipment plane as the storage region for two images What body defined, and graphic model etc. is included in the configuration of equipment plane, with resolution ratio(Picture frame)And color depth Phase separation.Then, 3D compatible layers set graphic model etc. according to the calling of API is set to configuration mode.Thus can To change graphic model etc. in the case where not changing resolution ratio.
The switching of PG/ text subtitles configuration
Video+PG/TextST(Text subtitle, text subtitle)It is to be applied generally from BD-J(Without distinction) Processing.In addition, BD-J applications cannot individually control PG planes 12, but position or the scaling of video can be controlled(Size).Note Meaning, in current BD standards, from control of the BD-J application executions to the position of video or scaling, PG/TextST It to be aligned with video.
To in the case where executing the zoom control to video, utilize the zoom ratio for scaling video(Amplification ratio Rate or reduction ratio)To scale PG planar offset values.
On the other hand, for PG(Including textST), it would be desirable to allow the setting of 3D compatible layers is served as playing to be used as The pattern of the PG images of the non-cubic image of 2D images(1 plane(Conventional replay)), for playing as serving as the vertical of 3D rendering The pattern of the PG images of body image(2 planes), and for utilizing the left eye image and the right side generated from 2D images and deviant Ophthalmically acceptable image(With parallax)Come play 3D rendering PG pattern(1 plane+offset), it is used as the playback mould for playing PG Formula.
Therefore, in 3D compatible layers, PG plane controls are executed indirectly by selecting PG streams(1 plane(Tradition weight It puts))And the configuration switching between 1 plane+offset and 2 planes.
Therefore, for HDMV PG, non-cubic PG streams(The PG of PG images as the non-cubic image for serving as 2D images Stream), solid PG stream(The PG of PG images as the stereo-picture for serving as 3D rendering flows)And offset is flowed with PG(As for Generate the PG streams of the PG images of the non-cubic image of stereo-picture)(E.g., including as the PG images of non-cubic image and offset The stream of value)It is defined as meeting the PG streams of the PG images of BD standards in conjunction with the deviant for assigning parallax to non-cubic image.
In addition, for HDMV PG, non-cubic 1 stream(Conventional contents)Pattern, L/R2 stream mode and 1 stream+planar offset Pattern is defined for playing the PG replay modes of PG images.
Now, in the case where PG replay modes are non-cubic 1 stream mode, schemed to play 2D PG using non-cubic PG streams Picture.
In the case where PG replay modes are L/R2 stream mode, by using three-dimensional PG stream broadcastings left eye image and right eye With image, to play 3D PG images.
In the case where PG replay modes are 1 stream+planar offset patterns, by being based on deviant using offset PG stream lifes At left eye image and right eye image and left eye image and right eye image are played, to play 3D PG images.
In addition, for HDMV TextST, non-cubic TextST streams(As the non-cubic image for serving as 2D images The TextST of TextST images flows), three-dimensional TextST streams(TextST images as the stereo-picture for serving as 3D rendering TextST flows)And offset is flowed with TextST(TextST images as the non-cubic image for generating stereo-picture TextST flows)(E.g., including as the TextST images of non-cubic image and the stream of deviant)It is assigned in conjunction with to non-cubic image The deviant for giving parallax is defined as meeting the TextST streams of the TextST images of BD standards.
In addition, for HDMV TextST, non-cubic 1 stream(Conventional contents)Pattern, L/R2 stream mode and 1 stream+plane are inclined Mode shifter is defined for playing the TextST replay modes of TextST images.
Now, it in the case where TextST replay modes are non-cubic 1 stream mode, is played using non-cubic TextST streams 2D TextST images.
In the case where TextST replay modes are L/R2 stream mode, 3D is played by using three-dimensional TextST streams TextST images, to play left eye image and right eye image.
In the case where TextST replay modes are 1 stream+planar offset patterns, used using offset by being based on deviant TextST streams generate left eye image and right eye image and play the left eye image and right eye image, to play 3D TextST images.
It, can be by switching for selecting the API of stream in 3D compatible layers(Setting)The configuration of PG/TextST.
Figure 27 shows the PG replay modes and TextST replay modes that can be used for selecting each video mode.
For HDMV PG, even if in video mode(Configuration)It is non-three-dimensional video-frequency pattern(It is non-cubic), planarization stereopsis Frequency pattern(Planarization is three-dimensional), double non-cubic video modes(It is double non-cubic), force non-cubic video mode(It forces non-cubic) With three-dimensional video-frequency pattern(It is three-dimensional)Any one of in the case of, also may be selected 1 stream+planar offset pattern(Non-cubic+partially It moves)(Offset is flowed with PG).
To even if being non-three-dimensional video-frequency pattern, planarization three-dimensional video-frequency pattern, double non-cubic video screen modules in video mode In the case of any one of formula, the non-cubic video mode of pressure and three-dimensional video-frequency pattern, offset can also be selected to be flowed with PG.
In addition, for HDMV PG, even if being planarization three-dimensional video-frequency pattern in video mode(Planarization is three-dimensional), it is double non- Three-dimensional video-frequency pattern(It is double non-cubic), force non-cubic video mode(It forces non-cubic)With three-dimensional video-frequency pattern(It is three-dimensional)In In the case of any type, L/R2 stream mode can also be selected(It is three-dimensional)(Three-dimensional PG streams).
To even if being planarization three-dimensional video-frequency pattern, double non-cubic video modes, forcing non-cubic regard in video mode In the case of any one of frequency pattern and three-dimensional video-frequency pattern, three-dimensional PG can also be selected to flow.
However, being non-three-dimensional video-frequency pattern in video mode(It is non-cubic), planarization three-dimensional video-frequency pattern(Planarization is vertical Body), force non-cubic video mode(It forces non-cubic)Or double non-cubic video modes(It is double non-cubic)In the case of, work as selection Offset is flowed with PG(Non-cubic+offset)When, ignoring deviant(By the way that deviant is set as 0)In the case of play offset use The non-cubic image of PG streams.
In addition, being non-three-dimensional video-frequency pattern in video mode(It is non-cubic)Or force non-cubic video mode(It forces non-vertical Body)In the case of, when selection solid PG streams(It is three-dimensional)When, it only plays to constitute and flows corresponding stereo-picture with these solids PG One of left eye image and right eye image, such as only play left eye image(L PG streams).
In addition, in the case where video mode is planarization three-dimensional video-frequency pattern or double non-cubic video modes, work as selection When three-dimensional PG streams, if there is the offset that stream number matches with the stream number that distribute to selected solid PG streams is flowed with PG (It is recorded in BD), then replace selected solid PG to flow, flowed with PG with offset of these solids PG streams with identical stream number Non-cubic image in the case where ignoring deviant be played.
On the other hand, for HDMV TextST, even if in video mode(Configuration)It is non-three-dimensional video-frequency pattern(It is non-vertical Body), planarization three-dimensional video-frequency pattern(Planarization is three-dimensional), force non-cubic video mode(It forces non-cubic)It non-cubic is regarded with double Frequency pattern(It is double non-cubic)Any one of in the case of, also may be selected 1 stream+planar offset pattern(Non-cubic+offset)(Partially Divert from one use to another text subtitle stream).
To be non-three-dimensional video-frequency pattern, planarization three-dimensional video-frequency pattern, force non-cubic video mode in video mode In the case of one kind in double non-cubic video modes, offset can be selected to be flowed with TextST(Offset text subtitle stream).
In addition, for HDMV TextST, even if being planarization three-dimensional video-frequency pattern in video mode(Planarization is three-dimensional)、 Double non-cubic video modes(It is double non-cubic), force non-cubic video mode(It forces non-cubic)With three-dimensional video-frequency pattern(It is three-dimensional) Any one of in the case of, L/R2 stream mode can also be selected(It is three-dimensional)(Three-dimensional text subtitle stream).
To be planarization three-dimensional video-frequency pattern, double non-cubic video modes, force non-cubic video screen module in video mode In the case of any one of formula and three-dimensional video-frequency pattern, three-dimensional TextST can be selected to flow(Three-dimensional text subtitle stream).
However, being non-three-dimensional video-frequency pattern in video mode(It is non-cubic), planarization three-dimensional video-frequency pattern(Planarization is vertical Body), force non-cubic video mode(It forces non-cubic)Or double non-cubic video modes(It is double non-cubic)In the case of, work as selection Offset is flowed with TextST(Non-cubic+offset)When, the non-cubic of offset TextST streams is played in the case where ignoring deviant Image.
In addition, being non-three-dimensional video-frequency pattern in video mode(It is non-cubic)Or force non-cubic video mode(It forces non-vertical Body)In the case of, when selection solid TextST streams(It is three-dimensional)When, it only plays and constitutes stand corresponding with these solid TextST streams One of left eye image and right eye image of body image, such as only play left eye image(L TextST streams).
In addition, in the case where video mode is planarization three-dimensional video-frequency pattern or double non-cubic video modes, work as selection When three-dimensional TextST stream, if there is stream number and to distribute to the stream number that selected solid TextST flows match it is inclined TextST streams are diverted from one use to another, then selected TextST is replaced to flow, are used with offset of these solids TextST streams with identical stream number The non-cubic image of TextST streams is played in the case where ignoring deviant.
Figure 28 is the Fig. 3 for the 3D compatible layers for being shown as the playback for executing PG or TextST images as described above In BD players functional configuration example block diagram.
In Figure 28,3D compatible layers are applied by BD-J, PG/TextST stream selections API, video control API, PG and select Engine(Playback control function), TextST select engine(Playback control function), video control engine(Playback control function), again Put control engine(Playback Control Engine), present engine(Presentation Engine)Etc. constitute.
It will be described with reference to Figure 29 the processing of the 3D compatible layers in Figure 28 by taking processing related with PG as an example.
BD-J application calls PG/TextST streams selection API is flowed with request selecting PG.PG/TextST stream selection API selection from The PG of BD-J application requests flows.
That is, as described in figure 27, can be selected from BD-J application requests for current video pattern In the case that PG flows, PG/TextST stream selection API control PG selection engines select these PG to flow.
PG selects engine to flow the control for selecting API according to PG/TextST, from the disk 100 being recorded in as BD(Fig. 3)In Selection PG streams in PG streams, and these PG streams are supplied to unshowned solid PG decoders or non-cubic PG decoders in Figure 28.
Now, in the case where the PG streams of PG selection engine selections are three-dimensional PG streams, these solid PG streams are provided to vertical Body PG decoders.
In addition, in the case where the PG streams of PG selection engine selections are that offset is flowed with PG, these offsets are provided with PG streams To non-cubic PG decoders.
Three-dimensional PG decoders are decoded as constituting the left eye image of stereo-picture the PG streams come are provided from PG selection engines With right eye image, and left eye image and right eye are depicted in L-PG the planes 12L and R-PG of PG planes 12 respectively with image On plane 12R.
On the other hand, non-cubic PG decoders are decoded as non-cubic figure the offset come is provided from PG selection engines with PG streams Picture, and be depicted on logic plane 10.
PG generates API and uses deviant(E.g., including offset flowed with PG in deviant, 3D compatible layers it is interior The deviant stored in portion's storage region or PSR#21)To generate left eye from the non-cubic image being depicted on logic plane 10 With image and right eye image.Then, PG generates API and left eye image and right eye is depicted in PG planes 12 with image respectively L-PG plane 12L and R-PG planes 12R on.
Note that being compatible in BD players in 3D, as described in figure 27, draw depending on current video pattern and PG selections Hold up the PG streams of selection(PG replay modes)Between combination, the left side that composition flows corresponding stereo-picture with solid PG can be played One of ophthalmically acceptable image and right eye image, such as left eye image is only played, or can be in the case where ignoring deviant only It plays and deviates with the corresponding non-cubic image of PG streams.
As described above, in 3D compatible layers, non-cubic PG streams(PG as the non-cubic image for serving as 2D images schemes The PG of picture flows), solid PG stream(The PG of PG images as the stereo-picture for serving as 3D rendering flows)And offset is flowed with PG(Make For the PG streams of the PG images of the non-cubic image for generating stereo-picture)It is combined as assigning the number of parallax to non-cubic image According to deviant be defined as meeting the PG streams of the PG images of BD standards.Then, PG/TextST streams selection API is according to from BD- The request of J applications selects non-cubic PG streams, solid PG streams or offset to be flowed with PG.
It is thus possible to from the playback of BD-J application indirect control PG images(The configuration of PG).
Switch the playback of 3D rendering and the playback of 2D images
Figure 30 is for describing to switch between the playback and the playback of 2D images of 3D rendering at 3D compatible layers Diagram.
In fig. 30, first, the operation mode of 3D compatible layers is the 3D replay modes for playing 3D rendering.
Then, graphic model is solid figure pattern(Three-dimensional gfx(Figure)), video mode is three-dimensional video-frequency pattern(It is vertical Volumetric video), and background mode is non-stereo background pattern(Non-cubic background).
Then, graphic model is changed to offset graphic model(Planar offset gfx), and video mode be changed to it is double Non-cubic video mode(Double non-cubic videos).
In addition, then, in fig. 30, operation mode is changed from 3D replay modes to 2D replay modes(Conventional replay mould Formula), for playing 2D images in a manner of identical with conventional player.
According to the change of operation mode, graphic model is by from offset graphic model(Planar offset gfx)Change to non-cubic Graphic model(Non-cubic gfx).In addition, video mode is by from double non-cubic video modes(Double non-cubic videos)Change to non-vertical Volumetric video pattern(Non-cubic video).Note that background mode is still non-cubic background mode(Non-cubic background).
Then, in fig. 30, operation mode is changed from 2D replay modes to 3D replay modes again.
According to the change of operation mode, graphic model is by from non-cubic graphic model(Non-cubic gfx)Change to stereogram Shape pattern(Three-dimensional gfx).In addition, video mode is by from non-cubic video mode(Non-cubic video)Change to planarization stereopsis Frequency pattern(Planarize three-dimensional video-frequency).Note that background mode is still non-cubic background mode(Non-cubic background).
In fig. 30, then, background mode is by from non-cubic background mode(Non-cubic background)Change to stereo background mould Formula(Stereo background).
In fig. 30, for example, in the case where operation mode is changed from 3D replay modes to 2D replay modes, when adjoint Resolution ratio(Picture frame)Change when, display screen may blank screen.
Pixel coordinate system for video
Such as " javax.tv.media.AWTVideoSizeControl ", " org.dvb.media.BackgroundVid The JMF of eoPRsentationControl " etc.(Java(Registered trademark)Media framework)Control can be used for answering from BD-J With to video position and size control.
Note that the author of BD-J applications is not to utilize plane(Video plane 13)On coordinate but using displaing coordinate come Set position and the size of video.
In addition, 3D compatible layers must be to left eye image(L video sources)With right eye image(R video sources)In it is each A position and size executes correction.
For example, for the video plane 13 of 1920 × 2160 pixels, displaing coordinate system is that size is 1920 × 1080 pictures The coordinate system of element is its half in vertical direction.In the case, author must such as set video so below Position and size.
RctangL src=new RctangL(0,0,1920,1080);
RctangL dest=new RctangL(100,100,960,540);
AWTVideoSizeControl videoSizeControl=(AWTVideoSizeControl) player.getControl("javax.tv.media.AWTVideoSizeControl");
videoSizeControl.setSize(new AWTVideoSize(src,dest))。
Figure 31 is the position for describing author to the position of video and the setting of size and 3D compatible layers to video Set the diagram with the correction of size.
Author sets position and the size of the left eye image of video.In Figure 31, the position of the left eye image of video It is set to the displaing coordinate system that size is 1920 × 1080 pixels with size.
3D compatible layers the setting of the position of the left eye image of the video for displaing coordinate system and size not Add be set to video plane 13 L video planes 13L with changing.
In addition, 3D compatible layers are without change applied the position of the video of L video planes 13L and the setting of size To R video planes 13R.
To be regarded with this in author in the case where the position of video and size are set to L video plane 13L The position of frequency and the identical position of size and size are also set to R video planes 13R.
Now, for video, depth information is not provided from outside.To, the arrangement for providing offset not only wastes, and And the output for being also possible to lead to video production person to be not expected to.
That is, although video production person should make video image to show expected 3D rendering.To in 3D In compatible layer, for example, according to the information provided from outside(Such as it is stored in PSR#21(Fig. 7)In deviant etc.) To execute the image such as to being depicted in the video on video plane 13(Left eye image and right eye image)Position carry out When the processing of displacement etc, image that the person that may show video production is not expected to.
Therefore, in 3D compatible layers, L/R video planes are defined in the configuration, but provide limitation, to allow The author of BD-J applications only handles L video planes.That is, 3D compatible layers must also be the L carried out by BD-J applications The API Calls of video scaling/L video locations are applied to R video scalings/R video locations.
Note that according to the size of set video using the size come scaling video in the case of, such as " PG/ texts Described in the switching of subtitle configuration ", the zoom ratio for scaling video is utilized(Magnification ratio or reduction ratio)To scale PG Planar offset value, but also graphics plane deviant is scaled using the zoom ratio of video in an identical manner.
Figure 32 is that the position being shown as executing video as described above is set(Correction)It is set with size(Scaling)'s The block diagram of the functional configuration example of BD players in Fig. 3 of 3D compatible layers.
3D compatible layers in Figure 32 include being stored in L video planes 13L for setting(The regions L)In image The L API of size and location, and to be stored in R video planes 13R for setting(Zone R domain)In image size and position The R API set.Then, L is identical with the size and location of image that another API is set big with API and R one of API settings Small and position.
That is, in 3D compatible layers in Figure 32, Video Decoder(Video decoder)To video solution Code, and it is supplied to L with API and R API with image the left eye of the video obtained as its result image and right eye.
L is with API by L video scalings(L(It is left)Video scaling)API and L video locations(L(It is left)Positioning)API is constituted, and According to the calling of the setting request from the position and size to video that BD-J is applied, the left eye from Video Decoder is set Position with image and size.
That is, L video scalings API executes scaling, to control the big of the left eye image from Video Decoder The small size with request of the acquisition basis from BD-J applications, and provide it to L video locations API.
The position of left eye image of the L video locations API controls from L video scalings API is to obtain according to from BD-J The position of the request of application, and using the left eye image description obtained as its result on L video planes 13L(From L On the position for the request that basis of the left eye image description of video scaling API on L video planes 13L is applied from BD-J).
In addition, L video scalings API Calls hereafter described in R video scaling API, with execute with from BD-J application Ask identical request.In addition, L video locations API Calls hereafter described in R video location API, with execute with come from BD-J The identical request of request of application.
In addition, according to the calling of the setting request to video size, images of the L video scalings API scaling video(Left eye Use image)When zoom ratio(Magnification ratio or reduction ratio)S is supplied to PG to generate API and graphic hotsopt API.
R is with API by R video scalings(R(It is right)Video scaling)API and R video locations(R(It is right)Positioning)API is constituted, and The position of video and the setting of size are asked with API according to from L, right eye image of the setting from Video Decoder Position and size.
That is, the size of right eye image of the R video scalings API controls from Video Decoder is to obtain according to next From the size of the request of L video scalings API, and provide it to R video locations API.
The position of right eye image of the R video locations API controls from R video scalings API is to obtain according to from L videos The position of the request of position location API, and using the right eye image description obtained as its result on R video planes 13R.
As described above, to be stored in L video planes 13L for setting(The regions L)In image size and location L It to be stored in R video planes 13R with API and for setting(Zone R domain)In image size and location R in API, wherein An API, for example, R API, setting is set with API according to the request applied from BD-J with the L as another API The identical size and location of size and location of image.
To which for wherein storing the video plane 13 for the video image for meeting BD standards, author is allowed to only handle As L video planes 13L(The regions L)With R video planes 13R(Zone R domain)One of L video plane 13L, so as to prevent from showing The video image that the person that shows video production is not expected to.
In 3D compatible layers, the processing described in Figure 29 is executed also for PG.
However, in PG generates API, PG planar offset values are scaled using the zoom ratio S from L video scalings API (For example, the offset stored in the deviant for including, the internal storage areas of 3D compatible layers or PSR#21 is flowed in offset with PG Value)(The PG planar offset values are multiplied by zoom ratio S).
Then, non-on logic plane 10 from being depicted in using the PG planar offset values after scaling in PG generates API Stereo-picture generates left eye image and right eye image.
In addition, in 3D compatible layers, configuration mode changes API from the disk 100 being recorded in as BD(Fig. 3)In figure Selection is according to the image in the graphic model of the request from BD-J applications in shape image, and is depicted in graphics plane 11 On.
That is, in the case where video mode is such as solid figure pattern, a left side for the figure as stereo-picture Ophthalmically acceptable image and right eye are depicted in image respectively on the L graphics plane 11L and R graphics planes 11R of graphics plane 11.
In addition, in the case where video mode is for example to deviate graphic model, the image of the figure as non-cubic image It is depicted on logic plane 10, moreover, graphic hotsopt API scales figure using the zoom ratio S from L video scalings API Shape planar offset value(For example, the internal storage areas or the deviant in PSR#21 that are stored in 3D compatible layers).
Then, graphic hotsopt API using the graphics plane deviant after scaling come non-on logic plane 10 from being depicted in Stereo-picture generates left eye image and right eye image, and these images are depicted in L graphics planes 11L and R figure respectively On shape plane 11R.
Pixel coordinate system for figure
Solid figure is configured(Configuration for showing figure 3D rendering)Effective pixel coordinate system be it is following it One.
(0,0)-(1920,2160)
(0,0)-(1280,1440)
(0,0)-(720,960)
(0,0)-(720,1152)
(0,0)-(960,1080)
Top half(top-half)It is assigned to L graphic views, and lower half portion(bottom-half)It is assigned to R graphic views.
Figure 33 shows the graphics plane 11 of 1920 × 2160 pixels.
It is depicted in the storage region as the upper side in graphics plane 11(Top half)L graphics planes 11L on Image is the left eye image observed by left eye(L(It is left)Graphic view), and be depicted in as under graphics plane 11 The storage region of square side(Lower half portion)R graphics planes 11R on image be the right eye image observed by right eye(R (It is right)Graphic view).
In fig. 33, a container is depicted on graphics plane 11(Root container)With two of the child as the container Component(Component).
The coordinate of component is indicated using the container of the father to serve as the component as the relative coordinate of benchmark.
Note that in 3D compatible layers, it is not necessary to the buffer area to shield be arranged to the edge of graphics plane 11.
In addition, 3D compatible layers must realize the arrangement for inhibiting the mismatch between the L kens and the R kens.
Now, as the BD players of conventional player not be used for detect BD-J application carry out description completion and The mechanism of monitor is sent it to after the completion.In the case where L and R videos export, can occur between L figures and R figures Output mistermination.
Therefore, in 3D compatible layers, certain a kind of API Calls is defined as showing the complete of the description of BD-J application progress At signal.On the contrary, if corresponding description completion notice API is never called in BD-J applications, export nothing on the screen. Author must resort to use this technology.
That is, in image(Left eye image)After being depicted on L graphics planes 11L, to R graphics planes 11R Image description complete before, be used as left eye image and the right side on the display screen the description content of graphics plane 11 is shown When ophthalmically acceptable image, left eye image and right eye are the mismatch images for being not to be seen as 3D rendering with image(In the case, right The description of ophthalmically acceptable image is defective), to which which results in the senses of the discomfort for the user for looking at the image on display screen.
To which user has the sense of discomfort, 3D compatible layers to have for inhibiting left eye image and right eye in order to prevent With the function of the mismatch between image, that is, left eye image and right eye in mismatch Conditions is prevented to be displayed on image aobvious Function on display screen curtain so as to be watched as 3D rendering.
Specifically, after completing to the description of the left eye image and both right eye images of graphics plane 11,3D Compatible layer exports the left eye image and right eye image to show them.
To, 3D compatible layers it is to be appreciated that left eye image and both right eye images to graphics plane 11 Description has been completed.
Directly describe model
In directly describing, 3D compatible layers, which do not have, to be sent out for distinguishing from BD-J applications for generating writing pattern image Drawing command the whether completed technology of operation.
It is arrived until #N, and by image description specifically, having had been sent from drawing command #1, #2 etc. in BD-J applications In the case that the operation of graphics plane 11 is executed according to drawing command #1 to #N, hereafter 3D compatible layers may not recognize that Whether drawing command can also be sent out, i.e., whether the drawing command carried out by BD-J applications is sent out has completed.
Therefore, in the case where executing the image description to graphics plane 11 by drawing command, the author of BD-J applications has Obligation recognize the completeness to the description for ensureing figure so as to the image description of graphics plane 11 complete before not The calling for returning process to the descriptions completeness guarantee API of BD-J applications, using as the signal provided to 3D compatible layers.
Alternatively, in the case where executing the image description to graphics plane 11 by drawing command, the author of BD-J applications has Obligation is recognized to the calling for notifying description completion notice API completed to the image description of graphics plane 11, to make For the signal provided to 3D compatible layers.
Alternatively, in the case where executing the image description to graphics plane 11 by drawing command, the author of BD-J applications has Obligation is recognized to the calling for notifying description that the image description to graphics plane 11 starts to start to notify API, Yi Jisui Afterwards to the calling for notifying description completion notice API completed to the image description of graphics plane 11, using as simultaneous to 3D Hold the signal that player provides.
In the case, 3D compatible layers can be applied by BD-J ensures describing completeness the calling of API, to describing The calling of completion notice API or to description start notify API calling and then to describe completion notice API calling, Recognize that the image description to graphics plane 11 has been completed, i.e., sending out for drawing command has been completed.Then, it is tied as it Fruit, left eye image and right eye image can be shown in matching status(So as to be counted as 3D rendering).
Here, can be defined as describing completeness guarantee API as the special API of parameter using drawing command sequence.
Now, for example, java.awt.Toolkit#sync () method is used as describing completion notice API.In this situation Under, in 3D compatible layers, as long as not executing the calling to java.awt.Toolkit#sync () method, it is depicted in figure Image in plane 11 is not just exported, to which the image being depicted on graphics plane 11 is not displayed on the display screen.
In addition, for example, Java(Registered trademark)Preordering method or special API can be defined as describe start notify API.
Note that during a frame(During 1 video frame)To the calling quilt of java.awt.Toolkit#sync () method When executing multiple, graphic frame may include the frame lost.To, do not allow continuous several times execute or therebetween almost without The calling to java.awt.Toolkit#sync () method is continuously performed in the case of description.
Redraw model
In AWT(Abstract Windowing toolkit are abstracted adding window kit)In drawing model, composition figure is served as Repaint () method call supply of the root container of a part for shape image constitutes each component of a part for graph image Update () method.
Then, it in AWT drawing models, can completely be controlled at 3D compatible layers(Control completely)Graph image Description process, to which 3D compatible layers will recognize that the image description to graphics plane 11 has been completed.
It is thus possible to execute the realization of 3D compatible layers so that even if not executing to above-mentioned description completion notice API Calling in the case of, also show left eye image and right eye image in matching status.
Figure 34 is to be shown as ensureing API or call to describe completion notice for describing completeness by force call API simultaneously then calls description to start to notify API, to recognize the figure for sending out the 3D compatible layers completed of drawing command The block diagram of the functional configuration example of BD players in 3.
Now, it lets as assume that in the completed BD-J application executions of image description to graphics plane 11 to retouching Paint the calling of completion notice API.
The 3D compatible layers include serve as graphics plane 11 buffer 201L and 201R and buffer 202L and 202R。
Note that in Figure 34, buffer 201L and 202L are equivalent to L graphics plane 11L, and buffer 201R and 202R It is equivalent to R graphics planes 11R.
In addition, this group of buffer 201L and 201R and buffer 202L and 202R this group act alternately as posterior bumper (Hide buffer)And anterior bumper.
Here, posterior bumper is the buffer of the wherein description of BD-J application executions graph image, and anterior bumper is to scheme Storage will be shown in display screen while execution in posterior bumper as being depicted in(Logical screen 21)On image buffer.
A in Figure 34 shows that this group is posterior bumper and buffer 202L and 202R in buffer 201L and 201R This group is the 3D compatible layers in the state of anterior bumper.
In A in Figure 34, BD-J is applied to graph image(Left eye image and right eye image)Description to serving as The buffer 201L and 201R of posterior bumper are executed, and the figure being stored in the buffer 202L and 202R for serving as anterior bumper Picture(Left eye image and right eye image)It is output to display screen as output.
After the completion of the graph image of buffer 201L and 201R to serving as posterior bumper are described, BD-J application calls are retouched Paint completion notice API.
After executing the calling to describing completion notice API, as the replacement to anterior bumper, 3D compatible layers start The image being stored in posterior bumper is output to display screen.
It is just being executed to the 3D compatibilities after the calling of description completion notice API that is, the B in Figure 34 is shown Player.
After executing the calling to describing completion notice API, 3D compatible layers start to serve as posterior bumper being stored in Buffer 201L and 201R in image be output to display screen, as the buffer 202L for serving as anterior bumper to being stored in With the replacement of the image in 202R.
In addition, 3D compatible layers be stored in serve as posterior bumper buffer 201L and 201R in image copy arrive Serve as the buffer 202L and 202R of anterior bumper.
Then, 3D compatible layers switching posterior bumper and anterior bumper.
Specifically, the buffer 201L and 201R that serve as posterior bumper are set as anterior bumper by 3D compatible layers, And the buffer 202L and 202R that serve as anterior bumper are set as posterior bumper.
That is, the C in Figure 34 shows that this group is anterior bumper and buffer in buffer 201L and 201R This group of 202L and 202R is the 3D compatible layers in the state of posterior bumper.
The graph image that BD-J applications start buffer 202L and 202R to serving as posterior bumper is described, and then, repeats Same processing.
Figure 35 is for describing to broadcast in the 3D compatibilities that BD-J application calls are described in the case that completeness ensures API in Figure 34 Put the flow chart of the graphics process of device progress.
In step s 11,3D compatible layers determine whether to ensure API to describing completeness from BD-J application executions Calling, and judgement have not carried out to describe completeness ensure API calling in the case of, 3D compatible layers return to Step S11.
In addition, if judgement executed ensures that describing completeness, the calling of API, 3D compatibilities play in step s 11 Device proceeds to step S12, and the drawing command sequence for describing the parameter that completeness ensures API is served as in sequence operation, and using as The result of the operation and the graph image that obtains are depicted on posterior bumper, and also the graphic diagram being stored in anterior bumper As being output to display screen(Output is for display).
Then, after being completed to the description of posterior bumper, in step s 13,3D compatible layers are slow after being stored in The graph image rushed in device is output to display screen, as the replacement to anterior bumper(Output is for display).
Then, in step S14, the graph image being stored in posterior bumper is copied to preceding buffering by 3D compatible layers Device.
Then, in step S15,3D compatible layers switch posterior bumper and anterior bumper, return to step S11, so After repeat similarly to handle.
As described above, in 3D compatible layers, for graphics plane 11(It is posterior bumper)It is held from BD-J applications It has gone in the case of the calling for ensureing the description completeness of the completeness of the description for ensureing graph image API, has been depicted in Image on graphics plane 11 is output for showing.
To in 3D compatible layers, after BD-J applications wait for the description of graph image to complete, be depicted in figure Image in plane 11 can be shown, so as to prevent the left eye image and right eye image being in mismatch Conditions from being shown Show on the display screen.
Figure 36 is to be compatible with broadcasting for describing the 3D in the case where BD-J application calls describe completion notice API in Figure 34 The flow chart for the graphics process that device carries out.
3D compatible layers wait for from BD-J applications and send out drawing command, and run the drawing command in the step s 21.
Then, in step S22,3D compatible layers are using the graph image obtained as the result of operation drawing command It is depicted in posterior bumper, and the graph image being stored in anterior bumper is also output to display screen(Output is for aobvious Show).
Then, in step S23,3D compatible layers determine whether from BD-J application executions to describing completion notice The calling of API.
If judgement has not carried out the calling to describing completion notice API in step S23,3D compatible layers wait for Drawing command is sent out from BD-J applications, and returns to step S21, then repeats similarly to handle.
In addition, if judging to have executed the calling to describing completion notice API in step S23,3D compatibilities play Device proceeds to step S24, and the graph image being stored in posterior bumper is output to display screen, as to anterior bumper Replacement(Output is for display).
Then, in step s 25, the graph image being stored in posterior bumper is copied to preceding buffering by 3D compatible layers Device.
Then, in step S26,3D compatible layers switch posterior bumper and anterior bumper, wait for and being sent out from BD-J applications Go out drawing command, and return to step S21, then repeats similarly to handle.
As described above, in 3D compatible layers, from BD-J application executions to being used to notify to graphics plane 11(It fills Work as posterior bumper)Graph image describe the calling for describing completion notice API completed in the case of, it is flat to be depicted in figure Image on face 11 is exported for display.
To which after performing BD-J and applying the notice completed to the description of graph image, it is flat to be depicted in figure Image on face 11 can be shown, it is thus possible to prevent left eye image and right eye image in mismatch Conditions from being shown Show on the display screen.
Figure 37 is for describing to start to notify the calling of API and to describing completion notice to description in BD-J application executions The flow chart for the graphics process that 3D compatible layers in the case of the subsequent calling of API in Figure 34 carry out.
In step S31,3D compatible layers determine whether since BD-J application executions to notifying API's describing It calls, and in the case where judgement has not carried out to describing the calling for starting to notify API, returns to step S31.
In addition, if judging that executed starts the reading of API, 3D compatible layers etc. to describing in step S31 It waits for that BD-J applications send out drawing command, proceeds to step S32, and run the drawing command.
Then, in step S33,3D compatible layers determine whether from BD-J application executions to describing completion notice The calling of API.
If judgement has not carried out the calling to describing completion notice API in step S33,3D compatible layers wait for Drawing command is sent out from BD-J applications, and returns to step S32, then repeats similarly to handle.
In addition, if judging executed to the calling of description completion notice API, 3D compatible layers in step S33 Step S34 is proceeded to, the graph image that the operation result as drawing command is obtained is depicted on posterior bumper, and also The graph image being stored in anterior bumper is output to display screen(Output is for display).
Then, in step s 35, the graph image being stored in posterior bumper is output to display screen by 3D compatible layers Curtain, as the replacement to anterior bumper(Output is for display).
Then, in step S36, the graph image being stored in posterior bumper is copied to preceding buffering by 3D compatible layers Device.
Then, in step S37,3D compatible layers switch posterior bumper and anterior bumper, return to step S31, so After repeat similarly to handle.
As described above, in 3D compatible layers, since BD-J application executions to being used for graphics plane 11(It fills Work as posterior bumper)Graph image description description start notify API calling and to be used for notify to graphics plane 11(It fills Work as posterior bumper)Graph image description it is completed describe completion notice API it is subsequent call in the case of, be depicted in figure Image in shape plane 11 is exported for display.
To in the case where performing BD-J using the notice completed to the description of graph image, be depicted in figure Image in shape plane 11 can be shown, it is thus possible to prevent the left eye image in mismatch Conditions and right eye image It is shown on the display screen.
Pixel coordinate system for background
Stereo background is configured(Configuration for display background 3D rendering)Effective pixel coordinate system be it is following it One.
(0,0)-(1920,2160)
(0,0)-(1280,1440)
(0,0)-(720,960)
(0,0)-(720,1152)
Top half(top-half)It is assigned to the L background kens, and lower half portion(bottom-half)It is assigned to The R background kens.
Note that the format of background image(Content format)It is monochromatic(Single-color)、JPEG(JFIF)With MPEG2 tiny streams Stream feeding(drip-feed)One of, and in the case where format is the feeding of MPEG2 trickles, background image must be SD images (Only limit SD videos).
In addition, the JPEG of 1920 × 2160 pixels, 1280 × 1440 pixels, 720 × 960 pixels or 720 × 1152 pixels (JFIF)Image can be used as background image.
Focus management
For example, based on window member(widget)GUI(Graphic user interface)Etc. be used as the feelings of graph image Under condition, in conventional player, multiple components that constitute GUI, child as certain single container cannot possess focus simultaneously.
In addition, in conventional player, multiple containers for constituting GUI cannot activity simultaneously(In focus state).
Here, container is the component of graph image(Component), and can have father(Upper layer)And child(Lower layer).No Father and the container of only child is referred to as root container.
Component is a kind of container, and can have father but cannot have child.
In the case where it is 3D rendering to serve as the GUI of graph image, for constituting left eye image and the right side of the 3D rendering Each in ophthalmically acceptable image, corresponding container must be focused, and be needed in an identical manner to the transformation of its focus(Together Etc. ground)It executes.
Specifically, if among left eye image and right eye image, some container of one of these images is constituted It is focused, but corresponds to the container, another image of composition container and be not focused, then viewing can be made to utilize such left side The user for the 3D rendering that ophthalmically acceptable image and right eye image are shown has the sense of discomfort.
To which user has the sense of discomfort in order to prevent, and 3D compatible layers execute focus management, so as in left eye image Container and right eye image container at there is identical focus to change.
Figure 38 shows the example for being depicted in 11 GUI on graphics plane.
GUI in Figure 38 is by constituting each two corresponding component #1, #2 and # of the child of a root container and the root container 3 are constituted.
Note that in Figure 38, component #1, #2 and #3 for being depicted on L graphics planes 11L constitute left eye image, and Component #1, #2 and the #3 being depicted on R graphics planes 11R constitute right eye image.
For example, in the case where the component #i of left eye image is focused, the right eye group as correspondence component of image Part #i must be also focused.
In order to enable window member state transformation/management is symmetrical between L and R, 3D compatible layers are by making two Container or component are focused to meet this point simultaneously.Therefore, the example of container or component needs have one to indicate whether to hold The mark of focus, so as to be managed.Further it is necessary to make the request failure of third focus.That is, holding focal container Or the number of component is limited to 0 or 2.
Two corresponding containers for making left eye image and right eye image(Component)The focus method packet being focused Include the first focus method and the second focus method.
Figure 39 shows the first focus method and the second focus method.
A in Figure 39 shows the first focus method(Across 1 container of L/R graphics planes).
First focus method to serve as the container across L graphics plane 11L and R graphics planes 11R(Root container)Child Container on the L graphics planes 11L of son(Component)With the container on R graphics planes 11R(Component)The two correspond to container simultaneously It is focused.
B in Figure 39 shows the second focus method(2 containers(One is used for L graphics planes, another is used for R figures Plane)).
In the second focus method, root container is depicted in each in L graphics plane 11L and R graphics planes 11R On, and two root containers are all simultaneously activated(It is focused).
Figure 40 is for describing as two corresponding containers for making left eye image and right eye image(Component)Possess The flow chart of the focus management of BD players in Fig. 3 of the 3D compatible layers of focus.
Now, the container for the GUI that composition will be depicted on graphics plane 11 is let as assume that(Component)It is corresponding with expression Container(Component)The focus marks whether being focused.
After focus is requested, in step s 51,3D compatible layers are for setting the variable i that number of vessels counts It is fixed to serving as the 0 of initial value.
Then, in step S52, the focus marks that 3D compatible layers are possessed based on each component judge as figure The component of the child of container c (i) in shape plane 11(Container)Among, if it is in focus state there are two component (It is also referred to as focus below and holds component).
If judgement does not hold group among the component for the child for serving as container c (i) there are two focus in step S52 Part, then 3D compatible layers proceed to step S53, and two corresponding components is made to possess requested focus.In addition, in step In rapid S53, each focus marks setting one of the 3D compatible layers into two components for being caught to focus shows to hold The value of focus, and proceed to step S54.
On the other hand, if there are two focuses among the component for the child for serving as container c (i) for judgement in step S52 Hold component, then 3D compatible layers skip step S53, proceed to step S54, variable i are incremented by 1, and proceed to step S55。
In step S55,3D compatible layers judge the number of vessels N whether variable i is less than on graphics plane 11.If The number of vessels N that variable i is less than on graphics plane 11 is judged in step S55, then 3D compatible layers return to step S22, And repeat same processing.
In addition, if judging that variable i not less than the number of vessels N on graphics plane 11, handles knot in step S55 Beam.
As described above, in the case where two containers are not focused for focus request, 3D compatible layers are storage The L graphics planes 11L of left eye image(The regions L)On container and it is corresponding with the container, storage right eye image R figure Shape plane 11R(Zone R domain)On container change in focus state.
To for example, among the container for constituting 3D rendering window member, scheme in the container and right eye of left eye image Between the container of picture, the transformation of focus can be set in an identical manner.
The processing of mouse event
In the case of solid figure, the two-dimensional coordinate of cursor of mouse on the screen may be different from L and R graphics planes On coordinate.To, BD-J needs to execute coordinate conversion when applying the processing dependent on mouse event in description, but for sitting The deviant for marking conversion is different the realization of each of BD players, to be unknown.
Specifically, Figure 41 is shown sees printing device on display screen(Such as mouse etc.)Cursor 3D rendering Position and graphics plane 11 on cursor position.
Cursor shown by BD players, but in 3D compatible layers, it is desirable to than figure 3D rendering(It will be from disk 100 The 3D rendering of broadcasting)The 3D rendering of display highlighting in closer proximity(So as to by watching).
On the other hand, using 3D rendering display highlighting, the cursor of the left eye image on logical screen 21 In position(x+Δx,y), the position is relative on the display screen it can be seen that position of the 3D rendering of cursor(x,y)It is displaced Certain offset value delta x, and the cursor of the image of the right eye on logical screen 21 is also at position(x-Δx,y), the position Relative on the display screen it can be seen that position of the 3D rendering of cursor(x,y)It is displaced certain offset value delta x.
Here, the position on the depth direction of the 3D rendering of cursor changes according to certain deviation value Δ x.
In 3D compatible layers, if on than figure 3D rendering closer proximity display highlighting 3D rendering, one Indicate the depth direction of figure 3D rendering(The directions z)On the value max-depth of proximal most position be necessary.However, simultaneous in 3D Hold in player, it is difficult to from figure 3D rendering calculated value max-depth.
Thus, for example, value max-depth is recorded in advance in the disk 100 as BD(Fig. 3)In, and 3D compatibilities play Device can set value max-depth(Storage)To PSR(Fig. 7)(For example, PSR#21).
In the case, 3D compatible layers(Or show the display of the 3D rendering exported by 3D compatible layers)It can With with reference to value max-depth in PSR is stored in, obtain the position for being indicated with value max-depth in Billy closer to one The offset value delta x of side display highlighting.Then, the 3D rendering of cursor is displayed at than in figure 3D rendering closer proximity.
Note that the OSD that 3D compatible layers are shown(On Screen Display are shown on screen)Can also by with The identical mode of cursor is displayed on than in figure 3D rendering closer proximity.
In addition, indicating the value of the most deep side position on the depth direction for the 3D rendering to be played from the disk 100 as BD Min-depth is recorded in advance in the disk 100 as BD together with value max-depth(Fig. 3)In, to value max-depth and Value min-depth can be set to PSR(Fig. 7).
As described above, in 3D compatible layers, the depth direction for the 3D rendering being recorded in the disk 100 as BD is indicated On the value max-depth of nearest side position etc. be set to PSR, to which cursor and OSD are displayed at than to be broadcast from BD The 3D rendering put closer to side.
By the way, 3D compatible layers can arbitrarily set the offset value delta x of the 3D rendering for display highlighting.Separately Outside, offset value delta x needs not be constant, such as can change for each frame(Setting).
To be shown when being used when 3D compatible layers send out the event using cursor position as parameter to BD-J applications The position of screen(x,y)When position as cursor, BD-J applications must be to the position of the display screen(x,y)Coordinate is executed to turn It changes, to obtain the cursor position on graphics plane 11(x+Δx,y)(Or(x–Δx,y)).
However, in order to the position for showing screen(x,y)Coordinate conversion is executed, BD-J applications need to identify offset value delta X, but BD-J applications are to be difficult to identify that deviant that 3D compatible layers can arbitrarily be set.
Therefore, the coordinate system of mouse event is restricted to only on L graphics planes.BD players are obligated flat using L figures Coordinate on face is as two-dimensional position information when sending out mouse event.
Specifically, in 3D compatible layers, for example, the 3D rendering of the cursor of the printing device of such as mouse etc by Left eye image and right eye image construction, but the 3D rendering of cursor is in the L graphics planes 11L of graphics plane 11(The regions L) With R graphics planes 11R(Zone R domain)One of such as L graphics planes 11L(The regions L)On position, be used as sending out with cursor position Set the cursor position when event as parameter.
To which BD-J applications can be learnt(Identification)Go out cursor position of the position on L graphics planes 11L as 3D rendering It sets, to which the author of BD-J applications can be using the position on L graphics planes 11L as cursor position, with the cursor position As parameter, to describe to event(Mouse event etc.)Processing.
Describe operation
3D compatible layers must assure that the matching between the L kens and the R kens.Specifically, 3D compatible layers are necessary The left eye image and right eye for ensuring figure are painted into graphics plane 11 with image in matching status(So as to be counted as 3D rendering), and be subsequently displayed on display screen.
The initialization of graphics plane 11(Resetting)Similarly executed.Specifically, in the L figures of initialization graphics plane 11 In the case of one of shape plane 11L and R graphics plane 11R, another must also be initialised.
However, the author of BD-J applications bears and carries out significant matched responsibility between the L kens and the R kens(Author Responsibility), i.e., the matching of the picture material between the left eye image and right eye image of figure.
Figure 42 is the left eye image for describing figure and the matched diagram between right picture image.
A in Figure 42 shows the left eye image and right eye image for the figure described in matching status.
In A in Figure 42, the description to the left eye image of L graphics planes 11L and the right side to R graphics planes 11R The description of ophthalmically acceptable image has been completed, to which after describing completion, 3D compatible layers must show a left side on the display screen Ophthalmically acceptable image and right eye image.
Note that ensureing API using drawing command sequence as parameter, but as this with reference to the description completeness that figure 35 describes Describe completeness and ensures that the drawing command sequence of the parameter of API must be in matching status for describing(So as to be seen Make 3D rendering)Left eye image and right eye image drawing command sequence, and according to this description completeness ensure API, it is ensured that come the left eye image and right eye image of generating writing pattern with matching status.
B in Figure 42 shows the left eye image and right eye image of the figure in mismatch Conditions.
In B in Figure 42, the description of the left eye image of L graphics planes 11L is completed, but to R graphics planes The description of the right eye of 11R image is not yet completed.
3D compatible layers need not by the state of the B in Figure 42 left eye image and right eye image include It shows on screen.
For example, by using triple buffer device at 3D compatible layers, it can be ensured that the left eye image of figure and the right side Matching between ophthalmically acceptable image.
Figure 43 is that the functional configuration for the BD players being shown as in Fig. 3 using the 3D compatible layers of triple buffer is shown The block diagram of example.
The 3D compatible layers include the posterior bumper for serving as graphics plane 11(Hide buffer)211, anterior bumper 212 With 213.
Posterior bumper 211 is made of buffer 211L and 211R.Anterior bumper 212 is made of buffer 212L and 212R, And anterior bumper 213 is made of buffer 213L and 213R.
Note that in Figure 43, buffer 211L, 212L and 213L are equivalent to L graphics plane 11L, and store left eye use Image.Buffer 211R, 212R and 213R are equivalent to R graphics plane 11R, and store right eye image.
BD-J applications send out drawing command, and the 3D rendering of the figure as the result for running the drawing command(Left eye With image and right eye image)It is depicted on posterior bumper 211.
On the other hand, anterior bumper 212 and 213 is by alternate selection, and is stored in that selected buffer(Hereinafter referred to as Be selected buffer)In left eye image and right eye it is shown on the display screen with image(Display processing is provided Device).
After being completed to the description of the left eye image of posterior bumper 211 and right eye image, storage(Describe)At this Left eye image and right eye in posterior bumper 211 with image be copied into anterior bumper 212 and 213 it is non-selected that It is a.
Switching as the selection of selected buffer for alternate selection anterior bumper 212 and 213 is completed from rear buffering Device is read(Copy)The VBI of left eye image and right eye after until image horizontal line to the last(Vertical Blanking Interval, vertical blanking interval)Timing operation, to prevent from tearing(tearing)The generation of artifact.
The accurate animation of frame
FAA(Frame Accuarte Animation, the accurate animation of frame)Including the accurate animation of picture frame(Image Frame Accurate Animation)With the accurate animation of synchronization frame(Sync Frame Accurate Animation)This two It is a, but in order to which operation is used for the left eye image and right eye image of animation simultaneously in 3D compatible layers(In order to realize L/R is synchronized), it is desirable to even with any one of the accurate animation of picture frame and the accurate animation of synchronization frame, also execute respectively The description of the description of left eye image for animation and right eye image for animation(Animation is operated at two simultaneously).
That is, in conventional player, animation is operated only at one.Using image or buffer to cross over L and R In the case of, animation operation can execute at two in a pseudo manner, but due to the performance requirement of one side of BD players, not export Enough animation frame rates.
Figure 44 is for describing the diagram using the animation carried out across the image of L and R.
In Figure 44, to cross over the L graphics plane 11L and R graphics planes 11R of the graphics plane 11 of 1920 × 2160 pixels Mode describe the single image of w × (h+1080) pixel.
In Figure 44, among the image of w × (h+1080) pixel, in addition to w × h pixel images on top and the w of lower part Part other than × h pixel images(Center portion)It is filled with transparent pixels(Transparent color), to w × h pixels on top Image can be considered as the left eye image for animation, and w × h pixel images of lower part can be considered as the right eye for animation Use image.
That is, the center portion of the single image in Figure 44 is filled with transparent color, in the single figure of viewing As when appearance can be set to the same position that w × h pixel images are depicted in L graphics plane 11L and R graphics planes 11R On state.It is thus possible to realize 3D rendering animation, w × h pixel images on wherein L graphics planes 11L and R graphics planes W × h pixel images on 11R are by simultaneously operating.
However, in Figure 44, although the left eye image and right eye for animation are w × h pixel images with image, still need to Execute the description of the single image of huge w × (h+1080) pixel.
As a result, the performance depending on BD players, may take time to describe image, and it is difficult to enough frame speed Rate shows 3D rendering animation.
Therefore, in 3D compatible layers, the description of the left eye image for animation is executed respectively and for animation The description of right eye image.
Figure 45 is showing for the description for showing the left eye image for animation and the description of the right eye image for animation Figure.
In 3D compatible layers, the left eye for animation is depicted in L graphics planes 11L with image(The regions L)On.This Outside, in 3D compatible layers, and to L graphics planes 11L(The regions L)The left eye image for animation description mutually separate Ground, the right eye for animation are depicted in R graphics planes 11R with image(Zone R domain)On.
It is thus possible to the description of the left eye image and right eye image for animation promptly be executed, as a result, can To show 3D rendering animation with enough frame rate.
Figure 46 is shown as executing retouching to the left eye image for animation of L graphics planes 11L respectively It paints and to the BD players in Fig. 3 of the 3D compatible layers of the description of the right eye image for animation of R graphics planes 11R Functional configuration example block diagram.
A in Figure 46 shows the configuration of the 3D compatible layers for describing animation in the form of the accurate animation of picture frame Example.
Frame buffer 231 is acted as BD-J applications load and is preserved from the disk 100 as BD(Fig. 3)Resource The buffer of buffer memory, and store the list of the left eye image for animation(L image lists)With for animation Right eye image list(R image lists).
Pixel transmission equipment 232L is sequentially read from frame buffer 231 as unit of pixel and is used for the left eye of animation Image is depicted on L graphics planes 11L.
Pixel transmission equipment 232R is sequentially read from frame buffer 231 as unit of pixel and is used for the right eye of animation Image is depicted on R graphics planes 11R.
B in Figure 46 shows the configuration of the 3D compatible layers for describing animation in the form of the accurate animation of synchronization frame Example.
Graphic memory 241 is the working storage of 3D compatible layers, and by storing the left eye figure for animation The buffer of picture(L frame buffers)Buffer with storage for the right eye image of animation(R frame buffers)Structure At.
Pixel transmission equipment 242L is sequentially read from graphic memory 241 as unit of pixel and is used for the left eye of animation Image is depicted on L graphics planes 11L.
Pixel transmission equipment 242R is sequentially read from graphic memory 241 as unit of pixel and is used for the right eye of animation Image is depicted on R graphics planes 11R.
Now, the definition of the extension API of the accurate animation of picture frame is shown in FIG. 47.
In addition, the definition of the extension API of the accurate animation of synchronization frame is shown in FIG. 48.
In addition, the sample code of the accurate animation of picture frame is shown in Figure 49 and 50.Note that Figure 50 is hookup 49 Figure.
In addition, the sample code of the accurate animation of synchronization frame is shown in Figure 51 and 52.Note that Figure 52 is hookup 51 Figure.
Now, the embodiment of the present invention is not limited to the above embodiments, without departing from the spirit of the present invention can be with Execute various modifications.
That is, in the present embodiment, in the BD players in Fig. 3 as 3D compatible layers, to be recorded in Perhaps Java in 3D rendering in disk 100(Registered trademark)Processing is performed using for object, at 3D compatible layers Perhaps Java in the 3D rendering of process object(Registered trademark)Using being from the number in addition to such as recording medium of disk 100 etc It is, for example, from the object carousel applied as digital broadcasting according to device is provided specifically(object carousel)Or data turn Disk is supplied to 3D compatible layers, and 3D compatible layers can be to provide be somebody's turn to do from the object carousel or data carousel Perhaps Java in 3D rendering(Registered trademark)Processing is executed using for object.

Claims (6)

1. a kind of information processing equipment, wherein the graphics plane for storing graph image and the video for store video images Each in plane is for a storage region of image corresponding with two screens, and the storage region is by the regions L and Zone R domain Configuration, wherein the regions L are the storage regions for storing left eye image corresponding with a screen, and Zone R domain is for storing The storage region of right eye image corresponding with a screen;
Wherein, the graphics plane configuration and the video plane configuration be respectively be directed to the graphics plane entirety and All definition of the video plane, each of which is the storage region for image corresponding with two screens;
Wherein, the video mode as the pattern for reproducing the video image, defines following pattern:
Non-cubic video mode, wherein when the video image is the non-cubic image as 2D images, it will be described non-cubic Image is stored in the regions L of the video plane and a storage region in the Zone R domain,
Three-dimensional video-frequency pattern will constitute the stereogram wherein when the video image is the stereo-picture as 3D rendering The left eye image and the right eye of picture are respectively stored in the regions L of the video plane and the Zone R with image In domain, and
Three-dimensional video-frequency pattern is planarized, wherein when the video image is the stereo-picture as 3D rendering, described in composition One of described left eye image and the right eye image of stereo-picture are stored in the regions L and the institute of the video plane It states in the two of Zone R domain,
The configuration of the wherein described video plane includes the video mode.
2. information processing equipment according to claim 1, wherein when the video mode changes from the three-dimensional video-frequency pattern When changing to non-cubic video mode, the image stored in the regions L of the graphics plane and a storage region in Zone R domain is kept For showing.
3. information processing equipment according to claim 1, wherein when the video mode is from the non-cubic video mode When changing to three-dimensional video-frequency pattern, the image stored in a storage region in the regions L of the graphics plane and Zone R domain is answered Make another storage region.
4. a kind of information processing method, wherein the graphics plane for storing graph image and the video for store video images Each in plane is for a storage region of image corresponding with two screens, and the storage region is by the regions L and Zone R domain Configuration, wherein the regions L are the storage regions for storing left eye image corresponding with a screen, and Zone R domain is for storing The storage region of right eye image corresponding with a screen;
Wherein, the graphics plane configuration and the video plane configuration be respectively be directed to the graphics plane entirety and All definition of the video plane, each of which is the storage region for image corresponding with two screens;
Wherein, the video mode as the pattern for reproducing the video image, defines following pattern:
Non-cubic video mode, wherein when the video image is the non-cubic image as 2D images, it will be described non-cubic Image is stored in the regions L of the video plane and a storage region in the Zone R domain,
Three-dimensional video-frequency pattern will constitute the stereogram wherein when the video image is the stereo-picture as 3D rendering The left eye image and the right eye of picture are respectively stored in the regions L of the video plane and the Zone R with image In domain, and
Three-dimensional video-frequency pattern is planarized, wherein when the video image is the stereo-picture as 3D rendering, described in composition One of described left eye image and the right eye image of stereo-picture are stored in the regions L and the institute of the video plane It states in the two of Zone R domain,
The configuration of the wherein described video plane includes the video mode.
5. information processing method according to claim 4, wherein when the video mode changes from the three-dimensional video-frequency pattern When changing to non-cubic video mode, the image stored in the regions L of the graphics plane and a storage region in Zone R domain is kept For showing.
6. information processing method according to claim 4, wherein when the video mode is from the non-cubic video mode When changing to three-dimensional video-frequency pattern, the image stored in a storage region in the regions L of the graphics plane and Zone R domain is answered Make another storage region.
CN201410081035.2A 2009-04-03 2010-03-24 Information processing equipment, information processing method and program Expired - Fee Related CN103888753B (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2009091160 2009-04-03
JP2009-091160 2009-04-03
JP2010046031A JP4915459B2 (en) 2009-04-03 2010-03-03 Information processing apparatus, information processing method, and program
JP2010-046031 2010-03-03

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201080001694.0A Division CN102301725B (en) 2009-04-03 2010-03-24 Information processing device, information processing method, and program

Publications (2)

Publication Number Publication Date
CN103888753A CN103888753A (en) 2014-06-25
CN103888753B true CN103888753B (en) 2018-08-31

Family

ID=

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1212812A (en) * 1996-02-28 1999-03-31 松下电器产业株式会社 High-resolution optical disk for recording stereoscopic video, optical disk reproducing device, and optical disk recording device
EP1501316A1 (en) * 2002-04-25 2005-01-26 Sharp Corporation Multimedia information generation method and multimedia information reproduction device
CN1892288A (en) * 2005-07-05 2007-01-10 三星Sdi株式会社 Stereoscopic image display device
CN101375315A (en) * 2006-01-27 2009-02-25 图象公司 Methods and systems for digitally re-mastering of 2D and 3D motion pictures for exhibition with enhanced visual quality

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1212812A (en) * 1996-02-28 1999-03-31 松下电器产业株式会社 High-resolution optical disk for recording stereoscopic video, optical disk reproducing device, and optical disk recording device
EP1501316A1 (en) * 2002-04-25 2005-01-26 Sharp Corporation Multimedia information generation method and multimedia information reproduction device
CN1892288A (en) * 2005-07-05 2007-01-10 三星Sdi株式会社 Stereoscopic image display device
CN101375315A (en) * 2006-01-27 2009-02-25 图象公司 Methods and systems for digitally re-mastering of 2D and 3D motion pictures for exhibition with enhanced visual quality

Similar Documents

Publication Publication Date Title
CN103841347B (en) Message processing device and information processing method
CN103903639B (en) Information processing device and information processing method
CN101859580B (en) Pointer information processing device, method and program
JP4919122B2 (en) Information processing apparatus, information processing method, and program
CN103179422B (en) Information processing device, information processing method, and program
CN103000209B (en) Message processing device and information processing method
JP2010244245A (en) Information processing apparatus, information processing method and program
CN103888753B (en) Information processing equipment, information processing method and program
JP4962670B2 (en) Information processing apparatus, information processing method, and program
JP2012100346A (en) Information processing equipment, information processing method, and program
JP2010245760A (en) Information processor, method of processing information, and program
JP2010245759A (en) Information processor, method of processing information, and program

Legal Events

Date Code Title Description
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180831

Termination date: 20210324