CN103489150A - Tiled viewport composition - Google Patents

Tiled viewport composition Download PDF

Info

Publication number
CN103489150A
CN103489150A CN201310208305.7A CN201310208305A CN103489150A CN 103489150 A CN103489150 A CN 103489150A CN 201310208305 A CN201310208305 A CN 201310208305A CN 103489150 A CN103489150 A CN 103489150A
Authority
CN
China
Prior art keywords
image
vision area
image sheet
buffer
buffer district
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310208305.7A
Other languages
Chinese (zh)
Other versions
CN103489150B (en
Inventor
艾丁尼·贝朗格
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BlackBerry Ltd
Original Assignee
QNX Software Systems Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by QNX Software Systems Ltd filed Critical QNX Software Systems Ltd
Publication of CN103489150A publication Critical patent/CN103489150A/en
Application granted granted Critical
Publication of CN103489150B publication Critical patent/CN103489150B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39Control of the bit-mapped memory
    • G09G5/393Arrangements for updating the contents of the bit-mapped memory
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39Control of the bit-mapped memory
    • G09G5/395Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39Control of the bit-mapped memory
    • G09G5/399Control of the bit-mapped memory using two or more bit-mapped memories, the operations of which are switched in time, e.g. ping-pong buffers

Abstract

The invention discloses a tiled viewport composition. A system that buffers an application image reduces bandwidth requirements for accessing memory. The application image is logically separated into tiles. A viewport identifies a visible portion of the application image, where the visible portion is smaller than the application image. The tiles overlapped by the viewport are buffered in a front buffer and a back buffer. The tiles not overlapped by the viewport are buffered in the back buffer but not in the front buffer. A composition manager, with knowledge of the viewport and at least two noncontiguous tile buffers in the front buffer, extracts the visible portion of the application image directly from the noncontiguous tile buffers.

Description

The tiling vision area is synthetic
Technical field
Present disclosure relates to figure, specifically, relates to graphic buffer.
Background technology
The graph image of graphic user interface (GUI), picture-in-picture (PiP) and other type can be synthetic by a plurality of images that independently present.For example, GUI can comprise background image and the one or more graph layers that present on background image.Graph layer can comprise the graphic element of application, taskbar or other type.Can each in graph layer be independent of to other graph layer by independent software application is presented in the application buffer zone.Can in display buffer, graph layer be synthesized to single composograph together, this single composograph can be presented on display device, by Internet Transmission or otherwise processed.The application buffer zone can mean to be greater than the image of the respective graphical layer that synthesizes single composograph.
The accompanying drawing explanation
Can carry out with reference to the following drawings and description to understand better present disclosure.Assembly in accompanying drawing needn't be drawn in proportion.In addition, in the accompanying drawings, similar reference number runs through different views indicates corresponding part.
Fig. 1 is tiling vision area synthesis system;
Fig. 2 is the hardware schematic diagram of tiling vision area synthesis system; And
Fig. 3 is the process flow diagram of the logic of tiling vision area synthesis system.
Embodiment
Can comprise synthetic manager and comprise the front buffer district and the storer in back buffer district for the system that cushions application image.Application image can logically be divided into or be divided into image sheet (tile).Each in image sheet can identify the respective regions of application image.Which in vision area overlapping (overlap) image sheet synthetic manager can determine.Vision area can identify the viewable portion of application image.Viewable portion may be less than application image.For example, viewing area can be the part shown on the display device of map in navigational system.
In some systems, the image sheet that the synthetic manager application of application image (or present) can be overlapping to vision area carries out double buffering (or more generally, multi-buffer).Synthetic manager (or application) may not be not overlapping to vision area image sheet carry out double buffering (or multi-buffer).The amount that reduces the storer of multi-buffer can reduce the bandwidth demand for access memory.
Double buffering can prevent from being write and the visual illusion (tearing artifacts) of tearing that another process causes when identical buffer zone is read to buffer zone when a process.In order to reduce or avoid causing the possibility of these visible defects, application presents application image when can read application image from preposition buffer zone in another process such as synthetic manager etc. in the back buffer district.More generally, the buffer zone that system is write with the frame of Structural application image to it can be the back buffer district.The buffer zone that system reads complete frame from it can be the front buffer district.In the example of using the multi-buffer district, system can comprise and use a plurality of back buffers district.
In response to vertical sync pulse or certain other event, can switching preamplifier buffer zone and back buffer district, make the back buffer district become the front buffer district, and the front buffer district become the back buffer district.This buffer zone switching may also be referred to as buffer zone and replaces.After buffer zone replaces it, the back buffer district can comprise the content of frame n, and the front buffer district can comprise the content of frame n+1.If the whole content replication of front buffer district (frame n+1) is to the back buffer district (frame n), the back buffer district can have nearest content (frame n+1), and application can start to present new frame n+2 in the back buffer district.Can repeat the process that presents, replaces and show.
Yet, for cushioning the system of application image, when buffer zone is replaced generation, can avoid the whole content from preposition buffer zone to rearmounted buffer zone replication application image.On the contrary, the double buffering (or multi-buffer) that synthetic manager and/or application can be skipped the image sheet not overlapping to vision area.Specifically, synthetic manager and/or application can be in front buffer district and back buffer district the overlapping image sheet of buffering vision area in the two, and the not overlapping image sheet of buffering vision area in the front buffer district in the back buffer district and.
Can be in corresponding image sheet buffer zone each in the buffer zone image sheet.Can be placed in storer the image sheet buffer zone is discontinuous.If buffer zone is not adjacent to each other in the memory address space of the residing storer of buffer zone, two buffer zones can be discrete.
In some systems, the synthetic manager that synthetic manager can be based on understanding vision area and image sheet buffer zone is directly from the viewable portion through buffering of discrete image sheet buffer zone replication application image.Application does not need to be created in connected storage the viewable portion through buffering that comprises application image so that synthetic manager can copy from connected storage the intermediate buffer of viewable portion.Avoid creating intermediate buffer and reduced the bandwidth demand for access memory.Synthetic manager can generate composograph according to viewable portion and one or more extra application image of this application image.
Fig. 1 shows tiling vision area synthesis system 100.System 100 can comprise application 102, application buffer zone 104, display buffer 106 and synthetic manager 108.Tiling vision area synthesis system 100 is for cushioning the system of application image 110.
Application 102 can present application image 110.Application image 110 can comprise the window for example, generated by the operating system of the window based operating system of mobile electronic device, desk-top computer or server (, for).The example of the operating system of window based can comprise MICROSOFT WINDOWS
Figure BDA00003273008100031
(it is the registered trademark of the Microsoft of Redmond, Washington); LINUX
Figure BDA00003273008100032
(it is the registered trademark of the Lin Nasi. Tuo Wazi of Finland); And ANDROID tM(it is the trade mark of the company limited of Google in mountain scene city, California).Replacedly or in addition, application image 110 can comprise graphic user interface (GUI), picture-in-picture (PiP), taskbar, background picture, can be frame in the frame sequence of a part of video or the digital picture of any other type.The example of application 102 can comprise word processor, mailer, web browser, mobile application or can present software program or the nextport hardware component NextPort of other type of application image 110.
Application buffer zone 104 can be the expression application image 110 of storer and/or one or more zones of its various piece.Storer can comprise the continuous and/or discontinuous zone of storer.
Display buffer 106 can comprise the zone of the storer of the composograph 112 that means each image combining from for example, being generated by one or more application (, the application shown in Fig. 1 102).Composograph 112 can be presented on display device, by network, send or processed at Local or Remote.
Synthetic manager 108 can synthesize each image composograph 112 or instruct each image is synthesized to composograph 112.Each image can comprise all or part of of application image.The example of synthetic manager 108 comprises hardware compositor, window manager or each image is synthesized to any other assembly of composograph 112.
During operation tiling vision area synthesis system 100, synthetic manager 108 can assign to present composograph 112 according to the visible section of the application image 110 by vision area 114 signs.Viewable portion by vision area 114 signs may be less than whole application image 110.Synthetic manager 108 can and present composograph 112 according to one or more extra images according to the viewable portion of application image 110.
Along with the viewable portion of application image 110 changes in time, apply 102 can be around application image 110 mobile vision area 114.In one example, application image 110 can be map image, and vision area 114 identifies the part that map images will show in navigational system.When the position of navigational system changes, the part that map image shows in navigational system also may change.In the second example, application image 110 can be the image that one in video-game closed, and vision area 114 can identify the part that the image of this pass will show on screen.When game role moves on every side in this pass, the part that the image of this pass shows on screen changes.In the 3rd example, web browser can present with on display shown in content compare more content.When application 102 use vision areas 114 are upgraded the viewable portion of application image 110, composograph 112 can upgrade or produce visually more level and smooth transition outward appearance more quickly.
Application 102 can logically be divided into or be divided into image sheet 116 by application image 110.Each in image sheet 116 can identify the respective regions of application image 110.In whole application image 110, image sheet 116 can be consistent on size and shape.Replacedly, in whole application image 110, the size and shape of image sheet 116 can change.In different examples, the size and shape of image sheet 116 can be different.
Can be in corresponding image sheet buffer zone 118 presentation graphs photo 116.For example, be appointed as individually the image sheet 116 of T1 to T4 in can in being appointed as individually the image sheet buffer zone 118 of A1 to A4, being illustrated in Fig. 1.Image sheet buffer zone 118 can be included in application buffer zone 104.
Which in the overlapping image sheet 116 of vision area 114 synthetic manager 108 can determine.Each in the image sheet 116 of or imbrication (intersect) overlapping with vision area 114 can at least comprise the part 120 of the viewable portion of application image 110.On the contrary, the not overlapping image sheet 116 of vision area 114 may not comprise any viewable portion 120 of application image 110.
Synthetic manager 108 can be overlapping to vision area 114 image sheet 116 rather than residual graph photo 116 carry out double buffering.Front buffer district 122 can comprise the image sheet buffer zone 118 (A3 and A4) of the image sheet 116 (T3 and T4) that means that vision area 114 is overlapping.Therefore, the image sheet buffer zone 118 in front buffer district 122 (A3 and A4) comprises the viewable portion 124 through buffering of application image 110.On the contrary, back buffer district 126 can comprise the image sheet buffer zone 118 (A1 and A2) of the image sheet 116 (T1 and T2) that means that vision area 114 is not overlapping.In addition, back buffer district 126 can comprise image sheet buffer zone 118 (B3 and B4) corresponding with the image sheet buffer zone 118 (A3 and A4) in front buffer district 122 and expression overlapping image sheet 116 by vision area 114.
When generating composograph 112, synthetic manager 108 can extract the viewable portion 124 through buffering of application image 110 from the image sheet buffer zone 118 in front buffer district 122 (A3 and A4).The frame n that can there is application image 110 through the viewable portion 124 of buffering.Application 102 can present by the image sheet buffer zone 118 (A1, A2, B3 and B4) of modification in back buffer district 126 the frame n+1 of the application image 110 in back buffer district 126.
When buffer zone is replaced generation, synthetic manager 108 can be by the content replication of the subset of the image sheet buffer zone 118 in back buffer district 126 to front buffer district 122.The subset of image sheet buffer zone 118 can be the image sheet buffer zone 118 (B3 and B4) corresponding with the image sheet buffer zone 118 (A3 and A4) in front buffer district 122.Synthetic manager 108 can be skipped the image sheet buffer zone 118 (A1 and A2) that means the image sheet 116 (T1 and T2) that vision area 114 is not overlapping is copied to front buffer district 122.
As the content of the subset of image sheet buffer zone 118 is copied to replacement or the interpolation in front buffer district 122 when buffer zone replace to occur from back buffer district 126, synthetic manager 108 can change associated between image sheet buffer zone 118 and front buffer district 122 and back buffer district 126.Synthetic manager 108 can be in data structure which in tracing figure photo buffer zone 118 with front buffer district 122, be associated and image sheet buffer zone 118 in which with back buffer district 126, be associated.Which in associated index map photo buffer zone 118 between image sheet buffer zone 118 and front buffer district 122 and back buffer district 126 is included in each in front buffer district 122 and back buffer district 126.When buffer zone replace to occur, synthetic manager 108 can be by the subset of image sheet buffer zone 118 (B3 and B4) and back buffer district 126 disassociations, and the subset of image sheet buffer zone 118 (B3 and B4) is associated with front buffer district 122.Therefore, synthetic manager 108 can be changed into the image sheet buffer zone 118 (A3 and A4) be associated with front buffer district 122 at first with back buffer district 126 and be associated.In other words, synthetic manager 108 can be replaced in response to buffer zone, second set be associated with back buffer district 126 of first set be associated with front buffer district 122 of image sheet buffer zone 118 and image sheet buffer zone 118 is exchanged, wherein, exchanged image sheet buffer zone 118 means the overlapping image sheet 116 of vision area 114 and does not mean the not overlapping image sheet of vision area 114 116.
When the image sheet buffer zone 118 that will be associated with front buffer district 122 when synthetic manager 108 and the corresponding image sheet buffer zone 118 be associated with back buffer district 126 are exchanged, the image sheet buffer zone 118 be switched in back buffer district 126 can mean older frame, for example, frame n.The image sheet buffer zone 118 be switched in front buffer district 126 can mean frame n+1.After the buffer zone exchange, apply 102 and can in back buffer district 126, present the 3rd frame, for example, frame n+2.
When vision area 114 move and with image sheet 116 in new image sheet when overlapping, synthetic manager 108 can carry out double buffering to new overlapping image sheet 116.On the contrary, when vision area 114 moves and be no longer overlapping with one of image sheet 116, synthetic manager 108 can stop previous overlapping image sheet 116 is carried out to double buffering.
Therefore, when vision area 114 moves, which in image sheet buffer zone 118 synthetic manager 108 can adjust in front buffer district 122, makes image sheet buffer zone 118 in front buffer district 122 image sheet 116 overlapping with vision area 114 corresponding.Similarly, when vision area 114 moves, which in image sheet buffer zone 118 synthetic manager 108 can adjust in back buffer district 126.
When vision area 114 moves and be overlapping with new overlapping image sheet 116, the corresponding image sheet buffer zone 118 of the image sheet 116 with newly overlapping in back buffer district 126 can be included in front buffer district 122.Do not need fully again to present the image sheet buffer zone 118 that adds the front buffer district to, this is because application 102 may present image sheet buffer zone 118 in back buffer district 126.
In some systems, can along with the movement of vision area 114, dynamically distribute and release graphics photo buffer zone 118.For example, if vision area 114 moves and overlapping with four image sheets (T1 to T4) rather than two image sheets (T3 and T4) in image sheet 116 in the image sheet 116 shown in Fig. 1, synthetic manager 108 can dynamically distribute two image sheet buffer zones 118 (B1 and B2, it is not shown in Fig. 1).Then, front buffer district 122 can comprise four the image sheet buffer zones (A1 to A4) in image sheet buffer zone 118, and back buffer district 126 can comprise four corresponding image sheet buffer zones 118 (B1 to B4).
As substituting of dynamic assignment image sheet buffer zone 118, can shift to an earlier date distribution diagram photo buffer zone 118.For example, after the initialization of application 102 requests, synthetic manager 108 can distribute abundant image sheet buffer zone 118, fully to mean application image 110 in back buffer district 126 and front buffer district 122.Synthetic manager 108 can dynamically be associated pre-assigned image sheet buffer zone 118 with front buffer district 122 and back buffer district 126.
Application 102 can have the feature different from described feature with synthetic manager 108.In a system, image sheet 116 be divided or be divided into to synthetic manager 108 (rather than applying 102) can by application image 110.Application 102 can be called API (application programming interface) and be come to the size of synthetic manager 108 indication application images 110.As response, synthetic manager 108 can be divided into image sheet 116 by application image 110, and distributes corresponding image sheet buffer zone 118.In another system, apply 102 (rather than synthetic managers 108) and can carry out double buffering to the image sheet overlapping by vision area 114 116 rather than residual graph photo 116.In another system, except apply 102 and synthetic manager 108 one or more assemblies can carry out application 102 and the described function of synthetic manager 108.
Synthetic manager 108 can assign to present composograph 112 according to the visible section of the application image 110 by vision area 114 signs.The synthetic manager 108 of understanding image sheet buffer zone 118 and vision area 114 can copy to display buffer 106 by the direct image sheet buffer zone 118 from preposition buffer zone 122 of viewable portion 124 through buffering, even the viewable portion 124 through cushioning spreads all over a plurality of discrete image sheet buffer zones 118, is also like this.It can be unnecessary will copying to intermediate buffer, then from middle buffer zone, copy to display buffer 106 through the image sheet buffer zone 118 of viewable portion 124 from preposition buffer zone of buffering.For example, apply 102 and can provide relevant with vision area 114 and relevant with the image sheet buffer zone 118 in front buffer district 122 information to synthetic manager 108.Synthetic manager 108 can be with by application 102 information that provide, by the viewable portion 124 through buffer zone, the image sheet buffer zone 118 from preposition buffer zone 122 copies to display buffer 106.Replacedly, synthetic manager 108 can present the composograph 112 from intermediate buffer.Application 102 can copy to fill intermediate buffer by the viewable portion 124 through buffering from preposition buffer zone 122.
The frame of the application image 110 meaned in front buffer district 122 can be frame n or any other frame.The frame of the application image 110 meaned in back buffer district 126 can be frame n+1 or any other frame.
As mentioned above, synthetic manager 108, apply 102 and/or a certain other assembly can be overlapping to vision area 114 image sheet 116 or be positioned at or the image sheet 116 that extends the part of (extend) and covering vision area 114 carries out double buffering.Synthetic manager 108 and/or apply 102 can be to the image sheet overlapping by vision area 114 116 and not overlapping image sheet 116 application multi-buffers to vision area 114 not.The multi-buffer district can comprise double buffering, triple buffer or other buffering course and/or hardware, be included in one or more front buffers district one or more frames in storage application image 110 to extract application image 110, and in one or more back buffers district the one or more frames in storage application image 110 to present application image 110.
Fig. 2 is the hardware schematic diagram of tiling vision area synthesis system 100.Tiling vision area synthesis system 100 can comprise processor 204, memory interface 206 and storer 208.Tiling vision area synthesis system 100 can be referred to as system 100.
Processor 204 can be to carry out the computer executable instructions be embodied in storer 208 or other storer or the computer code hardware with one or more features of realizing tiling vision area synthesis system 100.Processor 204 can comprise processor or its combination in any of general processor, CPU (central processing unit), Graphics Processing Unit, special IC (ASIC), digital signal processor, field programmable gate array (FPGA), digital circuit, mimic channel, microcontroller, any other type.
Memory interface 206 for example can be managed, to and from the transmission of the data of storer 208 (, between processor 204 and storer 208).Memory interface 206 can comprise any Memory Controller, for example, the Memory Controller of memory chip controller (MCC), the DDR2 Memory Controller for driving Double Data Rate 2 (DDR2) SDRAM (double data speed synchronous dynamic RAM), periphery component interconnection (PCI) bus controller or any other type.Memory interface 206 can pass through bus 214 (for example, at 400 megahertzes or locate 64 bit DDR2 buses of operation or the bus of any other type) to communicate with storer 208.
Storer 208 can comprise for storage and fetch the equipment of data or its combination in any.Storer 208 can comprise nonvolatile memory and/or volatile memory, for example, and random access memory (RAM), ROM (read-only memory) (ROM), Erasable Programmable Read Only Memory EPROM (EPROM) or flash memory.Replacedly or in addition, storer 208 can comprise the data storage device of optical storage apparatus, magnetic storage apparatus (hard disk drive) or any other form.
Storer 208 can be stored computer code, for example, synthetic manager 108, applies 102 and/or any other application.Computer code can comprise and utilizes the executable instruction of processor 204.Can write computer code with any computerese, computerese is for example the combination in any of C, C++, assembly language, tinter code, channel program code and/or computerese.
Storer 208 can comprise the buffer zone such as application buffer zone 104 and display buffer 106 etc.Application buffer zone 104 can comprise image sheet buffer zone 118.
No matter described specific implementation how, all disclosures are all illustrative rather than restrictive in itself.System 100 can comprise from Fig. 1, with the assembly shown in Fig. 2, compare more, still less or different assemblies.For example, system 100 can also comprise display controller 210 and display device 212.Display controller 210 can 106 read composograph 112 from display buffer by memory interface 206, and composograph 112 is presented in display device 212.
Processor 204 can communicate via memory interface 206 and storer 208.Processor 204 can communicate with other assembly such as display controller 210 and/or network controller (not shown) etc.
In addition, each assembly in the assembly of system 100 can comprise from Fig. 1, with the element shown in Fig. 2, compare more, still less or different elements.For example, storer 208 can comprise more, still less or different modules, graphic buffer and application.In addition, apply 102 and/or synthetic manager 108 can comprise various modules.Mark, data, database, form, entity and other data structure can be by store and managements individually, can be incorporated in single memory or database, can be distributed, or can logically and physically be organized in a lot of different modes.These assemblies can operate independently or can be identical program or the part of hardware.These assemblies can reside on the independent hardware such as independent removable circuit board etc., or share the common hardware such as identical storer and processor etc., to carry out the instruction from storer.Program can be the various piece of single program, is independent program, or is distributed on a plurality of storeies and processor.
In some instances, the one or more assemblies in the assembly of system 100 can be included in SOC (system on a chip) (SOC) 216.For example, SOC 216 can comprise processor 204, memory interface 206 and display controller 210.In another example, SOC 216 can comprise extra assembly, for example, and storer.
System 100 can realize in a lot of processes and/or system.For example, although some features be shown as be embodied as the logic of computer executable instructions or as the data structure storage in storer in computer-readable memory, the various piece of system 100 and logic thereof and data structure can be stored on any other machinable medium, be distributed on any other machinable medium or from any other machinable medium and read.The example of storage medium can comprise machinable medium or the computer-readable recording medium of storer, high-speed buffer, buffer zone, RAM, removable media, hard disk drive, hard disk, floppy disk, CD-ROM or any other type.Medium can comprise any non-instantaneous computer-readable recording medium, for example, and volatile memory or nonvolatile memory, RAM, ROM, CD-ROM, any other applicable memory device or its combination in any.Replacedly or in addition, the feature and/or the module that are described as being embodied as the logic of computer executable instructions or being described as the data structure in storer can realize in hardware, perhaps realize in the combination of hardware and software (for example, realize programmable gate array (FPGA) in) at the scene.
Can in response to be stored among computer-readable medium or on one or more logical OR instruction set carry out function shown in accompanying drawing or described, action or task.These functions, action or task are independent of instruction set, storage medium, processor or the processing policy of particular type, and can be realized by the software of independent operation or joint operation, hardware, integrated circuit, firmware, microcode etc.Similarly, processing policy can comprise the processing of multiprocessing, multitask, parallel processing, distributed treatment and/or any other type.In one embodiment, these instructions are stored on removable media device to be read by local system or remote system.In other embodiments, the logical OR instruction is stored in the remote location place, to be transmitted by computer network or on telephone wire.In further embodiments, the logical OR instruction can be stored in given computing machine, CPU (central processing unit) (" CPU "), Graphics Processing Unit (" GPU ") or system.
The processing power of system 100 can be distributed between a plurality of entities, for example, is distributed between a plurality of processors and storer, and wherein a plurality of entities selectively comprise a plurality of distributed processing system(DPS)s.Parameter and other data structure can be by store and managements individually, can be incorporated in single memory or database, can logically and physically be organized in a lot of different modes, and can use the dissimilar data structure such as lists of links, hash form or implicit expression memory mechanism etc. to realize.Logic such as program or circuit etc. can be combined or divide between a plurality of programs, is being distributed on a plurality of storeies and processor.
Fig. 3 is the process flow diagram of the logic of tiling vision area synthesis system 100.Application image 110 can be provided, and this application image 110 logically is divided into image sheet 116.For example, image sheet buffer zone 118 can be in storer 208 and presentation graphs photo 116.
Which in the overlapping image sheet 116 of (310) vision area 114 be logic can determine.Vision area 114 can identify the viewable portion of application image 110, and viewable portion can be less than application image 110.
The overlapping image sheet 116 of vision area 114 can cushion (320) in front buffer district 122 and back buffer district 126, wherein, extracts the viewable portion of application image 110 from preposition buffer zone 122, and revise application image 110 in back buffer district 126.For example, front buffer district 122 can buffered frame n, and back buffer district 126 can buffered frame n+1.
Buffering (330) during the not overlapping image sheet 116 of vision area 114 can (in back buffer district 126, be revised application image 119) in back buffer district 126 and in (extracting the viewable portion of application image 110 from preposition buffer zone 122) not in front buffer district 122.For example, the viewable portion 124 through cushioning that logic can be extracted application image 110 by synthetic manager 108 from preposition buffer zone 122 finishes.
Logic can comprise operation extra, different or still less.In such example, logic can comprise by distribution diagram photo buffer zone 118 application image 110 is divided into to image sheet 116.Order that can be different with the order from shown in Fig. 3 is carried out executable operations.
For the use that makes following phrase is clear and make thus the public note, unless replace above any other implicit definition or applicant hereinafter explicit state be contrary, the applicant the most broadly defined phrase "<A >,<B >, with<N > at least one " or "<A >,<B >,<N > at least one or its combination " or "<A >,<B >, and/or<N > ", thereby mean from comprising A, B, with one or more key elements of selecting in the group of N, that is to say, key element A, B, or the one or more combination in any in N comprises any one independent key element, perhaps comprise any one key element and may also combine the one or more key elements in other key element that comprises unlisted extra key element.
Although described each embodiment, it is evident that for those of ordinary skills, in the scope of present disclosure, more embodiment and realization are possible.Therefore, except according to claims and equivalents thereof, should not limit present disclosure.

Claims (15)

  1. One kind the buffering application image (110) computer implemented method, comprising:
    The described application image that is divided into a plurality of image sheets (116) (110) is provided;
    Determine which in the overlapping described image sheet of vision area (114) (116), wherein, described vision area (114) identifies the viewable portion of described application image (110), and described viewable portion is less than described application image;
    The overlapping image sheet (116) of the described vision area of buffering in front buffer district (122) and back buffer district (126), wherein, extract the described viewable portion of described application image from described front buffer district (122), revise described application image (110) in described back buffer district (126), and described front buffer district (122) and described back buffer district (126) are in computer-readable memory; And
    The not overlapping image sheet (116) of buffering described vision area (114) the described front buffer district (122) at the described viewable portion from wherein extracting described application image (110) in revising therein the described back buffer district (126) of described application image (110) and.
  2. 2. computer implemented method according to claim 1, also comprise: use the synthetic manager (108) of understanding at least two the discrete image sheet buffer zones (118) in described vision area and described front buffer district, directly from described at least two discrete image sheet buffer zones, read the viewable portion (124) through buffering of described application image.
  3. 3. computer implemented method according to claim 1 and 2, also comprise: when described vision area (114) is mobile, adjust which in a plurality of image sheet buffer zones (118) in described front buffer district, make described image sheet buffer zone in the described front buffer district described image sheet overlapping with described vision area corresponding, and not overlapping with described vision area described image sheet is corresponding.
  4. 4. computer implemented method according to claim 1 and 2, also comprise: in response to buffer zone, replace, the first image sheet buffer zone collection in described back buffer district is copied to the second image sheet buffer zone collection in described front buffer district, wherein, the described image sheet buffer zone copied means the described image sheet that described vision area is overlapping, but not the not overlapping described image sheet of described vision area.
  5. 5. computer implemented method according to claim 1 and 2, also comprise: in response to buffer zone, replace, the first image sheet buffer zone collection that will be associated with described front buffer district and the second image sheet buffer zone collection be associated with described back buffer district are exchanged, wherein, the described image sheet buffer zone of exchange means the described image sheet that described vision area is overlapping, but not the not overlapping described image sheet of described vision area.
  6. 6. the system (100) for cushioning the first application image (110), described system comprises:
    Processor (204); And
    Storer (208) comprising:
    Front buffer district (122);
    Back buffer district (126); And
    Synthetic manager (108), be configured to determine which and vision area (114) imbrication in a plurality of image sheets (116), wherein, each in described image sheet identifies the respective regions of described the first application image (110), described vision area identifies the viewable portion of described the first application image, and described viewable portion is less than described the first application image
    Wherein, described synthetic manager (108) is further configured to the described image sheet cushioned in described front buffer district and described back buffer district with described vision area imbrication, wherein, described synthetic manager extracts the described viewable portion of described the first application image from described front buffer district, and present described the first application image in described back buffer district
    Wherein, described synthetic manager be further configured in presenting therein the described back buffer district (126) of described the first application image (110) and not the described front buffer district (122) at the described viewable portion from wherein extracting described the first application image buffering not with the image sheet (116) of described vision area (114) imbrication, and
    Wherein, described synthetic manager (108) is further configured to according to described viewable portion and second application image of described the first application image (110) and generates composograph (112).
  7. 7. system according to claim 6, wherein, described synthetic manager is further configured at least two the discrete image sheet buffer zones (118) and described vision area imbrication of determining in described front buffer district, and described synthetic manager is further configured to the described viewable portion that directly from described at least two discrete image sheet buffer zones, extracts described the first application image.
  8. 8. according to the described system of claim 6 or 7, wherein, described synthetic manager (108) is further configured to the request in response to application, and described application image is divided into to described image sheet (116).
  9. 9. according to the described system of claim 6 or 7, wherein, all a plurality of image sheet buffer zones (118) that copy to described front buffer district (122) from described back buffer district (126) in response to the buffer zone replacement only mean the described image sheet with described vision area imbrication.
  10. 10. according to the described system of claim 6 or 7, wherein, all a plurality of image sheet buffer zones (118) that exchange between described front buffer district and described back buffer district in response to the buffer zone replacement only mean the described image sheet with described vision area imbrication.
  11. 11. the computer realization equipment of a buffering application image (110) comprising:
    For described application image (110) being divided into to the device of a plurality of image sheets (116);
    For determining which device of the overlapping described image sheet of vision area (114) (116), wherein, described vision area identifies the viewable portion of described application image, and described viewable portion is less than described application image;
    Device for the image sheet (116) overlapping in front buffer district (122) and back buffer district (126) the described vision areas of buffering (114), wherein, extract the described viewable portion of described application image from described front buffer district, revise described application image in described back buffer district; And
    The device of not overlapping described image sheet (116) in the described vision area of described front buffer district (122) buffer zone (114) of the described viewable portion from wherein extracting described application image not for the described back buffer district (126) revising therein described application image.
  12. 12. computer realization equipment according to claim 11, wherein, use described front buffer district and the described back buffer district image sheet (116) overlapping to described vision area (114) to carry out double buffering, and not overlapping described image sheet does not carry out double buffering to described vision area.
  13. 13. according to the described computer realization equipment of claim 11 or 12, wherein, with described front buffer district and comprise that a plurality of back buffers district image sheet (116) overlapping to described vision area (118) in described back buffer district carries out multi-buffer, and to described vision area, not overlapping image sheet does not carry out multi-buffer.
  14. 14. according to the described computer realization equipment of claim 11 or 12, also comprise: for the device image sheet buffer zone (118) in described back buffer district (126) is associated with described front buffer district (122) in response to the movement of described vision area, wherein, described image sheet buffer zone be illustrated in described vision area move after rather than before described vision area moves the overlapping image sheet of described vision area.
  15. 15., according to the described computer realization equipment of claim 11 or 12, also comprise: for copy the device of the content of described image sheet buffer zone (118) between described front buffer district (122) and described back buffer district (126) in response to the described movement of described vision area.
CN201310208305.7A 2012-06-08 2013-05-30 Tiling vision area synthesis Active CN103489150B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP12171363.0 2012-06-08
EP12171363.0A EP2672480B1 (en) 2012-06-08 2012-06-08 Tiled viewport composition

Publications (2)

Publication Number Publication Date
CN103489150A true CN103489150A (en) 2014-01-01
CN103489150B CN103489150B (en) 2017-03-01

Family

ID=46208373

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310208305.7A Active CN103489150B (en) 2012-06-08 2013-05-30 Tiling vision area synthesis

Country Status (3)

Country Link
EP (2) EP2672480B1 (en)
CN (1) CN103489150B (en)
CA (1) CA2817492C (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106406786A (en) * 2015-07-29 2017-02-15 Ls 产电株式会社 Apparatus and method for displaying in energy management system

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2672480B1 (en) * 2012-06-08 2016-11-16 2236008 Ontario Inc. Tiled viewport composition
KR102275712B1 (en) 2014-10-31 2021-07-09 삼성전자주식회사 Rendering method and apparatus, and electronic apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4839828A (en) * 1986-01-21 1989-06-13 International Business Machines Corporation Memory read/write control system for color graphic display
CN1886779A (en) * 2003-12-18 2006-12-27 苹果电脑有限公司 Composite graphics rendered using multiple frame buffers

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0312720A3 (en) * 1987-10-20 1990-06-13 Tektronix Inc. Double buffered graphics design system
US5877762A (en) * 1995-02-27 1999-03-02 Apple Computer, Inc. System and method for capturing images of screens which display multiple windows
US5933155A (en) * 1996-11-06 1999-08-03 Silicon Graphics, Inc. System and method for buffering multiple frames while controlling latency
US6911983B2 (en) * 2003-03-12 2005-06-28 Nvidia Corporation Double-buffering of pixel data using copy-on-write semantics
WO2010124397A1 (en) * 2009-04-29 2010-11-04 Torch Mobile Inc. Software-based asynchronous tiled backingstore
EP2672480B1 (en) * 2012-06-08 2016-11-16 2236008 Ontario Inc. Tiled viewport composition

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4839828A (en) * 1986-01-21 1989-06-13 International Business Machines Corporation Memory read/write control system for color graphic display
CN1886779A (en) * 2003-12-18 2006-12-27 苹果电脑有限公司 Composite graphics rendered using multiple frame buffers

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106406786A (en) * 2015-07-29 2017-02-15 Ls 产电株式会社 Apparatus and method for displaying in energy management system
CN106406786B (en) * 2015-07-29 2019-04-23 Ls 产电株式会社 Device and method for being shown in Energy Management System

Also Published As

Publication number Publication date
EP2672480B1 (en) 2016-11-16
CA2817492C (en) 2017-03-14
EP3098807A1 (en) 2016-11-30
EP2672480A1 (en) 2013-12-11
CN103489150B (en) 2017-03-01
EP3098807B1 (en) 2018-01-17
CA2817492A1 (en) 2013-12-08

Similar Documents

Publication Publication Date Title
US9699351B2 (en) Displaying image thumbnails in re-used screen real estate
CN102782747B (en) For display surface being divided into the apparatus and method of multiple virtual viewing area
US7889202B2 (en) Transparent multi-buffering in multi-GPU graphics subsystem
CN105190701B (en) Synthesis system based on primitive and method
US20120159383A1 (en) Customization of an immersive environment
US7995003B1 (en) System and method for rendering and displaying high-resolution images
JP6230076B2 (en) Virtual surface assignment
CN103294473B (en) Computer implemented method and apparatus for virtual surface compaction
JP5546593B2 (en) Image display apparatus and control method thereof
JP2010224535A (en) Computer readable storage medium, image processor and image processing method
CN103268628A (en) Virtual surface rendering
CN104765594A (en) Method and device for displaying graphical user interface
JP5442214B2 (en) Method and apparatus for simultaneously displaying mouse pointer on a plurality of display screen areas, mouse simulation program
JP5045428B2 (en) Image display system, image display method, and program
CN104765595A (en) Method and device for displaying graphical user interface
US9251555B2 (en) Tiled viewport composition
CN103489150A (en) Tiled viewport composition
US8773445B2 (en) Method and system for blending rendered images from multiple applications
CN105096365A (en) 3D interface local refreshing method and system
JP2009129223A (en) Image editing device, image editing program, recording medium, and image editing method
EP1909258A2 (en) Off-screen buffering management device and method
JP5229727B2 (en) Multi-image display system, image processing method and program
CN105164723A (en) Shared compositional resources
KR101535679B1 (en) Method and System for Displaying Screen of Merged Application in Mobile communication Terminal
US9251766B2 (en) Composing stereo 3D windowed content

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: 8758271 CANADIAN INC.

Free format text: FORMER OWNER: QNX SOFTWARE SYSTEMS CO., LTD.

Effective date: 20140728

Owner name: 2236008 ONTARIO INC.

Free format text: FORMER OWNER: 8758271 CANADIAN INC.

Effective date: 20140728

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20140728

Address after: Ontario

Applicant after: 2236008 ONTARIO Inc.

Address before: Ontario

Applicant before: 8758271 Canadian Ex-plosives Ltd

Effective date of registration: 20140728

Address after: Ontario

Applicant after: 8758271 Canadian Ex-plosives Ltd

Address before: Ontario, Canada

Applicant before: QNX Software Systems Ltd.

GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20200526

Address after: Voight, Ontario, Canada

Patentee after: BlackBerry Ltd.

Address before: Rika Univ.

Patentee before: 2236008 Ontario Inc.

TR01 Transfer of patent right