CN106132494A - Data acquisition system for multiple view generations - Google Patents

Data acquisition system for multiple view generations Download PDF

Info

Publication number
CN106132494A
CN106132494A CN201480061316.XA CN201480061316A CN106132494A CN 106132494 A CN106132494 A CN 106132494A CN 201480061316 A CN201480061316 A CN 201480061316A CN 106132494 A CN106132494 A CN 106132494A
Authority
CN
China
Prior art keywords
view
client
scene
segmentation
processing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201480061316.XA
Other languages
Chinese (zh)
Inventor
奎斯·塔拉基
维诺德·默利·马姆塔利
马特·瓦尔辛
詹姆斯·乔纳森·莫里斯
杰拉德·约瑟夫Ii·海因茨
尼古拉斯·帕特里克·维尔特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Amazon Technologies Inc
Original Assignee
Amazon Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/077,165 external-priority patent/US20150130815A1/en
Priority claimed from US14/077,180 external-priority patent/US20150133216A1/en
Priority claimed from US14/077,149 external-priority patent/US20150130814A1/en
Application filed by Amazon Technologies Inc filed Critical Amazon Technologies Inc
Publication of CN106132494A publication Critical patent/CN106132494A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/33Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
    • A63F13/335Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35Details of game servers
    • A63F13/352Details of game servers involving special game server arrangements, e.g. regional servers connected to a national server or a plurality of servers managing partitions of the game world
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35Details of game servers
    • A63F13/355Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A63F13/525Changing parameters of virtual cameras
    • A63F13/5252Changing parameters of virtual cameras using two or more virtual cameras concurrently or sequentially, e.g. automatically switching between fixed virtual cameras when a character changes room or displaying a rear-mirror view in a car-driving game
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/70Game security or game management aspects
    • A63F13/77Game security or game management aspects involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • General Business, Economics & Management (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

In some cases, one or more views presented of the scene of specific content item (such as video-game) can be generated by content supplier and from content provider server to multiple different clients.Additionally, in some cases, content supplier can use multiple Graphics Processing Unit to generate one or more view.Furthermore, in some cases, the data set synthesis individual data set that can will associate with multiple different views of scene, as presented target.

Description

Data acquisition system for multiple view generations
Cross-Reference to Related Applications
The rights and interests of the following U.S. Patent Application No. of patent application claims: the United States Patent (USP) Shen that on November 11st, 2013 submits to Please number 14/077,149;The U.S. Patent Application No. 14/077,165 that on November 11st, 2013 submits to;And November 11 in 2013 The U.S. Patent Application No. 14/077,180 that day submits to, the disclosure of these patent applications is fully incorporated herein by quoting.
Present patent application relates to following patent application, and in these patent applications, each is intactly incorporated to from there through quoting It is herein: the U.S. Patent Application No. 14/076,718 that on November 11st, 2013 submits to, entitled that " video based on region-of-interest is compiled Code " (attorney docket: 101058.000083);The U.S. Patent Application No. 14/076,821 that on November 11st, 2013 submits to, mark Entitled " quality-of-service based self adaptation scene complexity " (attorney docket: 101058.000084);On November 11st, 2013 The U.S. Patent Application No. 14/077,127 submitted to, entitled " for generating the service of graphic object data " (attorney docket: 101058.000086);The U.S. Patent Application No. 14/076,136 that on November 11st, 2013 submits to, entitled " based on the most right The image synthesis of image data " (attorney docket: 101058.000087);The U.S. Patent application that on November 11st, 2013 submits to Number 14/077,165, entitled " multiple parallel graphic processing unit " (attorney docket: 101058.0100110);2013 11 The U.S. Patent Application No. 14/077,084 that the moon 11 was submitted to, entitled " adaptive content transmission " (attorney docket: 101058.000114);The U.S. Patent Application No. 14/077,180 that on November 11st, 2013 submits to, entitled " based on shared The view generation of state " (attorney docket: 101058.000115);The U.S. Patent Application No. that on November 11st, 2013 submits to 14/077,186, entitled " multithread content presents " (attorney docket: 101058.000116);On November 11st, 2013 submits to U.S. Patent Application No. 14/077,142, entitled " streaming game server video recorder " (attorney docket: 101058.000125);On November 11st, 2013 submit to U.S. Patent Application No. 14/076,815, entitled " role's resource Position " (attorney docket: 101058.000128);The U.S. Patent Application No. 14/077,146 that on November 11st, 2013 submits to, Entitled " the session free time of streaming server optimizes " (attorney docket: 101058.000129);On November 11st, 2013 carries The U.S. Patent Application No. 14/077,023 handed over, entitled " application streaming service " (attorney docket: 101058.000139);The U.S. Patent Application No. 61/902.740 that on November 11st, 2013 submits to, entitled " high efficient band width is estimated Calculate " (attorney docket: 101058.000141).
Background technology
Some nearest technology development make the multiple clients conduct interactively with each other being positioned at multiple different remote location normal See that the part that content of multimedia is experienced becomes possibility.For example, it is possible to use different clients common at different remote locations Play some conventional video game.In some cases, each client is likely to be of and this client participant in gaming The association status information corresponding to action, event or other information associated.Such as, status information can include and particular persons Or the information of the action association of other entities execution of other relative client control.Often realize the mutual one of multiple client Rule method includes, periodically transmits game state information from each participation user end to server, server and then can be to Each client is forwarded back to the most more new state information received from other clients each.Each client can use this most more New state information safeguards their own individual game state accordingly, this individuality game state and then can be used for each visitor Presenting accordingly of video-game is presented at the end of family.Such as, the particular person that each particular clients can control from relative client The angle of thing or other entities represents the scene in video-game.
Although it is mutual that above-described routine techniques can realize multi-client, but they also can include multiple shortcoming. For example, it is desired to safeguard state at client device and present image, content on client device may be increased and present software Complexity and use requirement.This may cause providing consumption ample resources on the client device of limited function.Such as, client Equipment is often positioned the consumer of the equipment of preference reduced size, bigger portability and lower expense.Cannot be by additionally, work as More new state information is when server is effectively transmitted to multiple client, in fact it could happen that content present in time delay or in Disconnected.Furthermore, client device exists exquisiter game or the possible author producing this content of other guide and institute of retail trader The piracy paid close attention to and other safety issues.And, become more detail and complicated, the most constantly along with content item Client device including single Graphics Processing Unit cannot present this type of content the most possibly effectively.
Accompanying drawing explanation
When reading in conjunction with the accompanying, may be better understood and be described in detail below.For purposes of illustration, shown in accompanying drawing The example embodiment of many aspects disclosed by the invention;But, the invention is not restricted to disclosed concrete grammar and means.
Fig. 1 is the schematic diagram illustrating the exemplary computing system that can use in some embodiments.
Fig. 2 is the schematic diagram illustrating the exemplary computing system that can use in some embodiments.
Fig. 3 A is to illustrate the schematic diagram according to the example system for multiple view generations disclosed by the invention.
Fig. 3 B is to illustrate the schematic diagram according to the example system for identical view generation disclosed by the invention.
Fig. 4 is to illustrate the schematic diagram according to the first exemplary contents transmission system disclosed by the invention.
Fig. 5 is to illustrate the schematic diagram according to the second exemplary contents transmission system disclosed by the invention.
Fig. 6 is to illustrate the schematic diagram according to the 3rd exemplary contents transmission system disclosed by the invention.
Fig. 7 is to illustrate the schematic diagram according to the first example graph processing unit scaling situation disclosed by the invention.
Fig. 8 is to illustrate the schematic diagram according to the second example graph processing unit scaling situation disclosed by the invention.
Fig. 9 is to illustrate the schematic diagram according to the 3rd example graph processing unit scaling situation disclosed by the invention.
Figure 10 is to illustrate the schematic diagram according to the 4th example graph processing unit scaling situation disclosed by the invention.
Figure 11 is to illustrate the schematic diagram according to example disclosed by the invention splicing (stitching) technology.
Figure 12 is to illustrate the schematic diagram according to multiple exemplary layer disclosed by the invention.
Figure 13 is to illustrate the schematic diagram according to example demixing technology disclosed by the invention.
Figure 14 is to illustrate the schematic diagram according to exemplary contents provider disclosed by the invention system.
Figure 15 is to illustrate according to the example mistake generating one or more views based on shared status information disclosed by the invention The flow chart of journey.
Figure 16 is to illustrate to carry out, according to the one or more Graphics Processing Unit of use disclosed by the invention, the example mistake that presents The flow chart of journey.
Figure 17 is that diagram is according to the incompatible example system for multiple view generations of employing data set disclosed by the invention Schematic diagram.
Figure 18 is to illustrate the first sample data set according to the data including and associating with multiple views disclosed by the invention Schematic diagram.
Figure 19 is the schematic diagram that diagram represents formation sequence according to example disclosed by the invention.
Figure 20 is to illustrate the second sample data set according to the data including and associating with multiple views disclosed by the invention Schematic diagram.
Figure 21 is to illustrate according to the incompatible instantiation procedure for multiple view generations of employing data set disclosed by the invention Flow chart.
Detailed description of the invention
According to exemplary characteristics more disclosed by the invention, specific content item can be generated (as video is swum by content supplier Play) one or more views presented of scene, and from content provider server to multiple different clients.In some feelings Under condition, content supplier can generate multiple views of the scene of specific content item.Can such as by multiple views each With one or more corresponding client associate, it is possible to by it from content provider server to relative client.Such as, each View can represent the visual angle of particular persons or other entities controlled from the relative client as this view transfer destination From the point of view of scene.In some cases, the same view of the scene of specific content item can be sent to multiple by content supplier Client, such as, can be sent to same view control closely-related personage or the client of the single personage of Collaborative Control.
In order to generate one or more views of scene, in different participation clients, each can be collected accordingly Client state information.Client state information can include such as, about the information of the operation performed by relative client, As relative client control corresponding personage or other entities performed by movement or other actions.In relative client each Periodically the renewal of its relative client status information can be sent to content supplier.Then content supplier can make With the client state information received from each client more newly arrive update content provider safeguard shared content item state letter Breath.Content supplier then can use shared content item status information generate be sent to different participate in client one or Multiple views.In some cases, participate in client one or more can use mixed model to work, wherein except from Content supplier receives outside one or more views, and mixed model client also performs the their own local version of content item, and Generate their own local client stream.Then each mixed model client can originally be located in, in client, the view that will receive Content supplier's stream and the combination of local client stream are to generate and display mixed content item stream.
In some cases, content supplier can use multiple Graphics Processing Unit to generate the scene of specific content item One or more views.In some cases, multiple Graphics Processing Unit can generate the most simultaneously with one another with special Determine presenting of scene relating.Further, in some cases, use what multiple Graphics Processing Unit can help to realize to be presented to regard The generating in real time or quasi real time and present of figure.In some cases, multiple Graphics Processing Unit can each take on for generating confession The appropriate section of the scene of the one or more final view of display.In some cases, for each view, example can be passed through The expression carrying out logical combination will be presented to present group by multiple in different associated layers as being stitched together presenting or using Incompatible formation view.In some cases, the quantity of the Graphics Processing Unit for presenting specific content item can be elastic, So that this quantity changes according to many factors.This type of factor can include such as, closes with one or more Graphics Processing Unit The executions speed of connection, the complexity of scene presented and the quantity of view of scene relating presented, additional patterns process singly The availability of unit and any other correlative factor.
In some cases, multiple different views of scene can be combined into individual data set, as presented target.Example As, this type of individual data set can include that multiple segmentation, corresponding to multiple views one of each segmentation are associated.Then may be used The each segmentation of this data acquisition system is fetched separately, it is encoded and passes through network transmission.In some cases, in scene The association that each object is likely to be of moving to be formed in each segmentation of data acquisition system before next object represents.Example As, before forming the expression of second object, the reproduction of first object is probably each segmentation formation that cross datasets closes 's.In some cases, the state that this formation sequence can reduce with the data association loaded associated by each object changes, Including such as, multiple geometry, texture, coloring etc..
In some cases, content supplier can present content item view and by if the electric network of the Internet is by it It is sent to client.In some cases, such as streaming content payment technology can be used to provide content to when request Client.Will be described in detail now realization present content and be transmitted to the example computing device of client.Specifically, Fig. 1 diagram wherein can realize the example computing device of the embodiments described herein.Fig. 1 schemes in schematic form as schematic diagram Showing the example of data center 210, data center 210 can be via communication network 230 by subscriber computer 202a and 202b (this Literary composition may be referred to as computer 202 in the singular or be referred to as computer 202 with plural form) to user 200a and 200b (may be referred to as user 200 in the singular or be referred to as 200 with plural form herein) provides and calculates resource.Data center 210 can be configured to permanently or on-demand offer for perform application calculating resource.The calculating that data center 210 provides Resource can include polytype resource, such as gateway resource, load balance resource, routing resource, networked resources, calculating Resource, volatibility and non-volatile memory resource, content delivery resource, data processing resources, data storage resource, data are led to Letter resource etc..Each type of calculating resource can be general, and multiple particular configuration maybe can be used to provide.Such as, number Can provide as virtual machine instance according to processing resource, these virtual machine instance can be configured to provide multiple web services. Furthermore, it is possible to form the combination of resource for use by network, it is possible to be configured as one or more web services.This A little examples can be configured to carry out including the application of web services, such as application service, media services, database service, process clothes Business, gateway service, storage service, Routing Service, Security Service, cryptographic services, load balancing services, application service Deng.These services can may utilize setting or customized application configures, and can be at size, execution, cost, prolong Late, in type, persistent period, accessibility and configurable in any other dimension.These web services can be configured Carry out the available infrastructure for one or more clients, and may be configured to platform or be configured for one or One or more application of the software of multiple clients.These web services can be provided by one or more communication protocols. These communication protocols can include such as, HTML (Hypertext Markup Language) (HTTP) or non-http protocol.These communication protocols are all right Including such as, the transport layer protocol that reliability is higher, such as transmission control protocol (TCP), and the transport layer association that reliability is relatively low View, such as UDP (UDP).Data storage resource can include file-storage device, block storage device etc..
The calculating resource of each type or configuration can use different size to provide, as by multiple processors, great Liang Cun The large resource that reservoir and/or large storage capacity are constituted, and held by less processor, small amount memorizer and/or less storage The little resource that amount is constituted.Such as, client can select to distribute multiple little process resource as web server and/or distribution one The big resource that processes is as database server.
Data center 210 can include that server 216a and 216b of offer calculating resource (herein may be with odd number shape Formula is referred to as server 216 or is referred to as server 216 with plural form).These resources can be as bare machine (bare Metal) resource provides or (may be referred to as virtual machine instance herein in the singular as virtual machine instance 218a-d 218 or be referred to as virtual machine instance 218 with plural form) provide.Virtual machine instance 218c and 218d are to share state virtual Machine (" SSVM ") example.SSVM virtual machine instance 218c and 218d can be configured to carry out according to the present invention open and the most detailed All or any part of the thin shared content item status techniques described and/or any other disclosed technology.As should Recognize, although the particular example shown in Fig. 1 includes a SSVM virtual machine at each server, but this is only one Example.Server can comprise more than a SSVM virtual machine or can not include any SSVM virtual machine.
Intel Virtualization Technology is available for computing hardware, and this provides provides large-scale calculations resource to client and make calculating provide The benefit that source can efficiently and safely be shared between multiple clients.Such as, Intel Virtualization Technology can be by multiple users' Each user provides one or more virtual machine instance that physical computing devices deposits so that this physical computing devices can be many Share between individual user.Virtual machine instance can be to be used as Different Logic in specific physical computing systems to calculate the software mould of system Intend.This type of virtual machine instance provides the isolation sharing to determine between multiple operating systems of physical computing resources.Furthermore, some are empty Planization technology can provide the virtual resource across one or more physical resources, as having across multiple different physical computing systems The single virtual machine example of multiple virtual processors.
With reference to Fig. 1, public's addressable network of the network that communication network 230 can e.g. link and may by multiple not Run with operator, such as the Internet.In other embodiments, communication network 230 can be complete for non-privileged users Or the dedicated network of part inaccessible, such as enterprise or campus network.In other other embodiments, communication network 230 Internet access the Internet and/or the one or more dedicated networks from access to the Internet of having the right can be included.
Communication network 230 can provide the access right to computer 202.Subscriber computer 202 can be data center 210 User 200 or other clients use computer.Such as, subscriber computer 202a or 202b can be server, desktop Or laptop PC, tablet PC, radio telephone, personal digital assistant (PDA), E-book reader, game control Device processed, Set Top Box or be able to access that any other calculating equipment of data center 210.Subscriber computer 202a or 202b can be straight Receive the Internet (such as by cable modem or DSL (DSL)) in succession.Although only illustrating two users Computer 202a and 202b, but it is to be understood that multiple subscriber computer may be had.
Subscriber computer 202 can also be used to configure the many aspects of the calculating resource that data center 210 provides.With regard to this For, data center 210 can provide a mean for using the web browser application program performed on subscriber computer 202 Configure gateway or the web interface of the many aspects of its operation.Alternately, stand-alone application journey subscriber computer 202 performed Sequence can access application programming interface (API) disclosed in data center 210 and perform these configuration operations.For configuring in data Other mechanism of the operation of the multiple web services provided at the heart 210 can also be used.
Server 216 shown in Fig. 1 can be the standard clothes configured for being applicable to provide above-described calculating resource Business device, and the calculating resource for performing one or more web services and/or application can be provided.An embodiment In, calculating resource can be virtual machine instance 218.In the example of virtual machine instance, in server 216, each can be joined Put and perform to be able to carry out Instance Manager 220a or 220b of virtual machine instance 218 and (may be referred to as in the singular herein It is referred to as Instance Manager 220) for Instance Manager 220 or with plural form.Such as, Instance Manager 220 can be virtual Machine monitor (VMM) or be configured to perform on server 216 the another type of program of virtual machine instance 218. As discussed above, in virtual machine instance 218, each can be configured to carry out all or part of of application.
Should be realized that, although above-disclosed embodiment discusses the situation of virtual machine instance, but can be by other The realization of type is combined with concept disclosed herein and technology and uses.Such as, the embodiment switched herein can also be with The calculating system not using virtual machine instance combines to be used.
In the example data center 210 shown in Fig. 1, router 214 can be used mutual for server 216a and 216b Even.Router 214 may be also connected to gateway 240, and gateway 240 is connected to communication network 230.Router 214 may be coupled to One or more load balancers, and the communication that can manage alone or in combination in data center 210 in network are the most logical Cross based on this type of feature communicated (such as, including source and/or destination-address, protocol identifier, size, process requirement etc. Header information) and/or dedicated network feature (such as, route based on network topology etc.) come according to be suitable for situation forward point Group or other data communication.It will be recognized that for brevity, this example is calculated the multiple aspect of system and other equipment Carry out illustrating and certain routine techniques details not shown.Additional calculating system can be set with other in other embodiments For being interconnected, and these additional computing systems and other equipment can be interconnected in different ways.
In the example data center 210 shown in Fig. 1, also use server manager 215 to guide at least in part and send out Toward, from the multiple communication between server 216a and 216b and/or server 216a and server 216b.Although Fig. 1 illustrates Router 214 is located between gateway 240 and server manager 215, but this is only an exemplary configuration, in certain situation Under, such as, server manager 215 can be located between gateway 240 and router 214.In some cases, server admin Device 215 can check that the part of the incoming communication from subscriber computer 202 is to determine one or more applicable server 216 Receive and/or process these incoming communication.Server manager 215 can based on following many factors determine reception and/ Or process the applicable server of these incoming communications, such as the mark associated with subscriber computer 202, position or other attributes and The task of the characteristic of the task of these communication associations and the priority of the task of these communication associations and these communication associations The size of the task of persistent period and these communication associations and/or the resource of estimation use and other factors multiple.Server Manager 215 can such as be collected or Internet access associates with multiple-task by other means status information and other letters Breath, in order to such as help to manage the communication associated with this generic task and other operations.
It should be appreciated that the network topology shown in Fig. 1 has been carried out greatly simplifying and can using more networks and connection Net equipment is by multiple calculating system interconnection disclosed herein.These network topologies and equipment should for those skilled in the art It is apparent from.
It should further be appreciated that the data center 210 that Fig. 1 describes is merely illustrative and other realizations can be employed.This Outward, it should be appreciated that disclosed herein functional software, hardware or software can be used to realize with the combination of hardware.Other are real Should be apparent from referring now to those skilled in the art.It is also acknowledged that server, gateway or other calculating equipment can With include can alternately and perform functional hardware or any combination of software of described type, including and be not limited on table Type or other computers, database server, the network storage equipment and other network equipments, PDA, panel computer, cell phone, Radio telephone, beeper, electronic organisers, the Internet appliance, (such as, use Set Top Box and/or individual/digital video recorder Machine) system based on TV and include be suitable for communication capacity other consumer products multiple.Additionally, in some embodiments In, functional combination that the module of diagram is provided or can be distributed in the module added in less module.Similar Ground, in some embodiments, can not provide in illustrated module the functional of some and/or other can be had additional Functional available.
In at least some embodiment, it is achieved the some or all of clothes in one or more technology described herein Business device can include general-purpose computing system, and this general-purpose computing system includes or is configured to access addressable Jie of computer Matter.Fig. 2 illustrates the general-purpose computing system including or being configured to one or more computer accessible.Reality in diagram Executing in scheme, calculating equipment 100 includes being couple to of system storage 20 or many via input/output (I/O) interface 30 (it may be referred to as " processor 10 " in this article in the singular or claim with plural form for individual processor 10a, 10b and/or 10n For " processor 10 ").Calculating equipment 100 also includes the network interface 40 being couple to I/O interface 30.
In multiple embodiments, calculating equipment 100 can be the single processor system including a processor 10, or Multicomputer system including some processors 10 (such as, two, four, eight or other applicable quantity).Processor 10 can To be any applicable processor being able to carry out instruction.Such as, in multiple embodiments, processor 10 can be that realization is many Plant the general or flush bonding processor of any one in instruction set architecture (ISA), such as x86, PowerPC, SPARC or MIPS ISA or any other ISA being suitable for.In a multi-processor system, each processor 10 can normally but not necessarily realizes phase Same ISA.
System storage 20 can be configured to store the addressable instruction and data of processor 10.In multiple embodiments In, system storage 20 can use any applicable memory technology to realize, as static RAM (SRAM), Synchronous dynamic ram (SDRAM), nonvolatile/flash type memorizer or the memorizer of any other type.Embodiment party in diagram In case, it is achieved the function of one or more descriptions, the programmed instruction of those methods, technology and data and data described above It is shown as code 25 and data 26 are stored in system storage 20.
In one embodiment, I/O interface 30 can be configured to coprocessor 10, system storage 20 and equipment In any peripheral hardware between the I/O traffic, including via network interface 40 or other Peripheral Interfaces.In some embodiments In, I/O interface 30 can perform any required agreement, timing or other data conversion with by data signal from an assembly (such as system storage 20) is converted into and is suitable to the form that another assembly (such as, processor 10) uses.Some embodiment party In case, I/O interface 30 can include by polytype peripheral bus (such as peripheral component interconnection (PCI) bus standard Or the variant of USB (universal serial bus) (USB) standard) support of equipment that connects.In some embodiments, the merit of I/O interface 30 Can be split into two or more independent assemblies, such as, north bridge and south bridge.Further, in some embodiments, I/O connects The some or all of which of mouth 30 is functional, such as the interface to system storage 20, can be incorporated directly in processor 10.
Network interface 40 can be configured to enable data calculating equipment 100 be connected to one or more network 50 Other equipment one or more 60 (such as other calculate system or equipments) between swap.In multiple embodiments, Network interface 40 can be supported by any applicable wired or wireless general data network, as polytype Ethernet is carried out Communication.Additionally, network interface 40 can be supported by telecommunication/telephone network (such as analog voice network or digital fiber communication Network), by storage area network (such as optical-fibre channel SAN) (storage area network) or by the net of any other applicable type The communication that network and/or agreement are carried out.
In some embodiments, system storage 20 can be configured to store as described above for realizing correspondence The programmed instruction of the embodiment of method and apparatus and an embodiment of the computer accessible of data.But, In other embodiments, can receive, send or store in different types of computer accessible programmed instruction and/or Data.In general, computer accessible can include being couple to the non-transient of calculating equipment 100 via I/O interface 30 Storage medium or storage medium, such as magnetizing mediums or light medium-such as disk or DVD/CD.Non-transient computer-readable storage medium Matter can also include some realities that can be included in calculating equipment 100 as system storage 20 or another type of memorizer Execute any volatibility in scheme or non-volatile media, as RAM (such as, SDRAM, DDR SDRAM, RDRAM, SRAM etc.), ROM (read only memory) etc..Furthermore, computer accessible can include transmission medium or signal, as via communication media The signal of telecommunication, electromagnetic signal or the digital signal that (such as the network that can be realized by network interface 40 and/or wireless link) is carried. In multiple embodiments, it is possible to use the some or all of multiple calculating equipment (as shown in Figure 2 those) realizes Described is functional;Such as, the component software multiple distinct device and server run can cooperate and provide this function Property.In some embodiments, general-purpose computing system is additionally or alternatively used to realize, it is also possible to use storage to set Standby, the network equipment or dedicated computer system realize the some of described function.As used herein term " meter Calculation equipment " refer to the equipment of the most all these type and be not limited to the equipment of these types.
Calculate node (being referred to as calculating node) can realize in far-ranging multiple computing environment, as general Hardware (commodity-hardware) computer, virtual machine, web services, computing cluster (cluster) and calculating electrical equipment.Go out In convenient, may be by these calculating equipment or environment, any one is described as calculating node.
The entity organized such as company or public sector can pass through the Internet or other nets for providing to one group of scattered client One or more web services (e.g., polytype calculating based on cloud or storage) that network accesses and the network set up can claim For provider network.This type of provider network can include trustship realize and distribution provider network provide infrastructure and The mass data center in the multiple resources pond of web services, these resource pools such as physics and/or Virtualization Computer server, The set of storage device, networked devices etc..In some embodiments, can in the multiple unit relevant to web services, as For the memory capacity quantity stored, for the disposal ability processed, as an example, the services being correlated with as many groups etc. are by these Resource is supplied to client.Virtual computing example can such as include having the computing capability specified, and (this can be by instruction CPU's Type and quantity, main memory size etc. are specified) and specify software stack (such as, the operating system of particular version, enter And may operate on hypervisor (hypervisor) top layer) one or more servers.
In various embodiments, can by single for multiple different types of calculating equipment or be applied in combination with realize provide The resource of business's network, including universal or special computer server, storage device, the network equipment etc..In some embodiments, Can log in by such as giving customer administrator and password is to provide the direct access right to resource instances to client or user. In other embodiments, it is provided that business's network operator can allow client to be that the Client application specified specifies execution demand generation Manage this client and be suitable to the execution platform of these application (such as application server instance, JavaTMVirtual machine (JVM), universal or special Operating system, the platform supporting the programming (such as Ruby, Perl, Python, C, C++ etc.) of multiple explanation or compiling or high-performance meter Calculate platform) these execution applied of upper scheduling, and without the direct access instances of such as client or execution platform.Realize at some In, given execution platform can use one or more resource instances;In other realize, multiple execution platforms can be reflected It is mapped to single resource instances.
In multiple environment, it is achieved different types of virtualization calculates, storage and/or other network-accessibles functional The operator of provider network client can be allowed to subscribe with multiple resources obtaining mode or buy the access right to resource.Meter Calculate resource provider client to provide selection and start desired calculating resource, be deployed to application assembly calculate resource also Maintain the instrument of the application performed in environment.Additionally, calculate resource provider can provide the demand by application change to client Or apply the capacity requirement of change to come manually or by auto zoom quickly and simply to expand or shrink the money distributing to apply The quantity in source and the other instrument of type.The calculating resource that calculating resource provider provides can provide at discrete unit, These discrete unit are properly termed as example.Example can represent on physical server hardware platform, server perform virtual Machine example or certain combination of both.The example of polytype and configuration can be provided, including performing different operating system And/or the different size of resource of hypervisor, and there is the software application of multiple installation, when running etc. (OS).Also Can provide example in specific availability district, availability district represents such as, logic region, fault-tolerant region, data center or the end Other geographical position of layer computing hardware.Can be in availability district or cross over availability district copy instances to improve the superfluous of example Yu Xing, and can be in specific availability district or leap availability district migration example.As an example, and in availability district The delay of the client communication of particular server is likely less than the delay of the client communication with different server.Therefore, it can By example from the server migration of higher delay to the server of relatively low latency to improve overall client experience.
In some embodiments, provider network can be organized into multiple geographic area, and each region can be wrapped Include one or more availability district.Availability district (being referred to as availability container) and then one or more difference can be included Position or data center, these one or more different positions or data center are configured such that in given availability district Resource can be with the Fault Isolation in other availability districts or insulation.That is, the fault in one availability district there is no fear of Causing trouble in any other availability district.Therefore, availability distribution (profile) of resource instances is preset as independent of difference The availability distribution of the resource instances in availability district.Client can by starting multiple application example in corresponding availability district Protect their application impact from the fault of single position.Meanwhile, in some implementations, can manage in the same manner being positioned at There is provided the network connectivity of cheap and low latency (and between the resource in identical availability district between resource instances in region Network transmission can the most faster).
As described above, in some cases it may generated specific content item (such as video-game) by content supplier Multiple views presented of scene, and provide multiple different client by it from content.Fig. 3 A illustrates according to the present invention The example system of disclosed multiple view generations.As it can be seen, Fig. 3 A includes content supplier 300, its with client 310A and 310B communicates, and content supplier 300 performs content item 307.Content supplier 300 can such as provide for client (as Client 310A and 310B) provide content one or more content catering service.Content catering service may reside within one Or on multiple server.Content catering service can be telescopic, in order to meets the demand of one or more client, and can With the quantity asked based on incoming client and type to be increased or decreased on capacity.Can also be by content catering service Some migrate be placed on for requesting client postpone reduce position.Content is more fully hereinafter described Provider 300 and some of exemplary architecture.
Term content refers to any information that presents as used herein, and as used herein term content item is Refer to that any this type of can present any set of information.Such as, content item 307 can include the graphical content such as video-game.? Under certain situation, content item 307 can include that two-dimensional content, two-dimensional content the most as used refer to can be according to two-dimensional scene The content presented.Further, in some cases, content item 307 can include that three-dimensional content, three-dimensional content the most as used are The content that finger can present according to three-dimensional scenic.Two dimension or three-dimensional scenic can occupy anticipation the most physically to its logic Modeling or the region at expression place, thus, can be considered as logic by two dimension or three-dimensional scenic and reproduce.As used herein Term scene refers to generate with image and associates the expression used.Scene can such as include and the information describing this scene Or data or associated in other respects.In order to present content item 307, it is possible to use the scene associated with content item 307 is come Generate final image for display.These images can be generated by the process being commonly referred to as presenting, present can by such as, Project, reflect, illuminate, shade and other concepts combine.Image can include such as, the information associated with displayable output, as With multiple pixel value and/or the information of Attribute Association.Just as will be described below, in some cases, the image of each generation Can correspond to the particular figure of scene.
Content item 307 can be shown to user in client 310A and 310B and be otherwise presented to user. Client 310A and 310B can be via electric network (such as the Internet or another type of wide area network (WAN) or LANs (LAN)) communicate with content supplier 300.In some cases, client 310A and 310B may be physically located in the most distant Remote position.
Although Fig. 3 A illustrates two clients 310A and 310B, but can with receive the transmission corresponding with content item 307 Any amount of different client associate that participate in use disclosed technology.In some cases, the participation visitor connected One or more in the end of family can use mixed model to work, wherein except receiving one or more from content supplier 300 Outside view, mixed model client also performs the their own local version of content item 307, and generates their own local client Stream.Each mixed model client then can client originally be located in by receive view content supplier stream with this locality visitor Family end stream combination is to generate and to show mixed content item stream.Such as, mixed model can allow client good in network condition Time in addition to its local stream, also receive stream from content supplier 300, also allow for client may when network condition difference simultaneously Content supplier is not had when can provide, to be continuing with the local stream of their own.In order to be able to allow mixed model client keep it local State and the shared state synchronized of content supplier, content supplier 300 can be periodically to each mixed model client Send status information.
Some client can toggle between mixed model and full-flow mode, and in full-flow mode, client is only Receive content supplier's stream and do not generate local client stream.Therefore, in some cases it may big customer end group is safeguarded one Individual shared state.In this jumpbogroup, some clients can use mixed model to work, and some clients can use and entirely flow mould Formula works, and some clients can switch between mixed model and full-flow mode.Additionally, in some cases, send To each mixed model client data volume may and as the quality of connection between content supplier and client multiple because of Element is the most relevant, and the quality of connection between content supplier and client can be based on such as bandwidth, handling capacity, delay, packet loss Depending on Deng.Such as, for having the first mixed model client that better quality is connected with content supplier 300, content provides Business 300 can transmit the lot of complexity view of the larger data amount that includes of scene to the first mixed model client.Phase therewith Right, for having the second mixed model client that lower quality is connected with content supplier 300, content supplier 300 is permissible The lower complexity view including relatively small data quantity of scene is transmitted to the second mixed model client.Such as, first it is sent to The lot of complexity view of mixed model client can include that the lower complexity being sent to the second mixed model client regards Possible texture in greater detail not to be covered, pattern, shape and other features in figure.
Refer again to Fig. 3 A, in some cases it may by corresponding to client 310A and 310B and content item 307 Individual or multiple different corresponding entities are associated.This type of entity can include such as, multiple personage, vehicle, weapon, sports apparatus Or with any other entity corresponding to video-game or other guide item.In some cases, corresponding entity can be by them Associated client controls.However, it is possible to by such as being selected by the specific user of client or selecting to appoint for it Where formula is by corresponding entity and client associate.In the particular example of Fig. 3 A, client 310A controls corresponding controlled personage 315A, and client 310B controls corresponding controlled personage 315B.
Client 310A and 310B can collect and corresponding to content item 307 at client 310A and 310B present association Relative client status information.Client state information is owing to content item is relevant to one or more clients by any way Time any information of the state relation with content item.Client state information can include such as, client 310A and 310B Locate the information corresponding with the state presenting associated various features, event, action or operation of content item 307.In some feelings Under condition, client state information may indicate that the various motion or operation that controlled personage 315A and 315B perform.It is noted, however, that The client state information that each client 310 is collected is not limited to personage or other realities controlled with each relative client 310 The information that body is corresponding, and the information corresponding to any aspect associated with content item 307 can be included.
As shown in Figure 3A, its relative client state information updating 320A can be sent to content by client 310A provides Business 300, and its relative client state information updating 320B can be sent to content supplier 300 by client 310B.Permissible Periodically transmit client state information by any applicable plan or the unplanned time from client 310A and 310B to update 320A and 320B.For example, it is possible to by the interval specified or other times or respond some event transmit client state information more New 320A.For example, it is possible to performed action by personage, trigger as moved on to the position specified client state information update 320A and The transmission of 320B.Do not require that sending client state information the most simultaneously with each other updates 320A and 320B.As recognizing Knowledge is arrived, and in some cases, has updated client state information alternatively or additionally as transmitting, client 310A and 310B In one or more can transmit whole client state information and/or certain portions of client state information previously transmitted Point.Such as, in some cases, include that all client states are believed from the first time transmission of the status information of particular clients Breath, and subsequent transmission can only include updating or update certain part together with the previously information of transmission.
Content supplier 300 can receive client state information and update 320A and 320B, and uses these tune of more newly arriving Whole shared content item status information 305.This adjustment can include such as, adds, deletes and/or revise shared content item state letter Multiple different pieces of breath 305.Then can such as use shared content item status information 305 to combine with content item 307 to produce Raw one or more content item scenes.
As example, controlled personage 315A may open the weapon loaded and towards specific gateway emission bullet, and controlled people Thing 315B may simultaneously enter same gateway and in the face of controlled personage 315A.Client 310A can send client state letter Breath updates 320A, and it may indicate that controlled personage 315A opens fire and the direction of bullet.Client 310B can send client State information updating 320B, it may indicate that controlled personage 310B moves and enters gateway.Content supplier 300 can update altogether Enjoy client state information renewal 320A and 320B that content item status information 305 receives with instruction.Content item 307 is the most permissible The shared content item status information 305 of access is to produce subsequent content item scene, and the most controlled personage 315B stands in gateway and son Bullet wound and chest thereof, and controlled personage 315A from the position that controlled personage 315A opens fire towards gateway.
Once produce scene with content item 307, then content supplier 300 can present scene in client 310A Show with at 310B.In the particular example of Fig. 3 A, content supplier 300 generates multiple view 330A and 330B presented.Example As, as shown in Figure 3A, content supplier 300 can generate the view 330A presented and send it to client 310A, simultaneously Content supplier 300 can also generate the view 330B presented and send it to client 310B.The view 330A presented and 330B is different from each other.As used herein term, view refers to the specific image with scene relating.When generating spy When determining multiple different views of scene, each in these multiple different views can include the difference generated based on this scene Respective image.
In some cases, can be by view 330A and 330B presented and associated by client 310A and 310B Or multiple corresponding entity is associated.For example, it is possible to the view 330A presented is associated with controlled personage 315A, and by regarding of presenting Figure 33 0B associates with controlled personage 315B.
In some cases, view 330A with 330B presented can present in scene from corresponding to the corresponding entity associated The view at visual angle.Such as, the view 330A presented can illustrate such as the scene of the eye observation by controlled personage 315A, And the view 330B presented can illustrate such as the scene of the eye observation by controlled personage 315B.In other cases, in The view of scene can be presented such that the corresponding entity of association is positioned at the center of view by existing view 330A and 330B, or separately There is in being located at outward view high concern and/or high visual position.Exception, the view 330A presented can illustrate a scene, It makes controlled personage 315A be positioned at the center of view, and the view 330B presented can illustrate a scene, and it makes controlled people Thing 315B is positioned at the center of view.As another example, if some object in scene blocks the corresponding entity of association View, then can remove these objects or be additionally adjusted it in the view presented from the view presented.
In addition, in some cases it may add some amendment or additionally some amendment closed with the specific view presented Connection.Such as, in order to attract attention or improve visuality, can amplify or highlight corresponding personage or other realities of association Body.Furthermore, if other entities of some in view are to a certain degree less than corresponding personage or the entity associated of particular association, then may be used To revise these entities.Such as, if the corresponding personage of association is searching specific weapon, then in order to attract the attention to weapon Or increase the visuality of this weapon, can amplify in the view presented or highlight this weapon.
Refer again to controlled personage 315A mentioned above after gateway is opened fire, observe the exemplary scene of gateway, visitor The view 330A presented of family end 310A such as can provide view from the visual angle associated with controlled personage 315A.The view presented 330A can such as illustrate such as the exemplary scene being visually observed by controlled personage 315A.Thus, the view presented 330A can such as illustrate that controlled personage 315B stands in gateway and bullet wound and chest thereof, as controlled personage 315A is seen 's.
In contrast, the view 330B presented of client 310B such as can provide from the visual angle of controlled personage 315B and regard Figure.As described above, in this exemplary scene, controlled personage 315B stands in gateway towards the controlled personage just now opened fire 315A.The view 330B presented can such as illustrate such as the exemplary scene being visually observed by controlled personage 315B.By This, the view 330B presented can such as illustrate controlled personage 315A, and its hand-held weapon just now opened fire, as controlled personage 315B is seen.
In some cases, client state information renewal 320A and 320B can include can be used for helping formation to present Any information of view 330A and 330B.This type of information can include or many that instruction associates with client 310A and 310B The information of individual corresponding entity.Such as, Fig. 3 A is shown as the controlled personage of the corresponding entity associated with client 310A and 310B 315A and 315B.Client state information updates 320A and 320B and also can indicate that for example, it is possible to any mode and client Any other entity that 310A with 310B is relevant.Client state information update 320A and 320B also can indicate that for example whether visitor Family end 310A and 310B switches multiple personage or the control of view or is connected with participant or port in content transmission session.Visitor Family end state information updating 320A and 320B also can indicate that for example whether each mixes in client 310A and 310B Work under MODE of operation or full-flow mode and/or indicate the switching between the work under this quasi-mode.Can also will can be used for Help any other information being suitable for forming view 330A and 330B presented to be included in client state information and update 330A With in 330B, it is included in any other information aggregate being sent to content supplier 300, or in some cases, including Store or in the information that otherwise provides in content supplier 300.Such as, in some cases, content supplier 300 can Include such as with memorizer about client 310A and the information of 310B, this information, the personage that client 310A and 310B control Or any other information being suitable for indicating or can be used for view 330A and 330B helping formation to present of other entities.One In the case of Xie, the information that can be used for helping to form view 330A and 330B presented can be included in shared content item state letter In breath 305.
Thus, as described above, content supplier can present multiple views of content item, and send it to multiple not Same client device.But, in some cases, it can be possible to the same view of scene is sent to multiple client and sets by expectation Standby.For example, it may be desired to same view to be sent to there is the respective content item entity of identical or closely-related association not Same client.More specifically, such as, there may come a time when is sent to cooperate by same view controls the difference of identical personage together Client.As another example, there may come a time when to be sent to same view control different but closely-related personage (as identical Unit or the team member of tissue or member) different clients.As another example, when one or more clients are with onlooker Pattern work and other clients one or more when working with activity pattern, may transmit same view, in onlooker's pattern In, onlooker's client does not control any entity in content item, in an active mode, they control in content items or Multiple entities.In some cases, wherein one or more of onlooker's pattern client can receive same view.Further, In some cases, wherein one or more of wherein one or more or activity pattern client of onlooker's pattern client Same view can be received.Such as, the special entity that specific activities pattern client is controlled by specific onlooker's pattern client Interested, and therefore it may be desirable to receive the identical view being sent to this specific activities pattern client.It is also based on appointing Reason that what he is suitable for or principle are to transmit same view.
Fig. 3 B illustrates the example system according to multiple view generations disclosed by the invention.In figure 3b, client 310A Control its corresponding controlled team member 316A, and client 310B controls its corresponding controlled team member 316B.The most as shown in Figure 3 B, content carries Generate the same view 340 presented for business 300, and send it to client 310A and 310B simultaneously.As described above, Under certain situation, client receives the same view of scene it may be desirable to control team member.It is noted, however, that in the case of having many, control The client of team member processed is it may be desirable to receive different views.As mentioned above, as controlling supplementing or alternative of team member, may Also have other situations multiple, client 310A and 310B may receive same view.
It is also noted that identical and different views any combination can also be generated, and send it to any amount of Different clients.Halogen meat, for being sent to three content items participating in client, two in three clients can connect Receive same view, and the 3rd client can receive different views.
Furthermore, it is noted that the configuration receiving the client of identical or different views can pass in whole specific content item Transfer session changes.Such as, two clients may initially control two team members, and may receive the same of specific content item View.But, at certain time point that this content item transmits, one of client may abandon the control of its personage, and starts control The different personages of opposing teams processed.In the case, after the control of switching personage, switching client can start to receive with another The different view that one client transmits.As described above, in some cases, personage or any other view are correlated with The switching of information can as client state information update a part or use any other be suitable for technology from client It is sent to content supplier.
Furthermore, it is noted that not necessarily ad hoc to specify any particular clients to receive view different from each other or same View.On the contrary, in some cases, the view of each client can be based on the information with this client associate, as corresponding real Body or any applicable information generate.Therefore, in some cases, two clients can receive the different of some scenes View, and other scenes same or close to same view, and not necessarily these views are appointed as similar or complete phase With.Such as, in some cases, two different clients control two uncorrelated personages are it may happen that in special scenes Each other position very close to, in such cases, sometimes can be sent to by the same of this special scenes or close to same view The client that the two is different.In contrast, other scenes being not very close to each other for two uncorrelated personages are identical The two client can receive different views.
Thus, foregoing illustrate for presenting one or more view based on shared status information at content supplier Multiple technologies.In some cases, at content supplier, present one or more view to reduce state letter or remove from Breath is sent to any needs of client from content supplier.Additionally, in some cases, at content supplier, one is presented Or multiple view can reduce the content installed on client device and present the cost of software, complexity and use requirement.Sometimes, This can such as make content that thin-client can be used to present software to present on a client device, and described thin-client presents Software is for Fat Client presents software.Furthermore, in some cases, at content supplier, present one or many Individual view can reduce the wound author of content and retail trader is paid close attention to piracy and other safety issues.
Furthermore, it is noted that for performing the virtual machine instance of content item and/or the quantity of other resources or amount without necessarily taking Certainly in the quantity of the view generated with content item association.Such as, in some cases it may use single virtual machine example to hold Row has the view that multiple difference presents and is sent to the content item of multiple different clients.But, in some cases, if the phase Prestige can use multiple virtual machine instance, in order to such as reduces delay.
As presenting supplementing of one or more view at content supplier, technology disclosed by the invention can also allow for Associate with specific content item and use multiple Graphics Processing Unit.In some cases, multiple Graphics Processing Unit can be at least What generation associated with special scenes the most simultaneously with one another presents.Present and refer at least in part by one or more graphics process That unit generates and with one or more images at least some of data associated.Further, in some cases, use multiple Graphics Processing Unit can help the generating in real time or quasi real time and present of view realizing being presented.In some cases, many Individual Graphics Processing Unit can be distributed over any amount of different machines of any amount of different physical locations or set Standby upper.In some cases, it is possible to use multiple Graphics Processing Unit only present a view of scene, and in other feelings Under condition, it is possible to use multiple Graphics Processing Unit present multiple views of scene.It is noted, however, that not necessarily need multiple Graphics Processing Unit presents multiple views of scene.In some cases, a Graphics Processing Unit can be enough in scene Multiple views of scape.
Fig. 4-6 illustrates multiple mutual one between multiple view and the above-mentioned concept of multiple Graphics Processing Unit A little exemplary contents transmission systems.Specifically, Fig. 4 illustrates the example feelings using single Graphics Processing Unit to generate multiple views Shape.As shown in Figure 4, content supplier 400 includes Graphics Processing Unit 403A, and Graphics Processing Unit 403A generates the view presented 420A, 420B and 420C, view 420A, 420B and 420C of presenting are respectively transmitted to client 410A, 410B and 410C.Fig. 5 The illustrative case using multiple Graphics Processing Unit to generate single view is shown.As it is shown in figure 5, content supplier 500 includes figure Shape processing unit 503A, 503B and 503C, Graphics Processing Unit 503A, 503B and 503C are combined the view presented with generation 520A, the view 520A presented are sent to client 510A.Fig. 6 illustrates that the multiple Graphics Processing Unit of employing generate multiple views Illustrative case.As shown in Figure 6, content supplier 600 includes Graphics Processing Unit 603A, 603B and 603C, graphics process list Unit 603A, 603B and 603C are employed to generate view 620A, 620B and the 620C presented, view 620A, 620B of presenting and 620C is respectively transmitted to client 610A, 610B and 610C.In some other example arrangement, each Graphics Processing Unit 603A-C can generate the view 620A-C presented accordingly.Such as, Graphics Processing Unit 603A can generate the view presented 620A, Graphics Processing Unit 603B can generate the view 620B presented, and Graphics Processing Unit 603C can generate and present View 620C.In still other situations, two or more in Graphics Processing Unit 603A-C can be combined with life Become in the view 620A-C that presents is one or more.Such as, Graphics Processing Unit 603A and 603B can be combined with shape Become view 620A and 620B presented, and Graphics Processing Unit 603C can be separately generated the view 620C presented.
Any amount of applicable technology can be used to be distributed in multiple Graphics Processing Unit presenting of scene.Example As, in some cases it may by multiple Graphics Processing Unit, each is specified in the appropriate section of scene for presenting. Each part of scene can include such as, by the region indicated by multiple coordinate, dimension or other designators in scene.Example As, in some cases, it is distributed in the scene in two Graphics Processing Unit and can be divided into the half of two equivalent size, Be designated in two Graphics Processing Unit corresponding one of every half.
As another example, scene can include multiple object, as personage, building, vehicle, weapon, trees, water, Fire, animal and other.In some cases, can each in multiple Graphics Processing Unit be specified in scene is corresponding The set of object, a part for object or object is for presenting.As used herein term object refer to scene, image or Any part of other information aggregates.Object can be such as, specific pixel or collection of pixels.Object can be the most specific to have With the whole or any part of thing.Object can also is that such as, the whole or any part of the set of useful thing.Object is also Can be such as, the whole or any part of Ru Shu, fire, water, cloud, clothes, people, animal and other entity.Such as, object can To be a part for tree, object can also include such as, whole or any portions of the set of object, entity and/or useful thing Point.Such as, object can be multiple trees or the group of cloud being located at any position the most toward each other.
As another example, if generating multiple views of scene, the most in some cases, can be by multiple figures In shape processing unit, each is specified in one or more corresponding views of scene for presenting.Can use above-described Presenting of scene is distributed in multiple Graphics Processing Unit by any combination of example technique and/or any other applicable technology.
In some cases, the quantity of the Graphics Processing Unit for presenting specific content item can be elastic, so that This quantity changes according to many factors.This type of factor can include, such as, Graphics Processing Unit generates the speed or one presented The complexity of the scene that other of individual or multiple Graphics Processing Unit perform speed, present and the view of scene relating presented Any combination of quantity, the availability of additional patterns processing unit and these or other correlative factor.
In some cases, can monitor and holding of presenting one or more Graphics Processing Unit that specific content item associates Scanning frequency rate is to determine the efficiency that these Graphics Processing Unit are carrying out.Such as, in some cases, if graphics process list Unit performs speed less than certain threshold value and presents the some of multiple scene or scene, then may decide that increase by or many Individual additional patterns processing unit helps to present these parts of these scenes or scene.In contrast, in some cases, as Really two or more Graphics Processing Unit are presenting the some of multiple scene higher than certain threshold value execution speed, then may be used One or more with determine to abandon in these Graphics Processing Unit, in order to they can be used for helping other guide item or content to carry For business's task.
There is multiple factor may affect the pixel rate of one or more Graphics Processing Unit.One this type of example factor can To be scene complexity.Such as, in some cases, the scene complexity associated with specific content item is such as from a field Scape changes to next scene.Any amount of different factor all may cause this type of change in scene complexity.One In the case of Xie, some object or the some of object can be added remove it or otherwise adjust, it is hidden Or it is allowed to visible.Such as, when some personage, building, vehicle or other objects being added in subsequent scenario, scene is complicated Spend and increase to next scene such as from a scene.In some cases, when scene complexity increases, one or Multiple Graphics Processing Unit may become overload so that they are no longer able to present its corresponding scene or scene parts efficiently. In contrast, in some cases, when scene complexity reduces, one or more Graphics Processing Unit can obtain additional Active volume so that the quantity of the Graphics Processing Unit for presenting this content item can merge and be reduced.
The another kind of example factor of the execution speed that may affect one or more Graphics Processing Unit is different from multiple The quantity of the view of some associations of scene or scene.Such as, the personage controlled when one or more clients enters field During the specific part of scape, the quantity of the view of this partial association with scene may increase.Such as when one or more clients When the personage controlled enters the room in specific buildings or building, in fact it could happen that this situation.In contrast, when one or many When the personage that individual client controls leaves the specific part of scene, the quantity of the view of this partial association with scene may subtract Few.In some cases, when the quantity of view increases, one or more Graphics Processing Unit may become overload so that it Be no longer able to present its corresponding scene or scene parts efficiently.In contrast, in some cases, subtract when the quantity of view Time few, one or more Graphics Processing Unit can obtain additional active volume so that for presenting the figure of this content item The quantity of processing unit can merge and be reduced.
Describe and illustrate some of some of them of above-mentioned Graphics Processing Unit scaling concept by combining Fig. 7-10 and show now Example situation.Specifically, Fig. 7 diagram is according to the first example graph processing unit scaling situation of presently disclosed techniques.Specifically For, Fig. 7 illustrates the scene 700 that single Graphics Processing Unit 720 presents.Noting, scene 700 is shown in Figure 7 for three dimensional field Scape (as indicated by its stereogenic).But, technology disclosed by the invention is not limited to be utilized in conjunction with three-dimensional scenic, and Also to be utilized in conjunction with such as two-dimensional scene.Fig. 7 indicating graphic processing unit 720 performs speed work less than lower threshold Make.As described above, this lower limit execution speed is likely due to multiple factor and causes, as the highest in scene complexity and/or tool There is the view of too many association so that cannot be presented by single Graphics Processing Unit 720 efficiently.Correspondingly, in certain situation Under, content supplier can perform speed work it is determined that use attached based on Graphics Processing Unit 720 less than lower threshold Add Graphics Processing Unit to present subsequent scenario.
Fig. 8 illustrates that content supplier's Graphics Processing Unit based on Fig. 7 is increasing less than lower threshold execution speed work Add the situation of additional patterns processing unit 720.Specifically, Fig. 8 illustrates that scene 800, scene 800 are that the scene 700 of Fig. 7 is follow-up One or more scenes.Scene 800 is divided into two scene parts 810A and 810B.Additionally, presenting of scene 800 is divided Cloth is in two Graphics Processing Unit 820A and 820B.Specifically, scene parts 810A by Graphics Processing Unit 820A come in Existing, and scene parts 810B is presented by Graphics Processing Unit 820B.Note, select rectangular shape scene parts 810A and 810B is merely for descriptive purpose and without limitation.Can become to have any by scene partitioning according to technology disclosed by the invention The difformity of quantity or any amount of different piece of size.It is also noted that when increasing additional patterns processing unit, not Require certain half that the some of previous scene is divided into equivalent size.
Fig. 8 indicating graphic processing unit 820A just performs to work between speed in the upper limit and lower threshold.At figure Reason unit 820A works between the upper limit and lower threshold, and in some cases, content supplier may determine that for scene portion The Graphics Processing Unit dividing 810A scales without any change.By contrast, to go back indicating graphic processing unit 820B the lowest for Fig. 8 Speed work is performed in lower threshold.Correspondingly, in some cases, content supplier can be based on Graphics Processing Unit 820B Less than lower threshold perform speed work and it is determined that use additional patterns processing unit present in subsequent scenario with field The region that scape part 810B is corresponding..
Fig. 9 illustrates that content supplier's Graphics Processing Unit 820B based on Fig. 8 is less than lower threshold execution speed work Increase the situation of additional patterns processing unit.Specifically, Fig. 9 illustrates that scene 900, scene 900 are that the scene 800 of Fig. 8 is follow-up One or more scenes.Scene 900 is divided into scene parts 910A, 910B and 910C.Additionally, scene 900 present by It is distributed on three Graphics Processing Unit 920A, 920B and 920C.Specifically, scene parts 910A is by Graphics Processing Unit 920A presents, and scene parts 910B is presented by Graphics Processing Unit 920B, and scene parts 910C is by graphics process list Unit 920C presents.Noting, scene parts 910B and 910C is by the scene parts 810B of Fig. 8 is divided into two equal one Half is partly formed.Divide scene parts 810B and be because its respective graphical processing unit 820B less than lower threshold execution Speed works.
Fig. 9 indicating graphic processing unit 920A just performs to work between speed in the upper limit and lower threshold.At figure Reason unit 920A works between the upper limit and lower threshold, and in some cases, content supplier may determine that for scene portion The Graphics Processing Unit dividing 910A scales without any change.By contrast, Fig. 9 goes back indicating graphic processing unit 920B and 920C The most perform speed work higher than upper limit threshold.As described above, these upper limits perform speed be likely due to multiple because of Element causes, as view that is relatively low with the scene complexity that corresponding scene parts 910B and 910C associates and/or that present quantity relatively Low.Correspondingly, in some cases, content supplier can be based on Graphics Processing Unit 920B and 920C higher than upper limit threshold Perform speed work and it is determined that use less Graphics Processing Unit to present in subsequent scenario with scene parts 910B and The combination zone that 910C is corresponding.
Figure 10 illustrates that content supplier's Graphics Processing Unit 920B based on Fig. 9 and 920C are performing speed higher than upper limit threshold Rate works and removes the situation of Graphics Processing Unit.Specifically, Figure 10 illustrates that scene 1000, scene 1000 are the scenes of Fig. 9 900 follow-up one or more scenes.Scene 1000 is divided into two scene parts 1010A and 1010B.Additionally, scene 1000 present is distributed on two Graphics Processing Unit 1010A and 1010B.Specifically, scene parts 1010A is by figure Processing unit 1020A presents, and scene parts 1010B is presented by Graphics Processing Unit 1020B.Note, scene parts 1010B is to be formed by scene parts 910B and 910C of Fig. 9 is combined into single part.By scene parts 910B and 910C combination is because their respective graphical processing unit 920B and 920C and performs speed work higher than upper limit threshold.? Use the combination of scene parts 910B and 910C that two Graphics Processing Unit 920B or 920C can be enable to be weighed under certain situation Newly specified to another task that additional patterns processing unit may be had greater demand.
Again, it is to be noted that the scene parts shown in Fig. 7-10 and Graphics Processing Unit distribution are only examples.Disclosed by the invention Technology can make scene can become some with the model split of any description.Technology disclosed by the invention also can make graphics process list Unit can be distributed on multiple scene or multiple scene parts in the way of any description.
As should be appreciated, may have under certain situation, even if one or more Graphics Processing Unit is under being less than Limit threshold value performs speed work, it would still be possible to do not have additional patterns processing unit to use.This is likely to be due to be available for content supplier makes Resource-constrained.In the case, for example, it is possible to the request of one or more additional patterns processing units is placed in for Obtain when additional patterns processing unit becomes available in the queue of additional patterns processing unit.Additionally, for example, it is possible to based on multiple Factor determines that the urgency of request, such as less than lower threshold perform the degree of speed.In some cases, there is the most urgent being essential Ask and/or the minimum content item associating execution speed can receive quickly than the other guide item of non-very urgent needs and recently may be used Resource.Further, in some cases, when content item waits the resource of added requirement, can existing by this content item The Graphics Processing Unit specified is rearranged or is additionally redistributed efficiently to present content item scene.
Although the some of them of example above potentially include minimizing graphics process and perform speed to realize Graphics Processing Unit Scaling, it is noted that technology disclosed by the invention does not requires and is not limited to use Graphics Processing Unit to monitor.On the contrary, can use Any applicable technology determines the desired amt of the Graphics Processing Unit that scene to be used for presents.Such as, in some cases, Can be based at least partially on scene complexity information to determine the quantity of Graphics Processing Unit, scene complexity information can be with example As associated with specific content item and may indicate that, multiple different piece of the one or more scenes with this content item association is closed The complexity level of connection.In addition, in some cases it may participate in the transmission of specific content item at least partially through supervision The quantity of client and/or supervision or be otherwise determined that transmission with specific content item associates the quantity of the different views presented Determine the quantity of Graphics Processing Unit.Further, in some cases, can be based at least partially on particular content provider or Any client associated with content supplier or the ad hoc rule of other entity setting ups or preference are to determine Graphics Processing Unit Quantity.Any combination of these or other applicable technology can also be used.
Although it is one or more that the some of them of these example graph processing unit distribution techniques potentially include scene Part is specified in single Graphics Processing Unit, but not necessarily each part of scene is specified in one and only one figure Shape processing unit is for presenting.In some cases, multiple Graphics Processing Unit can cooperate and present complete field together Scape or any part of scene.
Thus, describe in detail above for be distributed in multiple Graphics Processing Unit multiple of presenting of scene is shown Example technology.In some cases, after multiple Graphics Processing Unit present the different piece of scene, can by multiple difference in Existing all or some combinations are to form one or more final views for transmission and display.Content supplier is permissible Multiple technologies are used to be combined into each view for by presenting of receiving from multiple Graphics Processing Unit.A kind of example combination skill Art, is referred to herein as splicing, can include being inserted in view multiple the presenting from different graphic processing unit In different identified areas.It is inserted in the first mark view for example, it is possible to present the first of the first Graphics Processing Unit execution At region, the second of second graph processing unit execution can be presented simultaneously and be inserted at the second mark view area.Permissible Coordinate based on the scene identity generating view is such as used to identify each view area.
The example illustrating splicing in Figure 11 describes.Specifically, Figure 11 illustrates four different graphic processing units Four of 1120A-D generation present 1130A-1130D.Specifically, present 1130A and generated by Graphics Processing Unit 1120A, in Existing 1130B is generated by Graphics Processing Unit 1120B, presents 1130C and is generated by Graphics Processing Unit 1120C, and presents 1130D Generated by Graphics Processing Unit 1120D.As shown in figure 11, in order to form view 1150,1130A will be presented and be inserted into view area In 1140A, 1130B will be presented and be inserted in view area 1140B, will present 1130C be inserted in view area 1140C and 1130D will be presented be inserted in view area 1140D.
Another kind of example combination technology, referred to herein as demixing technology, can use the view with multiple layers to represent.Table The each layer shown can correspond to the appropriate section of view.Such as, ground floor can include what the first Graphics Processing Unit presented The Part I of view, and the second layer can include the Part II of view that second graph processing unit presents.Specifically, Figure 12 illustrates four layers 1260A, 1260B, 1260C and 1260D.Layer 1260A include from Graphics Processing Unit 1220A receive in Existing 1230A.Layer 1260B includes presenting 1230B from what Graphics Processing Unit 1220B received.Layer 1260C includes from graphics process list What unit 1220C received presents 1230C.Layer 1260D includes presenting 1230D from what Graphics Processing Unit 1220D received.
The example illustrating demixing technology in Figure 13 describes.Specifically, it is shown that logical expressions 1300, its middle level 1260A-D Logically being expressed as being positioned at bottom with layer 1260D, layer 1260C is second relative to bottom, and layer 1260B is the 3rd from bottom And layer 1260A is positioned at the superiors and carrys out vertical stacking and note, logical expressions 1300 are not meant to be self physics of layer 1260A-D The physical arrangement of stacking.On the contrary, logical expressions 1300 be only intended to instruction can be by the number corresponding with multiple different pieces of view Logical expressions according to the way of example associated in logic.Moreover, it should be appreciated that the sample order that the layer shown in Figure 13 is arranged is only It is in order at illustrative purpose and unrestricted provides.Referring again to Figure 13, it is shown with logical expressions 1300 generation and includes Present the final view 1350 of 1230A-D.
Thus, foregoing illustrate for using one or more Graphics Processing Unit to generate one or more views of scene Multiple technologies.Exemplary contents provider system according to technology disclosed by the invention shown in Figure 14.As it can be seen, Figure 14 bag Include client 1410A-C communicated with content supplier 1400.Client 1410A-C can respectively participate in specific content item The transmission session of (such as video-game).Client 1410A-C can such as include active client and onlooker's client.Movable Client is to control the one or more personages in content item or the client of other entities.Onlooker's client be do not control in Hold any personage in item or the client of other entities.Client 1410A-C is respectively from three streaming server 1450A-C Respective streams transmission server receive the transmission of content item view presented.However, it is noted that, although the particular example of Figure 14 is wrapped Include streaming server 1450A-C, but technology disclosed by the invention is not limited to use streaming content transmission, and can adopt Content delivery by any other applicable form.Single respective streams transmission server 1450A-C is used content to be transferred to Each client 1410A-C is probably useful, such as, because in some cases, so improve property ground can based on such as with Be connected to the network associate of each client service quality multiple because of usually adjust to individual customer end multiple transmission spy Levy.The transmission feature adjusted can include such as, code rate, transmission speed, picture quality and other correlative factors.But, Noting, technology disclosed by the invention is not limited to use streaming technology or use single server to come to client transmissions.Phase Instead, multiple servers can be used to transmit to any amount of different clients according to the technology of the present invention.
Each in client 1410A-C periodically can send client state information to content supplier 1400 Update.In some cases, content supplier 1400 only can not receive state from onlooker's client from active client Information.As described above, client state information updates and can include such as, presents with at each client 1410A-C Various features, event, action or the information of operation correspondence associated by content item.Such as, client state information updates permissible Instruction client 1410A-C control personage or other entities perform various motion or operation.As another example, client End state information updating can include any information that can help to generate one or more views of scene, such as client control Personage or the instruction of other entities.About controlling to be switched to the information of another personage or entity from a personage or entity And the information disconnected that connects or connect about client forms the participation of content transmission session.Client state information updates Also can indicate that in such as client 1410A-C, each is to work the most in a hybrid mode or work under full-flow mode And/or indicate the switching between the work under this quasi-mode.
Receive, by input chain of command 1480, the client state transmitted from client 1410A-C at content supplier 1400 Information updating.The status information received from each client 1410A-C can be used uniformly to adjust the content transmitted The shared status information 1470 of item.Adjustment can include such as, adds, deletes and/or revise shared status information more than 1470 Individual different piece.As described above, can be multiple interior to produce with the incompatible use of groups of content items by shared status information 1470 Hold item scene.Also as described above, can be each interior to produce with the incompatible use of groups of content items by shared status information 1470 Hold one or more views of item scene.
Then by Graphics Processing Unit set 1490, each content item scene can be rendered into one or more view, figure Shape processing unit set 1490 can include one or more Graphics Processing Unit 1403A-C.For indicating graphic processing unit Set 1490 can include one or more Graphics Processing Unit, and Figure 14 illustrates a Graphics Processing Unit with solid border 1403B, and with dotted border, remaining Graphics Processing Unit 1403A and 1403C are shown.In some cases, at multiple figures Reason unit 1403A-C can be distributed over any amount of different machines or the equipment of any amount of different physical locations On.Can be at least partially determined by Graphics Processing Unit scaling assembly 1460 and associate the figure used with specific content item The quantity of reason unit 1403A-C.As described above, in some cases, for presenting the graphics process list of specific content item The quantity of unit can be elastic, so that this quantity can change for different scenes or come more by any applicable interval Change.Suitable number of multiple example technique for determining Graphics Processing Unit to be used is described in detail above.
In some cases, Graphics Processing Unit scaling assembly 1460 can monitor Graphics Processing Unit 1490, command diagram Shape processing unit 1490 with otherwise communicate with Graphics Processing Unit 1490.As described above, such as, graphics process list Unit's scaling assembly 1460 monitors that multiple live load, active volume, Graphics Processing Unit generate the speed presented and other perform Speed and any other the applicable feature associated with Graphics Processing Unit 1403A-C.In some cases, Graphics Processing Unit Scaling assembly 1460 can also be with input chain of command 1480, shared status information 1470, plurality of kinds of contents item and other assemblies multiple Communication, in order to determine the quantity of view such as scene complexity, the client of connection and association, the content supplier of association or visitor Family rule or the information of preference and any other relevant information.In the particular example of Figure 14, Graphics Processing Unit scaling assembly 1460 are included in input chain of command 1480, but, in some cases, Graphics Processing Unit scaling assembly 1460 can be Individually assembly or the part as other assemblies one or more include.
In some cases, in order to determine the quantity of the Graphics Processing Unit 1403 that participation is presented specific content item, figure Shape processing unit scaling assembly 1460 is it may also be determined that scene presents how total load is distributed at the participation figure of all quantity On reason unit 1403.Such as, Graphics Processing Unit scaling assembly 1460 can specify one or more special pattern processing unit To present multiple specific parts of scene.Shown in Fig. 7-10 and hereinbefore describe in detail several scenes part many Some example distribution on individual different graphic processing unit.As described above, in some cases it may specify one or many Individual Graphics Processing Unit presents the specific dimension of scene or coordinate, the particular figure of scene and/or such as personage, building, car , weapon, tree, water, fire, animal and other one or more scenario objects.In some cases, as Graphics Processing Unit Supplementing or alternative of scaling assembly 1460, can be by such as other groups of wherein one or more of Graphics Processing Unit 1403A-C Any other assembly shown in part or Figure 14 or other assemblies are made all or some Graphics Processing Unit and are presented distribution and determine.
As described above, the most one or more Graphics Processing Unit 1403A-C present multiple difference portions of scene Point, then multiple differences can be presented combination to form one or more final view.In some cases, can be by figure Manage wherein one or more of unit 1403A-C and/or performed, by any other applicable assembly, the combination that these differences present. Figure 11-13 diagram and describing in detail above for by be combined multiple of presenting from multiple Graphics Processing Unit Example technique.
Any can provide streaming server 1450A-C by one or more views presented to corresponding visitor Family end 1410A-C transmits.Before being transmitted, multiple operation can be performed with preparation for the view presented transmitted, such as coding And compression.These multiple operations can be performed by the assembly in streaming server 1450A-C or other assemblies multiple.
As described above, in some cases, client 1410A-C can receive specific field more at least within The different views of scape.Further, in some cases, client 1410A-C can receive special scenes more at least within Same view.Such as, client 1410A and 1410B can receive the same view of scene, and client 1410C can connect Receive the different views of same scene.
Figure 15 is to illustrate according to the example mistake generating one or more views based on shared status information disclosed by the invention The flow chart of journey.At operation 1510, initiate content item transmission session.In some cases, content item transmission session can be Initiate based on the one or more requests from one or more participation client devices.Participating in client device can be with example As, including any client device of the one or more transmission received with content item association.Participate in client can such as wrap Include active client and onlooker's client.Active client is to control the one or more personages in content item or other entities Client.Onlooker's client is not control any personage in content item or the client of other entities.As explaining above State, it is possible to use transmission of multimedia streams or any other content delivery technology being suitable for transmit content item.
At operation 1512, by content supplier from wherein one or more the reception client shapes participating in client device State information.In some cases, content supplier only can not receive state letter from onlooker's client from active client Breath.In some cases, operate the client state information received at 1512 and can include all visitors from particular clients Family end status information or only include the part of the client state information from particular clients.Such as, in some cases, exist Operate the client state information received at 1512 and can include that client state information updates.This type of client state information is more Newly can such as, including the client state information previously do not crossed to content provider server.Client state information updates also Such as can get rid of the client state information previously crossed to content provider server.
As described above, client state information updates and can include such as, presents content with at each client Various features, event, action or the information of operation correspondence associated by Xiang.Such as, client state information may indicate that client Hold the personage controlled or the various motion of other entities execution or operation.As another example, client state information is permissible Including helping to generate any information of one or more views of scene, the life controlled such as client or other entities Indicate, about controlling to be switched to another personage or the information of entity and about client and content from a personage or entity The information that the participation of transmission session is connected or disconnected from.As another example, client state information updates and can also refer to Example such as client is to work the most in a hybrid mode or work under full-flow mode and/or indicate the work under this quasi-mode Between switching.
At operation 1514, content supplier uses the client state information received at operation 1512 to carry with Suitable content The shared content item status information safeguarded for business.Operate at 1514 perform adjustment can include such as, add, delete and/or Multiple different pieces of content item status information are shared in amendment.As described above, in some cases, content item state is shared The renewal message reflection overall content item state that information can receive recently based on the client from each connection.
At operation 1516, generate next content item scene.As described above, can be based on such as, content item is originally Information and the shared content item status information of also content supplier's maintenance in body generate next content item scene.
It is noted here that Figure 15 and Figure 16 only illustrates may perform more infinite sample order used by operation.Thus, Such as, although Figure 15 illustrates that operation 1512 and 1514 was carried out before operation 1516, but any, all not requirements in the case of every kind These operations necessarily perform with this order.Specifically, as described above, can periodically by any applicable plan or The while of the unplanned time or receive client state information from one or more participation clients time different to update.Thus, such as, Do not require that necessarily receiving client state information from any or each client updates and/or real generating each of new scene Update before example and share status information.
At operation 1518, content supplier presents one or more views of the scene generated at operation 1516.As Described above, each view of scene can be the different images associated with same scene.Can be based on such as, content item itself The shared content item status information that interior information and also content supplier safeguard presents one or more views of scene. As described above, in some cases, at least some participates in client and can receive the different views of same scene.Further, In some cases, at least some participates in client and can receive the same view of same scene.
As described above, multiple different views of scene can respectively illustrate from the not homophase associated with each view Answer the scene from the point of view of visual angle.For example, it is possible to generate each view from the visual angle of one or more respective content item entities.Example As, one or more clients that the view that corresponding entity can be presented by transmission is mail to control or the most therewith Association.Corresponding entity can include such as, with personage, vehicle or any other entity of content item scene relating.Such as, one In the case of Xie, can illustrate as by the eyes of corresponding personage or another from associate with corresponding entity to the visual angle of view association The scene that one position is observed.As another example, can illustrate to the visual angle of view association so that corresponding personage or its He has high concern and/or the scene of high visual position in being physically located at the center of this view or being additionally provided in view.
At operation 1520, each view presented is sent to participate in client by content supplier.As described above, In some cases, different respective streams transmission servers can be used to come to relative client transmit.At operation 1522, really Whether fixed also have any remaining scene to generate with the content item association transmitted.If it is, then process returns to behaviour Make 1512.In contrast, to generate without remaining scene, then, at operation 1524, terminate the transmission of content item.
The most described above, in some cases it may to generate multiple different for multiple different blended syntype clients View.In the case, be sent to each mixed model client data volume may sometimes with such as content supplier and client Multiple factors of the quality of connection between end are the most relevant, and the quality of connection between content supplier and client can be based on such as Depending on bandwidth, handling capacity, delay, packet loss etc..Such as, for having the first mixing that better quality is connected with content supplier Pattern client, content supplier can include scene higher multiple of larger data amount to the first mixed model client transmission Miscellaneous degree view.In contrast, for having the second mixed model client that lower quality is connected with content supplier, content carries The lower complexity view including relatively small data quantity of scene can be transmitted to the second mixed model client for business.Such as, send out The lot of complexity view delivering to the first mixed model client can include being sent to the relatively low of the second mixed model client Possible texture in greater detail not to be covered, pattern, shape and other features in complexity view.
Figure 16 is to illustrate to carry out, according to the one or more Graphics Processing Unit of use disclosed by the invention, the example mistake that presents The flow chart of journey.At operation 1610, start content item transmission session.As described above, in some cases, content item passes Transfer session can be initiated based on the one or more requests from one or more participation client devices, and can use Such as, transmission of multimedia streams or any other content delivery technology being suitable for.As described above, participating in client can be such as Including active client and onlooker's client.At operation 1612, the next content item scene of mark.As described above, Can be based on such as, information in content item itself and also content supplier safeguard shared content item status information next life Become next content item scene.Describe some examples for obtaining and update shared content item status information in detail above Technology.The content item scene generated can such as by any combination of one or more Graphics Processing Unit, pass through figure Processing unit is scaled assembly or is identified by any other assembly being suitable for.Such as can identify scene, with enable to Partially accessed by one or more Graphics Processing Unit and present.
At operation 1614, obtain Graphics Processing Unit scalability information.Operate the Graphics Processing Unit contracting obtained at 1614 The information of putting can include any information associated with Graphics Processing Unit zoom operations.As described above, this type of information is permissible Including, such as, Graphics Processing Unit generates the speed presented or other execution associated with one or more Graphics Processing Unit Speed, about participate in content item transmission session client quantity information, about associating with content item transmission session The information of the quantity of the different views presented, about additional patterns processing unit or the information of the availability of other resources and Content supplier and/or the rule of client association or preference and any other information being suitable for.
At operation 1616, make one or more Graphics Processing Unit scaling and determine.Graphics Processing Unit scaling determines Can for example, at least be based in part on the Graphics Processing Unit scalability information obtained at operation 1614 to make.Graphics Processing Unit Scaling determines and can include, such as, use one or more additional patterns processing unit to present transmission content item, will be by One or more Graphics Processing Unit were abandoned and additionally to be redistributed or to reassign from the presenting of content item transmitted Present the determination of one or more Graphics Processing Unit involved by the content item of transmission.Graphics Processing Unit scaling determines permissible Including such as, the determination of amount of the Graphics Processing Unit about being used, and also include relating to how will be at operation 1612 The some of the scene generated is distributed in the determination in used Graphics Processing Unit.The most such as combine Fig. 7-10 and Run through present disclosure describes and make some example technique that Graphics Processing Unit scaling determines.
At operation 1618, one or more Graphics Processing Unit is used to generate and the presenting of scene relating.Can root Determine to generate present according to operating the Graphics Processing Unit scaling made at 1616.As described above, if in operation 1618 Place uses workman's volume Graphics Processing Unit, and these multiple Graphics Processing Unit can the most in some cases Generation simultaneously presents with scene relating.Further, in some cases, scene is presented with only with a Graphics Processing Unit Time compare, use multiple Graphics Processing Unit can reduce the total time presented needed for this scene.
At operation 1620, associate operating the one or more views with scene that present generated at 1618.At some In illustrative case, single Graphics Processing Unit can be used to generate the single view of scene.Further, in some illustrative case In, multiple Graphics Processing Unit can respectively generate the corresponding views of scene.Further, in some illustrative case, at multiple figures Reason unit can be combined to be formed the single view of scene.Further, in some illustrative case, multiple Graphics Processing Unit Can be combined to be formed multiple views of scene.Moreover, it is also possible to use above or any combination of other illustrative case. Correspondingly, operation 1620 can include, such as, determine and/or identify generated present in which partly will be incorporated into base In each view presented that scene generates.For example, it is possible to by the part presenting or presenting with include that this presents or presents This part each view association.Operation 1620 can also include, such as, by presenting from multiple Graphics Processing Unit Some is combined into one or more view.Figure 11-13 diagram and describe for will be from multiple figures in detail above Shape processing unit present the multiple example technique being combined into view.In some cases, when combining multiple Graphics Processing Unit When forming multiple view of scene, can in multiple views, each reuses combination technique whole or in part, as Splicing and layering.
At operation 1622, one or more views of scene are provided one or more participation client by content supplier End.As described above, in some cases it may use different respective streams transmission servers to come to relative client and pass Defeated.As described above, in some cases it may form multiple different view from scene relating.In these situations In some of them, each of multiple different views can include the different respective images from scene relating.Therefore, in some feelings Under condition, multiple different images can be formed at operation 1620 and transmit these images at operation 1622.
At operation 1624, it is determined whether also have any remaining scene to generate with the content item association transmitted.As Fruit is so, then process returns to operate 1612.In contrast, to generate without remaining scene, then at operation 1626, Terminate the transmission of content item.
As described above, in some cases it may will combine from presenting of different graphic processing unit To form one or more views of scene.The some of them of example described above may indicate that can be incited somebody to action by content supplier Combine from presenting of different graphic processing unit.But, in some cases, according to technology disclosed by the invention, To can be combined from presenting of different graphic processing unit by client.In such cases, content supplier can With such as by from multiple Graphics Processing Unit present be sent to client and not by these multiple present be combined into one or Multiple views.Then client can receive these and present, and will present at client and be combined into one or more view.Visitor Family end can use any combination of above-described splicing and demixing technology or any other technology being suitable for combine these Receive presents.
In some cases, the data set synthesis individual data set that can will associate with multiple different views of scene, As presented target.Figure 17 illustrates according to the incompatible example carrying out multiple view generation of employing data set disclosed by the invention System.As it can be seen, content supplier 1700 includes that Graphics Processing Unit 1702, Graphics Processing Unit 1702 as described above may be used The data associated with multiple view 1730A-C of content item scene for generation.In the example of Figure 17, by three views 1730A-C is sent to three clients 1750A-C.Specifically, view 1730A is sent to client 1750A, by view 1730B is sent to client 1750B, and view 1730C is sent to client 1750C.
As shown in figure 17, Graphics Processing Unit 1702 and/or other assemblies generate to include and/or store and different regard from multiple The data acquisition system 1710 of the data of figure association.Data acquisition system 1710 can be such as to present target or another data acquisition system.As Term as used herein present target refer to one or more data acquisition systems presented or with its of the information of scene relating He represents.Data acquisition system 1710 can by with one or more other tables presenting the data associated or the information with scene relating Show to generate, such as, will present, with one or more, the data associated or other expressions with the information of scene relating are included in Data acquisition system 1710.As will be described in detail below, the data included in data acquisition system 1710 can include, such as, with field The geometry manipulated of view association of scape, voxel, pixel, color, texture, number that shade is corresponding with any other data According to.The most as shown in figure 17, data acquisition system 1710 includes multiple segmentation 1720A-C, and in segmentation 1720A-C, each segmentation is with corresponding View 1730A-C association.Specifically, segmentation 1720A is associated with view 1730A, by segmentation 1720B and view 1730B Association, and segmentation 1720C is associated with view 1730C.Similarly, although Figure 17 illustrates and associates with three view 1730A-C Segmentation 1720A-C, but can include and any amount of different views according to the data acquisition system of technology disclosed by the invention Any amount of different segmentations of association.
When the data associated with view 1730A-C are successfully included in segmentation 1720A-C, encoding pack 1740A-C Corresponding segment 1720A-C that can respectively associate with corresponding views 1730A-C from data acquisition system 1710 is extracted data.Concrete next Saying, encoding pack 1740A can extract data from segmentation 1720A, and encoding pack 1740B can extract data from segmentation 1720B, And encoding pack 1740C can extract data from segmentation 1720C.Transmission assembly 1741A-C then can be each by view 1730A-C is sent to client 1750A-C respectively.In some cases, in client 1750A-C, each can have phase Answering dedicated stream transmission server, corresponding views 1730A-C can be sent to each client 1750A-C by it.In certain situation Under, each special respective streams transmission server can include corresponding encoded assembly and transmission assembly.Such as, in some cases, The special respective streams transmission server of client 1750A includes encoding pack 1740A and transmission assembly 1741A.
It is for instance possible to use input chain of command 1780 and/or another assembly determine is combined generation with given scenario The quantity of view.As illustrating in detail above, in some cases it may use the shared state from client 1750A-C Information partly determines the information associated with multiple views.Input chain of command 1780 and/or another assembly can also be such as Assisting to provide data acquisition system 1710 to include segmentation 1720A-C, segmentation 1720A-C is the most corresponding to multiple view 1730A-C View associates.In segmentation 1720A-C, each can such as be defined by multiple parameters, such as multiple dimension, data address, data Scope, data values, size and make other parameters that the part in data can be distinct from each other.In some cases, defeated Enter chain of command 1780 and may determine that the parameter associated with data acquisition system 1710 and segmentation 1720A-C, and be signaled to graphics process Unit 1702 and/or encoding pack 1740A-C.In some cases, it is also possible to by Graphics Processing Unit 1702 or by another Assembly determines these parameters.
Multiple technologies can be used to determine data acquisition system 1710 and the parameter of segmentation 1720A-C.In one example, may be used So that each segmentation 1720A-C equally to arrange size, and each segmentation 1720A-C can have length L and width W.This Data acquisition system 1710 can be promoted to have the size of W*3L, to consider the length of each in three segmentation 1720A-C.At some In the case of, this data acquisition system can include the additional information that data acquisition system can be promoted to exceed size W*3L.In some cases, divide Each in section 1720A-C can have the most different sizes.Such as, when view 1730A-C and different resolution During association, it is useful that use has different size of segmentation.Such as, the different application in different clients and/or client The most different resolution can be used to present video.In some cases, high-resolution view can have with relatively The data acquisition system segmentation of big size association, and low resolution view can have the data acquisition system associated with less size and divide Section.Larger data set fragment size is used for high-resolution view, such as so that the data volume of increase can be included in In bigger segmentation, this view that can help to generate high-resolution.In some cases, input chain of command 1780 or another Individual assembly can determine, based on the information that each client 1750A-C provides, the resolution associated with each view.Then, defeated Enter chain of command 1780 or another assembly can provide data acquisition system based on the resolution information that client 1750A-C provides 1710 and segmentation 1720A-C.
Terminology data set formation component is used to refer to help to generate data acquisition system 1710 and use at least in part herein Any assembly.Example data set closes formation component and can include, such as, inputs chain of command 1780, Graphics Processing Unit 1702 With any other assembly helping generation data acquisition system 1710.The one or more of data acquisition system formation component can such as, really The quantity of the view of scene to be generated.When data acquisition system 1710 is to present target, data acquisition system formation component is all right It is referred to as presenting target formation component.
As described above, multiple different views of scene can respectively illustrate from the not homophase associated with each view Answer the scene from the point of view of visual angle.For example, it is possible to generate each view from the visual angle of one or more respective content item entities.Example As, one or more clients that the view that corresponding entity can be presented by transmission is mail to control or the most therewith Association.Corresponding entity can include such as, with personage, vehicle or any other entity of content item scene relating.Such as, one In the case of Xie, can illustrate as by the eyes of corresponding personage or another from associate with corresponding entity to the visual angle of view association The scene that one position is observed.As another example, can illustrate to the visual angle of view association so that corresponding personage or its He has high concern and/or the scene of high visual position in being physically located at the center of this view or being additionally provided in view.
Figure 18 illustrates the first sample data set according to the data including and associating with multiple views disclosed by the invention. As it can be seen, data acquisition system 1810 includes segmentation 1820A-C.Segmentation 1820A-C illustrates and regards from different from the three of scene 1805 Expression 1850A-C, 1860A-C and 1870A-C of three different visual angles of Figure 183 0A-C association.Specifically, segmentation 1820A Including representing 1850A, 1860A and 1870A;Segmentation 1820B includes representing 1850B, 1860B and 1870B;And segmentation 1820C Including representing 1850C, 1860C and 1870C.
Represent that 1850A-C, 1860A-C and 1870A-C are the tables of the object 1850,1860 and 1870 included in scene 1805 Show.Specifically, represent that 1850A-C is the expression of object 1850, represent that 1860A-C is the expression of object 1860, and represent 1870A-C is the object of object 1870.Note, object 1850,1860 and 1870 and represent 1850A-C, 1860A-C and 1870A-C can include any amount of different texture and color and other visual effects.But, to put it more simply, in Figure 18-20 These visual effects not shown.
In some cases, Graphics Processing Unit can form the expression of object in each segmentation of data acquisition system, this The rear expression just continuously forming another object.This example representing formation sequence is illustrated in Figure 19.Specifically, Figure 19 shows Source is in the data acquisition system 1810 of Figure 18 of three formation stages.Stage 1910A is the first stage formed, and it occurs in second Before stage 1910B and phase III 1910C.As it can be seen, at first stage 1910A, only formed in segmentation 1820A-C with The expression 1850A-C of object 1850 association.
In some cases, represent 1850A-C formation can include operation execution, as multiple geometry manipulation, Coloring, texture padding and shade are arranged.Such as, in some cases it may in segmentation 1820A, be initially formed expression 1850A. Represent that the formation of 1850A can include, such as, load the geometry associated with the object 1850 in scene 1805, and manipulate The geometry of object 1850, in order to from the visual angle associated with view 1830A to present this object.Represent the formation of 1850A also Can include, such as, multiple color, texture and/or shade be filled and is applied to represent 1850A.It is applied to texture represent 1850A can include, such as, loads the texture file of the one or more storages associated with object 1850.Being filled by shade should For representing that 1850A can include, such as, load the one or more shades associated with object 1850 and fill file.
In some cases, formed in segmentation 1820A after representing 1850A, expression can be formed in segmentation 1820B 1850B.But, because representing that 1850B is formed after representing 1850A, so in some cases, can be by figure Reason unit loads geometry, texture, shade filling and other programs multiple and information associated with object 1850.Therefore, In some cases, represent that the loading forming needs and other search operaqtions of 1850B are considerably less than to be formed and represent 1850A institute The loading needed and other search operaqtions.Represent 1850B formation can include, such as, manipulation object 1850 loaded several What shape, in order to present this object from the visual angle associated with view 1830B.Represent that the formation of 1850B can also include, such as, Multiple color, texture and/or shade are filled and is applied to represent 1850A.As described above, it is applied to represent the stricture of vagina of 1850B Reason and shade are filled and can be included, such as, be previously used for forming the previously loaded texture of expression 1850A and shade is filled.
In some cases, formed in segmentation 1820B after representing 1850B, expression can be formed in segmentation 1820C 1850C.But, because representing that 1850C is formed after representing 1850A and 1850B, so in some cases, can be Geometry, texture, shade filling and other programs multiple and letter associated with object 1850 are loaded by Graphics Processing Unit Breath.Therefore, similar to representing 1850B, in some cases, represent that 1850C's forms the loading and other search operaqtions needed It is considerably less than to be formed and represents the loading needed for 1850A and other search operaqtions.Represent that the formation of 1850C can include, such as, The geometry loaded of manipulation object 1850, in order to present this object from the visual angle associated with view 1830C.Represent The formation of 1850C can also include, such as, multiple color, texture and/or shade is filled and is applied to represent 1850C.As upper Literary composition illustrates, is applied to represent that the texture of 1850C and shade are filled and can be included, such as, be previously used for being formed represent 1850A and The previously loaded texture of 1850B and shade are filled.
The stage 1910B of Figure 19 is the second formation stages, after it occurs in first stage 1910A and the phase III Before 1910C.As it can be seen, at second stage 1910B, the expression 1850A-C associated with object 1850 and and object The expression 1860A-C of 1860 associations is formed in segmentation 1820A-C.In some cases, represent that 1860A-C can be by the One forms expression 1860A followed by 1860B followed by 1860C is formed.Formed represent 1860A can include, such as, load with The geometry of object 1860 association, loads the one or more textures associated with object 1860 and loading is closed with object 1860 One or more shades of connection are filled.But, when when representing that after 1860A, formation represents 1860B and 1860C, in some feelings Under condition, geometry, texture, shade filling and other programs multiple of associating with object 1860 and information may be by figures Processing unit loads.Therefore, in some cases, represent that 1860B's and 1860C forms the loading and other search operaqtions needed May considerably less than be formed and represent the loading needed for 1860A and other search operaqtions.
Stage 1910C is the 3rd formation stages, after it occurs in first stage 1910A and second stage 1910C.Such as figure Shown in, at phase III 1910C, formed in segmentation 1820A-C and represented 1850A-C, 1860A-C and 1870A-C.? Under certain situation, represent that 1870A-C can be formed by first and represent that 1870A followed by 1870B followed by 1870C is formed. Being formed and represent that 1870A can include, such as, load the geometry associated with object 1870, loading associates with object 1870 One or more shades that one or more textures and loading associate with object 1870 are filled.But, when represent 1870A it Rear formed when representing 1870B and 1870C, in some cases, the filling of the geometry that associate with object 1870, texture, shade May be loaded by Graphics Processing Unit with other programs multiple and information.Therefore, in some cases, represent 1870B and What being formed of 1870C needed load and other search operaqtions may considerably less than be formed represent the loading needed for 1870A and its His search operaqtion.
As should be appreciated, in addition to manipulation geometry and application color, texture and shade are filled, according to segmentation The formation of any or all of expression in 1820A-C can perform other graphic operations.These type of other graphic operations can include, Such as, other map functions multiple, illumination, cutting, scan conversion, rasterize, obscure.
Thus, Figure 19 illustrates that Graphics Processing Unit forms the expression of an object in each segmentation of data acquisition system and then continues The example of the continuous expression forming another object.As described above, in some cases, such as, owing to reducing or removing weight from Recheck rope or load geometry, texture, shade filling and other programs or the demand of information, this shape associated with each object It can be useful for becoming sequence.In some cases, for associating the first expression formed with each object, one can only be loaded Secondary geometry, texture, shade fill and other programs or information more at least within.Then can be without repeating to load Geometry through loading, texture, shade are filled and other programs or information form the follow-up expression of same object.At some In the case of, each example loading geometry, texture or shade filling can make Graphics Processing Unit carry out process state more Change.The change of this type of state can increase the delay associated with the multiple views generating scene.
In some cases, formation sequence as shown in figure 19 is used can to significantly decrease the multiple views generating scene Required state change number of times.Such as, in some cases, the number of times of state change can be with the quantity with the object in scene The corresponding factor reduces.For example, it is contemplated that an alternative formation sequence, wherein by first forming each table in segmentation 1820A Show (include represent 1850A, 1860A and 1870A), then formed in segmentation 1820B each expression (include representing 1850B, 1860B and 1870A), in segmentation 1820C, then form each expression (including representing 1850C, 1860C and 1870C) formed The data acquisition system 1810 of Figure 18.In some cases, this alternative formation sequence may need to be three times in employing shape shown in Figure 19 Become the state change number of times needed for sequence.This is because this alternative formation sequence may be required for loading for each expression every time Geometry, texture, shade are filled and other programs or information-compare with this, only first associated with each object is represented Perform loading, and do not repeat the follow-up expression associated with each object to load.
Refer again to Figure 18, notice that the data acquisition system 1810 of Figure 18 includes the segmentation 1820A-C of equal sizes.But, just As explained above, do not require that the segmentation in data acquisition system must be equal sizes.In some cases, data acquisition system Can include that there is different correspondingly sized segmentation.During difference is correspondingly sized, each can include or can include each other The data of varying number relatively.Specifically, in some cases, the segmentation of size can compared with the segmentation of less size To include or larger data amount can be included.In some cases, size and/or each segmentation of each segmentation includes Data volume can determine based on the resolution corresponding with one or more clients of the view received associated by this segmentation. Such as, the different application in different clients and/or client can use the most different resolution to present video.? Under certain situation, can correspond to the view associated with high-resolution including the segmentation of the size of larger data amount, and The view associated with low resolution is can correspond to including the segmentation of the less size compared with small data quantity.Figure 20 illustrates data set Closing 2010, data acquisition system 2010 includes respectively having different size of segmentation 2020A-C relative to each other.As described above, such as, When view associates with different resolution, it is useful that use has different size of segmentation 2020A-C.Specifically, such as figure Shown in 20, segmentation 2020A associates with high resolution view 2030A, and segmentation 2020B associates with intermediate resolution view 2030B, with And segmentation 2020C associates with low resolution view 2030C.Segmentation 2020A can include the data volume bigger than segmentation 2020B, and Segmentation 2020B can include the data volume bigger than segmentation 2020C.
Figure 21 is to illustrate according to the incompatible instantiation procedure for multiple view generations of employing data set disclosed by the invention Flow chart.The flow chart of Figure 21 is directed to a particular example, in this example, data acquisition system include respectively with current scene Three segmentations of three view associations.But, it is again noted that can with include associating with any amount of different views respectively Technology disclosed by the invention is used in the data acquisition system association of any amount of different segmentation.
At operation 2104, produce current scene.As described above, field can be produced by content item at least in part Scape, such as video-game and/or other assemblies.Can be based on such as, information and one or more client in content item provide Status information produce current scene.
At operation 2106, receive data acquisition system placement information.Data acquisition system placement information can include, such as, Resolution that the quantity of view generated for each scene and/or the current scene of content item associate with each view and available In any other information providing data acquisition system.Content supplier can use multiple different technologies to determine, and generating regards The quantity of figure.Such as, in some cases, each different clients of content item to be received can receive it and respective regards accordingly Figure.Further, in some cases, each client of control personage or other entities or otherwise associated can connect Receive its each corresponding views.But, as described above, in some cases, some client controlling different entities is permissible Receive same view.Further, in some cases, the client controlling identical personage or another entity can receive same regarding Figure.In some cases, each client of employing difference monitor resolution or otherwise associated can receive Its respective corresponding views.In some cases, the status information that can provide based on one or more clients or other information Determine the quantity of view.
At operation 2108, carry out layout data set based on operating the placement information of mark at 2106.The cloth of data acquisition system Put and can include, such as, determine the quantity of segmentation in data acquisition system to be included in.The layout of this data acquisition system can also include Such as, the parameter that associates with each segmentation of definition, as multiple dimension, data address, scope of data, data values, size and its His parameter.In some cases, can be closed based on the one or more clients with the view received corresponding to each packet The resolution of connection determines the size of each packet.As described above, in some cases, input chain of command and/or another Individual assembly may determine that the dimension associated with data acquisition system and segmentation thereof or other parameters, and is signaled to Graphics Processing Unit And/or multiple coding and transmission assembly.In some cases, it is also possible to determine by Graphics Processing Unit or by another assembly These dimensions or other parameters.
In some cases, it is not necessary to necessarily for each different scene repetitive operations produced from broadcasting content item association 2106 and 2108.Such as, in some cases it may perform operation 2106 and 2108 when commencing play out content item, and only Want placement information can protect from a scene to another scene constant, the layout of each data acquisition system of the most each scene Hold constant.In some cases, it can be possible to occur some to change, under data acquisition system can be made for producing after change being detected One scene is re-arranged.Such as, when detecting that one or more client adds or terminates its participation playing video game, Then the data acquisition system of subsequent scenario is potentially based on and detects that this information is re-arranged.Specifically, such as, subsequent scenario Data acquisition system can based on this information on-demand be re-arranged to include additional or less (additional of fewer) point Section.
At operation 2110, to existing object iteration, so that existing object is set as next object.Existing object be At operation 2112-2116, it represents the object formed in data acquisition system.Such as, refer again to the example shown in Figure 19, operation The first time iteration of 2110 can include object 1850 is set to existing object.As another example, the of operation 2110 Two iteration can include object 1860 is set to existing object.Note, be for ease of illustrating to reader including operating 2110 One or more objects in current scene can be repeated the operation during Figure 21.Operation 2110 is not necessarily required to content Any process of provider's execution or calculating.Any amount of technology can be used to determine elected as currently by the object in scene The order of object.Such as, this order can determine by content item, by Graphics Processing Unit or by another assembly.This order Can determine based on many factors, as object relative to the degree of depth at the visual angle associated with one or more views or any other The factor being suitable for.
At operation 2112, the first segmentation of data acquisition system forms the expression of existing object.Such as, figure is referred again to Example shown in 19, the first time iteration of operation 2112 can be included in segmentation 1820A formation and represent 1850A.Slave operation 2112A instruction operation 2112 can include, such as, loads and uses geometry, texture and the shade associated with existing object Fill.For example, it is possible to load and the geometry of manipulation existing object, in order to form the view institute from associating with the first segmentation right The expression that the visual angle answered presents.Furthermore, it is possible to load the multiple texture associated with existing object and shade filling, and applied In the expression just formed in the first segmentation.Can also carry out any amount of other additionally or alternatively to operate with in the first segmentation Middle formation represents.
At operation 2114, the second segmentation of data acquisition system forms the expression of existing object.Such as, figure is referred again to Example shown in 19, the first time iteration of operation 2114 can be included in segmentation 1820B formation and represent 1850B.Slave operation 2112A instruction operation 2114 can include, such as, uses the geometry associated with existing object, texture and the moon loaded Shadow is filled.Such as, in some cases it may the geometry of the existing object that manipulation has loaded at slave operation 2112A To be formed from representing that the visual angle corresponding to the view associated with the second segmentation presents.In addition, in some cases it may by The multiple texture associated with existing object loaded at slave operation 2112A and shade are filled and are applied to just in the second segmentation The expression formed.Can also carry out any amount of other additionally or alternatively to operate and represent to be formed in the second segmentation.
At operation 2116, the 3rd segmentation of data acquisition system forms the expression of existing object.Such as, figure is referred again to Example shown in 19, the first time iteration of operation 2116 can be included in segmentation 1820C formation and represent 1850C.Slave operation 2116A instruction operation 2116 can include, such as, uses the geometry associated with existing object, texture and the moon loaded Shadow is filled.Such as, in some cases it may the geometry of the existing object that manipulation has loaded at slave operation 2112A To be formed from representing that the visual angle corresponding to the view associated with the 3rd segmentation presents.In addition, in some cases it may by The multiple texture associated with existing object loaded at slave operation 2112A and shade are filled and are applied to just in the 3rd segmentation The expression formed.Can also carry out other geometric operation being additionally or alternatively suitable for any amount of to be formed in the 3rd segmentation Represent.
Similarly note, slave operation 2112A, 2114A and 2116A be only intended to mark can respectively operation 2112, At 2114 and 2116 perform some example slave operations, and this type of slave operations all be not necessarily required to and not necessarily include The complete list of all slave operations that can perform in all cases.Such as, in some cases, operation 2114 and 2116 can Use some geometries previously not loaded at operation 2112 or another operation, texture, shade to fill including and/or Other assemblies.
At operation 2118, determining in current scene the most remaining has in data acquisition system not yet form that it represents any right As.In this case, then process returns to operate 2110, at operation 2110, is set to by existing object next remaining Object.Then repetitive operation 2112-2116 is to form representing of this next one object in each segmentation of data acquisition system.Example As, referring again to the example shown in Figure 19, the second time iteration of operation 2112-2116 can include forming expression 1860A-C, with And the third time iteration of operation 2112-2116 can include forming expression 1870A-C.In some cases, can be by such as Each object in scene is performed operation 2112-2116 until being suitable to the degree of each view to generate data acquisition system.But, In some cases, generate data acquisition system to form object without certain order as shown in Figure 21 and represent.In some feelings Under condition, some object in scene is without in being necessarily included in particular figure or have the data acquisition system that associates with particular figure The corresponding expression formed in segmentation.This situation possibly be present at such as object and is positioned at outside the viewing area associated with particular figure Time.
If determining that at operation 2118 scene does not has remaining its object represented that not yet formed in data acquisition system, then Process proceeds to operate 2120, at operation 2120, from each segmentation of first, second, and third segmentation of data acquisition system Extract at least some of of data, in order to be respectively formed first, second, and third view of current scene.In operation 2122 Place, by first, second, and third view coding, and at operation 2124, transmits first, second, and third view.At some In the case of, can be by first, second, and third view, each is sent to the most different first, second, and third client End.In other cases, one or more in these views can be sent to single client.As described above, Under certain situation, by corresponding own coding and transmission assembly, each in first, second, and third view can be encoded And transmit, these corresponding own codings and transmission assembly can such as include corresponding dedicated stream transmission server or be included in it In.
Each in process, method and algorithm described in preceding sections can be included in one or more computer or In the code module that computer processor performs and completely or partially realized automatization by these code modules.These codes Module can be stored on any kind of non-transient computer-readable medium or Computer Memory Unit, as hard disk drive, Solid-state memory, CD etc..These processes and algorithm can partially or even wholly realize in special circuit.The present invention is open Process and the result of process steps can be by permanently or be otherwise stored in such as volatibility or non-volatile deposit In any kind of non-transient Computer Memory Unit of storage device.
May be better understood above according to following clause:
1. one or more calculating nodes of storage instruction, described instruction is being calculated node execution by the one or more Time, promote the one or more calculate node perform include the following operation:
First scene of mark video-game, described first scene includes at least Part I and Part II, wherein adopts The first image is presented with described first scene based on described video-game by multiple Graphics Processing Unit;
The is generated by the described Part I of the first Graphics Processing Unit described first scene based on described video-game One presents;
The is generated by the described Part II of second graph processing unit described first scene based on described video-game Two present, wherein said generation described first present described with described generation second present at least in part with hold simultaneously with one another OK;
Described at least part of and described video-game at least partly presented with described second presented described first One or more views association of the first scene;And
The one or more view is sent to one or more client for as described video-game to institute The part of the streaming stating one or more client shows.
2. the one or more calculating nodes as described in clause 1, wherein associate with described video-game at the figure used The quantity of reason unit is to change.
3. the one or more calculating nodes as described in clause 2, wherein associate with described video-game at the figure used The described quantity of reason unit is based at least partially on the execution speed associated with described first Graphics Processing Unit and changes.
4. the one or more calculating nodes as described in clause 1, wherein associate with described video-game at the figure used The quantity of reason unit is at least partially based on the number of the view that the one or more scene relatings with described video-game generate Amount determines.
5. an at least part of computer implemented method for the first image is generated by one or more calculating nodes, its Including:
Generated first by the first Graphics Processing Unit the first scene based on content item to present;
Generated second by second graph processing unit described first scene based on described content item to present, wherein said life Become described first present described with described generation second present at least in part with perform simultaneously with one another;
Present described first at least partly and described second present at least partly with one of described first scene Or the association of multiple view;And
Present described first described at least partly and described second present described be at least partly sent to one or Multiple clients are for display.
6. the computer implemented method as described in clause 5, wherein present described first at least partly and described the Two at least part of the associations with one or more views of described first scene presented include:
Present described first described at least partly associates with the first view of described first scene;And
Present described second described at least partly associates with the second view of described first scene.
7. the computer implemented method as described in clause 5, wherein present described first at least partly and described the Two at least part of the associations with one or more views of described first scene presented include: described in presenting described first extremely Small part and the described second described at least part of combination presented are to form at least part of of the first view of described first scene.
8. the computer implemented method as described in clause 7, described in wherein said combination includes presenting described first It is at least partially inserted in the first identified areas of described first view, and described at least partly inserting of presenting described second Enter in the second identified areas of described first view.
9. the computer implemented method as described in clause 7, wherein said combination is held according to the expression including multiple layers OK, wherein ground floor corresponding to described first present described at least partly, and wherein the second layer corresponding to described second in Existing described at least partly.
10. the computer implemented method as described in clause 5, the graphics process list wherein used with described content item association The quantity of unit is to change.
The 11. computer implemented methods as described in clause 10, the graphics process wherein used with described content item association The quantity of unit is based at least partially on the execution speed associated with described first Graphics Processing Unit and changes.
The 12. computer implemented methods as described in clause 11, wherein when associating with described first Graphics Processing Unit When execution speed falls below lower threshold, increase the quantity of the Graphics Processing Unit used with described content item association, and Wherein when the execution speed associated with described first Graphics Processing Unit rises above upper limit threshold, reduce and described content item The quantity of the Graphics Processing Unit that association uses.
The 13. computer implemented methods as described in clause 5, the graphics process list wherein used with described content item association The quantity of unit is at least partially based on the quantity of the view that the one or more scene relatings with described content item generate and comes really Fixed.
The 14. computer implemented methods as described in clause 5, the graphics process list wherein used with described content item association The quantity of unit is at least partially based on what the availability of the Graphics Processing Unit operated by particular content provider determined.
The 15. computer implemented methods as described in clause 5, wherein described first scene relating with described content item is adopted The quantity of Graphics Processing Unit be at least partially based on what the scene complexity of described first scene determined.
16. one or more non-transient computer-readable recording mediums, it has the instruction being stored thereon, described instruction At least one calculate perform on node time, promote described at least one calculate node and perform to include the operation of the following:
The first scene based on content item determines that using the Graphics Processing Unit of the first quantity to generate presents, wherein said First quantity is more than one;
Present described in the Graphics Processing Unit of described first quantity described first scene based on described content item generates, Wherein said generation is performed by each in the Graphics Processing Unit of described first quantity the most simultaneously;
At least partly associating each in described presenting with one or more views of described first scene;And
The one or more view is sent to one or more client for display.
The 17. non-transient computer-readable recording mediums as described in clause 16, wherein by each in described presenting At least partly associate with one or more views of described first scene and include: at least part of by each in described presenting Combination is to form at least part of of the first view of described first scene.
The 18. non-transient computer-readable recording mediums as described in clause 17, wherein said combination includes presenting described In the respective identification region being at least partially inserted into described first view of each in.
The 19. non-transient computer-readable recording mediums as described in clause 17, wherein said combination is according to including multiple layer Expression perform, the most each layer correspond to described in present in corresponding one at least part of.
The 20. non-transient computer-readable recording mediums as described in clause 16, wherein use with described content item association The quantity of Graphics Processing Unit can change over another quantity from described first quantity.
The 21. non-transient computer-readable recording mediums as described in clause 20, wherein use with described content item association The described quantity of Graphics Processing Unit is based at least partially on the execution speed associated with the first Graphics Processing Unit and changes.
The 22. non-transient computer-readable recording mediums as described in clause 16, the graphics process of wherein said first quantity Unit is at least partially based on what the quantity with the view of described first scene relating generation determined.
The 23. non-transient computer-readable recording mediums as described in clause 16, wherein described the first of Graphics Processing Unit Quantity is at least partially based on what the availability of the Graphics Processing Unit operated by particular content provider determined.
The 24. non-transient computer-readable recording mediums as described in clause 16, the graphics process of wherein said first quantity Unit is at least partially based on what the scene complexity of described first scene determined.
May be better understood above according to following clause:
1. one or more calculating nodes of storage instruction, described instruction is being calculated node execution by the one or more Time, promote the one or more calculate node perform include the following operation:
At least some of of the first client video game states information is received from the first client;
At least some of of the second client video game states information is received from the second client;
Based on described first client video game states information and described second client video game states information The part received, adjusts and shares video game states information;
Based on described shared video game states information, generate the first video-game view and described first of the first scene Second video-game view of scene, wherein said first video-game view is at least partially different from described second video trip Play view;
Described first video-game view is sent to described first client;And
Described second video-game view is sent to described second client.
2. the one or more calculating nodes as described in clause 1, wherein said first video-game view with by described the The first video-game entity associated that one client controls.
3. the one or more calculating nodes as described in clause 2, wherein said first video-game view illustrate as from Described first scene with the view of described first video-game entity associated.
4. the one or more calculating nodes as described in clause 2, wherein in described first video-game view, described One video-game entity illustrates in the position of high observability.
5. a computer implemented method for the first view of the first scene is generated by one or more calculating nodes, its Including:
At least some of of the first client state information is received from the first client;
At least some of of the second client state information is received from the second client;
Based on described first client state information and the part received of described second client state information, adjust Share status information;
Described first view of described first scene is generated based on described shared status information;And
Described first view is sent to described first client.
6. the computer implemented method as described in clause 5, wherein uses thin-client content to present software described the Described first view is shown in one client.
7. the computer implemented method as described in clause 5, is wherein sent to described first client by described first view End and without transmitting, to described first client, the status information that associates with described first view.
8. the computer implemented method as described in clause 5, it also includes:
Described first view is sent to described second client.
9. the computer implemented method as described in clause 8, wherein said first view controls with described first client First instance and described second client control both second instances association.
10. the computer implemented method as described in clause 5, it also includes:
Generate the second view of described first scene based on described shared status information, wherein said first view is at least Partly it is different from described second view;And
Described second view is sent to described second client.
The 11. computer implemented methods as described in clause 10, wherein said first view and described first client control The first instance of system associates, and the second instance that wherein said second view controls with described second client associates.
The 12. computer implemented methods as described in clause 5, wherein said first view illustrates as from described first Described first scene of the view of the first instance association that client controls.
The 13. computer implemented methods as described in clause 5, wherein in described first view, by described first client The first instance that end controls illustrates in the position of high observability.
The 14. computer implemented methods as described in clause 5, at least a part of which is come in part with multiple Graphics Processing Unit Generate described first view.
15. one or more non-transient computer-readable recording mediums, it has the instruction being stored thereon, described instruction At least one calculate perform on node time, promote described at least one calculate node and perform to include the operation of the following:
At least some of of the first client state information is received from the first client;
At least some of of the second client state information is received from the second client;
Based on described first client state information and the part received of described second client state information, adjust Share status information;
The first view of the first scene is generated based on described shared status information;
Generate the second view of described first scene based on described shared status information, wherein said first view is at least Partly it is different from described second view;
Described first view is sent to described first client;And
Described second view is sent to described second client.
The 16. non-transient computer-readable recording mediums as described in clause 15, wherein use thin-client content to present soft Part shows described first view in described first client.
The 17. non-transient computer-readable recording mediums as described in clause 15, are wherein sent to institute by described first view State the first client and without transmitting, to described first client, the status information associated with described first view.
The 18. non-transient computer-readable recording mediums as described in clause 15, wherein said operation also includes:
Described first view is sent to the 3rd client.
The 19. non-transient computer-readable recording mediums as described in clause 18, wherein said first view and described first First instance and both second instances of described 3rd client control that client controls associate.
The 20. non-transient computer-readable recording mediums as described in clause 15, wherein said first view and described first The first instance association that client controls, and the second instance pass that wherein said second view controls with described second client Connection.
The 21. non-transient computer-readable recording mediums as described in clause 15, wherein said first view illustrate as from Described first scene of the view that the first instance controlled with described first client associates.
The 22. non-transient computer-readable recording mediums as described in clause 15, wherein in described first view, described The first instance that one client controls illustrates in the position of high observability.
The 23. non-transient computer-readable recording mediums as described in clause 22, the position of wherein said high observability is institute State the center of the first view.
The 24. non-transient computer-readable recording mediums as described in clause 15, at least a part of which is in part with multiple figures Processing unit generates described first view.
May be better understood above according to following clause:
The most one or more calculating nodes, comprising:
Processor;
Memorizer, it has the instruction performed by described processor being stored therein;
One or more presenting target formation component, it is configured to:
Determining at least the first view and second view of the scene generating content item, wherein said first view is from first First visual angle of client associate presents described scene, and wherein said second view is from second with the second client associate Visual angle presents described scene, and wherein said scene includes at least the first object and the second object;And
Generate at least through the following and present target, it include the first segmentation of associating with described first view and with institute State second view association the second segmentation:
Described first object the first table from described first visual angle is formed in described described first segmentation presenting target Show, and form described first object the second table from described second visual angle in described described second segmentation presenting target Show;And
After form described first object described first represents and described second represents, in the described institute presenting target State and the first segmentation is formed the first expression from described first visual angle of second object, and present described the second of target described Segmentation is formed the second expression from described second visual angle of described second object;
First encoding pack, it is configured at least part of number from described described first segmentation presenting target According to coding to form the first view of coding;
Second encoding pack, it is configured at least part of number from described described second segmentation presenting target According to coding to form the second view of coding;
First transmission assembly, it is configured to the first view of described coding is sent to described first client;And
Second transmission assembly, it is configured to the second view of described coding is sent to described second client.
2. the one or more calculating nodes as described in clause 1, in wherein said first segmentation, the data volume of storage is different The data volume of storage in described second segmentation, in wherein said first segmentation, the data volume of storage is based at least partially on and institute State the data volume of storage in the resolution of the first client associate, and wherein said second segmentation to be based at least partially on and institute State the resolution of the second client associate.
3. the one or more calculating nodes as described in clause 1, wherein form described the first of described first object and represent Including: the geometry associated with described first object is performed manipulation, and it is described first right to be applied to by one or more textures Described the first of elephant represents and one or more shades is filled described first expression being applied to described first object.
4. the one or more calculating nodes as described in clause 1, wherein form described the first of described first object and represent Including: load shade and fill, and described shade is filled described first expression being applied to described first object, and wherein Described second expression forming described first object includes: is filled by described shade and is applied to described the second of described second object Represent and fill without repeating to load described shade.
5. one kind is generated at least the first view of scene of content item and the second view by one or more calculating nodes Computer implemented method, comprising:
Determine described at least the first view of the described scene generating described content item and described second view, wherein said First view presents described scene from the first visual angle with the first client associate, and wherein said second view is from second Second visual angle of client associate presents described scene, and wherein said scene includes one or more object;
Generating data acquisition system, it includes the first segmentation associated with described first view and associates with described second view Second segmentation, wherein said first segmentation includes that at least one in the one or more object is formed from described first visual angle Expression, and wherein said second segmentation includes that at least one in the one or more object is from described second visual angle shape The expression become;
From at least partly extraction data of described first segmentation of described data acquisition system to form described first view;
From at least partly extraction data of described second segmentation of described data acquisition system to form described second view;
Described first view is sent to described first client;And
Described second view is sent to described second client.
6. the computer implemented method as described in clause 5, wherein said first visual angle with in described content item by Described first client control entity associated, and wherein said second visual angle with in described content item by described second The entity associated that client controls.
7. the computer implemented method as described in clause 5, in wherein said first segmentation, the data volume of storage is different from The data volume of storage in described second segmentation, in wherein said first segmentation, the data volume of storage is based at least partially on described In the resolution of the first client associate, and wherein said second segmentation, the data volume of storage is based at least partially on described The resolution of the second client associate.
8. the computer implemented method as described in clause 5, wherein said scene include the one or more is right As including at least the first object and the second object, and the described data acquisition system of wherein said generation includes:
Described first object the first table from described first visual angle is formed in described first segmentation of described data acquisition system Show, and in described second segmentation of described data acquisition system, form described first object the second table from described second visual angle Show;And
After form described first object described first represents and described second represents, in the institute of described data acquisition system State and the first segmentation is formed the first expression from described first visual angle of second object, and at described the second of described data acquisition system Segmentation is formed the second expression from described second visual angle of described second object.
9. the computer implemented method as described in clause 8, wherein form described first object described first represents bag Include: the geometry associated with described first object is performed manipulation, one or more textures are applied to described first object Described first represent and by one or more shades fill be applied to described first object described first represent.
10. the computer implemented method as described in clause 8, wherein form described first object described first represents bag Include: load shade and fill, and described shade is filled described first expression being applied to described first object, and wherein shape Become described the second of described first object to represent to include: described shade is filled described second table being applied to described second object Show and fill without repeating to load described shade.
The 11. computer implemented methods as described in clause 8, wherein form described first object described first represents bag Include: load texture, and described texture be applied to the first expression of described first object, and wherein formed described first right Elephant described second represent include: described texture is applied to described second object described second represent and without repeat load Described texture.
The 12. computer implemented methods as described in clause 5, it also includes:
Determine the quantity of the view of the described scene generated;And
Arrange that described data acquisition system is with dividing that the described quantity including view based on the described scene generated determines The quantity of section.
The 13. computer implemented methods as described in clause 5, wherein said data acquisition system also includes the 3rd segmentation, its with Described scene associates from the three-view diagram with the 3rd visual angle of the 3rd client associate.
The 14. computer implemented methods as described in clause 5, wherein said one or more calculating nodes include: first Streaming server, described first view is sent to described first client by it;With second transmission server, it is by described Second view is sent to described second client.
15. one or more non-transient computer-readable recording mediums, it has the instruction being stored thereon, described instruction At least one calculate perform on node time, promote described at least one calculate node and perform to include the operation of the following:
Determining at least the first view and second view of the scene generating content item, wherein said first view is from first First visual angle of client associate presents described scene, and wherein said second view is from second with the second client associate Visual angle presents described scene, and wherein said scene includes one or more object;
Generating data acquisition system, it includes the first segmentation associated with described first view and associates with described second view Second segmentation, wherein said first segmentation includes that at least one in the one or more object is formed from described first visual angle Expression, and wherein said second segmentation includes that at least one in the one or more object is from described second visual angle shape The expression become;
By at least part of data encoding of described first segmentation from described data acquisition system to form the first of coding View;
By at least part of data encoding of described second segmentation from described data acquisition system to form the second of coding View;
First view of described coding is sent to described first client;And
Described coding the second view is sent to described second client.
The 16. non-transient computer-readable recording mediums as described in clause 15, wherein said first visual angle with described In content item by described first client control entity associated, and wherein said second visual angle with in described content item By described second client control entity associated.
The 17. non-transient computer-readable recording mediums as described in clause 15, the number of storage in wherein said first segmentation Be different from described second segmentation the data volume of storage according to amount, in wherein said first segmentation, the data volume of storage is at least in part Based on the data volume of storage in the resolution with described first client associate, and wherein said second segmentation at least in part Based on the resolution with described second client associate.
The 18. non-transient computer-readable recording mediums as described in clause 15, wherein said scene include described one Individual or multiple objects include at least the first object and the second object, and the described data acquisition system of wherein said generation includes:
Described first object the first table from described first visual angle is formed in described first segmentation of described data acquisition system Show, and in described second segmentation of described data acquisition system, form described first object the second table from described second visual angle Show;And
After form described first object described first represents and described second represents, in the institute of described data acquisition system State and the first segmentation is formed the first expression from described first visual angle of second object, and at described the second of described data acquisition system Segmentation is formed the second expression from described second visual angle of described second object.
The 19. non-transient computer-readable recording mediums as described in clause 18, wherein form the described of described first object First expression includes: the geometry associated with described first object is performed manipulation, one or more textures are applied to institute State described the first of the first object represent and the filling of one or more shades is applied to described the first of described first object Represent.
The 20. non-transient computer-readable recording mediums as described in clause 18, wherein form the described of described first object First expression includes: loads shade and fills, and described shade is filled described first expression being applied to described first object, And described second expression wherein forming described first object includes: is filled by described shade and is applied to described second object Described second represents and fills without repeating to load described shade.
The 21. non-transient computer-readable recording mediums as described in clause 18, wherein form the described of described first object First expression includes: loading texture, and described texture is applied to the first expression of described first object, and is wherein formed Described the second of described first object represents and includes: described texture is applied to described the second of described second object and represents and nothing Need to repeat to load described texture.
The 22. non-transient computer-readable recording mediums as described in clause 15, wherein said operation also includes:
Determine the quantity of the view of the described scene generated;And
Arrange that described data acquisition system is with dividing that the described quantity including view based on the described scene generated determines The quantity of section.
The 23. non-transient computer-readable recording mediums as described in clause 15, wherein said data acquisition system also includes the 3rd Segmentation, it associates from the three-view diagram with the 3rd visual angle of the 3rd client associate with described scene.
The 24. non-transient computer-readable recording mediums as described in clause 15, wherein said one or more calculating nodes Including: first-class transmission server, described first view is sent to described first client by it;With the second streaming service Device, described second view is sent to described second client by it.
Above-described various features and process can use independently of one another, or can be combined in many ways.Institute Likely combination and sub-combination ought to fall in scope disclosed by the invention.Additionally, in some implementations can be by some Method or process frame omit.Method described herein and process are also not necessarily limited to any specific order, and frame related to this Or state can perform with other applicable order.Such as, the frame of description or state can be disclosed special suitable by the present invention Order beyond sequence performs, maybe can be by multiple frames or combinations of states in single frame or state.Example frame or state are permissible Sequentially, in parallel or in some other fashion perform.Frame or state can add to example disclosed by the invention implement In scheme or remove frame or state from which.Example system described herein and assembly can give from described different mode With configuration.Such as, than example embodiment disclosed by the invention, example embodiment disclosed by the invention can be added unit Part, remove element or compare with example embodiment disclosed by the invention from which element is rearranged.Described herein Assembly can be such as to include structural group for the one or more algorithms performed with one or more relational processors Part.
Will also recognize, multiple item be illustrated as used time be stored in memorizer or storage device on, and this A little items or its some can be for memorizer management and the conforming purpose of data in memorizer and other storage devices Between be transferred.Alternately, in other embodiments, the some or all of which of software module and/or system can be Memorizer on another equipment performs, and communicates with the calculating system of diagram via the communication between computer.Furthermore, In some embodiments, the some or all of which of these systems and/or module can be adopted in other ways, as at least in part Realizing in firmware and/or hardware or provide, these firmwares and/or hardware include but not limited to, one or more special integrated Circuit (ASIC), standard integrated circuit, controller (such as, by performing the instruction being suitable for, and include microcontroller and/or embedding Enter formula controller), can field programmable gate array (FPGA), complex programmable logic device (CPLD) etc..These modules, system and The some or all of which of data structure (such as, as software instruction or structural data) can also be stored in computer-readable On medium, as by applicable driver or via applicable hard disk, memorizer, network or the portable medium product connecting and reading. The data signal that these systems, module and data structure are also used as generating is (such as, as carrier wave or other analog or digitals A part for transmitting signal) transmit on multiple computer-readable transmission medium, these computer-readable transmission mediums include base In wireless and based on wired/cable medium, and these systems, module and data structure can take many forms (example As, as a part for the analogue signal of single or multiplexing, or as the packet of multiple discrete digital or frame).Other embodiment party In case, this type of computer program may also take on other forms.Correspondingly, the present invention can utilize other computer systems Configuration is implemented.
Conditional language used herein, wherein such as " can ", " can ", "available", " possible ", " such as " etc., unless The most otherwise indicated, or another Rational Solutions the most used hereinafter, some embodiment ought to be expressed the most in general manner Including some feature, element and/or parts, and other embodiments do not include some feature, element and/or step.Therefore, this Class conditional language is not intended to imply that feature, element and/or step are by any way for one or more embodiment party in general manner Case is required, or one or more embodiment must include by or not inputted by author or point out deciding whether to include These features, element and/or step or in any particular, to perform patrolling of these features, element and/or step Volume.Term " includes ", " including ", " having " etc. are synonyms, and non-repulsion uses openly, and is not excluded for other Element, feature, action, operation etc..Further, term "or" with nonexclusion meaning use (and be not with repellency anticipate Justice uses), in order to when such as making for the list of connecting element, term "or" represent the element in list one of, Some or all.
Although describing some example embodiment, but these embodiments are given the most by way of example and are not intended to Limit the scope of present invention disclosed herein.Therefore, all it is not intended to imply any special characteristic, feature, step, mould in described above Block or frame are required or indispensable.Indeed, it is possible to use other forms multiple to include innovation side described herein Method and system;Furthermore, method described herein and the pro forma multiple omission of system can be carried out, substitute and change, and not Deviate from the spirit of present invention disclosed herein.Claims and equivalent thereof ought to be contained to fall in present invention disclosed herein Some scope and spirit in this type of form or amendment.

Claims (15)

  1. The most one or more calculating nodes, comprising:
    Processor;
    Memorizer, it has the instruction performed by described processor being stored therein;
    One or more presenting target formation component, it is configured to:
    Determine at least the first view of scene and the second view generating content item, wherein said first view from the first client First visual angle of end association presents described scene, and wherein said second view is from the second visual angle with the second client associate Presenting described scene, wherein said scene includes at least the first object and the second object;And
    Generating at least through the following and present target, it includes the first segmentation of associating with described first view and with described the Second segmentation of two view associations:
    The first expression from described first visual angle of described first object is formed in described described first segmentation presenting target, with And in described described second segmentation presenting target, form the second expression from described second visual angle of described first object;And
    After form described first object described first represents and described second represents, present described the of target described One segmentation is formed the first expression from described first visual angle of second object, and in described described second segmentation presenting target Described second object of middle formation is from second expression at described second visual angle;
    First encoding pack, it is configured to compile at least part of data from described described first segmentation presenting target Code is to form the first view of coding;
    Second encoding pack, it is configured to compile at least part of data from described described second segmentation presenting target Code is to form the second view of coding;
    First transmission assembly, it is configured to the first view of described coding is sent to described first client;And
    Second transmission assembly, it is configured to the second view of described coding is sent to described second client.
  2. One or more calculating node the most as claimed in claim 1, in wherein said first segmentation, the data volume of storage is different The data volume of storage in described second segmentation, in wherein said first segmentation, the data volume of storage is based at least partially on and institute State the data volume of storage in the resolution of the first client associate, and wherein said second segmentation to be based at least partially on and institute State the resolution of the second client associate.
  3. One or more calculating node the most as claimed in claim 1, wherein forms described the first of described first object and represents Including: the geometry associated with described first object is performed manipulation, and it is described first right to be applied to by one or more textures Described the first of elephant represents and one or more shades is filled described first expression being applied to described first object.
  4. One or more calculating node the most as claimed in claim 1, wherein forms described the first of described first object and represents Including: load shade and fill, and described shade is filled described first expression being applied to described first object, and wherein Described second expression forming described first object includes: is filled by described shade and is applied to described the second of described second object Represent and fill without repeating to load described shade.
  5. 5. at least the first view of scene and the calculating of the second view being generated content item by one or more calculating nodes The method that machine realizes, comprising:
    Determine and generate the most described first view of described scene of described content item and described second view, wherein said first View presents described scene from the first visual angle with the first client associate, and wherein said second view from the second client Second visual angle of end association presents described scene, and wherein said scene includes one or more object;
    Generating database collection, it includes the first segmentation associated with described first view and associate the with described second view Two-section, wherein said first segmentation includes what at least one in the one or more object was formed from described first visual angle Represent, and wherein said second segmentation includes that at least one in the one or more object is formed from described second visual angle Expression;
    From at least partly extraction data of described first segmentation of described data acquisition system to form described first view;
    From at least partly extraction data of described second segmentation of described data acquisition system to form described second view;
    Described first view is sent to described first client;And
    Described second view is sent to described second client.
  6. Computer implemented method the most as claimed in claim 5, wherein said first visual angle with in described content item by Described first client control entity associated, and wherein said second visual angle with in described content item by described second The entity associated that client controls.
  7. Computer implemented method the most as claimed in claim 5, in wherein said first segmentation, the data volume of storage is different from The data volume of storage in described second segmentation, in wherein said first segmentation, the data volume of storage is based at least partially on described In the resolution of the first client associate, and wherein said second segmentation, the data volume of storage is based at least partially on described The resolution of the second client associate.
  8. Computer implemented method the most as claimed in claim 5, wherein said scene include the one or more is right As including at least the first object and the second object, and the described data acquisition system of wherein said generation includes:
    The first expression from described first visual angle of described first object is formed in described first segmentation of described data acquisition system, with And in described second segmentation of described data acquisition system, form the second expression from described second visual angle of described first object;And
    After form described first object described first represents and described second represents, at described the of described data acquisition system One segmentation is formed the first expression from described first visual angle of second object, and described second segmentation at described data acquisition system Described second object of middle formation is from second expression at described second visual angle.
  9. Computer implemented method the most as claimed in claim 8, wherein form described first object described first represents bag Include: the geometry associated with described first object is performed manipulation, one or more textures are applied to described first object Described first represent and by one or more shades fill be applied to described first object described first represent.
  10. Computer implemented method the most as claimed in claim 8, wherein form described first object described first represents bag Include: load shade and fill, and described shade is filled described first expression being applied to described first object, and wherein shape Become described the second of described first object to represent to include: described shade is filled described second table being applied to described second object Show and fill without repeating to load described shade.
  11. 11. computer implemented methods as claimed in claim 8, wherein form described first object described first represents bag Include: load texture, and described texture be applied to the first expression of described first object, and wherein formed described first right Elephant described second represent include: described texture is applied to described second object described second represent and without repeat load Described texture.
  12. 12. computer implemented methods as claimed in claim 5, it also includes:
    Determine the quantity of the view of the described scene generated;And
    Arrange the segmentation that described data acquisition system determines with the described quantity including view based on the described scene generated Quantity.
  13. 13. computer implemented methods as claimed in claim 5, wherein said data acquisition system also includes the 3rd segmentation, its with Described scene associates from the three-view diagram with the 3rd visual angle of the 3rd client associate.
  14. 14. computer implemented methods as claimed in claim 5, wherein said one or more calculating nodes include: first Streaming server, described first view is sent to described first client by it;With second transmission server, it is by described Second view is sent to described second client.
  15. 15. 1 kinds of systems, comprising:
    One or more processors;
    One or more memorizeies, it has the instruction being stored thereon, and described instruction is on the one or more processors During execution, promote the one or more processor perform include the following operation:
    Determine at least the first view of scene and the second view generating content item, wherein said first view from the first client First visual angle of end association presents described scene, and wherein said second view is from the second visual angle with the second client associate Presenting described scene, wherein said scene includes one or more object;
    Generating data acquisition system, it includes the first segmentation associated with described first view and associate second with described second view Segmentation, wherein said first segmentation includes at least one table formed from described first visual angle in the one or more object Show, and wherein said second segmentation includes what at least one in the one or more object was formed from described second visual angle Represent;
    By at least part of data encoding of described first segmentation from described data acquisition system to form the first view of coding;
    By at least part of data encoding of described second segmentation from described data acquisition system to form the second view of coding;
    First view of described coding is sent to described first client;And
    Second view of described coding is sent to described second client.
CN201480061316.XA 2013-11-11 2014-11-11 Data acquisition system for multiple view generations Pending CN106132494A (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US14/077,165 US20150130815A1 (en) 2013-11-11 2013-11-11 Multiple parallel graphics processing units
US14/077,180 US20150133216A1 (en) 2013-11-11 2013-11-11 View generation based on shared state
US14/077,149 US20150130814A1 (en) 2013-11-11 2013-11-11 Data collection for multiple view generation
US14/077,149 2013-11-11
US14/077,180 2013-11-11
US14/077,165 2013-11-11
PCT/US2014/065055 WO2015070235A1 (en) 2013-11-11 2014-11-11 Data collection for multiple view generation

Publications (1)

Publication Number Publication Date
CN106132494A true CN106132494A (en) 2016-11-16

Family

ID=53042246

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480061316.XA Pending CN106132494A (en) 2013-11-11 2014-11-11 Data acquisition system for multiple view generations

Country Status (5)

Country Link
EP (1) EP3068504A4 (en)
JP (1) JP2017504986A (en)
CN (1) CN106132494A (en)
CA (1) CA2929588A1 (en)
WO (1) WO2015070235A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111295680A (en) * 2017-09-11 2020-06-16 本特利系统有限公司 Intelligent model hierarchy for infrastructure modeling

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018206605A1 (en) * 2017-05-08 2018-11-15 Trimoo Ip Europe B.V. Transport simulation in a location-based mixed-reality game system
EP3400991A1 (en) * 2017-05-09 2018-11-14 Trimoo IP Europe B.V. Transport simulation in a location-based mixed-reality game system
EP3400992A1 (en) * 2017-05-08 2018-11-14 Trimoo IP Europe B.V. Providing a location-based mixed-reality experience
CN110059329B (en) * 2018-12-05 2023-06-20 中国航空工业集团公司西安飞机设计研究所 Comprehensive simulation method and comprehensive simulation system for energy of refined electromechanical system
CN113449228A (en) * 2020-03-24 2021-09-28 北京沃东天骏信息技术有限公司 Page rendering method and device
CN117651159B (en) * 2024-01-29 2024-04-23 杭州锐颖科技有限公司 Automatic editing and pushing method and system for motion real-time video

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1154169A (en) * 1994-05-27 1997-07-09 碧特斯特雷姆有限公司 Apparatus and methods for creating and using portable fonts
CN101025901A (en) * 2006-02-23 2007-08-29 精工爱普生株式会社 Image processing system, display device, program, and information storage medium
EP1290642B1 (en) * 2000-04-28 2010-09-15 Mental Images GmbH Method for interactive multi-user customizable web data retrieval and rendering
CN102867073A (en) * 2011-07-08 2013-01-09 中国民航科学技术研究院 Flight program design system for performance-based navigation, verification platform and verification method
US20130038618A1 (en) * 2011-08-11 2013-02-14 Otoy Llc Crowd-Sourced Video Rendering System

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000132705A (en) * 1998-10-26 2000-05-12 Square Co Ltd Image processor, image processing method, game device and recording medium
US20030212742A1 (en) * 2002-05-07 2003-11-13 Hochmuth Roland M. Method, node and network for compressing and transmitting composite images to a remote client
JP3883560B2 (en) * 2005-10-31 2007-02-21 株式会社バンダイナムコゲームス GAME DEVICE AND INFORMATION STORAGE MEDIUM
EP1837060A1 (en) * 2006-03-21 2007-09-26 In Fusio (S.A.) Method for displaying interactive video content from a video stream in a display of a user device
US8187104B2 (en) * 2007-01-29 2012-05-29 Sony Online Entertainment Llc System and method for creating, editing, and sharing video content relating to video game events
US8484284B2 (en) * 2007-08-03 2013-07-09 Nintendo Co., Ltd. Handheld wireless game device server, handheld wireless device client, and system using same
US8527646B2 (en) * 2009-04-14 2013-09-03 Avid Technology Canada Corp. Rendering in a multi-user video editing system
US8803892B2 (en) * 2010-06-10 2014-08-12 Otoy, Inc. Allocation of GPU resources across multiple clients
US8171137B1 (en) * 2011-05-09 2012-05-01 Google Inc. Transferring application state across devices
JP5076132B1 (en) * 2011-05-25 2012-11-21 株式会社スクウェア・エニックス・ホールディングス Drawing control apparatus, control method therefor, program, recording medium, drawing server, and drawing system
US8775850B2 (en) * 2011-06-28 2014-07-08 Amazon Technologies, Inc. Transferring state information between electronic devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1154169A (en) * 1994-05-27 1997-07-09 碧特斯特雷姆有限公司 Apparatus and methods for creating and using portable fonts
EP1290642B1 (en) * 2000-04-28 2010-09-15 Mental Images GmbH Method for interactive multi-user customizable web data retrieval and rendering
CN101025901A (en) * 2006-02-23 2007-08-29 精工爱普生株式会社 Image processing system, display device, program, and information storage medium
CN102867073A (en) * 2011-07-08 2013-01-09 中国民航科学技术研究院 Flight program design system for performance-based navigation, verification platform and verification method
US20130038618A1 (en) * 2011-08-11 2013-02-14 Otoy Llc Crowd-Sourced Video Rendering System

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111295680A (en) * 2017-09-11 2020-06-16 本特利系统有限公司 Intelligent model hierarchy for infrastructure modeling
CN111295680B (en) * 2017-09-11 2023-10-13 本特利系统有限公司 Intelligent model hierarchy for infrastructure modeling
US11971865B2 (en) 2017-09-11 2024-04-30 Bentley Systems, Incorporated Intelligent model hierarchy for infrastructure modeling

Also Published As

Publication number Publication date
CA2929588A1 (en) 2015-05-14
JP2017504986A (en) 2017-02-09
EP3068504A1 (en) 2016-09-21
WO2015070235A1 (en) 2015-05-14
EP3068504A4 (en) 2017-06-28

Similar Documents

Publication Publication Date Title
CN106132494A (en) Data acquisition system for multiple view generations
Stotko et al. SLAMCast: Large-scale, real-time 3D reconstruction and streaming for immersive multi-client live telepresence
CN103890749B (en) Cooperatively mobile analysis
CN103874991B (en) Crowd-sourced video rendering system
CN101266633B (en) Seamless super large scale dummy game world platform
US8893049B2 (en) Creation and prioritization of multiple virtual universe teleports in response to an event
TW200405219A (en) Systems and methods for providing intermediate targets in a graphics system
Glinka et al. Rtf: a real-time framework for developing scalable multiplayer online games
CN106991713A (en) Method and apparatus, medium, processor and the terminal of scene in more new game
CN103918012A (en) Rendering system, rendering server, control method thereof, program, and recording medium
JP2009543195A (en) Fast reconstruction of graphics pipeline state
CN105493501A (en) Virtual video camera
CN104980518B (en) The methods, devices and systems of more learning agent parallel training models
CN106575158A (en) Environmentally mapped virtualization mechanism
US20230040777A1 (en) Method and apparatus for displaying virtual landscape picture, storage medium, and electronic device
Ooi et al. The metaverse data deluge: What can we do about it?
KR20120040240A (en) Interest management for a virtual environment of a peer-to-peer network
US8910043B2 (en) Modifying spaces in virtual universes
Sahm et al. Efficient representation and streaming of 3D scenes
Trescak et al. Execution infrastructure for normative virtual environments
Pani et al. Distributed data exchange with Leap Motion
Ng et al. A performance study on multi-server DVE systems
Byelozyorov et al. An open modular architecture for effective integration of virtual worlds in the web
Capin et al. A taxonomy of networked virtual environments
US20230360345A1 (en) Generate a simplified version of a user-generated digital object

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20161116