CN108052364A - One kind is based on remote-operated method for displaying image, device, equipment and storage medium - Google Patents
One kind is based on remote-operated method for displaying image, device, equipment and storage medium Download PDFInfo
- Publication number
- CN108052364A CN108052364A CN201711328022.0A CN201711328022A CN108052364A CN 108052364 A CN108052364 A CN 108052364A CN 201711328022 A CN201711328022 A CN 201711328022A CN 108052364 A CN108052364 A CN 108052364A
- Authority
- CN
- China
- Prior art keywords
- client
- image data
- scene
- virtual scene
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Abstract
The invention discloses one kind to be based on remote-operated method for displaying image, device, equipment and storage medium.This method includes：The scene type that client is sent is obtained, the scene type sent according to the client chooses default virtual scene；Obtain the corresponding user image data of client；The corresponding user image data of client is incorporated into the default virtual scene；The default virtual scene for incorporating the corresponding user image data of client is sent to corresponding client, and is shown in the client, by technical scheme, can realize the multiple person cooperational that extensive, multi-user participates in jointly.
Description
Technical field
The present invention relates to a kind of intelligent terminal technology more particularly to one kind based on remote-operated method for displaying image, dress
It puts, equipment and storage medium.
Background technology
Virtual reality technology is an important directions of emulation technology, is computer graphics, Digital object identifier, people
The set of the multiple technologies such as machine interfacing, emulation technology, sensing technology, network technology is currently extremely challenging one
Interleaving techniques front subject and research field.With the fast development of computer science and technology, virtual reality technology is cured in clinic
The fields such as, life ＆ amusement, national defense and military, indoor design and industrial simulation obtain very extensive application.
The application of major part virtual reality can only provide one, the operating experience of unit, single-view at present, can not solve big
The problems such as multiple person cooperational that scale, multi-user participate in jointly.
The content of the invention
The embodiment of the present invention provides a kind of based on remote-operated method for displaying image, device, equipment and storage medium, energy
Enough multiple person cooperationals realized extensive, multi-user and participated in jointly.
In a first aspect, an embodiment of the present invention provides one kind to be based on remote-operated method for displaying image, including：
The scene type that client is sent is obtained, the scene type sent according to the client chooses default virtual field
Scape；
Obtain the corresponding user image data of client；
The corresponding user image data of client is incorporated into the default virtual scene；
The default virtual scene for incorporating the corresponding user image data of client is sent to corresponding client, and is shown
In the client.
Further, the scene type that client is sent is obtained, the scene type sent according to the client is chosen pre-
If it before virtual scene, further includes：
When the destination address for receiving client transmission obtains instruction, destination address is generated；
Correspondingly, after obtaining the corresponding user image data of client, further include：
Receive the user image data for being sent to the destination address.
Further, the corresponding user image data of client is incorporated to the default virtual scene includes：
User current location and attitude information are determined according to the user image data；
The virtual figure image identical with user current location and attitude information is created in the default virtual scene.
Further, the visual human identical with user current location and attitude information is created in the default virtual scene
Figure image includes：
When the user image data changes, the location information and attitude information of user are updated；
The visual human identical with updated user current location and attitude information is created in the default virtual scene
Figure image.
Second aspect, the embodiment of the present invention additionally provide a kind of based on remote-operated image display device, the device bag
It includes：
First acquisition module, for obtaining the scene type of client transmission, according to the scene class of client transmission
Type chooses default virtual scene；
Second acquisition module, for obtaining the corresponding user image data of client；
Module is incorporated, for incorporating the corresponding user image data of client into the default virtual scene；
Display module, it is corresponding for the default virtual scene for incorporating the corresponding user image data of client to be sent to
Client, and it is shown in the client.
Further, further include：
Generation module, for obtaining the scene type of client transmission, the scene type sent according to the client
Before choosing default virtual scene, when the destination address for receiving client transmission obtains instruction, destination address is generated；
Correspondingly, it further includes：
Receiving module, for after the corresponding user image data of client is obtained, reception to be sent to the destination
The user image data of location.
Further, the involvement module includes：
Determination unit, for determining user current location and attitude information according to the user image data；
Creating unit, for creating the void identical with user current location and attitude information in the default virtual scene
Anthropomorphic figure image.
Further, the creating unit is specifically used for：
When the user image data changes, the location information and attitude information of user are updated；
The visual human identical with updated user current location and attitude information is created in the default virtual scene
Figure image.
The third aspect, the embodiment of the present invention additionally provide a kind of computer equipment, including memory, processor and are stored in
On memory and the computer program that can run on a processor, the processor are realized when performing described program as the present invention is real
It applies any described based on remote-operated method for displaying image in example.
Fourth aspect, the embodiment of the present invention additionally provide a kind of computer readable storage medium, are stored thereon with computer
Program, when which is executed by processor realize as described in any in the embodiment of the present invention based on remote-operated image display
Method.
The scene type that the embodiment of the present invention is sent by obtaining client, the scene type sent according to the client
Choose default virtual scene；Obtain the corresponding user image data of client；The corresponding user image data of client is incorporated
Into the default virtual scene；The virtual scene for incorporating the corresponding user image data of client is sent to corresponding client
End, and the client is shown in, it can realize the multiple person cooperational that extensive, multi-user participates in jointly.
Description of the drawings
Fig. 1 is a kind of flow chart based on remote-operated method for displaying image in the embodiment of the present invention one；
Fig. 2 is a kind of flow chart based on remote-operated method for displaying image in the embodiment of the present invention two；
Fig. 3 is a kind of structure diagram based on remote-operated image display device in the embodiment of the present invention three；
Fig. 4 is a kind of structure diagram of computer equipment in the embodiment of the present invention four.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention rather than limitation of the invention.It also should be noted that in order to just
Part related to the present invention rather than entire infrastructure are illustrated only in description, attached drawing.
Embodiment one
Fig. 1 be the embodiment of the present invention one in a kind of flow chart based on remote-operated method for displaying image, this implementation
Example is applicable to the situation based on remote-operated image display, and this method can be by being grasped in the embodiment of the present invention based on long-range
The image display device of work performs, which can be used software and/or the mode of hardware is realized, as shown in Figure 1, this method has
Body includes the following steps：
S110 obtains the scene type that client is sent, and the scene type sent according to the client chooses default void
Intend scene.
Wherein, the scene type that the client is sent can be auction context type, conference scenario type and teaching field
Scape type, comparison of the embodiment of the present invention are not limited.
Wherein, the mode for the scene type that the client is sent can be formal character scene class of the user by button
Type, or user is manually entered scene type, client can send the scene that information determines user's selection according to
Type, comparison of the embodiment of the present invention are not limited.
Specifically, shooting user images by the camera in each client, such as can be gathered by camera
The image data of user A.
Optionally, the scene type that client is sent is obtained, the scene type sent according to the client is chosen default
Before virtual scene, further include：
When the destination address for receiving client transmission obtains instruction, destination address is generated；
Wherein, the client is arbitrary client.
Specifically, when server receives the acquisition destination address instruction of client transmission, according to server it is current in
Deposit occupancy situation generation destination address.And after destination address is generated, destination address is sent to client, client bag
It includes：Apply for client and be invited to client, wherein, the application client is to obtain instruction to server sending destination location
Client.Such as can be instructed if customer end A is obtained to server sending destination location, customer end A is application client
End.
Wherein, the destination address is applies for the address of client request, when application user end to server sends purpose
When address obtains instruction, server generation destination address, the destination address is according to the size of the current memory space of server
It is allocated.For example, if server storage A remaining spaces are larger, by the address of memory space A address as a purpose.
Optionally, when receiving the destination address acquisition instruction that application client is sent, the storage in server is inquired about
The size in region, by the address of the larger storage region of remaining storage region address as a purpose.
Specifically, when receiving the destination address acquisition instruction that application client is sent, server is according to currently stored
The situation generation destination address in space, such as can be that customer end A, customer end B, client C and client D are intended to carry out long-range
Meeting, then customer end A is to the acquisition instruction of server sending destination location, and server is according to the raw destination of current memory space generation
Location.
Correspondingly, after obtaining the corresponding user image data of client, further include：
Receive the described image data for being sent to the destination address.
Specifically, destination address is sent to and is invited to visitor after client transmission invitation is invited in application client
Family end.
S120 obtains the corresponding user image data of client.
Wherein, the user image data includes at least the face image data of user, can also include the clothing of user
Data etc..
Wherein, the mode for obtaining the corresponding user image data of client can be to be obtained by the camera built in client
Take user image data, or prestored user image data in the client, when needing using user image data, directly
Connect calling user image data.
Specifically, obtaining the corresponding image data of client, such as can be to obtain the corresponding client A images of customer end A
Data obtain the corresponding client B image datas of user terminal B.
S130 incorporates the corresponding user image data of client into the default virtual scene.
Wherein, the default virtual scene is the image that can bring 3D effect to user by VR glasses.
Wherein, the default virtual scene is the virtual scene image for different scenes pre-established.
Wherein, the corresponding user images of client are incorporated into the default virtual scene.
Specifically, first according to client send scene type select virtual scene, then by user image data incorporate to
In virtual scene, if afterwards be user posture or position change, can be directly changed user posture or
The corresponding image in position, need not be modified virtual scene, can so reduce the data volume of transmission, promote server
Processing speed.
The default virtual scene for incorporating the corresponding user image data of client is sent to corresponding client by S140,
And it is shown in the client.
Specifically, the default virtual scene for incorporating the corresponding user image data of client is sent to corresponding client
End, and it is shown in the on-screen display (osd) area of client.
Wherein, the client at least two.
In a specific example, customer end A, customer end B, client C and client D carry out remote auction, obtain
Corresponding default virtual scene is auctioned, obtains the image data A of customer end A, obtains the image data B of customer end B, obtains client
The image data C of C is held, the image data D of client D is obtained, the user image data in image data A is incorporated to the void
Intend in scene Q, the user image data in image data B is incorporated into the virtual scene Q, by the use in image data C
Family image data is incorporated into the virtual scene Q, and the user image data in image data D is incorporated to the virtual scene
In Q.And the virtual scene for incorporating the corresponding user image data of customer end A is sent to customer end A, customer end B, client C
With client D, and the on-screen display (osd) area of customer end A, customer end B, client C and client D are shown in；Client will be incorporated
The virtual scene of the corresponding user image datas of B is sent to customer end A, customer end B, client C and client D, and is shown in
Customer end A, customer end B, the on-screen display (osd) area of client C and client D；Incorporate the corresponding user image datas of client C
Virtual scene be sent to customer end A, customer end B, client C and client D, and be shown in customer end A, customer end B, client
Hold the on-screen display (osd) area of C and client D；The virtual scene for incorporating the corresponding user image datas of client D is sent to client
A, customer end B, client C and client D are held, and the screen for being shown in customer end A, customer end B, client C and client D is shown
Show region.
The invention belongs to technical field of virtual reality, it is specifically a kind of for realized in virtual reality applications it is long-range,
The distributed more people's real-time collaborative new technologies in strange land.With traditional virtual practical application one, compared with the mode of operation of unit, the present invention
The multi-person synergy method proposed in embodiment makes full use of Distributed Calculation, network communication, real-time graph the technologies such as to render, will not
With terminal device interconnection get up, collaborative simulation cluster is formed, so that more human bodies are tested, operate Same Scene and be possibly realized.
The distributed multi-person synergy technology of virtual reality engine is used for proposed in the embodiment of the present invention, is directed primarily to virtual reality skill
Art and computer network communication technology.
In general, virtual reality engine provide figure render, audio and video management, file system, scene management and
The function modules such as network communication.Figure renders the sequence of operations that the three-dimensional data of user is mainly passed through to rendering pipeline, such as
Vertex data conversion, pel assembling, illumination calculation, texture mapping and rasterisation and etc., three-dimensional scenic is plotted to calculating
On machine screen.However, the frame per second that computer graphical renders is often depending on operation most slow in rendering pipeline, in order to ensure user
Stable, continuous picture output is viewed on the screen, and the figure of virtual reality engine, which renders frame rate, must not generally be less than often
Second 25 frames.File system is then mainly used for managing resource file all in current scene, such as model file, material text
The files such as part, texture mapping, audio-video document and tinter, the virtual reality engine haveing excellent performance can provide resource toward contact
File loads automatically after changing, newer function, applies to check the modification to scene so as to which user be avoided repeatedly to restart
As a result.Scene management is a kind of higher management mechanism provided three-dimensional scenic, and virtual reality engine is generally needed in the more new stage
It does substantial amounts of calculating, such as node updates, cuts regarding centrum, collision detection operation, when scene is larger, such as nodal point
When number, scene triangle gridding are more, can seriously affect scene renders frame per second, can not ensure virtual reality engine stabilization compared with
High renders frame per second, and then influences user experience.Scene management function is an important skill of virtual reality engine improving performance
Scene in initial phase, is carried out region division by art approach, only need to update in each frame of real-time rendering, render it is current
Moment specifies regional nodes, the data of model, so as to significantly promote the real-time of virtual reality engine and render
Frame per second, it is ensured that optimal user experience effect.
However, most virtual reality applications are all single cpu modes at present, i.e. one, the mode of operation of single-view are divided
Cloth can not simultaneously participate in same virtual scene in the other users of different geographical and interact, and which also limits virtual realities
Technology is in the application of the more people in the strange lands such as distance education training, multiple person cooperational.By computer network communication technology, can realize by
The computer interconnection of various regions is distributed in, and then realizes client-side information intercommunication, it is distributed more that this has also established long-range strange land
The basis of people's collaboration.
In distributed collaboration, Collaboration Server is also equipped in addition to completing scene state synchronously：It is extremely strong fault-tolerant and
Self-repairing capability：When going offline occurs in collaboration customer, data packetloss and illegal operation are when abnormal behaviours, Collaboration Server should
Abnormality processing can be carried out automatically, it is ensured that cooperating data are accurate, are forwarded to client in real time；Self starts, self repaiies
Reactivation power：When Collaboration Server is improper to be exited, server should complete self startup, self-regeneration, so as to continue with association
With the ability of data；The collection of synergistic data merges ability：The status change data for cooperateing with scene interior joint is merged,
The node data of all collaborations is stored, it is ensured that the scene of the rear user's scene and other collaborative users for adding in multi-person synergy
It is completely the same；The user that room creates is completed, collaboration role will be automatically converted to room master, and room master can not only carry out
Scene is synchronous, is also equipped with following exclusive function：Location following function：Other collaborative users is controlled to follow oneself in scene is cooperateed with
Position, so as to ensure the efficiency of cooperating；Picture monitoring function：Under multi-person synergy pattern, the main unlatching picture in room
Face monitoring function rear engine will show the current visual angle of all collaborative users on Main form；
A kind of strange land distribution multi-person synergy technology proposed in the embodiment of the present invention reduces the medium-and-large-sized activity of real world
Cooperation and mated condition and process, each participant takes the helmet, with respective visual angle, browsing and operation Same Scene,
Mutually synergistically work together.The manager of multi-person synergy can not only manage the participant for participating in cooperating, but also can
To see the real-time scene in each participant's helmet.With reference to high refresh rate, high-precision more human action capturing technologies, meet remote
The business demands such as teaching, training, Virtual assemble, virtual real training and prototype review under the multi-person synergy of journey strange land.
In addition, the coordination technique that the invention proposes is unrelated with virtual reality display device, different display devices is interconnected,
Shield the difference of virtual reality hardware, additionally it is possible to which the equipment interference being largely avoided between centralized tracing system carries
The stability of the system of liter.Strange land distribution multi-person synergy inevitably faces the transmission of mass data in collaborative processes,
Collaboration Server is present with the problem of delay, obstruction etc. influence user experience during processing, forwarding data, how not
On the premise of reduction renders frame per second, a difficult point and emphasis that synergistic data is strange land distributed collaboration are transmitted in real time.The present invention
Active multithreading asynchronous process, the operational order of each node of forwarding collaboration are employed, i.e., the node of no any operation is only born
Duty receives data and more new scene from server, and the node transfer operation type of user's operation and operation as a result, from
And requirement of the cooperating to server bandwidth is reduced, realize the real-time of multi-person synergy.
The technical solution of the present embodiment, the scene type sent by obtaining client, sends according to the client
Scene type chooses default virtual scene；Obtain the corresponding user image data of client；By the corresponding user images of client
Data are incorporated into the default virtual scene；The virtual scene for incorporating the corresponding user image data of client is sent to pair
The client answered, and the client is shown in, it can realize the multiple person cooperational that extensive, multi-user participates in jointly.
Embodiment two
Fig. 2 be the embodiment of the present invention two in a kind of flow chart based on remote-operated method for displaying image, this implementation
Example optimized based on above-described embodiment one, in the present embodiment, by the corresponding user image data of client incorporate to
The default virtual scene includes：User current location and attitude information are determined according to the user image data；Described
The virtual figure image identical with user current location and attitude information is created in default virtual scene.
As shown in Fig. 2, the method for the present embodiment specifically comprises the following steps：
S210 obtains the scene type that client is sent, and the scene type sent according to client chooses default virtual field
Scape.
S220 obtains the corresponding user image data of client.
S230 determines user current location and attitude information according to user image data.
Specifically, the user image data in the image data that extraction camera obtains, is analyzed according to user image data
User current location and attitude information.
S240 creates the virtual figure image identical with user current location and attitude information in default virtual scene.
Specifically, the virtual portrait image identical with user current location and attitude information is added in virtual scene, it can
Think that user images are converted to 3D rendering incorporates into virtual scene.
The default virtual scene for incorporating the corresponding user image data of client is sent to corresponding client by S250,
And it is shown in client.
Optionally, the virtual portrait identical with user current location and attitude information is created in the default virtual scene
Image includes：
When the user image data changes, the location information and attitude information of user are updated；
Wherein, the user image data changes as the user image data of before the moment and the user images at rear a moment
Data are different, according to the change of user image data, determine the change of the location information and attitude information of user, and update user
Location information and attitude information, keep default virtual scene constant if user is not changed default virtual scene.
The visual human identical with updated user current location and attitude information is created in the default virtual scene
Figure image.
Specifically, virtual identical with attitude information of updated user current location is created in default virtual scene
Figure image.
In a specific example, one, unit, single-view can only be provided for current most of virtual reality applications
Operating experience, the problems such as can not realizing the multiple person cooperational that extensive, multi-user participates in jointly.The embodiment of the present invention mainly proposes
It is a kind of to be suitable for the general long-range strange land multi-person synergy methods in fields such as virtual reality teaching, training and achievements exhibition.With biography
System is compared using one, the mode of operation of unit, and the long-range strange land multi-person synergy method proposed in the present invention makes full use of distribution
Formula calculating, network communication, real-time graph such as render at the technologies, and different terminal device interconnections is got up, forms collaborative simulation cluster,
So that more human bodies are tested, operate Same Scene and be possibly realized.Synergistic method in the embodiment of the present invention is broadly divided into following step
Suddenly：Start multi-person synergy service under LAN or wan environment, the establishment room of main monitoring users adds in the clothes such as room
Business request, and it is responsible for the synergistic data of forwarding scene in real time；Room master creates collaboration room on Collaboration Server, other collaborations
User then adds in the collaboration room created and realizes the multiparty collaboration in same virtual environment；Cooperative client will be in scene
Operational order data the sequence of operations such as integrated, be packaged, being encrypted after be sent to Collaboration Server.Server is receiving
It will be decrypted, merge, being packaged, encrypting after synergistic data, and being then distributed to all clients for being connected to Collaboration Server again
End；Cooperative client receives the synergistic data that server is sent, will be according to cooperation with service data in the scene state more new stage
It is updated, it is ensured that the client scene state of all participation cooperatings is consistent, so as to fulfill long-range strange land multi-person synergy
Cooperation.Room is closed, terminates multi-person synergy service.In addition, the embodiment of the present invention is innovatively realized passes through biography in collaborative processes
Operational order stream is passed to substitute collaboration image data, requirement of the multi-person synergy to network bandwidth is not only significantly reduced, also exists
The maximum number of connections of multi-person synergy is largely expanded, has realized that strange land, more people are efficiently linked up, cooperate, taught for virtual reality
, training and achievements exhibition etc. provide effective solution.
In another specific example, distributed collaboration offer data on arbitrary Net-connected computer are provided first and are connect
The multi-person synergy server of the services such as receipts, processing, forwarding.During multi-person synergy, the data flow of system transmission is operation
Instruction stream so as to significantly reduce requirement of the multi-person synergy to network bandwidth, also largely ensure that distribution is more
Real-time, the validity of people's collaboration.After any client execution establishment collaboration room step for participating in collaboration, remaining client adds
Distributed real-time collaborative state can be entered by entering corresponding room on server.
Network is to will be distributed over the work station isolated in different geographical or computer connection with physical link, and composition is mutually
Connection, the data link of intercommunication, so as to fulfill data sharing, the purpose of information mutual communication.Socket (socket) is to support TCP/IP
The basic operation unit of the network communication of agreement and the foundation stone of network communication.It is the abstract of endpoint during network communication
It represents, includes the progress necessary five kinds of information of network communication：Connect the agreement used, the IP address of local host, local process
Protocol port, the IP address of remote ground host, the protocol port of remote ground process.Application layer is by transport layer into row data communication
When, the problem of TCP can run into while provide concurrent services for multiple program process.Multiple TCP connections are multiple using journey
Sequence process may be needed through same Transmission Control Protocol port transmission data.In order to distinguish different program process and connection,
Many computer operating systems interact with ICP/IP protocol for application program and provide socket Socket interfaces.Application layer can be with
With transport layer by Socket interfaces, the communication from different application process or network connection is distinguished, realizes data transmission
Concurrent services.
Network topology (Network Topology) is another important content in computer network communication, is directly determined
The component type of network, communication mode and quality etc..Network topology structure refers to the object that various equipment are interconnected with transmission medium
Removing the work office, it refer to refer to specific physics between the member for forming network i.e. really or the i.e. virtual arrangement side of logic
Formula.Network topology structure common at present mainly has：Hub-and-spoke configuration, loop configuration, bus type structure, tree structure and netted
Formula structure below will be briefly described above-mentioned 5 kinds of network topology structures：Hub-and-spoke configuration refers to each work station or computer
Connected in a manner of " star ", each client is directly connected with central node, it is simple in structure, convenient for assembling be that its is most important
Feature, but this network topology structure cost is higher, resource sharing capability and reliability are poor.Loop configuration is institute in network
Some work stations or host join end to end to form the ring of a closure, and information transmission is to be transferred to another visitor from a client
Family end.Since annular link is closing, it is not easy to extend, reliability is poor, once wherein failure has occurred in some node, that
Whole network, which will be directly resulted in, to be worked normally, therefore the maintenance difficulties of loop network are larger, malfunctioning node positioning compared with
It is difficult.Bus type structure refers to that a work station and server are hung on same main line, and each work station status for being connected into network is put down
Deng, no center control client, data transmission be by transmission client, be diffused to network both ends.Bus-network
It is simple in structure, expandability is good, similar with ring topology mode, bus type structure is difficult in maintenance, a certain client in network
It is difficult investigation if breaking down.Tree structure is the centralized network of classification, compared with star network, the communication of tree structure
Total line length is shorter, and client expansion is more convenient, and it is more convenient to find data transfer path.It should be noted that it is setting
In the network of shape structure, the client failures in leaf node can't cause network failure, but internal node
Client failure can influence normal network transmission.Net like structure can be all connected two-by-two between all devices in network, this
Kind connection mode cost is higher, generally just can use network topology using this only when each client frequently will send information
Structure, but this network topology structure reliability is higher, fault-tolerant ability is stronger, and client failure does not interfere with the positive normal open of network
Letter.In view of star structure it is simple, convenient for networking, the technical solution proposed in the embodiment of the present invention is based on star network topology
Structure carries out networking, and passes through Socket sockets and carry out data transmission between server and client.
Multiple Collaboration Servers can be configured in consolidated network, being connected between the client of same server just allows to assist
Make.Network module in virtual reality engine can also occupy certain hardware resource cost, and association is obtained from Socket sockets
Same data are parsed according to the agreement used when transmitting, then carry out assignment for the node in scene, so as to fulfill collaboration field
The state update of scape, aforesaid operations can also occupy the substantial amounts of computing resource of virtual reality engine.In general, application program can pin
Independent thread is established to network communication to complete the processes such as the pretreatment of data, transmission, parsing, so as to reduce network communication pair
Virtual reality engine renders the influence of frame per second, ensures the execution efficiency of virtual reality engine.
The strange land distribution multi-person synergy proposed in the embodiment of the present invention provides not only anthropomorphic three dimensional task model, side
Just cooperating of the user in virtual scene in addition, distributed multi-person synergy has real-time high-efficiency, is not required to modification scene just
Can support the multi-person synergy of scene, flexibility and scalability be tradition one, stand-alone application it is incomparable.It is based on
The remote distributed multi-person synergy service of C/S frameworks, is broadly divided into server service and client service.Client is mainly completed
Room is added in, sends the variable condition of current scene to server, and receives other cooperative client scenes of server forwarding
Variable quantity the node in scene is updated.Corresponding server is then responsible for receiving all cooperative client hairs
The synergistic data come, and be forwarded to, it is synchronous so as to fulfill the scene of long-range strange land distribution multi-person synergy.Client-side program is transported
After row, network cooperating function is first turned on, carries out the initialization of network cooperating, carries out message monitoring in designated port, then
Connection Service device, if connection failure shows miscue pop-up, if successful connection, it is possible to create room or add in others
The room created.If client executing be create room if, client can to server send create room
Instruction message, if create can unsuccessfully receive server return establishment failure, if created successfully, receive service
The successful message of establishment and the unique client ID of server-assignment that device returns, other rooms cannot be created before exiting room again
Or add in other rooms.Hereafter multi-person synergy can be carried out with the other users added in room.If room is added in, to clothes
Business device sends the room number that request adds in, if room number is not present, receives the message that the room of server return is not present, such as
Fruit room number exists, then adds in room success, can carry out multi-person synergy with other users in room.Open multi-person synergy service
Service monitoring can be carried out in the specified network port after device, if server receives client message, can judge message class first
Type if type of message is " Connection Service device ", determines whether it is established connection, if being successfully established connection
Repetition connection prompting is then returned, is otherwise attached thereto and returns to the message notifying of successful connection.If type of message is " to create room
Between ", then room information is initialized, returns and creates successful message and room ID.If type of message is " addition room ", search
The room number added in is asked, is added it to if finding in the room, returns and adds in the successful message in room, otherwise return
Return addition room failure.If type of message is " losing connection ", room is removed it.If type of message is certainly
Type of message is defined, then is sent to data monitor processing message.Scene synchronization flow：Scene is detected in Update functions
Delta data is encoded into Json data flows, is stored in data monitor queue by variation.Network manager is mainly for detection of data
Whether monitor queue has data, and server is sent to if there is Json data are packaged into Raknet data packets by data.Detection
The self-defined message of server whether is received, if there is message, monitor is sent to, parses Json data, realizes collaboration scene
Real-time synchronization.
Communication mode of the distributed multi-person synergy based on client and server in the embodiment of the present invention is developed.By
Then the information that the processing client of server independence is sent feeds back to client, does not share money directly mutually between client
Source.Information Security can farthest be ensured by so doing.Network communication except realizing multi-person synergy, for specific empty
When the plan more people of scene operate same scene simultaneously, we have also carried out clash handle and Network Abnormal processing, work as network
We can make client carry out Auto-reconnect and update the data of current scene when abnormal, all are all unwitting in user
In the case of carry out, avoid disagreeableness experience.
The technical solution of the present embodiment, the scene type sent by obtaining client, sends according to the client
Scene type chooses default virtual scene；Obtain the corresponding user image data of client；By the corresponding user images of client
Data are incorporated into the default virtual scene；The virtual scene for incorporating the corresponding user image data of client is sent to pair
The client answered, and the client is shown in, it can realize the multiple person cooperational that extensive, multi-user participates in jointly.
Embodiment three
Fig. 3 is a kind of structure diagram based on remote-operated image display device in the embodiment of the present invention three.This
Embodiment is applicable to the situation based on remote-operated image display, which can be used software and/or the mode of hardware is real
Existing, which can be integrated in any equipment of the offer based on remote-operated image display function, as shown in figure 3, the base
It is specifically included in remote-operated image display device：First acquisition module 310, the second acquisition module 320 incorporate module 330
With display module 340.
Wherein, the first acquisition module 310 for obtaining the scene type of client transmission, is sent according to the client
Scene type choose default virtual scene；
Second acquisition module 320, for obtaining the corresponding user image data of client；
Module 330 is incorporated, for incorporating the corresponding user image data of client into the default virtual scene；
Display module 340, for the default virtual scene for incorporating the corresponding user image data of client to be sent to pair
The client answered, and it is shown in the client.
Optionally, further include：
Generation module, for obtaining the scene type of client transmission, the scene type sent according to the client
Before choosing default virtual scene, when the destination address for receiving client transmission obtains instruction, destination address is generated；
Correspondingly, it further includes：
Receiving module, for after the corresponding user image data of client is obtained, reception to be sent to the destination
The user image data of location.
Optionally, the involvement module includes：
Determination unit, for determining user current location and attitude information according to the user image data；
Creating unit, for creating the void identical with user current location and attitude information in the default virtual scene
Anthropomorphic figure image.
Optionally, the creating unit is specifically used for：
When the user image data changes, the location information and attitude information of user are updated；
The visual human identical with updated user current location and attitude information is created in the default virtual scene
Figure image.
The technical solution of the present embodiment, the scene type sent by obtaining client, sends according to the client
Scene type chooses default virtual scene；Obtain the corresponding user image data of client；By the corresponding user images of client
Data are incorporated into the default virtual scene；The virtual scene for incorporating the corresponding user image data of client is sent to pair
The client answered, and the client is shown in, it can realize the multiple person cooperational that extensive, multi-user participates in jointly.
Example IV
Fig. 4 is a kind of structure diagram of computer equipment in the embodiment of the present invention four.Fig. 4 shows to be used for real
The block diagram of the exemplary computer device 12 of existing embodiment of the present invention.The computer equipment 12 that Fig. 4 is shown is only one and shows
Example, should not bring any restrictions to the function and use scope of the embodiment of the present invention.
As shown in figure 4, computer equipment 12 is showed in the form of universal computing device.The component of computer equipment 12 can be with
Including but not limited to：One or more processor or processing unit 16, system storage 28 connect different system component
The bus 18 of (including system storage 28 and processing unit 16).
Bus 18 represents the one or more in a few class bus structures, including memory bus or Memory Controller,
Peripheral bus, graphics acceleration port, processor or the local bus using the arbitrary bus structures in a variety of bus structures.It lifts
For example, these architectures include but not limited to industry standard architecture (ISA) bus, microchannel architecture (MAC)
Bus, enhanced isa bus, Video Electronics Standards Association (VESA) local bus and peripheral component interconnection (PCI) bus.
Computer equipment 12 typically comprises various computing systems readable medium.These media can be it is any can be by
The usable medium that computer equipment 12 accesses, including volatile and non-volatile medium, moveable and immovable medium.
System storage 28 can include the computer system readable media of form of volatile memory, such as arbitrary access
Memory (RAM) 30 and/or cache memory 32.Computer equipment 12 may further include it is other it is removable/can not
Mobile, volatile/non-volatile computer system storage medium.Only as an example, storage system 34 can be used for read-write not
Movably, non-volatile magnetic media (Fig. 4 is not shown, is commonly referred to as " hard disk drive ").Although not shown in Fig. 4, can with
It provides for moving the disc driver of non-volatile magnetic disk (such as " floppy disk ") read-write and to removable non-volatile
The CD drive of CD (such as CD-ROM, DVD-ROM or other optical mediums) read-write.In these cases, each driving
Device can be connected by one or more data media interfaces with bus 18.Memory 28 can include at least one program and produce
Product, the program product have one group of (for example, at least one) program module, these program modules are configured to perform of the invention each
The function of embodiment.
Program/utility 40 with one group of (at least one) program module 42 can be stored in such as memory 28
In, such program module 42 includes --- but being not limited to --- operating system, one or more application program, other programs
Module and program data may include the realization of network environment in each or certain combination in these examples.Program mould
Block 42 usually performs function and/or method in embodiment described in the invention.
Computer equipment 12 can also be with one or more external equipments 14 (such as keyboard, sensing equipment, display 24
Deng) communication, the equipment interacted with the computer equipment 12 communication can be also enabled a user to one or more and/or with making
Obtain any equipment that the computer equipment 12 can communicate with one or more of the other computing device (such as network interface card, modulatedemodulate
Adjust device etc.) communication.This communication can be carried out by input/output (I/O) interface 22.In addition, the calculating in the present embodiment
Machine equipment 12, display 24 exist not as independent individual, but in embedded minute surface, it is not aobvious in the display surface of display 24
When showing, the display surface of display 24 visually combines together with minute surface.Also, computer equipment 12 can also be fitted by network
Orchestration 20 and one or more network (such as LAN (LAN), wide area network (WAN) and/or public network, such as internet)
Communication.As shown in the figure, network adapter 20 is communicated by bus 18 with other modules of computer equipment 12.It should be understood that the greatest extent
Pipe is not shown in figure, and can be combined computer equipment 12 and be used other hardware and/or software module, include but not limited to：Micro- generation
Code, device driver, redundant processing unit, external disk drive array, RAID system, tape drive and data backup are deposited
Storage system etc..
Processing unit 16 is stored in program in system storage 28 by operation, so as to perform various functions application and
Data processing, for example, realize the embodiment of the present invention provided based on remote-operated method for displaying image：Obtain client hair
The scene type sent, the scene type sent according to the client choose default virtual scene；Obtain the corresponding use of client
Family image data；The corresponding user image data of client is incorporated into the default virtual scene；Client pair will be incorporated
The default virtual scene for the user image data answered is sent to corresponding client, and is shown in the client.
Embodiment five
The embodiment of the present invention five provides a kind of computer readable storage medium, is stored thereon with computer program, the journey
It is realized when sequence is executed by processor if all inventive embodiments offers of the application are based on remote-operated method for displaying image：It obtains
The scene type that client is taken to send, the scene type sent according to the client choose default virtual scene；Obtain client
Hold corresponding user image data；The corresponding user image data of client is incorporated into the default virtual scene；It will melt
The default virtual scene for entering the corresponding user image data of client is sent to corresponding client, and is shown in the client
End.
Any combination of one or more computer-readable media may be employed.Computer-readable medium can be calculated
Machine readable signal medium or computer readable storage medium.Computer readable storage medium for example can be --- but it is unlimited
In --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device or it is arbitrary more than combination.It calculates
The more specific example (non exhaustive list) of machine readable storage medium storing program for executing includes：Electrical connection with one or more conducting wires, just
It takes formula computer disk, hard disk, random access memory (RAM), read-only memory (ROM), erasable type and may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.In this document, computer readable storage medium can any include or store journey
The tangible medium of sequence, the program can be commanded the either device use or in connection of execution system, device.
Computer-readable signal media can include in a base band or as carrier wave a part propagation data-signal,
Wherein carry computer-readable program code.Diversified forms may be employed in the data-signal of this propagation, including --- but
It is not limited to --- electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be
Any computer-readable medium beyond computer readable storage medium, which can send, propagate or
Transmission for by instruction execution system, device either device use or program in connection.
The program code included on computer-readable medium can be transmitted with any appropriate medium, including --- but it is unlimited
In --- wireless, electric wire, optical cable, RF etc. or above-mentioned any appropriate combination.
It can write to perform the computer that operates of the present invention with one or more programming languages or its combination
Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++,
Further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with
It fully performs, partly perform on the user computer on the user computer, the software package independent as one performs, portion
Divide and partly perform or perform on a remote computer or server completely on the remote computer on the user computer.
Be related in the situation of remote computer, remote computer can pass through the network of any kind --- including LAN (LAN) or
Wide area network (WAN)-be connected to subscriber computer or, it may be connected to outer computer (such as is carried using Internet service
Pass through Internet connection for business).
Note that it above are only presently preferred embodiments of the present invention and institute's application technology principle.It will be appreciated by those skilled in the art that
The invention is not restricted to specific embodiment described here, can carry out for a person skilled in the art various apparent variations,
It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above example to the present invention
It is described in further detail, but the present invention is not limited only to above example, without departing from the inventive concept, also
It can include other more equivalent embodiments, and the scope of the present invention is determined by scope of the appended claims.
Claims (10)
1. one kind is based on remote-operated method for displaying image, which is characterized in that including：
The scene type that client is sent is obtained, the scene type sent according to the client chooses default virtual scene；
Obtain the corresponding user image data of the client；
The corresponding user image data of the client is incorporated into the default virtual scene；
The default virtual scene for incorporating the corresponding user image data of the client is sent to corresponding client, and is shown
In the client.
2. according to the method described in claim 1, it is characterized in that, the scene type that client is sent is obtained, according to the visitor
Before the scene type that family end is sent chooses default virtual scene, further include：
When the destination address for receiving client transmission obtains instruction, destination address is generated；
Correspondingly, after obtaining the corresponding user image data of the client, further include：
Receive the user image data for being sent to the destination address.
3. according to the method described in claim 1, it is characterized in that, by the corresponding user image data of the client incorporate to
The default virtual scene includes：
User current location and attitude information are determined according to the user image data；
The virtual figure image identical with user current location and attitude information is created in the default virtual scene.
4. it according to the method described in claim 3, it is characterized in that, is created and user's present bit in the default virtual scene
Putting the virtual figure image identical with attitude information includes：
When the user image data changes, the location information and attitude information of user are updated；
The virtual figure image identical with updated user current location and attitude information is created in the virtual scene.
5. one kind is based on remote-operated image display device, which is characterized in that including：
First acquisition module, for obtaining the scene type of client transmission, the scene type sent according to the client is selected
Take default virtual scene；
Second acquisition module, for obtaining the corresponding user image data of the client；
Module is incorporated, for incorporating the corresponding user image data of the client into the default virtual scene；
Display module, for the default virtual scene for incorporating the corresponding user image data of client to be sent to corresponding client
End, and it is shown in the client.
6. device according to claim 5, which is characterized in that further include：
Generation module, for obtaining the scene type of client transmission, the scene type sent according to the client is chosen
Before default virtual scene, when the destination address for receiving client transmission obtains instruction, destination address is generated；
Correspondingly, it further includes：
Receiving module, for after the corresponding user image data of client is obtained, reception to be sent to the destination address
The user image data.
7. device according to claim 5, which is characterized in that the involvement module includes：
Determination unit, for determining user current location and attitude information according to the user image data；
Creating unit, for creating the visual human identical with user current location and attitude information in the default virtual scene
Figure image.
8. device according to claim 7, which is characterized in that the creating unit is specifically used for：
When the user image data changes, the location information and attitude information of user are updated；
The virtual portrait shape identical with updated user current location and attitude information is created in the default virtual scene
As.
9. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor
Calculation machine program, which is characterized in that the processor realizes the side as described in any in claim 1-4 when performing described program
Method.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The method as described in any in claim 1-4 is realized during execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711328022.0A CN108052364A (en) | 2017-12-13 | 2017-12-13 | One kind is based on remote-operated method for displaying image, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711328022.0A CN108052364A (en) | 2017-12-13 | 2017-12-13 | One kind is based on remote-operated method for displaying image, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108052364A true CN108052364A (en) | 2018-05-18 |
Family
ID=62132152
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711328022.0A Pending CN108052364A (en) | 2017-12-13 | 2017-12-13 | One kind is based on remote-operated method for displaying image, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108052364A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110688080A (en) * | 2019-09-29 | 2020-01-14 | 深圳市未来感知科技有限公司 | Remote display method and device of three-dimensional picture and computer readable storage medium |
| CN110989842A (en) * | 2019-12-06 | 2020-04-10 | 国网浙江省电力有限公司培训中心 | Training method and system based on virtual reality and electronic equipment |
| WO2020078354A1 (en) * | 2018-10-16 | 2020-04-23 | 北京凌宇智控科技有限公司 | Video streaming system, video streaming method and apparatus |
| CN112492231A (en) * | 2020-11-02 | 2021-03-12 | 重庆创通联智物联网有限公司 | Remote interaction method, device, electronic equipment and computer readable storage medium |
| CN113179434A (en) * | 2021-04-19 | 2021-07-27 | 广州欢网科技有限责任公司 | VR-based television remote co-watching method and system |
| CN113179435A (en) * | 2021-04-19 | 2021-07-27 | 广州欢网科技有限责任公司 | Television remote karaoke method and system based on VR |
| CN113436495A (en) * | 2021-07-21 | 2021-09-24 | 航天科工系统仿真科技（北京）有限公司 | Many people coordinate equipment training system based on VR |
| CN114157907A (en) * | 2020-09-07 | 2022-03-08 | 华为云计算技术有限公司 | VR application design method and system based on cloud mobile phone |
| CN116384661A (en) * | 2023-03-10 | 2023-07-04 | 深圳职业技术学院 | Immersion type XR (X-ray diffraction) -based intelligent classroom teaching method, system and medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160292810A1 (en) * | 2013-10-23 | 2016-10-06 | Empire Technology Development Llc | Local management for intermediary graphics rendition |
| CN107426524A (en) * | 2017-06-06 | 2017-12-01 | 微鲸科技有限公司 | A kind of method and apparatus of the Multi-Party Conference based on virtual panoramic |
-
2017
- 2017-12-13 CN CN201711328022.0A patent/CN108052364A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160292810A1 (en) * | 2013-10-23 | 2016-10-06 | Empire Technology Development Llc | Local management for intermediary graphics rendition |
| CN107426524A (en) * | 2017-06-06 | 2017-12-01 | 微鲸科技有限公司 | A kind of method and apparatus of the Multi-Party Conference based on virtual panoramic |
Non-Patent Citations (6)
| Title |
|---|
| HAPPY梨花容: "https://tieba.baidu.com/p/4942663889?red_tag=3437754058", 《企业人员如何通过QQ或微信邀请同事和客户参加远程视频会议？》 * |
| 上海海事大学，中国物流与采购联合会: "《中国物流科技发展报告 2014-2015》", 31 October 2015 * |
| 张有录: "《媒体教学论》", 31 July 2008 * |
| 李维勇，夏继媛，杜亚杰，石建: "《Android项目驱动教程》", 31 August 2014 * |
| 程宏伟、蒋乐天: "基于Kinect的虚拟3D视频会议场景融合研究", 《计算机与数字工程》 * |
| 黄海: "《虚拟现实技术》", 31 January 2014, 北京邮电大学出版社 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020078354A1 (en) * | 2018-10-16 | 2020-04-23 | 北京凌宇智控科技有限公司 | Video streaming system, video streaming method and apparatus |
| US11500455B2 (en) | 2018-10-16 | 2022-11-15 | Nolo Co., Ltd. | Video streaming system, video streaming method and apparatus |
| CN110688080A (en) * | 2019-09-29 | 2020-01-14 | 深圳市未来感知科技有限公司 | Remote display method and device of three-dimensional picture and computer readable storage medium |
| CN110989842A (en) * | 2019-12-06 | 2020-04-10 | 国网浙江省电力有限公司培训中心 | Training method and system based on virtual reality and electronic equipment |
| CN114157907A (en) * | 2020-09-07 | 2022-03-08 | 华为云计算技术有限公司 | VR application design method and system based on cloud mobile phone |
| CN112492231A (en) * | 2020-11-02 | 2021-03-12 | 重庆创通联智物联网有限公司 | Remote interaction method, device, electronic equipment and computer readable storage medium |
| CN113179434A (en) * | 2021-04-19 | 2021-07-27 | 广州欢网科技有限责任公司 | VR-based television remote co-watching method and system |
| CN113179435A (en) * | 2021-04-19 | 2021-07-27 | 广州欢网科技有限责任公司 | Television remote karaoke method and system based on VR |
| CN113436495A (en) * | 2021-07-21 | 2021-09-24 | 航天科工系统仿真科技（北京）有限公司 | Many people coordinate equipment training system based on VR |
| CN116384661A (en) * | 2023-03-10 | 2023-07-04 | 深圳职业技术学院 | Immersion type XR (X-ray diffraction) -based intelligent classroom teaching method, system and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108011886A (en) | A kind of cooperative control method, system, equipment and storage medium | |
| CN108052364A (en) | One kind is based on remote-operated method for displaying image, device, equipment and storage medium | |
| CN107959687A (en) | A kind of data processing method, system, equipment and storage medium | |
| US20230245395A1 (en) | Re-creation of virtual environment through a video call | |
| Macedonia et al. | A taxonomy for networked virtual environments | |
| Leigh et al. | A review of tele-immersive applications in the CAVE research network | |
| CN102170361A (en) | Virtual-reality-based network conference method | |
| CN109885367A (en) | Interactive chat implementation method, device, terminal and storage medium | |
| CN104901815B (en) | A kind of group technology of user terminal, Conference server, conference system | |
| US20050253872A1 (en) | Method and system for culling view dependent visual data streams for a virtual environment | |
| CN110427227B (en) | Virtual scene generation method and device, electronic equipment and storage medium | |
| Huh et al. | XR collaboration architecture based on decentralized web | |
| US10891014B2 (en) | Remote view manipulation in communication session | |
| CN115766809A (en) | VR multi-person cooperative operation system | |
| Fechteler et al. | A framework for realistic 3D tele-immersion | |
| Theoktisto et al. | Enhancing collaboration in virtual reality applications | |
| CN108092868A (en) | One kind is based on remote-operated network-building method, device, equipment and storage medium | |
| Sudarsky et al. | Output-senstitive rendering and communication in dynamic virtual environments | |
| Yang et al. | Research on network architecture and communication protocol of network virtual reality based on image rendering | |
| Kharitonov | A software architecture for high-level development of component-based distributed virtual reality systems | |
| Zhao et al. | P‐2.8: Research on multi‐user interaction design in augmented reality | |
| KR20010055371A (en) | Networked Multi-User Dimension three dimensional graphic virtual reality system | |
| Rueda et al. | A comparative study of awareness methods for peer‐to‐peer distributed virtual environments | |
| Kharitonov | A Middleware for Integrating Components of Modern Distributed Virtual Reality Systems | |
| TW200924460A (en) | Automated real-time data stream switching in a shared virtual area communication environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhou Qinghui Inventor after: Li Gen Inventor after: Sun Wenquan Inventor after: Zhang Jianguo Inventor before: Zhou Qing Inventor before: Li Gen Inventor before: Sun Wenquan Inventor before: Zhang Jianguo |
|
| CB03 | Change of inventor or designer information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180518 |
|
| RJ01 | Rejection of invention patent application after publication |