CN111385152B

CN111385152B - Hardware management and content distribution system based on VR equipment

Info

Publication number: CN111385152B
Application number: CN202010172239.2A
Authority: CN
Inventors: 周清会; 于丽莎; 柳荣; 刘成
Original assignee: Shanghai Manheng Digital Technology Co ltd
Current assignee: Shanghai Manheng Digital Technology Co ltd
Priority date: 2020-03-12
Filing date: 2020-03-12
Publication date: 2021-08-06
Anticipated expiration: 2040-03-12
Also published as: CN111385152A

Abstract

The application relates to a hardware management and content distribution system based on VR equipment, and relates to the technical field of Internet. The system comprises a master end and a slave end: the main end application is installed on the central control host and/or the mobile terminal and comprises an intelligent central control module and a content management module; after a first account logs in a main terminal, intelligent central control management hardware equipment and a layout diagram are entered; after logging in the primary terminal, the second account enters intelligent central control and then automatically synchronizes equipment and layout information to form a unified control signal to uniformly control all equipment in the layout, and the equipment state of the secondary terminal is detected in real time through the layout; entering a content management module to perform content management and distribution operation; the slave application is installed on the computer of the connected device. According to the method and the device, the physical space layout of the device is integrated, the visual control management interface is generated, various tasks are carried out by the central control host or the mobile terminal, the unified management of the opening and closing of the device is achieved, the content is distributed or started through one key, and the like, so that the device is used efficiently, and the user experience is improved.

Description

Hardware management and content distribution system based on VR equipment

Technical Field

The application relates to the technical field of internet, in particular to a hardware management and content distribution system based on VR equipment.

Background

In recent years, with the rapid development of technologies such as Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and XR (X Reality, X representing an unknown variable), it is possible to realize different scenes such as Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and XR. With the development of VR technology, more and more institutions and universities begin to invest in resources to build VR laboratories and VR classrooms. A VR laboratory/VR classroom generally all possesses multiple equipment simultaneously, for example VR host computer helmet, VR all-in-one, the big screen of VR immersive, VR cave system etc.. However, the wide variety of equipment types may cause inconvenience in the operation and maintenance of a laboratory, the lecture course of a teacher, and the like. For laboratory administrators, classroom equipment is complicated in type and frequent in failure; the operation and maintenance personnel are more, and the management cost is high. For teachers, VR teaching equipment is new and various, and management difficulty is high; the equipment control learning cost is high; learning monitoring of each student cannot be realized.

Therefore, it is desirable to provide a hardware management and content distribution system based on VR devices, which integrates the physical space layout of the devices and generates a visual control management interface, and utilizes a central control host or a mobile terminal to perform various tasks, so as to implement unified management of the opening and closing of the devices, and one-key distribution or content starting, etc., so as to efficiently use the devices and improve user experience.

Disclosure of Invention

According to a first aspect of some embodiments of the present application, there is provided a hardware management and content distribution system based on a VR device, applied in a terminal scenario (e.g., a VR laboratory, etc.), the system including: the method comprises a master end and a slave end: the main end application is installed on the central control host and/or the mobile terminal and comprises an intelligent central control module and a content management module; after a first account logs in a main terminal, intelligent central control management hardware equipment and a layout diagram are entered; after logging in the primary terminal, the second account enters intelligent central control and then synchronizes equipment and layout information to form a unified control signal to uniformly control all equipment in the layout, and the equipment state of the secondary terminal is detected in real time through the layout; entering a content management module to perform content management and distribution operation; the slave application is installed on the computer of the connected device.

In some embodiments, after the first account logs in the host, entering the intelligent central control management hardware device and the layout comprises: creating a virtual space according to the actual space, and drawing a plane layout diagram of the virtual space; adding the devices in the device type list to the layout diagram in a dragging mode; adjusting the orientation of the equipment in the layout chart and determining the position of the equipment; and starting a Bluetooth list, and binding the virtual equipment in the layout drawing with the physical equipment in the actual space one by one.

In some embodiments, the bluetooth list records IP and Mac addresses of different devices, and after binding is completed, pairing information of all the devices is stored in a local database of the host.

In some embodiments, the unified control signal includes a one-key power on/off signal, and the device status of the slave includes power off, power on, during content distribution, failure in distribution, success in distribution, and during content running.

In some embodiments, the slave end feeds back the device state to the master end in the form of heartbeat packets during operation.

In some embodiments, after the second account logs in the host, entering the content management module for performing content management and distribution operations includes: entering a content management module to add content; the content is added by uploading local content or acquiring network resources; entering an intelligent central control module to distribute contents; and the content is directly dragged to the equipment in the layout diagram to complete distribution.

In some embodiments, the system may include: judging whether the content is matched with the current equipment type; if the matching is carried out, carrying out distribution operation; and if not, prompting through an interface.

In some embodiments, after the content distribution is successful, the master starts the content; the content comprises VR content and multimedia files.

In some embodiments, the distributing operation comprises: acquiring content, and segmenting the content into fixed byte slices through a main end; randomly assigning slices to different slave nodes; analyzing slice information required by the slave end; and controlling the slave to acquire the slices to other specified slaves.

In some embodiments, the content distribution operation incorporates cloud rendering techniques, compatible with host VR content and all-in-one VR content.

Therefore, according to the hardware management and content distribution system based on the VR device in some embodiments of the present application, a visual control management interface is generated by fusing the physical space layout of the device, and a central control host or a mobile terminal is used to perform various tasks, so as to implement unified management of the device on and off, and one-touch distribution or content start, etc., so as to efficiently use the device and improve user experience.

Drawings

For a better understanding and appreciation of some embodiments of the present application, reference will now be made to the description of embodiments taken in conjunction with the accompanying drawings, in which like reference numerals designate corresponding parts in the figures.

Fig. 1 is an exemplary schematic diagram of a VR device based hardware management and content distribution system provided in accordance with some embodiments of the present application.

Fig. 2 is a workflow diagram of an embodiment of a VR device based hardware management and content distribution system provided in accordance with some embodiments of the present application.

Fig. 3 is an exemplary topology diagram of a VR device based hardware management and content distribution system provided in accordance with some embodiments of the present application.

Detailed Description

The following description, with reference to the accompanying drawings, is provided to facilitate a comprehensive understanding of various embodiments of the application as defined by the claims and their equivalents. These embodiments include various specific details for ease of understanding, but these are to be considered exemplary only. Accordingly, those skilled in the art will appreciate that various changes and modifications may be made to the various embodiments described herein without departing from the scope and spirit of the present application. In addition, descriptions of well-known functions and constructions will be omitted herein for brevity and clarity.

The terms and phrases used in the following specification and claims are not to be limited to the literal meaning, but are merely for the clear and consistent understanding of the application. Accordingly, it will be appreciated by those skilled in the art that the description of the various embodiments of the present application is provided for illustration only and not for the purpose of limiting the application as defined by the appended claims and their equivalents.

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the accompanying drawings in some embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It is to be understood that the terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only, and is not intended to be limiting of the application. As used in the examples of this application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. The expressions "first", "second", "the first" and "the second" are used for modifying the corresponding elements without regard to order or importance, and are used only for distinguishing one element from another element without limiting the corresponding elements.

A terminal (master or slave) according to some embodiments of the present application may be an electronic device, which may include one or a combination of several of a personal computer (PC, e.g., tablet, desktop, notebook, netbook, PDA), a client device, a virtual reality device (VR), a renderer, a smartphone, a mobile phone, an e-book reader, a Portable Multimedia Player (PMP), an audio/video player (MP3/MP4), a camera, a wearable device, and the like. According to some embodiments of the present application, the wearable device may include an accessory type (e.g., watch, ring, bracelet, glasses, or Head Mounted Device (HMD)), an integrated type (e.g., electronic garment), a decorative type (e.g., skin pad, tattoo, or built-in electronic device), and the like, or a combination of several. In some embodiments of the present application, the electronic device may be flexible, not limited to the above devices, or may be a combination of one or more of the above devices. In this application, the term "user" may indicate a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

The embodiment of the application provides a hardware management and content distribution system based on VR equipment. In order to facilitate understanding of the embodiments of the present application, the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Fig. 1 is an exemplary schematic diagram of a VR device based hardware management and content distribution system provided in accordance with some embodiments of the present application. As shown in fig. 1, a VR device based hardware management and content distribution system 100 may include a network 110, a master 120, a slave 130, and the like. Specifically, the master 120 and the slave 130 establish communication through a network, for example, the master 120 and the slave 130 may communicate in the same local area network (e.g., a network environment of the same router, etc.). Further, the master 120 may be connected to the network 110 by a wired (e.g., a network cable, etc.) or a wireless (e.g., a WIFI, etc.), and the slave 130 may establish a communication connection with the network 110 by a wired or a wireless (e.g., a WIFI, etc.) or the like. In some embodiments, the master 120 may send content or the like to the slave 130. Further, the slave 130 may feed back information and the like to the master 120. Based on the feedback information, the master 120 may determine the device status of the slave 130. By way of example, the device status of the slave may include, but is not limited to, power off, power on, during content distribution, distribution failure, distribution success, content running, and the like.

According to some embodiments of the present application, the master 120, the slave 130 may be the same or different terminal devices, and the like. The terminal device may include, but is not limited to, a smart terminal, a mobile terminal, a computer, a rendering machine, and the like. In a VR scenario, the master 120 may include a central control host, a computer, and the like, and an Application (APP) of the master 120 is installed on the central control host; the slave 130 may include a computer and VR equipment, or a VR all-in-one machine, and an Application (APP) of the slave 130 is installed on the computer connected to the equipment.

In some embodiments of the present application, the VR device based hardware management and content distribution system 100 may omit one or more elements, or may further include one or more other elements. By way of example, the VR device based hardware management and content distribution system 100 can include a plurality of slaves 130, such as a plurality of VR all-in-one machines and the like. The plurality of slaves 130 may be online at the same time, or partially online. As another example, the VR device based hardware management and content distribution system 100 can include a plurality of hosts 120. As another example, the VR device based hardware management and content distribution system 100 may further include a server, which is a kind of computer, and has advantages of faster operation, higher load, and the like than a general computer, and the corresponding price is higher. In a network environment, a server may provide computing or application services to other clients (e.g., terminals such as PCs, smart phones, ATMs, and large devices such as transportation systems). The server has high-speed CPU computing capability, long-time reliable operation, strong I/O external data throughput capability and better expansibility. The services that the server may provide include, but are not limited to, the ability to undertake responding to service requests, undertake services, secure services, and the like. The server, as an electronic device, has an extremely complex internal structure, including an internal structure similar to that of a general computer, and the like, and the internal structure of the server may include a Central Processing Unit (CPU), a hard disk, a memory, a system bus, and the like, as an example.

The Network 110 may be any type of communication Network, which may include a computer Network (e.g., a Local Area Network (LAN) or Wide Area Network (WAN)), the internet and/or a telephone Network, etc., or a combination of several. In some embodiments, the network 110 may be other types of wireless communication networks. The wireless communication may include microwave communication and/or satellite communication, among others. The Wireless communication may include cellular communication, such as Global System for Mobile Communications (GSM), Code Division Multiple Access (CDMA), third Generation Mobile communication (3G, The 3rd Generation communication), fourth Generation Mobile communication (4G), fifth Generation Mobile communication (5G), sixth Generation Mobile communication (6G), Long Term Evolution (LTE-a), Wideband Code Division Multiple Access (WCDMA), Universal Mobile Telecommunications System (UMTS), Wireless Broadband (bro, Wireless) and The like, or a combination thereof. In some embodiments, the slave 130 may be other electronic devices with equivalent functional modules, and the electronic devices may include one or a combination of several of a virtual reality device (VR), a rendering machine, a personal computer (PC, such as a tablet computer, a desktop computer, a notebook, a netbook, a PDA), a smart phone, a mobile phone, an e-book reader, a Portable Multimedia Player (PMP), an audio/video player (MP3/MP4), a camera, and a wearable device.

In some embodiments, the WIFI may be other types of wireless communication technologies. According to some embodiments of the present application, the Wireless Communication may include Wireless local Area Network (WiFi), Bluetooth Low Energy (BLE), ZigBee (ZigBee), Near Field Communication (NFC), magnetic security transmission, radio frequency and Body Area Network (BAN), or the like, or a combination of several. According to some embodiments of the present application, the wired communication may include a Global Navigation Satellite System (Global Navigation Satellite System), a Global Positioning System (GPS), a beidou Navigation Satellite System, galileo (european Global Satellite Navigation System), or the like. The wired communication may include a Universal Serial Bus (USB), a High-Definition Multimedia Interface (HDMI), a recommended Standard 232 (RS-232), and/or Plain Old Telephone Service (POTS), or the like, or a combination of several.

According to some embodiments of the present application, a VR device based hardware management and content distribution system 100 may include a master 120 and a slave 130. The host 120 is installed in the central control host and/or the mobile terminal, and can log in a first account or a second account (e.g., a management account or a control account), including an intelligent central control module and a content management module. When a first account (such as a management account) logs in the host, the intelligent central control management hardware equipment and the layout chart can be accessed. After a second account (such as a control account) logs in the master terminal, intelligent central control synchronization equipment and layout diagram information can be entered, a unified control signal is formed to carry out unified control on all equipment in the layout diagram, and the equipment state of the slave terminal is detected in real time through the layout diagram. The synchronized device and map information may be stored at the central control host. The unified control signal may include a one-touch power-on/off signal. For example, after the control account logs in the host, after entering the smart central control, the device and the layout information stored in the central control host may be automatically synchronized, and all the devices in the layout are controlled to be turned on/off by one key (one-key power-on or one-key power-off). The layout may be a visualized layout. The slave end can feed back the state of the equipment to the master end in the form of heartbeat packets during operation. The device state of the slave end can comprise shutdown, startup, content distribution, distribution failure, distribution success and content operation. After the second account logs in the main terminal, the second account can enter a content management module to perform content management and distribution operations. The slave 130 applies a computer installed in the connection device. The devices may include, but are not limited to, devices based on Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and XR (X Reality, X representing an unknown variable) technologies.

In some embodiments, after logging in the host, the first account enters the intelligent central control management hardware device and the layout, and further includes creating a virtual space (e.g., a classroom, a conference room, etc.) according to the actual space, and drawing a planar layout of the virtual space. The layout may indicate orientation by door and window position, etc. The main terminal 120 may add the devices in the device type list to the layout diagram in a dragging manner, and adjust the orientation of the devices in the layout diagram, so as to further determine the location of the devices. As an example, the main terminal 120 may adjust the size, orientation, position, etc. of the device in the layout. In some embodiments, devices of the same or different types may be added repeatedly. Further, the master 120 may open a bluetooth list, and bind the virtual devices in the layout diagram with the physical devices in the real space one by one. The bluetooth list may record the IP and Mac addresses of different devices, and after the binding is completed, the pairing information of all the devices is stored in the local database of the master 120. For another example, the master 120 may distinguish different hardware devices by device names.

In some embodiments, after the second account logs in to the host, the second account enters the content management module to perform content management and distribution operations, and further the host 120 may enter the content management module to add content. The content may be added by uploading local content or obtaining network resources. The resources may include VR resources of the network, and the like. The master 120 may enter the intelligent central control module to distribute the content. The content may be distributed by dragging directly to the devices in the layout. As an example, the master 120 may determine whether the content is compatible with the current device type; if the matching is carried out, carrying out distribution operation; and if not, prompting through an interface. Further, after the content distribution is successful, the master 120 may start the content, for example, start the content of one or more slaves 130. The content may include VR content, multimedia files (multimedia courseware), etc. The content distribution operation may further incorporate cloud rendering technology to be compatible with host VR content and all-in-one VR content, and the like. When the experience is over, the master 120 can click on an end command and the system 100 can automatically close the running content (e.g., VR content, multimedia courseware, etc.).

In some embodiments, the distribution operation may further include obtaining the content, and slicing the content into fixed-byte slices by the master 120. The master 120 may randomly assign slices to different slave 130 nodes and analyze slice information required by the slave 130. The master peer 120 may control the slave peer 130 to obtain slices to other designated slave peers.

In some embodiments, the slave 130 application may be booted up automatically and may be used without logging into an account. The slave 130 may perform a download task locally after receiving the content transmitted by the master 120. During the content transmission process, the slave 130 may feed back the downloading progress to the master 120 in real time, and feed back the downloading result after the downloading is completed. Further, the slave 130 may locally start the content and start the listening task process after receiving the content start instruction sent by the master 120. The slave 130 may automatically shut down the started process, etc. when receiving the end instruction of the master 120.

It should be noted that the above description of the VR device based hardware management and content distribution system 100 is merely for convenience of description and should not limit the scope of the present application to the illustrated embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the principles of the system, which may be combined in any manner or combined with other elements to form a subsystem for use in a field of application in which the method and system described above is practiced. For example, the system 100 may further include a server or the like. Such variations are within the scope of the present application.

Fig. 2 is a workflow diagram of an embodiment of a VR device based hardware management and content distribution system provided in accordance with some embodiments of the present application. As shown in fig. 2, the process 200 may be implemented by the VR device based hardware management and content distribution system 100. In some embodiments, the process 200 may be initiated automatically or by instruction. The instructions may include system instructions, device instructions, user instructions, action instructions, and the like, or a combination of the several. Fig. 3 is an exemplary topology diagram of a VR device based hardware management and content distribution system provided in accordance with some embodiments of the present application. According to some embodiments of the present application, an exemplary topology of the intelligent platform 300 may be a specific application scenario of the VR device based hardware management and content distribution system 100. As shown in fig. 3, the intelligent platform 300 may be an OCTOPUS (OCTOPUS) management platform. The application scenario of the intelligent platform 300 may include a VR lab, a VR center, etc. The topology of the intelligent platform 300 may include an OCTOPUS workflow, controlling VR smart terminals through a LAN.

According to some embodiments of the present application, as shown in fig. 2, the control account number may be logged into an OCTOPUS host-side application (e.g., teacher side). As an example, the teacher end can execute the task process through the courseware management module and the intelligent central control module. For example, the teacher end may add VR content scenes, multimedia courseware, and the like as add-in courseware through the courseware management module. For another example, the teacher end may execute a one-touch power-on through the intelligent central control module, and perform operations such as courseware distribution (e.g., courseware distribution to the student end) and courseware drag-and-drop. The courseware can be added through a courseware management module. Furthermore, the teacher end can start courseware, finish the class and execute the operation of one-key power-off and the like.

According to some embodiments of the present application, as shown in fig. 3, the intelligent platform 300 may be an OCTOPUS (OCTOPUS) management platform. The topology of the intelligent platform 300 may include an OCTOPUS workflow, controlling VR smart terminals through a LAN. In some embodiments, the ocopus workflow may include connecting a router through a switch and sending and/or receiving master (e.g., control plane) information over WiFi; connecting the intelligent platform through LAN (UDP); the slave (e.g., VR smart terminal, etc.) is controlled via the LAN. The VR intelligent terminal can include but is not limited to VR cave interactive display device, immersive VR collaborative interactive display device, immersive VR large-screen interactive display device, immersive VR mobile interactive display device, G-Motion optical tracking system device, Vive Pro device, Window MR device, Oculus Quest device and the like.

It should be noted that the above descriptions of the process 200 and the intelligent platform 300 are only for convenience of description, and the present application is not limited to the scope of the illustrated embodiments. It will be appreciated by those skilled in the art that based upon the principles of the present system, the functions of the above-described processes and operations may be implemented in any combination or sub-processes and combinations of other operations without departing from such principles. Various modifications and changes in detail. For example, the flow 200 may further include operations in conjunction with cloud rendering techniques to be compatible with host VR content and all-in-one VR content, among other things. Such variations are within the scope of the present application.

In summary, according to the hardware management and content distribution system based on the VR device in the embodiment of the application, the physical space layout of the device is fused to generate the visual control management interface, and the central control host or the mobile terminal is used to perform various tasks, so that the unified management of the opening and closing of the device, the one-key distribution or the start of content, and the like are realized, so as to efficiently use the device and improve the user experience.

It is to be noted that the above-described embodiments are merely examples, and the present application is not limited to such examples, but various changes may be made.

It should be noted that, in the present specification, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

Finally, it should be noted that the series of processes described above includes not only processes performed in time series in the order described herein, but also processes performed in parallel or individually, rather than in time series.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware associated with computer program instructions, and the program can be stored in a computer readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

While the invention has been described with reference to a number of illustrative embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.

Claims

1. A hardware management and content distribution system based on VR device is characterized in that the system comprises a master end and a slave end:

the main end application is installed on the central control host and/or the mobile terminal and comprises an intelligent central control module and a content management module; after a first account logs in a main terminal, intelligent central control management hardware equipment and a layout diagram are entered; after logging in the primary terminal, the second account enters intelligent central control and then automatically synchronizes equipment and layout information to form a unified control signal to uniformly control all equipment in the layout, and the equipment state of the secondary terminal is detected in real time through the layout; entering a content management module to perform content management and distribution operation;

the computer installed on the connection device is applied from the end;

the intelligent central control management hardware equipment and the layout comprises the following steps:

creating a virtual space according to the actual space, and drawing a plane layout diagram of the virtual space;

adding the devices in the device type list to the layout diagram in a dragging mode;

adjusting the orientation of the equipment in the layout chart and determining the position of the equipment;

starting a Bluetooth list, and binding virtual equipment in a layout drawing with physical equipment in an actual space one by one;

the distributing operation includes:

acquiring content, and segmenting the content into fixed byte slices through a main end;

randomly assigning slices to different slave nodes;

analyzing slice information required by the slave end;

and controlling the slave to acquire the slices to other specified slaves.

2. The system of claim 1, wherein the bluetooth list records IP and Mac addresses of different devices, and after binding is completed, pairing information of all the devices is stored in a local database of the host.

3. The system of claim 1, wherein the unified control signal comprises a one-touch power-on/power-off signal, and the device status of the slave end comprises power-off, power-on, content distribution, distribution failure, distribution success, and content running.

4. The system of claim 3, wherein the slave end feeds back the device status to the master end in the form of heartbeat packets during operation.

5. The system of claim 1, wherein after the second account logs in the primary terminal, entering a content management module for content management and distribution comprises:

entering a content management module to add content; the content is added by uploading local content or acquiring network resources;

entering an intelligent central control module to distribute contents; and the content is directly dragged to the equipment in the layout diagram to complete distribution.

6. The system of claim 5, wherein:

judging whether the content is matched with the current equipment type;

if the matching is carried out, carrying out distribution operation;

and if not, prompting through an interface.

7. The system according to claim 6, wherein after the content distribution is successful, the master end starts the content; the content comprises VR content and multimedia files.

8. The system of claim 7, wherein the content distribution operation incorporates cloud rendering techniques that are compatible with host VR content and all-in-one VR content.