CN112968787A - Conference control method, AR (augmented reality) equipment and conference system - Google Patents
Conference control method, AR (augmented reality) equipment and conference system Download PDFInfo
- Publication number
- CN112968787A CN112968787A CN202110137614.4A CN202110137614A CN112968787A CN 112968787 A CN112968787 A CN 112968787A CN 202110137614 A CN202110137614 A CN 202110137614A CN 112968787 A CN112968787 A CN 112968787A
- Authority
- CN
- China
- Prior art keywords
- conference
- screen
- control server
- content
- personal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1818—Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1822—Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a conference control method, AR equipment and a conference system, wherein conference login information and a participant list of a pre-initiated conference are acquired; sending the conference login information and the participant list to a control server so that the control server sends the conference login information to target AR equipment which corresponds to target participants on the participant list one by one and the target participants can log in a conference; and establishing a pre-virtual display public screen, adding pre-shared content to the public screen, and sending the public screen with the added content to the control server, so that the control server sends the public screen to the target AR equipment for display, and the target participants can watch the public screen. Therefore, the conference can be carried out by only wearing one AR device by each participant, the operation is convenient and fast, and the conference efficiency is high; moreover, only the participants wearing the AR equipment can see the conference content, and the conference security is high.
Description
Technical Field
The invention relates to the technical field of augmented reality, in particular to a conference control method, AR equipment and a conference system.
Background
At present, most conference contents of conferences have two presentation modes, one mode is erasable board presentation, and the other mode is presentation based on a traditional computer and a traditional projection system. However, in any presentation mode, the conference content can be seen not only by the participants, but also by the surrounding non-participants, so that the conference content is leaked, and the conference security is reduced; moreover, when the board is erased and written for demonstration, the presenter needs to manually describe the board, which is time-consuming, and the conference efficiency is reduced.
Therefore, how to provide a solution to the above technical problem is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The invention aims to provide a conference control method, AR equipment and a conference system, conference participants can carry out a conference only by wearing one AR equipment per person, the operation is convenient and fast, and the conference efficiency is high; moreover, only the participants wearing the AR equipment can see the conference content, and the conference security is high.
In order to solve the above technical problem, the present invention provides a conference control method, which is applied to an AR device connected to a control server, and includes:
acquiring conference login information and a participant list of a pre-initiated conference;
sending the conference login information and the participant list to the control server, so that the control server sends the conference login information to target AR equipment in one-to-one correspondence with target participants on the participant list, and the target participants can log in a conference;
and establishing a pre-virtual display public screen, adding pre-shared content to the public screen, and sending the public screen with the added content to the control server, so that the control server sends the public screen to the target AR equipment for display for the target participants to watch.
Preferably, the conference control method further includes:
and establishing a personal screen of the pre-virtual display, and adding the pre-displayed content to the personal screen so as to display the personal screen with the added content on the AR device.
Preferably, the conference control method further includes:
selecting pre-shared content in the personal screen according to the sharing requirement of the personal screen;
and sending the selected shared content of the personal screen to the control server so that the control server adds the selected shared content to the public screen and resends the public screen with the added content to the target AR equipment for display.
Preferably, the conference control method further includes:
before sending the selected shared content of the personal screen to the control server, judging whether the current conference is in a speaking mode or a brainstorming mode;
if the personal screen is in the announcement mode, not allowing the step of sending the selected shared content of the personal screen to the control server to be executed;
and if the user is in the brain storm mode, allowing the step of sending the selected shared content of the personal screen to the control server.
Preferably, the conference control method further includes:
before sending the selected shared content of the personal screen to the control server, judging whether the content of the public screen is modified by the authority according to a preset authority personnel list;
if yes, allowing the step of sending the selected shared content of the personal screen to the control server;
if not, the step of sending the selected shared content of the personal screen to the control server is not allowed to be executed.
Preferably, the content adding process of the public screen or the personal screen includes:
when an input pen writes, recognizing the writing track of the input pen, and calculating the writing content according to the writing track;
and correspondingly adding the writing content to a corresponding area of the public screen or the personal screen according to a writing area of the input pen on the public screen or the personal screen.
Preferably, the process of the target AR device displaying a public screen includes:
receiving a public screen sent by the control server;
acquiring image information of the environment where the target AR equipment is located;
and determining a fixed display position of the public screen according to the image information, and fixedly displaying the public screen at the fixed display position.
Preferably, the process of the target AR device displaying a personal screen comprises:
acquiring a personal screen added with content;
acquiring image information of the environment where the target AR equipment is located;
and determining a display position right in front of the corresponding target AR equipment according to the image information, and displaying the personal screen at the display position.
In order to solve the above technical problem, the present invention further provides an AR device, including:
a memory for storing a computer program;
a processor for implementing the steps of any of the above-described conference control methods when executing the computer program.
In order to solve the technical problem, the invention further provides a conference system, which comprises the control server and the AR device.
The invention provides a conference control method, which is applied to AR equipment connected with a control server and comprises the following steps: acquiring conference login information and a participant list of a pre-initiated conference; sending the conference login information and the participant list to a control server so that the control server sends the conference login information to target AR equipment which corresponds to target participants on the participant list one by one and the target participants can log in a conference; and establishing a pre-virtual display public screen, adding pre-shared content to the public screen, and sending the public screen with the added content to the control server, so that the control server sends the public screen to the target AR equipment for display, and the target participants can watch the public screen. Therefore, the conference can be carried out by only wearing one AR device by each participant, the operation is convenient and fast, and the conference efficiency is high; moreover, only the participants wearing the AR equipment can see the conference content, and the conference security is high.
The invention also provides an AR device and a conference system, which have the same beneficial effects as the conference control method.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed in the prior art and the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a flowchart of a conference control method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a conference system according to an embodiment of the present invention;
fig. 3 is a schematic view of an AR intelligent conference scene provided in an embodiment of the present invention;
fig. 4 is an APP interface diagram for a conference provided in an embodiment of the present invention;
fig. 5 is a diagram of an interface for initiating a conference according to an embodiment of the present invention;
FIG. 6 is an interface diagram of a member selecting participant according to an embodiment of the present invention;
FIG. 7 is a diagram of a join conference interface according to an embodiment of the present invention;
fig. 8 is an interface diagram of a public screen module according to an embodiment of the present invention;
FIG. 9 is a diagram of a public screen creation options interface provided by an embodiment of the present invention;
FIG. 10 is a diagram of an interface for creating a public screen according to an embodiment of the present invention;
FIG. 11 is a diagram of a public screen viewing interface provided by an embodiment of the present invention;
FIG. 12 is a diagram of an interface for setting public screen permissions according to an embodiment of the present invention;
FIG. 13 is an interface diagram for selecting a public screen according to an embodiment of the present invention;
FIG. 14 is a diagram of a public screen control options interface provided by an embodiment of the present invention;
FIG. 15 is a diagram illustrating the creation of multiple public screen interfaces according to an embodiment of the present invention;
fig. 16 is a diagram of a public screen saving operation interface according to an embodiment of the present invention;
fig. 17 is a diagram of a common screen deletion operation interface according to an embodiment of the present invention;
fig. 18 is an interface diagram after the public screen 1 is deleted according to the embodiment of the present invention;
FIG. 19 is a diagram of a personal screen module interface provided by an embodiment of the present invention;
FIG. 20 is a diagram of a personal screen creation options interface provided by an embodiment of the present invention;
FIG. 21 is a diagram of a set up personal screen interface provided by an embodiment of the present invention;
FIG. 22 is a diagram of a selected personal screen interface provided by an embodiment of the present invention;
FIG. 23 is a diagram of a personal screen checkbox interface provided by an embodiment of the present invention;
FIG. 24 is a diagram of a content selection interface for a personal screen provided by an embodiment of the present invention;
FIG. 25 is a diagram of a personal screen selected content sharing operation interface according to an embodiment of the present invention;
FIG. 26 is a depiction of a personal screen selected content sharing to public screen interface, in accordance with an illustrative embodiment of the present invention;
fig. 27 is a schematic structural diagram of an AR device according to an embodiment of the present invention.
Detailed Description
The core of the invention is to provide a conference control method, AR equipment and a conference system, participants can carry out a conference only by wearing one AR equipment per person, the operation is convenient and fast, and the conference efficiency is high; moreover, only the participants wearing the AR equipment can see the conference content, and the conference security is high.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a conference control method according to an embodiment of the present invention.
The conference control method is applied to AR (Augmented Reality) equipment connected with a control server, and comprises the following steps:
step S1: and acquiring conference login information and a participant list of the pre-initiated conference.
Specifically, referring to fig. 2, fig. 2 is a schematic structural diagram of a conference system according to an embodiment of the present invention. The conference system includes a control server and a plurality of AR devices connected to the control server. Each AR device can send information to other AR devices through the control server to achieve information sharing. It should be noted that each participant in the conference needs to wear an AR device, so that the conference can be performed.
When a conference initiating requirement exists, a conference initiator firstly sets conference login information (such as a conference invitation link or a conference number) and a participant list (specifically which personnel participate in the conference) of a pre-initiated conference on AR equipment pre-worn by the conference initiator, so that the AR equipment can obtain the conference login information and the participant list of the pre-initiated conference to provide a basis for initiating a subsequent conference.
Step S2: and sending the conference login information and the participant list to a control server so that the control server sends the conference login information to target AR equipment in one-to-one correspondence with the target participants on the participant list for the target participants to log in the conference.
Specifically, after acquiring the conference login information and the participant list of the pre-initiated conference, the AR device pre-worn by the conference initiator sends the conference login information and the participant list to the control server. After receiving the participant list, the control server firstly determines target AR equipment in one-to-one correspondence with target participants on the participant list, and then sends the conference login information to the target AR equipment, so that the target participants can log in the conference on the corresponding AR equipment based on the conference login information, for example, the target participants can directly join the conference through a conference invitation link sent by a conference initiator, or join the conference through inputting a conference number.
Step S3: and establishing a pre-virtual display public screen, adding pre-shared content to the public screen, and sending the public screen with the added content to the control server, so that the control server sends the public screen to the target AR equipment for display, and the target participants can watch the public screen.
Specifically, after receiving a public screen establishing instruction, the AR device establishes a public screen to be virtually displayed in advance, adds pre-shared content to the public screen, and then sends the public screen to which the content is added to the control server. And after receiving the public screen, the control server sends the public screen to the target AR equipment in one-to-one correspondence with the target participants. And after receiving the public screen, the target AR equipment displays the public screen for the target participant to watch. It should be noted that the public screen is a virtual screen, and only the participant wearing the AR device can see the conference content.
It should be further noted that, for erasable board demonstration and demonstration based on a traditional computer and projection system, no matter which demonstration mode is adopted, the conference content is displayed in a 2D plane, if the displayed content needs strong third dimension and sense of reality, only the participants can imagine the displayed content, and the stereoscopic picture cannot be displayed, so that the demonstration effect is not good enough. The AR equipment can display the virtual screen in 2D or 3D mode, display modes can be freely switched according to needs, and 3D display can be adopted according to the display contents with strong stereoscopic impression and reality, so that the display is more vivid and visual, and understanding is facilitated.
The invention provides a conference control method, which is applied to AR equipment connected with a control server and comprises the following steps: acquiring conference login information and a participant list of a pre-initiated conference; sending the conference login information and the participant list to a control server so that the control server sends the conference login information to target AR equipment which corresponds to target participants on the participant list one by one and the target participants can log in a conference; and establishing a pre-virtual display public screen, adding pre-shared content to the public screen, and sending the public screen with the added content to the control server, so that the control server sends the public screen to the target AR equipment for display, and the target participants can watch the public screen. Therefore, the conference can be carried out by only wearing one AR device by each participant, the operation is convenient and fast, and the conference efficiency is high; moreover, only the participants wearing the AR equipment can see the conference content, and the conference security is high.
On the basis of the above-described embodiment:
as an optional embodiment, the conference control method further includes:
and establishing a personal screen of the pre-virtual display, and adding the pre-displayed content to the personal screen so as to display the personal screen with the added content on the AR device.
Further, for any AR device, after receiving the personal screen establishment instruction, establishing a personal screen for pre-virtual display, adding the pre-displayed content to the personal screen, and then displaying the personal screen to which the content is added, as shown in fig. 3, a wearer of any AR device can establish a personal dedicated virtual screen.
As an optional embodiment, the conference control method further includes:
selecting pre-shared content in the personal screen according to the sharing requirement of the personal screen;
and sending the selected shared content of the personal screen to the control server so that the control server adds the selected shared content to the public screen and resends the public screen with the added content to the target AR equipment for display.
Further, for any AR device, the personal screen established by the AR device can be shared, and particularly, pre-shared content of the personal screen can be added to the public screen, so that the content of the personal screen can be directly displayed on the public screen for all participants to watch.
Specifically, the sharing process of the personal screen includes: and selecting the pre-shared content in the personal screen according to the sharing requirement of the personal screen, and then sending the selected shared content of the personal screen to the control server. And after receiving the selected shared content of the personal screen, the control server adds the selected shared content of the personal screen to the public screen, and then resends the public screen with the added content to the target AR equipment for display, so that the sharing of the personal screen is realized.
Therefore, the design of the public screen and the personal screen protects the personal privacy while displaying the shared content. When the content of the personal screen is required to be shared in the conference, the participants only need to selectively put the content to be demonstrated on the personal screen to the public screen for displaying, and do not need to go to an erasing board for demonstrating or temporarily modify PPT through a computer for demonstrating like the prior art, so that the conference time is saved, and the conference is very convenient and fast.
As an optional embodiment, the conference control method further includes:
before sending the selected shared content of the personal screen to the control server, judging whether the current conference is in a speaking mode or a brainstorming mode;
if the user is in the announcement mode, not allowing the step of sending the selected shared content of the personal screen to the control server;
and if the mobile terminal is in the brain storm mode, allowing the step of sending the selected shared content of the personal screen to the control server.
Further, the conference of the present application has two conference modes: the method comprises a speaking mode and a brainstorming mode, wherein the speaking mode is that one person speaks, and other participants do not have the speaking right, namely the established personal screen is not allowed to be shared; the brain storm mode means that all participants have the right to speak, i.e. the established personal screen is allowed to be shared.
Based on the above, for any AR device, before sending the selected shared content of the personal screen to the control server, firstly, judging whether the current conference is in a speaking mode or a brainstorming mode according to a preset conference mode, and if the current conference is in the speaking mode, not allowing to execute the step of sending the selected shared content of the personal screen to the control server; and if the mobile terminal is in the brain storm mode, allowing the step of sending the selected shared content of the personal screen to the control server.
As an optional embodiment, the conference control method further includes:
before sending the selected shared content of the personal screen to the control server, judging whether the content of the public screen is modified by the authority according to a preset authority personnel list;
if yes, allowing the step of sending the selected shared content of the personal screen to the control server;
if not, the step of sending the selected shared content of the personal screen to the control server is not allowed to be executed.
Furthermore, the method and the device can set an authority list with the authority of modifying the content of the public screen before the conference, namely, a personal screen established by which participants is allowed to be shared. Based on this, for any AR device, before sending the selected shared content of the personal screen to the control server, firstly, judging whether the attendee corresponding to the AR device is in the authority list, if the attendee is in the authority list, and if the personal screen established by the AR device is allowed to be shared, allowing the step of sending the selected shared content of the personal screen to the control server; and if the user is not in the authority list, the user does not consider that the personal screen established by the AR equipment is not allowed to be shared, and the step of sending the selected shared content of the personal screen to the control server is not allowed to be executed.
As an alternative embodiment, the content adding process of the public screen or the personal screen includes:
when the input pen writes, recognizing the writing track of the input pen, and calculating the writing content according to the writing track;
and correspondingly adding the writing contents to the corresponding area of the public screen or the personal screen according to the writing area of the input pen on the public screen or the personal screen.
Specifically, the content input of the public screen or the personal screen is an input pen input mode, specifically, when the input pen writes, a writing track of the input pen is recognized, writing content is calculated according to the writing track of the input pen, and then the writing content is correspondingly added to a corresponding area of the public screen or the personal screen according to a writing area of the input pen on the public screen or the personal screen.
More specifically, an infrared LED (Light Emitting Diode) lamp is installed at the pen end of the input pen, and a camera is arranged on the AR device, so that the track of the LED lamp, i.e. the writing track, is recognized when the input pen writes through the camera of the AR device.
Or the content input of the public screen or the personal screen is an image recognition input mode, specifically, the AR device acquires image information of a notebook or a manuscript paper of the participant through the camera, recognizes the note content on the notebook or the manuscript paper, and then correspondingly uploads the note content to the selected input area of the public screen or the personal screen, or the participant writes on the notebook or the manuscript paper through the input pen, and the AR device automatically recognizes the note content of the input pen through the camera and uploads the note content to the selected input area of the public screen or the personal screen in real time.
Or, the AR equipment is connected with the mobile phone, the mobile phone end is loaded with a conference APP (Application, mobile phone software), the conference APP is directly input through a public screen or a personal screen of the pressure touch pen on the mobile phone end, the input content of the public screen or the personal screen of the mobile phone end is synchronously uploaded to the public screen or the personal screen displayed by the AR equipment, and the habit requirements of participants who are more inclined to note at the mobile phone end are met.
As an alternative embodiment, the process of displaying the public screen by the target AR device includes:
receiving a public screen sent by a control server;
acquiring image information of an environment where a target AR device is located;
and determining the fixed display position of the public screen according to the image information, and fixedly displaying the public screen at the fixed display position.
Specifically, the AR equipment of this application can be head-mounted display device, and the put in position of the public screen of AR equipment is fixed, can not change along with the rotation of the person's of wearing head, conveniently watches. Taking a target AR device as an example, the principle of fixed display of a public screen is explained as follows: the method comprises the steps of obtaining image information of an environment where a target AR device is located through a camera on the target AR device, determining a fixed display position (such as a desktop, a wall surface or any space position) of a public screen according to the image information, and then fixedly displaying the public screen at the fixed display position.
It should be noted that the drop position of the public screen may also be not fixed, and may be freely selected according to the need, and is not particularly limited, and the preferred mode is fixed.
As an alternative embodiment, the process of the target AR device displaying a personal screen includes:
acquiring a personal screen added with content;
acquiring image information of an environment where a target AR device is located;
and determining a display position right in front of the corresponding target AR equipment according to the image information, and displaying the personal screen at the display position.
Specifically, the release position of the personal screen of the AR device is not fixed and can be changed along with the rotation of the head of the wearer, so that the personal privacy is effectively protected. Taking target AR equipment as an example, the principle of non-fixed display of a personal screen is explained: the method comprises the steps of obtaining image information of the environment where the target AR equipment is located through a camera on the target AR equipment, determining a display position right in front of the corresponding target AR equipment according to the image information, namely, the display position serves as a throwing position of a personal screen, and displaying the personal screen at the display position right in front of the corresponding target AR equipment.
It should be noted that the placement position of the personal screen may also be fixed, and may be freely selected according to the need, and is not particularly limited, and the preferred mode is not fixed. The participants can only see the personal screen established by themselves, and cannot see the personal screens established by other participants, so that the personal privacy is effectively protected.
Based on the conference control method, the application provides a conference APP, and as shown in fig. 4, the conference APP comprises six modules, namely a conference, an address book, a public screen, a personal screen, a cloud account and a function. The conference module comprises two units of initiating a conference and joining the conference, a conference initiator selects to initiate the conference and then enters a conference initiating interface, as shown in fig. 5, the conference initiating step comprises setting of a conference theme, a conference place, conference time and a conference mode (a declaration mode and a brainstorming mode), the conference theme, the conference place, the conference time and the conference mode are set on the conference initiating interface of the conference APP, after conference information of the conference theme, the conference place, the conference time and the conference mode is set, a conference invitation is clicked and sent, the conference initiating enters a conference personnel selecting interface diagram, as shown in fig. 6, the conference initiator sends a list of conference personnel to the control server.
And the control server sends the conference information (including the conference login information) to the corresponding AR equipment according to the list of the participants. The conference information is received by the participants, the participants directly log in the conference by joining the conference unit, the participants can directly join in the conference by the conference invitation link sent by the conference initiator, and the participants can also join in the conference in the form of inputting the conference number on the conference APP, as shown in fig. 7.
The conference initiator establishes a public screen through a public screen module, as shown in fig. 8, the public screen module comprises three units of establishment, check and permission, the establishment unit is used for establishing the public screen, a window for inquiring whether to establish the public screen is popped up if the establishment unit clicks the establishment, as shown in fig. 9, if the establishment unit chooses to establish the public screen, as shown in fig. 10, after the public screen is established, the content to be shared is directly placed on the public screen, and the public screen is sent to the control server. The viewing unit is used for selecting to view the established public screen, as shown in fig. 11. The rights unit is used to set the rights holder with the public screen content modification rights, as shown in fig. 12.
And the control server receives the public screen and sends the public screen to the AR equipment corresponding to all the participants. The participants receive the public screen sent by the control server, directly watch the public screen, or perform other operations on the public screen through the public screen module, such as storage, deletion, movement and printing operations of the public screen, select the established public screen, as shown in fig. 13, pop up public screen control operation options, as shown in fig. 14, the public screen operation options include deletion, storage, movement and printing, and select autonomously according to needs. The AR equipment is connected with the printer, and if printing is selected, the public screen is printed through the external printer. For example, a plurality of public screens are created, and the created public screen 1 is selected, as shown in fig. 15, and the public screen control operation options are popped up, and the operation options of the public screen include deletion, saving, movement, and printing, and if saving is selected, as shown in fig. 16, the public screen 1 is saved in the storage unit. If deletion is selected, as shown in fig. 17, the public screen 1 is deleted, and the interface after deletion is shown in fig. 18. The multiple public screens can be displayed in an overlapping manner or in columns, and are not particularly limited.
The participants establish personal screens according to respective requirements, as shown in fig. 19, the personal screen module comprises an establishing unit and a viewing unit, the establishing unit is used for establishing the personal screens, if the establishing unit is clicked, a window for inquiring whether to establish the personal screens is popped up, as shown in fig. 20, and if the establishing unit is selected, one personal screen is established, as shown in fig. 21. The viewing unit is used for selecting to view the established personal screen. After the personal screen is established, personal notes and the like can be added to the personal screen. The personal screen module also includes other operations such as save, delete, move, share, and print operations of the personal screen. Selecting the established personal screen, as shown in fig. 22, popping up personal screen control operation options, as shown in fig. 23, the operation options of the personal screen include deletion, storage, movement, sharing and printing, and are selected autonomously according to needs. The AR device is connected with the printer, and if printing is selected, the personal screen is printed through the external printer. If the content in the personal screen needs to be shared with the participants, the content in the personal screen can be directly transmitted to the control server, specifically, a certain part of the content in the personal screen is selected, as shown in fig. 24, an operation option box pops up, as shown in fig. 25, and the content selected by the personal screen is transmitted to the control server if sharing is selected. The control server receives the content of the personal screen, uploads the content to the public screen and sends the content to the participants, and as shown in fig. 26, the content shared by the personal screen is directly displayed on the public screen for all the participants to watch.
The present application also provides an AR device, including:
a memory for storing a computer program;
a processor for implementing the steps of any of the above-described conference control methods when executing a computer program.
Specifically, referring to fig. 27, fig. 27 is a schematic structural diagram of an AR device according to an embodiment of the present invention. The AR equipment is integrated AR glasses, all components are integrated in the glasses, and the AR equipment comprises a CPU processing module (a memory and a processor), a wireless communication module, an image recognition and display module and an audio module (an audio player and a microphone). The CPU processing module comprises a single chip microcomputer, a Random Access Memory (RAM), a Read-Only Memory (ROM) and other hardware, can realize the installation of a conference APP and the processing of video and interactive information data, and can also carry out operation processing on sensing data, save files and modify file data during a conference; meanwhile, the CPU processing module further uploads the conference real-time data to the control server through the wireless communication module, and then synchronizes the conference real-time data to other AR devices (please refer to the embodiment of the conference control method for the specific conference control method of the CPU processing module in the conference process, which is not described herein again). The wireless communication module mainly establishes wireless communication connection between the control server and external equipment (such as an input pen and a mobile phone) and the AR equipment, and can adopt wireless modes such as Bluetooth, WiFi and 3G/4G/5G. The image recognition and display module comprises a micro projection optical machine, a left lens, a right lens, a SLAM (synchronous positioning and mapping) camera (the number is not limited), and the image recognition and display module has three-dimensional display and real augmented imaging capabilities. The audio module comprises a microphone for collecting the speaker's voice and an audio player for playing the speaker's voice.
The AR glasses include a frame comprising a front piece including a left lens and a right lens, a left temple and a right temple, the left lens and the right lens may be lenses, displays, display assemblies, or combinations of the foregoing. The left and right temples are respectively connected to the left and right ends of the front member, and may be hinged or rigidly or fixedly connected to the front member so as to be integrated with the front member. Each temple (left and right temples) may include a temple front end and a temple rear end, the temple rear end being of a flexible material, which may be a bent or arcuate piece, for connection with the wearer's ear. The front member may be formed from a single piece of material so as to have a unitary structure. The entire frame may be formed from a single piece of material so as to have a unitary structure.
In addition, the AR glasses may include any number of input sensors or sensing peripherals, such as video sensors, digital imaging modules, iris recognition sensors, biometric sensors, position sensors, or other sensors, with face recognition, voice recognition, 3D sensing, and the like.
It should be noted that the structure and function of the AR device in the present application are not limited to this, and may be an AR glasses, a helmet display, a near-eye display, and the like, an all-in-one machine, or a split machine (AR display + mobile terminal), and the present application is not limited to this specifically.
The application also provides a conference system which comprises the control server and the AR equipment.
For introduction of the conference system provided in the present application, reference is made to the above-mentioned embodiment of the conference control method, which is not described herein again.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A conference control method is applied to an AR device connected with a control server, and comprises the following steps:
acquiring conference login information and a participant list of a pre-initiated conference;
sending the conference login information and the participant list to the control server, so that the control server sends the conference login information to target AR equipment in one-to-one correspondence with target participants on the participant list, and the target participants can log in a conference;
and establishing a pre-virtual display public screen, adding pre-shared content to the public screen, and sending the public screen with the added content to the control server, so that the control server sends the public screen to the target AR equipment for display for the target participants to watch.
2. The conference control method as claimed in claim 1, wherein said conference control method further comprises:
and establishing a personal screen of the pre-virtual display, and adding the pre-displayed content to the personal screen so as to display the personal screen with the added content on the AR device.
3. The conference control method as claimed in claim 2, wherein said conference control method further comprises:
selecting pre-shared content in the personal screen according to the sharing requirement of the personal screen;
and sending the selected shared content of the personal screen to the control server so that the control server adds the selected shared content to the public screen and resends the public screen with the added content to the target AR equipment for display.
4. The conference control method as claimed in claim 3, wherein said conference control method further comprises:
before sending the selected shared content of the personal screen to the control server, judging whether the current conference is in a speaking mode or a brainstorming mode;
if the personal screen is in the announcement mode, not allowing the step of sending the selected shared content of the personal screen to the control server to be executed;
and if the user is in the brain storm mode, allowing the step of sending the selected shared content of the personal screen to the control server.
5. The conference control method as claimed in claim 3, wherein said conference control method further comprises:
before sending the selected shared content of the personal screen to the control server, judging whether the content of the public screen is modified by the authority according to a preset authority personnel list;
if yes, allowing the step of sending the selected shared content of the personal screen to the control server;
if not, the step of sending the selected shared content of the personal screen to the control server is not allowed to be executed.
6. The conference control method as claimed in claim 2, wherein the content adding process of the public screen or the personal screen includes:
when an input pen writes, recognizing the writing track of the input pen, and calculating the writing content according to the writing track;
and correspondingly adding the writing content to a corresponding area of the public screen or the personal screen according to a writing area of the input pen on the public screen or the personal screen.
7. The conference control method of any of claims 2-6, wherein said target AR device displaying a public screen comprises:
receiving a public screen sent by the control server;
acquiring image information of the environment where the target AR equipment is located;
and determining a fixed display position of the public screen according to the image information, and fixedly displaying the public screen at the fixed display position.
8. The conference control method of claim 7, wherein said target AR device displaying a personal screen comprises:
acquiring a personal screen added with content;
acquiring image information of the environment where the target AR equipment is located;
and determining a display position right in front of the corresponding target AR equipment according to the image information, and displaying the personal screen at the display position.
9. An AR device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the conference control method as claimed in any one of claims 1-8 when executing said computer program.
10. A conferencing system comprising a control server and an AR device as claimed in claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110137614.4A CN112968787A (en) | 2021-02-01 | 2021-02-01 | Conference control method, AR (augmented reality) equipment and conference system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110137614.4A CN112968787A (en) | 2021-02-01 | 2021-02-01 | Conference control method, AR (augmented reality) equipment and conference system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112968787A true CN112968787A (en) | 2021-06-15 |
Family
ID=76273576
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110137614.4A Pending CN112968787A (en) | 2021-02-01 | 2021-02-01 | Conference control method, AR (augmented reality) equipment and conference system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112968787A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114063778A (en) * | 2021-11-17 | 2022-02-18 | 北京蜂巢世纪科技有限公司 | Method and device for simulating image by utilizing AR glasses, AR glasses and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106709310A (en) * | 2017-01-17 | 2017-05-24 | 宇龙计算机通信科技(深圳)有限公司 | Virtual reality system interface login method and device |
| CN107277429A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of method that teleconference is carried out using AR |
| CN110069230A (en) * | 2019-04-24 | 2019-07-30 | 北京小米移动软件有限公司 | Extend content display method, device and storage medium |
| US20200035203A1 (en) * | 2018-07-30 | 2020-01-30 | Honeywell International Inc. | Method and system for user-related multi-screen solution for augmented reality for use in performing maintenance |
| US20200280456A1 (en) * | 2019-02-28 | 2020-09-03 | Ricoh Company, Ltd. | Information processing apparatus, information processing system, and information processing method |
| CN111752511A (en) * | 2019-03-27 | 2020-10-09 | 优奈柯恩(北京)科技有限公司 | AR glasses remote interaction method and device and computer readable medium |
| CN112272328A (en) * | 2020-10-27 | 2021-01-26 | 万翼科技有限公司 | Bullet screen recommendation method and related device |
-
2021
- 2021-02-01 CN CN202110137614.4A patent/CN112968787A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106709310A (en) * | 2017-01-17 | 2017-05-24 | 宇龙计算机通信科技(深圳)有限公司 | Virtual reality system interface login method and device |
| CN107277429A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of method that teleconference is carried out using AR |
| US20200035203A1 (en) * | 2018-07-30 | 2020-01-30 | Honeywell International Inc. | Method and system for user-related multi-screen solution for augmented reality for use in performing maintenance |
| US20200280456A1 (en) * | 2019-02-28 | 2020-09-03 | Ricoh Company, Ltd. | Information processing apparatus, information processing system, and information processing method |
| CN111752511A (en) * | 2019-03-27 | 2020-10-09 | 优奈柯恩(北京)科技有限公司 | AR glasses remote interaction method and device and computer readable medium |
| CN110069230A (en) * | 2019-04-24 | 2019-07-30 | 北京小米移动软件有限公司 | Extend content display method, device and storage medium |
| CN112272328A (en) * | 2020-10-27 | 2021-01-26 | 万翼科技有限公司 | Bullet screen recommendation method and related device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114063778A (en) * | 2021-11-17 | 2022-02-18 | 北京蜂巢世纪科技有限公司 | Method and device for simulating image by utilizing AR glasses, AR glasses and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11803055B2 (en) | Sedentary virtual reality method and systems | |
| US9998508B2 (en) | Multi-site screen interactions | |
| US7840638B2 (en) | Participant positioning in multimedia conferencing | |
| US8099462B2 (en) | Method of displaying interactive effects in web camera communication | |
| US10235808B2 (en) | Communication system | |
| JP2019120976A (en) | system | |
| CN102460487A (en) | System and method for hybrid course instruction | |
| WO2021043121A1 (en) | Image face changing method, apparatus, system, and device, and storage medium | |
| JP6455138B2 (en) | CONFERENCE SYSTEM AND CONTROL METHOD | |
| CN101023655A (en) | Portable electronic devices with picture in picture capability | |
| ES1259240U (en) | Method and system for making functional devices availalble to participants of meetings | |
| US20170185269A1 (en) | Display management solution | |
| WO2021170123A1 (en) | Video generation method and device, and corresponding storage medium | |
| CN106850577B (en) | Data interaction method and device, first virtual reality terminal and conference server | |
| CN112968787A (en) | Conference control method, AR (augmented reality) equipment and conference system | |
| Mathew et al. | Access on demand: real-time, multi-modal accessibility for the deaf and hard-of-hearing based on augmented reality | |
| US20220286641A1 (en) | Background image adjustment in virtual meeting | |
| TWI602436B (en) | Virtual conference system | |
| KR20120079636A (en) | Method for sharing document work in multilateral conference | |
| JP2019121812A (en) | Information process system, control method of the same, and program | |
| KR102138835B1 (en) | Apparatus and method for providing information exposure protecting image | |
| US11972505B2 (en) | Augmented image overlay on external panel | |
| CN115037874A (en) | Photographing method and device and electronic equipment | |
| CN209859042U (en) | Wearable control device and virtual/augmented reality system | |
| CN107680038A (en) | A kind of image processing method, medium and relevant apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |