WO2021104260A1 - 展厅控制方法及系统、控制终端、后台服务器和中控主机 - Google Patents

展厅控制方法及系统、控制终端、后台服务器和中控主机 Download PDF

Info

Publication number
WO2021104260A1
WO2021104260A1 PCT/CN2020/131146 CN2020131146W WO2021104260A1 WO 2021104260 A1 WO2021104260 A1 WO 2021104260A1 CN 2020131146 W CN2020131146 W CN 2020131146W WO 2021104260 A1 WO2021104260 A1 WO 2021104260A1
Authority
WO
WIPO (PCT)
Prior art keywords
exhibition hall
controllable
control
virtual
instruction
Prior art date
Application number
PCT/CN2020/131146
Other languages
English (en)
French (fr)
Inventor
王峣
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US17/417,530 priority Critical patent/US20220121270A1/en
Publication of WO2021104260A1 publication Critical patent/WO2021104260A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G05B19/0423—Input/output
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/25—Pc structure of the system
    • G05B2219/25257—Microcontroller
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/26—Pc applications
    • G05B2219/2642—Domotique, domestic, home control, automation, smart house
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/04—Architectural design, interior design
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present disclosure relates to the field of intelligent exhibition halls, and in particular to an exhibition hall control method and system, a control terminal, a background server, a central control host, and a computer-readable storage medium.
  • the opening, closing and content control of each exhibition equipment are independent. For example, during the opening process of the exhibition hall, managers need to go to different locations to manually turn on each device (for example, display, lighting, sound, etc.) one by one.
  • the present disclosure provides an exhibition hall control method and system, a control terminal, a background server, a central control host, and a computer-readable storage medium.
  • the embodiments of the present disclosure provide an exhibition hall control method, applied to the control terminal side, including: displaying a virtual exhibition hall model; in response to the first controllable virtual device in the virtual exhibition hall model being operated, generating device control Instruction, the device control instruction includes: operation information and device information of the first controllable physical device matching the first controllable virtual device; sending the device control instruction to the central control host through the background server to For the central control host to control the first controllable entity device in the exhibition hall to perform corresponding operations according to the device control instruction.
  • the method further includes: when the device status of the second controllable entity device in the exhibition hall changes, receiving a model update instruction sent by the back-end server, the model update instruction includes: contacting the second The device information and current device status of the second controllable virtual device that matches the controllable physical device; in response to the model update instruction, the second controllable virtual device in the virtual exhibition hall model is updated to the current device status .
  • the method further includes: after the back-end server finishes processing the collected data uploaded by the data collection unit, receiving the processing result sent by the back-end server; and displaying the processing result.
  • the method before the step of displaying the virtual exhibition hall model, the method further includes: obtaining relevant data of the virtual exhibition hall model from a database of the back-end server.
  • the embodiments of the present disclosure also provide an exhibition hall control method, which is applied to the back-end server side, including: receiving the control terminal when the first controllable virtual device in the virtual exhibition hall model displayed by the control terminal is operated A device control instruction sent, where the device control instruction includes: operation information and device information of a first controllable physical device matching the first controllable virtual device; sending the device control instruction to the central control host, For the central control host to control the first controllable physical device in the exhibition hall to perform corresponding operations.
  • the method further includes: when the device status of the second controllable entity device in the exhibition hall changes, receiving a data update instruction sent by the central control host, the data update instruction includes: the second The device information and current device status of the controllable physical device; in response to the data update instruction, update the related data of the virtual exhibition hall model stored in the database; send a model update instruction to the control terminal, the model update instruction includes : Device information and current device status of the second controllable virtual device matching the second controllable physical device.
  • the method further includes: receiving collected data uploaded by a data collecting unit arranged in the exhibition hall; processing the collected data to obtain a processing result.
  • the data collection unit includes an image collection unit, and the collected data includes image data; the step of processing the collected data includes: determining the real-time number of people and the number of people in each area in the exhibition hall according to the image data. At least one of the person's character attribute and the movement trajectory of each person.
  • the method further includes: sending the processing result to the control terminal for display by the control terminal.
  • the method further includes: receiving a sensing result uploaded by a person sensing unit arranged in the exhibition hall; when the sensing result changes from a non-existent person to an existing person, sending it to the central control The host sends a first working state switching instruction, so that the central control host controls the third controllable physical device corresponding to the person sensing unit to switch from a standby state to a working state according to the first working state switching instruction;
  • a second operating state switching instruction is sent to the central control host, so that the central control host can control the communication with the central control host according to the second operating state switching instruction.
  • the third controllable entity device corresponding to the person sensing unit is switched from the working state to the standby state.
  • the embodiments of the present disclosure also provide an exhibition hall control method, which is applied to the central control host side, including: when the first controllable virtual device in the virtual exhibition hall model displayed by the control terminal is operated, receiving through the background server The device control instruction sent by the control terminal, where the device control instruction includes: device information and operation information of a first controllable physical device matching the first controllable virtual device; in response to the device control instruction, Control the first controllable entity device in the exhibition hall to perform corresponding operations.
  • the method further includes: when the device status of the second controllable entity device in the exhibition hall is monitored to change, sending a data update instruction to the back-end server for the back-end server to update the data in the database.
  • the data update instruction includes: device information and current device status of the second controllable physical device.
  • the method further includes: when the sensing result uploaded to the back-end server by the person sensing unit arranged in the exhibition hall changes from a non-existent person to an existing person, receiving the first person sent by the back-end server A working state switching instruction; according to the first working state switching instruction, the third controllable physical device corresponding to the person sensing unit is controlled to switch from a standby state to a working state.
  • the method further includes: when the sensing result uploaded to the back-end server by the person-sensing unit arranged in the exhibition hall changes from an existing person to a non-existent person, receiving the first sent by the back-end server 2.
  • a working state switching instruction according to the second working state switching instruction, the third controllable physical device corresponding to the person sensing unit is controlled to switch from a working state to a standby state.
  • an embodiment of the present disclosure also provides a control terminal, including: a first processor and a first memory, the first memory stores a first program, and the first program is processed by the first processor.
  • the steps in the exhibition hall control method provided in the foregoing first aspect embodiment are implemented when the device is executed.
  • an embodiment of the present disclosure also provides a background server, including: a second processor and a second memory, the second memory stores a second program, and the second program is processed by the second processor.
  • a background server including: a second processor and a second memory, the second memory stores a second program, and the second program is processed by the second processor.
  • the embodiments of the present disclosure also provide a central control host, including: a third processor and a third memory, the third memory stores a third program, and the third program is controlled by the third When the processor executes, the steps in the exhibition hall control method provided in the foregoing third aspect embodiment are implemented.
  • the embodiments of the present disclosure also provide an exhibition hall control system, including: the control terminal provided in the embodiment in the fourth aspect, the back-end server provided in the embodiment in the fifth aspect, and the control terminal provided in the embodiment in the sixth aspect. Central control host.
  • embodiments of the present disclosure also provide a computer-readable storage medium on which instructions are stored, and when the instructions are executed by a processor, the steps of the methods provided in the embodiments of the first to third aspects are implemented.
  • Figure 1 is a structural framework diagram of the exhibition hall control system involved in the technical solution of the present disclosure
  • FIG. 2 is a flowchart of an exhibition hall control method provided by an embodiment of the disclosure
  • FIG. 3 is a schematic diagram of an interface for controlling a terminal to display a virtual exhibition hall model in an embodiment of the disclosure
  • FIG. 5 is a flowchart of yet another exhibition hall control method provided by an embodiment of the present disclosure.
  • FIG. 6 is a schematic diagram of an interface for the control terminal to display character attributes, personnel distribution point maps, personnel number changes, and personnel distribution heat maps in an embodiment of the present disclosure
  • FIG. 7 is a schematic diagram of a terminal displaying a movement track of a person in an embodiment of the disclosure.
  • FIG. 8 is a flowchart of yet another exhibition hall control method provided by an embodiment of the present disclosure.
  • FIG. 9 is a flowchart of yet another exhibition hall control method provided by an embodiment of the disclosure.
  • FIG. 10 is a flowchart of yet another exhibition hall control method provided by an embodiment of the present disclosure.
  • FIG. 11 is a flowchart of yet another exhibition hall control method provided by an embodiment of the present disclosure.
  • FIG. 12 is a flowchart of yet another exhibition hall control method provided by an embodiment of the present disclosure.
  • FIG. 13 is a flowchart of yet another exhibition hall control method provided by an embodiment of the present disclosure.
  • FIG. 14 is a flowchart of yet another exhibition hall control method provided by an embodiment of the present disclosure.
  • FIG. 15 is a signaling diagram of controlling a controllable entity device in a real exhibition hall to perform corresponding operations through a control terminal in this disclosure
  • FIG. 16 is a signaling diagram of the state synchronization and data synchronization of the exhibition hall control system after the device state of the controllable entity device in the disclosure changes;
  • FIG. 17 is a signaling diagram in which the back-end server in the disclosure completes processing the collected data uploaded by the data collection unit and sends the processing result to the control terminal for display;
  • FIG. 18 is a signaling diagram of the back-end server in the disclosure controlling the corresponding controllable entity device to switch between the standby state and the working state according to the sensing result uploaded by the human sensing unit.
  • the opening, closing and content control of each exhibition equipment are independent. For example, during the opening process of the exhibition hall, managers need to go to different locations to manually turn on each device (for example, display, lighting, sound, etc.) one by one. Such an operation process is inefficient and error-prone, and it is not easy to adjust in response to emergencies.
  • the present disclosure provides an exhibition hall control method and system, a control terminal, a background server, and a central control host, which are used to eliminate one or more of the shortcomings and limitations in the related technology.
  • Fig. 1 is a structural framework diagram of the exhibition hall control system involved in the technical solution of the present disclosure.
  • the exhibition hall control system includes: a control terminal, a background server, and a central control host.
  • the central control host is the core of the entire exhibition hall.
  • Various external expansion actuators for example, relays, strong current controllers, infrared transmitters, serial ports
  • the equipment performs software and hardware control, and at the same time, all control commands for the controllable physical equipment are made into a standard control instruction library for subsequent calls.
  • the database of the back-end server stores the relevant data of the virtual exhibition hall model.
  • the virtual reality technology is combined with 3D modeling tools (such as 3DMax modeling work) in advance to model the real scene of the exhibition hall (also known as digitization), so as to obtain relevant data of the virtual exhibition hall model for subsequent control of the terminal use.
  • the background server can be used to "connect" the control terminal and the central control host, as a channel and gateway for the transmission of data and control instructions between the virtual exhibition hall and the real exhibition hall.
  • the control terminal can obtain the relevant data of the virtual exhibition hall model from the database of the back-end server, and render all the controllable physical equipment in the real exhibition hall in the form of controllable virtual equipment (for example, Unity3D rendering) on the 3D model.
  • the 3D model is
  • the virtual exhibition hall model can also be called the "digital twin exhibition hall".
  • the control terminal includes, but is not limited to, a tablet computer, a mobile phone, a personal computer (Personal Computer, PC for short) and other operable smart devices with a display function.
  • the controllable physical device in the present disclosure refers to the physical device located in the real exhibition hall that can be operated by control instructions, such as power controller, air conditioner, display, lighting, audio, digital signage, electric curtain, etc.
  • Managers can operate the virtual exhibition hall model presented by the control terminal, for example, adjust the size of the virtual exhibition hall model, switch the visual angle of the virtual exhibition hall model at will, watch the controllable virtual equipment in the virtual exhibition hall model from different angles, and watch the virtual exhibition hall model.
  • the panoramic view of the exhibition hall model, etc. can facilitate real-time monitoring of the actual exhibition hall by managers.
  • the management personnel can also operate the controllable virtual equipment in the virtual exhibition hall model to realize the control of the controllable physical equipment matching the controllable virtual equipment in the real exhibition hall to perform corresponding operations, thereby reducing the control of the management personnel. Difficulty, it is also convenient for managers to centralize management of all controllable physical equipment in the actual exhibition hall.
  • Fig. 2 is a flowchart of an exhibition hall control method provided by an embodiment of the present disclosure.
  • the execution body of the exhibition hall control method is a control terminal, and the exhibition hall control method may include steps S101 to S103.
  • step S101 a virtual exhibition hall model is displayed.
  • the relevant data of the virtual exhibition hall model is also stored in the control terminal, which can be based on rendering
  • the technology directly displays the virtual showroom model.
  • the relevant data of the virtual exhibition hall model is stored in the background server, but not in the control terminal. Therefore, before the control terminal displays the virtual exhibition hall model, it is also necessary to first obtain the relevant data of the virtual exhibition hall model from the database of the background server.
  • Fig. 3 is a schematic diagram of an interface for the control terminal to display a virtual exhibition hall model in an embodiment of the present disclosure.
  • the interface for displaying the virtual exhibition hall model can not only include the virtual exhibition hall model, but also display other information according to actual needs.
  • virtual function buttons such as "content control”, “light control”, “equipment control”, “exhibition hall open”, “exhibition hall all closed”, “lights all on”, “lights all off”
  • number of visitors Information such as "content control”, “light control”, “equipment control”, “exhibition hall open”, “exhibition hall all closed”, “lights all on”, “lights all off”
  • FIG. 3 only exemplarily shows an interface for displaying a virtual exhibition hall model, which does not limit the technical solution of the present disclosure.
  • step S102 in response to the first controllable virtual device in the virtual exhibition hall model being operated, a device control instruction is generated.
  • the control terminal When managers need to operate one or several controllable physical devices in the real exhibition hall, they only need to perform corresponding operations on the matching controllable virtual devices in the virtual exhibition hall model. At this time, the control terminal generates a device control instruction in response to the operation of the manager.
  • the device control instruction includes: device information (for example, device identification or device name) and operation information of the first controllable physical device matching the first controllable virtual device.
  • first controllable virtual device in this disclosure does not refer to a specific controllable virtual device, but refers to one or several controllable devices currently operated by the manager in the virtual exhibition hall model. Virtual device.
  • first controllable physical device is the controllable physical device that matches the first controllable virtual device in the real exhibition hall (that is, the controllable physical device that the manager currently wants to operate).
  • step S103 the device control instruction is sent to the central control host through the background server, so that the central control host controls the first controllable physical device in the exhibition hall to perform corresponding operations according to the device control instruction.
  • the mobile terminal sends the device control instruction to the back-end server, and the back-end server forwards the device control instruction to the central control host.
  • the central control host can send information corresponding to the operation information to the first controllable physical device in the actual exhibition hall through the external expansion actuator.
  • Corresponding standard control instructions (different operation information and corresponding standard control instructions are pre-stored in the control instruction library of the central control host) to control the first controllable entity device to perform corresponding operations.
  • FIG. 4 is a flowchart of another exhibition hall control method provided by an embodiment of the disclosure.
  • the executive body of the exhibition hall control method is a control terminal.
  • the exhibition hall control method not only includes the above steps S101 to S103, but also Including step S104 and step S105.
  • step S104 when the device status of the second controllable physical device in the exhibition hall changes, a model update instruction sent by the background server is received.
  • the central control host will also monitor in real time whether the device status of each controllable entity device in the exhibition hall changes, and when the device status of the controllable entity device changes (for example, the brightness of a certain light becomes brighter). , The volume of a certain speaker is reduced), the data update command will be sent to the background host.
  • the data update instruction includes: the device information of the second controllable entity device and the current device state.
  • the “second controllable entity device” in the present disclosure refers to one or more controllable entity devices whose status in the actual exhibition hall changes as monitored by the central control host.
  • the background server updates the related data of the virtual exhibition hall model stored in the database, and sends the model update instruction to the control terminal.
  • the data update instruction includes: device information and current device status of the second controllable virtual device matching the second controllable physical device.
  • step S105 in response to the model update instruction, the second controllable virtual device in the virtual exhibition hall model is updated to the current device state.
  • the control terminal updates the second controllable virtual device in the virtual exhibition hall model to the current device state, so as to synchronize the status of the virtual exhibition hall model and the real exhibition hall, while maintaining the connection between the control terminal and the background server. data synchronization.
  • the first controllable virtual device is the virtual display of the first controllable physical device in the virtual exhibition hall model
  • the second controllable virtual device is the virtual display of the second controllable physical device in the virtual exhibition hall model.
  • the first controllable virtual device (first controllable physical device) can be the same as the second controllable virtual device (second controllable physical device), or can be the same as the second controllable virtual device (second controllable physical device). Control physical equipment) is different.
  • the manager manipulates the controllable virtual device A'in the virtual exhibition hall model to control the controllable physical device A in the real exhibition hall (the controllable virtual device A'is a virtual display of the controllable physical device A) Change the state of the device.
  • the controllable physical device A responds to the standard control command sent by the central control host to change the device status
  • the central control host detects that the device status of the controllable physical device A has changed, and sends a data update command to the background server.
  • After receiving the data update instruction update the relevant data of the controllable virtual device A'in the database, and send the model update instruction to the control terminal.
  • the control terminal updates the device status of the controllable virtual device A'in the virtual exhibition hall model after receiving the model update instruction .
  • the first controllable virtual device and the second controllable virtual device are both controllable virtual device A′
  • the first controllable physical device and the second controllable physical device are both controllable virtual device A.
  • the manager manipulates the controllable virtual device A'in the virtual exhibition hall model to control the controllable physical device A in the real exhibition hall to change the device state.
  • another manager directly adjusts another controllable entity device B in the actual exhibition hall, so that the device status of the controllable entity device B changes, based on the aforementioned "status synchronization" and "data synchronization” process .
  • the background server updates the relevant data of the controllable virtual device B'in the database
  • the control terminal updates the device status of the controllable virtual device B'in the virtual exhibition hall model.
  • the first controllable virtual device is controllable virtual device A'
  • the second controllable virtual device is controllable virtual device B'
  • the first controllable physical device is controllable physical device A
  • the second controllable virtual device is controllable virtual device A'
  • the controllable entity device is the controllable entity device B.
  • step S104 to step S105 can be executed before step S101 to step S103 (the corresponding example is not given) ), or executed after step S101 to step S103 (as in example scenario 1), or executed synchronously with step S101 to step S103 (as in example scenario 2).
  • Fig. 4 also exemplarily shows the situation where steps S104 to S105 are executed after step S103.
  • Fig. 5 is a flowchart of another exhibition hall control method provided by an embodiment of the present disclosure.
  • the executive body of the exhibition hall control method is a control terminal.
  • the exhibition hall control method not only includes the above steps S101 to S103, but also Including step S106 and step S107.
  • step S106 after the back-end server finishes processing the collected data uploaded by the data collection unit, the back-end server receives the processing result sent by the back-end server.
  • several data collection units can be arranged in the actual exhibition hall, and these data collection units can send collected data to the back-end server, and the back-end server can perform corresponding processing on the collected data and obtain the processing result.
  • the data collection unit includes an image collection unit (for example, a camera), and the collected data uploaded by the data collection unit is image data.
  • the back-end server can use image processing technology (such as face recognition technology, target tracking technology, etc.) to analyze and process the image data uploaded by each image acquisition unit in the reality exhibition hall in real time to obtain the real-time number of people and personnel in each area of the reality exhibition hall.
  • image processing technology such as face recognition technology, target tracking technology, etc.
  • At least one of the person attributes for example, gender, age, VIP person, blacklist person, etc.
  • the background server can send the obtained processing result to the control terminal.
  • step S107 the processing result is displayed.
  • the technical solution of the present disclosure does not limit the display mode of the processing result.
  • Fig. 6 is a schematic diagram of an interface for the control terminal to display character attributes, personnel distribution point maps, personnel number changes, and personnel distribution heat maps in an embodiment of the disclosure.
  • the processing result includes character attribute recognition
  • the control terminal can use four display areas to display the processing results: the upper left display area is the display of character attribute recognition results, the upper right display area is the display of the distribution of people in the exhibition hall, the lower left is the display of the number of people change, and the lower right is the distribution of people in the exhibition hall.
  • Heat map display is the upper left display area is the display of character attribute recognition results
  • the upper right display area is the display of the distribution of people in the exhibition hall
  • the lower left is the display of the number of people change
  • the lower right is the distribution of people in the exhibition hall.
  • FIG. 7 is a schematic diagram of the terminal displaying the movement trajectory of a person in an embodiment of the disclosure.
  • the processing result includes the movement trajectory of the person.
  • the movement trajectory of at least part of the person is displayed in combination with the virtual exhibition hall model. .
  • managers can intuitively view the real-time status of the entire exhibition hall. Using these data, managers can quickly make operation and maintenance decisions. For example, adding management personnel to areas with too many visitors, and replacing exhibits in areas with too few people.
  • VIP or blacklist data can be added to the back-end server, and the personal attributes of the people in the exhibition hall can be identified through face recognition technology.
  • VIP personnel or blacklisted personnel appear in the exhibition hall they can be captured by the data acquisition unit and recognized by the back-end server.
  • the back-end server can quickly push the processing results to the control terminal of the manager to remind the manager.
  • step S106 to step S107 can be executed before step S101 to step S103, or after step S101 ⁇ Step S103 is executed, or executed synchronously with step S101 ⁇ Step S103.
  • Fig. 5 also exemplarily shows the situation where steps S106 to S107 are executed after step S103.
  • FIG. 8 is a flowchart of another exhibition hall control method provided by an embodiment of the present disclosure.
  • the execution body of the exhibition hall control method is a background server, and the exhibition hall control method may include steps S201 and S202.
  • step S201 when the first controllable virtual device in the virtual exhibition hall model displayed by the control terminal is operated, a device control instruction sent by the control terminal is received.
  • the device control instruction includes: operation information and device information of the first controllable physical device matching the first controllable virtual device.
  • step S202 the device control instruction is sent to the central control host, so that the central control host controls the first controllable physical device in the exhibition hall to perform corresponding operations.
  • step S201 and step S202 refer to the corresponding content in the foregoing embodiment, which will not be repeated here.
  • Fig. 9 is a flowchart of yet another exhibition hall control method provided by an embodiment of the present disclosure.
  • the executive body of the exhibition hall control method is a background server.
  • the exhibition hall control method not only includes the above steps S201 to S202, but also Including step S203 to step S205.
  • step S203 when the device status of the second controllable physical device in the exhibition hall changes, a data update instruction sent by the central control host is received.
  • the data update instruction includes: the device information of the second controllable entity device and the current device state.
  • step S204 in response to the data update instruction, the related data of the virtual exhibition hall model stored in the database is updated.
  • step S205 a model update instruction is sent to the control terminal for the control terminal to update the virtual exhibition hall model according to the model update instruction.
  • the model update instruction includes: the device information of the second controllable virtual device that matches the second controllable physical device and the current device state.
  • step S203 to step S205 please refer to the corresponding content in the foregoing embodiment, which will not be repeated here.
  • step S203 to step S205 can be executed before step S201 to step S202, or after step S201 ⁇ Step S202 is executed, or executed synchronously with step S201 ⁇ Step S202.
  • Fig. 9 also exemplarily shows the situation where steps S203 to S205 are executed after step S202.
  • Fig. 10 is a flowchart of another exhibition hall control method provided by an embodiment of the present disclosure.
  • the executive body of the exhibition hall control method is a background server.
  • the exhibition hall control method not only includes the above steps S201 to S202, but also Including step S206 to step S208.
  • step S206 the collected data uploaded by the data collection unit arranged in the exhibition hall is received.
  • step S207 the collected data is processed to obtain a processing result.
  • the data collection unit includes an image collection unit (for example, a camera), and the collected data includes image data; the step of processing the collected data may include: determining the real-time number of persons in each area of the exhibition hall and the number of persons in each area according to the image data. At least one of character attributes and movement trajectories of each person.
  • step S208 the processing result is sent to the control terminal for display by the control terminal.
  • step S206 to step S208 please refer to the corresponding content in the foregoing embodiment, which will not be repeated here.
  • step S206 to step S208 can be executed before step S201 to step S202, or after step S201 ⁇ Step S202 is executed, or executed synchronously with step S201 ⁇ Step S202.
  • Fig. 10 also exemplarily shows the situation where steps S206 to S208 are executed after step S202.
  • FIG. 11 is a flowchart of another exhibition hall control method provided by an embodiment of the present disclosure.
  • the executive body of the exhibition hall control method is a background server.
  • the exhibition hall control method not only includes the above steps S201 to S202, but also Including step S209 to step S211.
  • step S209 the sensing result uploaded by the personnel sensing unit arranged in the exhibition hall is received.
  • some controllable physical devices for example, digital signage
  • the personnel sensing units can detect whether there are people near the corresponding controllable physical devices. , And upload the test results to the background server.
  • the back-end server receives the sensing results uploaded by each person sensing unit in real time; when the back-end server receives the sensing result uploaded by a certain person sensing unit from a non-existent person to an existing person, step S210 is executed thereafter; when the back-end server When a sensing result uploaded by a certain person sensing unit is received and changed from an existing person to a non-existent person, step S211 is executed thereafter.
  • step S210 a first operating state switching instruction is sent to the central control host.
  • the back-end server When the back-end server receives the sensing result uploaded by a certain person sensing unit from non-existent person to existing person, it indicates that a person arrives at the controllable entity device corresponding to the person sensing unit (that is, the third controllable entity) Near the device), the background server sends the first working state switching instruction to the central control host, so that the central control host controls the third controllable physical device corresponding to the human sensing unit to switch from the standby state according to the first working state switching instruction To working state.
  • the first working state switching instruction includes device information of the third controllable entity device corresponding to the human sensing unit and operation information indicating that the central control host needs to switch the third controllable entity device to the working state.
  • step S211 a second operating state switching instruction is sent to the central control host.
  • the back-end server When the back-end server receives that the sensing result uploaded by a certain person sensing unit changes from a presence of a person to a non-existent person, it indicates that there is no one near the controllable physical device corresponding to the person’s sensing unit, and the back-end server reports
  • the central control host sends a second working state switching instruction for the central control host to control the third controllable physical device corresponding to the human sensing unit to switch from the working state to the standby state according to the second working state switching instruction.
  • the second working state switching instruction includes device information of the third controllable entity device corresponding to the human sensing unit and operation information indicating that the central control host needs to switch the third controllable entity device to the standby state.
  • a digital signage is provided in a real exhibition hall, and the digital signage can be used to explain the exhibition in at least one form of text, image, audio, and video.
  • Each digital sign (an example of a controllable physical device) is equipped with a corresponding infrared human sensor (an example of a person sensing unit).
  • Each infrared human sensor can detect whether there is a person near the corresponding digital sign, and The test results are uploaded to the server.
  • the background server sends a first working state switching instruction to the central control host (including the device information of the controllable entity device C and characterizes that the central control host needs the controllable entity device C switch to working state operation information), the central control host controls the controllable physical device C to switch from the standby state (no exhibition explanation) to the working state (exhibition explanation) according to the received first working state switching instruction.
  • the central control host controls the control system according to the received second working state switching instruction
  • the control entity device C is switched from the working state (for exhibition explanation) to the standby state (without exhibition explanation).
  • FIG. 12 is a flowchart of another exhibition hall control method provided by an embodiment of the present disclosure. As shown in FIG. 12, the execution body of the exhibition hall control method is the central control host, and the exhibition hall control method may include steps S301 and S302.
  • step S301 when the first controllable virtual device in the virtual exhibition hall model displayed by the control terminal is operated, the device control instruction sent by the control terminal is received through the background server.
  • the device control instruction includes: device information and operation information of the first controllable physical device matching the first controllable virtual device.
  • step S302 in response to the device control instruction, the first controllable entity device in the exhibition hall is controlled to perform corresponding operations.
  • step S301 and step S302 please refer to the corresponding content in the foregoing embodiment, which will not be repeated here.
  • FIG. 13 is a flowchart of yet another exhibition hall control method provided by an embodiment of the present disclosure.
  • the execution body of the exhibition hall control method is the central control host.
  • the exhibition hall control method not only includes the above steps S301 to S302, It also includes step S303.
  • step S303 when the device status of the second controllable physical device in the exhibition hall is monitored to change, a data update instruction is sent to the back-end server for the back-end server to update the relevant data of the virtual exhibition hall model stored in the database and send it to the control terminal Send model update instructions.
  • the data update instruction includes: the device information of the second controllable entity device and the current device state.
  • step S303 For the specific description of step S303, refer to the corresponding content in the foregoing embodiment, which is not repeated here.
  • step S303 can be executed before step S301 to step S302, or after step S301 to step S302, or It is executed synchronously with step S301 to step S302.
  • Fig. 13 also only exemplarily shows the case where S303 is executed after step S302.
  • FIG. 14 is a flowchart of another exhibition hall control method provided by an embodiment of the disclosure.
  • the executive body of the exhibition hall control method is the central control host.
  • the exhibition hall control method not only includes the above steps S301 to S302, It also includes steps S304 to S307.
  • step S304 when the sensing result uploaded to the background server by the personnel sensing unit arranged in the exhibition hall changes from non-existent personnel to existing personnel, the first working state switching instruction sent by the background server is received.
  • step S305 the third controllable entity device corresponding to the person sensing unit is controlled to switch from the standby state to the working state according to the first working state switching instruction.
  • step S306 when the sensing result uploaded to the back-end server by the person-sensing unit arranged in the exhibition hall changes from the presence of the personnel to the absence of the personnel, the second working state switching instruction sent by the back-end server is received.
  • step S307 the third controllable entity device corresponding to the person sensing unit is controlled to switch from the working state to the standby state according to the second working state switching instruction.
  • step S304 to step S307 refer to the corresponding content in the foregoing embodiment, which will not be repeated here.
  • Fig. 14 also exemplarily shows the case where steps S304 to S305 and steps S306 to S307 are executed after step S302.
  • the embodiment of the present disclosure also provides a control terminal, including: a first processor and a first memory, and a first program is stored on the first memory.
  • a control terminal including: a first processor and a first memory, and a first program is stored on the first memory.
  • the steps in the exhibition hall control method provided by the embodiments shown in 4 and FIG. 5.
  • the embodiment of the present disclosure also provides a background server, including: a second processor and a second memory, and a second program is stored on the second memory. 9. The steps in the exhibition hall control method provided by the embodiment shown in FIG. 10 and FIG. 11.
  • the embodiment of the present disclosure also provides a central control host, including: a third processor and a third memory, and a third program is stored on the third memory.
  • a central control host including: a third processor and a third memory, and a third program is stored on the third memory.
  • the embodiment of the present disclosure also provides an exhibition hall control system, including: the control terminal, the background server, and the central control host provided in the foregoing embodiment.
  • the embodiments of the present disclosure also provide a computer-readable storage medium on which instructions are stored, and when the instructions are executed by a processor, the steps of the method described herein are implemented.
  • FIG. 15 is a signaling diagram of controlling the controllable entity equipment in the actual exhibition hall to perform corresponding operations through the control terminal in this disclosure.
  • the signaling interaction between the parties may include: BZ1, the control terminal from the background server Get the relevant data of the virtual exhibition hall model in the database; BZ2, display the virtual exhibition hall model; BZ3, respond to the operation of the first controllable virtual device in the virtual exhibition hall model, and control the terminal to generate device control instructions; BZ4a, send the device control instructions To the background server; BZ4b, the background server forwards the equipment control instructions to the central control host; BZ4c, the central control host generates and sends standard control instructions according to the equipment control instructions to control the first controllable entity equipment in the exhibition hall to perform corresponding operations.
  • BZ1 is optional.
  • Figure 16 is a signaling diagram of the state synchronization and data synchronization of the exhibition hall control system after the device status of the controllable entity device in the disclosure changes.
  • the signaling interaction between the parties can include: BZ5, Zhong The control host monitors that the device status of the second controllable physical device changes; BZ6, the central control host sends a data update instruction to the background server; BZ7, the background server updates the database according to the data update instruction; BZ8, the background server sends the control terminal Send a model update instruction; BZ9, the control terminal updates the model of the virtual exhibition hall according to the model update instruction.
  • Figure 17 is a signaling diagram showing that the back-end server in the disclosure processes the collected data uploaded by the data collection unit and sends the processing result to the control terminal for display.
  • the signaling interaction between the parties can include : BZ10, the background server receives the collected data uploaded by the data collection unit; BZ11, the background server processes the collected data and obtains the processing result; BZ12, sends the processing result to the control terminal; BZ13, the control terminal displays the processing result.
  • FIG. 18 is a signaling diagram of the back-end server in the disclosure controlling the corresponding controllable entity device to switch between the standby state and the working state according to the sensing result uploaded by the human sensing unit.
  • the parties The signaling interaction can include: BZ14, the background server receives the sensing result uploaded by the human sensing unit; BZ15, in response to the sensing result uploaded by a certain sensing unit, changes from a non-existent person to an existing person, and sends it to the central control host The first working state switching instruction; BZ16, the central control host controls the third controllable entity device corresponding to the sensing unit to switch from the standby state to the working state; BZ17, in response to the sensing result uploaded by a certain sensing unit When the existing personnel changes to the non-existent personnel, the second working state switching instruction is sent to the central control host; BZ18, the central control host controls the third controllable entity device corresponding to the sensing unit to switch from the working state to the standby state.
  • the functional modules/units in the device can be implemented as software, firmware, hardware, and appropriate combinations thereof.
  • the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may consist of several physical components.
  • the components are executed cooperatively.
  • Some physical components or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit .
  • Such software may be distributed on a computer-readable medium, and the computer-readable medium may include a computer storage medium (or a non-transitory medium) and a communication medium (or a transitory medium).
  • the term computer storage medium includes volatile and nonvolatile implementations in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Sexual, removable and non-removable media.
  • Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, tapes, magnetic disk storage or other magnetic storage devices, or Any other medium used to store desired information and that can be accessed by a computer.
  • communication media usually contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery media. .

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Automation & Control Theory (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephonic Communication Services (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

一种展厅控制方法，应用于控制终端侧，包括：显示虚拟展厅模型（S101）；响应于虚拟展厅模型中的第一可控虚拟设备被操作，生成设备控制指令，设备控制指令包括：与第一可控虚拟设备相匹配的第一可控实体设备的设备信息以及操作信息（S102）；将设备控制指令通过后台服务器发送至中控主机，以供中控主机根据设备控制指令控制展厅内的第一可控实体设备执行相应操作（S103）。还提供了一种控制终端、后台服务器、中控主机、展厅控制方法、计算机可读存储介质。

Description

展厅控制方法及系统、控制终端、后台服务器和中控主机
相关申请的交叉引用
本申请要求于2019年11月25日提交的中国专利申请No.201911168740.5的优先权，其全部内容通过引用合并于此。
技术领域
本公开涉及智能展厅领域，特别涉及一种展厅控制方法及系统、控制终端、后台服务器、中控主机、以及计算机可读存储介质。
背景技术
在大多展厅中，各展陈设备的开启、关闭、内容控制都是独立的。例如，在展厅开启的过程中，需要管理人员跑到不同位置逐一手动开启各个设备(例如，显示器、灯光、音响等)。
发明内容
本公开提供了一种展厅控制方法及系统、控制终端、后台服务器、中控主机及计算机可读存储介质。
第一方面，本公开实施例提供了一种展厅控制方法，应用于控制终端侧，包括：显示虚拟展厅模型；响应于所述虚拟展厅模型中的第一可控虚拟设备被操作，生成设备控制指令，所述设备控制指令包括：操作信息和与所述第一可控虚拟设备相匹配的第一可控实体设备的设备信息；将所述设备控制指令通过后台服务器发送至中控主机，以供所述中控主机根据所述设备控制指令控制展厅内的所述第一可控实体设备执行相应操作。
在一些实施例中，所述方法还包括：当展厅内的第二可控实体设备的设备状态发生变化时，接收后台服务器发送的模型更新指令，所述模型更新指令包括：与所述第二可控实体设备相匹配的第二可控虚拟设备的设备信息以及当前设备状态；响应于所述模型更新指令，将虚拟展厅模型中的所述第二可控虚拟设备更新至所述当前设备状 态。
在一些实施例中，所述方法还包括：当后台服务器对数据采集单元所上传的采集数据完成处理后，接收所述后台服务器发送的处理结果；将所述处理结果进行展示。
在一些实施例中，在所述显示虚拟展厅模型的步骤之前，所述方法还包括：从所述后台服务器的数据库内获取所述虚拟展厅模型的相关数据。
第二方面，本公开实施例还提供了一种展厅控制方法，应用于后台服务器侧，包括：当控制终端所显示虚拟展厅模型中的第一可控虚拟设备被操作时，接收所述控制终端发送的设备控制指令，所述设备控制指令包括：操作信息和与所述第一可控虚拟设备相匹配的第一可控实体设备的设备信息；将所述设备控制指令发送至中控主机，以供所述中控主机控制展厅内的所述第一可控实体设备执行相应操作。
在一些实施例中，所述方法还包括：当展厅内的第二可控实体设备的设备状态发生变化时，接收中控主机发送的数据更新指令，所述数据更新指令包括：所述第二可控实体设备的设备信息和当前设备状态；响应于所述数据更新指令，更新数据库内存储的所述虚拟展厅模型的相关数据；向所述控制终端发送模型更新指令，所述模型更新指令包括：与所述第二可控实体设备相匹配的第二可控虚拟设备的设备信息以及当前设备状态。
在一些实施例中，所述方法还包括：接收布置于展厅内的数据采集单元上传的采集数据；对所述采集数据进行处理，得到处理结果。
在一些实施例中，所述数据采集单元包括图像采集单元，所述采集数据包括图像数据；所述对采集数据进行处理的步骤包括：根据所述图像数据确定展厅内各区域的实时人数、各人员的人物属性、各人员的移动轨迹中的至少一者。
在一些实施例中，在所述对所述采集数据进行处理的步骤之后，所述方法还包括：将所述处理结果发送至所述控制终端，以供所述控制终端进行展示。
在一些实施例中，所述方法还包括：接收布置于展厅内的人员 感测单元所上传的感测结果；当所述感测结果由不存在人员变化为存在人员时，向所述中控主机发送第一工作状态切换指令，以供所述中控主机根据所述第一工作状态切换指令控制与所述人员感测单元相对应的第三可控实体设备由待机状态切换至工作状态；当所述感测结果由存在人员变化为不存在人员时，向所述中控主机发送第二工作状态切换指令，以供所述中控主机根据所述第二工作状态切换指令控制与所述人员感测单元相对应的第三可控实体设备由工作状态切换至待机状态。
第三方面，本公开实施例还提供了一种展厅控制方法，应用于中控主机侧，包括：当控制终端所显示虚拟展厅模型中的第一可控虚拟设备被操作时，通过后台服务器接收所述控制终端发送的设备控制指令，所述设备控制指令包括：与所述第一可控虚拟设备相匹配的第一可控实体设备的设备信息以及操作信息；响应于所述设备控制指令，控制所述展厅内的所述第一可控实体设备执行相应操作。
在一些实施例中，所述方法还包括：当监控到展厅内的第二可控实体设备的设备状态发生变化时，向所述后台服务器发送数据更新指令，以供所述后台服务器更新数据库内存储的所述虚拟展厅模型的相关数据以及向所述控制终端发送模型更新指令，所述数据更新指令包括：所述第二可控实体设备的设备信息和当前设备状态。
在一些实施例中，所述方法还包括：当布置于展厅内人员感测单元所上传至所述后台服务器的感测结果由不存在人员变化为存在人员时，接收所述后台服务器发送的第一工作状态切换指令；根据所述第一工作状态切换指令控制与所述人员感测单元相对应的第三可控实体设备由待机状态切换至工作状态。
在一些实施例中，所述方法还包括：当布置于展厅内人员感测单元所上传至所述后台服务器的感测结果由存在人员变化为不存在人员时，接收所述后台服务器发送的第二工作状态切换指令；根据所述第二工作状态切换指令控制与所述人员感测单元相对应的第三可控实体设备由工作状态切换至待机状态。
第四方面，本公开实施例还提供了一种控制终端，包括：第一 处理器和第一存储器，所述第一存储器上存储有第一程序，所述第一程序被所述第一处理器执行时实现如前述第一方面实施例提供的所述展厅控制方法中的步骤。
第五方面，本公开实施例还提供了一种后台服务器，包括：第二处理器和第二存储器，所述第二存储器上存储有第二程序，所述第二程序被所述第二处理器执行时实现如前述第二方面实施例提供的所述展厅控制方法中的步骤。
第六方面，本公开实施例还提供了一种中控主机，包括：第三处理器和第三存储器，所述第三存储器上存储有第三程序，所述第三程序被所述第三处理器执行时实现如前述第三方面实施例提供的所述展厅控制方法中的步骤。
第七方面，本公开实施例还提供了一种展厅控制系统，包括：第四方面实施例所提供的控制终端、第五方面实施例所所提供的后台服务器和第六方面实施例所提供的中控主机。
第八方面，本公开实施例还提供了一种计算机可读存储介质，其上存储有指令，所述指令被处理器执行时，实现第一至第三方面的实施例提供的方法的步骤。
附图说明
图1为本公开的技术方案涉及的展厅控制系统的结构构架图；
图2为本公开实施例提供的一种展厅控制方法的流程图；
图3为本公开实施例中控制终端展示虚拟展厅模型的一种界面示意图；
图4为本公开实施例提供的另一种展厅控制方法的流程图；
图5为本公开实施例提供的再一种展厅控制方法的流程图；
图6为本公开实施例中控制终端展示人物属性、人员分布点图、人员数量变化、人员分布热力图的一种界面示意图；
图7为本公开实施例中终端展示人员移动轨迹的示意图；
图8为本公开实施例提供的再一种展厅控制方法的流程图；
图9为本公开实施例提供的再一种展厅控制方法的流程图；
图10为本公开实施例提供的再一种展厅控制方法的流程图；
图11为本公开实施例提供的再一种展厅控制方法的流程图；
图12为本公开实施例提供的再一种展厅控制方法的流程图；
图13为本公开实施例提供的再一种展厅控制方法的流程图；
图14为本公开实施例提供的再一种展厅控制方法的流程图；
图15为本公开中通过控制终端控制现实展厅内的可控实体设备执行相应操作的信令图；
图16为本公开中可控实体设备的设备状态发生变化后展厅控制系统进行状态同步和数据同步的信令图；
图17为本公开中后台服务器对数据采集单元所上传的采集数据完成处理后将处理结果发送至控制终端进行显示的信令图；
图18为本公开中后台服务器根据人员感测单元上传的感测结果控制对应的可控实体设备在待机状态和工作状态之间进行切换的信令图。
具体实施方式
为使本领域的技术人员更好地理解本公开的技术方案，下面结合附图对本公开提供的一种展厅控制方法及系统、控制终端、后台服务器和中控主机进行详细描述。
在下文中将参考附图更充分地描述示例实施例，但是所述示例实施例可以以不同形式来体现且不应当被解释为限于本文阐述的实施例。反之，提供这些实施例的目的在于使本公开透彻和完整，并将使本领域技术人员充分理解本公开的范围。
本文所使用的术语仅用于描述特定实施例，且不意欲限制本公开。如本文所使用的，单数形式“一个”和“该”也意欲包括复数形式，除非上下文另外清楚指出。还将理解的是，当本说明书中使用术语“包括”和/或“由……制成”时，指定存在所述特征、整体、步骤、操作、元件和/或组件，但不排除存在或添加一个或多个其他特征、整体、步骤、操作、元件、组件和/或其群组。
将理解的是，虽然本文可以使用术语第一、第二等来描述各种 指令、设备，但这些指令、设备不应当受限于这些术语，这些术语仅用于区分一个对象和另一对象。
除非另外限定，否则本文所用的所有术语(包括技术和科学术语)的含义与本领域普通技术人员通常理解的含义相同。还将理解，诸如那些在常用字典中限定的那些术语应当被解释为具有与其在相关技术以及本公开的背景下的含义一致的含义，且将不解释为具有理想化或过度形式上的含义，除非本文明确如此限定。
在大多展厅中，各展陈设备的开启、关闭、内容控制都是独立的。例如，在展厅开启的过程中，需要管理人员跑到不同位置逐一手动开启各个设备(例如，显示器、灯光、音响等)。这样的操作流程，效率低下且容易出错，应对突发事件不易进行调整。
因此，本公开提供了展厅控制方法及系统、控制终端、后台服务器和中控主机，用于消除相关技术中的缺点和限制所导致的问题中的一个或多个。
图1为本公开的技术方案涉及的展厅控制系统的结构构架图，如图1所示，该展厅控制系统包括：控制终端、后台服务器和中控主机。
其中，中控主机作为整个展厅控制的核心，中控主机上扩展有各种外扩执行器(例如，继电器、强电控制器、红外发射器、串口)，可对展厅内所有的可控实体设备进行软、硬件的控制，同时将所有对可控实体设备的控制命令做成标准的控制指令库供后续调用。
后台服务器的数据库中存储有虚拟展厅模型的相关数据。具体地，预先利用虚拟现实技术与三维建模工具(例如3DMax建模工作)相结合，将展厅的实景模型化(又叫作数字化)，从而得到虚拟展厅模型的相关数据，以供控制终端后续使用。后台服务器可用于“连接”控制终端和中控主机，作为虚拟展厅与现实展厅之间数据和控制指令传输的通路和网关。
控制终端可从后台服务器的数据库中获取虚拟展厅模型的相关数据，将现实展厅内所有的可控实体设备以可控虚拟设备的形式渲染(例如Unity3D渲染)在3D模型上呈现，该3D模型为虚拟展厅模 型，亦可称为“数字孪生展厅”。针对现实展厅内的每一个可控实体设备，会在虚拟展厅模型中存在一个相匹配的可控虚拟设备。其中，控制终端包括但不限于平板电脑、手机、个人计算机(Personal Computer，简称PC)等具有显示功能的可操作型智能设备。
本公开中的可控实体设备是指位于现实展厅中可以通过控制指令来控制其进行操作的实体设备，例如电源控制器、空调、显示器、灯光、音响、数字标牌、电动窗帘等。
管理人员可对控制终端所呈现的虚拟展厅模型进行操作，例如，调节虚拟展厅模型的大小、随意切换虚拟展厅模型的可视视角、从不同角度观看虚拟展厅模型中的可控虚拟设备、观看虚拟展厅模型的全景视图等，能方便管理人员对现实展厅进行实时监控。同时，管理人员还可通过对虚拟展厅模型内的可控虚拟设备进行操作，以实现控制现实展厅内与该可控虚拟设备相匹配的可控实体设备进行相应操作，从而能降低管理人员的操控难度，也方便管理人员对现实展厅中的全部可控实体设备进行集中化管理。
下面将结合具体实施例来对本公开的技术方案进行详细描述。
图2为本公开实施例提供的一种展厅控制方法的流程图，如图2所示，该展厅控制方法的执行主体为控制终端，该展厅控制方法可以包括步骤S101至S103。
在步骤S101，显示虚拟展厅模型。
在一些实施例中，在对展厅进行建模的过程中，在将虚拟展厅模型的相关数据存储于后台服务器的同时，还将虚拟展厅模型的相关数据存储至控制终端内，控制终端可基于渲染技术直接显示虚拟展厅模型。
在一些实施例中，在对展厅进行建模的过程中，仅将虚拟展厅模型的相关数据存储于后台服务器，而未存储于控制终端内。因此，在控制终端显示虚拟展厅模型之前，还需要先进行从后台服务器的数据库内获取虚拟展厅模型的相关数据的步骤。
图3为本公开实施例中控制终端展示虚拟展厅模型的一种界面示意图，如图3所示，该展示虚拟展厅模型的界面不但可以包括虚拟 展厅模型，还可以根据实际需要来展示其他信息，例如虚拟功能按键(例如“内容控制”、“灯光控制”、“设备控制”、“展馆全开”、“展馆全关”、“灯光全开”、“灯光全关”)、参观人数信息、展馆环境信息、设备状态、展项实时排名等。需要说明的是，图3仅示例性给出了一种展示虚拟展厅模型的界面，其不会对本公开的技术方案产生限制。
在步骤S102，响应于虚拟展厅模型中的第一可控虚拟设备被操作，生成设备控制指令。
当管理人员需要对现实展厅内的某一个或几个可控实体设备进行操作时，其仅需对虚拟展厅模型中相匹配的可控虚拟设备进行相应操作即可。此时，控制终端响应于管理人员的操作，生成设备控制指令。其中，设备控制指令包括：与第一可控虚拟设备相匹配的第一可控实体设备的设备信息(例如，设备标识或设备名称)以及操作信息。
需要说明的是，本公开中的“第一可控虚拟设备”并不是指某个特定的可控虚拟设备，而是指管理人员在虚拟展厅模型中当前所操作的某一个或几个可控虚拟设备。此时，“第一可控实体设备”为现实展厅中与第一可控虚拟设备相匹配的可控实体设备(即管理人员当前想进行操作的可控实体设备)。
在步骤S103，将设备控制指令通过后台服务器发送至中控主机，以供中控主机根据设备控制指令控制展厅内的第一可控实体设备执行相应操作。
移动终端将该设备控制指令发送至后台服务器，后台服务器将该设备控制指令转发至中控主机，中控主机可通过外扩执行器向现实展厅内的第一可控实体设备发送与操作信息相对应的标准控制指令(中控主机的控制指令库中预先存储有不同操作信息及其对应的标准控制指令)，以控制第一可控实体设备执行相应操作。
图4为本公开实施例提供的另一种展厅控制方法的流程图，如图4所示，该展厅控制方法的执行主体为控制终端，该展厅控制方法不但包括上述步骤S101～步骤S103，还包括步骤S104和步骤S105。
在步骤S104，当展厅内的第二可控实体设备的设备状态发生变 化时，接收后台服务器发送的模型更新指令。
在本公开中，中控主机还会实时监控展厅内各可控实体设备的设备状态是否发生变化，并当监控到存在可控实体设备的设备状态发生变化(例如，某个灯的亮度变亮，某个音响的音量降低)时，会向后台主机发送的数据更新指令。其中，数据更新指令包括：第二可控实体设备的设备信息和当前设备状态。
需要说明的是，本公开中的“第二可控实体设备”是指中控主机监控到的现实展厅内设备状态发生变化的一个或多个可控实体设备。
后台服务器接收到数据更新指令后，更新数据库内存储的虚拟展厅模型的相关数据，并向控制终端发送模型更新指令。其中，数据更新指令包括：与第二可控实体设备相匹配的第二可控虚拟设备的设备信息和当前设备状态。
在步骤S105，响应于模型更新指令，将虚拟展厅模型中的第二可控虚拟设备更新至当前设备状态。
控制终端根据接收到的模型更新指令，将虚拟展厅模型中的第二可控虚拟设备更新至当前设备状态，以实现虚拟展厅模型与现实展厅的状态同步，同时还能保持控制终端与后台服务器的数据同步。
在本公开中，第一可控虚拟设备是第一可控实体设备在虚拟展厅模型中的虚拟化展现，第二可控虚拟设备是第二可控实体设备在虚拟展厅模型中的虚拟化展现。在本公开中，第一可控虚拟设备(第一可控实体设备)可以与第二可控虚拟设备(第二可控实体设备)相同，也可以与第二可控虚拟设备(第二可控实体设备)不同。
作为示例场景一，在管理人员通过操作虚拟展厅模型中可控虚拟设备A′，以控制现实展厅内的可控实体设备A(可控虚拟设备A′为可控实体设备A的虚拟化展现)改变设备状态。当该可控实体设备A响应中控主机发送的标准控制指令以进行设备状态改变时，中控主机监测到可控实体设备A的设备状态发生改变，并向后台服务器发送数据更新指令，后台服务器接收到数据更新指令后更新数据库中可控虚拟设备A′的相关数据，并向控制终端发送模型更新指令， 控制终端接收到模型更新指令后更新虚拟展厅模型中可控虚拟设备A′的设备状态。在该示例场景一中，第一可控虚拟设备和第二可控虚拟设备均为可控虚拟设备A′，第一可控实体设备和第二可控实体设备均为可控虚拟设备A。
作为示例场景二，在管理人员通过操作虚拟展厅模型中可控虚拟设备A′，以控制现实展厅内的可控实体设备A改变设备状态。与此同时，另一管理人员在现实展厅中直接对另一可控实体设备B进行调节，以使得可控实体设备B的设备状态发生改变，基于前述“状态同步”和“数据同步”的流程，后台服务器更新数据库中可控虚拟设备B′的相关数据，控制终端更新虚拟展厅模型中可控虚拟设备B′的设备状态。在该示例场景二中，第一可控虚拟设备为可控虚拟设备A′，第二可控虚拟设备为可控虚拟设备B′，第一可控实体设备为可控实体设备A，第二可控实体设备为可控实体设备B。
需要说明的是，本公开的技术方案对步骤S104～步骤S105与步骤S101～步骤S103的先后执行顺序不作限定，即步骤S104～步骤S105可先于步骤S101～步骤S103执行(未给出相应示例)，或后于步骤S101～步骤S103执行(如示例场景一)，或与步骤S101～步骤S103执行同步执行(如示例场景二)。附图4也仅示例性给出了步骤S104～步骤S105位于步骤S103之后执行的情况。
图5为本公开实施例提供的再一种展厅控制方法的流程图，如图5所示，该展厅控制方法的执行主体为控制终端，该展厅控制方法不但包括上述步骤S101～步骤S103，还包括步骤S106和步骤S107。
在步骤S106，当后台服务器对数据采集单元所上传的采集数据完成处理后，接收后台服务器发送的处理结果。
在本公开实施例中，可在现实展厅中布置若干个数据采集单元，这些数据采集单元可向后台服务器发送采集数据，后台服务器可对这些采集数据进行相应处理并得到处理结果。
作为一个示例，数据采集单元包括图像采集单元(例如摄像头)，数据采集单元所上传的采集数据为图像数据。后台服务器可通过图像处理技术(例如人脸识别技术、目标跟踪技术等)，对现实展厅内各 图像采集单元上传的图像数据进行实时分析处理，以得到现实展厅内各区域的实时人数、各人员的人物属性(例如，性别、年龄、VIP人员、黑名单人员等)、各人员的移动轨迹中的至少一者，并输出结构化的处理结果数据。后台服务器可将得到的处理结果发送至控制终端。
在步骤S107，将处理结果进行展示。
本公开的技术方案对处理结果的展示方式不作限定。
图6为本公开实施例中控制终端展示人物属性、人员分布点图、人员数量变化、人员分布热力图的一种界面示意图，如图6所示，作为一个示例，处理结果中包括人物属性识别结果、各区域的实时人数。控制终端可利用四个显示区来显示处理结果：左上显示区为人物属性识别结果展示、右上显示区为展厅内人员分布点图展示、左下为人员数量变化图展示、右下为展厅内人员分布热力图展示。
图7为本公开实施例中终端展示人员移动轨迹的示意图，如图7所示，作为一个示例，处理结果中包括人员的移动轨迹，此时结合虚拟展厅模型将至少部分人员的移动轨迹进行展示。
在本公开中，管理人员能够直观的查看整个展厅的实时状态，使用这些数据，管理人员可以快速进行运维决策。例如，对参观人数过多的区域增派管理人员，替换掉人流过少的区域展品等。
作为一个示例，可在后台服务器中添加VIP或者黑名单数据，通过人脸识别技术可对展厅内人员的人物属性进行识别。当VIP人员或黑名单人员出现在展厅内时，可被数据采集单元捕获并被后台服务器识别，后台服务器可以快速的推送处理结果至管理人员的控制终端上，以提醒管理人员。
需要说明的是，本公开的技术方案对步骤S106～步骤S107与步骤S101～步骤S103的先后执行顺序不作限定，即步骤S106～步骤S107可先于步骤S101～步骤S103执行，或后于步骤S101～步骤S103执行，或与步骤S101～步骤S103执行同步执行。附图5也仅示例性给出了步骤S106～步骤S107位于步骤S103之后执行的情况。
在本公开中，图2、图4和图5所示实施例中的步骤之间可以相 互组合以得到新的技术方案，该新的技术方案也应属于本公开的保护范围。
图8为本公开实施例提供的再一种展厅控制方法的流程图，如图8所示，该展厅控制方法的执行主体为后台服务器，该展厅控制方法可以包括步骤S201和步骤S202。
在步骤S201，当控制终端所显示虚拟展厅模型中的第一可控虚拟设备被操作时，接收控制终端发送的设备控制指令。
其中，设备控制指令包括：操作信息和与第一可控虚拟设备相匹配的第一可控实体设备的设备信息。
在步骤S202，将设备控制指令发送至中控主机，以供中控主机控制展厅内的第一可控实体设备执行相应操作。
对于步骤S201和步骤S202的具体描述可参见前述实施例中相应内容，此处不赘述。
图9为本公开实施例提供的再一种展厅控制方法的流程图，如图9所示，该展厅控制方法的执行主体为后台服务器，该展厅控制方法不但包括上述步骤S201～步骤S202，还包括步骤S203～步骤S205。
在步骤S203，当展厅内的第二可控实体设备的设备状态发生变化时，接收中控主机发送的数据更新指令。
其中，数据更新指令包括：第二可控实体设备的设备信息和当前设备状态。
在步骤S204，响应于数据更新指令，更新数据库内存储的虚拟展厅模型的相关数据。
在步骤S205，向控制终端发送模型更新指令，以供控制终端根据模型更新指令更新虚拟展厅模型。
其中，模型更新指令包括：与第二可控实体设备相匹配的第二可控虚拟设备的设备信息以及当前设备状态。
对于步骤S203～步骤S205的具体描述可参见前述实施例中相应内容，此处不赘述。
需要说明的是，本公开的技术方案对步骤S203～步骤S205与 步骤S201～步骤S202的先后执行顺序不作限定，即步骤S203～步骤S205可先于步骤S201～步骤S202执行，或后于步骤S201～步骤S202执行，或与步骤S201～步骤S202执行同步执行。附图9也仅示例性给出了步骤S203～步骤S205位于步骤S202之后执行的情况。
图10为本公开实施例提供的再一种展厅控制方法的流程图，如图10所示，该展厅控制方法的执行主体为后台服务器，该展厅控制方法不但包括上述步骤S201～步骤S202，还包括步骤S206～步骤S208。
在步骤S206，接收布置于展厅内的数据采集单元上传的采集数据。
在步骤S207，对采集数据进行处理，得到处理结果。
在一些实施例中，数据采集单元包括图像采集单元(例如，摄像头)，采集数据包括图像数据；对采集数据进行处理的步骤可以包括：根据图像数据确定展厅内各区域的实时人数、各人员的人物属性、各人员的移动轨迹中的至少一者。
在步骤S208，将处理结果发送至控制终端，以供控制终端进行展示。
对于步骤S206～步骤S208的具体描述可参见前述实施例中相应内容，此处不赘述。
需要说明的是，本公开的技术方案对步骤S206～步骤S208与步骤S201～步骤S202的先后执行顺序不作限定，即步骤S206～步骤S208可先于步骤S201～步骤S202执行，或后于步骤S201～步骤S202执行，或与步骤S201～步骤S202执行同步执行。附图10也仅示例性给出了步骤S206～步骤S208位于步骤S202之后执行的情况。
图11为本公开实施例提供的再一种展厅控制方法的流程图，如图11所示，该展厅控制方法的执行主体为后台服务器，该展厅控制方法不但包括上述步骤S201～步骤S202，还包括步骤S209～步骤S211。
在步骤S209，接收布置于展厅内的人员感测单元所上传的感测结果。
在本公开实施例中，可针对现实展厅中部分可控实体设备(例如，数字标牌)配置对应的人员感测单元，人员感测单元能够检测其所对应的可控实体设备的附近是否存在人员，并将检测结果上传至后台服务器。
后台服务器实时接收各人员感测单元所上传的感测结果；当后台服务器接收到某个人员感测单元上传的感测结果由不存在人员变化为存在人员时，此后执行步骤S210；当后台服务器接收到某个人员感测单元上传的感测结果由存在人员变化为不存在人员时，此后执行步骤S211。
在步骤S210，向中控主机发送第一工作状态切换指令。
当后台服务器接收到某个人员感测单元上传的感测结果由不存在人员变化为存在人员时，则表明有人员到达该人员感测单元所对应的可控实体设备(即第三可控实体设备)的附近，后台服务器向中控主机发送第一工作状态切换指令，以供中控主机根据第一工作状态切换指令控制与人员感测单元相对应的第三可控实体设备由待机状态切换至工作状态。其中，第一工作状态切换指令包括与人员感测单元相对应的第三可控实体设备的设备信息以及表征中控主机需将该第三可控实体设备切换至工作状态的操作信息。
在步骤S211，向中控主机发送第二工作状态切换指令。
当后台服务器接收到某个人员感测单元上传的感测结果由存在人员变化为不存在人员时，则表明有人员该人员感测单元所对应的可控实体设备的附近无人，后台服务器向中控主机发送第二工作状态切换指令，以供中控主机根据第二工作状态切换指令控制与人员感测单元相对应的第三可控实体设备由工作状态切换至待机状态。其中，第二工作状态切换指令包括与人员感测单元相对应的第三可控实体设备的设备信息以及表征中控主机需将该第三可控实体设备切换至待机状态的操作信息。
作为一个示例，现实展厅中设置有数字标牌，数字标牌可用于以文字、图像、音频、视频中的至少一种形式进行展览讲解。每个数字标牌(可控实体设备的示例)均配置有对应的一个红外人体感应传 感器(人员感测单元的示例)，各红外人体感应传感器可检测对应的数字标牌的附近是否存在人员，并将检测结果上传至服务器。以某一个数字标牌C为例，当该数字标牌C附近无人时，该数据标牌C处于待机状态；当有人员到达该数字标牌C的附近时，数字标牌C所对应的红外人体感应传感器的检测结果由不存在人员变化为存在人员，后台服务器响应于该变化向中控主机发送第一工作状态切换指令(包含可控实体设备C的设备信息以及表征中控主机需将该可控实体设备C切换至工作状态的操作信息)，中控主机根据接收到的第一工作状态切换指令控制可控实体设备C由待机状态(不进行展览讲解)切换至工作状态(进行展览讲解)。当可控实体设备C附近的全部人员均离开后，数字标牌C所对应的红外人体感应传感器的检测结果由存在人员变化为不存在人员，后台服务器响应于该变化向中控主机发送第二工作状态切换指令(包含可控实体设备C的设备信息以及表征中控主机需将该可控实体设备C切换至待机状态的操作信息)，中控主机根据接收到的第二工作状态切换指令控制可控实体设备C由工作状态(进行展览讲解)切换至待机状态(不进行展览讲解)。
在本公开中，图8、图9、图10和图11所示实施例中的步骤之间可以相互组合以得到新的技术方案，该新的技术方案也应属于本公开的保护范围。
图12为本公开实施例提供的再一种展厅控制方法的流程图，如图12所示，该展厅控制方法的执行主体为中控主机，该展厅控制方法可以包括步骤S301和步骤S302。
在步骤S301，当控制终端所显示虚拟展厅模型中的第一可控虚拟设备被操作时，通过后台服务器接收控制终端发送的设备控制指令。
其中，设备控制指令包括：与第一可控虚拟设备相匹配的第一可控实体设备的设备信息以及操作信息。
在步骤S302，响应于设备控制指令，控制展厅内的第一可控实体设备执行相应操作。
对于步骤S301和步骤S302的具体描述可参见前述实施例中相应内容，此处不赘述。
图13为本公开实施例提供的再一种展厅控制方法的流程图，如图13所示，该展厅控制方法的执行主体为中控主机，该展厅控制方法不但包括上述步骤S301～步骤S302，还包括步骤S303。
在步骤S303，当监控到展厅内的第二可控实体设备的设备状态发生变化时，向后台服务器发送数据更新指令，以供后台服务器更新数据库内存储的虚拟展厅模型的相关数据以及向控制终端发送模型更新指令。
其中，数据更新指令包括：第二可控实体设备的设备信息和当前设备状态。
对于步骤S303的具体描述可参见前述实施例中相应内容，此处不赘述。
需要说明的是，本公开的技术方案对步骤S303与步骤S301～步骤S302的先后执行顺序不作限定，即步骤S303可先于步骤S301～步骤S302执行，或后于步骤S301～步骤S302执行，或与步骤S301～步骤S302执行同步执行。附图13也仅示例性给出了S303位于步骤S302之后执行的情况。
图14为本公开实施例提供的再一种展厅控制方法的流程图，如图14所示，该展厅控制方法的执行主体为中控主机，该展厅控制方法不但包括上述步骤S301～步骤S302，还包括步骤S304～步骤S307。
在步骤S304，当布置于展厅内人员感测单元所上传至所述后台服务器的感测结果由不存在人员变化为存在人员时，接收所述后台服务器发送的第一工作状态切换指令。
在步骤S305，根据第一工作状态切换指令控制与人员感测单元相对应的第三可控实体设备由待机状态切换至工作状态。
在步骤S306，当布置于展厅内人员感测单元所上传至后台服务器的感测结果由存在人员变化为不存在人员时，接收后台服务器发送的第二工作状态切换指令。
在步骤S307，根据第二工作状态切换指令控制与人员感测单元相对应的第三可控实体设备由工作状态切换至待机状态。
对于步骤S304～步骤S307的具体描述可参见前述实施例中相应内容，此处不赘述。
需要说明的是，本公开的技术方案对步骤S304～步骤S305与步骤S306～步骤S307、步骤S301～步骤S302先后执行顺序不作限定。附图14也仅示例性给出了步骤S304～步骤S305和步骤S306～步骤S307位于步骤S302之后执行的情况。
在本公开中，图12、图13和图14所示实施例中的步骤之间可以相互组合以得到新的技术方案，该新的技术方案也应属于本公开的保护范围。
本公开实施例还提供了一种控制终端，包括：第一处理器和第一存储器，第一存储器上存储有第一程序，第一程序被第一处理器执行时实现如前述图2、图4和图5所示实施例提供的展厅控制方法中的步骤。
本公开实施例还提供了一种后台服务器，包括：第二处理器和第二存储器，第二存储器上存储有第二程序，第二程序被第二处理器执行时实现如前述图8、图9、图10和图11所示实施例提供的展厅控制方法中的步骤。
本公开实施例还提供了一种中控主机，包括：第三处理器和第三存储器，第三存储器上存储有第三程序，第三程序被第三处理器执行时实现如前述图12、图13和图14所示实施例提供的展厅控制方法中的步骤。
本公开实施例还提供了一种展厅控制系统，包括：如前述实施例提供的控制终端、后台服务器和中控主机。
本公开实施例还提供了一种计算机可读存储介质，其上存储有指令，所述指令被处理器执行时，实现本文所描述的方法的步骤。
图15为本公开中通过控制终端控制现实展厅内的可控实体设备执行相应操作的信令图，如图15所示，各方之间的信令交互可以包括：BZ1、控制终端从后台服务器的数据库内获取虚拟展厅模型的相 关数据；BZ2、显示虚拟展厅模型；BZ3、响应于虚拟展厅模型中的第一可控虚拟设备被操作，控制终端生成设备控制指令；BZ4a、将设备控制指令发送至后台服务器；BZ4b、后台服务器将设备控制指令转发至中控主机；BZ4c、中控主机根据设备控制指令生成并发送标准控制指令，以控制展厅内的第一可控实体设备执行相应操作。在一些实施例中，BZ1是非必要的。
图16为本公开中可控实体设备的设备状态发生变化后展厅控制系统进行状态同步和数据同步的信令图，如图16所示，各方之间的信令交互可以包括：BZ5、中控主机监测到第二可控实体设备的设备状态发生变化；BZ6、中控主机向后台服务器发送数据更新指令；BZ7、后台服务器根据数据更新指令对数据库进行数据更新；BZ8、后台服务器向控制终端发送模型更新指令；BZ9、控制终端根据模型更新指令对虚拟展厅模型进行模型更新。
图17为本公开中后台服务器对数据采集单元所上传的采集数据完成处理后将处理结果发送至控制终端进行显示的信令图，如图17所示，各方之间的信令交互可以包括：BZ10、后台服务器接收数据采集单元上传的采集数据；BZ11、后台服务器对采集数据进行处理，得到处理结果；BZ12、将处理结果发送至控制终端；BZ13、控制终端显示处理结果。
图18为本公开中后台服务器根据人员感测单元上传的感测结果控制对应的可控实体设备在待机状态和工作状态之间进行切换的信令图，如图18所示，各方之间的信令交互可以包括：BZ14、后台服务器接收人员感测单元上传的感测结果；BZ15、响应于某个感测单元上传的感测结果由不存在人员变化为存在人员，向中控主机发送第一工作状态切换指令；BZ16、中控主机控制与该感测单元所对应的第三可控实体设备由待机状态切换至工作状态；BZ17、响应于某个感测单元上传的感测结果由存在人员变化为不存在人员，向中控主机发送第二工作状态切换指令；BZ18、中控主机控制与该感测单元所对应的第三可控实体设备由工作状态切换至待机状态。
对于上述BZ1～BZ18的具体描述，可参见前述实施例中相应内 容，此处不再赘述。
在本公开中，图15、图16、图17和图18中的步骤可以相互组合以得到新的技术方案，该新的技术方案也应属于本公开的保护范围。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
本文已经公开了示例实施例，并且虽然采用了具体术语，但它们仅用于并仅应当被解释为一般说明性含义，并且不用于限制的目的。在一些实例中，对本领域技术人员显而易见的是，除非另外明确指出，否则可单独使用与特定实施例相结合描述的特征、特性和/或元素，或可与其他实施例相结合描述的特征、特性和/或元件组合使用。因此，本领域技术人员将理解，在不脱离由所附的权利要求阐明 的本公开的范围的情况下，可进行各种形式和细节上的改变。

Claims (19)

  1. 一种展厅控制方法，应用于控制终端侧，包括：
    显示虚拟展厅模型；
    响应于所述虚拟展厅模型中的第一可控虚拟设备被操作，生成设备控制指令，所述设备控制指令包括：操作信息和与所述第一可控虚拟设备相匹配的第一可控实体设备的设备信息；
    将所述设备控制指令通过后台服务器发送至中控主机，以供所述中控主机根据所述设备控制指令控制展厅内的所述第一可控实体设备执行相应操作。
  2. 根据权利要求1所述的展厅控制方法，还包括：
    响应于展厅内的第二可控实体设备的设备状态发生变化，接收后台服务器发送的模型更新指令，所述模型更新指令包括：与所述第二可控实体设备相匹配的第二可控虚拟设备的设备信息以及当前设备状态；
    响应于所述模型更新指令，将虚拟展厅模型中的所述第二可控虚拟设备更新至所述当前设备状态。
  3. 根据权利要求1所述的展厅控制方法，还包括：
    当后台服务器对数据采集单元所上传的采集数据完成处理后，接收所述后台服务器发送的处理结果；
    将所述处理结果进行展示。
  4. 根据权利要求1-3中任一所述的展厅控制方法，在所述显示虚拟展厅模型的步骤之前，还包括：
    从所述后台服务器的数据库内获取所述虚拟展厅模型的相关数据。
  5. 一种展厅控制方法，应用于后台服务器侧，包括：
    响应于控制终端所显示虚拟展厅模型中的第一可控虚拟设备被操作，接收所述控制终端发送的设备控制指令，所述设备控制指令包括：操作信息和与所述第一可控虚拟设备相匹配的第一可控实体设备的设备信息；
    将所述设备控制指令发送至中控主机，以供所述中控主机控制展厅内的所述第一可控实体设备执行相应操作。
  6. 根据权利要求5所述的展厅控制方法，还包括：
    响应于展厅内的第二可控实体设备的设备状态发生变化，接收中控主机发送的数据更新指令，所述数据更新指令包括：所述第二可控实体设备的设备信息和当前设备状态；
    响应于所述数据更新指令，更新数据库内存储的所述虚拟展厅模型的相关数据；
    向所述控制终端发送模型更新指令，所述模型更新指令包括：与所述第二可控实体设备相匹配的第二可控虚拟设备的设备信息以及当前设备状态。
  7. 根据权利要求5所述的展厅控制方法，还包括：
    接收布置于展厅内的数据采集单元上传的采集数据；
    对所述采集数据进行处理，得到处理结果。
  8. 根据权利要求7所述的展厅控制方法，其中，所述数据采集单元包括图像采集单元，所述采集数据包括图像数据；
    所述对采集数据进行处理的步骤包括：
    根据所述图像数据确定展厅内各区域的实时人数、各人员的人物属性、各人员的移动轨迹中的至少一者。
  9. 根据权利要求7所述的展厅控制方法，在所述对所述采集数据进行处理的步骤之后，还包括：
    将所述处理结果发送至所述控制终端，以供所述控制终端进行展示。
  10. 根据权利要求5所述的展厅控制方法，还包括：
    接收布置于展厅内的人员感测单元所上传的感测结果；
    响应于所述感测结果由不存在人员变化为存在人员，向所述中控主机发送第一工作状态切换指令，以供所述中控主机根据所述第一工作状态切换指令控制与所述人员感测单元相对应的第三可控实体设备由待机状态切换至工作状态；
    响应于所述感测结果由存在人员变化为不存在人员，向所述中控主机发送第二工作状态切换指令，以供所述中控主机根据所述第二工作状态切换指令控制与所述人员感测单元相对应的第三可控实体设备由工作状态切换至待机状态。
  11. 一种展厅控制方法，应用于中控主机侧，包括：
    响应于控制终端所显示虚拟展厅模型中的第一可控虚拟设备被操作，通过后台服务器接收所述控制终端发送的设备控制指令，所述设备控制指令包括：操作信息和与所述第一可控虚拟设备相匹配的第一可控实体设备的设备信息；
    响应于所述设备控制指令，控制所述展厅内的所述第一可控实体设备执行相应操作。
  12. 根据权利要求11所述的展厅控制方法，还包括：
    响应于监控到展厅内的第二可控实体设备的设备状态发生变化，向所述后台服务器发送数据更新指令，以供所述后台服务器更新数据库内存储的所述虚拟展厅模型的相关数据以及向所述控制终端发送模型更新指令，所述数据更新指令包括：所述第二可控实体设备的设备信息和当前设备状态。
  13. 根据权利要求11所述的展厅控制方法，还包括：
    响应于布置于展厅内人员感测单元所上传至所述后台服务器的感测结果由不存在人员变化为存在人员，接收所述后台服务器发送的第一工作状态切换指令；
    根据所述第一工作状态切换指令控制与所述人员感测单元相对应的第三可控实体设备由待机状态切换至工作状态。
  14. 根据权利要求11所述的展厅控制方法，还包括：
    响应于布置于展厅内人员感测单元所上传至所述后台服务器的感测结果由存在人员变化为不存在人员，接收所述后台服务器发送的第二工作状态切换指令；
    根据所述第二工作状态切换指令控制与所述人员感测单元相对应的第三可控实体设备由工作状态切换至待机状态。
  15. 一种控制终端，包括：处理器和存储器，所述存储器上存储有程序，所述程序被所述处理器执行时实现如权利要求1至4中任一项所述展厅控制方法中的步骤。
  16. 一种后台服务器，包括：处理器和存储器，所述存储器上存储有程序，所述程序被所述处理器执行时实现如权利要求5至10中任一项所述展厅控制方法中的步骤。
  17. 一种中控主机，包括：处理器和存储器，所述存储器上存储有程序，所述程序被所述处理器执行时实现如权利要求11至14中任一项所述展厅控制方法中的步骤。
  18. 一种展厅控制系统，包括：如上述权利要求15所提供的控制终端、上述权利要求16所提供的后台服务器和如上述权利要求17所提供的中控主机。
  19. 一种计算机可读存储介质，其上存储有指令，所述指令被 处理器执行时，实现如权利要求1至14中任一项的方法。
PCT/CN2020/131146 2019-11-25 2020-11-24 展厅控制方法及系统、控制终端、后台服务器和中控主机 WO2021104260A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/417,530 US20220121270A1 (en) 2019-11-25 2020-11-24 Exhibition hall control method and system, control terminal, back-end server and central control host

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911168740.5 2019-11-25
CN201911168740.5A CN112835304B (zh) 2019-11-25 2019-11-25 展厅控制方法及系统、控制终端、后台服务器和中控主机

Publications (1)

Publication Number Publication Date
WO2021104260A1 true WO2021104260A1 (zh) 2021-06-03

Family

ID=75923027

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/131146 WO2021104260A1 (zh) 2019-11-25 2020-11-24 展厅控制方法及系统、控制终端、后台服务器和中控主机

Country Status (3)

Country Link
US (1) US20220121270A1 (zh)
CN (1) CN112835304B (zh)
WO (1) WO2021104260A1 (zh)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114170731B (zh) * 2021-11-19 2023-09-26 武汉虹信技术服务有限责任公司 一种智慧共享展厅系统
CN114172887A (zh) * 2021-11-30 2022-03-11 合肥安达创展科技股份有限公司 一种智能化展馆中控系统
CN114721772A (zh) * 2022-03-25 2022-07-08 乐元素科技(北京)股份有限公司 虚拟设备管理方法及装置
CN114863653A (zh) * 2022-05-06 2022-08-05 太原泰森智能科技有限公司 一种智能展柜的安全管理方法、装置、设备及存储介质
CN115086368A (zh) * 2022-05-31 2022-09-20 福州华纳信息科技有限公司 一种基于虚拟展厅的多模式展陈的控制方法、系统及设备
CN116133201B (zh) * 2023-04-17 2023-07-18 广东中诚科技有限公司 智能灯光控制方法、装置、电子设备及存储介质
CN117195379B (zh) * 2023-11-03 2024-02-06 南京中音讯达网络科技有限公司 基于人工智能的数字孪生仿真展厅的快速部署方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104656597A (zh) * 2013-11-25 2015-05-27 上海风语筑展览有限公司 一种用于展厅远程控制的中央控制系统
CN204408715U (zh) * 2015-03-05 2015-06-17 四川工美环境艺术设计工程有限公司 数字化多媒体展厅灯光远程综合调控系统
US20180349012A1 (en) * 2015-04-27 2018-12-06 Microsoft Technology Licensing, Llc Mixed environment display of attached control elements
CN109085966A (zh) * 2018-06-15 2018-12-25 广东康云多维视觉智能科技有限公司 一种基于云计算的三维展示系统及方法
CN109377921A (zh) * 2018-12-28 2019-02-22 广东您好科技有限公司 一种可语音控制的自动化智能演示展厅
CN109857258A (zh) * 2019-02-20 2019-06-07 福州凡来界信息科技有限公司 一种虚拟远程遥控方法及装置、系统

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017018561A1 (ko) * 2015-07-30 2017-02-02 주식회사 씽크브릿지 전시공간 제어 시스템 및 전시공간 제어방법
CN106445156A (zh) * 2016-09-29 2017-02-22 宇龙计算机通信科技(深圳)有限公司 一种基于虚拟现实的智能家居控制的方法、装置以及终端
CN107634938A (zh) * 2017-08-30 2018-01-26 宁波梦居智能科技有限公司 一种基于vr的智能家居演示系统
US20190354074A1 (en) * 2018-05-17 2019-11-21 Johnson Controls Technology Company Building management system control using occupancy data
CN109459990A (zh) * 2018-11-28 2019-03-12 上海风语筑展示股份有限公司 一种展览馆的人工智能控制系统及其方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104656597A (zh) * 2013-11-25 2015-05-27 上海风语筑展览有限公司 一种用于展厅远程控制的中央控制系统
CN204408715U (zh) * 2015-03-05 2015-06-17 四川工美环境艺术设计工程有限公司 数字化多媒体展厅灯光远程综合调控系统
US20180349012A1 (en) * 2015-04-27 2018-12-06 Microsoft Technology Licensing, Llc Mixed environment display of attached control elements
CN109085966A (zh) * 2018-06-15 2018-12-25 广东康云多维视觉智能科技有限公司 一种基于云计算的三维展示系统及方法
CN109377921A (zh) * 2018-12-28 2019-02-22 广东您好科技有限公司 一种可语音控制的自动化智能演示展厅
CN109857258A (zh) * 2019-02-20 2019-06-07 福州凡来界信息科技有限公司 一种虚拟远程遥控方法及装置、系统

Also Published As

Publication number Publication date
US20220121270A1 (en) 2022-04-21
CN112835304B (zh) 2023-06-27
CN112835304A (zh) 2021-05-25

Similar Documents

Publication Publication Date Title
WO2021104260A1 (zh) 展厅控制方法及系统、控制终端、后台服务器和中控主机
EP3605314B1 (en) Display method and apparatus
CN106534343B (zh) 展馆云端控制系统
US20170083220A1 (en) Method and apparatus for controlling devices
CN111095408A (zh) 基于相机的视场的与远程物联网(iot)设备的连接
CN204903983U (zh) 一种智能家居系统及其无人飞行器、智能中枢设备
CN107493311B (zh) 实现操控设备的方法、装置和系统
CN104330996A (zh) 遥控方法及装置
US11327467B2 (en) Information processing device and information processing method
US11483451B2 (en) Methods and systems for colorizing infrared images
KR101746215B1 (ko) 사물인터넷을 활용한 스마트 강의실 관리 시스템 및 관리 방법
CN114387445A (zh) 对象关键点识别方法及装置、电子设备和存储介质
KR20170025245A (ko) 표정 인식에 기반한 스마트 조명 서비스 제공 방법 및 그를 위한 장치 및 시스템
US20120284652A1 (en) Human-environment interactive system and portable device using the same
CN112533070B (zh) 视频声音和画面的调整方法、终端和计算机可读存储介质
US20160323498A1 (en) Intelligent presentation of surveillance information on a mobile device
TWI386769B (zh) Control method and system of indoor environment state of image monitoring
WO2023236848A1 (zh) 设备控制方法、装置、系统、电子设备及可读存储介质
CN107632285A (zh) 地图创建及修改方法与装置
US11967147B2 (en) Augmented reality visualization of enclosed spaces
JP2004289779A (ja) 移動体撮像方法、移動体撮像システム
US11863905B1 (en) Application-based control of devices within an environment
TWI407130B (zh) 即時顯示電器之使用狀態及用電量資訊之系統及方法
CN114384848A (zh) 交互方法、装置、电子设备及存储介质
KR20220090251A (ko) 콘서트 및 전시회 융합 기반 미술작품 전시를 위한 콘스비션 서비스 제공 방법 및 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20891534

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20891534

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 20891534

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 06.02.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20891534

Country of ref document: EP

Kind code of ref document: A1