WO2023159591A1 - 一种展陈场景智能讲解的系统及其方法 - Google Patents

一种展陈场景智能讲解的系统及其方法 Download PDF

Info

Publication number
WO2023159591A1
WO2023159591A1 PCT/CN2022/078385 CN2022078385W WO2023159591A1 WO 2023159591 A1 WO2023159591 A1 WO 2023159591A1 CN 2022078385 W CN2022078385 W CN 2022078385W WO 2023159591 A1 WO2023159591 A1 WO 2023159591A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
target user
following
information
exhibit
Prior art date
Application number
PCT/CN2022/078385
Other languages
English (en)
French (fr)
Inventor
董兆朝
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US18/018,903 priority Critical patent/US20240272648A1/en
Priority to CN202280000345.XA priority patent/CN117178241A/zh
Priority to PCT/CN2022/078385 priority patent/WO2023159591A1/zh
Publication of WO2023159591A1 publication Critical patent/WO2023159591A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/60Intended control result
    • G05D1/656Interaction with payloads or external entities
    • G05D1/686Maintaining a relative position with respect to moving targets, e.g. following animals or humans
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/12Target-seeking control
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/20Control system inputs
    • G05D1/24Arrangements for determining position or orientation
    • G05D1/243Means capturing signals occurring naturally from the environment, e.g. ambient optical, acoustic, gravitational or magnetic signals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/62Analysis of geometric attributes of area, perimeter, diameter or volume
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/53Recognition of crowd images, e.g. recognition of crowd congestion
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2105/00Specific applications of the controlled vehicles
    • G05D2105/70Specific applications of the controlled vehicles for displaying or announcing information
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2111/00Details of signals used for control of position, course, altitude or attitude of land, water, air or space vehicles
    • G05D2111/10Optical signals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30244Camera pose
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y20/00Information sensed or collected by the things
    • G16Y20/10Information sensed or collected by the things relating to the environment, e.g. temperature; relating to location
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00IoT characterised by the purpose of the information processing
    • G16Y40/30Control
    • G16Y40/35Management of things, i.e. controlling in accordance with a policy or in order to achieve specified objectives
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00IoT characterised by the purpose of the information processing
    • G16Y40/60Positioning; Navigation

Definitions

  • the present disclosure relates to the technical field of the Internet of Things, and in particular to a system and method for intelligently explaining exhibition scenes.
  • the exhibition system is a kind of exhibition display system, which is generally used in the exhibition halls of governments, enterprises, and museums to realize switch control, playback control, and interactive control of exhibit equipment.
  • most of the exhibition items exhibited or displayed in the exhibition hall are all-in-one terminal equipment, which are generally composed of a host and a display screen.
  • the explanation is mainly done manually by the instructor.
  • the explanation method is relatively simple and boring, and the explanation effect is not good, which affects the visiting experience of the visitors.
  • the present disclosure provides a system and method for intelligently explaining exhibition scenes, which are used to automatically follow and explain users or visitors by using intelligent follow-up equipment, so as to improve the visiting experience of visitors.
  • an embodiment of the present disclosure provides a system for intelligent explanation of exhibition scenes, the system includes an intelligent following device and a positioning device, wherein:
  • the positioning device is used to determine the positioning information of the target user
  • the intelligent following device is configured to follow the target user according to the positioning information of the target user.
  • the intelligent following device is further configured to generate control instructions, and perform corresponding control on at least one display component according to the generated control instructions.
  • the intelligent following device further includes a sounding device, and the intelligent following device intelligently explains exhibit information of at least one exhibition item through the sounding device.
  • the smart following device is also used to switch between multiple following modes; where the types of target users followed by the smart following device in different following modes are different, and the target users
  • the classification of is determined according to at least one of the purpose of visiting, the interactive relationship with exhibit items, and the interactive relationship with exhibit components.
  • the intelligent following device is further configured to stop following when the target user stops moving, and determine its own station information when the target user stops following.
  • control instructions are generated in the following manner:
  • the smart following device generates the control instruction according to the positioning information of the target user; or,
  • the smart following device generates the control instruction according to the positioning information of the smart following device itself.
  • the intelligent following device intelligently explains the exhibit information of at least one exhibit through the sounding device, including:
  • the intelligent following device determines at least one exhibition item according to the positioning information of the target user, and uses the sounding device to intelligently explain the exhibition item information of the at least one exhibition item; or,
  • the intelligent following device determines at least one exhibit item according to its own positioning information, and intelligently explains the exhibit item information of the at least one exhibit item through the sound generating device.
  • the following mode includes at least one intelligent way of explaining information about the exhibit by the smart following device .
  • the intelligent following device determines its own station information when it stops following, including:
  • the intelligent following device determines the shortest line segment according to the positioning information when the target user stops moving and the exhibit item closest to the positioning information;
  • the intelligent following device takes the positioning information when it stops moving as a center to determine a preset area
  • the intelligent following device determines its own station information when it stops following according to the intersection of the shortest line segment and the preset area, and its own orientation relative to the target user.
  • the smart following device determines the shortest line segment according to the positioning information when the target user stops moving and the exhibit item closest to the positioning information, including:
  • the intelligent following device determines the shortest line segment according to the positioning information when the target user stops moving and the edge position of the exhibit item closest to the positioning information.
  • the target user includes a first user who visits the exhibit.
  • the smart following device triggers generation of the control instruction in response to a first operation of the target user.
  • the smart following device performs switching between various following modes, including:
  • the smart following device In response to the second operation of the target user, the smart following device triggers the generation of a switching instruction, and executes switching between multiple following modes according to the switching instruction.
  • the smart following device determines the shortest line segment according to the positioning information when the target user stops moving and the exhibit item closest to the positioning information, including:
  • the intelligent following device determines the shortest line segment according to the positioning information when the target user stops moving and the center position of the exhibit item closest to the positioning information.
  • the target user includes a second user who introduces the exhibit.
  • the following mode includes at least one control mode of the smart following device on the display component.
  • the smart following device performs switching between various following modes, including:
  • the smart following device triggers switching between multiple following modes according to the positioning information of different types of target users.
  • the target users include the first user who visits the exhibit and the second user who introduces the exhibit, and the smart following device triggers the execution of various following according to the location information of different types of target users Switching between modes, including:
  • the smart following device triggers switching between multiple following modes according to the location information of the first user and the second user.
  • the smart following device triggers switching between multiple following modes according to the location information of the first user and the second user, including:
  • the smart following device triggers switching between multiple following modes according to the positioning information of the first user and the second user, and the crowd density information of the first user.
  • the smart follower device includes a touch screen, and the control instruction is generated through a touch signal received by the touch screen.
  • the smart following device includes a touch screen, and the switching instruction is triggered and generated by a touch signal received by the touch screen.
  • the smart follower device includes a touch screen, and the smart follower device is further configured to display exhibit item information of at least one exhibit item through the touch screen screen.
  • the positioning device includes a locator, and the positioning device determines the positioning information of the target user in the following manner:
  • the positioning device determines the positioning information of the target user through a locator carried by the target user.
  • the target user includes a second user who introduces the exhibit.
  • the target user includes multiple, and the positioning device determines the positioning information of the target user through a locator carried by the target user, including:
  • the locating device determines an area containing multiple target users according to the locators carried by the multiple target users;
  • the positioning device determines the positioning information of the target user according to the center point of the area, or the locator of the target user closest to the center point of the area.
  • the positioning device includes a camera component, and the positioning device determines the positioning information of the target user in the following manner:
  • the positioning device determines the positioning information of the target user according to the image of the target user collected by the camera component.
  • the target user includes multiple, and the positioning device determines the positioning information of the target user according to the image of the target user collected by the camera component, including:
  • the positioning device recognizes the images collected by the camera assembly that contain multiple target users, and determines the area that contains multiple target users;
  • the positioning device determines the positioning information of the target user according to the center point of the area, or the position of the target user closest to the center point of the area, wherein the target user closest to the center point of the area
  • the location of is obtained by recognizing images containing multiple target users.
  • the target user includes a first user who visits the exhibit.
  • the positioning device is also used to determine the crowd density information of the first user in the following manner:
  • the positioning device determines the crowd density information of the first user according to the size of the area and the number of locators detected in the area.
  • the positioning device determines the crowd density information of the first user in the following manner:
  • the positioning device determines the crowd density information of the first user according to the size of the area and the number of first users identified in the area.
  • the positioning device includes a locator, and the positioning device is further configured to determine the positioning information of the smart following device in the following manner:
  • the positioning device determines the positioning information of the smart following device according to the locator carried by the smart following device.
  • the positioning device includes a camera component, and the positioning device is also used to determine the positioning information of the smart following device in the following manner:
  • the locating device recognizes the image collected by the camera assembly and includes the smart following device, and determines the positioning information of the smart following device.
  • the exhibit information includes at least one of video, picture, audio, light, and projection.
  • control instruction includes at least one of playback switch, pause, volume adjustment, playback progress adjustment, and switch control.
  • the display component includes at least one of a display component, a lighting component, an intelligent air conditioner, and an intelligent Internet of Things device.
  • an embodiment of the present disclosure provides a method for intelligently explaining an exhibition scene, including:
  • it also includes:
  • it also includes:
  • it also includes:
  • it also includes:
  • control instructions are generated in the following manner:
  • the intelligent explanation of the exhibit information of at least one exhibit includes:
  • the target user to follow includes the first user who visits the exhibit
  • the following mode includes at least one intelligent way of explaining information about the exhibit.
  • the determination of the own station information when stopping following includes:
  • intersection point of the shortest line segment and the preset area, and the orientation of the user relative to the target user determine the location information of the user when the following is stopped.
  • the determining the shortest line segment according to the positioning information when the target user stops moving and the exhibit item closest to the positioning information includes:
  • the shortest line segment is determined according to the positioning information when the target user stops moving, and the edge position of the exhibit item closest to the positioning information.
  • the target user includes a first user who visits the exhibit.
  • the generation of the control instruction is triggered in response to the first operation of the target user.
  • the switching between multiple following modes includes:
  • the generation of a switching instruction is triggered, and switching between multiple following modes is performed according to the switching instruction.
  • the determining the shortest line segment according to the positioning information when the target user stops moving and the exhibit item closest to the positioning information includes:
  • the shortest line segment is determined according to the positioning information when the target user stops moving, and the center position of the exhibit item closest to the positioning information.
  • the target user includes a second user who introduces the exhibit.
  • the following mode includes at least one control mode for the display component.
  • the switching between multiple following modes includes:
  • the target users include the first user who visits the exhibit and the second user who introduces the exhibit. According to the positioning information of different types of target users, switching between multiple following modes is triggered, include:
  • the triggering execution of switching between multiple following modes according to the location information of the first user and the second user includes:
  • control instruction is generated by triggering a touch signal received by the touch screen.
  • the switching instruction is triggered and generated by a touch signal received by the touch screen.
  • it also includes:
  • the screen display of the exhibit information of at least one exhibit is performed through the touch screen.
  • the positioning information of the target user is determined in the following manner:
  • the positioning information of the target user is determined through the locator carried by the target user.
  • the target user includes a second user who introduces the exhibit.
  • the target user includes multiple, and determining the positioning information of the target user through the locator carried by the target user includes:
  • the positioning information of the target user is determined according to the center point of the area, or the locator of the target user closest to the center point of the area.
  • the positioning information of the target user is determined in the following manner:
  • the positioning information of the target user is determined according to the image of the target user collected by the camera component.
  • the target user includes multiple, and determining the positioning information of the target user according to the image of the target user collected by the camera component includes:
  • the target user includes a first user who visits the exhibit.
  • the crowd density information of the first user is determined in the following manner:
  • the crowd density information of the first user is determined in the following manner:
  • determine your own positioning information in the following manner:
  • the positioning information of itself is determined.
  • determine your own positioning information in the following manner:
  • the exhibit information includes at least one of video, picture, audio, light, and projection.
  • control instruction includes at least one of playback switch, pause, volume adjustment, playback progress adjustment, and switch control.
  • the display component includes at least one of a display component, a lighting component, an intelligent air conditioner, and an intelligent Internet of Things device.
  • an embodiment of the present disclosure provides a device for intelligent explanation of exhibition scenes, including:
  • the following mobile unit is configured to follow the target user to move according to the positioning information of the target user.
  • an embodiment of the present disclosure further provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, it is used to implement the steps of the method described in the second aspect above.
  • FIG. 1 is a system for intelligent explanation of exhibition scenes provided by an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of crowd density calculation and distance calculation provided by an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of an updated shortest path provided by an embodiment of the present disclosure.
  • FIG. 4 is a schematic diagram of determining station location information when the target user is the first user provided by an embodiment of the present disclosure
  • FIG. 5 is a schematic diagram of determining station location information when the target user is a second user provided by an embodiment of the present disclosure
  • FIG. 6 is a schematic structural diagram of an intelligent following device provided by an embodiment of the present disclosure.
  • FIG. 7 is a flow chart of interaction between modules in a smart following device provided by an embodiment of the present disclosure.
  • FIG. 8 is a flow chart for implementing a method for assisting intelligent explanation of exhibition scenes provided by an embodiment of the present disclosure
  • FIG. 9 is a flow chart for implementing a method for independent intelligent explanation of exhibition scenes provided by an embodiment of the present disclosure.
  • FIG. 10 is a schematic diagram of an auxiliary explanation mode provided by an embodiment of the present disclosure.
  • FIG. 11 is a schematic diagram of an independent explanation mode provided by an embodiment of the present disclosure.
  • FIG. 12 is a flow chart for implementing a method for intelligent explanation of exhibition scenes provided by an embodiment of the present disclosure
  • FIG. 13 is a schematic diagram of an apparatus for intelligent explanation of an exhibition scene provided by an embodiment of the present disclosure.
  • the exhibition system is a kind of exhibition display system, which is generally used in the exhibition halls of governments, enterprises, and museums to realize switch control, playback control, and interactive control of exhibit equipment.
  • most of the exhibition items exhibited or displayed in the exhibition hall are all-in-one terminal equipment, which are generally composed of a host and a display screen.
  • the explanation is mainly done manually by the instructor.
  • the explanation method is relatively simple and boring, and the explanation effect is not good, which ultimately affects the visitor's visiting experience.
  • An embodiment of the present disclosure provides a system for intelligent explanation of exhibition scenes, including an intelligent following device and a positioning device, wherein the intelligent following device in this embodiment includes but is not limited to an intelligent robot equipped with a driving device to Implement follow-up movement.
  • the system for intelligent explanation of exhibition scenes provided in this embodiment can provide a more intelligent explanation scene, and use intelligent follow-up equipment to automatically follow the explainers or visitors, improve the efficiency of explanations, and enhance the visiting experience.
  • the core idea of the design is to use the positioning device to determine the positioning information of the target user, and realize automatic following based on the positioning information.
  • this embodiment provides a system for intelligent explanation of exhibition scenes, the system includes a positioning device 100 and an intelligent following device 101, wherein:
  • the positioning device 100 is configured to determine positioning information of a target user
  • the intelligent following device 101 is configured to follow the target user according to the location information of the target user.
  • the smart following device 101 in this embodiment includes a controller, which is used to control itself to follow the target user to move, and can also be used to perform other functions such as calculation of positioning information.
  • the follower device 101 is separated, and data and messages are transmitted between the controller and the smart follower 101 in a wireless or wired manner.
  • the controller includes a server, and the data calculation involved in the smart follower 101 is performed through the server.
  • the follower device 101 sends signaling to control the intelligent follower device 101 to realize automatic follow.
  • the controller is integrated with the smart following device 101 and built into the smart following device 101 . In this embodiment, the structural relationship between the controller and the smart following device 101 and the information transmission manner are not limited too much.
  • the positioning device 100 in this embodiment can also be built into the smart following device 101 , that is, the positioning device 100 can be used as a component of the smart following device 101 .
  • the target users in this embodiment include but are not limited to: the first user who visits the exhibit, the second user who introduces the exhibit; optionally, the first user includes multiple, and the second user is one .
  • the first user can be understood as a visitor, and the second user can be understood as a guide.
  • the intelligent following device 101 in this embodiment can also realize functions such as controlling the display components, intelligently explaining the information of the exhibited items, and switching between following modes, among which, These functions may be combined with each other or used independently, which is not limited too much in this embodiment, and the above functions will be described one by one below.
  • the smart following device 101 in this embodiment is also used to perform any one or multiple functions as follows:
  • the first type is the control function of the display components.
  • the smart following device 101 generates a control instruction, and performs corresponding control on at least one display component according to the generated control instruction.
  • control instructions in this embodiment include but are not limited to at least one of playback switching, pause, volume adjustment, playback progress adjustment, and switch control.
  • the display components in this embodiment include at least one of a display component, a lighting component, an intelligent air conditioner, and an intelligent Internet of Things device.
  • the exhibition components are located inside the exhibition hall. While explaining, the explanation scenes are enriched by controlling the exhibition components, so that users can experience the scenes related to the exhibition items while visiting the exhibits and listening to the information of the exhibits. , to provide visitors with a more appropriate and vivid explanation experience.
  • the display components can be controlled through control instructions, wherein the control instructions and the display components can be in a corresponding relationship, for example, through the generated control instructions for the lighting components, the corresponding lighting components are controlled to change brightness.
  • the manner of generating the control instruction in this embodiment includes but is not limited to any of the following:
  • Mode 1a automatically generating control instructions.
  • This method can automatically trigger and generate control commands based on positioning information.
  • the specific situations are divided into the following two types:
  • the smart following device 101 generates the control instruction according to the location information of the target user.
  • the smart following device 101 generates the control instruction according to the location information of the smart following device itself.
  • a control command is generated according to the distance between the location information and the preset position in the exhibition hall; or according to the location of the smart following device 101 itself and the preset location in the exhibition hall The distance between the positions to generate control commands.
  • a control instruction is generated when the distance is less than or equal to the distance threshold.
  • the smart following device 101 when the smart following device 101 detects that the target user has moved to a designated location, or when the smart following device 101 itself moves to a designated location, it generates a control instruction to control multiple display components to achieve linkage, for example, it can control display, acousto-optic Switch control of IoT devices such as , projection, combination of multiple playlists, switching of playback content, play/pause, volume increase/decrease, fast forward/rewind, etc.
  • the target user may be the first user who visits the exhibit.
  • the control display component performs the corresponding operation; or, when the smart following device 101 itself arrives at the designated location , to control the display components to perform corresponding operations; no matter which method can realize automatic control, the display components can be automatically controlled without the operation of the guide, which effectively improves the visiting experience.
  • the target user may also be the second user who introduces the exhibition item.
  • the specific method of generating control instructions is the same as when the target user is the first user. Here No longer.
  • Mode 1b manually triggering and generating a control instruction. In this manner, the generation of the control instruction can be triggered only after the first operation of the target user is received.
  • the smart following device triggers generation of the control instruction in response to a first operation of the target user.
  • the first operation may be a click operation on a key or a button on the smart follower device, or a touch operation through a touch screen.
  • the smart follower device in this embodiment includes a touch screen, and the control instruction is generated through a touch signal received by the touch screen. That is to say, the target user performs the first operation through the touch screen, generates a touch signal, and triggers and generates a control instruction based on the touch signal. That is, the touch signal received by the touch screen is generated by the target user performing the first operation.
  • the target user in the way of manually triggering and generating control instructions, may be the second user who introduces the exhibit, and during the process of the smart following device 101 following the second user, the second user passes the manually triggered
  • the way to control the display components to perform corresponding operations provides a way for explainers to assist in explaining, which improves the efficiency of explaining, improves the effect of explaining, and thus improves the visiting experience of visitors.
  • the target user may also be the first user who visits the exhibit.
  • the method of generating control instructions is the same as the principle of generating control instructions when the target user is the second user. Here No longer.
  • control instruction in this embodiment is determined based on the target user, specifically as follows:
  • control instruction includes controlling the smart follower device to display information related to the exhibit item when the smart follower device enters an exhibit area containing the exhibit item. Instructions for exhibit information;
  • the smart following device is controlled to follow the movement of the first user, and when the server detects that the positioning information of the smart following device reaches the exhibit area containing the exhibition items, the smart following device is sent Send a control instruction to instruct the smart following device to automatically display the instruction of the exhibit information related to the exhibition item, so that when the first user does not have the second user to explain, the smart following device can still display the information of the exhibition item display to improve the viewing experience for users.
  • control instruction includes controlling the smart follower device to display an image corresponding to the operation instruction in response to an operation instruction triggered by the second user on the smart follower device. Instructions for exhibit information.
  • control instruction includes controlling the exhibit to perform an operation corresponding to the operation instruction in response to an operation instruction triggered by the second user on the smart follower device instructions.
  • the smart following device acts as the second user's auxiliary explanation device, and can interact with the second user to display item information first.
  • the smart follower device sends the operation instruction to the server, and the server responds to the operation instruction triggered by the second user on the smart follower device, and sends the
  • the control instruction is used to instruct the smart follower device to display exhibit information corresponding to the operation instruction, and/or send a control instruction to the exhibit to instruct the exhibit to perform the operation corresponding to the operation instruction.
  • prompt information may also be sent to the smart following device to remind the Whether the second user needs to switch to the automatic explanation mode, wherein the automatic explanation mode means that the exhibition item information is automatically displayed through the intelligent follower device; wherein, the prompt information can be sent to the second user by voice, pop-up window, etc.
  • the second user decides whether to switch to the independent explanation mode of the smart following device. In this independent explanation mode, the smart following device will follow the first user and move towards the first user. The user automatically displays exhibit information related to the exhibit.
  • a switching instruction triggered by the second user on the smart follower device based on the prompt information may also be received, and the server responds to the second user based on the prompt information in the
  • the switching instruction triggered on the smart following device sends the following instruction and the control instruction to the smart following device to instruct the smart following device to follow the first user to move and automatically display the information of the exhibition items .
  • the second type is the intelligent explanation function of the exhibition item information.
  • the exhibition item information includes at least one of video, picture, audio, lighting, projection, text, and voice.
  • the exhibition item information of an exhibition item can be understood as historical information related to a product or cultural relic, including production time or unearthed time, the meaning of the product or cultural relic itself, through video, picture, audio, lighting, projection,
  • the information of the exhibition items is explained in text, voice, etc., which is convenient for visitors to understand, and can also deepen visitors' understanding of the exhibition items more vividly, and improve the efficiency and experience of visitors.
  • the smart following device 101 further includes a sounding device, and the smart following device intelligently explains at least one exhibit information through the sounding device.
  • the smart following device 101 can automatically explain the information of the exhibition items, assisting the explainer to provide more intelligent explaining methods and explaining scenes.
  • the smart following device 101 can also determine exhibit information and implement smart explanations in any of the following ways, specifically as follows:
  • the intelligent following device 101 determines at least one exhibit information according to the target user's positioning information, and intelligently explains the at least one exhibit information through the sound generating device.
  • the exhibition item information of an exhibition item includes one or more items, which is not limited in this embodiment.
  • the target user includes the first user who visits the exhibit.
  • the smart following device 101 moves with the first user, when the smart following device 101 arrives within the detection range of the electronic fence of a certain exhibition item, it will intelligently explain the information of the at least one exhibition item through the sounding device. In this way, there is no need for manual explanation by the guide, and the user's visit experience is improved by intelligently explaining the way to the visitors.
  • At least one exhibit item information is determined according to the positioning information of the first user, and the exhibit item information is intelligently explained. Specifically, an intelligent explanation may be performed on at least one exhibit item information closest to the positioning information of the first user. It is also possible to intelligently explain the exhibit information of the exhibit items whose distance from the first user is within a preset range.
  • the target user may also include a second user who introduces the exhibit.
  • This embodiment does not make too many limitations on this.
  • the smart following device 101 determines at least one exhibit information according to its own positioning information, and intelligently explains the at least one exhibit information through the sound generating device.
  • an intelligent explanation can be made on at least one exhibit item information that is closest to the positioning information of the intelligent following device 101 itself.
  • the smart follower device includes a touch screen, and the smart follower device is further configured to display exhibit information of at least one exhibit item through the touch screen.
  • the smart following device 101 is also used to switch between multiple following modes.
  • the types of target users followed by the smart following device 101 are different in different following modes, and the classification of the target users is based on at least kind of sure.
  • the target users in this embodiment can be divided into two types, one is the first user who visits the exhibit, and the other is the second user who introduces the exhibit.
  • the way to classify the target users can be determined based on actual needs, including but not limited to at least one of the ways of determining the classification based on the purpose of visiting, the interaction relationship with exhibit items, and the interaction relationship with display components.
  • the classification method in this embodiment is only an example, and implementations based on the same classification principle all belong to the protection scope of the present disclosure.
  • this embodiment provides at least two following modes, specifically as follows:
  • the smart follower implements at least one smart explanation method for the exhibit information.
  • the following mode when the target user followed by the smart following device includes the first user visiting the exhibit, the following mode includes at least one intelligent way of explaining information about the exhibit by the smart following device.
  • the intelligent follower device performs at least one control method on the display components.
  • the following mode includes at least one control method of the smart following device on the display component.
  • this embodiment can also classify the target users at a finer granularity, and provide more than two following modes, which can be defined according to actual needs, and the following modes of different types of target users can be partially different , or all are different, which is not limited too much in this embodiment.
  • the target user followed by the smart follow device it is necessary to judge whether the target user followed by the smart follow device is a user who visits the exhibit or introduces the exhibit, so that according to the judged target user, the target user can be followed more accurately
  • control the display components or display item information to perform corresponding operations.
  • the target user is determined to be the first user to visit the exhibit, follow the first user who visits, and automatically explain the exhibit information related to the exhibit, improving the user's visiting experience and effect.
  • this embodiment can determine the target user followed by the smart following device from the first user and the second user according to the distance between the first user and the second user, and according to the distance between the target user and the According to the positioning information of the intelligent following device, generate a following instruction, and determine a control instruction according to the target user; according to the following instruction and control instruction, follow the target user to move, and display the exhibition item information related to the exhibition item.
  • the distance between the visitor and the explaining user can be obtained, so that when the visitor is far away from the explaining user, the visitor is taken as the target user, and the intelligent following device is controlled to follow the visitor to move , and visitors are not automatically displayed information related to the exhibition items. If the explaining user is used as the target user, then the smart following device can be controlled to follow the explaining user's movement, and the interaction between the explaining user and the smart following device can be used to assist the explanation and improve the user's experience. viewing experience.
  • a control instruction is generated according to the location information of the target user and the smart follower device, and the smart follower device is controlled to follow the target user to move.
  • the control instruction is determined according to the target user.
  • the intelligent explanation method for exhibition scenes in this embodiment can automatically follow different target users, and display exhibit information for different target users, effectively improving the user's visiting experience.
  • the method provided in this embodiment can assist the explaining user to better display content and control exhibition items through the intelligent following device, free the hands of the explaining user, and improve the explaining effect.
  • the intelligent following device can realize independent explanation, Ensure that everyone receives the explanation information, reduce the workload of explaining users, and improve the visiting experience of visitors.
  • the smart following device is manually triggered to switch between following modes.
  • the smart following device triggers the generation of a switching instruction in response to the second operation of the target user, and performs switching between multiple following modes according to the switching instruction.
  • the manner of manual switching includes switching the manual operation trigger of the physical key and switching the manual operation trigger of the virtual key, which is not limited too much in this embodiment.
  • the physical button is located on the smart following device, and the virtual button is located on the display screen of the smart following device.
  • the target user may be a second user.
  • the second user instructor
  • the target user manually switches the following mode.
  • the target user may also be the first user, and the first user may switch the following mode manually, which is not limited in this embodiment.
  • the smart follower device includes a touch screen, and the switching instruction is triggered and generated by a touch signal received by the touch screen.
  • the target user performs a second operation through the touch screen to generate a touch signal (that is, a switching instruction).
  • the smart following device can automatically switch between following modes.
  • the smart following device triggers switching between multiple following modes according to positioning information of different types of target users.
  • the target users include a first user who visits the exhibit and a second user who introduces the exhibit, and the smart following device triggers execution according to the location information of the first user and the second user. Switch between various following modes.
  • the distance between the first user and the second user is determined according to the location information of the first user and the location information of the second user, and switching of the following mode is triggered according to the distance.
  • the switching of the following mode will be triggered, and it will switch to following the first user.
  • the smart following device follows the first user when it is detected that the distance is less than the distance threshold, it will continue to trigger the switching of the following mode, and switch to following the second user.
  • the location information of the first user and the second user can be periodically detected and the distance between them can be calculated, so as to periodically detect whether it is necessary to switch the following mode.
  • the smart following device may also use the location information of the first user and the second user, and the crowd density of the first user information, triggering the switching between various following modes.
  • the distance between the first user and the second user is determined according to the location information of the first user and the second user, and switching between multiple following modes is triggered according to the distance and crowd density information.
  • the current following mode is that the smart following device follows the second user
  • the distance is greater than or equal to the distance threshold and the crowd density information is greater than or equal to the density threshold
  • a switching of the following mode is triggered to follow the first user, and then, If the smart following device detects that the distance is less than the distance threshold and the crowd density information is less than the density threshold during the process of following the first user, it will continue to trigger the switching of the following mode and turn to follow the second user.
  • this embodiment includes but is not limited to two explaining modes, one is the assisted explaining mode, in this mode, the target user to be followed is determined to be the second user, that is, the explaining user, and the intelligent following device can assist in explaining Users control the exhibits, and the touch screen (such as PAD) on the smart follower device can be removed for use, which is convenient for explaining more convenient operations for users.
  • the assisted explaining mode in this mode, the target user to be followed is determined to be the second user, that is, the explaining user, and the intelligent following device can assist in explaining Users control the exhibits, and the touch screen (such as PAD) on the smart follower device can be removed for use, which is convenient for explaining more convenient operations for users.
  • the target user to be followed is determined to be the second user, that is, the explaining user
  • the intelligent following device can assist in explaining Users control the exhibits, and the touch screen (such as PAD) on the smart follower device can be removed for use, which is convenient for explaining more convenient operations for users.
  • PAD touch screen
  • the explaining user can open the playback control interface of the exhibition item through the smart follower device, and trigger the play button to play the introduction video, picture, voice and other exhibition item information corresponding to the exhibiting item; the explaining user can also trigger switching playback Operation instructions such as content, play/pause, volume increase and decrease, fast forward/rewind, etc., can also trigger the switch control of IoT devices such as display, sound and light, and projection; operations such as scene switching can also be performed, where the scene is defined as multiple Combination of on/off states and playlists of an IoT device.
  • the other is the independent explanation mode.
  • the target user to be followed is determined to be the first user, that is, the visitor, and the intelligent following device automatically follows the visitor.
  • the intelligent following device enters the exhibition area of an exhibition item (such When within the range of the electronic fence)
  • the pre-set explanation content of the exhibit will be played automatically.
  • the smart follower device is instructed to automatically display the exhibit information, such as automatically playing the introduction of the exhibit item Video, picture, voice, etc.
  • this embodiment can determine the target user to follow in any of the following ways:
  • Method 1 Determine the target user according to the distance.
  • the target user to be followed by the smart following device is determined from the first user and the second user.
  • determining the first user as the target user if the distance between the first user and the second user is greater than or equal to a distance threshold, then determining the first user as the target user;
  • the second user is determined as the target user.
  • the first user in this embodiment includes multiple
  • the second user in this embodiment includes one, that is, there are multiple visitors, and one explaining user. In this case, it is determined by the following method The distance between the first user and the second user:
  • the distance between the first user and the second user may be calculated according to the positioning information, that is, it may be calculated according to the positioning information of the first user and the positioning information of the second user.
  • the location information of the second user may be collected by a locator worn by the second user, and the location information of the first user may also be collected by a locator worn by the second user, or may be collected by a terminal device of the first user. This embodiment does not make too many limitations on the specific manner of collecting positioning information.
  • the distance between the first user and the second user is determined as follows:
  • the area containing the first user can be an area with an unlimited area size that can contain all the first users, or a limited area size, and as many users as possible can be included in the area with a limited area size the first user of .
  • the determination of the area containing the first user is not limited too much, and determination rules may be defined according to actual requirements.
  • the first area in this embodiment may be a circular area or a polygonal closed area, which is not limited too much in this embodiment.
  • the original images of each area in the exhibition hall can be collected through the camera device in the exhibition hall, and at least one of face recognition, human body recognition, biometrics, and crowd information recognition can be performed on the original image, and the collected original images can be selected according to the recognition results.
  • User images containing the first user are filtered out from the images, and an area containing the first user is determined from the user images.
  • Method 2 Determine the target user to follow according to the distance and crowd density.
  • the target user to be followed by the smart following device is determined from the first user and the second user.
  • the target user to be followed by the smart following device is determined from the first user and the second user.
  • the distance is higher than or equal to a distance threshold and the crowd density information is higher than or equal to a density threshold, then determining the first user as the target user;
  • the distance is lower than a distance threshold, or the crowd density information is lower than a density threshold, then determine the second user as the target user.
  • the crowd density information of the first user is determined in the following manner:
  • the first area containing the largest number of first users, wherein the size of the first area is fixed; according to the number of first users contained in the first area, determine the first area Describe the crowd density information of the first user.
  • the first area is a circular area with a radius of 2 meters.
  • the crowd density information of the first user is determined by the number of first users included in the first area of a fixed size. In the first area, a small number of visitors are outside the first area, or all the visitors are concentrated in the first area with a fixed size, then according to the number of visitors in the first area, it can be estimated that the second Crowd density information in an area.
  • the crowd density information of the first user is determined by any of the following methods:
  • each area in the exhibition hall can be scanned to obtain an area image, and the area image is identified to obtain an area image containing the first user, and according to each area image containing the first user, it is determined that the exhibition hall contains The first area with the largest number of first users; it is also possible to scan the interior of the exhibition hall according to the cameras installed in the exhibition hall, for example, according to the camera devices installed in each angle, orientation, and area of the exhibition hall to capture the original image inside the exhibition hall, The original image is used as an area image; the camera device can also be used to periodically scan and shoot the interior of the exhibition hall to obtain an area image, wherein the area image includes multiple pieces, and there are differences in the shooting angles and shooting areas of each area image.
  • the area image acquisition is not limited too much. After the area image is obtained, at least one of face recognition, human body recognition, crowd flow information identification, and biometric identification is performed on the area image.
  • the positioning information in the exhibition hall scan the positioning information in the exhibition hall to obtain the positioning information related to each area.
  • the positioning information of the first user is determined from the positioning information related to each area.
  • a first area containing the largest number of first users is determined.
  • the distance between the first user and the second user may also be determined through the following steps:
  • the crowd density information of the first users can be determined based on the number of first users in the first area, and according to the first area
  • the distance between the center point of , and the positioning information of the second user is used to determine the distance between the first user and the second user. Therefore, according to the crowd density information and the distance, the target user to follow is determined from the first user and the second user, so as to determine the current follow mode.
  • the first area is a circular area with a radius of 2 meters
  • the density threshold is 10 people gathered in the circular area with a radius of 2 meters
  • the distance threshold is 8 meters.
  • the target user to be followed is the first user, that is, the following mode is determined to be the mode of following the first user, otherwise, the target user to be followed is determined to be the second user, that is, the following mode is determined to be the mode of following the second user.
  • the corresponding positioning information is determined according to different target users, and the specific implementation is as follows:
  • the target user When the target user is the second user, receiving the location information of the second user, and determining the location information of the second user as the location information of the target user.
  • the positioning information of the target user can be determined according to the positioning information of the explaining user, and the user intelligently follows the device to realize the function of following movement. It should be noted that, since the location information of the second user is constantly changing during the moving process, the location information of the target user is also constantly moving along with the movement of the second user.
  • the positioning information is determined by any of the following methods:
  • Mode (1) determines the center point of the first area containing the largest number of first users as the positioning information of the target user.
  • the location of the first user in the first area may also be used as the location information of the target user.
  • the center point of the first area containing the largest number of first users also moves, so the location information of the target user also moves as the first user moves.
  • Mode (2) receiving the location information of the first user, and determining the location information of the target user according to the location information of the first user.
  • one location information can be selected from the location information of multiple first users as the location information of the target user, and the selection rule can be to select the location farthest from the second user
  • the positioning information of the target user is used as the positioning information of the target user; it is also possible to randomly select a positioning information as the positioning information of the target user in the first area containing the most positioning information in the exhibition hall, where the size of the first area is fixed; it can also be calculated
  • the average value of the positioning information which is used as the positioning information of the target user.
  • the average value of the positioning information can be calculated by calculating the average value of all the positioning information, or the positioning information after removing the maximum and minimum values. The average value is not too limited in this embodiment.
  • the target user after determining the target user and the location information of the target user, generate corresponding following instructions according to different target users, and determine the corresponding control instructions, thereby instructing the smart following device to follow the target user to move, and display and display items Relevant display information to improve the user's visit experience.
  • following instructions are generated by:
  • the shortest path between the target user and the positioning information of the smart following device and the distance between the target user and the positioning information of the smart following device, generate a following instruction to instruct the smart following device to Move on the shortest path mentioned above, and ensure that the distance meets the preset range.
  • the shortest drivable path between the two positioning information can be determined, for example, pre-obtaining the indoor architectural structure diagram of the exhibition hall, according to the location of the target user in the exhibition hall, and the smart Following the location of the equipment in the exhibition hall, determine the shortest path between the two in the exhibition hall.
  • instruct the smart follower device to keep the distance between the target user within a preset range, for example, control the smart follower device to follow the target user and move between the target user and the target user. The distance between them is maintained within the preset range, which can not only play the role of following, but also not affect the movement of the target user.
  • this embodiment also provides a method for updating the shortest path.
  • the shortest path After the shortest path is determined, it can also be judged in real time whether there is an obstacle on the shortest path. If an obstacle is detected on the shortest path, update the shortest path according to the obstacle position information on the shortest path, and instruct the smart following device to avoid the obstacle when moving according to the updated shortest path .
  • the path at the obstacle is replanned, the steering and the driving route in the direction of the steering are calculated at the obstacle, and the shortest path is replanned with the position after the steering as the starting point, And use the re-planned shortest path to instruct the intelligent follower device to avoid obstacles in time while moving on the shortest path.
  • this embodiment provides a schematic diagram of updating the shortest path.
  • the smart following device follows the target user and moves on the shortest path (the straight line between the position of the target user and the smart following device).
  • the shortest path the straight line between the position of the target user and the smart following device.
  • the smart following device described in this embodiment is further configured to stop following the target user when the target user stops moving, and determine its own station information when the target user stops following.
  • the intelligent following device determines its own station information when it stops following through the following steps:
  • the intelligent following device determines the shortest line segment according to the positioning information when the target user stops moving, and the exhibit item closest to the positioning information;
  • the smart following device determines the shortest line segment according to the positioning information when the target user stops moving, and the edge position of the exhibit closest to the positioning information.
  • the target user includes a first user who visits the exhibit or a second user who introduces the exhibit.
  • the line between the positioning information when the target user stops moving and the edge position of the exhibit closest to the positioning information can be used as the shortest line segment; the positioning information when the target user stops moving can also be used as the shortest line segment.
  • the shortest path among the actual drivable paths between the edge positions of the exhibit items closest to the positioning information is taken as the shortest line segment.
  • the edge position of the exhibition item includes, but is not limited to, the edge position closest to the target user's edge.
  • the smart following device determines the shortest line segment according to the positioning information when the target user stops moving, and the center position of the exhibit closest to the positioning information.
  • the target user includes a first user who visits the exhibit or a second user who introduces the exhibit.
  • the intelligent following device takes the positioning information when it stops moving as the center to determine a preset area; optionally, the preset area can be a circular area or a polygonal closed area, which is not discussed in this embodiment More limited.
  • the intelligent following device determines its own station information when it stops following according to the intersection of the shortest line segment and the preset area, and its own orientation relative to the target user.
  • the smart following device when the smart following device stops following, it faces the target user. If the smart following device includes a touch display, the touch display is facing the target user when the smart following device stops following.
  • this embodiment provides a schematic diagram of determining the location information when the target user is the first user, wherein the center point of the first area containing the largest number of first users is determined, and the first area is the radius For a circular area of 2 meters, the station information is the intersection point of the line connecting the center point and the center point of the exhibit and the boundary of the circular area.
  • this embodiment provides a schematic diagram of determining the location information when the target user is the second user, wherein the positioning information of the second user is determined, with the positioning information as the center and a circle with a radius of 2 meters
  • the station information is the intersection of the line connecting the positioning information and the edge position of the exhibit item with the boundary of the circular area.
  • the edge position of the exhibit item is the edge position closest to the edge of the exhibit item for explaining the user.
  • the positioning technology used in this embodiment includes but is not limited to indoor positioning technology, such as indoor Bluetooth precise positioning technology, Bluetooth AOA technology, and the positioning accuracy can reach within 0.5m.
  • the positioning methods in this embodiment include but are not limited to any of the following:
  • the first positioning method locator positioning.
  • the positioning device in this embodiment includes a locator, and the positioning device determines the positioning information of the target user in the following manner:
  • the positioning device determines the positioning information of the target user through a locator carried by the target user.
  • the locator is an indoor Bluetooth locator.
  • the target user includes a second user who introduces the exhibit.
  • the positioning device determines the positioning information of the second user through a locator carried by the target user.
  • the target user includes multiple, and the positioning device determines the positioning information of the target user through a locator carried by the target user, including:
  • the locating device determines an area containing multiple target users according to the locators carried by the multiple target users; the locating device determines the area containing the multiple target users according to the center point of the area, or the locator of the target user closest to the center point of the area , to determine the location information of the target user.
  • the target user includes the first user who visits the exhibit.
  • the positioning device determines an area containing multiple first users according to the locators carried by the multiple first users; according to the center point of the area, or the locator of the first user closest to the center point of the area, Determine the location information of the first user.
  • this positioning method is also used to determine crowd density information in the following manner:
  • the positioning device determines the crowd density information of the first user according to the size of the area and the number of locators detected in the area.
  • the second positioning method camera positioning.
  • the positioning device includes a camera component, and the positioning device determines the positioning information of the target user in the following manner:
  • the positioning device determines the positioning information of the target user according to the image of the target user collected by the camera component.
  • the target users include multiple, and the positioning device recognizes the images collected by the camera assembly containing multiple target users, and determines the area containing multiple target users; the positioning device determines the area containing multiple target users; or, the position of the target user closest to the center point of the area, to determine the positioning information of the target user.
  • the position of the target user closest to the central point of the area is obtained by identifying an image containing multiple target users.
  • the target user includes the first user who visits the exhibit.
  • the positioning device recognizes the images collected by the camera assembly that contain multiple first users, and determines the area containing multiple first users; the positioning device is based on the center point of the area, or the distance from the center point of the area The nearest location of the first user is used to determine the location information of the first user.
  • this positioning method is also used to determine crowd density information in the following manner:
  • the positioning device determines the crowd density information of the first user according to the size of the area and the number of first users identified in the area.
  • the third positioning method positioner positioning combined with camera positioning.
  • the locator can be used to determine the location information of the second user, and the camera location can be used to determine the location information of the first user. It is also possible to use the locator to determine the location information of the first user, and use the camera to determine the location information of the second user. This embodiment does not make too many limitations on this. For specific locator positioning methods and camera positioning methods, refer to the descriptions of the above two positioning methods, and will not be repeated here.
  • this embodiment also provides any one of the following methods for locating the smart follower device:
  • the positioning device includes a locator, and the positioning device is also used to determine the positioning information of the intelligent following device in the following manner:
  • the positioning device determines the positioning information of the smart following device according to the locator carried by the smart following device.
  • Positioning method 2 Camera positioning.
  • the positioning device includes a camera component, and the positioning device is also used to determine the positioning information of the intelligent following device in the following manner:
  • the locating device recognizes the image collected by the camera assembly and includes the smart following device, and determines the positioning information of the smart following device.
  • an embodiment of the present disclosure also provides a schematic structural diagram of a smart following device, including a display 600 , a display base 601 , a main chassis 602 and a wheel 603 .
  • the display 600 can be removed, and the display 600 includes a touch screen, such as an electronic display device such as an electronic tablet with a touch function.
  • a touch screen such as an electronic display device such as an electronic tablet with a touch function.
  • the main chassis 602 is composed of other basic modules such as a controller and a drive device.
  • the smart follower device in this embodiment includes a controller (such as a server) and a follower, wherein the server is used to implement functions such as positioning, data processing, and signal sending and receiving, and the follower is used to implement following.
  • a controller such as a server
  • the follower is used to implement following.
  • the interaction between the server and the follower is described below by taking the smart follower device including the server and the follower as an example.
  • this embodiment provides an interaction process between modules in a smart follower device, specifically as follows:
  • Step 700 the server determines the target user from the first user and the second user according to the distance between the first user and the second user;
  • the first user represents a user who visits an exhibit
  • the second user represents a user who introduces an exhibit
  • Step 701 the server generates a follow instruction according to the location information of the target user and the location information of the follower;
  • Step 702 Send the following instruction to the follower, so as to control the follower to follow the target user.
  • Step 703 the follower receives the following instruction sent by the server
  • Step 704 The follower determines a moving path according to the following instruction, and follows the target user according to the moving path.
  • control instruction can also be determined according to the target user, and the control instruction can be sent to the follower, so as to control the follower to display the exhibition item information related to the exhibition item; and/or, send the control instruction to at least one display component, and control The display component performs the corresponding operation.
  • the embodiment of the present disclosure provides a method for assisting intelligent explanation of a display scene, and the implementation process of the method is specifically as follows:
  • Step 800 the server determines the first area containing the largest number of first users from each area of the exhibition hall, and determines the crowd density information of the first users according to the number of first users contained in the first area;
  • Step 801 the server receives the positioning information sent by the second user; calculates the distance between the center point of the first area containing the largest number of first users and the positioning information;
  • Step 802. If the distance is lower than a distance threshold, or the crowd density information is lower than a density threshold, the server determines the second user as the target user;
  • Step 803 the server generates a follow instruction according to the shortest path between the location information of the second user and the follower, and the distance between the location information of the second user and the follower;
  • Step 804 Send a follow instruction and a control instruction to the second user.
  • control instruction includes a control instruction for display component and/or exhibit item information of the exhibit item.
  • the embodiment of the present disclosure provides a method for independent intelligent explanation of the exhibition scene, and the implementation process of the method is specifically as follows:
  • Step 900 the server determines the first area containing the largest number of first users from each area of the exhibition hall, and determines the crowd density information of the first users according to the number of first users contained in the first area;
  • Step 901 the server receives the positioning information sent by the second user; calculates the distance between the center point of the first area containing the largest number of first users and the positioning information;
  • Step 902 If the distance is higher than or equal to a distance threshold and the crowd density information is higher than or equal to a density threshold, the server determines the first user as the target user;
  • Step 903 the server determines the center point of the first area containing the largest number of first users as the positioning information of the target user.
  • Step 904 the server sends prompt information to the follower to prompt the second user whether to switch to the automatic explanation mode
  • the automatic explanation mode means that the exhibition item information is automatically displayed through the follower
  • step 905 the server sends a following instruction and a control instruction to the follower in response to the switching instruction triggered by the second user on the follower based on the prompt information.
  • This embodiment may instruct the follower to follow the movement of the first user, and automatically display the information of the exhibition items, and/or, automatically control the display components.
  • the following instruction is generated according to the shortest path between the target user and the location information of the follower, and the distance between the target user and the location information of the follower. It is ensured that the follower keeps a certain distance from the target user during the process of following the target user, wherein the control instruction includes a control instruction on the display component and/or the display item information of the display item.
  • this embodiment also provides a schematic diagram of an auxiliary explanation mode, wherein the intelligent following device includes a server and a follower.
  • the target user to follow is the second user, that is, the explaining user.
  • the locator reports its own positioning information to the Bluetooth beacon.
  • the follower reports its own positioning information to the Bluetooth beacon.
  • the Bluetooth beacon will explain the user's positioning information and send it to the server.
  • the server generates a following instruction based on the reported positioning information.
  • the explaining user can also perform touch operations on the content related to the exhibit displayed by the follower, and the second user triggers the operation command on the follower , the follower sends the operation instruction to the server, and the server triggers and generates a control instruction according to the received operation instruction, and sends the control instruction to the follower and the display component to instruct the follower and the display component to perform the corresponding operation.
  • the follower in this embodiment includes a touch screen, and the touch screen is detachable.
  • this embodiment also provides a schematic diagram of an independent explanation mode, wherein the intelligent following device includes a server and a follower, and in this mode, the target user to follow is the first user, that is, the visiting user.
  • the intelligent following device includes a server and a follower
  • the target user to follow is the first user, that is, the visiting user.
  • You can select a target visitor from among the visitors, and report the location information of the target visitor to the Bluetooth beacon according to the locator worn by the target visitor.
  • the follower reports its own location information to the Bluetooth beacon, and the Bluetooth beacon will
  • the location information of the target visitor (as the location information of the first user) is sent to the server, and the server generates a follow instruction according to the reported location information, and sends the follow instruction to the follower to instruct the follower to follow the first user, and when detecting After the follower enters the electronic fence area of an exhibition item, it sends a control command to the follower, and the follower is controlled to automatically display the exhibition item information related to the exhibition item.
  • the embodiments of the present disclosure also provide a method for intelligent explanation of exhibition scenes, which can be applied to intelligent follower devices.
  • the implementation principle of this method is the same as that of the above-mentioned system.
  • this embodiment also provides a method for intelligently explaining the exhibition scene, and the specific implementation process of the method is as follows:
  • Step 1200 determine the positioning information of the target user
  • Step 1201. Follow the target user according to the location information of the target user.
  • it also includes:
  • it also includes:
  • it also includes:
  • it also includes:
  • control instructions are generated in the following manner:
  • the intelligent explanation of the exhibit information of at least one exhibit includes:
  • the target user to follow includes the first user who visits the exhibit
  • the following mode includes at least one intelligent way of explaining information about the exhibit.
  • the determination of the own station information when stopping following includes:
  • intersection point of the shortest line segment and the preset area, and the orientation of the user relative to the target user determine the location information of the user when the following is stopped.
  • the determining the shortest line segment according to the positioning information when the target user stops moving and the exhibit item closest to the positioning information includes:
  • the shortest line segment is determined according to the positioning information when the target user stops moving, and the edge position of the exhibit item closest to the positioning information.
  • the target user includes a first user who visits the exhibit.
  • the generation of the control instruction is triggered in response to the first operation of the target user.
  • the switching between multiple following modes includes:
  • the generation of a switching instruction is triggered, and switching between multiple following modes is performed according to the switching instruction.
  • the determining the shortest line segment according to the positioning information when the target user stops moving and the exhibit item closest to the positioning information includes:
  • the shortest line segment is determined according to the positioning information when the target user stops moving, and the center position of the exhibit item closest to the positioning information.
  • the target user includes a second user who introduces the exhibit.
  • the following mode includes at least one control mode for the display component.
  • the switching between multiple following modes includes:
  • the target users include the first user who visits the exhibit and the second user who introduces the exhibit. According to the positioning information of different types of target users, switching between multiple following modes is triggered, include:
  • the triggering execution of switching between multiple following modes according to the location information of the first user and the second user includes:
  • control instruction is generated by triggering a touch signal received by the touch screen.
  • the switching instruction is triggered and generated by a touch signal received by the touch screen.
  • it also includes:
  • the screen display of the exhibit information of at least one exhibit is performed through the touch screen.
  • the positioning information of the target user is determined in the following manner:
  • the positioning information of the target user is determined through the locator carried by the target user.
  • the target user includes a second user who introduces the exhibit.
  • the target user includes multiple, and determining the positioning information of the target user through the locator carried by the target user includes:
  • the positioning information of the target user is determined according to the center point of the area, or the locator of the target user closest to the center point of the area.
  • the positioning information of the target user is determined in the following manner:
  • the positioning information of the target user is determined according to the image of the target user collected by the camera component.
  • the target user includes multiple, and determining the positioning information of the target user according to the image of the target user collected by the camera component includes:
  • the target user includes a first user who visits the exhibit.
  • the crowd density information of the first user is determined in the following manner:
  • the crowd density information of the first user is determined in the following manner:
  • determine your own positioning information in the following manner:
  • the positioning information of itself is determined.
  • determine your own positioning information in the following manner:
  • the exhibit information includes at least one of video, picture, audio, light, and projection.
  • control instruction includes at least one of playback switch, pause, volume adjustment, playback progress adjustment, and switch control.
  • the display component includes at least one of a display component, a lighting component, an intelligent air conditioner, and an intelligent Internet of Things device.
  • the embodiment of the present disclosure also provides a device for intelligently explaining the scene, because the device is the device in the method in the embodiment of the present disclosure, and the problem-solving principle of the device is similar to the method , so the implementation of the device can refer to the implementation of the method, and the repetition will not be repeated.
  • the device includes:
  • a determining and positioning unit 1300 configured to determine the positioning information of the target user
  • the following mobile unit 1301 is configured to follow the target user to move according to the location information of the target user.
  • an embodiment of the present disclosure also provides a computer storage medium on which a computer program is stored, and when the program is executed by a processor, the following steps are implemented:
  • the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Accordingly, the present disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) having computer-usable program code embodied therein.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Geometry (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开提出了一种展陈场景智能讲解的系统及其方法,用于利用智能跟随设备自动跟随讲解用户或参观人员,提高参观人员的参观体验。该系统包括定位装置、智能跟随设备,其中:所述定位装置,用于确定目标用户的定位信息;所述智能跟随设备,用于根据所述目标用户的定位信息,跟随所述目标用户移动。

Description

一种展陈场景智能讲解的系统及其方法 技术领域
本公开涉及物联网技术领域,特别涉及一种展陈场景智能讲解的系统及其方法。
背景技术
展陈系统是一种展览展示系统,一般用于政府、企业、博物馆展厅,实现对展项设备的开关控制、播放控制、互动控制。其中,展厅中展览或展示的展项大多是终端设备一体机,一般由主机和显示屏构成。
目前,接待参观团后,对展厅中的展项进行讲解时,主要通过讲解员进行人工讲解,讲解方式较为单一、枯燥,讲解效果不佳,影响参观人员的参观体验。
发明内容
本公开提供一种展陈场景智能讲解的系统及其方法,用于利用智能跟随设备自动跟随讲解用户或参观人员,提高参观人员的参观体验。
第一方面,本公开实施例提供的一种展陈场景智能讲解的系统,该系统包括智能跟随设备、定位装置,其中:
所述定位装置,用于确定目标用户的定位信息;
所述智能跟随设备,用于根据所述目标用户的定位信息,跟随所述目标用户移动。
作为一种可选的实施方式,所述智能跟随设备还用于生成控制指令,并根据生成的控制指令,对至少一个展陈组件进行对应的控制。
作为一种可选的实施方式,所述智能跟随设备还包括发声装置,所述智能跟随设备通过所述发声装置对至少一个展项的展项信息进行智能讲解。
作为一种可选的实施方式,所述智能跟随设备还用于执行多种跟随模式 间的切换;其中不同跟随模式下所述智能跟随设备跟随的目标用户的类型是不同的,所述目标用户的分类是根据参观目的、与展项的互动关系以及与展陈组件的互动关系中的至少一种确定的。
作为一种可选的实施方式,所述智能跟随设备还用于当目标用户停止移动时停止跟随,并确定停止跟随时自身的站位信息。
作为一种可选的实施方式,通过如下方式生成控制指令:
所述智能跟随设备根据所述目标用户的定位信息,生成所述控制指令;或,
所述智能跟随设备根据所述智能跟随设备自身的定位信息,生成所述控制指令。
作为一种可选的实施方式,所述智能跟随设备通过所述发声装置对至少一个展项的展项信息进行智能讲解,包括:
所述智能跟随设备根据所述目标用户的定位信息确定至少一个展项,通过所述发声装置对所述至少一个展项的展项信息进行智能讲解;或,
所述智能跟随设备根据自身的定位信息确定至少一个展项,通过所述发声装置对所述至少一个展项的展项信息进行智能讲解。
作为一种可选的实施方式,当所述智能跟随设备跟随的目标用户包括参观展项的第一用户时,所述跟随模式包括所述智能跟随设备对展项信息的至少一种智能讲解方式。
作为一种可选的实施方式,所述智能跟随设备确定停止跟随时自身的站位信息,包括:
所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段;
所述智能跟随设备将所述停止移动时的定位信息作为中心,确定预设区域;
所述智能跟随设备根据所述最短线段和所述预设区域的交叉点,以及自身相对于所述目标用户的朝向,确定停止跟随时自身的站位信息。
作为一种可选的实施方式,所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段,包括:
所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的边缘位置,确定最短线段。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户。
作为一种可选的实施方式,所述智能跟随设备响应于目标用户的第一操作,触发生成所述控制指令。
作为一种可选的实施方式,所述智能跟随设备执行多种跟随模式间的切换,包括:
所述智能跟随设备响应于目标用户的第二操作,触发生成切换指令,根据所述切换指令执行多种跟随模式间的切换。
作为一种可选的实施方式,所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段,包括:
所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的中心位置,确定最短线段。
作为一种可选的实施方式,所述目标用户包括介绍展项的第二用户。
作为一种可选的实施方式,当所述智能跟随设备跟随的目标用户包括介绍展项的第二用户时,所述跟随模式包括所述智能跟随设备对展陈组件的至少一种控制方式。
作为一种可选的实施方式,所述智能跟随设备执行多种跟随模式间的切换,包括:
所述智能跟随设备根据不同类型的目标用户的定位信息,触发执行多种跟随模式间的切换。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户和介绍展项的第二用户,所述智能跟随设备根据不同类型的目标用户的定位信息, 触发执行多种跟随模式间的切换,包括:
所述智能跟随设备根据所述第一用户和所述第二用户的定位信息,触发执行多种跟随模式间的切换。
作为一种可选的实施方式,所述智能跟随设备根据所述第一用户和所述第二用户的定位信息,触发执行多种跟随模式间的切换,包括:
所述智能跟随设备根据所述第一用户和所述第二用户的定位信息,以及所述第一用户的人群密度信息,触发执行多种跟随模式间的切换。
作为一种可选的实施方式,所述智能跟随设备包括触控显示屏,所述控制指令是通过所述触控显示屏接收的触控信号触发生成的。
作为一种可选的实施方式,所述智能跟随设备包括触控显示屏,所述切换指令是通过所述触控显示屏接收的触控信号触发生成的。
作为一种可选的实施方式,所述智能跟随设备包括触控显示屏,所述智能跟随设备还用于通过所述触控显示屏进行至少一个展项的展项信息的画面显示。
作为一种可选的实施方式,所述定位装置包括定位器,所述定位装置通过如下方式确定所述目标用户的定位信息:
所述定位装置通过所述目标用户携带的定位器,确定所述目标用户的定位信息。
作为一种可选的实施方式,所述目标用户包括介绍展项的第二用户。
作为一种可选的实施方式,所述目标用户包括多个,所述定位装置通过所述目标用户携带的定位器,确定所述目标用户的定位信息,包括:
所述定位装置根据多个目标用户携带的定位器,确定包含多个目标用户的区域;
所述定位装置根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的定位器,确定所述目标用户的定位信息。
作为一种可选的实施方式,所述定位装置包括摄像组件,所述定位装置通过如下方式确定所述目标用户的定位信息:
所述定位装置根据摄像组件采集的目标用户的图像,确定所述目标用户的定位信息。
作为一种可选的实施方式,所述目标用户包括多个,所述定位装置根据摄像组件采集的目标用户的图像,确定所述目标用户的定位信息,包括:
所述定位装置对摄像组件采集的包含多个目标用户的图像进行识别,确定包含多个目标用户的区域;
所述定位装置根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的位置,确定所述目标用户的定位信息,其中,所述距离所述区域中心点最近的目标用户的位置是对包含多个目标用户的图像进行识别得到的。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户时,所述定位装置还用于通过如下方式确定所述第一用户的人群密度信息:
所述定位装置根据所述区域的大小,以及在所述区域内检测到的定位器的数量,确定所述第一用户的人群密度信息。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户时,所述定位装置通过如下方式确定所述第一用户的人群密度信息:
所述定位装置根据所述区域的大小,以及在所述区域内识别出的第一用户的数量,确定所述第一用户的人群密度信息。
作为一种可选的实施方式,所述定位装置包括定位器,所述定位装置还用于通过如下方式确定所述智能跟随设备的定位信息:
所述定位装置根据所述智能跟随设备携带的定位器,确定所述智能跟随设备的定位信息。
作为一种可选的实施方式,所述定位装置包括摄像组件,所述定位装置还用于通过如下方式确定所述智能跟随设备的定位信息:
所述定位装置对摄像组件采集的包含所述智能跟随设备的图像进行识别,确定所述智能跟随设备的定位信息。
作为一种可选的实施方式,所述展项信息包括视频、图片、音频、灯光、 投影中的至少一种。
作为一种可选的实施方式,所述控制指令包括播放切换、暂停、音量调节、播放进度调节、开关控制中的至少一种。
作为一种可选的实施方式,所述展陈组件包括显示组件、灯光组件、智能空调设备、智能物联网设备中的至少一种。
第二方面,本公开实施例提供的一种展陈场景智能讲解的方法,包括:
确定目标用户的定位信息;
根据所述目标用户的定位信息,跟随所述目标用户移动。
作为一种可选的实施方式,还包括:
生成控制指令,并根据生成的控制指令,对至少一个展陈组件进行对应的控制。
作为一种可选的实施方式,还包括:
对至少一个展项的展项信息进行智能讲解。
作为一种可选的实施方式,还包括:
执行多种跟随模式间的切换;其中不同跟随模式下跟随的目标用户的类型是不同的,所述目标用户的分类是根据参观目的、与展项的互动关系以及与展陈组件的互动关系中的至少一种确定的。
作为一种可选的实施方式,还包括:
当目标用户停止移动时停止跟随,并确定停止跟随时自身的站位信息。
作为一种可选的实施方式,通过如下方式生成控制指令:
根据所述目标用户的定位信息,生成所述控制指令;或,
根据自身的定位信息,生成所述控制指令。
作为一种可选的实施方式,所述对至少一个展项的展项信息进行智能讲解,包括:
根据所述目标用户的定位信息确定至少一个展项,对所述至少一个展项的展项信息进行智能讲解;或,
根据自身的定位信息确定至少一个展项,对所述至少一个展项的展项信 息进行智能讲解。
作为一种可选的实施方式,当跟随的目标用户包括参观展项的第一用户时,所述跟随模式包括对展项信息的至少一种智能讲解方式。
作为一种可选的实施方式,所述确定停止跟随时自身的站位信息,包括:
根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段;
将所述停止移动时的定位信息作为中心,确定预设区域;
根据所述最短线段和所述预设区域的交叉点,以及自身相对于所述目标用户的朝向,确定停止跟随时自身的站位信息。
作为一种可选的实施方式,所述根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段,包括:
根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的边缘位置,确定最短线段。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户。
作为一种可选的实施方式,所述响应于目标用户的第一操作,触发生成所述控制指令。
作为一种可选的实施方式,所述执行多种跟随模式间的切换,包括:
响应于目标用户的第二操作,触发生成切换指令,根据所述切换指令执行多种跟随模式间的切换。
作为一种可选的实施方式,所述根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段,包括:
根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的中心位置,确定最短线段。
作为一种可选的实施方式,所述目标用户包括介绍展项的第二用户。
作为一种可选的实施方式,当跟随的目标用户包括介绍展项的第二用户时,所述跟随模式包括对展陈组件的至少一种控制方式。
作为一种可选的实施方式,所述执行多种跟随模式间的切换,包括:
根据不同类型的目标用户的定位信息,触发执行多种跟随模式间的切换。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户和介绍展项的第二用户,根据不同类型的目标用户的定位信息,触发执行多种跟随模式间的切换,包括:
根据所述第一用户和所述第二用户的定位信息,触发执行多种跟随模式间的切换。
作为一种可选的实施方式,所述根据所述第一用户和所述第二用户的定位信息,触发执行多种跟随模式间的切换,包括:
根据所述第一用户和所述第二用户的定位信息,以及所述第一用户的人群密度信息,触发执行多种跟随模式间的切换。
作为一种可选的实施方式,所述控制指令是通过触控显示屏接收的触控信号触发生成的。
作为一种可选的实施方式,所述切换指令是通过触控显示屏接收的触控信号触发生成的。
作为一种可选的实施方式,还包括:
通过触控显示屏进行至少一个展项的展项信息的画面显示。
作为一种可选的实施方式,通过如下方式确定所述目标用户的定位信息:
通过所述目标用户携带的定位器,确定所述目标用户的定位信息。
作为一种可选的实施方式,所述目标用户包括介绍展项的第二用户。
作为一种可选的实施方式,所述目标用户包括多个,所述通过所述目标用户携带的定位器,确定所述目标用户的定位信息,包括:
根据多个目标用户携带的定位器,确定包含多个目标用户的区域;
根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的定位器,确定所述目标用户的定位信息。
作为一种可选的实施方式,通过如下方式确定所述目标用户的定位信息:
根据摄像组件采集的目标用户的图像,确定所述目标用户的定位信息。
作为一种可选的实施方式,所述目标用户包括多个,所述根据摄像组件 采集的目标用户的图像,确定所述目标用户的定位信息,包括:
对摄像组件采集的包含多个目标用户的图像进行识别,确定包含多个目标用户的区域;
根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的位置,确定所述目标用户的定位信息,其中,所述距离所述区域中心点最近的目标用户的位置是对包含多个目标用户的图像进行识别得到的。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户时,通过如下方式确定所述第一用户的人群密度信息:
根据所述区域的大小,以及在所述区域内检测到的定位器的数量,确定所述第一用户的人群密度信息。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户时,通过如下方式确定所述第一用户的人群密度信息:
根据所述区域的大小,以及在所述区域内识别出的第一用户的数量,确定所述第一用户的人群密度信息。
作为一种可选的实施方式,通过如下方式确定自身的定位信息:
根据自身携带的定位器,确定自身的定位信息。
作为一种可选的实施方式,通过如下方式确定自身的定位信息:
对摄像组件采集的包含自身的图像进行识别,确定自身的定位信息。
作为一种可选的实施方式,所述展项信息包括视频、图片、音频、灯光、投影中的至少一种。
作为一种可选的实施方式,所述控制指令包括播放切换、暂停、音量调节、播放进度调节、开关控制中的至少一种。
作为一种可选的实施方式,所述展陈组件包括显示组件、灯光组件、智能空调设备、智能物联网设备中的至少一种。
第三方面,本公开实施例提供的一种展陈场景智能讲解的装置,包括:
确定定位单元,用于确定目标用户的定位信息;
跟随移动单元,用于根据所述目标用户的定位信息,跟随所述目标用户移动。
第四方面,本公开实施例还提供计算机存储介质,其上存储有计算机程序,该程序被处理器执行时用于实现上述第二方面所述方法的步骤。
本申请的这些方面或其他方面在以下的实施例的描述中会更加简明易懂。
附图说明
为了更清楚地说明本公开实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简要介绍,显而易见地,下面描述中的附图仅仅是本公开的一些实施例,对于本领域的普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1为本公开实施例提供的一种展陈场景智能讲解的系统;
图2为本公开实施例提供的一种人群密度计算和距离计算的示意图;
图3为本公开实施例提供的一种更新最短路径的示意图;
图4为本公开实施例提供的一种目标用户为第一用户时确定站位信息的示意图;
图5为本公开实施例提供的一种目标用户为第二用户时确定站位信息的示意图;
图6为本公开实施例提供的一种智能跟随设备的结构示意图;
图7为本公开实施例提供的一种智能跟随设备中的模块间的交互流程图;
图8为本公开实施例提供的一种展陈场景辅助智能讲解的方法实施流程图;
图9为本公开实施例提供的一种展陈场景独立智能讲解的方法实施流程图;
图10为本公开实施例提供的一种辅助讲解模式的示意图;
图11为本公开实施例提供的一种独立讲解模式的示意图;
图12为本公开实施例提供的一种展陈场景智能讲解的方法实施流程图;
图13为本公开实施例提供的一种展陈场景智能讲解的装置示意图。
具体实施方式
为了使本公开的目的、技术方案和优点更加清楚,下面将结合附图对本公开作进一步地详细描述,显然,所描述的实施例仅仅是本公开一部分实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例,都属于本公开保护的范围。
本公开实施例中术语“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
本公开实施例描述的应用场景是为了更加清楚的说明本公开实施例的技术方案,并不构成对于本公开实施例提供的技术方案的限定,本领域普通技术人员可知,随着新应用场景的出现,本公开实施例提供的技术方案对于类似的技术问题,同样适用。其中,在本公开的描述中,除非另有说明,“多个”的含义是两个或两个以上。
展陈系统是一种展览展示系统,一般用于政府、企业、博物馆展厅,实现对展项设备的开关控制、播放控制、互动控制。其中,展厅中展览或展示的展项大多是终端设备一体机,一般由主机和显示屏构成。目前,接待参观团后,对展厅中的展项进行讲解时,主要通过讲解员进行人工讲解,讲解方式较为单一、枯燥,讲解效果不佳,最终影响参观人员的参观体验。
本公开实施例提供的一种展陈场景智能讲解的系统,包括智能跟随设备、定位装置,其中,本实施例中的智能跟随设备包括但不限于配置驱动装置的智能机器人,以通过该驱动装置实现跟随移动。
本实施例提供的展陈场景智能讲解的系统,能够提供一种更加智能化的讲解场景,利用智能跟随设备对讲解员或参观人员实现自动跟随,提高讲解效率、提升参观体验。设计的核心思想是利用定位装置确定目标用户的定位 信息,基于该定位信息实现自动跟随。
如图1所示,本实施例提供的一种展陈场景智能讲解的系统,该系统包括定位装置100、智能跟随设备101,其中:
所述定位装置100,用于确定目标用户的定位信息;
所述智能跟随设备101,用于根据所述目标用户的定位信息,跟随所述目标用户移动。
需要说明的是,本实施例中的智能跟随设备101包括控制器,用于控制自身跟随目标用户移动,还可以用于进行定位信息的计算等其他功能,可选的,该控制器可以与智能跟随设备101分离,控制器和智能跟随设备101之间通过无线或有线的方式进行数据、消息的传输,例如控制器包括服务器,通过服务器进行智能跟随设备101中涉及到的数据计算,通过向智能跟随设备101发送信令的方式,控制智能跟随设备101实现自动跟随。可选的,该控制器和智能跟随设备101为一体,内置于智能跟随设备101中。本实施例对控制器和智能跟随设备101之间的结构关系、信息传输方式不进行过多限定。
在一些实施例中,本实施例中的定位装置100也可以内置于智能跟随设备101中,即将定位装置100作为智能跟随设备101中的一个部件。
在一些实施例中,本实施例中的目标用户包括但不限于:参观展项的第一用户、介绍展项的第二用户;可选的,第一用户包括多个,第二用户为一个。第一用户可以理解为参观人员,第二用户可以理解为讲解员。
在一些实施例中,本实施例中的智能跟随设备101除了可以进行自动跟随以外,还可以实现对展陈组件的控制、对展项信息的智能讲解、跟随模式间的切换等功能,其中,这些功能之间可以相互组合,也可以独立使用,本实施例对此不作过多限定,下面将对上述功能进行逐一说明。
在一些实施例中,本实施例中的智能跟随设备101还用于执行如下任意一种或任意多种功能:
第1种,对展陈组件的控制功能。
在一些实施例中,智能跟随设备101生成控制指令,并根据生成的控制指令,对至少一个展陈组件进行对应的控制。
可选的,本实施例中的控制指令包括但不限于播放切换、暂停、音量调节、播放进度调节、开关控制中的至少一种。
可选的,本实施例中的展陈组件包括显示组件、灯光组件、智能空调设备、智能物联网设备中的至少一种。展陈组件位于展厅内部,在进行讲解的同时,通过控制展陈组件来丰富讲解场景,使得用户在参观展项并聆听展项信息的同时,能够声临其境地体验与该展项相关的场景,为参观用户提供更贴切、形象的讲解体验。
本实施例可以通过控制指令实现对展陈组件的控制,其中控制指令和展陈组件可以是对应的关系,例如通过生成的针对灯光组件的控制指令,控制对应的灯光组件进行亮度变化。
在一些实施例中,本实施例生成控制指令的方式包括但不限于如下任一种:
方式1a、自动生成控制指令。该方式可以基于定位信息自动触发生成控制指令,具体情况分为如下两种:
(1)所述智能跟随设备101根据所述目标用户的定位信息,生成所述控制指令。
(2)所述智能跟随设备101根据所述智能跟随设备自身的定位信息,生成所述控制指令。
实施中,当智能跟随设备101检测到目标用户的定位信息后,根据该定位信息和展厅内预设位置之间的距离,生成控制指令;或者根据智能跟随设备101自身的位置和展厅内预设位置之间的距离,生成控制指令。实施中,当该距离小于或等于距离阈值时,生成控制指令。例如,当智能跟随设备101检测到目标用户移动到指定位置时,或,智能跟随设备101自身移动到指定位置时,生成控制指令,控制多个展陈组件实现联动,例如可以控制显示类、 声光电、投影等物联网设备的开关控制,多个播放列表的组合、播放内容切换、播放/暂停、音量增减、快进/快退等。
可选的,在上述两种自动生成控制指令的方式中,目标用户可以是参观展项的第一用户。在智能跟随设备101跟随第一用户移动的过程中,当智能跟随设备101检测到第一用户到达指定位置时,控制展陈组件执行对应的操作;或者,当智能跟随设备101自身到达指定位置时,控制展陈组件执行对应的操作;不论哪种方式都能实现自动控制,无需讲解员操作即可自动控制展陈组件,有效提高了参观体验。
可选的,在上述两种自动生成控制指令的方式中,目标用户也可以是介绍展项的第二用户,具体生成控制指令的方式和目标用户是第一用户时的方式原理相同,此处不再赘述。
方式1b、手动触发生成控制指令。该方式下需要接收到目标用户的第一操作,才可以触发生成控制指令。
可选的,所述智能跟随设备响应于目标用户的第一操作,触发生成所述控制指令。实施中,第一操作可以是对智能跟随设备上的按键、按钮的点击操作,也可以是通过触控显示屏进行的触控操作。
在一些实施例中,本实施例中的智能跟随设备包括触控显示屏,所述控制指令是通过所述触控显示屏接收的触控信号触发生成的。也就是说,目标用户通过触控显示屏进行第一操作,生成触控信号,基于触控信号触发生成控制指令。即触控显示屏接收的触控信号是目标用户进行第一操作生成的。
在一些实施例中,在该手动触发生成控制指令的方式下,目标用户可以是介绍展项的第二用户,在智能跟随设备101跟随第二用户移动的过程中,第二用户通过手动触发的方式,控制展陈组件执行相应的操作,为讲解员提供了一种辅助讲解的方式,提高了讲解效率,提升了讲解效果,从而提高了参观人员的参观体验。
可选的,在该手动触发生成控制指令的方式下,目标用户也可以是参观展项的第一用户,生成控制指令的方式和目标用户是第二用户时生成控制指 令的原理相同,此处不再赘述。
在一些实施例中,本实施例中的控制指令是基于目标用户确定的,具体如下:
方式1)若所述目标用户为第一用户,则所述控制指令包括在所述智能跟随设备进入包含所述展项的展项区时,控制所述智能跟随设备展示与所述展项相关的展项信息的指令;
实施中,若目标用户为第一用户,则控制智能跟随设备跟随第一用户的移动而移动,并且当服务器检测到智能跟随设备的定位信息到达包含展项的展项区时,向智能跟随设备发送控制指令,指示智能跟随设备自动展示与所述展项相关的展项信息的指令,这样当第一用户在没有第二用户进行讲解的情况下,仍旧可以通过智能跟随设备进行展项信息的展示,提高用户的观看体验。
方式2)若所述目标用户为第二用户,则所述控制指令包括响应于第二用户在所述智能跟随设备上触发的操作指令,控制所述智能跟随设备展示与所述操作指令对应的展项信息的指令。
方式3)若所述目标用户为第二用户,则所述控制指令包括响应于第二用户在所述智能跟随设备上触发的操作指令,控制所述展项执行与所述操作指令对应的操作的指令。
实施中,若目标用户为第二用户,则智能跟随设备作为第二用户的辅助讲解设备,可以和第二用户通过交互首先展项信息的展示。当第二用户在所述智能跟随设备上触发操作指令后,智能跟随设备将该操作指令发送给服务器,服务器响应于第二用户在所述智能跟随设备上触发的操作指令,向智能跟随设备发送控制指令,用于指示智能跟随设备展示与所述操作指令对应的展项信息,和/或,向展项发送控制指令,用于指示展项执行与所述操作指令对应的操作。
在一些实施例中,若所述目标用户为第一用户,则向所述智能跟随设备发送所述跟随指令和所述控制指令之前,还可以向所述智能跟随设备发送提 示信息,以提示所述第二用户是否需要切换到自动讲解模式,其中所述自动讲解模式表征通过智能跟随设备自动进行展项信息的展示;其中,提示信息可以通过语音、弹窗等方式发送给第二用户。当第二用户接收到提示信息后,由第二用户决定是否进行切换,切换到智能跟随设备的独立讲解模式,在该独立讲解模式下,智能跟随设备会跟随第一用户移动,并且向第一用户自动展示与展项相关的展项信息。
在一些实施例中,当向所述智能跟随设备发送提示信息之后,还可以接收第二用户基于提示信息在智能跟随设备上触发的切换指令,服务器响应于第二用户基于所述提示信息在所述智能跟随设备上触发的切换指令,向所述智能跟随设备发送所述跟随指令和所述控制指令,以指示所述智能跟随设备跟随所述第一用户移动,并自动进行展项信息的展示。
第2种,对展项信息的智能讲解功能。
在一些实施例中,展项信息包括视频、图片、音频、灯光、投影、文字、语音中的至少一种。
在一些实施例中,展项的展项信息可以理解为一种产品、文物相关的历史信息,包括生产时间或出土时间、产品或文物自身的含义,通过视频、图片、音频、灯光、投影、文字、语音等方式对展项信息进行讲解,便于参观用户理解的同时,也能够更加形象地加深参观人员对该展项的理解,提高参观人员的参观效率和参观体验。
智能跟随设备101还包括发声装置,所述智能跟随设备通过所述发声装置对至少一个展项信息进行智能讲解。
在这种情况下,智能跟随设备101可以对展项信息进行自动讲解,辅助讲解员提供更加智能的讲解方式和讲解场景。
在一些实施例中,智能跟随设备101还可以通过如下任意一种方式确定展项信息并实现智能讲解,具体如下所示:
方式2a、所述智能跟随设备101根据所述目标用户的定位信息确定至少一个展项信息,通过所述发声装置对所述至少一个展项信息进行智能讲解。
可选的,一个展项的展项信息包括一个或多个,本实施例不作过多限定。
可选的,在该方式下,所述目标用户包括参观展项的第一用户。在智能跟随设备101跟随第一用户移动的过程中,当智能跟随设备101到达某个展项的电子围栏检测范围内时,则通过所述发声装置对所述至少一个展项信息进行智能讲解。从而无需讲解员人工讲解,通过对参观人员进行智能讲解的方式,提高用户的参观体验。
实施中,根据第一用户的定位信息确定至少一个展项信息,对该展项信息进行智能讲解。具体的,可以对距离该第一用户的定位信息最近的至少一个展项信息进行智能讲解。也可以对和该第一用户之间的距离在预设范围内的展项的展项信息进行智能讲解。
可选的,在该方式下,所述目标用户也可以包括介绍展项的第二用户。本实施例对此不作过多限定。
方式2b、所述智能跟随设备101根据自身的定位信息确定至少一个展项信息,通过所述发声装置对所述至少一个展项信息进行智能讲解。
可选的,在该方式下,可以对距离该智能跟随设备101自身的定位信息最近的至少一个展项信息进行智能讲解。
在一些实施例中,所述智能跟随设备包括触控显示屏,所述智能跟随设备还用于通过所述触控显示屏进行至少一个展项的展项信息的画面显示。
第3种,所述智能跟随设备101还用于执行多种跟随模式间的切换。
其中,不同跟随模式下所述智能跟随设备101跟随的目标用户的类型是不同的,所述目标用户的分类是根据参观目的、与展项的互动关系以及与展陈组件的互动关系中的至少一种确定的。
在一些实施例中,本实施例中的目标用户可以分为两种,一种是参观展项的第一用户,另一种是介绍展项的第二用户。可选的,对目标用户进行分类的方式可以通过实际需求确定,包括但不限于通过参观目的、与展项的互动关系以及与展陈组件的互动关系中的至少一种确定分类方式。本实施例中的分类方式仅为一种示例,基于同一分类原理的实施方式都属于本公开的保 护范围。
在一些实施例中,本实施例提供至少两种跟随模式,具体如下所示:
模式1)智能跟随设备101跟随第一用户。
在该模式下,智能跟随设备对展项信息执行至少一种智能讲解方式。
在一些实施例中,当所述智能跟随设备跟随的目标用户包括参观展项的第一用户时,所述跟随模式包括所述智能跟随设备对展项信息的至少一种智能讲解方式。
模式2)智能跟随设备101跟随第二用户。
在该模式下,智能跟随设备对展陈组件执行至少一种控制方式。
在一些实施例中,当所述智能跟随设备跟随的目标用户包括介绍展项的第二用户时,所述跟随模式包括所述智能跟随设备对展陈组件的至少一种控制方式。
在一些实施例中,本实施例还可以对目标用户进行更细粒度的分类,提供两种以上的跟随模式,具体可以根据实际需求进行定义,不同种类的目标用户的跟随模式可以是部分不同的,或全部不同,本实施例对此不作过多限定。
实施中,确定使用哪种跟随模式,需要判断智能跟随设备跟随的目标用户是参观展项的用户,还是介绍展项的用户,从而根据判断出的目标用户,可以更加精准地跟随该目标用户的同时控制展陈组件或展项信息执行相应的操作。从而辅助讲解员进行讲解,当确定目标用户是参观展项的第一用户时,跟随参观的第一用户,并自动讲解与展项相关的展项信息,提高用户的参观体验和效果。
在一些实施例中,本实施例可以根据第一用户和第二用户的距离,从所述第一用户和所述第二用户中确定智能跟随设备跟随的目标用户,根据所述目标用户和所述智能跟随设备的定位信息,生成跟随指令,并根据所述目标用户确定控制指令;根据该跟随指令和控制指令,跟随所述目标用户移动,并展示与所述展项相关的展项信息。
本实施例根据第一用户和第二用户的距离,能够得到参观人员和讲解用户的距离,从而当参观人员距讲解用户较远时,将参观人员作为目标用户,控制智能跟随设备跟随参观人员移动,并未参观人员自动展示与展项相关的展示信息,如果将讲解用户作为目标用户,那么控制智能跟随设备跟随讲解用户移动,可以通过讲解用户和智能跟随设备的交互,辅助讲解,提高用户的观看体验。
本实施例在判断出目标用户是参观人员或讲解用户之后,根据目标用户的和智能跟随设备的定位信息,生成控制指令,控制智能跟随设备跟随目标用户移动,同时,根据目标用户确定控制指令,从而控制智能跟随设备进行展项信息的展示。本实施例中的展陈场景智能讲解方法,能够针对不同的目标用户进行自动跟随,并且针对不同的目标用户进行展项信息的展示,有效提高了用户的参观体验。本实施例提供的方法,能够通过智能跟随设备辅助讲解用户更好地进行内容展示、展项控制,解放讲解用户的双手,提升讲解效果,当参观人员众多时,智能跟随设备能够实现独立讲解,确保所有人都接收到讲解信息,减轻讲解用户工作负荷,提高参观人员的参观体验。
在一些实施例中,智能跟随设备通过手动方式触发进行跟随模式间的切换。
可选的,所述智能跟随设备响应于目标用户的第二操作,触发生成切换指令,根据所述切换指令执行多种跟随模式间的切换。其中,手动切换的方式包括对实体按键的手动操作触发进行切换,以及对虚拟按键的手动操作触发进行切换,本实施例对此不作过多限定。可选的,实体按键位于智能跟随设备上,虚拟按键位于智能跟随设备的显示屏上。
可选的,该目标用户可以是第二用户,实施中,当第二用户(讲解员)通过手动方式,进行跟随模式的切换。
可选的,目标用户也可以是第一用户,第一用户也可以通过手动方式,进行跟随模式的切换,本实施例对此不作过多限定。
在一些实施例中,所述智能跟随设备包括触控显示屏,所述切换指令是 通过所述触控显示屏接收的触控信号触发生成的。目标用户通过触控显示屏进行第二操作,生成触控信号(即切换指令)。
在一些实施例中,智能跟随设备可以自动实现跟随模式间的切换。
可选的,所述智能跟随设备根据不同类型的目标用户的定位信息,触发执行多种跟随模式间的切换。
在一些实施例中,所述目标用户包括参观展项的第一用户和介绍展项的第二用户,所述智能跟随设备根据所述第一用户和所述第二用户的定位信息,触发执行多种跟随模式间的切换。
在一些实施例中,根据第一用户的定位信息和所述第二用户的定位信息,确定第一用户和第二用户的距离,根据该距离触发执行跟随模式的切换。实施中,若当前跟随模式为智能跟随设备跟随第二用户,则当该距离大于或等于距离阈值时触发跟随模式切换,转为跟随第一用户,之后,若智能跟随设备跟随第一用户的过程中,检测到该距离小于距离阈值时继续触发跟随模式切换,转为跟随第二用户。
本实施例可以周期对第一用户和第二用户的定位信息进行检测并计算两者之间的距离,从而可以周期检测是否需要进行跟随模式切换。
在一些实施例中,为了更加精确地判断是否进行跟随模式的切换,所述智能跟随设备还可以根据所述第一用户和所述第二用户的定位信息,以及所述第一用户的人群密度信息,触发执行多种跟随模式间的切换。
在一些实施例中,根据第一用户和所述第二用户的定位信息,确定第一用户和第二用户的距离,根据该距离和人群密度信息,触发执行多种跟随模式间的切换。
实施中,若当前跟随模式为智能跟随设备跟随第二用户,则当该距离大于或等于距离阈值且人群密度信息大于或等于密度阈值时,触发跟随模式切换,转为跟随第一用户,之后,若智能跟随设备跟随第一用户的过程中,检测到该距离小于距离阈值且人群密度信息小于密度阈值时继续触发跟随模式切换,转为跟随第二用户。
需要说明的是,本实施例中的上述三种方法之间可以两两进行组合,形成一个新的方案,也可以全部组合形成一个新的方案,还可以独立实施,本实施例对此不作过多限定。
在一些实施例中,本实施例包括但不限于两种讲解模式,一种是辅助讲解模式,在该模式下,确定跟随的目标用户为第二用户,即讲解用户,智能跟随设备可以辅助讲解用户进行展项控制,其中智能跟随设备上的触控显示屏(例如PAD)可取下来使用,便于讲解用户更便捷的操作。在该模式下,讲解用户可以通过智能跟随设备打开该展项的播放控制界面,触发播放按键,从而播放对应该展项的介绍视频、图片、语音等展项信息;讲解用户还可以触发切换播放内容、播放/暂停、音量增减、快进/快退等操作指令,还可以触发显示类、声光电、投影等物联网设备的开关控制;还可以进行场景切换等操作,其中场景定义为多个物联网设备的开关状态和播放列表的组合。
另一种是独立讲解模式,在该模式下,确定跟随的目标用户为第一用户,即参观人员,智能跟随设备自动跟随参观人员,当判断智能跟随设备进入某展项的展项区(如电子围栏范围)内时,自动播放该展项提前设置好的讲解内容。在该模式下,不需要参观人员或讲解人员在智能跟随设备上进行操作,当检测到智能跟随设备进入展项区,则指示智能跟随设备自动展示展项信息,例如自动播放该展项的介绍视频、图片、语音等。
在一些实施例中,本实施例可以通过如下任意一种方式确定跟随的目标用户:
方式1、根据距离确定目标用户。
在一些实施例中,根据第一用户和第二用户的距离,从所述第一用户和所述第二用户中确定智能跟随设备跟随的目标用户。
在一些实施例中,若所述第一用户和所述第二用户的距离高于或等于距离阈值,则将所述第一用户确定为所述目标用户;
若所述第一用户和所述第二用户的距离低于距离阈值,则将所述第二用户确定为所述目标用户。
在一些实施例中,本实施例中的第一用户包括多个,本实施例中的第二用户包括一个,即参观人员包括多个,讲解用户为一个,在该情况下,通过如下方式确定第一用户和第二用户的距离:
1a)计算各个第一用户和第二用户的第一距离,将各个第一距离的平均值作为第一用户和第二用户的距离。
可选的,可以根据定位信息计算第一用户和第二用户的距离,即可以根据第一用户的定位信息和第二用户的定位信息计算。第二用户的定位信息可以通过第二用户佩戴的定位器采集,第一用户的定位信息也可以通过佩戴的定位器采集,还可以通过第一用户的终端设备采集。本实施例对具体采集定位信息的方式不作过多限定。
在一些实施例中,通过如下方式确定所述第一用户和第二用户的距离:
接收所述第一用户发送的定位信息和所述第二用户发送的定位信息;
根据所述第一用户的定位信息和所述第二用户的定位信息,确定所述第一用户和第二用户的距离。可选的,若第一用户包括多个,则计算各个第一用户的定位信息和第二用户的定位信息的第一距离,将各个第一距离的平均值作为第一用户和第二用户的距离。
1b)从展厅的各个区域中,确定出包含最多数量的第一用户的第一区域的中心点,将中心点和第二用户的距离,作为第一用户和第二用户的距离。其中,第二用户的位置可以通过第二用户上报的定位信息确定。
可选的,包含第一用户的区域,可以是不限定区域大小,能够将所有的第一用户都包含的区域,也可以是限定区域大小,并且在该限定区域大小的区域中包含尽可能多的第一用户。本实施例对确定包含第一用户的区域不作过多限定,可以根据实际需求定义确定规则。
可选的,本实施例中的第一区域可以是圆形区域或多边形的闭合区域,本实施例对此不作过多限定。
实施中,可以通过展厅内的摄像装置,采集展厅内各个区域的原始图像,对原始图像进行人脸识别、人体识别、生物识别、人流信息识别中的至少一 种,根据识别结果从采集的原始图像中筛选出包含第一用户的用户图像,从用户图像中确定出包含第一用户的区域。
方式2、根据距离和人群密度确定跟随的目标用户。
在一些实施例中,根据第一用户和第二用户的距离,以及所述第一用户的人群密度信息,从所述第一用户和所述第二用户中确定智能跟随设备跟随的目标用户。其中,第一用户和第二用户的距离的确定方式可以参见上述方式1中的内容,此处不再赘述。
在一些实施例中,若所述距离高于或等于距离阈值,且所述人群密度信息高于或等于密度阈值,则将所述第一用户确定为所述目标用户;
若所述距离低于距离阈值,或所述人群密度信息低于密度阈值,则将所述第二用户确定为所述目标用户。
在一些实施例中,通过如下方式确定所述第一用户的人群密度信息:
从展厅的各个区域中,确定出包含最多数量的第一用户的第一区域,其中所述第一区域的大小是固定的;根据所述第一区域内包含的第一用户的数量,确定所述第一用户的人群密度信息。例如,第一区域为在2米半径的圆形区域。
本实施例是通过在固定大小的第一区域内包含的第一用户的数量,来确定该第一用户的人群密度信息,例如参观人员在参观过程中,大部分的参观人员都集中在固定大小的第一区域内,少部分的参观人员在第一区域以外,或者,所有的参观人员都集中在固定大小的第一区域内,那么根据第一区域内的参观人员的数量,能够估计出第一区域内的人群密度信息。
在一些实施例中,通过如下任意一种方式确定第一用户的人群密度信息:
2a)获取展厅内与各个区域相关的区域图像,对所述区域图像进行识别,根据识别结果确定出包含最多数量的第一用户的第一区域;
可选的,可以对展厅内的各个区域进行扫描,得到区域图像,对所述区域图像进行识别,得到包含第一用户的区域图像,根据各个包含第一用户的区域图像,确定出展厅内包含最多数量的第一用户的第一区域;还可以根据 展厅内设置的摄像装置实现展厅内部的扫描,例如根据展厅内各个角度、各个方位、各个区域内设置的摄像装置拍摄展厅内部的原始图像,将原始图像作为区域图像;还可以利用摄像装置周期对展厅内部进行扫描拍摄,得到区域图像,其中区域图像包括多张,各个区域图像的拍摄角度、拍摄区域都存在差异,本实施例对具体如何获取区域图像不作过多限定。得到区域图像后,对区域图像进行人脸识别、人体识别、人流信息识别、生物识别中的至少一种。
2b)接收展厅内与各个区域相关的定位信息,根据接收的定位信息中第一用户的定位信息,确定出包含最多数量的第一用户的第一区域。
可选的,对展厅内的定位信息进行扫描,得到各个区域相关的定位信息,各个区域相关的定位信息中确定出第一用户的定位信息,根据接收的展厅内的第一用户的定位信息,确定出包含最多数量的第一用户的第一区域。
在一些实施例中,还可以通过如下步骤确定第一用户和第二用户的距离:
(1)接收所述第二用户发送的定位信息;
(2)将包含最多数量的第一用户的第一区域的中心点,和所述定位信息的距离,确定为所述第一用户和所述第二用户的距离。
实施中,通过区域图像识别的方式确定出包含最多数量的第一用户的第一区域之后,可以通过第一区域内的第一用户的数量确定第一用户的人群密度信息,以及根据第一区域的中心点和第二用户的定位信息的距离,确定出第一用户和第二用户的距离。从而根据人群密度信息和距离,从第一用户和第二用户中确定出跟随的目标用户,从而确定出当前的跟随模式。
如图2所示,本实施例提供的一种人群密度计算和距离计算的示意图。例如,第一区域为2米半径的圆形区域,密度阈值为在2米半径的圆形区域内聚集10个人,距离阈值为8米。计算第一区域为2米半径的圆形区域内的第一用户的数量是否大于或等于10,以及计算圆形区域的中心点到第二用户的距离是否大于或等于8米,如果都满足,则确定跟随的目标用户为第一用户,即确定跟随模式为跟随第一用户的模式,否则确定跟随的目标用户为第 二用户,即确定跟随模式为跟随第二用户的模式。
在一些实施例中,在确定出跟随的目标用户为第一用户或第二用户之后,根据目标用户的不同确定对应的定位信息,具体实施如下:
当目标用户为第二用户时,接收所述第二用户的定位信息,将所述第二用户的定位信息,确定为所述目标用户的定位信息。
由于第二用户为讲解用户,讲解用户通常为一个,则可以根据讲解用户的定位信息,确定目标用户的定位信息,以用户智能跟随设备实现跟随移动的功能。需要说明的是,由于第二用户在移动过程中,定位信息也不断变化,因此目标用户的定位信息也随着第二用户的移动而不断移动。
当目标用户为第一用户时,通过如下任意一种方式确定定位信息:
方式(1)将包含最多数量的第一用户的第一区域的中心点,确定为所述目标用户的定位信息。
该方式下,如果包含最多数量的第一用户的第一区域中第一用户的数量为1个,则还可以将该第一区域中第一用户所在的位置作为目标用户的定位信息。
需要说明的是,随着第一用户的移动,包含最多数量的第一用户的第一区域的中心点也是移动的,因此目标用户的定位信息也是随着第一用户的移动而移动。
方式(2)接收所述第一用户的定位信息,根据所述第一用户的定位信息确定所述目标用户的定位信息。
这种方式下,如果第一用户包括多个,则可以从多个第一用户的定位信息中选取一个定位信息作为目标用户的定位信息,选取的规则可以是选取距离第二用户的位置最远的定位信息作为目标用户的定位信息;也可以在展厅中包含最多定位信息的第一区域内,随机选取一个定位信息作为目标用户的定位信息,其中第一区域的大小是固定的;还可以计算定位信息的平均值,将该平均值作为目标用户的定位信息,其中计算定位信息的平均值,可以是计算全部的定位信息的平均值,也可以是去除最大值和最小值之后的定位信 息的平均值,本实施例对此不作过多限定。
在一些实施例中,确定目标用户,以及目标用户的定位信息之后,根据不同的目标用户生成对应的跟随指令,确定对应的控制指令,从而指示智能跟随设备跟随目标用户移动,并展示与展项相关的展示信息,提高用户的参观体验。
在一些实施例中,通过如下方式生成跟随指令:
根据所述目标用户和所述智能跟随设备的定位信息之间的最短路径,以及所述目标用户和所述智能跟随设备的定位信息的间距,生成跟随指令,以指示所述智能跟随设备在所述最短路径上移动,并保证所述间距满足预设范围。
实施中,确定目标用户和智能跟随设备的定位信息之后,可以确定两个定位信息之间的最短可行驶路径,例如,预先获取展厅室内建筑结构图,根据目标用户在展厅中的位置,以及智能跟随设备在展厅中的位置,确定出展厅内两者之间的最短路径。确定出最短路径之后,还可以根据目标用户和定位信息之间的间距,指示智能跟随设备和目标用户保持间距在预设范围内,例如,控制智能跟随设备跟随目标用户移动,并且和目标用户之间的间距维持在预设范围内,这样既能起到跟随的作用,还不会影响目标用户的移动。
在一些实施例中,本实施例还提供一种对最短路径进行更新的方法,具体实施时,在确定最短路径之后,还可以实时判断最短路径上是否存在障碍物,若在所述最短类路径上检测到障碍物,则根据所述最短路径上的障碍物位置信息,对所述最短路径进行更新,根据所述更新后的最短路径指示所述智能跟随设备在移动时避开所述障碍物。
实施中,当在最短路径上检测到障碍物时,对障碍物处的路径进行重新规划,计算在障碍物处的转向和转向方向的行驶路线,以转向后的位置为起点重新规划最短路径,并利用重新规划后的最短路径指示智能跟随设备在最短路径上移动的过程中能够及时避开障碍物。
如图3所示,本实施例提供的一种更新最短路径的示意图,智能跟随设 备跟随目标用户在最短路径(目标用户和智能跟随设备的位置之间的直线段)上移动,当遇到障碍物时转向躲避,转向后重新计算与目标用户的最短路径,以此类推。
在一些实施例中,本实施例所述智能跟随设备还用于当目标用户停止移动时停止跟随,并确定停止跟随时自身的站位信息。
在一些实施例中,所述智能跟随设备通过如下步骤确定停止跟随时自身的站位信息:
1)所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段;
在一些实施例中,所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的边缘位置,确定最短线段。可选的,目标用户包括参观展项的第一用户或者介绍展项的第二用户。
可选的,可以将目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的边缘位置之间的连线,作为最短线段;还可以将目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的边缘位置之间的实际可行驶路径中的最短路径,作为最短线段。
可选的,展项的边缘位置包括但不限于最接近目标用户的边缘的边缘位置。
在一些实施例中,所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的中心位置,确定最短线段。可选的,目标用户包括参观展项的第一用户或者介绍展项的第二用户。
2)所述智能跟随设备将所述停止移动时的定位信息作为中心,确定预设区域;可选的,预设区域可以是圆形区域,或多边形的闭合区域,本实施例对此不作过多限定。
3)所述智能跟随设备根据所述最短线段和所述预设区域的交叉点,以及自身相对于所述目标用户的朝向,确定停止跟随时自身的站位信息。
可选的,智能跟随设备停止跟随时自身面向目标用户,若智能跟随设备 包括触控显示屏,则智能跟随设备停止跟随时该触控显示屏正对目标用户。
如图4所示,本实施例提供的一种目标用户为第一用户时确定站位信息的示意图,其中,确定包含最多数量的第一用户的第一区域的中心点,第一区域为半径2米的圆形区域,站位信息是中心点和展项中心点的连线与圆形区域的边界的交叉点。
如图5所示,本实施例提供的一种目标用户为第二用户时确定站位信息的示意图,其中,确定第二用户的定位信息,以定位信息为中心,以2米为半径确定圆形区域,站位信息是定位信息和展项边缘位置的连线与圆形区域的边界的交叉点。其中展项的边缘位置是最靠近讲解用户的展项的边缘的边缘位置。
在一些实施例中,本实施例使用的定位技术包括但不限于室内定位技术,例如室内蓝牙精准定位技术,蓝牙AOA技术,定位精度能达到0.5m以内。本实施例中的定位方式包括但不限于如下任意一种:
第1种定位方式、定位器定位。
在一些实施例中,本实施例中的定位装置包括定位器,所述定位装置通过如下方式确定所述目标用户的定位信息:
所述定位装置通过所述目标用户携带的定位器,确定所述目标用户的定位信息。
可选的,定位器为室内蓝牙定位器。
可选的,该方式下,所述目标用户包括介绍展项的第二用户。所述定位装置通过所述目标用户携带的定位器,确定所述第二用户的定位信息。
在一些实施例中,所述目标用户包括多个,所述定位装置通过所述目标用户携带的定位器,确定所述目标用户的定位信息,包括:
所述定位装置根据多个目标用户携带的定位器,确定包含多个目标用户的区域;所述定位装置根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的定位器,确定所述目标用户的定位信息。
可选的,所述目标用户包括参观展项的第一用户。所述定位装置根据多 个第一用户携带的定位器,确定包含多个第一用户的区域;根据所述区域的中心点,或,距离所述区域中心点最近的第一用户的定位器,确定所述第一用户的定位信息。
在一些实施例中,该定位方式下,还用于通过如下方式确定人群密度信息:
所述定位装置根据所述区域的大小,以及在所述区域内检测到的定位器的数量,确定所述第一用户的人群密度信息。
第2种定位方式、摄像头定位。
在一些实施例中,所述定位装置包括摄像组件,所述定位装置通过如下方式确定所述目标用户的定位信息:
所述定位装置根据摄像组件采集的目标用户的图像,确定所述目标用户的定位信息。
在一些实施例中,所述目标用户包括多个,所述定位装置对摄像组件采集的包含多个目标用户的图像进行识别,确定包含多个目标用户的区域;所述定位装置根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的位置,确定所述目标用户的定位信息。
其中,所述距离所述区域中心点最近的目标用户的位置是对包含多个目标用户的图像进行识别得到的。
可选的,所述目标用户包括参观展项的第一用户。所述定位装置对摄像组件采集的包含多个第一用户的图像进行识别,确定包含多个第一用户的区域;所述定位装置根据所述区域的中心点,或,距离所述区域中心点最近的第一用户的位置,确定所述第一用户的定位信息。
在一些实施例中,该定位方式下,还用于通过如下方式确定人群密度信息:
所述定位装置根据所述区域的大小,以及在所述区域内识别出的第一用户的数量,确定所述第一用户的人群密度信息。
第3种定位方式、定位器定位结合摄像头定位。
在该种方式下,可以使用定位器确定第二用户的定位信息,使用摄像头定位确定第一用户的定位信息。也可以使用定位器确定第一用户的定位信息,使用摄像头定位确定第二用户的定位信息。本实施例对此不作过多限定。具体的定位器定位方式和摄像头定位方式可以参见上述两种定位方式的说明,此处不再赘述。
在一些实施例中,本实施例还提供如下任意一种对智能跟随设备进行定位的方法:
定位方法1)定位器定位。
所述定位装置包括定位器,所述定位装置还用于通过如下方式确定所述智能跟随设备的定位信息:
所述定位装置根据所述智能跟随设备携带的定位器,确定所述智能跟随设备的定位信息。
定位方法2)摄像头定位。
所述定位装置包括摄像组件,所述定位装置还用于通过如下方式确定所述智能跟随设备的定位信息:
所述定位装置对摄像组件采集的包含所述智能跟随设备的图像进行识别,确定所述智能跟随设备的定位信息。
如图6所示,为本公开实施例还提供一种智能跟随设备的结构示意图,包括显示器600、显示器底座601、主机箱602和滚轮603。
其中显示器600可以取下,显示器600包括触控显示屏,例如具有触控功能的电子平板等电子显示装置。
主机箱602由控制器、驱动装置等其他基础模块构成。
在一些实施例中,本实施例中的智能跟随设备包括控制器(如服务器)和跟随器,其中,服务器用于实现定位、数据处理、信号收发等功能,跟随器用于实现跟随。下面以智能跟随设备包括服务器和跟随器为例,对服务器和跟随器间的交互进行说明。
如图7所示,本实施例提供一种智能跟随设备中的模块间的交互流程, 具体如下所示:
步骤700、服务器根据第一用户和第二用户的距离,从所述第一用户和所述第二用户中确定目标用户;
其中所述第一用户表征参观展项的用户,所述第二用户表征介绍展项的用户;
步骤701、服务器根据所述目标用户的定位信息和跟随器的定位信息,生成跟随指令;
步骤702、向跟随器发送所述跟随指令,以控制所述跟随器跟随所述目标用户移动。
步骤703、跟随器接收服务器发送的跟随指令;
步骤704、跟随器根据所述跟随指令确定移动路径,并按所述移动路径跟随所述目标用户移动。
可选的,还可以根据目标用户确定控制指令,向跟随器发送控制指令,控制跟随器展示与所述展项相关的展项信息;和/或,向至少一个展陈组件发送控制指令,控制展陈组件执行对应的操作。
如图8所示,以跟随目标为第二用户为例,本公开实施例提供了一种展陈场景辅助智能讲解的方法,该方法的实施流程具体如下所示:
步骤800、服务器从展厅的各个区域,确定出包含最多数量的第一用户的第一区域,根据第一区域内包含的第一用户的数量,确定第一用户的人群密度信息;
其中所述第一区域的大小是固定的;
步骤801、服务器接收所述第二用户发送的定位信息;计算包含最多数量的第一用户的第一区域的中心点和定位信息的距离;
步骤802、若所述距离低于距离阈值,或所述人群密度信息低于密度阈值,则服务器将所述第二用户确定为所述目标用户;
步骤803、服务器根据第二用户和跟随器的定位信息之间的最短路径,以及第二用户和跟随器的定位信息的间距,生成跟随指令;
步骤804、向第二用户发送跟随指令和控制指令。
其中,控制指令包括对展陈组件和/或展项的展项信息的控制指令。
如图9所示,以跟随目标为第一用户为例,本公开实施例提供了一种展陈场景独立智能讲解的方法,该方法的实施流程具体如下所示:
步骤900、服务器从展厅的各个区域,确定出包含最多数量的第一用户的第一区域,根据第一区域内包含的第一用户的数量,确定第一用户的人群密度信息;
其中所述第一区域的大小是固定的;
步骤901、服务器接收所述第二用户发送的定位信息;计算包含最多数量的第一用户的第一区域的中心点和定位信息的距离;
步骤902、若所述距离高于或等于距离阈值,且所述人群密度信息高于或等于密度阈值,则服务器将所述第一用户确定为所述目标用户;
步骤903、服务器将包含最多数量的第一用户的第一区域的中心点,确定为所述目标用户的定位信息。
步骤904、服务器向所述跟随器发送提示信息,以提示所述第二用户是否需要切换到自动讲解模式;
其中所述自动讲解模式表征通过跟随器自动进行展项信息的展示;
步骤905、服务器响应于第二用户基于提示信息在跟随器上触发的切换指令,向跟随器发送跟随指令和控制指令。
本实施例可以指示跟随器跟随所述第一用户移动,并自动进行展项信息的展示,和/或,展陈组件的自动控制。
其中,根据所述目标用户和所述跟随器的定位信息之间的最短路径,以及所述目标用户和所述跟随器的定位信息的间距,生成跟随指令。保证跟随器在跟随目标用户的过程中,和目标用户一直保持一定的距离,其中,控制指令包括对展陈组件和/或展项的展项信息的控制指令。
如图10所示,本实施例还提供一种辅助讲解模式的示意图,其中,智能跟随设备包括服务器和跟随器,在该模式下,跟随的目标用户为第二用户即 讲解用户,讲解用户佩戴定位器,上报自身的定位信息到蓝牙信标,同时,跟随器上报自身的定位信息到蓝牙信标,蓝牙信标将讲解用户的定位信息发送给服务器,服务器根据上报的定位信息生成跟随指令,将跟随指令发送给智跟随器,以指示跟随器跟随讲解用户移动,讲解用户还可以对跟随器显示的与展项相关的内容进行触控操作,第二用户在所述跟随器上触发操作指令,跟随器将操作指令发送给服务器,服务器根据接收到的操作指令,触发生成控制指令,并将控制指令发送给跟随器和展陈组件,以指示跟随器和展陈组件执行对应的操作。
本实施例中的跟随器包括触控显示屏,该触控显示屏是可拆卸的。
如图11所示,本实施例还提供一种独立讲解模式的示意图,其中,智能跟随设备包括服务器和跟随器,在该模式下,跟随的目标用户为第一用户即参观用户,实施中,可以从参观用户中选择一个目标参观用户,根据目标参观用户佩戴的定位器,上报目标参观用户的定位信息到蓝牙信标,同时,跟随器上报自身的定位信息到蓝牙信标,蓝牙信标将目标参观用户的定位信息(作为第一用户的定位信息)发送给服务器,服务器根据上报的定位信息生成跟随指令,将跟随指令发送给跟随器,以指示跟随器跟随第一用户移动,并且当检测到跟随器进入某个展项的电子围栏区域内后,向跟随器发送控制指令,控制跟随器自动展示该展项相关的展项信息。
基于相同的发明构思,本公开实施例还提供了一种展陈场景智能讲解的方法,可以应用于智能跟随设备,该方法的实施原理和上述系统的实施的原理相同,具体的实施方式可参见上述内容,此处不再赘述。
如图12所示,本实施例还提供一种展陈场景智能讲解的方法,该方法的具体实施流程如下所示:
步骤1200、确定目标用户的定位信息;
步骤1201、根据所述目标用户的定位信息,跟随所述目标用户移动。
作为一种可选的实施方式,还包括:
生成控制指令,并根据生成的控制指令,对至少一个展陈组件进行对应的控制。
作为一种可选的实施方式,还包括:
对至少一个展项的展项信息进行智能讲解。
作为一种可选的实施方式,还包括:
执行多种跟随模式间的切换;其中不同跟随模式下跟随的目标用户的类型是不同的,所述目标用户的分类是根据参观目的、与展项的互动关系以及与展陈组件的互动关系中的至少一种确定的。
作为一种可选的实施方式,还包括:
当目标用户停止移动时停止跟随,并确定停止跟随时自身的站位信息。
作为一种可选的实施方式,通过如下方式生成控制指令:
根据所述目标用户的定位信息,生成所述控制指令;或,
根据自身的定位信息,生成所述控制指令。
作为一种可选的实施方式,所述对至少一个展项的展项信息进行智能讲解,包括:
根据所述目标用户的定位信息确定至少一个展项,对所述至少一个展项的展项信息进行智能讲解;或,
根据自身的定位信息确定至少一个展项,对所述至少一个展项的展项信息进行智能讲解。
作为一种可选的实施方式,当跟随的目标用户包括参观展项的第一用户时,所述跟随模式包括对展项信息的至少一种智能讲解方式。
作为一种可选的实施方式,所述确定停止跟随时自身的站位信息,包括:
根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段;
将所述停止移动时的定位信息作为中心,确定预设区域;
根据所述最短线段和所述预设区域的交叉点,以及自身相对于所述目标用户的朝向,确定停止跟随时自身的站位信息。
作为一种可选的实施方式,所述根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段,包括:
根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的边缘位置,确定最短线段。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户。
作为一种可选的实施方式,所述响应于目标用户的第一操作,触发生成所述控制指令。
作为一种可选的实施方式,所述执行多种跟随模式间的切换,包括:
响应于目标用户的第二操作,触发生成切换指令,根据所述切换指令执行多种跟随模式间的切换。
作为一种可选的实施方式,所述根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段,包括:
根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的中心位置,确定最短线段。
作为一种可选的实施方式,所述目标用户包括介绍展项的第二用户。
作为一种可选的实施方式,当跟随的目标用户包括介绍展项的第二用户时,所述跟随模式包括对展陈组件的至少一种控制方式。
作为一种可选的实施方式,所述执行多种跟随模式间的切换,包括:
根据不同类型的目标用户的定位信息,触发执行多种跟随模式间的切换。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户和介绍展项的第二用户,根据不同类型的目标用户的定位信息,触发执行多种跟随模式间的切换,包括:
根据所述第一用户和所述第二用户的定位信息,触发执行多种跟随模式间的切换。
作为一种可选的实施方式,所述根据所述第一用户和所述第二用户的定位信息,触发执行多种跟随模式间的切换,包括:
根据所述第一用户和所述第二用户的定位信息,以及所述第一用户的人 群密度信息,触发执行多种跟随模式间的切换。
作为一种可选的实施方式,所述控制指令是通过触控显示屏接收的触控信号触发生成的。
作为一种可选的实施方式,所述切换指令是通过触控显示屏接收的触控信号触发生成的。
作为一种可选的实施方式,还包括:
通过触控显示屏进行至少一个展项的展项信息的画面显示。
作为一种可选的实施方式,通过如下方式确定所述目标用户的定位信息:
通过所述目标用户携带的定位器,确定所述目标用户的定位信息。
作为一种可选的实施方式,所述目标用户包括介绍展项的第二用户。
作为一种可选的实施方式,所述目标用户包括多个,所述通过所述目标用户携带的定位器,确定所述目标用户的定位信息,包括:
根据多个目标用户携带的定位器,确定包含多个目标用户的区域;
根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的定位器,确定所述目标用户的定位信息。
作为一种可选的实施方式,通过如下方式确定所述目标用户的定位信息:
根据摄像组件采集的目标用户的图像,确定所述目标用户的定位信息。
作为一种可选的实施方式,所述目标用户包括多个,所述根据摄像组件采集的目标用户的图像,确定所述目标用户的定位信息,包括:
对摄像组件采集的包含多个目标用户的图像进行识别,确定包含多个目标用户的区域;
根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的位置,确定所述目标用户的定位信息,其中,所述距离所述区域中心点最近的目标用户的位置是对包含多个目标用户的图像进行识别得到的。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户时,通过如下方式确定所述第一用户的人群密度信息:
根据所述区域的大小,以及在所述区域内检测到的定位器的数量,确定所述第一用户的人群密度信息。
作为一种可选的实施方式,所述目标用户包括参观展项的第一用户时,通过如下方式确定所述第一用户的人群密度信息:
根据所述区域的大小,以及在所述区域内识别出的第一用户的数量,确定所述第一用户的人群密度信息。
作为一种可选的实施方式,通过如下方式确定自身的定位信息:
根据自身携带的定位器,确定自身的定位信息。
作为一种可选的实施方式,通过如下方式确定自身的定位信息:
对摄像组件采集的包含自身的图像进行识别,确定自身的定位信息。
作为一种可选的实施方式,所述展项信息包括视频、图片、音频、灯光、投影中的至少一种。
作为一种可选的实施方式,所述控制指令包括播放切换、暂停、音量调节、播放进度调节、开关控制中的至少一种。
作为一种可选的实施方式,所述展陈组件包括显示组件、灯光组件、智能空调设备、智能物联网设备中的至少一种。
基于相同的发明构思,本公开实施例还提供了一种展陈场景智能讲解的装置,由于该装置即是本公开实施例中的方法中的装置,并且该装置解决问题的原理与该方法相似,因此该装置的实施可以参见方法的实施,重复之处不再赘述。
如图13所示,该装置包括:
确定定位单元1300,用于确定目标用户的定位信息;
跟随移动单元1301,用于根据所述目标用户的定位信息,跟随所述目标用户移动。
基于相同的发明构思,本公开实施例还提供了一种计算机存储介质,其上存储有计算机程序,该程序被处理器执行时实现如下步骤:
确定目标用户的定位信息;
根据所述目标用户的定位信息,跟随所述目标用户移动。
本领域内的技术人员应明白,本公开的实施例可提供为方法、系统、或计算机程序产品。因此,本公开可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本公开可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
本公开是参照根据本公开实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的设备。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令设备的制造品,该指令设备实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
显然,本领域的技术人员可以对本公开进行各种改动和变型而不脱离本公开的精神和范围。这样,倘若本公开的这些修改和变型属于本公开权利要求及其等同技术的范围之内,则本公开也意图包含这些改动和变型在内。

Claims (48)

  1. 一种展陈场景智能讲解的系统,其中,该系统包括定位装置、智能跟随设备,其中:
    所述定位装置,用于确定目标用户的定位信息;
    所述智能跟随设备,用于根据所述目标用户的定位信息,跟随所述目标用户移动。
  2. 根据权利要求1所述的系统,其中,
    所述智能跟随设备还用于生成控制指令,并根据生成的控制指令,对至少一个展陈组件进行对应的控制。
  3. 根据权利要求1所述的系统,其中,
    所述智能跟随设备还包括发声装置,所述智能跟随设备通过所述发声装置对至少一个展项的展项信息进行智能讲解。
  4. 根据权利要求1所述的系统,其中,
    所述智能跟随设备还用于执行多种跟随模式间的切换;其中不同跟随模式下所述智能跟随设备跟随的目标用户的类型是不同的,所述目标用户的分类是根据参观目的、与展项的互动关系以及与展陈组件的互动关系中的至少一种确定的。
  5. 根据权利要求1~4任一所述的系统,其中,
    所述智能跟随设备还用于当目标用户停止移动时停止跟随,并确定停止跟随时自身的站位信息。
  6. 根据权利要求2所述的系统,其中,通过如下方式生成控制指令:
    所述智能跟随设备根据所述目标用户的定位信息,生成所述控制指令;或,
    所述智能跟随设备根据所述智能跟随设备自身的定位信息,生成所述控制指令。
  7. 根据权利要求3所述的系统,其中,所述智能跟随设备通过所述发声 装置对至少一个展项的展项信息进行智能讲解,包括:
    所述智能跟随设备根据所述目标用户的定位信息确定至少一个展项,通过所述发声装置对所述至少一个展项的展项信息进行智能讲解;或,
    所述智能跟随设备根据自身的定位信息确定至少一个展项,通过所述发声装置对所述至少一个展项的展项信息进行智能讲解。
  8. 根据权利要求4所述的系统,其中,
    当所述智能跟随设备跟随的目标用户包括参观展项的第一用户时,所述跟随模式包括所述智能跟随设备对展项信息的至少一种智能讲解方式。
  9. 根据权利要求5所述的系统,其中,所述智能跟随设备确定停止跟随时自身的站位信息,包括:
    所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段;
    所述智能跟随设备将所述停止移动时的定位信息作为中心,确定预设区域;
    所述智能跟随设备根据所述最短线段和所述预设区域的交叉点,以及自身相对于所述目标用户的朝向,确定停止跟随时自身的站位信息。
  10. 根据权利要求9所述的系统,其中,所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段,包括:
    所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的边缘位置,确定最短线段。
  11. 根据权利要求6~7、10任一所述的系统,其中,所述目标用户包括参观展项的第一用户。
  12. 根据权利要求2所述的系统,其中,
    所述智能跟随设备响应于目标用户的第一操作,触发生成所述控制指令。
  13. 根据权利要求4所述的系统,其中,所述智能跟随设备执行多种跟随模式间的切换,包括:
    所述智能跟随设备响应于目标用户的第二操作,触发生成切换指令,根据所述切换指令执行多种跟随模式间的切换。
  14. 根据权利要求9所述的系统,其中,所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项,确定最短线段,包括:
    所述智能跟随设备根据所述目标用户停止移动时的定位信息,以及与所述定位信息距离最近的展项的中心位置,确定最短线段。
  15. 根据权利要求12~14任一所述的系统,其中,所述目标用户包括介绍展项的第二用户。
  16. 根据权利要求4所述的系统,其中,
    当所述智能跟随设备跟随的目标用户包括介绍展项的第二用户时,所述跟随模式包括所述智能跟随设备对展陈组件的至少一种控制方式。
  17. 根据权利要求4所述的系统,其中,所述智能跟随设备执行多种跟随模式间的切换,包括:
    所述智能跟随设备根据不同类型的目标用户的定位信息,触发执行多种跟随模式间的切换。
  18. 根据权利要求17所述的系统,其中,所述目标用户包括参观展项的第一用户和介绍展项的第二用户,所述智能跟随设备根据不同类型的目标用户的定位信息,触发执行多种跟随模式间的切换,包括:
    所述智能跟随设备根据所述第一用户和所述第二用户的定位信息,触发执行多种跟随模式间的切换。
  19. 根据权利要求18所述的系统,其中,所述智能跟随设备根据所述第一用户和所述第二用户的定位信息,触发执行多种跟随模式间的切换,包括:
    所述智能跟随设备根据所述第一用户和所述第二用户的定位信息,以及所述第一用户的人群密度信息,触发执行多种跟随模式间的切换。
  20. 根据权利要求2或12所述的系统,其中,所述智能跟随设备包括触控显示屏,所述控制指令是通过所述触控显示屏接收的触控信号触发生成的。
  21. 根据权利要求13所述的系统,其中,所述智能跟随设备包括触控显示屏,所述切换指令是通过所述触控显示屏接收的触控信号触发生成的。
  22. 根据权利要求3、7~8任一所述的系统,其中,所述智能跟随设备包括触控显示屏,所述智能跟随设备还用于通过所述触控显示屏进行至少一个展项的展项信息的画面显示。
  23. 根据权利要求1、6~7、9~10、14、17~19任一所述的系统,其中,所述定位装置包括定位器,所述定位装置通过如下方式确定所述目标用户的定位信息:
    所述定位装置通过所述目标用户携带的定位器,确定所述目标用户的定位信息。
  24. 根据权利要求23所述的系统,其中,所述目标用户包括介绍展项的第二用户。
  25. 根据权利要求23所述的系统,其中,所述目标用户包括多个,所述定位装置通过所述目标用户携带的定位器,确定所述目标用户的定位信息,包括:
    所述定位装置根据多个目标用户携带的定位器,确定包含多个目标用户的区域;
    所述定位装置根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的定位器,确定所述目标用户的定位信息。
  26. 根据权利要求1、6~7、9~10、14、17~19任一所述的系统,其中,所述定位装置包括摄像组件,所述定位装置通过如下方式确定所述目标用户的定位信息:
    所述定位装置根据摄像组件采集的目标用户的图像,确定所述目标用户的定位信息。
  27. 根据权利要求26所述的系统,其中,所述目标用户包括多个,所述定位装置根据摄像组件采集的目标用户的图像,确定所述目标用户的定位信息,包括:
    所述定位装置对摄像组件采集的包含多个目标用户的图像进行识别,确定包含多个目标用户的区域;
    所述定位装置根据所述区域的中心点,或,距离所述区域中心点最近的目标用户的位置,确定所述目标用户的定位信息,其中,所述距离所述区域中心点最近的目标用户的位置是对包含多个目标用户的图像进行识别得到的。
  28. 根据权利要求25或27所述的系统,其中,所述目标用户包括参观展项的第一用户。
  29. 根据权利要求25所述的系统,其中,所述目标用户包括参观展项的第一用户时,所述定位装置还用于通过如下方式确定所述第一用户的人群密度信息:
    所述定位装置根据所述区域的大小,以及在所述区域内检测到的定位器的数量,确定所述第一用户的人群密度信息。
  30. 根据权利要求27所述的系统,其中,所述目标用户包括参观展项的第一用户时,所述定位装置通过如下方式确定所述第一用户的人群密度信息:
    所述定位装置根据所述区域的大小,以及在所述区域内识别出的第一用户的数量,确定所述第一用户的人群密度信息。
  31. 根据权利要求6或7所述的系统,其中,所述定位装置包括定位器,所述定位装置还用于通过如下方式确定所述智能跟随设备的定位信息:
    所述定位装置根据所述智能跟随设备携带的定位器,确定所述智能跟随设备的定位信息。
  32. 根据权利要求6或7所述的系统,其中,所述定位装置包括摄像组件,所述定位装置还用于通过如下方式确定所述智能跟随设备的定位信息:
    所述定位装置对摄像组件采集的包含所述智能跟随设备的图像进行识别,确定所述智能跟随设备的定位信息。
  33. 根据权利要求3、7~8任一所述的系统,其中,所述展项信息包括视频、图片、音频、灯光、投影中的至少一种。
  34. 根据权利要求2、6或12所述的系统,其中,所述控制指令包括播 放切换、暂停、音量调节、播放进度调节、开关控制中的至少一种。
  35. 根据权利要求2、4或16所述的系统,其中,所述展陈组件包括显示组件、灯光组件、智能空调设备、智能物联网设备中的至少一种。
  36. 一种展陈场景智能讲解的方法,其中,该方法包括:
    确定目标用户的定位信息;
    根据所述目标用户的定位信息,跟随所述目标用户移动。
  37. 根据权利要求36所述的方法,其中,还包括:
    生成控制指令,并根据生成的控制指令,对至少一个展陈组件进行对应的控制。
  38. 根据权利要求36所述的方法,其中,还包括:
    对至少一个展项的展项信息进行智能讲解。
  39. 根据权利要求36所述的方法,其中,还包括:
    执行多种跟随模式间的切换;其中不同跟随模式下跟随的目标用户的类型是不同的,所述目标用户的分类是根据参观目的、与展项的互动关系以及与展陈组件的互动关系中的至少一种确定的。
  40. 根据权利要求36~39任一所述的方法,其中,还包括:
    当目标用户停止移动时停止跟随,并确定停止跟随时自身的站位信息。
  41. 根据权利要求37所述的方法,其中,通过如下方式生成控制指令:
    根据所述目标用户的定位信息,生成所述控制指令;或,
    根据自身的定位信息,生成所述控制指令。
  42. 根据权利要求38所述的方法,其中,所述对至少一个展项的展项信息进行智能讲解,包括:
    根据所述目标用户的定位信息确定至少一个展项,对所述至少一个展项的展项信息进行智能讲解;或,
    根据自身的定位信息确定至少一个展项,对所述至少一个展项的展项信息进行智能讲解。
  43. 根据权利要求37所述的方法,其中,通过如下方式生成控制指令:
    响应于目标用户的第一操作,触发生成所述控制指令。
  44. 根据权利要求39所述的方法,其中,所述执行多种跟随模式间的切换,包括:
    响应于目标用户的第二操作,触发生成切换指令,根据所述切换指令执行多种跟随模式间的切换。
  45. 根据权利要求39所述的方法,其中,所述执行多种跟随模式间的切换,包括:
    根据不同类型的目标用户的定位信息,触发执行多种跟随模式间的切换。
  46. 根据权利要求36、41、42或45所述的方法,其中,通过如下方式确定所述目标用户的定位信息:
    通过所述目标用户携带的定位器,确定所述目标用户的定位信息。
  47. 根据权利要求36、41、42或45所述的方法,其中,通过如下方式确定所述目标用户的定位信息:
    根据摄像组件采集的目标用户的图像,确定所述目标用户的定位信息。
  48. 一种计算机存储介质,其上存储有计算机程序,其中,该程序被处理器执行时实现如权利要求36~47任一所述方法的步骤。
PCT/CN2022/078385 2022-02-28 2022-02-28 一种展陈场景智能讲解的系统及其方法 WO2023159591A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US18/018,903 US20240272648A1 (en) 2022-02-28 2022-02-28 System and method for intelligently interpreting exhibition scene
CN202280000345.XA CN117178241A (zh) 2022-02-28 2022-02-28 一种展陈场景智能讲解的系统及其方法
PCT/CN2022/078385 WO2023159591A1 (zh) 2022-02-28 2022-02-28 一种展陈场景智能讲解的系统及其方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/078385 WO2023159591A1 (zh) 2022-02-28 2022-02-28 一种展陈场景智能讲解的系统及其方法

Publications (1)

Publication Number Publication Date
WO2023159591A1 true WO2023159591A1 (zh) 2023-08-31

Family

ID=87764398

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/078385 WO2023159591A1 (zh) 2022-02-28 2022-02-28 一种展陈场景智能讲解的系统及其方法

Country Status (3)

Country Link
US (1) US20240272648A1 (zh)
CN (1) CN117178241A (zh)
WO (1) WO2023159591A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117708373A (zh) * 2024-02-06 2024-03-15 成都数之联科技股份有限公司 一种动画交互方法及系统
CN118646774A (zh) * 2024-08-15 2024-09-13 深圳市卡司通展览股份有限公司 一种全自动讲解调控系统、方法及其在机器人中的应用

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106970627A (zh) * 2017-05-17 2017-07-21 深圳市元时科技有限公司 一种智能跟随系统
US20180181137A1 (en) * 2016-12-23 2018-06-28 Korea Institute Of Science And Technology Moving and searching method of mobile robot for following human
CN108549410A (zh) * 2018-01-05 2018-09-18 灵动科技(北京)有限公司 主动跟随方法、装置、电子设备及计算机可读存储介质
CN109129507A (zh) * 2018-09-10 2019-01-04 北京联合大学 一种智能讲解机器人及讲解方法和系统
CN110405767A (zh) * 2019-08-01 2019-11-05 深圳前海微众银行股份有限公司 智能化展厅的引领方法、装置、设备及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180181137A1 (en) * 2016-12-23 2018-06-28 Korea Institute Of Science And Technology Moving and searching method of mobile robot for following human
CN106970627A (zh) * 2017-05-17 2017-07-21 深圳市元时科技有限公司 一种智能跟随系统
CN108549410A (zh) * 2018-01-05 2018-09-18 灵动科技(北京)有限公司 主动跟随方法、装置、电子设备及计算机可读存储介质
CN109129507A (zh) * 2018-09-10 2019-01-04 北京联合大学 一种智能讲解机器人及讲解方法和系统
CN110405767A (zh) * 2019-08-01 2019-11-05 深圳前海微众银行股份有限公司 智能化展厅的引领方法、装置、设备及存储介质

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117708373A (zh) * 2024-02-06 2024-03-15 成都数之联科技股份有限公司 一种动画交互方法及系统
CN117708373B (zh) * 2024-02-06 2024-04-05 成都数之联科技股份有限公司 一种动画交互方法及系统
CN118646774A (zh) * 2024-08-15 2024-09-13 深圳市卡司通展览股份有限公司 一种全自动讲解调控系统、方法及其在机器人中的应用

Also Published As

Publication number Publication date
CN117178241A (zh) 2023-12-05
US20240272648A1 (en) 2024-08-15

Similar Documents

Publication Publication Date Title
WO2023159591A1 (zh) 一种展陈场景智能讲解的系统及其方法
WO2019085716A1 (zh) 移动机器人的交互方法、装置、移动机器人及存储介质
KR102348041B1 (ko) 복수의 이동 로봇을 포함하는 로봇 시스템의 제어 방법
CN107336243B (zh) 基于智能移动终端的机器人控制系统及控制方法
JP5318623B2 (ja) 遠隔操作装置および遠隔操作プログラム
US20170318407A1 (en) Systems and Methods for Generating Spatial Sound Information Relevant to Real-World Environments
EP3037917B1 (en) Monitoring
WO2017033513A1 (ja) 情報処理装置、情報処理方法、及びプログラム
Sugimoto et al. Time Follower's Vision: a teleoperation interface with past images
WO2018103023A1 (zh) 人机混合决策方法和装置
US20230057965A1 (en) Robot and control method therefor
US9823634B2 (en) System and method for providing three-dimensional paths
JPWO2018025531A1 (ja) 情報処理装置、情報処理方法、およびプログラム
WO2013114493A1 (ja) コミュニケーション引き込みシステム、コミュニケーション引き込み方法およびコミュニケーション引き込みプログラム
CN110543173B (zh) 车辆定位系统及方法、车辆控制方法及装置
KR20190093529A (ko) 공기 청정기의 배치 위치를 가이드하는 인공 지능 장치 및 그의 동작 방법
US11188145B2 (en) Gesture control systems
KR20210051014A (ko) 로봇 청소기 및 그의 동작 방법
JP2018510537A (ja) サーベイランス
CN110580426A (zh) 机器人的人机交互方法及机器人
KR20190104488A (ko) 인공 지능을 이용하여, 오브젝트의 이동을 관리하는 인공 지능 로봇 및 그의 동작 방법
KR20210004487A (ko) 환기 상황을 자동으로 파악할 수 있는 인공 지능 장치 및 그의 동작 방법
JP7279646B2 (ja) 情報処理装置、情報処理方法及びプログラム
CN111596776B (zh) 电子白板书写笔及其教学系统
KR20200128486A (ko) 사용자의 위치를 결정하는 인공 지능 장치 및 그 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22927872

Country of ref document: EP

Kind code of ref document: A1