CN116820242A - Digital exhibition hall system - Google Patents
Digital exhibition hall system Download PDFInfo
- Publication number
- CN116820242A CN116820242A CN202310786880.9A CN202310786880A CN116820242A CN 116820242 A CN116820242 A CN 116820242A CN 202310786880 A CN202310786880 A CN 202310786880A CN 116820242 A CN116820242 A CN 116820242A
- Authority
- CN
- China
- Prior art keywords
- module
- exhibition hall
- personnel
- exhibition
- digital
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000006399 behavior Effects 0.000 claims abstract description 74
- 238000004458 analytical method Methods 0.000 claims abstract description 47
- 238000013473 artificial intelligence Methods 0.000 claims abstract description 38
- 230000014509 gene expression Effects 0.000 claims description 103
- 238000009877 rendering Methods 0.000 claims description 34
- 241000282414 Homo sapiens Species 0.000 claims description 26
- 230000009471 action Effects 0.000 claims description 20
- 230000003993 interaction Effects 0.000 claims description 20
- 230000005540 biological transmission Effects 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 description 30
- 238000010586 diagram Methods 0.000 description 24
- 210000003414 extremity Anatomy 0.000 description 15
- 238000000034 method Methods 0.000 description 10
- 210000003813 thumb Anatomy 0.000 description 10
- 238000004422 calculation algorithm Methods 0.000 description 6
- 238000013135 deep learning Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 210000004247 hand Anatomy 0.000 description 5
- 230000003068 static effect Effects 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 241000282412 Homo Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The application provides a digital exhibition hall system, relates to the technical field of artificial intelligence, and is used for solving the problems of single transmission mode and limited space experience of a traditional exhibition hall. The system comprises: an artificial intelligent analysis module and a digital person module; the artificial intelligence analysis module is used for analyzing and identifying the behaviors of exhibition hall personnel; the digital person module is used for generating digital persons and controlling the digital persons to interact with the exhibition hall personnel according to the behaviors of the exhibition hall personnel identified by the artificial intelligence analysis module.
Description
Technical Field
The application relates to the technical field of artificial intelligence, in particular to a digital exhibition hall system.
Background
With the continuous development and innovation of digital technology, the form and content of exhibition hall shows are also deeply changed.
At present, exhibition hall shows often mainly use static physical models and graphic information, and are quite limited, for example: the transmission mode is single, and exhibition hall personnel can only passively accept contents such as characters, pictures, videos and the like displayed in the exhibition hall.
Disclosure of Invention
The application provides a digital exhibition hall system, relates to the technical field of artificial intelligence, and can solve the problems of single transmission mode, static visual experience, limited space experience and the like of a traditional exhibition hall.
In a first aspect, the present application provides a digital display system comprising: an artificial intelligence analysis module and a digital person module.
The artificial intelligence analysis module is used for analyzing and identifying the behaviors of exhibition hall personnel; the digital person module is used for generating digital persons and controlling the digital persons to interact with the exhibition hall personnel according to the behaviors of the exhibition hall personnel identified by the artificial intelligence analysis module.
The technical scheme provided by the application has at least the following beneficial effects: realize the man-machine interaction control to exhibition hall show whole flow through artificial intelligence analysis module, based on the integration linkage of artificial intelligence technique and digital man technique, intelligent start corresponding digital man, compare with traditional exhibition hall exhibition, provide initiative participation and interactive opportunity for the exhibition hall personnel, increased exhibition hall personnel's visit experience, improve exhibition hall exhibition effect.
In one possible implementation, the system further includes a console module; the artificial intelligent analysis module and the digital person module are connected with the control center platform module; the control center module is used for determining feedback information according to the behaviors of exhibition hall personnel and the preset corresponding relation between the behaviors and the feedback information; and controlling the interaction between the digital person and the exhibition personnel through the digital person module according to the feedback information.
In one possible implementation, the behavior of the exhibition hall personnel includes an expressive behavior of the exhibition hall personnel; the artificial intelligent analysis module comprises an expression recognition sub-module; the system also comprises a control center module; the artificial intelligent analysis module and the digital person module are connected with the control center platform module; the expression recognition sub-module is used for analyzing and recognizing expression behaviors of exhibition hall personnel; the control center module is used for determining first target feedback information according to the expression behaviors of exhibition hall personnel and the preset corresponding relation between the recognition expression behaviors and the feedback information; the feedback information comprises feedback expressions and/or feedback speech; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the first target feedback information.
Based on the possible implementation mode, through carrying out analysis and identification to the expression behaviors of exhibition hall personnel, the digital personnel are controlled to interact with the exhibition hall personnel, the opportunity of the initiative participation of the exhibition hall personnel is increased, and therefore the visit experience of the exhibition hall personnel is increased.
In one possible implementation, the behavior of the exhibition hall personnel includes gestures of the exhibition hall personnel; the artificial intelligence analysis module comprises a gesture tracking sub-module; the system also comprises a control center module; the artificial intelligent analysis module and the digital person module are connected with the control center platform module; the gesture tracking sub-module is used for analyzing and identifying gestures of exhibition hall personnel; the control center platform module is specifically used for determining second target feedback information according to the gesture of the exhibition hall personnel and the corresponding relation between the preset recognition gesture and the feedback information; the feedback information comprises feedback expressions and/or feedback speech; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the second target feedback information.
Based on this possible implementation, through analyzing the gesture of exhibition hall personnel, control digital person and exhibition hall personnel interact, increased the chance that exhibition hall personnel interacted to increase exhibition hall personnel's visiting experience.
In one possible implementation, the behavior of the exhibition hall personnel includes the expressive behavior and gestures of the exhibition hall personnel; the artificial intelligent analysis module comprises an expression recognition sub-module and a gesture tracking sub-module; the system also comprises a control center module; the artificial intelligent analysis module and the digital person module are connected with the control center platform module; the expression recognition sub-module is used for analyzing and recognizing expression behaviors of exhibition hall personnel; the gesture tracking sub-module is used for analyzing and identifying gestures of exhibition hall personnel; the control center module is specifically used for determining first target feedback information according to the expression behaviors of exhibition hall personnel and the preset corresponding relation between the recognition expression behaviors and the feedback information; the feedback information comprises feedback expressions and/or feedback speech; determining second target feedback information according to the gesture of the exhibition hall personnel and the corresponding relation between the preset recognition gesture and the feedback information; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the first target feedback information and the second target feedback information.
Based on the possible implementation mode, through analyzing the expression behaviors and gestures of the exhibition hall personnel, the digital personnel are controlled to interact with the exhibition hall personnel, the opportunity of the initiative participation and interaction of the exhibition hall personnel is increased, and accordingly the visiting experience of the exhibition hall personnel is increased.
In a possible implementation manner, the system further comprises a control center console module, an exhibition hall light module and an exhibition hall music module; the artificial intelligent analysis module, the digital person module, the exhibition hall light module and the exhibition hall music module are respectively connected with the control center platform module; the artificial intelligent analysis module also comprises a personnel crossing sub-module and a human body tracking sub-module; the personnel crossing sub-module is used for identifying whether exhibition hall personnel enter an area near an exhibition hall gate; the control center platform module is used for opening the exhibition hall light through the exhibition hall light module and playing music through the exhibition hall music module under the condition that the personnel crossing sub-module recognizes that the exhibition hall personnel enter the area near the exhibition hall gate; the human body tracking submodule is used for identifying whether exhibition hall personnel reach an area near any exhibition stand in the exhibition hall or not; and the control center platform module is also used for lightening the light of the area nearby the exhibition stand through the exhibition hall light module and reducing music sound through the exhibition hall music module under the condition that exhibition hall personnel reach the area nearby any exhibition stand in the exhibition hall.
In another possible implementation manner, the human body tracking sub-module is further used for acquiring the current position of the exhibition hall personnel; the system also includes a personnel location rendering module; the personnel position rendering module is used for rendering a position model of the exhibition hall personnel according to the current position of the exhibition hall personnel and a preset exhibition hall model, which are acquired by the human body tracking sub-module; the exhibition hall personnel position model is used for showing the positions of exhibition hall personnel.
In yet another possible implementation, the system further includes a 3D presentation rendering module; the 3D exhibition rendering module is used for rendering and generating an exhibition hall model.
In another possible implementation manner, the human body tracking sub-module is further used for analyzing and identifying the action behaviors of exhibition hall personnel; the system also comprises an emergency command and dispatch module; the emergency command scheduling module is used for sending out alarm information under the condition that the human body tracking submodule analyzes and identifies preset actions.
In yet another possible implementation, the system further includes an analysis module; the analysis module is used for acquiring interaction information among modules in the system and generating an interaction log.
In yet another possible implementation, the system further includes a storage module; the storage module is used for storing the interaction log.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a digital exhibition hall system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of another digital exhibition hall system according to an embodiment of the present application;
FIG. 3 is a schematic diagram of another digital exhibition hall system according to an embodiment of the present application;
FIG. 4 is a schematic diagram of another digital exhibition hall system according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application;
FIG. 6 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application;
FIG. 7 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application;
FIG. 8 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application;
FIG. 9 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application;
FIG. 10 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application;
FIG. 11 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application;
fig. 12 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It should be noted that, in the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "for example" is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
In addition, in the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may mean a or B. "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" means two or more than two.
In order to clearly describe the technical solution of the embodiments of the present application, in the embodiments of the present application, the terms "first", "second", etc. are used to distinguish the same item or similar items having substantially the same function and effect, and those skilled in the art will understand that the terms "first", "second", etc. are not limited in number and execution order.
First, technical terms related to the present application will be described:
1. digital humans (Digital Human/Meta Human) are digitized personas created using Digital technology that approximate Human personas.
2. The digital exhibition hall uses multimedia and digital technology as exhibition technology, uses latest movie and television animation technology, combines unique graphic digital and multimedia technology, attracts visitors with various novel technologies, and realizes the exhibition hall form of man-machine interaction mode.
3. Artificial intelligence (Artificial Intelligence, AI) is a new technical science to study, develop theories, methods, techniques and application systems for simulating, extending and expanding human intelligence.
4. The Digital Twin (Digital Twin) is a simulation process integrating multiple disciplines, multiple physical quantities, multiple scales and multiple probabilities by fully utilizing data such as a physical model, sensor updating, operation history and the like, and mapping is completed in a virtual space, so that a full life cycle process of corresponding entity equipment is reflected.
With the continuous development and innovation of digital technology, the form and content of exhibition hall shows are also deeply changed. Traditional exhibition hall shows often take static physical models and graphic information as the main materials, and are limited in many ways, for example: the transmission mode is single, and exhibition hall personnel can only passively accept the contents such as characters, pictures, videos and the like displayed in the exhibition hall; the visual experience is static, and exhibition hall personnel are difficult to obtain multidimensional perception and immersion; the space experience is limited, and exhibition hall personnel cannot freely select interested exhibits and information, acquire update of the exhibition hall in real time and the like.
At present, the existing digital exhibition hall mostly controls multimedia facilities in the exhibition hall through data detection and calculation, or provides exhibition explanation for exhibition hall personnel through artificial intelligence voice technology, so that the visiting experience of the exhibition hall personnel is increased, and the exhibition effect of the exhibition hall is improved.
Therefore, how to increase multidimensional perception and immersion of exhibition hall personnel and provide more freely selected space for the exhibition hall personnel, increase the visiting experience of the exhibition hall personnel and improve the exhibition effect of the exhibition hall becomes the problem to be solved at present.
As described in the background art, the traditional exhibition hall has the limitations of single transmission mode, static visual experience, limited space experience and the like.
Based on the above, the embodiment of the application provides a digital exhibition hall system, which realizes man-machine interaction control of the whole exhibition hall exhibition process by means of the digital means of fusion linkage of an artificial intelligence technology, a digital twin technology and a digital man technology, thereby increasing the opportunities of active participation and interaction of exhibition hall personnel and increasing the visit experience of the exhibition hall personnel.
For easy understanding, the digital exhibition hall system provided by the embodiment of the application is specifically described below with reference to the accompanying drawings.
In some possible embodiments, fig. 1 is a schematic diagram of a digital exhibition hall system according to an embodiment of the present application.
As shown in fig. 1, the system includes: an artificial intelligence analysis module 100 and a digital person module 200.
Wherein the artificial intelligence analysis module 100 is used to analyze and identify the behavior of exhibition personnel.
The specific components of the artificial intelligence analysis module 100 may be described with reference to fig. 12 below, and are not described again here.
The digital person module is used for generating digital persons and controlling the digital persons to interact with the exhibition hall personnel according to the behaviors of the exhibition hall personnel identified by the artificial intelligence analysis module.
The specific components of the digital person module 200 may be described with reference to fig. 12, which is not described herein.
The digital exhibition hall system provided by the embodiment of the application can realize man-machine interaction control over the whole exhibition hall exhibition process through the artificial intelligence analysis module, intelligently starts corresponding digital persons based on fusion linkage of the artificial intelligence technology and the digital person technology, and provides the exhibition hall personnel with the opportunity of active participation and interaction compared with the traditional exhibition hall exhibition, increases the visit experience of the exhibition hall personnel and improves the exhibition hall exhibition effect.
In some possible embodiments, fig. 2 is a schematic diagram of the composition of another digital exhibition hall system according to an embodiment of the present application.
As shown in fig. 2, the system further includes: the console module 300 is controlled.
The artificial intelligent analysis module and the digital person module are connected with the control center platform module; the control center module is used for determining feedback information according to the behaviors of the exhibition hall personnel and the corresponding relation between the preset behaviors and the feedback information; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the feedback information.
The behaviors of the exhibition hall personnel and the corresponding relation between the preset behaviors and the feedback information are described in the following fig. 3 to 5, and are not repeated here.
In some possible embodiments, the behavior of the exhibition hall person includes an expressive behavior of the exhibition hall person, and the system can specifically identify the expressive behavior of the exhibition hall person and interact with the exhibition hall person according to the expressive behavior. Fig. 3 is a schematic diagram of another digital exhibition hall system according to an embodiment of the present application.
As shown in fig. 3, the artificial intelligence analysis module may further specifically include an expression recognition sub-module 1001, where the expression recognition sub-module 1001 is configured to analyze and recognize expression behaviors of exhibition hall personnel.
Illustratively, the expressive behavior of the exhibition hall person may be smiling, angry, or surprised, etc. Optionally, the expression recognition submodule can recognize the expression of the exhibition hall personnel through an artificial intelligence algorithm based on a deep learning technology, and specific reference can be made to the related technology, and details are not repeated here.
The control center module is used for determining first target feedback information according to the expression behaviors of exhibition hall personnel and the preset corresponding relation between the recognition expression behaviors and the feedback information; the feedback information comprises feedback expressions and/or feedback speech; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the first target feedback information.
Optionally, the expression behaviors of the exhibition hall personnel are used as indexes, the corresponding relation between the preset expression behaviors and the feedback information is traversed, and the feedback information corresponding to the expression behaviors of the exhibition hall personnel is used as the first target feedback information in the corresponding relation between the preset expression behaviors and the feedback information.
Illustratively, the correspondence between the preset recognition expression behavior and the feedback information may be as shown in the following table 1:
TABLE 1
As shown in table 1, the table may include expression behavior items and feedback information items. Among them, expressive behavior items include smiling, vital energy, and surprise. The feedback information items include the expression of "happy" and the limb action of "clapping", the expression of "vital energy" and the limb action of "making a fist", and the expression of "surprise" and the limb action of "glabrous". The smile and the happy expression have a corresponding relation with the limb actions of the clapping hands; the expression of qi generation and the limb action of fist making have a corresponding relation; there is a correspondence between the expression of surprise and "surprise" and the limb movements of "zelle".
Taking the example that exhibition hall personnel make smiling movements on digital people, the expression recognition submodule can recognize smiling expressions, the control center desk module can determine that the feedback information of the digital people is happy expressions and limb movements of the hand clapping according to the recognition results of the expression recognition submodule and the corresponding relations between preset expression behaviors and feedback information, and the control center desk module controls the digital people to make happy expressions and limb movements of the hand clapping through the digital people module according to the feedback information.
In some possible embodiments, the behavior of the showman includes gestures of the showman, and the system may specifically recognize the gestures of the showman and interact with the showman according to the gestures. Fig. 4 is a schematic diagram of another digital exhibition hall system according to an embodiment of the present application.
As shown in fig. 4, the artificial intelligence analysis module may further include a gesture tracking sub-module 1002 in particular; gesture tracking sub-module 1002 is used to analyze and recognize gestures of the exhibition personnel.
For example, the gesture of the exhibition hall person may be stretching the thumb upwards, or waving the hand, etc. Optionally, the gesture tracking submodule may implement recognition of the gesture of the exhibition hall person through an artificial intelligence algorithm based on a deep learning technology, and specific reference may be made to the related technology, which is not described herein.
The control center platform module is specifically used for determining second target feedback information according to the gesture of the exhibition hall personnel and the corresponding relation between the preset recognition gesture and the feedback information; the feedback information comprises feedback expressions and/or feedback speech; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the second target feedback information.
Optionally, the gesture of the exhibition hall person is used as an index, the corresponding relation between the preset gesture and the feedback information is traversed, and the feedback information corresponding to the gesture of the exhibition hall person is used as the second target feedback information in the corresponding relation between the preset gesture and the feedback information.
For example, the correspondence between the preset recognition gesture and the feedback information may be as shown in the following table 2:
TABLE 2
| Gesture | Feedback information |
| Extend upward the thumb | Speech of "thank you" and expression of "happy |
| Extend down thumb | Voice of sorry and expression of depression |
| Hand waving | "bye" voice and "waving" limb movements |
As shown in table 2, the table may include gesture items and feedback information items. Wherein the gesture items include extending the thumb upward, extending the thumb downward, and extending the hand. Feedback information items include "thank you" speech and "happy" expressions, "sorry" speech and "frustrated" expressions, and "bye" speech and "waving hands" limb movements. The correspondence is formed between the voice of the thumb extending upwards and the thank you and the expression of happy; the corresponding relation exists between the downward extending thumb and the voice of 'sorry' and the expression of 'depression'; there is a correspondence between the voice of waving the hand and "bye" and the limb movements of waving the hand. Taking an example that a person in an exhibition makes an upward thumb gesture to a digital person, the gesture tracking sub-module can recognize the upward thumb gesture, the control center platform module can determine that the feedback information of the digital person is a voice of 'thank you' and a happy expression according to a recognition result of the gesture tracking sub-module and a corresponding relation between a preset expression behavior and feedback information, and the control center platform module controls the digital person to send the voice of 'thank you' and make the happy expression through the digital person module according to the feedback information.
In some possible embodiments, the behavior of the exhibition hall person includes an expressive behavior and a gesture of the exhibition hall person, and the system can specifically recognize the expressive behavior and the gesture of the exhibition hall person and interact with the exhibition hall person according to the expressive behavior and the gesture. Fig. 5 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application.
As shown in fig. 5, the artificial intelligence analysis module may further specifically include an expression recognition submodule 1001 and a gesture tracking submodule 1002; the expression recognition sub-module 1001 is used for analyzing and recognizing expression behaviors of exhibition hall personnel; gesture tracking sub-module 1002 is used to analyze and recognize gestures of the exhibition personnel.
Illustratively, the expressive behavior of the exhibition hall person may be smiling, angry, or surprising, and the gesture of the exhibition hall person may be stretching the thumb upward, or waving the hand, etc.
Optionally, the expression recognition submodule and the gesture tracking submodule can recognize the expression and the gesture of the exhibition hall personnel through an artificial intelligence algorithm based on a deep learning technology, and specific reference can be made to the related technology, and details are not repeated here.
The control center module is specifically used for determining first target feedback information according to the expression behaviors of exhibition hall personnel and the preset corresponding relation between the recognition expression behaviors and the feedback information; the feedback information comprises feedback expressions and/or feedback speech; determining second target feedback information according to the gesture of the exhibition hall personnel and the corresponding relation between the preset recognition gesture and the feedback information; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the first target feedback information and the second target feedback information.
Optionally, when the exhibition hall personnel make expression behaviors and gestures on the digital personnel at the same time, after the control center console module determines the first target feedback information and the second target feedback information, the digital personnel and the exhibition hall personnel are controlled to interact by taking the first target feedback information as feedback information through the digital personnel module.
By way of example, taking the correspondence shown in the above tables 1 and 2 as an example, assuming that the exhibition hall personnel makes smiling expressions and thumb-extending gestures on the digital personnel at the same time, the expression recognition submodule can recognize smiling expressions and the gesture tracking submodule can recognize thumb-extending gestures, and the control center desk module can determine that the first feedback information of the digital personnel is the happy expressions and limb actions of the clapping hands according to the recognition results of the expression recognition submodule and the gesture tracking submodule and the preset expressions and feedback information, and the second feedback information is the voice of the clashing and makes the happy expressions, and at the moment, the control center desk module controls the digital personnel to make the happy expressions and the limb actions of clapping hands according to the first feedback information through the digital personnel module.
Optionally, when the exhibition hall personnel make expression behaviors and gestures on the digital personnel at the same time, after the control center console module determines the first target feedback information and the second target feedback information, the digital personnel and the exhibition hall personnel are controlled to interact by using the second target feedback information as feedback information through the digital personnel module.
By way of example, taking the case that the exhibition hall personnel make smiling expressions and thumb-extending gestures simultaneously, the expression recognition sub-module can recognize smiling expressions, the gesture tracking sub-module can recognize thumb-extending gestures, the control center platform module can determine that the first feedback information of the digital personnel is the happy expressions and limb actions of the clapping hands according to the recognition results of the expression recognition sub-module and the gesture tracking sub-module and the preset expression actions and feedback information, the second feedback information is the thank voices and the happy expressions, and at the moment, the control center platform module controls the digital personnel to send the thank voices and make the happy expressions according to the second feedback information.
Optionally, when the exhibition hall personnel make expression behaviors and gestures on the digital personnel at the same time, after the control center console module determines the first target feedback information and the second target feedback information, the digital personnel and the exhibition hall personnel are controlled to interact by using the first target feedback information and the second target feedback information as feedback information through the digital personnel module.
By way of example, taking the case that the exhibition hall personnel make smiling expressions and thumb-extending gestures simultaneously, the expression recognition submodule can recognize smiling expressions, the gesture tracking submodule can recognize thumb-extending gestures, the control center desk module can determine that the first feedback information of the digital personnel is the happy expressions and limb actions of the hand clapping according to the recognition results of the expression recognition submodule and the gesture tracking submodule and the preset expression actions and feedback information, the second feedback information is the voices of the thanking and the happy expressions, and at the moment, the control center desk module controls the digital personnel to make the happy expressions and the limb actions of the hand clapping through the digital personnel module according to the first feedback information and the second feedback information, and then gives out the voices of the thanking and the happy expressions.
In some possible embodiments, the system may identify whether the exhibition hall person arrives at a particular area of the exhibition hall by detecting the behavior of the exhibition hall person, and turn on or adjust lights and music for the exhibition hall person. Fig. 6 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application.
As shown in fig. 6, the system may further include a control console module 300, an exhibition hall light module 400, and an exhibition hall music module 500, to which the artificial intelligence analysis module, the digital person module, the exhibition hall light module, and the exhibition hall music module are connected, respectively; the artificial intelligence analysis module also includes a person crossing sub-module 1003 and a person tracking sub-module 1004.
The personnel out-of-range sub-module is used to identify whether the exhibition personnel enter an area near the exhibition hall door.
Optionally, the personnel crossing sub-module can recognize that the exhibition hall personnel enter the vicinity of the exhibition hall gate through an artificial intelligence algorithm based on a deep learning technology, and specific reference can be made to the related technology, and details are not repeated here.
The exhibition hall light module is used for controlling the light intensity change of different areas in the exhibition hall by sending a switch signal to the exhibition hall light system.
The exhibition hall music module is used for controlling the sound size and music switching of different areas in the exhibition hall by sending a switch signal to the exhibition hall sound system.
The control center platform module is used for opening the exhibition hall light through the exhibition hall light module and playing music through the exhibition hall music module under the condition that the personnel crossing sub-module recognizes that the exhibition hall personnel enter the area near the exhibition hall gate.
The body tracking submodule is used for identifying whether exhibition hall personnel reach an area near any exhibition stand in the exhibition hall.
Optionally, the human body tracking submodule can recognize that the exhibition hall personnel enter the vicinity of the exhibition hall gate through an artificial intelligence algorithm based on a deep learning technology, and specific reference can be made to the related technology, and details are not repeated here.
The control center table module is also used for lightening the light of the area nearby the exhibition table through the exhibition hall light module under the condition that exhibition hall personnel reach the area nearby any exhibition table in the exhibition hall, and reducing music sound through the exhibition hall music module.
In some possible embodiments, the system may display the location of the exhibition hall personnel in real time within the exhibition hall through the collection of the exhibition hall personnel location information. Fig. 7 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application.
As shown in fig. 7, the system may further comprise a digital twinning module 600, which may in particular comprise a personnel location rendering module 6001.
The human body tracking sub-module is also used for acquiring the current position information of exhibition hall personnel and sending the current position information to the artificial intelligent analysis module.
Optionally, the human body tracking submodule can obtain the position of the exhibition hall personnel through an artificial intelligence algorithm based on a deep learning technology, and specific reference can be made to the related technology, and details are not repeated here.
The personnel position rendering module is used for rendering a exhibition hall personnel position model according to the current position information of the exhibition hall personnel and a preset exhibition hall model, which are acquired by the human body tracking sub-module; the exhibition hall personnel position model is used for showing the positions of exhibition hall personnel.
Optionally, the personnel location rendering module may perform 3D rendering on the location model of the exhibition hall personnel through a 3D rendering technology when receiving the location information of the artificial intelligence analysis module.
In some possible embodiments, the system may also demonstrate the overall condition of the exhibition hall. Fig. 8 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application.
As shown in fig. 8, the system may further include a 3D presentation rendering module 6002,3D presentation rendering module for rendering the generated exhibition model.
Optionally, the 3D display rendering module may implement rendering output of the overall effect of the preset exhibition hall model through a 3D rendering technology.
In some possible embodiments, the system can identify whether emergency situations occur to the exhibition hall personnel through detection of the behaviors of the exhibition hall personnel, and inform the exhibition hall manager to go to check and timely process to provide help for the exhibition hall personnel. Fig. 9 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application.
As shown in fig. 9, the system may further include an emergency command and dispatch module 6003, and the body tracking sub-module is further configured to analyze and identify action behaviors of exhibition hall personnel, and the emergency command and dispatch module is configured to send out alarm information when the body tracking sub-module analyzes and identifies a preset action.
Illustratively, the preset action may be fighting, falling of a person, or the like. Taking the situation that the personnel fall in the exhibition hall as an example, the personnel fall is analyzed and identified by the human body tracking submodule, and the emergency command scheduling module sends out alarm information (can be an acousto-optic alarm) according to the analysis and identification result of the human body tracking submodule to inform exhibition hall management personnel of going to check and timely process risks.
In some possible embodiments, the system may obtain interaction information between the various modules and generate an interaction log. Fig. 10 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application.
As shown in fig. 10, the system may further include an analysis module 700 for obtaining interaction information between the modules in the system and generating an interaction log.
In some possible embodiments, the system may store a log of interactions between the various modules. Fig. 10 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application.
As shown in fig. 11, the system may further include a storage module 800 for storing interaction logs between various modules in the system through a plurality of data formats.
In some possible embodiments, the system may comprise all of the modules of the embodiments described above. Fig. 12 is a schematic diagram of a digital exhibition hall system according to another embodiment of the present application.
As shown in fig. 12, the artificial intelligence analysis module 100 may specifically include an expression recognition sub-module 1001, a gesture tracking sub-module 1002, a body tracking sub-module 1003, and a person out-of-bounds sub-module 1004.
The expression recognition sub-module 1001 is specifically described in fig. 2, and is not described herein.
The gesture tracking sub-module 1002 is specifically described in fig. 3, and is not described herein.
The specific description of the body tracking sub-module 1003 and the person crossing sub-module 1004 is described in fig. 4, and will not be repeated here.
The digital person module 200 may specifically include a digital person voice sub-module 2001, a digital person rendering sub-module 2002.
The digital human voice submodule 2001 is used for accurately converting a text designed in advance into natural, smooth and clear voice through a voice synthesis technology.
The digital person rendering sub-module 2002 is used for realizing the animation rendering output of the digital person through a 3D rendering technology.
The digital twinning module 600 may specifically include an emergency command dispatch module 6001, a personnel location rendering module 6002 and a 3D presentation rendering module 6003.
The specific description of the emergency command dispatch module 6001 is as described in fig. 9, and will not be repeated here.
The specific description of the personnel location rendering module 6002 is as described in fig. 7, and will not be repeated here.
The specific description of the 3D display rendering module 6003 is as described in fig. 8, and is not repeated here.
The specific description of the console module 300 is as described in fig. 2, and will not be repeated here.
The showroom lighting module 400 is specifically described in fig. 6, and will not be described again here.
The exhibition hall music module 500 is specifically described in fig. 6 and will not be described again here.
The specific description of the memory module 800 is as described in fig. 11, and will not be repeated here.
The analysis module 700 is specifically described in fig. 10, and is not described herein.
When a person in the exhibition hall goes to the exhibition hall to visit the exhibition hall, the person out-of-range submodule recognizes that the person in the exhibition hall enters an area near the gate of the exhibition hall, and at the moment, the control center desk module turns on the light of the exhibition hall through the light module of the exhibition hall and plays music through the music module of the exhibition hall; when exhibition hall personnel visit at different positions in the exhibition hall, the human body tracking sub-module acquires the real-time positions of the exhibition hall personnel, and the control center platform module synchronizes the real-time positions of the exhibition hall personnel to the 3D exhibition rendering module and the personnel position rendering module in the digital twin module and displays the real-time positions of the exhibition hall personnel; when exhibition hall personnel stop to the nearby area of exhibition stand in the exhibition hall, the light of exhibition stand department lightens, the music sound reduces, and the digital person of exhibition stand department starts, triggers digital person's sound submodule among the digital person module and digital person and renders the submodule, begins to explain the exhibit, and exhibition hall personnel also can interact with digital person through expression action or gesture.
The foregoing is merely illustrative of specific embodiments of the present application, and the scope of the present application is not limited thereto, but any changes or substitutions within the technical scope of the present application should be covered by the scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims (11)
1. A digital display system, the system comprising: an artificial intelligent analysis module and a digital person module; the artificial intelligent analysis module is used for analyzing and identifying behaviors of exhibition hall personnel; the digital person module is used for generating digital persons and controlling the digital persons to interact with the exhibition hall personnel according to the behaviors of the exhibition hall personnel identified by the artificial intelligent analysis module.
2. The system of claim 1, further comprising a control center module; the artificial intelligent analysis module and the digital human module are connected with the control center platform module; the control center platform module is used for determining feedback information according to the behaviors of the exhibition hall personnel and the corresponding relation between preset behaviors and feedback information; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the feedback information.
3. The system of claim 2, wherein the behavior of the exhibition hall person comprises an expressive behavior of the exhibition hall person; the artificial intelligence analysis module comprises an expression recognition sub-module; the expression recognition sub-module is used for analyzing and recognizing expression behaviors of the exhibition hall personnel; the control center platform module is used for determining first target feedback information according to the expression behaviors of the exhibition hall personnel and the corresponding relation between the preset recognition expression behaviors and the feedback information; the feedback information comprises feedback expressions and/or feedback speech; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the first target feedback information.
4. The system of claim 2, wherein the behavior of the exhibition hall person comprises a gesture of the exhibition hall person; the artificial intelligence analysis module comprises a gesture tracking sub-module; the gesture tracking sub-module is used for analyzing and identifying gestures of the exhibition staff; the control center platform module is specifically used for determining second target feedback information according to the gesture of the exhibition hall personnel and the corresponding relation between the preset recognition gesture and the feedback information; the feedback information comprises feedback expressions and/or feedback speech; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the second target feedback information.
5. The system of claim 2, wherein the behavior of the exhibition hall person comprises expressive behavior and gestures of the exhibition hall person; the artificial intelligence analysis module comprises an expression recognition sub-module and a gesture tracking sub-module; the expression recognition sub-module is used for analyzing and recognizing expression behaviors of the exhibition hall personnel; the gesture tracking sub-module is used for analyzing and identifying gestures of the exhibition staff; the control center platform module is specifically used for determining first target feedback information according to the expression behaviors of the exhibition hall personnel and the corresponding relation between the preset recognition expression behaviors and the feedback information; the feedback information comprises feedback expressions and/or feedback speech; determining second target feedback information according to the gesture of the exhibition hall personnel and the corresponding relation between the preset recognition gesture and the feedback information; and controlling the digital person to interact with the exhibition hall personnel through the digital person module according to the first target feedback information and the second target feedback information.
6. The system of any one of claims 1-5, further comprising a control center station module, a hall light module, a hall music module; the artificial intelligent analysis module, the digital person module, the exhibition hall light module and the exhibition hall music module are respectively connected with the control center platform module; the artificial intelligence analysis module further comprises a personnel crossing sub-module and a human body tracking sub-module; the personnel crossing sub-module is used for identifying whether the exhibition hall personnel enter an area near the exhibition hall gate; the control center platform module is used for opening the exhibition hall light through the exhibition hall light module and playing music through the exhibition hall music module under the condition that the person crossing sub-module recognizes that the exhibition hall person enters the area near the exhibition hall gate; the human body tracking submodule is used for identifying whether the exhibition hall personnel reach the area near any exhibition stand in the exhibition hall or not; the control center table module is also used for lightening the light of the area nearby the exhibition stand through the exhibition hall light module and reducing music sound through the exhibition hall music module under the condition that the exhibition hall personnel reach the area nearby any exhibition stand in the exhibition hall.
7. The system of claim 5, wherein the body tracking sub-module is further configured to obtain a current location of the exhibition personnel; the system also comprises a personnel position rendering module;
the personnel position rendering module is used for rendering a exhibition hall personnel position model according to the current position of the exhibition hall personnel and a preset exhibition hall model, which are acquired by the human body tracking sub-module; the exhibition hall personnel position model is used for displaying the positions of the exhibition hall personnel.
8. The system of claim 6, further comprising a 3D presentation rendering module; the 3D exhibition rendering module is used for rendering and generating the exhibition hall model.
9. The system of claim 1, wherein the body tracking sub-module is further configured to analyze and identify an action behavior of the exhibition personnel; the system also comprises an emergency command scheduling module; the emergency command scheduling module is used for sending out alarm information under the condition that the human body tracking submodule analyzes and identifies preset actions.
10. The system of any one of claims 1-9, wherein the system further comprises an analysis module; the analysis module is used for acquiring interaction information among modules in the system and generating an interaction log.
11. The system of claim 10, further comprising a storage module; the storage module is used for storing the interaction log.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310786880.9A CN116820242A (en) | 2023-06-29 | 2023-06-29 | Digital exhibition hall system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310786880.9A CN116820242A (en) | 2023-06-29 | 2023-06-29 | Digital exhibition hall system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116820242A true CN116820242A (en) | 2023-09-29 |
Family
ID=88125482
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310786880.9A Pending CN116820242A (en) | 2023-06-29 | 2023-06-29 | Digital exhibition hall system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116820242A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117195379A (en) * | 2023-11-03 | 2023-12-08 | 南京中音讯达网络科技有限公司 | Quick deployment method of digital twin simulation exhibition hall based on artificial intelligence |
-
2023
- 2023-06-29 CN CN202310786880.9A patent/CN116820242A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117195379A (en) * | 2023-11-03 | 2023-12-08 | 南京中音讯达网络科技有限公司 | Quick deployment method of digital twin simulation exhibition hall based on artificial intelligence |
| CN117195379B (en) * | 2023-11-03 | 2024-02-06 | 南京中音讯达网络科技有限公司 | Quick deployment method of digital twin simulation exhibition hall based on artificial intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Park et al. | A metaverse: Taxonomy, components, applications, and open challenges | |
| US10586369B1 (en) | Using dialog and contextual data of a virtual reality environment to create metadata to drive avatar animation | |
| CN108665492B (en) | Dance teaching data processing method and system based on virtual human | |
| CN104461525B (en) | A kind of intelligent consulting platform generation system that can customize | |
| Mittelberg | Gestures as image schemas and force gestalts: A dynamic systems approach augmented with motion-capture data analyses | |
| Sharma et al. | Speech-gesture driven multimodal interfaces for crisis management | |
| Kasap et al. | Making them remember—Emotional virtual characters with memory | |
| André et al. | Interacting with embodied conversational agents | |
| Fdili Alaoui et al. | Dance interaction with physical model visuals based on movement qualities | |
| CN111414506B (en) | Emotion processing method and device based on artificial intelligence, electronic equipment and storage medium | |
| Ma | Automatic conversion of natural language to 3D animation | |
| CN116820242A (en) | Digital exhibition hall system | |
| CN115953521B (en) | Remote digital person rendering method, device and system | |
| Maiorani | Kinesemiotics: Modelling how choreographed movement means in space | |
| Pelachaud et al. | Multimodal behavior modeling for socially interactive agents | |
| Wasfy et al. | Intelligent virtual environment for process training | |
| Martin et al. | Levels of Representation in the Annotation of Emotion for the Specification of Expressivity in ECAs | |
| Jeon et al. | Constructing the immersive interactive sonification platform (iISoP) | |
| Cerezo et al. | Interactive agents for multimodal emotional user interaction | |
| Krenn et al. | Embodied conversational characters: Representation formats for multimodal communicative behaviours | |
| Khan | An Approach of Lip Synchronization With Facial Expression Rendering for an ECA | |
| Lee et al. | The potential of a text-based interface as a design medium: An experiment in a computer animation environment | |
| Baldassarri et al. | Maxine: Embodied conversational agents for multimodal emotional communication | |
| Martin et al. | Coordinating the generation of signs in multiple modalities in an affective agent | |
| Lamolle et al. | Contextual factors and adaptative multimodal human-computer interaction: Multi-level specification of emotion and expressivity in embodied conversational agents |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |