CN115869612A - Offline acousto-optic effect display method - Google Patents

Offline acousto-optic effect display method Download PDF

Info

Publication number
CN115869612A
CN115869612A CN202111166537.1A CN202111166537A CN115869612A CN 115869612 A CN115869612 A CN 115869612A CN 202111166537 A CN202111166537 A CN 202111166537A CN 115869612 A CN115869612 A CN 115869612A
Authority
CN
China
Prior art keywords
user
acousto
node
optic
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111166537.1A
Other languages
Chinese (zh)
Inventor
陈飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yaoling Artificial Intelligence Zhejiang Co ltd
Original Assignee
Yaoling Artificial Intelligence Zhejiang Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yaoling Artificial Intelligence Zhejiang Co ltd filed Critical Yaoling Artificial Intelligence Zhejiang Co ltd
Priority to CN202111166537.1A priority Critical patent/CN115869612A/en
Publication of CN115869612A publication Critical patent/CN115869612A/en
Pending legal-status Critical Current

Links

Abstract

The invention relates to an offline acousto-optic effect display method, which is based on the recognition of the orientation, the advancing speed and the gesture action of a user, and aims at the user or other users to display the corresponding acousto-optic effect in a display area through acousto-optic display equipment, so that the user or other users can obtain immersive experience in the environment where the user or other users are located. The acousto-optic effect display method can also realize the corresponding interactive acousto-optic effect based on the interaction between users; the directivity and the interactivity of the acousto-optic effect can be realized by combining the orientation, the advancing speed and the gesture action of the user. The invention can also associate the online game attribute with the offline game attribute, the online game attribute can be used for determining the style of the acousto-optic effect correspondingly displayed in the offline behavior of the user, and the interaction between the users through the offline behavior influences the game attribute so as to determine the online game attribute and realize the online and offline linkage.

Description

Offline acousto-optic effect display method
Technical Field
The invention relates to the technical field of computers, in particular to an offline acousto-optic effect display method.
Background
Although with the implementation of intelligent means, scenic spot, venue possess more and more can carry out the interactive mode with the user, promote the monotony sense of visiting the process. However, in the prior art, the interaction mode is actually only a single device or a single scenic spot, and the implementation scheme of the interaction mode shows the relevant content to the user, and the user still goes, stops and looks in the whole scenic spot and venue range, which does not essentially solve the monotonous sense of the visiting process. For example, the Chinese patent application 201910820209.5 provides an AR-based scenic spot experience system, which adopts a scenic spot service module, a gamification tourism experience module, an AR vision display module and a culture IP module, tourists can know the actual characteristics of scenic spots through AR vision and quickly know the scenic spots through the gamification tourism experience module, and the games and the scenic spot knowledge popularization are combined, so that the tourists can quickly know the cultural characteristics of the scenic spots in the playing process, and a good scenic spot experience effect is achieved.
However, in the technical solution of the above patent application, a handheld terminal including an AR device, an intelligent mobile phone, and the like is inevitably required to perform AR visual display on interactive content, so as to realize interaction with a user. However, the AR technology cannot achieve real immersive experience due to the influence of the characteristics of the technology itself, and the presentation form through the AR vision is single, that is, the visual content is presented by superimposing on the real scene through the AR device and the smart phone, and the user cannot obtain any feeling of "physically present to his environment" in the environment where the user is located.
And in the scenic spot, route guide in the place, chinese invention patent application 201710576965.9 provides a navigation logic method and its indoor AR navigation system, the navigation system includes: the indoor positioning module, the path searching module and the navigation module improve the path searching algorithm of the path searching module and the navigation logic method of the navigation module.
However, in the technical scheme of the invention patent application, a handheld terminal including an AR device, an intelligent mobile phone and the like is inevitably required to realize AR navigation; indoor positioning is carried out based on the handheld terminal, and the positioning method adopted by the indoor positioning module is a WiFi indoor positioning method, an iBeacon indoor positioning method, a communication base station indoor positioning method or a pseudo satellite GPS indoor positioning method. Obviously, due to the inherent defects of the technology, the performance influence of related hardware or the influence of environmental interference factors and other reasons, different navigation technologies are only suitable for navigation under specific conditions, otherwise, the accuracy and the real-time performance are poor, namely, the universality is lacked. Correspondingly, in the prior art, the user is strongly associated with the handheld terminal equipment, the user is difficult to get rid of the handheld terminal equipment, and the use convenience is insufficient.
On the other hand, the conventional navigation needs to generate route information first, and then the route information is used as a navigation basis for navigation. Due to the existence of the route information, privacy risks exist due to recording of the route information by a navigation service provider or local security holes. For navigation software which cannot be used without agreeing to the privacy yielding terms, the user privacy can be unnecessarily acquired under the condition that the user neglects or compromises, and the effective solution is difficult to solve at the present stage.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provide an off-line acousto-optic effect display method, wherein the display and guide processes of the acousto-optic effect are all free from dependence on a handheld terminal device; the universality is high, and the device can be adapted to various environments; the method is realized based on the peer-to-peer network, the perception information of the user does not need to be stored, the route information does not need to be generated, and the privacy safety of the user is ensured.
The technical scheme of the invention is as follows:
an off-line acousto-optic effect display method, wherein acousto-optic display equipment is deployed in a display area; acquiring orientation data, traveling speed data and gesture action data of a user, and displaying acousto-optic effects corresponding to the current orientation, traveling speed and gesture action of the user through acousto-optic display equipment based on the orientation, traveling speed and gesture action of the user.
Preferably, a plurality of types of game attributes are set for each user, if the current orientation, the traveling speed and the gesture actions of the user correspondingly influence the game attributes of the user, the corresponding sound and light effects are displayed for the user, and the game attributes of the user or other users are modified; if the current orientation, the traveling speed and the gesture action of the user correspondingly influence the game attributes of other users, the corresponding acousto-optic effect is displayed for other users, and the game attributes of the user or other users are modified.
Preferably, reading the online game attribute of the user, and calculating the matched acousto-optic effect according to the online game attribute; and uploading the modified game attributes corresponding to the influence of the user on the game attributes of the user or other users on line to an on-line game server according to a preset rule, and updating the on-line game attributes of the user.
Preferably, the route requirement aiming at the user is obtained, and the position information of the user is obtained; calculating the next guiding information of the user based on the route requirement and the real-time position information of the user; the guide information is presented through acousto-optic display equipment at the position corresponding to the real-time position information of the user and is used for guiding the user.
Preferably, the orientation data, the traveling speed data and the gesture action data of the user are acquired, the next action of the user is pre-judged by using a pre-judging model pre-trained by using a preset condition or machine learning, the next action of the user comprises the orientation, the traveling speed and the gesture action of the user, and the acousto-optic effect and the next guiding information of the user are presented on the acousto-optic display equipment matched with the pre-judged position of the next orientation, the traveling speed and the gesture action of the user.
Preferably, if the pre-judgment on the acousto-optic effect or the next action of the user is not accurate, the acousto-optic display device presenting the acousto-optic effect and the guidance information of the next step of the user is corrected based on the real-time orientation data, the traveling speed data and the gesture action data of the user, and the personnel density and the environment information around the user, the orientation data, the traveling speed data and the gesture action data around the user are used as training samples and added into a sample library for further training and adjusting the pre-judgment model.
Preferably, height data, leg length data and step frequency data of the user are obtained, and the traveling speed of the user is measured and calculated; and if the prediction of the next action of the user is not accurate, replacing the predicted travelling speed with the measured travelling speed.
Preferably, pre-judging models aiming at individuals are established for different users, and after the users are identified, the next action of the users is pre-judged by using the associated pre-judging models.
Preferably, the acousto-optic display device comprises a visual information display device for displaying visual effects and visual guide information;
the method comprises the steps of obtaining real-time orientation data, traveling speed data and gesture action data of a user, keeping a visual information display device at a position where the orientation of the user is a certain distance away from the user along with the orientation, traveling speed and gesture action of the user, and displaying visual guide information of the next step of the user; or the visual effect is displayed according to the position of the current user or other users and the position of the current user or other users;
or based on the route requirement of the user and the real-time position information of the user, performing collaborative calculation by using a peer-to-peer network to obtain visual information display equipment matched with the position of each user needing visual guidance information display in the next step; the visual information display equipment keeps a position at a certain distance from the user relative to the real-time position information, the real-time traveling speed and the real-time gesture action of the user, and displays the next visual guide information of the user; or the visual effect is displayed corresponding to the position of the current user or other users and following the position of the current user or other users.
Preferably, the distance between the visual information display device displaying the visual guidance information and the user is calculated based on the height and the step length of the user.
Preferably, the sound and light display device comprises an audio playing device for playing audio effects and audio guide information; acquiring real-time position information, traveling speed data and gesture action data of a user, following the position, the traveling speed and the gesture action of the user, keeping an audio playing device with a sound field covering the position of the user, and playing an audio effect and audio guide information of the next step of the user;
or, based on the route requirement of the user and the real-time position information of the user, performing collaborative calculation by using a peer-to-peer network to obtain audio playing equipment matched with the position of each user needing to play the audio guide information in the next step; and relative to the real-time position information, the real-time advancing speed and the real-time gesture action of the user, the audio playing device which keeps the sound field covering the position of the user plays the audio effect and the audio guide information of the next step of the user.
Preferably, the audio playing device is arranged above the display area and is provided with a downward sound gathering cover, and the sound gathering cover is used for limiting a sound field of the audio playing device within a certain range;
or, the super-directional loudspeaker with the holder is adopted, and the emitting angle is adjusted according to the direction and the traveling speed of a user who listens to the audio effect and the audio guide information.
Preferably, the physical attributes of the users in the display area are acquired through the corresponding type of sensors which are deployed in the display area and cover the display area, the route requirements of the users are acquired through the human-computer interaction devices which are associated with the users, and the acousto-optic effect and the next-step guiding information for each user are acquired through the cooperative computing through the peer-to-peer network.
Preferably, the route demand is inferred from play content for the user, the play content comprising a determined or estimated destination, the determined or estimated destination being the next to the final destination or a plurality of consecutive destinations.
Preferably, the peer-to-peer network is utilized to perform non-specific feature identification and location identification on the user;
the peer-to-peer network comprises a plurality of node devices, and all the node devices have no primary and secondary relation; the node equipment is provided with a data acquisition device and an operation module, wherein the data acquisition device comprises at least one type of sensor and is used for acquiring different corresponding types of sensing data; the node equipment arranged at different acquisition positions acquires at least one sample of a user, wherein the sample is sensing data corresponding to the type of the sensor;
for a certain node device, processing the acquired sensing data to obtain result data, and transmitting the result data to other node devices; the other node equipment which receives the result data takes the result data as one of the collected original data, and the result data of the other node equipment is influenced by the result data; based on the method, under the condition that identity information of the user does not need to be acquired, a plurality of node devices in the peer-to-peer network perform collaborative calculation, each unique user is determined to be the unique user, non-specific feature identification is achieved, and position identification is performed on the user.
Preferably, the current node device receives result data output by other node devices; for the current node equipment, combining the acquired sensing data with result data from other node equipment, calculating to obtain the result data of the current node equipment, and sending the result data to other node equipment; and the node equipment in the peer-to-peer network performs cooperative calculation along with the acquisition of the sensing data and the calculation of the result data.
Preferably, in the peer-to-peer network, for a certain sample book of a certain user, in the result data transmitted from the node device which collects the sample of the sample to other node devices, the subsequent node device adjusts the perception attention according to the characteristics of the sample of the point, or reports the characteristics of the sample book for the subsequent node device to adjust the perception attention; if the other node device in the following does not detect the characteristics of the point sample, but can determine that the characteristics of the point sample which cannot be detected still belong to the user from the characteristics of the other point sample, the characteristics of the point sample which cannot be detected are continuously represented in the result data of the current node device and are transmitted to the other node device.
Preferably, the method of reporting characteristics of the sample book for a subsequent node device to adjust perceived attention is: adjusting parameters of a data processing model of subsequent node equipment according to result data of the characteristics of the expression point sample provided by the pre-order node equipment or the characteristics of the sample book, so that the subsequent node equipment improves the calculation force for identifying the characteristics of the sample book; alternatively, subsequent node devices make computational adjustments using a perceptual attention model to match the characteristics of the received point samples or the resulting data expressing the characteristics of the point samples.
Preferably, when the node device processes result data output by a plurality of preceding node devices, based on the data processing model, when users described by the plurality of preceding node devices can be determined as the same user by some common sample book features, sample book features and other information described by each node device are merged to the same user.
Preferably, when the result data received by the node device indicates that the current node device receives the result data at the previous time, the flag for identifying the user is different from the flags for identifying the user of other node devices, and the flags allocated by other node devices to the user are updated, the flag for identifying the user by the current node device before receiving the result data at the previous time is converted.
Preferably, the method for converting the flag used by the current node device to identify the user before the current reception of the result data is as follows:
replacing the mark used for identifying the user by the current node equipment before the current node equipment receives the result data with the mark distributed to the user by the latest other node equipment;
or recording the conversion relation between the mark used for identifying the user by the current node device before the current node device receives the result data and the updated mark distributed to the user by other node devices, and converting when the result data received by the current node device at the current time needs to be referred;
or the node device deploys a conversion model, and performs corresponding conversion on the marks of a plurality of users according to the input original data or result data.
Preferably, for one or more point samples collected successively by the node devices at different collection positions, if the characteristic values of one or more point samples at different collection positions respectively meet preset similar conditions or are judged to have correlation reaching a threshold value by a specific model, and each collection position is unique, the point samples at different collection positions are judged to have correlation.
Preferably, for one or more point samples collected by node devices at different collection positions at the same time, if the node devices at different collection positions collect the same spatial field, and when only one user exists in the spatial field or the collected point sample book can correctly point to one of multiple users, for a certain user, the one or more point sample books collected by the node devices at different collection positions have relevance.
Preferably, the data acquisition device of the node equipment comprises one or more of an image acquisition device, an electromagnetic induction device, a temperature measurement device and a vibration frequency sensing device and a laser radar, and the data acquired by the device and the three-dimensional point cloud acquired by the laser radar or the point cloud generated according to the images acquired by the plurality of image acquisition devices are subjected to combined calculation to obtain the three-dimensional point with the data; taking the image color, contour, line, reflectivity, motion trend, electromagnetic characteristic, temperature change trend, vibration frequency and vibration frequency change trend based on two-dimensional perception as additional attributes of corresponding three-dimensional points to form three-dimensional point cloud with attributes; and determining the corresponding relation between each area of the three-dimensional point cloud with the attributes and each part or associated part of the 3D appearance of the user by combining the electromagnetic induction, the temperature law, the change characteristics of the vibration frequency, the motion correlation and the reflectivity.
Preferably, when the identity information of the user needs to be acquired, the identity information acquisition command is triggered, the identity information acquisition command is used as one of input to participate in calculation of result data of the node device, and the identity information of the user is acquired by driving the node device connected with the barrier-free data acquisition condition capable of acquiring the identity information of the user in the peer-to-peer network to respond to the corresponding result data.
Preferably, the peer-to-peer network checks the authenticity of the identity information of the user, and further determines the authority of the user; the node equipment capable of acquiring the identity information in the peer-to-peer network does not provide the identity information, and the checking result is expressed in the result data of the node equipment only according to the checking requirement on the authenticity of the identity information in the received result data.
Preferably, the node device capable of acquiring the identity information in the peer-to-peer network does not provide the identity information, and drives the information source device providing the identity information to establish an encrypted information transmission channel through an encrypted file transmission channel established between the information source device and the node device input terminal needing to acquire the identity information or in other network communication modes; identity information is used as one of the inputs to the node device.
Preferably, the data acquisition device comprises one or more of an image acquisition device, an audio acquisition device, a temperature measurement device, a vibration frequency sensing device, a laser radar, a chemical sensor and an electromagnetic induction device.
Preferably, the human-computer interaction device associated with the user is used as access equipment to be connected with the node equipment and submits a route requirement to the peer-to-peer network; each acousto-optic display device is added into the peer-to-peer network through one or more node devices; and if the acousto-optic display equipment is judged to be presented based on the corresponding acousto-optic effect and the next guiding information of the user based on the cooperative calculation, the current node equipment sends an instruction to the acousto-optic display equipment connected to the current node equipment according to the result data obtained by calculation, and the acousto-optic display equipment is controlled to finish the acousto-optic effect and the guiding information presentation.
Preferably, the acousto-optic effect and the guiding information of the next step of the user represent result data; and the acousto-optic display equipment receives result data output by the connected node equipment, and if a specific element in the result data indicates that the acousto-optic display equipment needs to perform acousto-optic effect and guide information presentation, or the result data is used as one of the inputs of a data processing model of the node equipment, and the acousto-optic display equipment calculates and determines that the acousto-optic effect and the guide information need to be presented by the corresponding acousto-optic display equipment, the acousto-optic display equipment presents corresponding acousto-optic effect and guide information.
Preferably, when the acousto-optic display device is required to present acousto-optic effects and guide information, the acousto-optic display device calculates result data of the acousto-optic display device by combining received result data output by other node devices, and controls the acousto-optic display device to present corresponding acousto-optic effects and guide information through the obtained result data.
Preferably, for the acousto-optic display equipment, the result data obtained by calculation comprises the optimal solution of all conditions obtained by performing collaborative calculation on all users in the display area and the external environment at the current moment; and the acousto-optic effect and the guiding information of the next step of the user are presented through the acousto-optic display equipment.
Preferably, the acousto-optic display device receives result data output by other node devices, and the principle is as follows: when the corresponding acousto-optic display equipment is required to present acousto-optic effect and guide information, if the acousto-optic display equipment which is required to present acousto-optic effect and guide information can be determined by result data obtained by calculation of one or more node equipment, the corresponding acousto-optic display equipment is added into a node list for transmitting current result data, and the one or more node equipment directly transmits the result data to the acousto-optic display equipment or the node equipment connected with the acousto-optic display equipment; or the acousto-optic display equipment receives result data output by other node equipment in a layer-by-layer transmission mode.
Preferably, corresponding acousto-optic display equipment is added into a node list for transmitting result data according to preset conditions or algorithm output and model output.
Preferably, the acousto-optic display device is a node device of an execution component with a specific function, and execution feedback information of the execution component of the acousto-optic display device is fed back to the acousto-optic display device to participate in calculation of subsequent result data of the acousto-optic display device.
Preferably, when the result data of the collaborative calculation judges that the orientations and the traveling speeds of the users are consistent, the distances between the users meet the criterion of the same-row distance, and only the route requirement of one user or the obtained route requirements of the users are the same, the users are grouped into the same-team user group.
Preferably, among users in the user group in the same team, based on the result data of the collaborative calculation, if the vision and/or hearing of part of the users are judged to be interfered by other users, the users who are required by the acquired route or the frontmost users who have correct orientation of the next guiding information of the corresponding users are preferentially shown with the vision guiding information and/or played with the audio guiding information; if the vision and the hearing of the user with the acquired route requirement are interfered by other users, the users without the interference of the vision or the hearing show the visual guide information or play the audio guide information;
and if the vision and hearing of all users are not interfered by other users, showing the visual guide information and playing the audio guide information to each user.
The invention has the following beneficial effects:
the method for displaying the acousto-optic effect under the line is based on the recognition of the orientation, the advancing speed and the gesture action of the user, and aiming at the user or other users, the acousto-optic display equipment is used for displaying the corresponding acousto-optic effect in the display area, so that the user or other users can obtain immersive experience in the environment where the user or other users are located. The acousto-optic effect display method can also realize the corresponding interactive acousto-optic effect based on the interaction between users; the directivity and the interactivity of the acousto-optic effect can be realized by combining the orientation, the advancing speed and the gesture action of the user.
The invention can also associate the online game attribute with the offline game, the online game attribute can be used for determining the style of the acousto-optic effect correspondingly displayed in the online offline game of the user, and the user interacts with the offline behavior to influence the game attribute so as to determine the online game attribute and realize online and offline linkage.
The invention is applied to scenic spots and venues, and not only can display content information in the scenic spots and venues through acousto-optic effect, but also can realize immersive tourism; the online game system can also combine scenic spots, venues and online games, play games by using immersive acousto-optic effect display and offline behaviors, realize online and offline linkage by associating the acousto-optic effect displayed offline with the online games, and increase the diversity of online games and offline tourism.
The method is based on the identification and the positioning of the user, and guides the user through the acousto-optic display equipment deployed in the surrounding environment of the user, so that the user can get rid of the handheld terminal equipment in the guiding process; furthermore, the problems of poor precision and instantaneity caused by inherent defects of the technology, performance influence of hardware related to the handheld terminal equipment, more environmental interference factors and the like in the prior art do not exist.
According to the method and the device, the physical attributes of the users in the display area are acquired through the corresponding type of sensors which are deployed in the display area and cover the display area, the users are identified and positioned, a pure intranet can be constructed, navigation can be achieved, and potential data safety hazards caused by data interaction through a public communication platform are avoided. The method can be implemented in any scene where the sensor can be deployed, and has strong universality.
The invention utilizes the peer-to-peer network to carry out cooperative calculation, and carries out nonspecific feature identification and position identification on all users in the display area so as to complete identity identification and positioning; in the peer-to-peer network, all node devices have no primary and secondary relation, no fixed connection path exists among the node devices, the node devices only receive calculation results of other node devices and send out self calculation result data, and the discovery of events and/or the response of corresponding acousto-optic display devices are identified and controlled without depending on a single node device, but are cooperatively calculated and jointly confirmed through a plurality of node devices in the peer-to-peer network. Furthermore, the invention can distribute the operation function to the whole network without depending on single-point identification of the user, thereby reducing the software and hardware requirements of single-point operation, having high execution efficiency and greatly improving the anti-attack capability; the node devices are in a relatively information symmetrical state, the problem of illegal data tampering can be solved, even if a single node device is physically cracked to tamper the sent data, because the whole network operation is ultrahigh-redundancy complex calculation and ultra-multi-dimensional check, the data sent by the single node device is tampered without influencing the whole network calculation result, the fault and the tampered node device can be quickly positioned, the reliability of the whole network calculation result is ensured, and further, the contradiction between data sharing and information safety among departments can be solved.
The invention can determine each unique user as the user without specific characteristics and acquiring specific identity information, thereby realizing non-specific characteristic identification. The invention carries out user identification, identity confirmation or event monitoring in a non-specific characteristic identification mode, and has high identification result accuracy and accurate position identification. The invention can carry out user identification and identity confirmation without depending on specific characteristics, protect privacy and solve the problems of traffic, education, medical convenience, epidemic prevention, civil service, emergency, community service, market behavior, safe production, civilized behavior and the like.
The invention adopts nonspecific characteristic identification, on the other hand, the risk caused by specific characteristic theft or imitation can be effectively prevented, and the safety is greatly improved. The invention adopts a non-contact passive mode to perform non-inductive identification on the identity of the user, thereby greatly improving the execution convenience. Based on the peer-to-peer network, the invention can easily arrange the coverage area on the level of hundred meters or hundreds of kilometers, and is suitable for the regional areas of various levels.
In the invention, the peer-to-peer network does not directly carry out stand-alone control on the acousto-optic display equipment; the response execution (namely presenting acousto-optic effect and guiding information) of the acousto-optic display equipment is correspondingly controlled based on the calculation result obtained by the cooperative calculation, the response efficiency is high, and illegal responses such as false execution or non-execution during the execution caused by network attack are avoided. In order to avoid hijacking, the invention can also use a plurality of node devices to cooperatively control the acousto-optic display device, thereby further improving the immunity to the hijacking attack.
Detailed Description
The present invention will be described in further detail with reference to examples.
The invention provides an offline acousto-optic effect display method for solving the defects of poor universality, poor precision and poor real-time performance, dependence on a handheld terminal device and the like in the prior art, and realizes the immersive experience of a user or other users by displaying the acousto-optic effect of acousto-optic display equipment deployed in the surrounding environment of the user aiming at the user based on the identification of the offline behavior (including but not limited to orientation, traveling speed and gesture actions) of the user; based on the identification and location of the user, the user is guided by a sound and light display device deployed in the user's surrounding environment. According to the invention, in the acousto-optic effect display and guidance process, a user can get rid of the handheld terminal equipment, so that the interaction between the users and the immersive experience of the acousto-optic effect can be realized in the acousto-optic effect display process, and the high precision and the high real-time performance can be realized in the guidance process. According to the method, the physical attributes of the users in the display area are acquired through the corresponding type of sensors which are deployed in the display area and cover the display area, the users are identified and positioned, a pure intranet can be constructed, the acousto-optic effect display and navigation aiming at the users can be realized, and the potential data safety hazard existing in data interaction by utilizing a public communication platform is avoided; the invention can be applied to any scene where the sensor can be deployed, and has strong universality.
According to the method for displaying the acousto-optic effect under the line, the acousto-optic display equipment is deployed in the display area, and the acousto-optic effect is performed on the user at the position of the user through the acousto-optic display equipment in the environment where the user is located, so that immersion type experience of the user is achieved. Moreover, the acousto-optic display device can also be used for displaying corresponding information content to a user at a required position in a display area to serve as an information output function, and can be used for displaying specific information content at a specific scenic spot and a specific position to fulfill the aim of visiting if being implemented in a scenic spot and a venue. In the invention, specifically, orientation data, traveling speed data and gesture action data of a user are obtained, namely, the orientation, the traveling speed and the gesture action of the user are detected and recognized; and then displaying the acousto-optic effect corresponding to the current orientation, the advancing speed and the gesture action of the user through the acousto-optic display equipment based on the orientation, the advancing speed and the gesture action of the user. When the method is specifically implemented, the orientation, the advancing speed, the gesture actions and the combination thereof of the user or the orientation, the advancing speed, the gesture actions and the combination thereof at a plurality of continuous moments (namely, the offline behavior of the user) can be exhausted, the corresponding acousto-optic effect is set, the offline behavior of the user is correspondingly triggered, and then the acousto-optic display equipment corresponding to the position where the acousto-optic effect needs to be displayed is displayed. The sound and light effect can be shown for the user who performs offline behavior, and can also be shown for other specified users (based on identification and positioning of other users), for example, the other specified users are determined by the orientation and gesture actions (pointing direction of fingers or arms) of the user.
When the online game and offline travel linkage system is suitable for online game and offline travel linkage, the game attributes comprise online game attributes and offline game attributes, the online game attributes correspond to the categories of the online game attributes, if the current orientation, the traveling speed and the gesture actions of the user influence the game attributes of the user, the corresponding sound and light effects are displayed for the user, and the game attributes of the user or other users are modified; if the current orientation, the traveling speed and the gesture action of the user correspondingly influence the game attributes of other users, the corresponding acousto-optic effect is displayed for the other users, and the game attributes of the user or other users are modified. For example, when a team PK is used, one or more users make an account of a halo effect (game skill corresponding to triggering is a skill affecting game attributes of teammates) or release skill (game skill corresponding to triggering is a skill affecting game attributes of the other party) by using an offline action, and the acousto-optic display device displays corresponding acousto-optic effects (including picture presentation and sound playing) according to the orientation, the traveling speed and the gesture actions of the users. Correspondingly, the corresponding acousto-optic effect is displayed in the environment of the teammate or the other party at the position of the teammate or the other party. For other users that are designated (e.g., from teammates, or from each other), the same is true of passively exhibiting a sound and light effect at their location in the environment in which they are located. Meanwhile, the game attributes of the related users are modified according to the received influences, such as buff addition from teammates, attack power (one of the game attributes) improvement of other teammates, attack from enemies, life value (one of the game attributes) reduction of attacked users, and the like.
When the online game and the offline game need to be linked, the offline game and the online game can be associated, the online game attribute of the user is read, the online game attribute and the offline game attribute correspond or are correspondingly converted during specific implementation, and the matched acousto-optic effect is calculated according to the online game attribute. For example, the levels of the online game attributes are different, and the online acousto-optic effect has corresponding difference, so that the results of the influence of the offline behavior on the game attributes among the users are determined to be different, for example, the higher the level is, the higher the attack power is, the larger the range of the acousto-optic effect is, and the higher the influence on other users is. The invention realizes online and offline linkage, and offline is the influence on the game attribute of the user, and in the process of user interaction, the game attribute of the user is modified, and the modified game attribute corresponding to the influence of the online and offline user on the game attribute of the user or other users is uploaded to an online game server according to a preset rule, so as to update the online game attribute of the user.
The invention can be implemented as script type tourism and immersive play tourism, and guides the user to complete the whole tourism process through the progress of the script and the game. In the process, the user can be guided, so that the user can finish traveling according to the scenario and the game plot. According to the invention, by identifying (or locking) and positioning the user, based on the route requirement of the user (which can be implemented as the initial position corresponding to the script or the game plot, a plurality of passing positions, and route requirements such as different requirements of game difficulty, path length, terrain complexity and the like), the next step action of the user is calculated and output one by one based on the conditions of all users in the acquisition range under the condition that the route requirement is met without calculating and generating the route information, and the user is gradually guided to the destination. When the invention is used for navigation (namely guiding the user according to the scenario and the game plot), the route requirement aiming at the user is firstly obtained, and the position information of the user is obtained in real time; then, based on the route requirement and the real-time position information of the user, calculating the next step guiding information of the user; the guiding information is presented through the acousto-optic display equipment at the position corresponding to the real-time position information of the user and is used for guiding the user. The invention guides the user in stages, and usually can present guiding information to the user at the position where the route selection is needed (the complete route information is not selected, in fact, the invention does not generate the complete route information, but the user is needed to select one of the routes when meeting an intersection) so as to guide the user to select the proper traveling direction; and so on until navigation is completed.
In this embodiment, the acousto-optic display device may be implemented as a visual information display device or an audio playing device or a combination of both, and when implemented specifically, can be selected according to the implementation scene and the performance requirement; the visual information display device is projection device (projected on the ground or wall surface), special display device (arranged on the ground or wall surface), multipurpose display device (such as billboard, lamp box, signboard, outdoor display screen, etc.) or various combinations thereof; the audio playing device is a dedicated playing device, a multi-purpose playing device (such as an advertisement terminal with a sound playing function, a background music playing device, an information broadcasting device, etc., or a plurality of combinations thereof). When there are multiple users and the guiding information needs to be presented to the multiple users at the same time, different types of acousto-optic display devices can select a presentation mode suitable for the features of their own functions, for example, a projection device can simultaneously display the visual guiding information belonging to each user, and an audio playing device can play the audio guiding information belonging to each user one by one. When the guide information and the acousto-optic effect are triggered simultaneously, the guide information and the acousto-optic effect can be displayed simultaneously, and the guide information or the acousto-optic effect is preferentially displayed according to setting, if the acousto-optic effect is a flash bomb, the guide information is not displayed so as to express the effect of the flash bomb; when the user has the virtual prop for counteracting the flash bomb, the display effect of the guide information is stronger than the acousto-optic effect so as to express the effect of the prop.
In order to improve user experience and realize pre-guidance of a user without stopping the user when the user travels, the method also acquires orientation data, travel speed data and gesture action data of the user, and pre-judges the next action of the user by using a pre-judged model trained in advance by using a pre-set condition (such as a pre-set judgment standard) or machine learning, wherein the pre-judged model comprises the orientation, travel speed and gesture action of the user; if the gesture motion data is "east-west" user, the travel speed will typically slow or stop; the gesture motion data is for a user "looking straight ahead", the travel speed data is for a user "walking fast", the travel speed is usually maintained or may be increased, etc. Then, the acousto-optic display equipment which is matched with the predicted position of the next step of the user, such as the orientation, the advancing speed and the gesture action, presents acousto-optic effect and the guide information of the next step of the user; if the traveling speed is predicted to be slowed or stopped, the acousto-optic effect and the presenting time of the next guiding information of the user can be correspondingly delayed or not displayed until the user moves to the position where the acousto-optic effect and the guiding information need to be presented, and the neutral time can be used for presenting other contents, including acousto-optic effect and guiding information aiming at other users or other types of contents; for example, for a user whose traveling speed is predicted to be kept or accelerated, the sound and light effect and the presentation time of the guidance information of the next step of the user can be kept or correspondingly advanced. Therefore, the acousto-optic effect and the guiding information are dynamically and actively adjusted, and not only the positioning of the user is relied on, but also the guiding information is realized.
The method comprises the following steps of obtaining height data, leg length data and step frequency data of a user, and calculating the traveling speed of the user, wherein the advance judgment of the traveling speed of the user can be carried out through an auxiliary means; and if the prediction of the next action of the user is not accurate, replacing the predicted travelling speed with the measured travelling speed.
And if the pre-judgment on the acousto-optic effect or the next action of the user is not accurate, modifying the acousto-optic display equipment presenting the acousto-optic effect and the guidance information of the next step of the user based on the real-time orientation data, the travelling speed data and the posture action data of the user, and adding the personnel density and the environmental information around the user, the orientation data, the travelling speed data and the posture action data of the personnel around the user as training samples into a sample library for further training and adjusting the pre-judgment model so as to improve the accuracy of the pre-judgment model. In order to further improve the accuracy of the pre-judging model, the invention can establish the pre-judging model aiming at the individual aiming at different users, and after the user identifies, the associated pre-judging model is used for pre-judging the next action of the user.
When the acousto-optic display equipment is implemented as visual information display equipment, the acousto-optic display equipment is used for displaying visual effects and visual guide information; in order to improve the experience of a user for acquiring visual guide information, the visual guide information display device acquires real-time orientation data, travelling speed data and gesture action data of the user, keeps a position where the orientation of the user is at a certain distance from the user along with the orientation, travelling speed and gesture actions of the user, and displays the visual guide information of the next step of the user; the display of the visual guidance information is displayed at a position where the user can conveniently watch along with the orientation and the traveling speed of the user, and the display effect is the display of the user moving in the same direction and at the same speed. Or the visual effect is displayed according to the position of the current user or other users and the position of the current user or other users.
As another embodiment, based on the route requirement of the user and the real-time position information of the user, the peer-to-peer network provided by the invention is utilized to perform collaborative calculation, and the visual information display equipment matched with the position of each user needing to perform visual guidance information display in the next step is obtained; and the visual information display equipment keeps a position at a certain distance from the user relative to the real-time position information, the real-time advancing speed and the real-time gesture action of the user, and displays the next visual guide information of the user. Or, the position of the current user or other users is corresponded, and the visual effect is displayed by following the position of the current user or other users. The peer-to-peer network provided by the invention can perform nonspecific feature identification on the user based on cooperative computing, and determine the real-time position, orientation, traveling speed and posture action of the user, and meanwhile, based on the result of the cooperative computing, the visual information display equipment which needs to display the visual effect and the visual guide information can display the corresponding visual effect and the visual guide information.
The distance between the visual information display equipment for displaying the visual guide information and the user is obtained by calculation based on the height and the step length of the user.
When the acousto-optic display equipment is implemented as audio playing equipment, the acousto-optic display equipment is used for playing audio effects and audio guide information; in order to improve the experience of a user for acquiring audio guide information, the invention acquires real-time position information, traveling speed data and gesture action data of the user, follows the position, the traveling speed and the gesture action of the user, keeps an audio playing device with a sound field covering the position of the user, and plays an audio effect and the audio guide information of the next step of the user; namely, the audio effect and the audio guide information are played at the position where the sound field is aligned with and covers the user along with the orientation, the advancing speed and the gesture action of the user, and the playing effect is played in the same direction and at the same speed as the user.
As another embodiment, based on the route requirement of the user and the real-time position information of the user, the peer-to-peer network provided by the invention is utilized to perform collaborative calculation, and audio playing equipment matched with the position of each user needing to play audio guide information in the next step is obtained; and relative to the real-time position information, the real-time advancing speed and the real-time gesture action of the user, the audio playing device keeps the sound field covering the position of the user, and plays the audio effect and the audio guide information of the next step of the user. The peer-to-peer network provided by the invention can perform nonspecific feature identification on the user based on cooperative computing, and determine the real-time position, orientation, traveling speed and posture action of the user, and meanwhile, based on the result of the cooperative computing, the audio playing device which needs to play the audio effect and the audio guide information can play the audio effect and the corresponding audio guide information.
The sound gathering cover is used for limiting a sound field of the audio playing equipment within a certain range, for example, the sound can be clearly transmitted to a space below the audio playing equipment, which is needed by one person to walk, and the sound can be diffused to the periphery as little as possible; or, the super-directional loudspeaker with the holder is adopted, and the emitting angle is adjusted according to the audio effect and the direction and the traveling speed of the user listening to the audio guidance information, so that the super-directional loudspeaker is aligned to the user.
In order to get rid of dependence on the handheld terminal device, the physical attributes (physical space, sound, appearance, body temperature, smell and other elements) of the user in the display area are obtained through the corresponding type of sensor which is deployed in the display area and covers the display area, the route requirement of the user is obtained through the human-computer interaction device (which can be implemented as a fixed or mobile device and only needs to be used for submitting the route requirement) associated with the user, and the acousto-optic effect and the next step guiding information aiming at each user are obtained through the peer-to-peer network provided by the invention for collaborative calculation.
In particular embodiments, the human-machine interaction device may be omitted, and the routing requirement may be determined from play content for the user, the play content comprising a determined destination or an estimated destination, the determined destination or the estimated destination being the next to the final destination or a plurality of consecutive destinations. The invention can implement the playing content as the whole course or stage content of the scenario or game plot, when the peer-to-peer network covers the range of the user's route requirement, the user goes out, namely, the user starts from the starting position, then the peer-to-peer network carries out real-time calculation of various states and requirements, the various requirements comprise the calculation of the navigation requirement, and the peer-to-peer network can realize that the user is gradually guided to the indoor from the road and then gradually guided to the destination (or the next of a plurality of continuous destinations) in various calculations carried out according to laws, regulations and user protocols.
In specific implementation, a traditional single-point identification method can be adopted to identify the identity of the user at a set position, so that the aim of identifying the associated position information by the identity is fulfilled; the peer-to-peer network-based cooperative computing provided by the invention can also be adopted to carry out non-specific characteristic identification. The peer-to-peer network is based on cooperative computing, does not need Lai Shandian identification, fully distributes the operation function to the whole network, relieves the software and hardware requirements of single-point operation, has high execution efficiency and greatly improves the anti-attack capability; the node devices are in a relatively symmetrical information state, so that the problem of illegal data tampering can be solved, even if a single node device is physically cracked to tamper the sent data, because the whole-network operation is ultrahigh-redundancy complex calculation and ultrahigh-dimensionality check, the data sent by the single node device is tampered without influencing the whole-network calculation result, the fault and the tampered node device can be quickly positioned, the reliability of the whole-network calculation result is ensured, and further, the contradiction between data sharing and information safety among departments can be solved.
The result data transmitted between the node devices can be information processing results, but not information, so that the acquired original data (namely sensing data) can not be stored, the node devices only receive the calculation results output by other node devices and send out the calculation results of the node devices, the information content of a single calculation result is not enough to restore any event and target information, the calculation results, the multidimensional data matrix elements and the corresponding relation of physical space and facilities on the whole peer-to-peer network are combined to perform cooperative calculation to obtain a determined result, the cooperative calculation has small information dependency on the transmission of a few node devices, and the essence of traditional informatization single-point safety and sensitivity can be fundamentally changed.
In the invention, the identity information and the position information of the user are acquired through the peer-to-peer network provided by the invention. Specifically, the peer-to-peer network is utilized to perform non-specific feature identification and location identification on the user. The term "non-specific feature recognition" is different from the term "recognition" in the strict conceptual definition. "identify" in the general sense means to determine the identity of a user or specific identity information of a user, such as who is specific (including name, specific information indicating the identity of the user), what is (such as car, person, etc.). The term "identification" in the "non-specific feature identification" of the present invention means that each unique user (i.e., user, fixed or moving object other than the user) is determined to be itself; that is, the existence of a certain object to be identified is unique, and after the invention realizes the 'non-specific feature identification', namely the object to be identified (i.e. a user which is not identified or identified) is determined to be the object per se, but not other objects to be identified, the result of the 'non-specific feature identification' does not need to determine the specific features of the object to be identified, and does not need to determine the identity information or the specific image of the object to be identified. For example, for a person, the object a to be confirmed is regarded as the object B to be confirmed, and after the non-specific feature recognition is realized, the person and the specific identity of the object a to be confirmed do not need to be recognized, and the object B to be confirmed, specifically what item, does not need to be recognized; it is determined that the object a to be confirmed is the object a itself to be confirmed, and the object B to be confirmed is the object B itself to be confirmed. Then, corresponding service or control can be performed for the object A to be confirmed or the object B to be confirmed.
The peer-to-peer network comprises a plurality of node devices, and all the node devices have no primary and secondary relation to form a decentralized network and a computing framework. Different from the traditional information single-point convergence type calculation mode, the direction of data transmission between the node devices does not have a fixed and preset path relation. In the peer-to-peer network, for a certain node device, the acquired original data is processed to obtain result data, and the result data is transmitted to other node devices; and the other node equipment which receives the result data takes the result data as one of the collected original data, and the result data influences the result data of the other node equipment. For convenience, one of the effects is that the result data obtained by calculation of the subsequent node device is not completely determined by the original data acquired by the subsequent node device, but is determined together with the result data output by the current node device; the result data output by the current node device may change a data processing model and parameters used by the subsequent node device to calculate the result data, and further affect the result data of the subsequent node device. For example, if there is a correlation between the result data output by the current node device and the original data acquired by the subsequent node device, the influence of the result data output by the current node device on the accuracy of the result data of the subsequent node device must be considered; specifically, for the perception of a specific user, if result data obtained by calculation is only calculated based on original data collected by subsequent node equipment, only real-time (including real-time location and time) single-point result judgment of the user in the perception range of the subsequent node equipment can be reflected; and the result data output by the current node equipment reflects direct perception data and result judgment about the user at other places and other moments or indirectly related other perception data and result judgment, so that the accuracy and the comprehensiveness of the result data of subsequent node equipment are improved, including superposition calculation of the same dimension and correlation reference of different dimensions.
Because node devices in the peer-to-peer network have no master-slave relationship, the node devices can perform point-to-point transmission, and further, for a calculation result corresponding to certain perception data of a certain user, which is reflected in result data output by a certain node device, information is relatively symmetrical in other node devices receiving the result data; the other node devices take the received result data as input, calculate the result data of the node devices by combining the sensing data of the sensor of the node devices, naturally cover the received result data and the information embodied by the sensor of the node devices, and transmit the result data to other node devices on the next layer, so that certain sensing data of a certain user is in a relatively symmetrical state of information in all the node devices, the calculation process of a single node device and the calculation result are immunized, the calculation result is distorted and the influence on the result data is caused, and the node devices which are failed or distorted and the node devices with unqualified performance are found. The invention is different from the technical scheme that each node is independently calculated, the result is determined and the original data storage is emphasized in the block chain technology, the invention emphasizes the peer-to-peer cooperative calculation among node devices, each node device can adjust the data processing model (namely the algorithm of the calculation result data) and the parameters when processing the data through the peer-to-peer cooperative calculation, the adjustment is the feedback of all the node devices on the self adjustment, thereby the calculation of all the node devices is changed into a whole, each node device does not independently complete the calculation any more, but all the node devices complete the calculation together. After the data processing model of the node device is adjusted, the adjustment which exists objectively will affect the next data processing.
The node equipment is provided with a data acquisition device (in specific implementation, the node equipment can comprise one or more of an image acquisition device, an audio acquisition device, a temperature measurement device, a vibration frequency sensing device, a laser radar, a chemical sensor and an electromagnetic induction device) and an operation module, wherein the data acquisition device comprises at least one type of sensor and is used for acquiring different corresponding types of sensing data. And the operation module calculates to obtain result data based on the data processing model. The node devices arranged at different collection positions (namely located at different physical installation positions) collect at least one point sample of the user, and the point sample is sensing data corresponding to the type of the sensor. Based on the method, under the condition that the identity information of the user does not need to be acquired, the plurality of node devices in the peer-to-peer network perform collaborative calculation, each unique user is determined to be the user, non-specific feature identification is realized, and the position identification is performed on the user.
Specifically, a certain node device is taken as a current node device, and data transmission of a preamble node device and a subsequent node device is combined (the preamble node device and the subsequent node device in the present invention are only used for describing a context in the current calculation and data transmission process with the current node device, and do not indicate that the context and the priority relationship are inevitable between the preamble node device and the subsequent node device), and correspondingly, the current node device receives result data output by other node devices (including the preamble node device), and the subsequent node device receives result data output by other node devices (including the current node device). And for the current node equipment, combining the acquired sensing data with result data from other node equipment (including the preorder node equipment), calculating to obtain the result data of the current node equipment, and sending the result data to the other node equipment (including the subsequent node equipment). Similarly, the working process of the subsequent node equipment is the same as that of the current node equipment, and the preorder node equipment also receives the result data of the preorder node equipment and carries out the working process which is the same as that of the current node equipment; that is, the node devices in the peer-to-peer network perform the same operation process. And then, carrying out cooperative calculation on the node equipment in the equal network along with the acquisition of the sensing data and the calculation of the result data. For the result data output by a certain node device, only the subsequent layer of node device receives and serves as input, and the result data of the subsequent layer of node device covers the result data of the preceding layer of node device (including the aforementioned certain node device).
In a peer-to-peer network, all events are processed synchronously, and it is not necessary to explicitly generate such staged result outputs as to what events are found, what the specific content of the events is, etc.; in the peer-to-peer network, only the perception of the sensor and the corresponding execution device (the invention is the acousto-optic display device) are definitely used for responding, and other intermediate processes are processed simultaneously through cooperative computing, namely, in the running process of the invention, the intermediate process of event discovery is non-perception, and the result data of the node device is obtained along with the cooperative computing, and the corresponding execution device automatically responds and executes.
In order to ensure that the data source and the calculation process are further credible, all the node equipment encrypts result data obtained by calculation based on an encryption consensus mechanism to obtain an encryption result, and then sends the encryption result to other node equipment. The encryption consensus mechanism comprises one or more consensus mechanisms, and different consensus mechanisms correspondingly change the encryption algorithm structure and parameters of the node equipment.
The node devices communicate with each other in data packets of a standard size (i.e., result data or calculation results). In the invention, the node equipment of the equal network is similar to the neurons of human beings, each neuron does not transmit specific data directly describing external events, and similarly, the node equipment does not output raw data, but processes the raw data acquired by a connected sensor and a data acquisition device into a data packet with standard size (namely result data or calculation result, nerve pulse similar to the neuron) according to a data processing model (similar to the biological characteristics of the neurons). The information content of a single data packet is not enough to restore any event and target information, a determined result can be obtained only by performing cooperative calculation jointly through a calculation result, a multidimensional data matrix element and a physical space and facility corresponding relation on the whole peer-to-peer network, the cooperative calculation has low dependence on data output by a few node devices, and the cooperative calculation simultaneously processes the requirements received or initiated by all the node devices, so that the cooperative check calculation of the related information with super-multidimensional property is realized, and the safety and sensitivity essence of the traditional informatization single point can be fundamentally changed.
In order to ensure the integrity of data and the effective execution of cooperative computing, the peer-to-peer network deploys a QoS mechanism, and the QoS mechanism preferentially ensures the transmission quality of result data between node devices.
In specific implementation, the networking mode of the peer-to-peer network is one or a combination of a 4G mode, a 5G mode or a MESH mode, so that the method is suitable for different application scenarios, and factors such as feasibility of implementation and cost consideration are integrated to realize an optimal solution. The MESH mode is based on an LTE system and is communicated at a physical layer of the LTE system; data is carried in a customized frame structure, and interaction is performed using a dedicated wireless communication protocol. The frame structure is customized to be suitable for peer-to-peer network calculation, and a proprietary wireless communication protocol developed for urban group peer-to-peer network calculation is adopted, so that the safety and the reliability of the urban group peer-to-peer network can be further improved. And the wireless algorithm is fully suitable for the multi-path channel environment based on the consensus mechanism control required by the peer-to-peer network calculation, the communication distance in the city is 100 meters to 10 kilometers, and the high-efficiency transmission at the distance of 120 kilometers can be realized under the condition that an omnidirectional antenna is adopted in the field. In this embodiment, the Mesh network communication distance is: the distance between indoor node devices is 50-150 meters, the distance between outdoor node devices is 50-120 kilometers, and the number of node devices accessible to each node is 65535. In addition, when networking is performed in the 4G mode and the 5G mode, the communication distance is not limited, and the number of the accessible node devices depends on the computing power of a computing chip and the communication time delay.
In the peer-to-peer network, aiming at a certain sample specimen of a certain object to be identified, in the result data transmitted from the node device for acquiring the sample specimen to other node devices, the subsequent node device can adjust the perception attention according to the characteristics of the sample specimen (the characteristics of the sample specimen are not necessarily included in the result data, but the characteristics of the sample specimen participate in the calculation of the preceding node device, so that the result data of the preceding node device can be input as the data processing model of the subsequent node device, and the data processing model of the subsequent node device can realize the effect of adjusting the perception attention in the calculation); alternatively, characteristics of the sample are reported for subsequent node devices to adjust the perception attention (characteristics of the sample are directly expressed in the result data). If the other node devices in the following do not detect the characteristics of the point sample, but the characteristics of the point sample which cannot be detected can be determined to still belong to the object to be identified from the characteristics of the other point samples, the characteristics of the point sample which cannot be detected are continuously expressed in the result data of the current node device and are transmitted to the other node devices. For example, the preamble node device senses the color on the object a to be recognized, and the current node device does not sense the color on the object a to be recognized, but it can be determined from the sensing data of other node devices that the object a to be recognized still exists in addition to other objects to be recognized, and then the color on the object a to be recognized, which is continuously not sensed, is still expressed in the result data of the current node device.
In this embodiment, the method for reporting the characteristics of the sample book for the subsequent node device to adjust the perception attention is as follows: adjusting parameters of a data processing model of subsequent node equipment according to the characteristics of the point sample provided by the previous node equipment, so that the subsequent node equipment improves the calculation force for identifying the characteristics of the point sample; alternatively, subsequent node devices use the perceptual attention model to match the characteristics of the received point samples for computational adjustment.
The above-mentioned "feature" is different from the meaning of the "feature recognition" in the prior art, the "feature recognition" in the prior art generally refers to information capable of determining the identity of a user, and the "feature" in the present invention refers to a kind of sensed sensing data belonging to an object to be recognized, such as coordinates, colors belonging to the object to be recognized, and the like, and the "non-specific feature recognition" of the object to be recognized cannot be directly completed by only the "feature" sensed at a single point.
In this embodiment, the method for reporting the characteristics of the sample book for the subsequent node device to adjust the perception attention is as follows: aiming at result data provided by a front-order node device and expressing the characteristics of point samples (in the invention, the characteristics of the point samples are not provided in the result data in general, but are expressed in the result data), or the characteristics of the point samples (namely the characteristics of the point samples) adjust the parameters of a data processing model of a subsequent node device, so that the subsequent node device improves the calculation power for identifying the characteristics of the point samples; alternatively, subsequent node devices make computational adjustments using a perceptual attention model to match the received characteristics of the point samples or the resulting data expressing the characteristics of the point samples.
When the node devices process result data output by a plurality of previous node devices, on the basis of a data processing model, when objects to be recognized described by the node devices in the previous sequences can be determined as the same user through certain common sample book characteristics, sample book characteristics and other information described by the node devices are combined to the same user. For example, sample features in physical spaces that overlap almost completely at the same time can be determined to be the same user.
When the result data received by the node device indicates that the current node device receives the result data at the current time, the mark for identifying the object to be identified is different from the marks used by other node devices for identifying the object to be identified, and the marks allocated by other node devices for the object to be identified are updated, the mark used by the current node device for identifying the object to be identified before the current time receives the result data is converted. Specifically, the method for converting the flag used by the current node device to identify the object to be identified before the current reception of the result data is as follows:
replacing the mark used for identifying the object to be identified by the current node equipment before the current node equipment receives the result data with the latest mark distributed to the object to be identified by other node equipment; this provides a simpler embodiment of the invention.
Or recording the conversion relation between a mark used for marking the object to be identified by the current node equipment before the current node equipment receives the result data and a mark allocated to the object to be identified by other updated node equipment, and converting when the current node equipment needs to be referred to receive the result data at the current time; this is a relatively complex implementation of the present invention.
Or the node equipment deploys a conversion model, and correspondingly converts the marks of the objects to be identified according to the input original data or result data; this provides a more complex implementation of the present invention.
In the invention, in order to improve the effectiveness of non-specific feature recognition, for one or more point samples collected successively by node equipment at different collection positions, if the feature values of one or more point samples at different collection positions respectively accord with preset similar conditions or are judged to have correlation to reach a threshold value by a specific model, and each collection position is unique, the point samples at different collection positions are judged to have correlation.
On the other hand, for one or more point samples simultaneously acquired by the node devices at different acquisition positions, if the node devices at different acquisition positions acquire the same spatial field, when only one object to be identified exists in the spatial field, or the acquired point sample can correctly point to one of the multiple objects to be identified, for a certain object to be identified, the one or more point samples acquired by the node devices at different acquisition positions have relevance.
In the invention, a data acquisition device of node equipment comprises one or more combinations of an image acquisition device, an electromagnetic induction device, a temperature measurement device and a vibration frequency sensing device and a laser radar, and the data acquired by the devices (namely one or more combinations of the image acquisition device, the electromagnetic induction device, the temperature measurement device and the vibration frequency sensing device) and three-dimensional point clouds acquired by the laser radar or point clouds generated according to images acquired by a plurality of image acquisition devices are subjected to combined calculation to obtain three-dimensional points with data; the method comprises the following steps of (1) forming an attributive three-dimensional point cloud by taking image color, outline, line, reflectivity, motion trend, electromagnetic characteristic, temperature change trend, vibration frequency and vibration frequency change trend based on two-dimensional perception as additional attributes of corresponding three-dimensional points; and determining the corresponding relation between each area of the three-dimensional point cloud with the attributes and each part or associated part of the 3D appearance of the object to be identified by combining electromagnetic induction, temperature law, change characteristics of vibration frequency, motion correlation (different motion correlations presented by different materials such as ropes, cloth and the like) and reflectivity. In the embodiment, the relationship among the points and the corresponding relationship between each region to which each related point belongs and each part or related part of the 3D appearance of the object to be recognized are judged by using the attributes and the correlations of the three-dimensional point cloud with the attributes, so that the sample characteristic of the object to be recognized can be judged more accurately, and the efficiency and accuracy of the non-specific characteristic recognition are improved.
In the process of 'nonspecific characteristic identification', the invention can also acquire the identity information of the object to be identified if necessary. Specifically, when it is determined that the identity information of the object to be recognized needs to be acquired, an identity information acquisition command is triggered, the identity information acquisition command is used as one of input to participate in calculation of result data of the node device, and the node device connected with a barrier-free data acquisition condition capable of acquiring the identity information of the object to be recognized in the peer-to-peer network is driven to respond to corresponding result data, so that the identity information of the object to be recognized is acquired. The acquisition of the identity information is also a result of cooperative computation, that is, the acquisition of the identity information is triggered by the determination that the identity information needs to be acquired, rather than by an additional trigger through a specific request command. Based on the invention, if the permission calculation is triggered by the request command, most of the cases can be completed without acquiring the identity information, and a few of the cases can generate the judgment that the identity information needs to be acquired according to the implementation requirement when the permission calculation cannot be completed without acquiring the identity information. For example, it can be known through cooperative computing that identity information of a person exists in a code scanning registration system at some places, an express pickup registration system at some places, or a consumption registration system at some places, and authorization of the person is obtained in advance or inquiry authority is obtained according to law, the peer-to-peer network can drive node devices connected with these systems in a barrier-free data acquisition manner, the obtained related information is sent to the peer-to-peer network through each node device, and information comparison and accurate identity information provision are obtained. Based on this, the invention can also minimize the possibility of tampering with a system counterfeit identity.
Specifically, the peer-to-peer network checks the authenticity of the identity information of the object to be identified, and further determines the authority of the object to be identified; the node device capable of acquiring the identity information in the peer-to-peer network may not provide the identity information (or may provide the identity information according to the implementation requirement), and only according to the checking requirement for the authenticity of the identity information in the received result data, the checking result is expressed in the result data of the node device. That is, in the present invention, when the node device capable of acquiring the identity information does not provide the identity information, the result of the verification is expressed in the result data of the node device only according to the verification requirement for the authenticity of the identity information in the received result data.
When node equipment capable of acquiring identity information in a peer-to-peer network does not provide the identity information, driving an information source device providing the identity information to establish an encrypted information transmission channel through an encrypted file transmission channel established between the information source device and a node equipment input terminal needing to acquire the identity information or in other network communication modes; identity information is used as one of the inputs to the node device.
When necessary, in order to meet the requirements of other traditional computing modes on raw data, such as the traditional evidence-taking requirement, in this embodiment, a data storage device may be added to the node setup for storing the raw data sensed by the sensor.
In specific implementation, the node device can also be provided with functions such as leakage protection and the like on a power supply device. The node equipment can also provide various communication interfaces including an optical fiber interface, a wireless communication interface and the like; and a data interface can be provided for connecting the storage equipment externally. The node equipment can be powered by solar energy or commercial power. The implementation of the node equipment, such as outdoor implementation, can be installed on members such as street lamps (without a cross arm, clasped on a main rod or integrated in a lampshade); rodless areas, such as implemented indoors, may be wall mounted or integrated into the ceiling.
When the invention is implemented indoors and outdoors, the node equipment is used as an artificial intelligence facility installed in public space and can be used as an urban digital economic infrastructure for 24-hour uninterrupted seamless coverage. Through the cooperative calculation of the cross-node equipment, the vehicle identity recognition at any position in the coverage area can be realized with the accuracy rate close to 100 percent, and the position recognition accuracy is related to the sensor accuracy.
In the framework of the peer-to-peer computing network, all node devices are of the same type and have the same function, and each node device dynamically adjusts the data processing model of the node device in real time according to the consensus mechanism of the whole network. Raw data collected by a data collection device (including a sensor, a camera and the like) connected to each node device is processed and encrypted by the node device according to a data processing model of the node device, so that a byte-level processing and encryption result (namely, result data) is generated, and the result data is sent to other node devices (calculation and encryption results output by other node devices and received by the current node device at the same time also belong to one of the raw data collected by the current node device). Therefore, the effect of the raw data sensed by each sensor will be propagated among the peer-to-peer massive node devices according to the power level. If each node device sends its own result data to 100 peripheral node devices, four units of time later, billions of node devices are affected by events sensed by the sensor. Under the calculation mode, the information is relatively symmetrical, immune falsification and forgery are realized, the fundamental hidden danger of the traditional information technology is fundamentally solved, namely false information, forged information and error information are caused by the asymmetry of the information, and then the hidden danger becomes the entry point of fraud and network attack behaviors, and the problems of long complex comprehensive application period, poor precision, poor adaptability and the like are solved, so that the hidden danger really becomes an information infrastructure for comprehensive management of a larger area and becomes a digital economic infrastructure.
The invention utilizes the cooperative computing of the peer-to-peer network, and when the result data of the cooperative computing can determine a certain event, the discovery of the event is completed. In this embodiment, the discovery of the event by the peer-to-peer network includes the content of the event, the location where the event occurs, and the corresponding response handling. In a peer-to-peer network, all events are processed synchronously, and it is not necessary to explicitly generate such staged result outputs as to what events are found, what the specific content of the events is, etc.; in the peer-to-peer network, only the perception of the sensor and the corresponding execution device explicitly respond, and other intermediate processes are processed simultaneously by the cooperative computing, namely, in the running process of the invention, the intermediate process of the event discovery is non-inductive, and the result data of the node device is obtained along with the progress of the cooperative computing, and the corresponding execution device automatically responds and executes.
In the invention, each acousto-optic display device is added into a peer-to-peer network through one or more node devices. In order to avoid hijacking, the invention can use a plurality of node devices to cooperatively control the acousto-optic display device, thereby further improving the immunity to the hijacking attack. The man-machine interaction device associated with the user is used as access equipment to be connected with the node equipment and submits route requirements to the peer-to-peer network. In the present invention, the route requirement can be regarded as a request command that the user wants to automatically drive from one place to another. The response to the request command includes "demand-execute", "request-answer", or other various cases. When result data obtained by calculation of one or more node devices in the peer-to-peer network are matched with the request command, representing a result corresponding to the request command into the result data output by one or more node devices, and outputting a deployed program or a data processing model deployed on the node devices according to a preset condition or the advanced program. If the current node equipment is judged to need to respond to the request command based on the cooperative computing, the current node equipment sends an instruction to an execution device connected to the current node equipment according to the result data obtained by computing, and the execution device is controlled to finish a response action; i.e., the "demand-execute" case. In the invention, if the acousto-optic display equipment is judged to be presented based on the corresponding acousto-optic effect and the next guiding information of the user based on the cooperative computing, the current node equipment sends a command to the acousto-optic display equipment connected to the current node equipment according to the result data obtained by the computing, and the acousto-optic display equipment is controlled to finish the acousto-optic effect and the guiding information presentation.
Based on the cooperative computing of the peer-to-peer network, the executing device can be used as one of the node devices, and as the cooperative computing is performed, when the result data obtained by the computing of the executing device can perform relevant operations corresponding to the request command, the executing device completes the response to the request command. In the invention, the acousto-optic effect and the next guiding information of the user represent result data; and the acousto-optic display equipment receives result data output by the connected node equipment, and if a specific element in the result data indicates that the acousto-optic display equipment needs to perform acousto-optic effect and guide information presentation, or the result data is used as one of the inputs of a data processing model of the node equipment, and the acousto-optic display equipment calculates and determines that the acousto-optic effect and the guide information need to be presented by the corresponding acousto-optic display equipment, the acousto-optic display equipment presents corresponding acousto-optic effect and guide information.
When the acousto-optic display equipment is required to present acousto-optic effect and guide information, the acousto-optic display equipment calculates the result data of the acousto-optic display equipment by combining the received result data output by other node equipment, and controls the acousto-optic display equipment to present corresponding acousto-optic effect and guide information through the obtained result data. In the invention, the acousto-optic display equipment does not need to judge whether the acousto-optic effect and the guide information need to be presented or not, but the received result data output by other node equipment is combined with the sensing data acquired by the sensor of the acousto-optic display equipment and input into the data processing model of the acousto-optic display equipment, and the output result data is the acousto-optic effect and the guide information of whether the acousto-optic display equipment presents the acousto-optic effect and the guide information and what contents are presented.
In the invention, the result data obtained by calculation comprises the optimal solution of all conditions obtained by performing collaborative calculation on all users in the display area and the external environment at the current moment; and the acousto-optic effect and the next guiding information of the user are presented through the acousto-optic display equipment. In the invention, the results of the peer-to-peer network for various information calculations are embodied by result data, all the acousto-optic display equipment is used as one of the node equipment, and when participating in the cooperative calculation of the peer-to-peer network, the optimal solution containing all the conditions is output; furthermore, the control instructions of all the acousto-optic display devices are the optimal solution instructions output by the node devices connected with the acousto-optic display devices after the acousto-optic display devices are subjected to cooperative computing. The acousto-optic display equipment does not have the traditional generation instruction and sending instruction, namely, the security loophole caused by the generation instruction and the sending instruction is avoided, so that the acousto-optic display equipment becomes a risk point.
In this embodiment, the acousto-optic display device is a node device connected to an execution component with a specific function, and execution feedback information of the execution component of the acousto-optic display device is fed back to the acousto-optic display device to participate in calculation of subsequent result data of the acousto-optic display device.
In the invention, the acousto-optic display equipment can be used as one of the node equipment, the acousto-optic display equipment responds and executes correspondingly based on the calculation result obtained by the cooperative calculation, the response efficiency is high, and illegal responses such as false execution or non-execution during the execution and the like caused by network attack are avoided. In order to avoid hijacking, the invention can also use a plurality of node devices to cooperatively control the acousto-optic display device, thereby further improving the immunity to the hijacking attack.
In the peer-to-peer network, the result data obtained and output by the node device through calculation can be implemented as a state corresponding to the representation perception data (i.e. the original data), and can be represented by using a state value, and further, the node device does not need to store and send the original data. In this embodiment, data or elements in the multidimensional matrix are related to the installation position, the attribute, and the like of each node device, and thus when the result data is transmitted, the transcoding result after transcoding of multiple sets of parameters is actually transmitted. The multidimensional matrix is actually a combination of multiple sets of parameters, for example, the path of a certain user is fixed from a-b-c-d, and the physical position of an abcd node device, so that the sequence of abcd can be expressed by a character or a similar concept when multiple sets of parameters are transcoded and transmitted.
Based on the technical characteristics of the peer-to-peer network, the method can be applied to various usage scenarios for providing targeted services or control for a certain user or event. Based on this, because the result data transmitted between the node devices is the processing result of the information, not the information itself, and further, the acquired original data (namely, the perception data) is not stored, the node devices only receive the calculation results output by other node devices and send out the calculation results of the node devices, the information amount contained in a single calculation result is not enough to restore any event and target information, the calculation result, the multidimensional data matrix elements and the corresponding relationship between the physical space and the facility on the whole peer-to-peer network are combined to perform collaborative calculation to obtain a determined result, the collaborative calculation has small dependence on the information transmitted by a few node devices, and further, the safety and sensitivity essence of the traditional information single point can be fundamentally changed.
In the invention, because the state evolution of the result data output by the preorder node equipment is reflected in the result data output by each node equipment, the behavior, the attribute, the state or the event of the user when perceived by each preorder node equipment can be obtained by reverse deduction based on the result data received by the current node equipment. For example, when the position of the user a before 15 minutes needs to be searched, the position corresponding to the node device perceived by the user a can be obtained at the current moment, that is, the position of the user a can be inferred; then, based on the transmission path of the result data, performing reverse extrapolation to 15 minutes ago, that is, extrapolating the position of the user a (determined by the node device perceived by the user a) 15 minutes ago; furthermore, the node device does not need to store the original data about the user a, that is, based on the present invention, the search for the user a can be realized without identifying the original data, but the node device perceived by the user a can be inferred first, and if necessary, the original data about the time when the user a needs to be searched can be obtained from the storage device connected with the node device.
In the invention, the acousto-optic display equipment receives result data output by other node equipment, and the principle is as follows: when the corresponding acousto-optic display equipment is required to present acousto-optic effect and guide information, if the acousto-optic display equipment which is required to present acousto-optic effect and guide information can be determined by result data obtained by calculation of one or more node equipment, the corresponding acousto-optic display equipment is added into a node list for transmitting current result data, the one or more node equipment directly transmits the result data to the acousto-optic display equipment or the node equipment connected with the acousto-optic display equipment, and the corresponding acousto-optic display equipment is added into the node list for transmitting the result data according to preset conditions or algorithm output and model output. Or the acousto-optic display equipment receives result data output by other node equipment in a layer-by-layer transmission mode. In the process of performing cooperative computing on the peer-to-peer network, when the node device performs computing on result data each time, a node list needing to receive the result data is computed, one or more acousto-optic display devices needing to be added are definitely known according to the current result data, the acousto-optic display devices are added into the node list, and the acousto-optic display devices or the node devices connected with the acousto-optic display devices are directly used as subsequent node devices of the next layer to directly receive the current result data, so that normal layer-by-layer transmission is realized, and the peer-to-peer network is changed into a three-dimensional framework. For example, the result data of the current node device may definitely know that the proof needs to be raised to the public security, and if the result data of the current node device is transmitted to the node device corresponding to the public security by using a normal layer-by-layer transmission method, at least one layer or multiple layers of transmission are needed; if the node equipment corresponding to the public security is added into the node list, the node equipment corresponding to the public security can directly receive result data of the current node equipment when the node equipment is transmitted in the next layer, so that the processing time is greatly shortened, and the strain capacity is improved. The invention adopts the peer-to-peer network, so the temporary construction is just the advantage of the invention, and the traditional informationized layer-by-layer convergence architecture cannot bear the complex calculation requirement brought by the temporary construction of the network.
In order to save the resource use of the acousto-optic display equipment, improve the operating efficiency of the acousto-optic display equipment and enable the acousto-optic display equipment to meet the use requirements of more users, in the invention, when the orientation and the traveling speed of a plurality of users are judged to be consistent by the result data of the collaborative calculation, the distance between the users meets the same-row distance standard, and in addition, only the route requirement of one user is acquired or the acquired route requirements of the users are the same, the users are combined into a same-team user group. Furthermore, when guiding, only one or a plurality of the users in the same team can be guided, and the whole user group in the same team can be guided.
In the invention, for the selection of users who guide in the same-team user group, specifically, in the users of the same-team user group, based on the result data of cooperative calculation, if the vision and/or hearing of part of users are judged to be interfered by other users, the users who are required by the acquired route or the forefront user who has the correct orientation corresponding to the guide information of the next step of the users are preferentially shown with the vision guide information and/or played with the audio guide information; if the vision and hearing of the user who is acquired the route demand are interfered by other users, the other users whose vision or hearing is not interfered show the visual guide information or play the audio guide information. For example, two users move side by side, without visual interference, but with auditory interference; when four users move forward in pairs in a row, the front row of users form visual interference and auditory interference to the rear row of users, and the auditory interference is formed among the users in the same row; in particular, the type and presentation manner of the guidance information may be selected according to the situation of the collaborative calculation determination.
And if the vision and the hearing of all the users are not interfered by other users, the visual guide information and the playing audio guide information are displayed to each user so as to meet the use requirement of each user.
The above examples are provided only for illustrating the present invention and are not intended to limit the present invention. Changes, modifications, etc. to the above-described embodiments are intended to fall within the scope of the claims of the present invention, as long as they are in accordance with the technical spirit of the present invention.

Claims (37)

1. An off-line acousto-optic effect display method is characterized in that acousto-optic display equipment is deployed in a display area; acquiring orientation data, traveling speed data and gesture action data of a user, and displaying acousto-optic effects corresponding to the current orientation, traveling speed and gesture action of the user through acousto-optic display equipment based on the orientation, traveling speed and gesture action of the user.
2. The method for displaying acousto-optic effects under line according to claim 1, characterized in that a plurality of kinds of game attributes are set for each user, if the current orientation, the traveling speed and the gesture action of the user correspondingly affect the game attributes of the user, the corresponding acousto-optic effects are displayed for the user, and the game attributes of the user or other users are modified; if the current orientation, the traveling speed and the gesture action of the user correspondingly influence the game attributes of other users, the corresponding acousto-optic effect is displayed for the other users, and the game attributes of the user or the other users are modified.
3. The method for displaying acousto-optic effects under line according to claim 2, characterized in that the online game attributes of the user are read, and the matched acousto-optic effect is calculated according to the online game attributes; and uploading the modified game attributes corresponding to the influence of the user on the game attributes of the user or other users on line to an on-line game server according to a preset rule, and updating the on-line game attributes of the user.
4. The method for displaying an offline sound and light effect according to claim 1, wherein position information of a user is obtained according to a route requirement of the user; calculating the next guiding information of the user based on the route requirement and the real-time position information of the user; the guide information is presented through acousto-optic display equipment at the position corresponding to the real-time position information of the user and is used for guiding the user.
5. The off-line acousto-optic effect display method according to claim 4, characterized in that orientation data, traveling speed data, and gesture action data of the user are acquired, a pre-judging model pre-trained by using a preset condition or machine learning is used to pre-judge the next actions of the user, including the orientation, traveling speed, and gesture actions of the user, and acousto-optic effect and guidance information of the next step of the user are presented on the acousto-optic display device matching the pre-judged positions of the next step of the user, the traveling speed, and the gesture actions.
6. The off-line acousto-optic effect display method as claimed in claim 5, wherein if the pre-judgment of the acousto-optic effect or the next action of the user is not accurate, the acousto-optic display device presenting the acousto-optic effect and the guidance information of the next step of the user is corrected based on the real-time orientation data, the travelling speed data and the gesture action data of the user, and the personnel density around the user, the environmental information, the orientation data, the travelling speed data and the gesture action data of the personnel around the user are taken as training samples and added into a sample library for further training and adjusting the pre-judgment model.
7. The method for displaying acousto-optic effects under line according to claim 5, wherein the height data, the leg length data and the step frequency data of the user are obtained, and the traveling speed of the user is measured; and if the prediction is not accurate for the next action of the user, replacing the predicted travelling speed with the measured travelling speed.
8. The method for displaying an offline sound and light effect according to claim 5, wherein pre-judging models for individuals are established for different users, and after the users are identified, the associated pre-judging models are used for pre-judging the next actions of the users.
9. The method as claimed in claim 1, wherein the acousto-optic display device comprises a visual information display device for displaying visual effect and visual guide information;
acquiring real-time orientation data, traveling speed data and gesture action data of a user, following the orientation, the traveling speed and the gesture action of the user, keeping a visual information display device at a position where the orientation of the user is at a certain distance from the user, and displaying visual guide information of the next step of the user; or, the position of the current user or other users is corresponded, and the visual effect is displayed along with the position of the current user or other users;
or based on the route requirement of the user and the real-time position information of the user, performing collaborative calculation by using a peer-to-peer network to obtain visual information display equipment matched with the position of each user needing visual guidance information display in the next step; the visual information display equipment keeps a position at a certain distance from the user relative to the real-time position information, the real-time traveling speed and the real-time gesture action of the user, and displays the next visual guide information of the user; or the visual effect is displayed according to the position of the current user or other users and the position of the current user or other users.
10. The method for displaying an offline sound-light effect according to claim 9, wherein the distance between the visual information displaying device for displaying the visual guidance information and the user is calculated based on the height and the step length of the user.
11. The method as claimed in claim 1, wherein the acousto-optic display device comprises an audio playing device for playing audio effect and audio guidance information; acquiring real-time position information, traveling speed data and gesture action data of a user, following the position, the traveling speed and the gesture action of the user, keeping an audio playing device with a sound field covering the position of the user, and playing an audio effect and audio guide information of the next step of the user;
or, based on the route requirement of the user and the real-time position information of the user, performing cooperative calculation by using a peer-to-peer network to obtain audio playing equipment matched with the position of each user needing to play the audio guide information in the next step; and relative to the real-time position information, the real-time advancing speed and the real-time gesture action of the user, the audio playing device keeps the sound field covering the position of the user, and plays the audio effect and the audio guide information of the next step of the user.
12. The method for displaying an offline sound-light effect according to claim 11, wherein the audio player is disposed above the display area and is provided with a downward sound gathering cover, and the sound gathering cover is used for limiting a sound field of the audio player within a certain range;
or, the super-directional loudspeaker with the holder is adopted, and the emitting angle is adjusted according to the direction and the traveling speed of a user who listens to the audio effect and the audio guide information.
13. The method for displaying acousto-optic effects under line according to claim 1, 4, 9 or 11, characterized in that physical attributes of users in the display area are obtained through corresponding types of sensors deployed in the display area and covering the display area, route requirements of the users are obtained through a human-computer interaction device associated with the users, and collaborative calculation is performed through a peer-to-peer network, and acousto-optic effects and next-step guide information for each user are obtained.
14. The method of claim 13, wherein the route demand is inferred from play content for the user, the play content comprising a determined or estimated destination that is next to the final destination or a plurality of consecutive destinations.
15. The method for displaying acousto-optic effects under line according to claim 13, characterized in that the peer-to-peer network is utilized to perform non-specific feature recognition and location recognition for the user;
the peer-to-peer network comprises a plurality of node devices, and all the node devices have no primary and secondary relation; the node equipment is provided with a data acquisition device and an operation module, wherein the data acquisition device comprises at least one type of sensor and is used for acquiring different corresponding types of sensing data; the node equipment arranged at different acquisition positions acquires at least one sample of a user, wherein the sample is sensing data corresponding to the type of the sensor;
for a certain node device, processing the acquired sensing data to obtain result data, and transmitting the result data to other node devices; the other node equipment which receives the result data takes the result data as one of the collected original data, and the result data of the other node equipment is influenced by the result data; based on the method, under the condition that the identity information of the user does not need to be acquired, the plurality of node devices in the peer-to-peer network perform collaborative calculation, each unique user is determined to be the user, non-specific feature identification is realized, and the position identification is performed on the user.
16. The method for displaying an offline acousto-optic effect according to claim 15, wherein the current node device receives result data output by other node devices; for the current node equipment, the acquired sensing data is combined with result data from other node equipment, the result data of the current node equipment is obtained through calculation, and the result data are sent to other node equipment; and the node equipment in the peer-to-peer network performs cooperative calculation along with the acquisition of the sensing data and the calculation of the result data.
17. The method for displaying an offline sound and light effect according to claim 15, wherein in the peer-to-peer network, for a certain sample specimen of a certain user, the subsequent node device adjusts the perception attention according to the characteristics of the sample specimen in the result data transmitted from the node device that collects the sample specimen to the other node devices, or reports the characteristics of the sample specimen for the subsequent node devices to adjust the perception attention; if the other node equipment in the following does not detect the characteristics of the point sample, but the characteristics of the point sample which cannot be detected can be determined to still belong to the user from the characteristics of the other point sample, the characteristics of the point sample which cannot be detected are continuously expressed in the result data of the current node equipment and are transmitted to the other node equipment.
18. The method of claim 16, wherein the method of reporting characteristics of the sample book for a subsequent node device to adjust the perception of attention is: adjusting parameters of a data processing model of subsequent node equipment according to result data of the characteristics of the expression point sample provided by the pre-order node equipment or the characteristics of the sample book, so that the subsequent node equipment improves the calculation force for identifying the characteristics of the sample book; alternatively, subsequent node devices make computational adjustments using a perceptual attention model to match the received characteristics of the point samples or the resulting data expressing the characteristics of the point samples.
19. The method for displaying acousto-optic effects under line according to claim 18, characterized in that the node device combines the sample book characteristics and other information described by each node device to the same user when the user described by several preceding node devices can be determined to be the same user by some common sample book characteristics based on the data processing model when processing the result data output by several preceding node devices.
20. The method for displaying an offline sound and light effect of claim 19, wherein when the result data received by the node device indicates that the current node device is before the current node device receives the result data, the flag for identifying the user is different from the flags for identifying the user of other node devices, and the flag assigned to the user by other node devices is updated, the flag for identifying the user by the current node device before the current node device receives the result data is converted.
21. The method for displaying acousto-optic effects under line according to claim 19, wherein the method for converting the flag used by the current node device to identify the user before the current reception of the result data is:
replacing the mark used for identifying the user by the current node equipment before the current node equipment receives the result data with the latest mark distributed to the user by other node equipment;
or recording the conversion relation between the mark used for identifying the user by the current node device before the current node device receives the result data and the updated mark distributed to the user by other node devices, and converting when the result data received by the current node device at the current time needs to be referred;
or the node device deploys a conversion model, and performs corresponding conversion on the marks of a plurality of users according to the input original data or result data.
22. The method for displaying an offline acousto-optic effect according to claim 17, wherein for one or more point samples collected successively by the node devices at different collection positions, if the eigenvalues of one or more point samples at different collection positions respectively satisfy preset proximity conditions or are determined by a specific model to have correlation reaching a threshold, and each collection position is unique, it is determined that the point samples at different collection positions have correlation.
23. The method of claim 17, wherein for one or more samples of different sample positions collected by node devices at different collection positions, if the node devices at different collection positions collect one spatial field, and when there is only one user in the spatial field or the collected sample points can point to one of the multiple users correctly, the sample samples collected by the node devices at different collection positions are correlated for a certain user.
24. The method for displaying an offline acousto-optic effect according to claim 23, wherein the data acquisition device of the node device comprises one or a combination of several of an image acquisition device, an electromagnetic induction device, a temperature measurement device and a vibration frequency sensing device, and a laser radar, and the data acquired by the above devices and the three-dimensional point cloud acquired by the laser radar or the point cloud generated according to the images acquired by the plurality of image acquisition devices are jointly calculated to obtain the three-dimensional point with data; the method comprises the following steps of taking image color, outline, line, reflectivity, motion trend, electromagnetic characteristics, temperature change trend, vibration frequency and vibration frequency change trend based on two-dimensional perception as additional attributes of corresponding three-dimensional points to form three-dimensional point cloud with attributes; and determining the corresponding relation between each area of the three-dimensional point cloud with the attributes and each part or associated part of the 3D appearance of the user by combining electromagnetic induction, temperature law, change characteristics of vibration frequency, motion correlation and reflectivity.
25. The method for displaying an offline sound-light effect according to claim 15, wherein when the identity information of the user needs to be acquired, the identity information acquisition command is triggered, the identity information acquisition command is used as one of inputs to participate in calculation of result data of the node device, and the acquisition of the identity information of the user is achieved by driving the node device connected with a barrier-free data acquisition condition capable of acquiring the identity information of the user in the peer-to-peer network to respond to the corresponding result data.
26. The method for displaying acousto-optic effects under line according to claim 25, wherein the peer-to-peer network determines the authority of the user by checking the authenticity of the user's identity information; the node equipment capable of acquiring the identity information in the peer-to-peer network does not provide the identity information, and the checking result is expressed in the result data of the node equipment only according to the checking requirement on the authenticity of the identity information in the received result data.
27. The method for displaying acousto-optic effects under line of claim 26, wherein the node device capable of acquiring identity information in the peer-to-peer network does not provide identity information, and the information source device driving the information source device providing identity information establishes an encrypted information transmission channel through an encrypted file transmission channel established between the node device input terminal and the node device input terminal that needs to acquire identity information or in other network communication modes; identity information is used as one of the inputs to the node device.
28. The method as claimed in claim 15, wherein the data acquisition device comprises one or more of an image acquisition device, an audio acquisition device, a temperature measurement device, a vibration frequency sensing device, a laser radar, a chemical sensor, and an electromagnetic induction device.
29. The method for displaying acousto-optic effects offline of claim 15, wherein a human-computer interaction device associated with a user is connected to the node device as an access device, submitting a route requirement to a peer-to-peer network; each acousto-optic display device is added into the peer-to-peer network through one or more node devices; and if the acousto-optic display equipment is judged to be presented based on the corresponding acousto-optic effect and the next guiding information of the user based on the cooperative calculation, the current node equipment sends an instruction to the acousto-optic display equipment connected to the current node equipment according to the result data obtained by calculation, and the acousto-optic display equipment is controlled to finish the acousto-optic effect and the guiding information presentation.
30. The method for displaying acousto-optic effects according to claim 29, wherein the acousto-optic effect and the guiding information of the user's next step are characterized to result data; and the acousto-optic display equipment receives result data output by the connected node equipment, and if a specific element in the result data indicates that the acousto-optic display equipment needs to perform acousto-optic effect and guide information presentation, or the result data is used as one of the inputs of a data processing model of the node equipment, and the acousto-optic display equipment calculates and determines that the acousto-optic effect and the guide information need to be presented by the corresponding acousto-optic display equipment, the acousto-optic display equipment presents corresponding acousto-optic effect and guide information.
31. The method according to claim 30, wherein when the acousto-optic display device is required to display the acousto-optic effect and the guidance information, the acousto-optic display device calculates its own result data in combination with the received result data output by the other node devices, and controls the acousto-optic display device to display the corresponding acousto-optic effect and the guidance information according to the obtained result data.
32. The method according to claim 31, wherein the result data obtained by the calculation for the acousto-optic display device includes the optimal solution of all the conditions obtained by the collaborative calculation of all the users in the display area and the external environment at the current moment; and the acousto-optic effect and the next guiding information of the user are presented through the acousto-optic display equipment.
33. The method for displaying acousto-optic effects under line of claim 31, wherein the acousto-optic display device receives the result data outputted from the other node devices in accordance with the following principle: when the corresponding acousto-optic display equipment is required to present acousto-optic effect and guide information, if the acousto-optic display equipment which is required to present acousto-optic effect and guide information can be determined by result data obtained by calculation of one or more node equipment, the corresponding acousto-optic display equipment is added into a node list for transmitting current result data, and the one or more node equipment directly transmits the result data to the acousto-optic display equipment or the node equipment connected with the acousto-optic display equipment; or the acousto-optic display equipment receives result data output by other node equipment in a layer-by-layer transmission mode.
34. The method of claim 33, wherein the corresponding acousto-optic rendering device is added to the list of nodes that deliver the resulting data according to preset conditions or algorithm output, model output.
35. The method as claimed in claim 30, wherein the acousto-optic display device is a node device of an execution component with a specific function, and the execution feedback information of the execution component of the acousto-optic display device is fed back to the acousto-optic display device to participate in the calculation of the subsequent result data of the acousto-optic display device.
36. The method as claimed in claim 15, wherein when the result data of the collaborative computation determines that the orientations and the traveling speeds of the users are consistent, the distances between the users satisfy the criterion of the co-traveling distance, and only the route requirement of one user among the users is obtained or the obtained route requirements of the users are the same, the users are grouped into the group of users in the same team.
37. The method for displaying an offline sound and light effect according to claim 36, wherein, in the users in the user group in the same team, based on the result data of the cooperative computing, if it is determined that the visual sense and/or the auditory sense of some users are disturbed by other users, the users who are requested to obtain the route or the frontmost user whose guidance information corresponding to the next step of the users has the correct orientation are preferentially displayed with visual guidance information and/or played with audio guidance information; if the vision and the hearing of the user with the acquired route requirement are interfered by other users, the users without the interference of the vision or the hearing show the visual guide information or play the audio guide information;
if the vision and hearing of all users are not disturbed by other users, the visual guidance information is presented and the audio guidance information is played to each user.
CN202111166537.1A 2021-09-30 2021-09-30 Offline acousto-optic effect display method Pending CN115869612A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111166537.1A CN115869612A (en) 2021-09-30 2021-09-30 Offline acousto-optic effect display method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111166537.1A CN115869612A (en) 2021-09-30 2021-09-30 Offline acousto-optic effect display method

Publications (1)

Publication Number Publication Date
CN115869612A true CN115869612A (en) 2023-03-31

Family

ID=85756767

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111166537.1A Pending CN115869612A (en) 2021-09-30 2021-09-30 Offline acousto-optic effect display method

Country Status (1)

Country Link
CN (1) CN115869612A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116455522A (en) * 2023-06-13 2023-07-18 良业科技集团股份有限公司 Method and system for transmitting lamplight interaction control information

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116455522A (en) * 2023-06-13 2023-07-18 良业科技集团股份有限公司 Method and system for transmitting lamplight interaction control information
CN116455522B (en) * 2023-06-13 2023-08-29 良业科技集团股份有限公司 Method and system for transmitting lamplight interaction control information

Similar Documents

Publication Publication Date Title
CN103472909B (en) Realistic occlusion for a head mounted augmented reality display
JP7133470B2 (en) System and method for network augmented reality representation
CN109479119A (en) The System and method for of UAV interactive video broadcast
US9218665B2 (en) Method for determining the pose of a camera and for recognizing an object of a real environment
US9216347B2 (en) Portable device, virtual reality system and method
CN104380347B (en) Video processing equipment, method for processing video frequency and processing system for video
AU2009220952B2 (en) A media system and method
US20110066682A1 (en) Multi-Modal, Geo-Tempo Communications Systems
JP2018060511A (en) Simulation system, simulation program, and simulation method
CN204465738U (en) A kind of disaster relief rescue visible system
CN107258087A (en) Position determines the time-multiplexed transmission of beacon signal and control coherent signal
WO2018079557A1 (en) Information processing device and image generation method
KR20190078475A (en) Virtual reality control system
CN111131904A (en) Video playing method and head-mounted electronic equipment
CN115869612A (en) Offline acousto-optic effect display method
CN109849788A (en) Information providing method, apparatus and system
Hinz et al. Designing a far-reaching view for highway traffic scenarios with 5G-based intelligent infrastructure
CN208723929U (en) A kind of AR remote controler
CN115888065A (en) Method for online and offline synchronous game
CN115900707A (en) Walking navigation method
CN115935084A (en) Tour guide method
CN116059620A (en) Method for correspondingly updating virtual scene and real scene
CN116795305A (en) Method for carrying out information interaction service by using camouflage screen
CN116797411A (en) Method for conducting tour guide service based on authorized virtual image
CN115481311A (en) Method for releasing description information of user real visit

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination