WO2019119314A1

WO2019119314A1 - Simulated sandbox system

Info

Publication number: WO2019119314A1
Application number: PCT/CN2017/117551
Authority: WO
Inventors: 王子南
Original assignee: 王子南
Priority date: 2017-12-20
Filing date: 2017-12-20
Publication date: 2019-06-27
Also published as: KR102463112B1; JP7009508B2; GB2571853A; KR20200097637A; JP2020508822A; GB201907569D0

Abstract

Provided is a simulated sandbox system, comprising a lens device, a controller, a digital processor, a display device, a physical sandbox marker, and a physical sand cabinet marker; the lens device is connected to the digital processor and the display device; the physical sandbox marker is connected to the lens device for the transmission of optical information; the physical sand cabinet marker is connected to the lens device for the transmission of optical information. The system enables multi-person online networking, allowing a 3D virtual sandbox to be operated remotely.

Description

Simulation sandbox system

Technical field

The invention relates to the field of psychology, and relates to a simulation sand table system, in particular to a simulated sand disk system created based on the practice and development of the sand table game theory in psychology.

technical background

With the continuous development of sandplay theory, physical sandboxes have emerged, which can be divided into group sandboxes and single sandboxes. Compared with the single-person characteristics of single-player sandboxes, group sandboxes have achieved good results in improving interpersonal interactions in groups and promoting group and individual growth. Generally used is a restricted group sand table. The so-called restricted group sandbox refers to the group sandbox game method with certain rules and restrictions. The requirements are the same as the single sandbox. There is no special requirement in the sandbox game room configuration. Group members can use a variety of random methods to generate order in a manner agreed upon in advance. All members complete one round, and the whole process does not allow any linguistic and non-verbal communication and interaction between members. The consultant can discover the personality characteristics through the members' compliance with the rules.

Restricted group sandboxes are suitable for the treatment of relationships, relationships, and relationships between children and parents. Restricted sandbox games are an acronym for social reality, and each individual's behavioral patterns can be reflected in group sandboxes. In group sandbox games, everyone has their own ideas, but to complete a common work, this may be integrated. At the same time, through the process of sandboxing, the consultant can observe each person's personality characteristics to help them understand these characteristics. Group sandbox games require multiple production processes, after no The break-in will achieve the final integration.

technical problem

In view of the difficulty in promoting the practical operation of the physical sandbox, the focus is on solving the fixed location of the sand table, the large amount of physical sandbox, the limited number of participants, the limited number of models, the inflexible use time of the operators, and the inability to produce sound effects during operation. , smell and other problems.

Technical solution

The invention provides a simulation sandbox system, which transplants a group sandbox to an electronic device, which perfectly solves the shortcomings that the consultant can not effectively cope with many users at the same time, solves the address problem of the sandbox room, and solves the space of the sandbox room. The problem is that the virtual sandbox is more flexible in operation than the real sandbox. In the space expansion and function extension of the sandbox, the virtual sandbox is more flexible and richer than the real sandbox. The virtual sandbox no longer has space limitation, and the sandbox design Can be customized, the model has a unified performance style and scale standards, making the model more representative, the operation of the sandbox increases the vibration feedback of the device, and the electronic sandbox can present the light and shadow effects that are not available in the physical sandbox. Each mold has its own unique attribute action, the sand table has changes in day and night rotation, weather, etc., and the same mold can be used multiple times, or it can appear in the sand table at the same time. The operation of the single sandbox and the group sandbox is no longer limited by the consultant's physical, mental and organizational capabilities. The user can be more immersed in the sandbox operation, expand and enhance the user's perception, and can more conveniently help the user to observe and feel the sand table and the model from all angles. In the virtual environment, the user can get rid of the physical rule restrictions in the real world under certain circumstances, and can effectively perform all-round operations on the sand table and the model. Will be sanded by the assistant in the real sandbox The part of the disk data statistics is converted into the system to digitize the data information of the sand disk operation.

The technical solution adopted:

A simulated sandbox system includes a lens device, a controller, a digitizer, a display device, a physical sandbox mark, and a physical sandbox mark, and the lens device includes a mobile phone, a tablet, a notebook computer, a smart glasses, a Bluetooth camera, and the like. The device for capturing a real scene, the controller includes a motion capture handle, other handheld devices that can map user behavior through sensors, a lens device, a controller connected to the digitizer and the display device, and a real scene through the lens device. The digital processor associated with the lens device and the controller acquires and parses the real-world scene data captured by the lens device, digitizes the data of the real-world scene, and then presents the data to the display device through the Internet or a local area network and other networking methods. The digitized data is connected and interacted with other devices in which the present invention is installed; the physical sandbox mark refers to the fact that the real sand disk cannot be placed due to many reasons in the real environment, and the virtual sand disk mapping is started by some mark. This The mark may be a picture, a plastic, a cloth, or other object that can be used as a mark by the example of the present invention, and the physical sandbox mark is optically transmitted and connected with the lens device; the physical sandbox mark refers to the real environment due to For many reasons, it is impossible to place a real cabinet, and the virtual sandbox mapping can be opened by some kind of mark. The mark can be a picture, a plastic, a cloth, or other objects that can be used as a mark by the example of the present invention. The physical sandbox marker is connected to the lens device for optical information transfer.

Regarding taste: A device certified by the example of the present invention can emit a corresponding harmless gas on the external device of the device if the relevant conditions are satisfied. Further method specific The method may be: obtaining a basic parameter of an upcoming virtual scent in the virtual environment; generating a control signal according to the basic parameter and a layout parameter and a performance parameter of the odor generator; and controlling the odor generator according to the control signal The scent generator produces an odor corresponding to the virtual scent. The obtaining the basic parameters of the virtual scent that is about to appear in the virtual environment includes: parsing the pre-stored virtual data, and generating the basic data set; and when the virtual scent is about to appear in the virtual environment, according to the time parameter of the upcoming virtual scent Obtaining corresponding basic parameters from the basic data set. After obtaining the basic parameter of the virtual scent that is about to appear in the virtual environment, the method further includes: acquiring a realistic odor parameter in the real environment; and generating a control signal according to the basic parameter and the layout parameter and the performance parameter of the odor generator The method includes: generating a control signal according to the actual odor parameter, the basic parameter, and a layout parameter and a performance parameter of the odor generator. Controlling the scent generator according to the control signal to cause the scent generator to generate an odor corresponding to the virtual scent, comprising: controlling, by the control signal, the odor generator to generate a corresponding scent corresponding to the virtual scent The true scent is volatilized by the fan to the true odor.

About the sense of touch: Simulate the effect of the touch by the vibration of the device. The arrangement of surrounding scenes can enhance the tester's experience level, and combine virtual and reality to reflect more experience test results, and provide basic conditions and possibilities for more test methods. The method can be: Get virtual The state information of each object in the real scene and/or the environment of the tester; generating tactile feedback information according to the state information; and performing tactile feedback on the tester according to the tactile feedback information. Obtaining state information of each object in the virtual reality scene and/or the environment in which the tester is located includes: identifying each of the virtual reality scenes An object, determining physical state information corresponding to each identified object; and/or monitoring motion state information of each object in the environment of the tester by a preset radar sensor or an infrared sensor; wherein the physical state The information includes: softness and/or roughness of the object; the motion state information includes: position, moving direction, and/or moving speed information. When the state information includes the motion state information, the generating the haptic feedback information includes: determining, according to the motion state information of each object, a distance between the tester and the object in the environment where the tester is located; if the test is determined The distance between the tester and the object in the environment is greater than 0, and the feedback strength information corresponding to each object is generated according to the correspondence between the preset distance and the feedback strength. The haptic feedback to the tester according to the haptic feedback information includes: applying a pressure corresponding to the feedback strength information to the tester by using a pressure device; and/or applying the feedback strength information to the tester by using the vibration device; Corresponding vibration. When the state information includes the physical state information, the generating the haptic feedback information includes: generating a touch corresponding to each object according to physical state information of each object in the virtual reality scene displayed on the preset touch screen Sensing information; wherein the touch sensing information includes: a magnitude of a force and a distribution area information required to sense an object's softness and/or roughness when the object is touched. The haptic feedback of the tester according to the haptic feedback information includes: inputting, according to the generated touch sensing information, a corresponding input voltage signal to the transmitting electrode and the receiving electrode according to a preset matching rule in different regions of the touch screen; The difference in the input voltage signal produces a corresponding electrostatic force for each region to sense the softness and/or roughness of the object when it is touched based on the electrostatic force generated by each region. Before the haptic feedback is performed on the tester according to the haptic feedback information, the method further includes: detecting a pressure of the tester touching the touch screen; when detecting the touch of the tester When the pressure of the touch screen is greater than a preset threshold, the touch screen is triggered to perform tactile feedback on the tester according to the tactile feedback information.

Setting the sandbox: After the lens device is marked on the physical sandbox or the physical sandbox, a virtual sandbox appears in the device scene, and the virtual sandbox style is correspondingly rendered according to the characteristics of the physical sandbox or the physical sandbox mark. In the case of a physical sandbox, the virtual sandbox is completely within the plane of the physical sandbox, but it expands the range of inoperable space in the real sandbox. This spatial extent includes the upper and bottom of the real sandbox, based on the largest flat section of the solid sandbox. A virtual sandbox within the framework but extending in the space domain. In the case of a physical sandbox mark, the virtual sandbox is a virtual sandbox that appears entirely in the sandbox based on the sandbox mark. "Physical sandbox and sandbox mark are all reference materials for viewfinder devices". Because the physical sandbox and sandbox mark exist at the same time, they can be switched to each other, and the virtual sandbox has special characteristics compared to the limitations of the physical sandbox. The properties of the appearance can be changed: the sky, the ground and the underground. Therefore, the special case of the virtual sandbox is different from the virtual sandbox: the shape of the virtual sandbox after setting the sandbox can be actively or passively changed. The virtual sandbox does not have the interactive properties of sky, ground and underground.

Set the sandbox: After the device is marked with a physical cabinet or a physical cabinet, a virtual sandbox appears in the device scene. The style of the virtual sandbox is displayed according to the mark of the physical cabinet or the physical cabinet. If it is a reference cabinet, all the sandware will be enhanced on the solid cabinet. If it is a physical cabinet mark, the virtual sandbox completely continues the cabinet mark to recreate a completely virtual sandbox.

Specific operation: you can change the distance between the lens device and the real object or the mark To change the distance of interaction in augmented reality or virtual reality, you can also zoom in or away from the interactive distance in augmented reality or virtual reality by controller, gesture or finger operation. Changing the focus position of the lens device can also change the viewing focus position in augmented reality or virtual reality, and can also change the viewing focus position in augmented reality or virtual reality by controller, gesture or finger operation. Changing the angle of the lens device relative to reality can also change the viewing angle in augmented reality or virtual reality. All operations in augmented reality are based on the device's screen. The virtual sandbox can be rotated, flipped, stretched, panned, reset, deformed, etc. After the sandbox is obtained on the sandbox, the lens device is transferred to the sandbox. Then you can observe the virtual sand table in the state of holding the sand. You can choose to place or discard the sand. If you discard it, release the hand outside the sand table and the sand will disappear. If it is placed, release the hand within the virtual sandbox. Through the device, you can observe that the sand will be superimposed on the solid sand table. AR and VR and other devices can be connected to multiple networks via LAN or Internet.

Further, in the test process, the organizer or the staff member may need to enter the virtual scenario to provide guidance and communication. The implementation method applied by the present invention is: the virtual reality platform receives the communication request message sent by the first virtual reality device. The communication request message includes a first view position information and an identifier of the second virtual reality device, where the first view position information is any view position information in the panoramic view position information of the first virtual reality device; Determining, by the first view location information and the identifier of the second virtual reality device, a corresponding second video region in the panoramic video region of the second virtual reality device; acquiring a multi-dimensional video corresponding to the second video region, And sending to the first virtual reality device to perform display of the multi-dimensional video corresponding to the second video region. The virtual The reality platform includes a processing chip built in or externally disposed in the first virtual reality device or the second virtual reality device for implementing multi-dimensional video communication between the first virtual reality device and the second virtual reality device. Before receiving the communication request message sent by the first virtual reality device, the virtual reality platform further includes: the virtual reality platform receiving a registration request message sent by the first virtual reality device and the second virtual reality device, respectively The registration request message sent by the first virtual reality device includes a correspondence between the panoramic video area of the first virtual reality device and the panoramic view position information, and the registration request message sent by the second virtual reality device includes Corresponding relationship between the panoramic video area of the second virtual reality device and the panoramic view position information; establishing and saving the identifier of the first virtual reality device, the panoramic video area of the first virtual reality device, and the panoramic view Corresponding relationship between the location information; establishing and saving the identifier of the second virtual reality device, the correspondence between the panoramic video region of the second virtual reality device and the panoramic view position information. Determining, by the first view position information and the identifier of the second virtual reality device, the corresponding second video area in the panoramic video area of the second virtual reality device, including: according to the first view position information and the An identifier of the second virtual reality device, where the second view position information corresponding to the first view position information is determined in the panoramic view position information of the second virtual reality device, where the second view position information is the Determining, in the panoramic video area of the second virtual reality device, the corresponding position information of the second perspective device according to the second view position information. a second video area; or determining, according to the first view position information, a first video area corresponding to the first view position information in a panoramic video area of the first virtual reality device, And determining, according to the identifier of the second virtual reality device and the first video region, a second video region corresponding to the first video region in a panoramic video region of the second virtual reality device. The virtual reality platform receives an image in a panoramic video area of the first virtual reality device and an image in a panoramic video area of the second virtual reality device; according to the panoramic video area of the first virtual reality device The image establishes a panoramic multi-dimensional video of the first virtual reality device; and the panoramic multi-dimensional video of the second virtual reality device is established according to an image in the panoramic video region of the second virtual reality device.

Further, during the testing process, language communication with the tester may be required, but too many buttons and manual control methods are complicated in operation, which affects the test effect, and the present invention provides unique settings and methods. , reducing the tester's operation, and can bring emotions, reduce the impact on the tester in the emotion, and intelligently communicate with the tester, specifically: its equipment includes voice mobile terminal, virtual environment terminal, external server The external server is in communication with the voice mobile terminal and the virtual environment terminal, and the voice mobile terminal is connected to the virtual environment terminal. The voice mobile terminal includes a voice collection module, configured to collect voice signals of the user, and collect the voice signals of the user. The voice signal is preprocessed; the voice recognition module is configured to convert the preprocessed voice signal into text information, and generate corresponding control commands and parameters for the text information; and the voice emotion feature parameter extraction module is configured to extract the voice collection module Emotional features in the processed speech signal a storage module for storing updated voice recognition data, a voice control command database, and a voice emotion database from an external server; a wireless communication module for using the recognized control commands and parameters or voice text information and corresponding voice emotions Sent to the virtual environment terminal and used to communicate with external servers, thus The corresponding data packet in the server is loaded and updated into the storage module; the processor is configured to process the collected user voice information, or send an update command to the external server to load the data stored by the update storage module; the processor and the voice collection module respectively The voice recognition module, the voice emotion feature parameter extraction module, the storage module, and the wireless communication module are connected; the voice collection module is respectively connected with the voice recognition module and the voice emotion feature parameter extraction module, and the emotion feature extracted by the voice emotion feature parameter extraction module Separating respectively with the voice text information recognized by the corresponding voice recognition module; the storage module is respectively connected to the voice recognition module and the voice emotion feature parameter extraction module; the virtual environment terminal includes a storage unit for storing and loading from an external server An updated model library of emotional expressions and actions of avatars, a tone and speech rate database corresponding to voice emotions, a voice play module for playing received voice text information, and a display module for displaying emotions of voice expressions of virtual characters And a communication module, configured to communicate with the voice mobile terminal, and communicate with the external server, so as to load and update the corresponding data packet in the external server to the storage unit; the storage unit and the voice playback module and the display module respectively connection. The voice collection module is mainly a microphone. The speech recognition module includes a speech feature extraction unit, a speech feature comparison unit, and a comparison result output unit. The speech feature extraction unit is coupled to the speech feature comparison unit, and the speech feature comparison unit is coupled to the comparison result output unit. The speech emotion feature parameter extraction module includes an emotion feature extraction unit, an emotion feature comparison unit, and an emotion feature output unit, and the emotion feature extraction unit is connected to the emotion feature comparison unit, and the emotion feature comparison unit is connected to the emotion feature output unit. The voice playing module includes a tone matching unit and a voice playing unit, and the tone matching unit is connected to the voice playing unit. The display module includes an action matching list And a display unit, wherein the action matching unit is connected to the display unit. The method includes the following steps: the voice mobile terminal is connected to the virtual environment terminal. After the connection is successful, the processor of the voice mobile terminal and the virtual environment terminal respectively send a database version query command to the external server, and query the storage module of the voice mobile terminal for storage. The version of the voice recognition data, the voice control command database, and the voice emotion database, and the model library of the avatar's emotional expressions and actions stored in the storage unit of the virtual environment terminal, the version of the tone and the speech rate database corresponding to the voice emotion, and the external server Consistent, if not consistent, load and update the latest version of the data from the external server to the corresponding storage module and storage unit, so that the data in the storage module and the storage unit are in the latest state; the voice collection module collects the voice signal of the user. The collected speech signal is filtered, quantized and the like, and then sent to the speech recognition module and the speech emotion feature parameter extraction module; the speech recognition module combines the speech recognition data stored in the storage module to preprocess the speech signal. Switching to the text information form, and matching the text information with the command data in the voice control command database is a control command; if it is a control command, generating corresponding control commands and parameters and outputting to the virtual environment terminal for corresponding control operations; If it is not a control command, it is a voice communication information, and the voice emotion feature parameter extraction module analyzes the waveform of the preprocessed voice signal, and extracts parameters having emotional characteristics, and extracts the emotion parameter and the emotion of the voice emotion database. The data is matched to obtain corresponding emotional features, and then the emotional feature information is mapped to the corresponding words or sentences, and the emotional features and the emotional feature information mapping corresponding words or sentences are transmitted to the virtual environment terminal, and the action of the virtual environment terminal The matching unit matches the received emotional features with a model library of the avatar's emotional expressions and actions in the storage unit, and obtains the emotional features. The corresponding emotional expressions and actions display the corresponding emotional expressions and actions through the display unit; the intonation matching unit matches the words or sentences corresponding to the emotional features with the tonality corresponding to the speech emotions and the data in the speech rate database, thereby obtaining the words or The tone and the speech rate corresponding to the statement are played by the voice playing unit to play the corresponding voice communication information with the tone and the speech rate, and the voice playing module and the display module are synchronously played, thereby the virtual user's multi-person communication in the real environment.

Required software support:

AR development tools, including: ARPA, ARLab, DroidAR, Metaio, Wikitude, vuforia, development platforms include: Android, IOS, GoogleGlass, WindowsPC, Unity, EpsonMoverio BT-2000, Vuzix M-100, Optinvent OPA1, PhoneGap, Titanium, Xamarin .

VR development tools, including: HoloLens Emulator, Google VR SDK, Google VR View, Web VR, Cardboard SDK, Faceshift Studio, A-Frame, Oculus DK2, Cryengine, Destinations Workshop Tools, RealSense SDK, Leap Motion SDK, kinect SDK, Source Engine, OpenVR SDK, Oculus SDK, Gear VR, Nibiru VR SDK, development platforms include: Android, IOS, GoogleGlass, WindowsPC, Unity, EpsonMoverio BT-2000, Vuzix M-100, Optinvent OPA1, PhoneGap, Titanium, Xamarin, Auto Stingray3D , Gamebryo, Virtools.

The invention opens and observes the virtual sand disk through the lens device, and the Bluetooth model device in the lens device involved can be separated from the device, and can also enhance the interactive operation in the augmented reality or virtual reality. A proprietary authentication device of the present invention, the device having a responsive switch Dissipate the corresponding odor.

Specific applications of the invention:

The invention is opened, and the main interface is entered. The person logged into the main interface has two identities when operating the sandbox instance: one is the organizer or the initiator (the following are all organizers), and the other identity is invited. People, ordinary users.

After the sandbox instance is created, the user automatically converts the identity to the organizer. Other users who enter the sandbox instance are invitees.

The organizer can open a sandbox instance with no other users involved, and the sandbox instance becomes a single sandbox, which is a single sandbox.

The organizer creates a new sandbox instance and sends an invitation to invite people in the list of their own online or LBS location (location-based services) to invite nearby people to perform multiplayer sandboxing.

The invitee can make a request to join a sandbox instance in preparation.

Features in this preparation interface:

Organizers can view a list of existing contact lists.

A list of surrounding online user lists can be viewed based on the LBS (Location Based Service).

You can choose the number of people who need to work together on the group sandbox. The sandbox instance can be modified at will before you start.

You can communicate text, voice or video with any person who has already agreed to be invited, or communicate privately.

Text, voice or video communication can be done separately with people who have not yet agreed to accept the invitation.

You can determine the sanding round of the required operation, and the sandbox instance can be repaired before it can be started. change.

The final finishing round of the sand table can be determined, and the sand table instance can be modified freely before it has started.

This preparation interface can be closed or hidden.

Other possible operations.

About the list of contact lists:

Everyone can add to each other's contact list. In the contact list, you can view the online status of the contact. The online status includes waiting, leaving, preparing, and the number is full (only the special status of the organizer) In the sandbox, both the organizer and the invitee can view the contact's tags, including: avatar, name, notes, and other tags. Click on the contact's tag to view more detailed contact information.

About waiting:

It means that the organizer and the invitee are in a state where they can be applied for or invited.

About temporary leave:

It means that the organizer and the invitee have no action for a certain period of time, including text, voice and video communication, and are not in the sandbox instance that has not yet started, and there is no invitation or application action. The system will set the current The status is temporary, when the user performs any interface operation and then returns to the state before the temporary departure.

About preparation:

If it is an organizer, create a sandbox instance that has not yet started, but it has not started yet, and the number is not full. If it is an invitee, after entering a sandbox instance that has not yet started.

About the number of people is full:

Only the organizer has the status. When the number of sandbox instances that have not yet started is full, but it has not yet started, other invitees at this time cannot apply to join, and the current organizer can no longer invite other invitees.

About the sand table:

When the organizer and the invitee are in an already-initiated sandbox instance, it is not possible to apply or invite them at this time.

Restrictions on the number of people who choose the group sandbox to work with:

The sandbox instance selected by the organizer from one person to one hundred people to participate in the group can be changed when the sandbox instance has not started yet. If the number of people modified is less than the number of people who have joined the sandbox instance, it will not succeed.

About the choice of sand table rounds:

The organizer needs to determine the operation round of this sandbox instance after creating the sandbox instance. The operation round is usually 5 or 8 rounds.

About choosing the finishing round:

The finishing rounds are usually 1-5 times and can be changed when the sandbox instance has not yet started.

About tags/tags:

After the sandbox instance is created, in the current sandbox instance, the system assigns a separate label to each person in the preparation interface. The label content includes the avatar, name, and assigned color block. This label can be used by others. Click and there will be more detailed information after the point.

About the invitation:

Only the organizer can invite, can only invite online people, the invitee can not be in the sandbox instance that has already started operation, but can be in the preparation interface of other organizers, the organizer needs to wait for the invitee after issuing the invitation In response, the invitee can choose to decline or agree within a certain period of time, or the system will help the invitee to reject the invitation after the waiting time has elapsed.

About please come out:

The organizer can also ask an invitee to leave a sandbox instance that has not yet started.

About the invitees in the invitation:

The invitee can wait for the organizer's invitation.

About the application:

The invitee can apply to join an organization's unstarted sandbox instance, but the status of the applied organizer can only be in preparation, and the applied organizer needs to choose to agree or refuse within a certain period of time. Or after the timeout, the system will automatically choose to reject. The organizer can receive multiple applications at the same time. You can apply for the consent without the order. When the organizer's number of sandbox instances is full, other applications will be invalidated.

About communication:

In an instance of a sandbox that has not yet started, the invitee can communicate with others in text, voice, and video. Everyone can communicate with people on the contact list in text, voice, and video.

Other descriptions of group sandboxes:

The invitee can leave the sandbox instance in preparation in advance.

The organizer will become a single sandbox after the start of an unsatisfactory sandbox instance, organizer The identity becomes the user who operates the sandbox.

The organizer can invite multiple people to enter the sandbox instance at the same time. This number is the number that can exceed the prescribed number of sandbox instances.

The invitees enter the sandbox instance in the order in which the organizer agrees. After the number of people in the sandbox instance is full, the invitees who subsequently agree to enter cannot enter the sandbox instance. When the number of sandbox instances is full, the organizer No new invitations can be initiated.

The invitee can apply to join the sandbox instance of multiple organizers at the same time. If the number of the sandbox instances of the applied organizer is full, the applicant will not be able to apply, and the invitee will enter the first sandbox instance that is agreed to enter and enter a certain After the organizer's sandbox instance, other applications will automatically expire.

Invitees can also be invited by multiple organizers. After entering a sandbox instance, the applications that have already been sent, and other invitations will automatically expire.

After entering the preparation interface of a sandbox instance, the invitee can view the rounds of the sandbox instance, view the list of people in the sandbox instance, and communicate with others for text, voice, and video.

If the invitee is offline or offline, if it has already entered a sandbox instance, it will automatically leave, and the current sandbox instance is free of a location.

If the organizer is offline or offline, the current sandbox instance will be automatically dismissed. The previous invitee's preparation interface for this sandbox instance will be closed.

After the number of sandbox instances is full, the organizer can start the sandbox instance and have a countdown wait time. After the countdown ends, everyone will close the current preparation interface and wait for the load to complete before entering a virtual sandbox instance.

Division of modules in the sandbox instance

About the sandbox room:

Also known as the virtual sandbox room. In virtual reality (VR), it is based on the real sandbox room. In the virtual reality environment, there are sandboxes, sandboxes, models, and other items necessary for real sandboxes in the sandbox. If it is a group sandbox instance, there will be images of other people. In an augmented reality (AR) environment, the current user's room or space is not limited by address and size.

About sand:

Also known as the model, after analyzing the color prototypes of various types of sand tools, it is created through simple design. In order to give the operator more freedom to imagine the space, there are several main categories: people, animals, plants, buildings, furniture and everyday. Supplies, transportation, food, stones and shells, natural materials, weather and others.

About the sand cabinet:

Also known as the cabinet, it is also a virtual sand cabinet, which is a cabinet for placing models. All the initial placement of the model needs to be extracted in the sand cabinet, and some other operations need to start from the sand cabinet.

About the sand table:

It is also a virtual sand table for placing and operating sand tools. It can be used to dig sand and pile sand, and can realize the presentation of water and grass. There are various sand table styles that can be customized.

About the weather:

Change weather changes in sandbox instances

About the perspective:

The observation of different orientations of the sand table instance is achieved by switching the angle and height of the viewing angle.

About the interface operation:

It is possible to record the operational data in the operating sandbox instead of part of the consultant's work. In the group sandbox instance, you can communicate instantly with other users in the sandbox instance.

Everyone enters the sandbox and is operated by hands, fingers and gestures or controllers.

In the sandbox instance, it is mainly divided into operation status and viewing status.

About viewing status:

All users can view the panorama of the sandbox with the Rotate feature, including close-up and distant views. It is also possible to switch between the normal viewing angle and the vertical viewing angle through the switch. It is also possible to move around within the allowable range of the virtual sandbox room, and the active observation and operation of the sandbox can be performed at any time. You can also zoom in or out through the magnifying glass switch to view the partial sand table.

About the operational status:

The sandbox and model can be operated in the operating state. Including the placement of the model and the placement of the operation, you need to select the model, then the model will be rendered operational, and the operation, rotation, scaling, and deletion operations can be performed in the operational state of the model. Operating the sand table, the sand tray can be dug and piled, and sound effects will occur at the same time. The electronic device will respond to the vibration effect, and operate “dig” at a certain position in the sand table. After digging to a certain extent, water will appear on the sand table. After the water has emerged and then digging to a certain extent, that is, after the water reaches a certain depth, it will not respond to the digging action at this position. The sand piles up the sand table and can fill the water. It can pile up the mountain and stop responding to the sand pile operation after the pile reaches a certain height. All operations are controlled by the switch of the device. In the form of expression, the handheld device can be illusory. Turn into hands or other assistive devices.

Operating the objective environment in the air:

It is possible to change the meteorological representation in the sand table.

The placement of the operational model:

The model can be taken from the cabinet in the scene and placed in the sandbox. The model in the sandbox can be edited when placed.

Select the operation of the model:

Triggering the model to be operated by a finger, hand or controller, and activating the selected state of the model to be operated.

Movement of the operational model:

After manipulating the model that needs to be moved, the model follows the movement of the finger, hand or controller.

Rotation of the operational model:

After selecting the model to be rotated, the corresponding rotation is performed by the swipe of the finger, gesture or controller.

The scaling of the operational model:

Two fingers, gestures, or controllers are required to operate, move relative or vice versa, and then map to the scale of the model.

Removal of the operational model:

Use the mobile method to control the model to the outside of the sand table.

Interface operation:

Control the music, sound effects, vibration, communication window switch, you can view the hint help community Face, or jump to the main interface.

communicate with:

Open the communication window in the group sandbox instance, which can be communicated by all the people at the same time, or the organizer can communicate with the invitee alone. In the organizer's sandbox instance, the interface is a small number of invited people +1. The window, in addition to a common window for communication with everyone, and a separate window for each individual invitee.

In the group sandbox instance, the organizer can actively communicate with the invitees for text, voice and video. The sandbox instance will have obvious prompt confirmation every round after the official start, which is used to let the invitee confirm the start, everyone After confirming, the next step can be performed. The confirmation status of all invitees will be displayed in the organizer interface. If someone does not confirm, the organizer needs to conduct a separate inquiry for an undetermined invitee. In the official operation group sandbox, before the start of the first round, the system will randomly customize the order of the invitees, and then in this sandbox instance, the order of each person will not change.

Description of the countdown and operation node:

If it is the turn of an invitee to operate, there will be a clear prompt on the screen, and then there will be a countdown. Each invitee has a limited time for operation in each round. Before the end of the countdown, one can be performed. Effective operation or continuous effective operation. If it is a one-time operation, it will automatically jump to the next operator after the operation ends. If it is a continuous operation, you can end the operation before the countdown technique to jump to the next operator, or wait for the countdown to automatically jump to the next operator. If there is no follow-up operator in the current round, then The sandbox instance of the current round is in a node state. At this time, there will be a separate window in front of each operator's screen, which requires the operator to operate the current round. To supplement the explanation, it is used to explain the operation. The supplementary explanation can be in the form of inputting text, voice and video. The supplementary explanation has a time limit. After the countdown is finished at this time, the operator will submit it after the operator completes the supplement. The input content information, the operator can also give up the supplementary instructions. In the node at the end of this round, the organizer's interface has the function of hiding other and only displaying the sandbox instance, and the organizer can take screenshots of any angle before the countdown ends. After the countdown is over, the current round of operations is officially finished, and then the next round is officially started to repeat the current sandbox instance. After the last round, if it is in the group sandbox, there will be a separate window in each operator's interface to enter the name of the current sandbox instance, which can be in the form of text, voice and video. Entering this named node also has a countdown. When the countdown ends, whether or not the name is given, everyone's naming is displayed in each person's interface, and then sorted according to the operator's operation sequence, and the operator is required to vote on the naming. Select a current sandbox instance name. The last sandbox instance name is the one with the most votes. If the number of votes is the same, choose the name that gets the most votes first. If this is a single sandbox, the user will be prompted to name the current sandbox instance separately.

After the naming is finished, each operator will be prompted to select a favorite area or a certain type of model in the current sandbox instance, and there will be a window on the screen for supplementary explanation. Why do you like this? The reason is that this operation will count down. After the countdown ends, the last choice will be recorded. The operator can choose not to add or not, and the supplementary form can be text, voice and video.

After selecting the favorite operation, each operator is prompted to select a model that is particularly concerned, and there will be a window on the screen for supplementary explanation, why is it especially For this reason, this operation will count down. After the countdown is over, the final selection will be recorded. The operator can choose not to add or not, and the supplementary form can be text, voice and video.

After selecting a model that is particularly concerned, each operator will be prompted to select the most annoying model or sandbox area, and there will be a window on the screen to supplement the explanation. Why do you hate this reason most? There is a countdown, the final selection will be recorded after the countdown is over, the operator can choose not to add or not, and the supplementary form can be text, voice and video.

After recording the most annoying operation, each operator begins to choose a self-image, and there is a window on the screen to explain why this is chosen as a self-image. The supplementary forms can be text, voice and video.

When the operator makes a selection of favorite, special care, most annoying and self-image, the organizer's interface has the function of hiding other and only displaying the sandbox instance, and the organizer can take screenshots of any angle before the countdown ends.

After the end of the self-image operation, it will enter the stage of sorting out the current sandbox instance. According to the previous operator's operation sequence, each person has a short adjustment time, and there will be a countdown. In this sorting phase, the operator can The sandbox instance performs any operation, and the specific operation round is specified by the organizer in the preparation interface of the sandbox instance.

Beneficial effect

The first multi-person, online networking, 3D virtual sandbox that can operate simultaneously in different places.

DRAWINGS

Figure 1 is a flow chart showing the operation of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

Embodiments of the invention

In the description of the present invention, it should be noted that the terms "installation", "connected", and "connected" are to be understood broadly, and may be solid, for example, unless otherwise specifically defined and defined. The connection may be a detachable connection or an integral connection, which may be a mechanical connection or an electrical connection, and may be directly connected or indirectly connected through an intermediate medium, and may be internal communication between the two elements. The specific meaning of the above terms in the present invention can be understood in a specific case by those skilled in the art. Further, in the description of the present invention, the meaning of "a plurality" is two or more unless otherwise specified.

In the entire operation process of the sandbox instance, if the definitions of "single", "single person", "group", "multiple person" are not clearly indicated, it can be understood that it can be satisfied under the conditions of multiple people or single person. And applicable.

In order to facilitate the understanding of the present invention, preferred embodiments of the present invention are given below. However, the invention may be embodied in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided so that this disclosure will be more fully understood. It should be noted that when an element is referred to as being "fixed" to another element, it can be directly on the other element or the element can be present. When an element is considered to be "connected" to another element, it can be directly connected to the other element or. The terms "vertical", "horizontal", "left", "right", and the like, as used herein, are for the purpose of illustration and are not intended to be the only embodiment. All technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. The terminology used in the description of the present invention is for the purpose of describing particular embodiments and is not intended to limit the invention. The term "and/or" used herein includes any and all combinations of one or more of the associated listed items.

A simulation sandbox system, including a lens device, a controller, a digital processor, and a display The device includes a mobile phone, a tablet, a notebook computer, smart glasses, a Bluetooth camera, and other devices that can be used to capture a real scene, and the controller includes a motion capture handle. Other handheld devices that can map user behavior through sensors, the lens device and the controller are connected to the digital processor and the display device, and the real-life scene is acquired through the lens device, and the digital processor associated with the lens device and the controller acquires and analyzes the lens device. Capture the actual scene data, digitize the data of the real scene, and then present it to the display device. The device performs the digitized data and other devices with the examples of the present invention through the Internet or a local area network and other networking methods. Connection interaction; physical sandbox mark refers to the fact that in the real environment, due to many reasons, the real sandbox cannot be placed, and the virtual sandbox mapping can be opened by some kind of mark. The mark can be picture, plastic, cloth, or other through the invention. Instance authentication It can be used as a marked object, and the physical sandbox mark is connected with the lens device for optical information transmission; the physical sandbox mark refers to the fact that in the real environment, the real cabinet cannot be placed due to many reasons, and the virtual sand is opened by some kind of mark. Cabinet mapping, such a mark may be a picture, a plastic, a cloth, or other object that can be used as a mark by the example of the present invention, and the physical sandbox mark is optically transmitted with the lens device.

The present invention and its embodiments have been described above, and the description is not limited, and only one of the embodiments of the present invention is shown, and the actual structure is not limited thereto. In general, if the person skilled in the art is inspired by the invention, the structural solutions and embodiments similar to the technical solution are designed without the creator's permission, and should belong to the present invention. The scope of protection.

Industrial applicability

According to existing physical rules. On the one hand, it can simulate the real natural environment in a complete virtual environment, so that the operator can feel the perception of vision, hearing, touch, taste, smell and movement, so that the operator can have all the perceptions that human beings can have. The operator can have the sense of presence in the real environment, the operator has the feedback and response generated when interacting with the virtual environment to obtain the operational sense and interactivity. The characteristics of the virtual environment itself are that there is no need for the operator to participate. Autonomy and diversity. All the information in the virtual sandbox is digitized.

On the other hand, it is also possible to apply the virtual information to the sand table information (image, sound, taste, touch, etc.) which is difficult to experience in a certain time and space range in the real world. To the real sand table, it is perceived by human senses to achieve a sensory experience that transcends reality. The real environment and virtual objects are superimposed in real time on the same sandbox.

Claims

A simulation sandbox system, comprising a lens device, a controller, a digital processor, a display device, a physical sandbox mark, and a physical sandbox mark, wherein the lens device comprises a mobile phone, a tablet, a notebook computer, a smart glasses, and a bluetooth A camera and other devices that can be used to capture real scenes, the controller including a motion capture handle, other handheld devices that can map user behavior through sensors, lens devices, controllers connected to digital processors and display devices, through lens devices Obtaining a real scene, the digital processor associated with the lens device and the controller acquires and parses the real-world scene data captured by the lens device, digitizes the data of the real-world scene, and then presents the data to the display device, and the device passes through the Internet or a local area network. And other networking methods connect and digitize the digitized data with other devices in which the present invention is installed; the physical sandbox mark refers to the fact that in the real environment, the real sand disk cannot be placed due to many reasons, and is opened by some mark. virtual Disk mapping, such a mark may be a picture, a plastic, a cloth, or other object that can be used as a mark by the example of the present invention, and the physical sandbox mark is optically transmitted and connected with the lens device; the physical sandbox mark means In the real environment, due to many reasons, the real cabinet can not be placed, and the virtual sandbox mapping can be opened by some kind of mark. The mark can be picture, plastic, cloth, or other certified by the invention. For the marked object, the physical sandbox marker is optically transmitted to the lens device.
A simulated sandbox system according to claim 1 wherein said scheme is applied to a sandbox game in the field of psychology.