CN113157088B - Criminal investigation virtual scene-based data processing method and device - Google Patents
Criminal investigation virtual scene-based data processing method and device Download PDFInfo
- Publication number
- CN113157088B CN113157088B CN202110291697.2A CN202110291697A CN113157088B CN 113157088 B CN113157088 B CN 113157088B CN 202110291697 A CN202110291697 A CN 202110291697A CN 113157088 B CN113157088 B CN 113157088B
- Authority
- CN
- China
- Prior art keywords
- interactive
- virtual
- criminal
- screen
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The invention discloses a data processing method and a data processing device based on a criminal investigation virtual scene, wherein an annular wall screen is constructed firstly, and an annular three-dimensional space is surrounded by the annular wall screen; constructing a criminal crime scene environment in a virtual system, wherein the criminal crime scene environment comprises a background environment and an interactive environment, the interactive environment comprises a plurality of interactive factors, and at least one interactive factor in the plurality of interactive factors is related to criminal crime cases; arranging a camera sensor and a positioning sensor, performing sensor fusion on data acquired by the camera sensor and the positioning sensor to obtain fusion data, and dynamically capturing an object or a person in the annular three-dimensional space based on the fusion data; the user interacts with the virtual scene in the annular stereo space. By the method, the criminal investigation environment is vivid, the immersion and training quality of the user is improved, and criminal investigation experience and related training in VR are facilitated.
Description
Technical Field
The application belongs to the technical field of virtual reality, and particularly relates to a data processing method and device based on a criminal investigation virtual scene.
Background
Criminal investigation generally refers to investigation and evidence collection at the criminal crime scene. In order to find out crime facts and collect crime evidences, investigation personnel carry out field visit and investigation and inspection work on crime-related persons and events, places, articles, persons, corpses and the like by law after criminal cases occur, and the criminal lawsuit investigation personnel are an important investigation measure. The detection task comprises the steps of finding, fixing and extracting trace material evidence and other information related to crime; storing the field information; judging the case property; analyzing a criminal process; determining a detection direction and range; providing clues and evidence. The advantages and disadvantages of the investigation technology can even determine the trend of the whole case to a certain extent, and the investigation technology is an important and necessary skill for criminal policemen and other related technicians. However, in the prior art, related technicians have different mastery of the detection skills and are difficult to measure, and in the training process of training the detection skills, the training content is simple, the teaching method is single, the deviation degree from reality is high, the knowledge drawing of trainees is limited, and the effect of really improving the abilities of the trainees is difficult to achieve, usually based on the modes of related books, experience teaching of experienced persons, case teaching and the like.
Moreover, in the existing virtual reality method, the interaction with the trainees is lacked, especially in the field of investigation, the interaction between the reconnaissance personnel and the scene is the most basic work in the investigation process, and the effect of really improving the reconnaissance capability of the trainees still cannot be achieved by applying the conventional virtual reality training method to criminal investigation.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a data processing method and device for a criminal investigation virtual scene.
Specifically, the criminal investigation virtual scene data processing method claimed in the present application includes:
s100, constructing an annular wall screen, wherein the annular wall screen surrounds an annular three-dimensional space, a corresponding projector is arranged at the back of the annular wall screen, screen content is projected onto the screen, and a user can view content displayed in the screen in the annular three-dimensional space;
s110, constructing a criminal crime scene environment in a virtual system, wherein the criminal scene environment comprises a background environment and an interactive environment, the background environment comprises environmental factors irrelevant to the current crime case, the interactive environment comprises a plurality of interactive factors, at least one interactive factor of the interactive factors is relevant to the criminal crime case, and the constructed criminal crime scene environment is projected to the annular wall screen;
s120, a camera sensor and a positioning sensor are arranged, wherein the camera sensor is used for acquiring image information of an object or a person in the annular three-dimensional space, and the positioning sensor is used for acquiring coordinate information of the object or the person in the annular three-dimensional space; carrying out sensor fusion on data acquired by a camera sensor and a positioning sensor to obtain fusion data, and dynamically capturing an object or a person in the annular three-dimensional space based on the fusion data;
s130, a criminal investigation virtual scene is set in the virtual system, and a user interacts with the virtual scene in the annular three-dimensional space.
The interaction factors at least comprise an on-screen interaction factor and an off-screen interaction factor; the interactive factors outside the screen comprise an entity object arranged in the annular three-dimensional space and an interactive virtual object in the virtual scene, the interactive operation of the entity object of the interactive factors outside the screen is identified through fused data acquired by the sensor, the identified interactive operation result acts on the interactive virtual object in the virtual scene, criminal investigation action is triggered, and the virtual system feeds back the criminal investigation action data to the screen, so that the criminal investigation simulation is realized.
The annular wall screen comprises a left screen, a right screen, an upper screen, a lower screen and a front screen.
Wherein at least one of the plurality of interaction factors is unrelated to a crime case; and when the user interacts with at least one of the plurality of interaction factors, the interaction factors irrelevant to the crime case feed back information irrelevant to the crime case to the user.
Wherein, the interactive operation of the entity object of user and the interactive factor outside the screen is discerned through the image information and the coordinate information gathered, including:
respectively wearing a positioning sensor and a motion capture sensor on a physical object of interaction factors outside a screen and a user, identifying the user and the user motion based on sensor data, and setting a user virtual object in a virtual system based on an identification result;
applying the identified user action to a user virtual object in the virtual system; analyzing the data of the user virtual object and the interactive virtual object, and feeding back an interactive analysis result;
the system comprises a virtual system and a plurality of criminal investigation tool virtual objects, wherein at least one criminal investigation tool virtual object is modeled in the virtual system, corresponding criminal scene investigation tool entity tools are arranged in an annular three-dimensional space and are in one-to-one correspondence, a user interacts with entity objects of interaction factors through the criminal investigation tools, the virtual system acts interaction operation on the corresponding criminal investigation tool virtual object and the interaction virtual object, and feedback is carried out based on a user interaction mode.
Correspondingly, aiming at the problems in the prior art, the invention provides a VR education training device based on crime scene investigation, which comprises the following steps: the method comprises the following steps:
the display module is used for constructing an annular wall screen, the annular wall screen surrounds an annular three-dimensional space, a corresponding projector is arranged at the back of the annular wall screen, screen content is projected onto the screen, and a user can view content displayed in the screen in the annular three-dimensional space;
the virtual system module is used for constructing a criminal crime scene environment in the virtual system, wherein the criminal scene environment comprises a background environment and an interactive environment, the background environment comprises environmental factors irrelevant to the current crime case, the interactive environment comprises a plurality of interactive factors, at least one interactive factor of the interactive factors is relevant to the criminal crime case, and the constructed criminal crime scene environment is projected to the annular wall screen;
the sensor module is provided with a camera sensor and a positioning sensor, the camera sensor is used for acquiring the image information of an object or a person in the annular three-dimensional space, and the positioning sensor is used for acquiring the coordinate information of the object or the person in the annular three-dimensional space; carrying out sensor fusion on data acquired by a camera sensor and a positioning sensor to obtain fusion data, and dynamically capturing an object or a person in the annular three-dimensional space based on the fusion data;
and the investigation interaction module is used for setting a criminal investigation virtual scene in the virtual system, and a user interacts with the virtual scene in the annular three-dimensional space.
The interaction factors at least comprise an on-screen interaction factor and an off-screen interaction factor; the interactive factors outside the screen comprise an entity object arranged in the annular three-dimensional space and an interactive virtual object in the virtual scene, the interactive operation of the entity object of the interactive factors outside the screen is identified through fused data acquired by the sensor, the identified interactive operation result acts on the interactive virtual object in the virtual scene, criminal investigation action is triggered, and the virtual system feeds back the criminal investigation action data to the screen, so that the criminal investigation simulation is realized.
The annular wall screen comprises a left screen, a right screen, an upper screen, a lower screen and a front screen.
Wherein at least one of the plurality of interaction factors is unrelated to a crime case; and when the user interacts with at least one of the plurality of interaction factors, the interaction factors irrelevant to the crime case feed back information irrelevant to the crime case to the user.
Wherein, the interactive operation of the entity object of user and the interactive factor outside the screen is discerned through the image information and the coordinate information gathered, including:
respectively wearing a positioning sensor and a motion capture sensor on a physical object of interaction factors outside a screen and a user, identifying the user and the user motion based on sensor data, and setting a user virtual object in a virtual system based on an identification result;
applying the identified user action to a user virtual object in the virtual system; analyzing the data of the user virtual object and the interactive virtual object, and feeding back an interactive analysis result;
the system comprises a virtual system and a plurality of criminal investigation tool virtual objects, wherein at least one criminal investigation tool virtual object is modeled in the virtual system, corresponding criminal scene investigation tool entity tools are arranged in an annular three-dimensional space and are in one-to-one correspondence, a user interacts with entity objects of interaction factors through the criminal investigation tools, the virtual system acts interaction operation on the corresponding criminal investigation tool virtual object and the interaction virtual object, and feedback is carried out based on a user interaction mode.
Based on the technical scheme, the annular wall screen is constructed, the annular wall screen surrounds an annular three-dimensional space, the back of the annular wall screen is provided with a corresponding projector, screen content is projected onto the screen, and a user can view content displayed in the screen in the annular three-dimensional space; constructing a criminal crime scene environment in a virtual system, wherein the criminal scene environment comprises a background environment and an interactive environment, the background environment comprises environmental factors irrelevant to the current crime case, the interactive environment comprises a plurality of interactive factors, at least one interactive factor of the interactive factors is relevant to the criminal crime case, and the constructed criminal crime scene environment is projected to the annular wall screen; arranging a camera sensor and a positioning sensor, wherein the camera sensor is used for acquiring the image information of an object or a person in the annular three-dimensional space, and the positioning sensor is used for acquiring the coordinate information of the object or the person in the annular three-dimensional space; carrying out sensor fusion on data acquired by a camera sensor and a positioning sensor to obtain fusion data, and dynamically capturing an object or a person in the annular three-dimensional space based on the fusion data; and a criminal investigation virtual scene is set in the virtual system, and a user interacts with the virtual scene in the annular three-dimensional space.
The scheme of this application can be applied to the virtual reality recreation scene of simulation criminal investigation, also can be applied to criminal investigation training virtual reality scene, and it possesses following advantage:
1. carry out VR virtual interaction through setting up environment wall body screen and user to be applied to criminal investigation simulation with this system, improved user experience, improved criminal investigation teaching quality and learning efficiency.
2. Particularly, interactive factors outside the screen are set, the real factors are communicated with the virtual factor content, the user immersion is improved, and therefore the user experience is further improved.
3. The virtual system is provided with a plurality of sensors, and the interaction of the user and the interaction factors outside the screen is identified based on the sensor fusion data, so that the identification precision of the virtual reality system to the real events is improved, and the improvement of the interaction feedback precision of the virtual system is facilitated.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It should be clear that the drawings in the following description are only intended to illustrate some embodiments of the present application, and that for a person skilled in the art, it is possible to derive from these drawings, without inventive effort, technical features, connections or even method steps not mentioned in the other drawings.
Fig. 1 is a data processing flow chart based on a criminal investigation virtual scene provided by an embodiment of the invention.
Fig. 2 is a structural diagram of a data processing device based on a criminal investigation virtual scene according to an embodiment of the present invention.
DETAILED DESCRIPTION OF EMBODIMENT (S) OF INVENTION
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the examples of this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, and "a" and "an" typically include at least two, but do not exclude the presence of at least one.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a monitoring", depending on the context. Similarly, the phrase "if it is determined" or "if it is monitored (a stated condition or event)" may be interpreted as "when determining" or "in response to determining" or "when monitoring (a stated condition or event)" or "in response to monitoring (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Example 1
As shown in fig. 1, the data processing method based on criminal investigation virtual scene claimed in the present application includes:
s100, constructing an annular wall screen, wherein the annular wall screen surrounds an annular three-dimensional space, a corresponding projector is arranged at the back of the annular wall screen, screen content is projected onto the screen, and a user can view content displayed in the screen in the annular three-dimensional space;
the annular wall screen comprises a left screen, a right screen, an upper screen, a lower screen and a front screen; the screen is typically at a 90 degree angle to the front of the screen; in order to better accord with the habit of human eyes and improve the virtual environment immersion feeling of trained personnel, the plane included angles between the left screen and the front screen and between the front screen and the right screen are set to be 120-fold 128 degrees, the upper screen is set to be an arc, and the circle center corresponding to the arc line is 150-fold 170 degrees. Except for the lower screen, the left screen, the right screen, the upper screen and the front screen all use metal screens, and the content is displayed on the screens in a hoisting and forward projection mode; the lower screen can be used for the user to walk, and an LED screen is adopted; a protective layer is added between the lower screen and the user, and the protective layer has at least 325kg/m2The weight bearing capacity and the transparency of more than 90 percent provide weight support for users and related articles, and the users can watch the content displayed by the LED screen through the protective layer.
S110, constructing a criminal crime scene environment in a virtual system, wherein the criminal scene environment comprises a background environment and an interactive environment, the background environment comprises environmental factors irrelevant to the current crime case, the interactive environment comprises a plurality of interactive factors, at least one interactive factor of the interactive factors is relevant to the criminal crime case, and the constructed criminal crime scene environment is projected to the annular wall screen;
at least one of the plurality of interaction factors is unrelated to a crime case; and when the user interacts with at least one of the plurality of interaction factors, the interaction factors irrelevant to the crime case feed back information irrelevant to the crime case to the user.
Background environment content is relatively fixed, a plurality of crime scenes of one type can correspond to one background environment of one type, for example, crime scenes of a traffic accident type can have various conditions, wherein the condition 1 is that casualties are caused by accidents of driving motor vehicles after drinking wine, the condition 2 is that property damage is caused by accidents of running red light, and the two conditions can correspond to the same background environment of one type, such as a road background virtual reality environment. The road background virtual reality environment is irrelevant to the case of virtual crime, and is only provided for an immersive investigation experience environment for a user, so that the background and the interactive content are mutually stripped, the updating and maintenance of the content are efficient, and the content development efficiency is improved.
The interactive environment at least comprises interactive factors, the interactive factors are relevant to criminal investigation scenes, a user interacts with an investigation site based on the interactive factors, a trainee obtains experience knowledge based on an interaction result, a training instructor provides teaching for the trainee based on the interaction result, and the experience user obtains immersion experience. The multiple interaction factors may also include factors unrelated to criminal crime scenes, and setting up complex interaction factors of different functions facilitates development of different content applications. Specifically, in the event of a drunk driving motor vehicle accident scene, one interaction factor can be set in the annular three-dimensional space as an alcohol-containing pop can, and the other interaction factor is common road stones; when a user interacts with the alcohol-containing pop can, a prompt that drunk driving is likely to escape can be obtained, and when the user interacts with the common road stone, an invalid prompt or a prompt for interference can be obtained.
S120, a camera sensor and a positioning sensor are arranged, wherein the camera sensor is used for acquiring image information of an object or a person in the annular three-dimensional space, and the positioning sensor is used for acquiring coordinate information of the object or the person in the annular three-dimensional space; carrying out sensor fusion on data acquired by a camera sensor and a positioning sensor to obtain fusion data, and dynamically capturing an object or a person in the annular three-dimensional space based on the fusion data;
respectively loading a positioning sensor and a motion capture sensor on a user and an entity object of an interaction factor outside a screen, identifying the user and the user motion based on sensor data, and setting a user virtual object in a virtual system based on an identification result;
the camera sensor comprises a common image sensor which can be used for shooting images of users and objects, and identifying the conditions of the personnel and the objects on site through a person identification technology and a dynamic tracking technology; preferably, the camera sensor further comprises an infrared temperature sensor for identifying the user himself. When a user interacts with an object in the annular three-dimensional space, the shielding condition exists usually, and the object and the person at different temperatures are distinguished based on the identification result of the infrared temperature sensor when the shielding occurs, so that the interaction precision of the person and the object is improved.
The positioning sensor comprises a sensor worn by a user such as a glove, a helmet, a bracelet, a finger stall, clothes and the like, and further comprises a sticking sensor stuck to the characteristic position of an object in the annular three-dimensional space. For example, in a virtual environment of a crime scene caused by a hit and run, four sticky sensors are arranged at four characteristic angles of an automobile engine hood, whether the automobile engine hood is opened or not can be judged according to the motion tracks of the sensors, a user is spatially positioned based on the sensor worn by the user, and a specific scene is set to be a position where gloves are positioned below the engine hood, so that the user is judged to open the engine hood to execute related exploration operation. Various sensors can comprehensively analyze various data based on a sensor data fusion technology, preset a judgment model of each interaction event, and recognize interaction operation in the system operation process.
And performing fusion operation on data acquired by the positioning sensor and the camera sensor to obtain fusion data, and performing operations such as target motion recognition, motion capture and the like based on the fusion data.
S130, a criminal investigation virtual scene is set in the virtual system, and a user interacts with the virtual scene in the annular three-dimensional space.
The interactive factors at least comprise an on-screen interactive factor and an off-screen interactive factor. The interaction factor is one of the key points of the application. The interactive operation between the user and the solid object of the interactive factor outside the screen is identified through the acquired image information and coordinate information, the identified interactive operation result acts on the interactive virtual object in the virtual scene to trigger the crime scene investigation, and the virtual system feeds the scene investigation data back to the screen, so that the simulation of the crime scene investigation is realized.
In prior art VR systems, a content provider generally provides a corresponding virtual scene, and a user can interact with objects in the virtual scene, however, the virtual scene lacks reality connected with reality, and the immersion experienced by the user is limited. This application improves this technique, sets up the interactive factor outside the screen of virtual scene, and the user in annular three-dimensional space can carry out direct interaction with the interactive factor outside the screen, is showing and is improving user experience. For example, when a crime scene of a theft case is detected, a locker entity overturned by a suspected person is arranged in an annular three-dimensional space, the locker is modeled in a virtual system, a corresponding interactive virtual object is arranged, and in the process of investigation and teaching, if a user who recognizes the identity of a criminal police uses a tool to check the interactive operation of the fingerprint of the locker, relevant feedback is carried out, such as scoring the behavior, or displaying a fingerprint image to the user, so that interaction between VR and realization is realized.
In order to further improve the fidelity of a criminal investigation scene, the method models various measuring tools in a virtual system, models at least one criminal investigation tool virtual object in the virtual system, sets corresponding criminal investigation entity tools in an annular three-dimensional space, the two tools correspond to each other one by one, a user interacts with an entity object of an interaction factor through the criminal investigation tool, the virtual system acts the interaction operation on the corresponding criminal investigation tool virtual object and the interaction virtual object, and feedback is carried out based on a user interaction mode; if the user does not use specific work to directly check the fingerprint of the locker, ineffective interactive information is not fed back or fed back.
Example 2
As shown in fig. 2, fig. 2 is a diagram of a corresponding data processing device based on a criminal investigation virtual scene, which includes:
the display module is used for constructing an annular wall screen, the annular wall screen surrounds an annular three-dimensional space, a corresponding projector is arranged at the back of the annular wall screen, screen content is projected onto the screen, and a user can view content displayed in the screen in the annular three-dimensional space;
the virtual system module is used for constructing a criminal crime scene environment in the virtual system, wherein the criminal scene environment comprises a background environment and an interactive environment, the background environment comprises environmental factors irrelevant to the current crime case, the interactive environment comprises a plurality of interactive factors, at least one interactive factor of the interactive factors is relevant to the criminal crime case, and the constructed criminal crime scene environment is projected to the annular wall screen;
the sensor module is provided with a camera sensor and a positioning sensor, the camera sensor is used for acquiring the image information of an object or a person in the annular three-dimensional space, and the positioning sensor is used for acquiring the coordinate information of the object or the person in the annular three-dimensional space; carrying out sensor fusion on data acquired by a camera sensor and a positioning sensor to obtain fusion data, and dynamically capturing an object or a person in the annular three-dimensional space based on the fusion data;
and the investigation interaction module is used for setting a criminal investigation virtual scene in the virtual system, and a user interacts with the virtual scene in the annular three-dimensional space.
The interaction factors at least comprise an on-screen interaction factor and an off-screen interaction factor; the interactive factors outside the screen comprise an entity object arranged in the annular three-dimensional space and an interactive virtual object in the virtual scene, the interactive operation of the entity object of the interactive factors outside the screen is identified through fused data acquired by the sensor, the identified interactive operation result acts on the interactive virtual object in the virtual scene, criminal investigation action is triggered, and the virtual system feeds back the criminal investigation action data to the screen, so that the criminal investigation simulation is realized.
The annular wall screen comprises a left screen, a right screen, an upper screen, a lower screen and a front screen.
Wherein at least one of the plurality of interaction factors is unrelated to a crime case; and when the user interacts with at least one of the plurality of interaction factors, the interaction factors irrelevant to the crime case feed back information irrelevant to the crime case to the user.
Wherein, the interactive operation of the entity object of user and the interactive factor outside the screen is discerned through the image information and the coordinate information gathered, including:
respectively wearing a positioning sensor and a motion capture sensor on a physical object of interaction factors outside a screen and a user, identifying the user and the user motion based on sensor data, and setting a user virtual object in a virtual system based on an identification result;
applying the identified user action to a user virtual object in the virtual system; analyzing the data of the user virtual object and the interactive virtual object, and feeding back an interactive analysis result;
the system comprises a virtual system and a plurality of criminal investigation tool virtual objects, wherein at least one criminal investigation tool virtual object is modeled in the virtual system, corresponding criminal scene investigation tool entity tools are arranged in an annular three-dimensional space and are in one-to-one correspondence, a user interacts with entity objects of interaction factors through the criminal investigation tools, the virtual system acts interaction operation on the corresponding criminal investigation tool virtual object and the interaction virtual object, and feedback is carried out based on a user interaction mode.
Example 3
Example 3 demonstrates an example flow of data processing based on a criminal investigation virtual scene.
Starting a virtual system to work, forming an annular three-dimensional space by a multi-surface screen, and constructing a criminal investigation site of a virtual entrance robbery case in the annular three-dimensional space; the user gets into annular three-dimensional space, and the user wears positioner such as special gloves, helmet, bracelet, dactylotheca, clothing, and annular three-dimensional space surveys user's action based on infrared camera sensor. A user checks a detection site through a virtual environment, searches for suspicious objects and carries out interaction; the suspicious object comprises an in-screen interactive object and an out-screen interactive object; the interactive objects in the screen comprise windows, doors, bookcases and the like; the off-screen interactive objects include lockers, tables, corner clothing, dropped books, etc. And arranging a positioning sensor at a preset position of the off-screen interactive object, positioning and modeling the off-screen object based on the sensor, and setting a corresponding virtual object of the off-screen object in a virtual system. The method comprises the following steps that a user interacts with a suspicious target, interactive operation is sent to a virtual system, the virtual system simulates the interactive operation based on a virtual object of an object outside a screen, and an interactive result, such as parameters of fingerprints, bloodstains, time, evidences and the like related to a case and parameters unrelated to the case are fed back to the user together; and the user analyzes and processes the parameters to obtain a detection result. The position, relation and parameter of the site interaction factors are adjusted by the staff according to the requirements, and the criminal investigation scene is flexibly set; through a realistic criminal investigation scene, the user experiences the whole criminal investigation process.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.
The foregoing description shows and describes several preferred embodiments of the invention, but as aforementioned, it is to be understood that the invention is not limited to the forms disclosed herein, but is not to be construed as excluding other embodiments and is capable of use in various other combinations, modifications, and environments and is capable of changes within the scope of the inventive concept as expressed herein, commensurate with the above teachings, or the skill or knowledge of the relevant art. And that modifications and variations may be effected by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (8)
1. A criminal investigation virtual scene-based data processing method comprises the following steps:
s100, constructing an annular wall screen, wherein the annular wall screen surrounds an annular three-dimensional space, a corresponding projector is arranged at the back of the annular wall screen, screen content is projected onto the screen, and a user can view content displayed in the screen in the annular three-dimensional space;
s110, constructing a criminal crime scene environment in a virtual system, wherein the criminal scene environment comprises a background environment and an interactive environment, the background environment comprises environmental factors irrelevant to the current crime case, the interactive environment comprises a plurality of interactive factors, at least one interactive factor of the interactive factors is relevant to the criminal crime case, and the constructed criminal crime scene environment is projected to the annular wall screen;
s120, a camera sensor and a positioning sensor are arranged, wherein the camera sensor is used for acquiring image information of an object or a person in the annular three-dimensional space, and the positioning sensor is used for acquiring coordinate information of the object or the person in the annular three-dimensional space; carrying out sensor fusion on data acquired by a camera sensor and a positioning sensor to obtain fusion data, and dynamically capturing an object or a person in the annular three-dimensional space based on the fusion data;
s130, a criminal investigation virtual scene is set in the virtual system, and a user interacts with the virtual scene in the annular three-dimensional space;
the interaction factors at least comprise an in-screen interaction factor and an out-screen interaction factor; the interactive factors outside the screen comprise an entity object arranged in the annular three-dimensional space and an interactive virtual object in the virtual scene, the interactive operation of the entity object of the interactive factors outside the screen is identified through fused data acquired by the sensor, the identified interactive operation result acts on the interactive virtual object in the virtual scene, criminal investigation action is triggered, and the virtual system feeds back the criminal investigation action data to the screen, so that the criminal investigation simulation is realized.
2. The criminal investigation virtual scene-based data processing method according to claim 1, wherein at least one of the plurality of interaction factors is unrelated to criminal crime cases; and when the user interacts with at least one of the plurality of interaction factors, the interaction factors irrelevant to the criminal case feed back information irrelevant to the criminal case to the user.
3. The criminal investigation virtual scene-based data processing method according to claim 1, wherein the interactive operation of the user and the physical object of the off-screen interactive factor is identified by fused data obtained by fusing data collected by the sensor, and the method comprises the following steps:
respectively loading a positioning sensor and a motion capture sensor on a user and an entity object of an interaction factor outside a screen, identifying the user and the user motion based on sensor data, and setting a user virtual object in a virtual system based on an identification result;
applying the identified user action to a user virtual object in the virtual system; and analyzing the data of the user virtual object and the interactive virtual object, and feeding back the interactive analysis result.
4. The criminal investigation virtual scene-based data processing method according to claim 3, wherein at least one criminal investigation tool virtual object is modeled in the virtual system, corresponding criminal scene investigation tool physical tools are arranged in the annular three-dimensional space and correspond to each other one by one, a user interacts with a physical object of an interaction factor through the criminal investigation tool, the virtual system acts the interaction operation on the corresponding criminal investigation tool virtual object and the interaction virtual object, and feedback is performed based on the user interaction mode.
5. A criminal investigation virtual scene-based data processing apparatus comprising:
the display module is used for constructing an annular wall screen, the annular wall screen surrounds an annular three-dimensional space, a corresponding projector is arranged at the back of the annular wall screen, screen content is projected onto the screen, and a user can view content displayed in the screen in the annular three-dimensional space;
the virtual system module is used for constructing a criminal crime scene environment in the virtual system, wherein the criminal scene environment comprises a background environment and an interactive environment, the background environment comprises environmental factors irrelevant to the current crime case, the interactive environment comprises a plurality of interactive factors, at least one interactive factor of the interactive factors is relevant to the criminal crime case, and the constructed criminal crime scene environment is projected to the annular wall screen;
the sensor module is provided with a camera sensor and a positioning sensor, the camera sensor is used for acquiring the image information of an object or a person in the annular three-dimensional space, and the positioning sensor is used for acquiring the coordinate information of the object or the person in the annular three-dimensional space; carrying out sensor fusion on data acquired by a camera sensor and a positioning sensor to obtain fusion data, and dynamically capturing an object or a person in the annular three-dimensional space based on the fusion data;
the investigation interaction module is used for setting a criminal investigation virtual scene in the virtual system, and the trainee interacts with the virtual scene in the annular three-dimensional space;
the interaction factors at least comprise an in-screen interaction factor and an out-screen interaction factor; the interactive factors outside the screen comprise an entity object arranged in the annular three-dimensional space and an interactive virtual object in the virtual scene, the interactive operation of the entity object of the interactive factors outside the screen is identified through fused data acquired by the sensor, the identified interactive operation result acts on the interactive virtual object in the virtual scene, criminal investigation action is triggered, and the virtual system feeds back the criminal investigation action data to the screen, so that the criminal investigation simulation is realized.
6. The criminal investigation virtual scene-based data processing device according to claim 5, wherein at least one of said plurality of interaction factors is unrelated to criminal crime cases; and when the user interacts with at least one of the plurality of interaction factors, the interaction factors irrelevant to the criminal case feed back information irrelevant to the criminal case to the user.
7. The criminal investigation virtual scene-based data processing device according to claim 5, wherein the interaction operation of the user with the physical object of the off-screen interaction factor is identified by fused data obtained by fusing data collected by the sensor, comprising:
respectively loading a positioning sensor and a motion capture sensor on a user and an entity object of an interaction factor outside a screen, identifying the user and the user motion based on sensor data, and setting a user virtual object in a virtual system based on an identification result;
applying the identified user action to a user virtual object in the virtual system; and analyzing the data of the user virtual object and the interactive virtual object, and feeding back the interactive analysis result.
8. The device of claim 7, wherein at least one criminal investigation tool virtual object is modeled in the virtual system, and corresponding criminal scene investigation tool physical tools are arranged in the annular three-dimensional space, the criminal investigation tool physical tools correspond to the criminal scene investigation tool physical objects one to one, a user interacts with the physical object of the interaction factor through the criminal investigation tool, the virtual system acts the interaction operation on the corresponding criminal investigation tool virtual object and the interaction virtual object, and feedback is performed based on the user interaction mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110291697.2A CN113157088B (en) | 2021-03-18 | 2021-03-18 | Criminal investigation virtual scene-based data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110291697.2A CN113157088B (en) | 2021-03-18 | 2021-03-18 | Criminal investigation virtual scene-based data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113157088A CN113157088A (en) | 2021-07-23 |
| CN113157088B true CN113157088B (en) | 2022-04-08 |
Family
ID=76888126
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110291697.2A Active CN113157088B (en) | 2021-03-18 | 2021-03-18 | Criminal investigation virtual scene-based data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113157088B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104331929A (en) * | 2014-10-29 | 2015-02-04 | 深圳先进技术研究院 | Crime scene reduction method based on video map and augmented reality |
| CN111695424A (en) * | 2020-05-07 | 2020-09-22 | 广东康云科技有限公司 | Crime scene restoration method, crime scene restoration system and storage medium based on three-dimensional real scene |
| CN112307406A (en) * | 2020-11-23 | 2021-02-02 | 安徽鹿鼎科技有限公司 | Criminal meeting investigation and examination comprehensive application platform |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10268266B2 (en) * | 2016-06-29 | 2019-04-23 | Microsoft Technology Licensing, Llc | Selection of objects in three-dimensional space |
| US20190156558A1 (en) * | 2016-08-31 | 2019-05-23 | Factualvr, Inc. | Virtual reality system |
| CN107340862A (en) * | 2017-06-29 | 2017-11-10 | 三峡大学 | A kind of process of commission of crime analysis system and method based on virtual reality |
| CN109637256A (en) * | 2019-01-29 | 2019-04-16 | 湖北警官学院 | A kind of criminal investigation virtual emulation practice-training teaching application system and method |
| CN110738895A (en) * | 2019-09-16 | 2020-01-31 | 潘涛 | Criminal scene investigation real-scene VR comprehensive training system |
| CN110619777B (en) * | 2019-09-26 | 2021-08-27 | 重庆三原色数码科技有限公司 | Criminal investigation and experiment intelligent training and assessment system creation method based on VR technology |
-
2021
- 2021-03-18 CN CN202110291697.2A patent/CN113157088B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104331929A (en) * | 2014-10-29 | 2015-02-04 | 深圳先进技术研究院 | Crime scene reduction method based on video map and augmented reality |
| CN111695424A (en) * | 2020-05-07 | 2020-09-22 | 广东康云科技有限公司 | Crime scene restoration method, crime scene restoration system and storage medium based on three-dimensional real scene |
| CN112307406A (en) * | 2020-11-23 | 2021-02-02 | 安徽鹿鼎科技有限公司 | Criminal meeting investigation and examination comprehensive application platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113157088A (en) | 2021-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7036186B2 (en) | Video processing system, video processing method and video processing program | |
| US10950103B2 (en) | Virtual enhancement of security monitoring | |
| US20200348677A1 (en) | System for customizing the operation of a self-driving motor vehicle | |
| US20060009702A1 (en) | User support apparatus | |
| CN101952868A (en) | Dangerous driving prevention consciousness decision-making system and dangerous driving prevention consciousness decision method | |
| CN111091044B (en) | Network appointment-oriented in-vehicle dangerous scene identification method | |
| CN110147731A (en) | Vehicle type recognition method and Related product | |
| CN106710348A (en) | Civil air defense interactive experience method and system | |
| CN112990057A (en) | Human body posture recognition method and device and electronic equipment | |
| CN110544312A (en) | Video display method and device in virtual scene, electronic equipment and storage device | |
| CN113064486B (en) | VR education training method and device based on crime scene investigation | |
| CN113157088B (en) | Criminal investigation virtual scene-based data processing method and device | |
| Van Rest et al. | Requirements for multimedia metadata schemes in surveillance applications for security | |
| CN113066182A (en) | Information display method and device, electronic equipment and storage medium | |
| WO2015005102A1 (en) | Image processing device, image processing method, and image processing program | |
| CN110533889B (en) | Sensitive area electronic equipment monitoring and positioning device and method | |
| CN110073364A (en) | Object detection systems and its method based on RGBD sensing | |
| CN112669578B (en) | Interested object warning method and system based on sound source in afterglow area | |
| JP6739119B6 (en) | Risk determination program and system | |
| JP6739115B6 (en) | Risk determination program and system | |
| CN113837066A (en) | Behavior recognition method and device, electronic equipment and computer storage medium | |
| KR100712959B1 (en) | Marking system and method for global local security recorder | |
| US20240119815A1 (en) | Virtual enhancement of security monitoring | |
| Sisodia et al. | Anomalous Motion Identification for Bank Surveillance | |
| Toma et al. | Determining car driver interaction intent through analysis of behavior patterns |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |