CN110148222A - It is a kind of that vehicle method and system are seen based on AR technology - Google Patents
It is a kind of that vehicle method and system are seen based on AR technology Download PDFInfo
- Publication number
- CN110148222A CN110148222A CN201910445658.6A CN201910445658A CN110148222A CN 110148222 A CN110148222 A CN 110148222A CN 201910445658 A CN201910445658 A CN 201910445658A CN 110148222 A CN110148222 A CN 110148222A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- technology
- module
- scene
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Abstract
Vehicle method and system are seen based on AR technology the invention discloses a kind of, comprising the following steps: S1: collecting vehicle data, 3D modeling and rendering is carried out to vehicle according to data, and import and see vehicle software；S2: virtual reality development kit is integrated into and described sees vehicle software；S3: the human-computer interaction operating system of software is established；S4: operator is opened camera, is directed at any scene, the vehicle of selection is put into selected scene using the software integrated in step S1, S2 and S3；S5: dollying head position, the state of omnibearing observation vehicle appearance and vehicle under selected scene；S6: vehicle scaling, rotation and appearance switching observation operation are completed by the human-computer interaction operating system.The present invention has the advantages that free scene, adaptive scene changes, human-computer interaction is strong, sees that vehicle experience sense is good.
Description
Technical field
The present invention relates to field of virtual reality, and in particular to a kind of to see vehicle method and system based on AR technology.
Background technique
Vehicle transaction industry is the industry that trading volume is bigger at this stage, in the link for carrying out sale of automobile, Mai Fangxu
Actual observation is carried out to automobile, but since 2D picture can not react truth, scene sees that vehicle will receive time, distance etc.
The obstruction of human factor reduces the efficiency for selecting vehicle, therefore the 3D for simulating reality sees that vehicle mode becomes more and more popular.
Existing 3D, which is seen in driving skills art, establishes model for the data of automobile, and people pass through rotation auto model on software,
Vehicle condition can be got information about, still, often will appear the case where not being inconsistent with virtual condition, this is because car model exists
It carrying out being single constant when data acquisition, all users are it is seen that same vehicle condition, but in actual use, with
Setting off for the factors such as environment, illumination, background, can there are gaps with the vehicle of 3D modeling, even if having scene switching, and in advance
The online experience of the fixed environment data of design, user has been limited in the scene set, and experience property is poor.
Summary of the invention
In view of the above shortcomings of the prior art, the technical problems to be solved by the present invention are: how to provide a kind of scene from
Choosing, adaptive scene changes, human-computer interaction is strong, sees that vehicle experience sense is good sees vehicle method based on AR technology.
In order to solve the above-mentioned technical problem, present invention employs the following technical solutions:
It is a kind of that vehicle method is seen based on AR technology, comprising the following steps:
S1: collecting vehicle data, carries out 3D modeling and rendering to vehicle according to data, and import and see vehicle software,；
S2: virtual reality development kit is integrated into and described sees vehicle software；
S3: the human-computer interaction operating system of software is established；
S4: operator is opened camera, is directed at any scene, will selected using the software integrated in step S1, S2 and S3
Vehicle be put into selected scene；
S5: dollying head position, the state of omnibearing observation vehicle appearance and vehicle under selected scene；
S6: vehicle scaling, rotation and appearance switching observation operation are completed by the human-computer interaction operating system.
Further, in step S1, the vehicle data include vehicle modeling size data, appearance and interior trim information and
Fine arts material, wherein modeling size data are according to the reduction of the actual size and ratio of vehicle, the appearance and interior trim information
For the practical pattern of the practical exterior color of vehicle, shape and interior trim, the fine arts material is that actual vehicle is alternatively believed
Breath.
Further, the software modeled in step S1 to vehicle is Max3D, Maya, C4D, ZBrush modeling software.
Further, the rendering of vehicle includes the material to modeling vehicle, baking rendering and ambient lighting in step S2
With the setting of vehicle reflected intensity parameter, the rendering is carried out by Unity3D development technique.
Further, human-computer interaction operating system is used for performance of operator's simulating vehicle under different situations in step S3
Switching realizes vehicle color replacement, adjustment vehicle location, size and angle, adjustment vehicle body brightness, car door is opened by controlling UI
Close human-computer interaction operation.
Further, in step S4, vehicle is placed in the scene of camera acquisition, is identified using Kalman filter
Vision inertia ranging technology and the output of combined inertia airmanship as a result, selection closer to one of real scene, realizes vehicle
The adjustment of posture.
It is a kind of that vehicle system is seen based on AR technology, which is characterized in that including information acquisition system, simulation reality system and people
Machine interaction systems；
The information acquisition system is for acquiring reality scene, light environment information；
The simulation reality system is used to be loaded into auto model information in actual environment, as the variation of environmental information is real
Now adaptive vehicle-state adjustment；
The human-computer interaction system carries out the state tune of active for realizing the auto model in operator and environmental information
It is whole, flexibly check information of vehicles.
Further, the information acquisition system includes: image capture module, video acquisition module, Lighting information acquisition
Module and audio collection module.
Further, the simulation reality system includes that visible sensation distance range finder module, combined inertia navigation module, position chase after
Track module and optical Information Processing module.
Further, the human-computer interaction system include image present module, gesture tracing module, touch sensible module,
And information switch module.
The invention has the benefit that the present invention sees that vehicle system is unable to satisfy the defect that real scene is experienced and does for existing
It improves, user when in use, the vehicle for wanting to see can be placed in the scene of own camera acquisition, such as from family
In institute, road or city, the performance of vehicle is checked according to the environmental information that own camera acquires, passes through dollying
Head checks the vehicle-state of different location, compares the in-mind anticipation of oneself, and can satisfy the needs for seeing vehicle, and when having saved
Between, it improves and selects vehicle efficiency.
Detailed description of the invention
Fig. 1 is a kind of flow chart for seeing one embodiment of vehicle method based on AR technology of the present invention.
Fig. 2 is a kind of frame diagram for seeing one embodiment of vehicle system based on AR technology of the present invention.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawing.
It is as shown in Figs. 1-2, a kind of that vehicle method is seen based on AR technology, comprising the following steps:
S1: collecting vehicle data, carries out 3D modeling and rendering to vehicle according to data, and import and see vehicle software,；
S2: virtual reality development kit is integrated into and described sees vehicle software；
S3: the human-computer interaction operating system of software is established；
S4: operator is opened camera, is directed at any scene, will selected using the software integrated in step S1, S2 and S3
Vehicle be put into selected scene；
S5: dollying head position, the state of omnibearing observation vehicle appearance and vehicle under selected scene；
S6: vehicle scaling, rotation and appearance switching observation operation are completed by the human-computer interaction operating system.
Further, in step S1, the vehicle data include vehicle modeling size data, appearance and interior trim information and
Fine arts material, wherein modeling size data are according to the reduction of the actual size and ratio of vehicle, the appearance and interior trim information
For the practical pattern of the practical exterior color of vehicle, shape and interior trim, the fine arts material is that actual vehicle is alternatively believed
Breath.
Further, the software modeled in step S1 to vehicle is Max3D, Maya, C4D, ZBrush modeling software.
Further, the rendering of vehicle includes the material to modeling vehicle, baking rendering and ambient lighting in step S2
With the setting of vehicle reflected intensity parameter, the rendering is carried out by Unity3D development technique.
Specifically, in this way AndroidStudio and Xcode engineering just can be exported with primary development, realize respectively
The app of Android and ios platform is integrated, improves integrated efficiency.
Further, human-computer interaction operating system is used for performance of operator's simulating vehicle under different situations in step S3
Switching realizes vehicle color replacement, adjustment vehicle location, size and angle, adjustment vehicle body brightness, car door is opened by controlling UI
Close human-computer interaction operation.
Further, in step S4, vehicle is placed in the scene of camera acquisition, is identified using Kalman filter
Vision inertia ranging technology and the output of combined inertia airmanship as a result, selection closer to one of real scene, realizes vehicle
The adjustment of posture.
Specifically, opening camera, towards any plane that can put vehicle, virtual reality can use the survey of vision inertia
Away from the vision difference feature (cluster characteristic point) in technology identification camera acquisition visual information, obtained in conjunction with inertial navigation technology
Change in location of the equipment in physical space, combine the defeated of two technologies using Kalman filter (Kalman Filter)
Out as a result, determining estimation closer " true " position (ground truth) of user and the working as more new equipment which technology provides
Preceding posture.
It is a kind of that vehicle system is seen based on AR technology, which is characterized in that including information acquisition system, simulation reality system and people
Machine interaction systems；
The information acquisition system is for acquiring reality scene, light environment information；
The simulation reality system is used to be loaded into auto model information in actual environment, as the variation of environmental information is real
Now adaptive vehicle-state adjustment；
The human-computer interaction system carries out the state tune of active for realizing the auto model in operator and environmental information
It is whole, flexibly check information of vehicles.
Specifically, by acquisition familiar object data, mark basis of formation labeled data collection, and in virtual scene into
Row simulation, truthful data is merged with analogue data, forms dedicated labeled data collection, dedicated labeled data collection input front end is set
It is standby, by continuous model training and object detection training, autonomous learning is carried out, strengthens recognition accuracy, when user's input is existing
When the scene of field, dedicated labeled data collection and field scene form special purpose model, and output result is checked for user.
Further, the information acquisition system includes: image capture module, video acquisition module, Lighting information acquisition
Module and audio collection module.
Further, the simulation reality system includes that visible sensation distance range finder module, combined inertia navigation module, position chase after
Track module and optical Information Processing module.
Specifically, the spatial position of tracing module real-time tracing user, i.e., three-dimensional motion (movement) on the direction xyz with bow
It faces upward/deflection/to roll (rotation), and recalculates the position of equipment before every frame refreshing, will be showed by vision (camera shooting) system
A point in the real world matches with the frame pixel on camera sensor, thus the posture of tracing equipment.Finally, software
Vision alignment is realized by acquisition equipment camera and equipment optical Information Processing module, and IMU is filtered out by low-pass filter
Noise in system realizes inertia calibration, keeps tracking result more accurate.
Further, the human-computer interaction system include image present module, gesture tracing module, touch sensible module,
And information switch module.
Specifically, user can change the posture and appearance color of vehicle body by touching image.
The invention has the benefit that the present invention sees that vehicle system is unable to satisfy the defect that real scene is experienced and does for existing
It improves, user when in use, the vehicle for wanting to see can be placed in the scene of own camera acquisition, such as from family
In institute, road or city, the performance of vehicle is checked according to the environmental information that own camera acquires, passes through dollying
Head checks the vehicle-state of different location, compares the in-mind anticipation of oneself, and can satisfy the needs for seeing vehicle, and when having saved
Between, it improves and selects vehicle efficiency.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that；It still may be used
To modify to technical solution documented by previous embodiment, or same replace is carried out to some or all of the technical features
It changes；And these are modified or replaceed, the range for technical solution of the embodiment of the present invention that it does not separate the essence of the corresponding technical solution,
It should all cover within the scope of the claims and the description of the invention.
Claims (10)
1. a kind of see vehicle method based on AR technology, which comprises the following steps:
S1: collecting vehicle data, carries out 3D modeling and rendering to vehicle according to data, and import and see vehicle software；
S2: virtual reality development kit is integrated into and described sees vehicle software；
S3: the human-computer interaction operating system of software is established；
S4: operator is opened camera, any scene is directed at, by the vehicle of selection using the software integrated in step S1, S2 and S3
It is put into selected scene；
S5: dollying head position, the state of omnibearing observation vehicle appearance and vehicle under selected scene；
S6: vehicle scaling, rotation and appearance switching observation operation are completed by the human-computer interaction operating system.
A kind of vehicle method is seen based on AR technology 2. according to claim 1, which is characterized in that in step S1, the vehicle
Data include modeling size data, appearance and the interior trim information and fine arts material of vehicle, and wherein modeling size data are bases
The reduction of the actual size and ratio of vehicle, the appearance and interior trim information are the practical exterior color of vehicle, shape and interior
The practical pattern of decorations, the fine arts material are the interchangeable information of actual vehicle.
A kind of vehicle method is seen based on AR technology 3. according to claim 2, which is characterized in that in step S1 to vehicle into
The software of row modeling is Max3D, Maya, C4D, ZBrush modeling software.
A kind of vehicle method is seen based on AR technology 4. according to claim 3, which is characterized in that the wash with watercolours of vehicle in step S2
Dye includes the material to modeling vehicle, baking rendering and the setting of ambient lighting and vehicle reflected intensity parameter, the rendering
It is carried out by Unity3D development technique.
A kind of vehicle method is seen based on AR technology 5. according to claim 4, which is characterized in that human-computer interaction in step S3
Performance switching of the operating system for operator's simulating vehicle under different situations, by controlling UI, realization vehicle color is replaced,
Adjust vehicle location, size and angle, adjustment vehicle body brightness, door contact interrupter human-computer interaction operation.
A kind of vehicle method is seen based on AR technology 6. according to claim 5, which is characterized in that in step S4, by vehicle
It is placed in the scene of camera acquisition, identifies vision inertia ranging technology and combined inertia navigation skill using Kalman filter
Art output as a result, selection realizes the adjustment of vehicle attitude closer to one of real scene.
7. a kind of see vehicle system based on AR technology, which is characterized in that including information acquisition system, simulation reality system and man-machine
Interaction systems；
The information acquisition system is for acquiring reality scene, light environment information；
The simulation reality system is used to be loaded into auto model information in actual environment, as the variation of environmental information is realized certainly
The vehicle-state of adaptation adjusts；
The human-computer interaction system adjusts for realizing the state that the auto model in operator and environmental information carries out active, spirit
Living checks information of vehicles.
A kind of vehicle system is seen based on AR technology 8. according to claim 7, which is characterized in that the information acquisition system
It include: image capture module, video acquisition module, Lighting information acquisition module and audio collection module.
A kind of vehicle system is seen based on AR technology 9. according to claim 8, which is characterized in that the simulation reality system
Including visible sensation distance range finder module, combined inertia navigation module, location tracking module and optical Information Processing module.
A kind of vehicle system is seen based on AR technology 10. according to claim 9, which is characterized in that the human-computer interaction system
System includes that module, gesture tracing module, touch sensible module and information switch module is presented in image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910445658.6A CN110148222A (en) | 2019-05-27 | 2019-05-27 | It is a kind of that vehicle method and system are seen based on AR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910445658.6A CN110148222A (en) | 2019-05-27 | 2019-05-27 | It is a kind of that vehicle method and system are seen based on AR technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110148222A true CN110148222A (en) | 2019-08-20 |
Family
ID=67591972
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910445658.6A Pending CN110148222A (en) | 2019-05-27 | 2019-05-27 | It is a kind of that vehicle method and system are seen based on AR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110148222A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110488979A (en) * | 2019-08-23 | 2019-11-22 | 北京枭龙科技有限公司 | A kind of automobile showing system based on augmented reality |
| CN111414225A (en) * | 2020-04-10 | 2020-07-14 | 北京城市网邻信息技术有限公司 | Three-dimensional model remote display method, first terminal, electronic device and storage medium |
| CN112509152A (en) * | 2020-12-17 | 2021-03-16 | 重庆实唯信息技术有限公司 | Car watching method, system, equipment and readable medium based on AR technology |
| CN113034697A (en) * | 2019-12-24 | 2021-06-25 | 北京车和家信息技术有限公司 | Method, device and system for augmented reality display of target equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170004651A1 (en) * | 2014-07-24 | 2017-01-05 | Youngzone Culture (Shanghai) Co., Ltd. | Augmented reality technology-based handheld viewing device and method thereof |
| CN107564108A (en) * | 2017-07-27 | 2018-01-09 | 湖北历拓网络科技有限公司 | The vehicle method of commerce and device of a kind of virtual reality |
| CN108427499A (en) * | 2018-02-13 | 2018-08-21 | 视辰信息科技(上海)有限公司 | A kind of AR systems and AR equipment |
| CN108536734A (en) * | 2018-03-02 | 2018-09-14 | 北京邮电大学 | A kind of movable dissemination methods of WEB AR |
| CN109427096A (en) * | 2017-08-29 | 2019-03-05 | 深圳市掌网科技股份有限公司 | A kind of automatic guide method and system based on augmented reality |
-
2019
- 2019-05-27 CN CN201910445658.6A patent/CN110148222A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170004651A1 (en) * | 2014-07-24 | 2017-01-05 | Youngzone Culture (Shanghai) Co., Ltd. | Augmented reality technology-based handheld viewing device and method thereof |
| CN107564108A (en) * | 2017-07-27 | 2018-01-09 | 湖北历拓网络科技有限公司 | The vehicle method of commerce and device of a kind of virtual reality |
| CN109427096A (en) * | 2017-08-29 | 2019-03-05 | 深圳市掌网科技股份有限公司 | A kind of automatic guide method and system based on augmented reality |
| CN108427499A (en) * | 2018-02-13 | 2018-08-21 | 视辰信息科技(上海)有限公司 | A kind of AR systems and AR equipment |
| CN108536734A (en) * | 2018-03-02 | 2018-09-14 | 北京邮电大学 | A kind of movable dissemination methods of WEB AR |
Non-Patent Citations (1)
| Title |
|---|
| 亮风台: "汽车之家AR车展", 《BILIBILI》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110488979A (en) * | 2019-08-23 | 2019-11-22 | 北京枭龙科技有限公司 | A kind of automobile showing system based on augmented reality |
| CN113034697A (en) * | 2019-12-24 | 2021-06-25 | 北京车和家信息技术有限公司 | Method, device and system for augmented reality display of target equipment |
| CN111414225A (en) * | 2020-04-10 | 2020-07-14 | 北京城市网邻信息技术有限公司 | Three-dimensional model remote display method, first terminal, electronic device and storage medium |
| CN111414225B (en) * | 2020-04-10 | 2021-08-13 | 北京城市网邻信息技术有限公司 | Three-dimensional model remote display method, first terminal, electronic device and storage medium |
| CN112509152A (en) * | 2020-12-17 | 2021-03-16 | 重庆实唯信息技术有限公司 | Car watching method, system, equipment and readable medium based on AR technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110148222A (en) | It is a kind of that vehicle method and system are seen based on AR technology | |
| CN110045816B (en) | Near-eye display and system | |
| US20230093612A1 (en) | Touchless photo capture in response to detected hand gestures | |
| CN107004279B (en) | Natural user interface camera calibration | |
| CN107004275B (en) | Method and system for determining spatial coordinates of a 3D reconstruction of at least a part of a physical object | |
| CN105931263B (en) | A kind of method for tracking target and electronic equipment | |
| US9986228B2 (en) | Trackable glasses system that provides multiple views of a shared display | |
| CN111344749B (en) | Directing attention to users | |
| KR20180101496A (en) | Head-mounted display for virtual and mixed reality with inside-out location, user body and environment tracking | |
| US10146332B2 (en) | Information processing device, information processing system, block system, and information processing method | |
| US11170521B1 (en) | Position estimation based on eye gaze | |
| KR20180108709A (en) | How to virtually dress a user's realistic body model | |
| JP2022519309A (en) | Lightweight, low power cross-reality device with high temporary resolution | |
| US10652525B2 (en) | Quad view display system | |
| CN112509040A (en) | Image-based detection of surfaces providing specular reflection and reflection modification | |
| US11776182B1 (en) | Techniques for enabling drawing in a computer-generated reality environment | |
| CN110692237B (en) | Method, system, and medium for lighting inserted content | |
| CN114041175A (en) | Neural network for estimating head pose and gaze using photorealistic synthetic data | |
| CN114022565A (en) | Alignment method and alignment device for display equipment and vehicle-mounted display system | |
| US20160332071A1 (en) | Information processing apparatus, information processing system, assembled device, and information processing method | |
| JP2022523283A (en) | Systems and methods for processing images for display devices | |
| US10130883B2 (en) | Information processing device and information processing method | |
| US20220256137A1 (en) | Position calculation system | |
| US11182978B1 (en) | Rendering virtual content with coherent visual properties | |
| WO2021029164A1 (en) | Image processing device, image processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190820 |
|
| RJ01 | Rejection of invention patent application after publication |