CN105654030A - Electronic apparatus, control method thereof, computer program, and computer-readable recording medium - Google Patents
Electronic apparatus, control method thereof, computer program, and computer-readable recording medium Download PDFInfo
- Publication number
- CN105654030A CN105654030A CN201510868227.2A CN201510868227A CN105654030A CN 105654030 A CN105654030 A CN 105654030A CN 201510868227 A CN201510868227 A CN 201510868227A CN 105654030 A CN105654030 A CN 105654030A
- Authority
- CN
- China
- Prior art keywords
- mentioned
- place
- guiding
- vehicle
- electronic installation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000004590 computer program Methods 0.000 title abstract description 8
- 238000009434 installation Methods 0.000 claims description 133
- 230000002708 enhancing effect Effects 0.000 claims description 55
- 238000005728 strengthening Methods 0.000 claims description 52
- 238000010586 diagram Methods 0.000 claims description 22
- 238000013507 mapping Methods 0.000 claims description 20
- 230000008569 process Effects 0.000 claims description 20
- 230000008859 change Effects 0.000 claims description 14
- 238000001514 detection method Methods 0.000 claims description 13
- 230000003190 augmentative effect Effects 0.000 abstract 1
- 238000004891 communication Methods 0.000 description 27
- 230000006870 function Effects 0.000 description 17
- 238000012360 testing method Methods 0.000 description 10
- 239000011159 matrix material Substances 0.000 description 7
- 230000009471 action Effects 0.000 description 6
- 238000007689 inspection Methods 0.000 description 6
- 238000010276 construction Methods 0.000 description 4
- 239000011435 rock Substances 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 206010039203 Road traffic accident Diseases 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 208000035126 Facies Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 235000000332 black box Nutrition 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/365—Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/3446—Details of route searching algorithms, e.g. Dijkstra, A*, arc-flags, using precalculated routes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/3647—Guidance involving output of stored or live camera images or video streams
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
Landscapes
- Engineering & Computer Science (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- Architecture (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Navigation (AREA)
- Traffic Control Systems (AREA)
Abstract
Disclosed herein are an electronic apparatus, a control method of the electronic apparatus, a computer program, and a computer-readable recording medium. The control method of an electronic apparatus includes: determining a position of a vehicle that is being operated; detecting information of a guidance point positioned in front of the determined position of the vehicle by a predetermined distance using a map data; generating an object indicating the guidance point using the information of the guidance point; and outputting the generated object through augmented reality.
Description
Technical field
The present invention relates to electronic installation, the control method of electronic installation, computer program and computer readable recording medium storing program for performing, more in detail, it relates to reality performs vehicle to use personnel drive the relevant electronic installation, the control method of electronic installation, computer program and the computer readable recording medium storing program for performing that guide strengthening.
Background technology
When the vehicle is running, the most important thing is to travel safely and prevention traffic accident, for this reason, the multiple supplementary unit of the function etc. be provided with, at vehicle, the posture performing control vehicle, controlling vehicle structure device and the security device such as securing band, air bag.
Moreover, in the recent period, be arranged at the device store car of the black box etc. of vehicle traveling image and from the data of various sensor transmissions, thus be in vehicle set when vehicle generation traffic accident for finding out the trend of the device of the cause of accident of vehicle. Owing to black box or navigating instrument application etc. can also be installed at the portable terminal equipment such as smart mobile phone, panel computer, thus it is used as vehicle device as above.
In fact, but the utilization ratio of the traveling image in this kind of vehicle device is very low at present. More specifically, even if obtaining the traveling image of vehicle by being installed on the first-class vision sensor of shooting of vehicle at present, the electronic installation of vehicle only stays in and merely shows, transmit this kind of image or only stay in the simple periphery notice information such as whether departing from track line that generates.
And, as new vehicle electronics concerned at present, head-up display (HUD is also proposed, Head-UpDisplay) or strengthen reality interface, but in these devices, the utilization ratio of the traveling image of vehicle is also only stopped in the aspect showing merely or generating simple notice information.
Summary of the invention
The present invention proposes according to above-mentioned necessity, it is an object of the invention to, if the scope within providing the vehicle in running to guide place to reach predetermined distance close to distance, then generate the object guiding place for representing, and export the electronic installation of the above-mentioned object generated, the control method of electronic installation, computer program and computer readable recording medium storing program for performing by strengthening reality.
Comprise for realizing the control method of the electronic installation of one embodiment of the invention of above-mentioned purpose: the step determining the position of the vehicle in running; Taking the position of determined above-mentioned vehicle as benchmark, utilization ground diagram data detects the step of the information in the guiding place being positioned at front predetermined distance scope;The information in above-mentioned guiding place is utilized to generate the step of the object for representing above-mentioned guiding place; And the step of the above-mentioned object generated is exported by strengthening reality.
And, can comprise above by strengthening the real step exporting the above-mentioned object generated: by camera being performed calibration (Calibration), calculate the step of camera parameter; Based on above-mentioned camera parameter, generate the step of the virtual three-dimensional space of the filmed image of above-mentioned camera; And the step of the above-mentioned object generated to above-mentioned virtual three-dimensional (3-Dimensional) spatial mappings.
Further, the control method of the electronic installation of the present invention also can comprise: the step calculating the alternate position spike information between the position of above-mentioned vehicle and above-mentioned guiding place; And utilize above-mentioned alternate position spike information to determine the step of position of the above-mentioned object generated in above-mentioned virtual three-dimensional space.
And, above-mentioned object can comprise the first object, and above-mentioned first object for representing the position in above-mentioned guiding place in the enhancing reality corresponding with real world.
Further, can according to the range difference of above-mentioned vehicle and above-mentioned guiding place move change above-mentioned first object manifest position.
And, if above-mentioned vehicle is through above-mentioned guiding place, then for represent the object in above-mentioned guiding place of process can disappear from above-mentioned enhancing reality.
Further, above-mentioned object also can comprise the 2nd object, and above-mentioned 2nd object is for guiding above-mentioned guiding place.
And, in the operational process of above-mentioned vehicle, if above-mentioned guiding place enters in the distance set in advance, then can activate above by strengthening the real step exporting the above-mentioned object generated.
And, when can be presented as between the boot section comprising and guiding and start place and guide end place in above-mentioned guiding place, in the above-mentioned step utilizing the information in above-mentioned guiding place to generate the object for representing above-mentioned guiding place, above-mentioned guiding is utilized to start the information in place and above-mentioned guiding terminates the information in place, generate for guiding the object between above-mentioned boot section, above by strengthening in the real step exporting the above-mentioned object generated, during above-mentioned vehicle is positioned between above-mentioned boot section, the above-mentioned object generated is exported by strengthening reality.
On the other hand, comprise for realizing the electronic installation of one embodiment of the invention of above-mentioned purpose: display portion, for display frame; Detection portion, taking the position of the vehicle in running as benchmark, utilizes ground diagram data to detect the information in the guiding place being positioned at front predetermined distance scope; Object generating unit, utilizes the information in above-mentioned guiding place to generate the object for representing above-mentioned guiding place; And control portion, reality shows the above-mentioned object generated by strengthening to control above-mentioned display portion.
And, the electronic installation of the present invention also can comprise: calibration portion, by camera is performed calibration, calculates camera parameter; Three-dimensional space generating unit, based on above-mentioned camera parameter, generates the virtual three-dimensional space of the filmed image of above-mentioned camera; And mapping portion, for mapping the object generated to the above-mentioned virtual three-dimensional space generated.
Further, above-mentioned control portion can calculate the alternate position spike information between the position of above-mentioned vehicle and above-mentioned guiding place, and utilizes above-mentioned alternate position spike information to determine the position of the above-mentioned object generated in above-mentioned virtual three-dimensional space.
And, above-mentioned object can comprise the first object, and above-mentioned first object for representing the position in above-mentioned guiding place in the enhancing reality corresponding with real world.
Further, can according to the range difference of above-mentioned vehicle and above-mentioned guiding place move change above-mentioned first object manifest position.
And, if above-mentioned vehicle is through above-mentioned guiding place, then for represent the object in above-mentioned guiding place of process can disappear from above-mentioned enhancing reality.
Further, the electronic installation of the present invention also can comprise the 2nd object for guiding above-mentioned guiding place.
And, in the operational process of above-mentioned vehicle, if above-mentioned guiding place enters in the distance set in advance, then can activate and manifest above-mentioned object in above-mentioned enhancing reality.
And, when can be presented as between the boot section comprising and guiding and start place and guide end place in above-mentioned guiding place, above-mentioned object generating unit utilizes above-mentioned guiding to start the information in place and above-mentioned guiding terminates the information in place, generate for guiding the object between above-mentioned boot section, above-mentioned control portion controls above-mentioned display portion, make during above-mentioned vehicle is positioned between above-mentioned boot section, show, by strengthening reality, the above-mentioned object generated.
On the other hand, following step is performed for realizing the computer program being stored in recording medium of one embodiment of the invention of above-mentioned purpose by combining with electronic installation: the step determining the position of the vehicle in running; Taking the position of determined above-mentioned vehicle as benchmark, utilization ground diagram data detects the step of the information in the guiding place being positioned at front predetermined distance scope; The information in above-mentioned guiding place is utilized to generate the step of the object for representing above-mentioned guiding place; And the step of the above-mentioned object generated is exported by strengthening reality.
On the other hand, in the computer readable recording medium storing program for performing of the computer program storing the control method for performing electronic installation of the one embodiment of the invention for realizing above-mentioned purpose, above-mentioned control method comprises: the step determining the position of the vehicle in running; Taking the position of determined above-mentioned vehicle as benchmark, utilization ground diagram data detects the step of the information in the guiding place being positioned at front predetermined distance scope; The information in above-mentioned guiding place is utilized to generate the step of the object for representing above-mentioned guiding place; And the step of the above-mentioned object generated is exported by strengthening reality.
Above-mentioned various embodiments according to the present invention, by reflection vehicle and guide the range difference between place strengthen reality picture three-dimensionally presents object manifest position, thus more effectively transmit the range difference between vehicle and guiding place to navigating mate.
Further, according to the above-mentioned various embodiments of the present invention, the position that manifests of object is made to strengthen mobile in reality picture change by the range difference between reflection vehicle and guiding place, such that it is able to guide to navigating mate offer with method more intuitively.
And, above-mentioned various embodiments according to the present invention, check to test the speed section, easily ways section etc. in place, interval in hypervelocity, position and the guidance information in place is dynamically manifested by strengthening practical method, thus effectively can provide to navigating mate and guide, and the interest of navigating mate can be caused, but also navigating mate can be sought the safety of vehicle is driven and accessibility.
Accompanying drawing explanation
Fig. 1 is the block diagram of the electronic installation representing one embodiment of the invention.
Fig. 2 is the block diagram of the enhancing reality providing unit specifically representing one embodiment of the invention.
Fig. 3 is the figure of the network for illustration of the system being connected with the electronic installation of one embodiment of the invention.
Fig. 4 is the schema of the control method of the electronic installation briefly expressing one embodiment of the invention.
Fig. 5 is the schema of the method mapping the object guiding place for representing in enhancing reality specifically representing one embodiment of the invention.
Fig. 6 is the figure of the conversion relation represented between the two dimension shooting image of one embodiment of the invention and virtual three-dimensional space.
Fig. 7 is the schema of the enhancing reality picture display process of the electronic installation specifically representing one embodiment of the invention.
Fig. 8 is the figure representing the enhancing reality picture that the display hypervelocity of one embodiment of the invention checks place.
Fig. 9 is the figure representing the place, display branch road of one embodiment of the invention, the enhancing reality picture of intermediate location.
Figure 10 is the figure representing the enhancing reality picture that the display hypervelocity of one embodiment of the invention checks place.
Figure 11 is the figure of the enhancing reality picture of the display road traffic direction board representing one embodiment of the invention.
Figure 12 is the figure of the enhancing reality picture representing the display construction section of one embodiment of the invention, foggy section.
Figure 13 be represent the display accident-prone road section of one embodiment of the invention, the figure of the enhancing reality picture in note falling section, falling rock section.
Figure 14 is the display zig zag section, easily the ways section that represent one embodiment of the invention, the figure noting the enhancing display frame in wildlife section.
Figure 15 is the figure of the enhancing reality picture of the display level crossing representing one embodiment of the invention.
Figure 16 is that represent one embodiment of the invention is the figure of embodiments when divergence type at camera and electronic installation.
Figure 17 is the figure of the embodiments when camera and electronic installation are integrated type representing one embodiment of the invention.
Figure 18 represents to utilize the head-up display of one embodiment of the invention and the figure of the embodiments of electronic installation.
Embodiment
The principle of following content only illustration of invention. Therefore, clearly do not illustrate at this specification sheets although those skilled in the art can invent or illustrate, but the principle of the present invention can be embodied and be contained in the concept of the present invention and the multiple device of scope. Further, the term of all conditions enumerated in the present invention and embodiment in principle clearly for understanding the concept of the present invention, and that it be understood that for not limit the embodiment and state enumerated especially in the manner.
Further, for enumerating the principle of the present invention, viewpoint and embodiment, and all detailed description enumerating specific embodiment should be understood to the structure comprising this kind of item and functional equivalent technical solutions. Further, this kind of equivalent technical solutions should be understood to include current disclosed equivalent technical solutions, also comprises the equivalent technical solutions being developed from now on, that is, all elements invented in the way of performing identical function with independent of structure.
Such as, therefore, the block diagram of this specification sheets should be understood to the viewpoint representing the concept in the exemplary loop principle of the present invention specialized. Similar, all schemas, State Transferring figure, false code etc. should be understood to no matter whether be substantially shown in computer-readable medium, no matter whether clearly illustrate computer or treater, all represent the multiple programs by computer or processing execution.
Treater or the function of multiple element shown in accompanying drawing comprising the functional block with the concept similar to treater display not only can be provided as specialized hardware, and can be provided as and use that have can the hardware of function of operating software relevantly to suitable software. When by treater offer above-mentioned functions, can providing above-mentioned functions by single application specific processor, single share processor or multiple indivedual treater, the part in these can be shared.
And, by process, control or term that concept similarly proposes clearly use not should with get rid of have can operating software ability hardware in the way of explain, should comprise while hint property is interpreted as digital signal processor (DSP) hardware, read-only storage (ROM) for storing software, random access memory (RAM) and nonvolatile memory in unrestricted mode.Also can comprise other known usual hardware.
In the claimed scope of invention of this specification sheets; the textural element showing as the mechanism for performing function described in detailed description comprises the combination of the loop element as performed above-mentioned functions or comprises all methods of the function of the software performing the form of ownership containing firmware/microcode etc.; and combine with for running the suitable loop of above-mentioned software, perform above-mentioned functions. By the present invention that this kind of claimed scope of invention defines; the function provided by the method enumerated in many ways combines; and combine with the mode required by the claimed scope of invention, thus can provide any method of above-mentioned functions it will be also be appreciated that to be equal to the method grasped from this specification sheets identical.
By the following detailed description relevant to accompanying drawing, object that can be definitely above-mentioned, feature and advantage, thus, general technical staff of the technical field of the invention can easily implement the technological thought of the present invention. Further, in the process that the present invention will be described, if judging, the concrete explanation to known technology likely makes the purport of the present invention become fuzzy, then by description is omitted.
Hereinafter, with reference to accompanying drawing, the various embodiments of the present invention is described in detail.
Fig. 1 is the block diagram of the electronic installation representing one embodiment of the invention. With reference to Fig. 1, electronic installation 100 comprises all or part of in storage portion 110, input portion 120, output portion 130, detection portion 140, enhancing reality providing unit 160, control portion 170, communication portion 180, sensing portion 190, power supply portion 195.
Here, electronic installation 100 can be presented as can to the smart mobile phone of the vehicle navigating mate relevant guiding of offer driving being in driving condition, panel computer, notebook computer, personal digital assistant (PDA, personaldigitalassistant), portable media player (PMP, portablemultimediaplayer), the multiple device such as intelligent glasses, expansion Reality glasses, navigating instrument (navigation), black box (Black-box), above-mentioned electronic installation 100 can be located at vehicle.
Here, the various states of the vehicle that the running status of vehicle can comprise the dead ship condition of vehicle, the running status of vehicle, the state etc. of parking of vehicle are driven by navigating mate.
Vehicle drive relevant guide can comprise depart from such as navigation, track line guide, front vehicles sets out guidings, signal lamp change guide, prevent from guiding with front vehicles collision, driveway change guide, driveway guides, the oil consumption of vehicle, moment acceleration, transport information, current vehicle current driving speed, apart from the distance till specific place, front, arrive the multiple guiding for auxiliary navigating mate driving vehicle such as consuming time till specific place, front.
Here, navigation can comprise: strengthens reality navigation, and the various information such as the position of personnel, direction that are combined in the image in the front of vehicle that shooting is running perform navigation; And two dimension (2D, 2-Dimensional) or three-dimensional (3D, 3-Dimensional) navigation, the various information such as the position of personnel, direction that are combined in diagram data two-dimensional or three-dimensional perform navigation. Wherein, navigation is interpreted as and is not only included in use personnel's ride-on vehicles and carries out navigation when driving, and also comprises the concept of the navigation of use personnel moving in the way of walking or running when.
Further, track line departs from guiding for whether the vehicle in traveling is departed from track line can guide.
Further, the guiding that whether front vehicles is set out and guided and can set out and carry out for the vehicle in front of the vehicle of contraposition in parking.
Further, signal lamp changes guiding can for whether the signal lamp in the front of the vehicle of contraposition in stopping changes the guiding carried out. As an example, if from representing that the Status Change that the red light of stop signal lights is the green light indicating signalling, then this can be guided.
Further, if prevent and front vehicles collision guiding can for stop or vehicle in travelling and distance between the vehicle in front within predetermined distance, then in order to prevent and front vehicles collision and the guiding that carries out.
Further, driveway changes that guide can for guided vehicle is altered to other driveways from the driveway residing for vehicle in order to the path till guiding point of destination.
Further, driveway guide can for vehicle currently residing for the guiding that carries out of driveway.
This kind can provide the relevant image of driving of multiple guiding to carry out captured in real-time by the camera placed towards the front of vehicle. Here, camera can be to form as one with the electronic installation 100 being positioned over vehicle, and takes the camera in the front of vehicle. In this case, camera can form as one with smart mobile phone, navigating instrument or black box, and electronic installation 100 can receive the image captured by the camera formed as one.
As another example, camera for be positioned over vehicle respectively with electronic installation 100, and can take the camera in the front of vehicle. In this case, camera can be the independent black box that the front towards vehicle is placed, electronic installation 100 receives the image captured by the black box of placement separately by wire/wireless communication, if or be inserted in electronic installation 100 for storing the storage media of the image captured by black box, then electronic installation 100 can receive the image captured by black box.
Hereinafter, based on foregoing, the electronic installation 100 of one embodiment of the invention is carried out more specifically bright.
Storage portion 110 performs the function of the several data needed for the work of storage electronics 100 and application. Especially, storage portion 110 can data needed for the work of storage electronics 100, as operating system (OS), path explore application, diagram data etc. Further, storage portion 110 can store the data that the work by electronic installation 100 generates, as explore path data, the image etc. that receives.
Wherein, storage portion 110 is possible not only to be presented as random access memory (RAM, RandomAccessMemory), flash memory, read-only storage (ROM, ReadOnlyMemory), erasable programmable read-only storage (EPROM, ErasableProgrammableROM), electrically erasable formula read-only storage (EEPROM, ElectronicallyErasableandProgrammableROM), register, hard disk, moveable magnetic disc, RAM (random access memory) card, common user identification module (USIM, the internally-arranged type storage element such as UniversalSubscriberIdentityModule), the storage element of the dismantled and assembled forms such as the total linear memory of general serial can also be presented as.
Input portion 120 performs the function that the physics input from the outside input of electronic installation 100 is converted to specific electrical signal. Wherein, input portion 120 can comprise all or part of in use personnel's input portion 121 and microphone portion 123.
Use personnel's input portion 121 can receive the input that touch, pushing action etc. use personnel. Here, it may also be useful to personnel's input portion 121 can utilize the form of multiple button, the touch sensing device receiving touch input, receive embodying close at least one in sensor close to action.
The sound that microphone portion 123 can receive use personnel and the sound produced from the inside and outside of vehicle.
Output portion 130 is the device of the data for exporting electronic installation 100. Wherein, output portion 130 can comprise all or part of in display portion 131 and audio output part 133.
Display portion 131 be electronic installation 100 export can in the way of sense of vision the device of the data of identification. The display portion before the shell being located at electronic installation 100 can be presented as by display portion 131. Further, display portion 131 can form as one with electronic installation 100, and exports the identification data of sense of vision, also such as head-up display, can arrange separately the identification data exporting sense of vision with electronic installation 100.
Audio output part 133 be electronic installation 100 export can in the way of audio the device of the data of identification. Audio output part 133 embodies the data that should inform use personnel of electronic installation 100 by showing the loud speaker of sound.
Communication portion 180 can in order to make electronic installation 100 and other equipment carry out communicating and establish. Communication portion 180 can comprise all or part of in position data portion 181, wireless Internet portion 183, broadcast receiving and transmitting portion 185, mobile division 186, closely communication portion 187, wire communication portion 189.
Position data portion 181 is the device being obtained position data by global navigation satellite system (GNSS, GlobalNavigationSatelliteSystem). global navigation satellite system means to utilize the electric wave signal received from moonlet to calculate the navigationsystem of the position receiving terminal. as the concrete example of global navigation satellite system, Global Positioning System (GPS can be divided into according to subject of operation, GlobalPositioningSystem), GALILEO positioning system (Galileo), Ge Luonasi satellite navigation system (GLONASS, GlobalOrbitingNavigationalSatelliteSystem), Beidou satellite navigation system (COMPASS), India area navigation statllite system (IRNSS, IndianRegionalNavigationalSatelliteSystem), accurate zenith statllite system (QZSS, Quasi-ZenithSatelliteSystem) etc. by receiving, the signal to the global navigation satellite system of the area offer service using electronic installation 100 obtains positional information to the position data portion 181 of the electronic installation 100 of one embodiment of the invention.
Wireless Internet portion 183 is the device obtaining data or the information of transmission with wireless Internet by being connected. The wireless Internet connected by wireless Internet portion 183 can be WLAN (wireless local area network) (WLAN, WirelessLAN), wireless broadband (Wibro, Wirelessbroadband), worldwide interoperability for microwave access (Wimax, Worldinteroperabilityformicrowaveacess), high-speed slender body theory (HSDPA, HighSpeedDownlinkPacketAcess) etc.
Broadcast receiving and transmitting portion 185 is the device being received and dispatched broadcast signal by various loudspeaker system. the loudspeaker system received and dispatched by broadcast receiving and transmitting portion 185 can broadcast (DMBT for ground digital multimedia, DigitalMultimediaBroadcastingTerrestrial), digital multimedia satellite broadcast (DMBS, DigitalMultimediaBroadcastingSatellite), mobile TV standard (the MediaFLO that high pass proposes, MediaForwardLinkOnly), hand-held digital video broadcast (DVBH, DigitalVideoBroadcastHandheld), Japanese Digital audio broadcasting scheme (ISDBT, IntegratedServicesDigitalBroadcastTereestrial) etc.The broadcast signal received and dispatched by broadcast receiving and transmitting portion 185 can comprise traffic data, life data etc.
Mobile division 186 can according to G mobile communication (3G, 3rdGeneration), third generation affiliate plan (3GPP, 3rdGenerationPartnershipProject), the various kinds of mobile communication specification such as long-term evolution plan (LTE, LongTermEvoloution) is connected with mobile radio communication and communicates.
Closely communication portion 187 is the device for closely communicating. As mentioned above, closely communication portion 187 is by bluetooth (Bluetooth), RF identification (RFID, RadioFrequencyIdntification), infrared data tissue (IrDA, InfraedDataAssociation), ultra broadband (UWB, UltraWidBand), ZigBee protocol (ZigBee), near-field communication (NFC, NearFieldCommunication), Wireless Fidelity (Wi-Fi) etc. communicate.
Wire communication portion 189 is the interface arrangement that electronic installation 100 can be made in a wired fashion to be connected with other equipment. Wire communication portion 189 can for carrying out the universal serial bus module communicated by USB port (USBPort).
This kind of communication portion 180 can utilize at least one in position data portion 181, wireless Internet portion 183, broadcast receiving and transmitting portion 185, mobile division 186, closely communication portion 187, wire communication portion 189 to come and other devices communicatings.
As an example, when electronic installation 100 does not comprise camera function, at least one in closely communication portion 187, wire communication portion 189 can be utilized to receive the image of the vehicle camera shootings such as black box.
As another example, when with multiple devices communicating, it is possible to being communicated by closely communication portion 187 by an equipment, another equipment is communicated by wire communication portion 189.
Sensing portion 190 is can the device of current state of detection. electronics 100. Sensing portion 190 can comprise all or part of in action sensing portion 191, light sensing portion 193.
Action sensing portion 191 can motion on the three-dimensional space of detection. electronics 100. Action sensing portion 191 can comprise three axle geomagnetic sensor and 3-axis acceleration sensors. The exercise data obtained by action sensing portion 191 and the position data obtained by position data portion 191 can be combined, calculate the track more accurately of the vehicle being attached with electronic installation 100.
Light sensing portion 193 is the device of the periphery illumination (illuminance) measuring electronic installation 100. Utilize the illumination data obtained by light sensing portion 193, the brightness in display portion 195 can be made to change accordingly with periphery brightness.
The device of the power supply of power supply portion 195 needed for the work of other equipment working or being connected with electronic installation 100 for supplying electronic installation 100. Power supply portion 195 can for from the device being built in the outside power supply such as the battery of electronic installation 100 or vehicle and receiving power supply. Further, according to the form receiving power supply, power supply portion 195 can be presented as wire communication module 119 or be presented as the device receiving power supply wirelessly.
Detection portion 140 taking the position of the vehicle in running as benchmark, can utilize ground diagram data to detect the information in the guiding place being positioned at front predetermined distance scope. Specifically, detection portion 140, by the positional information of the vehicle obtained from position data portion 181 is applicable to ground diagram data, comes taking the position of vehicle as benchmark, and detection is positioned at the information in the guiding place of front predetermined distance scope.
Wherein, ground diagram data can obtain from the storage portion 110 in electronic installation 100, or can obtain from outside ground chart database of other beyond electronic installation 100 (DB, Database), or can obtain ground diagram data from other electronic installations.This kind of ground diagram data is the data of the map for representing current position and surrounding area, and above-mentioned ground diagram data can comprise: multiple traffic route, for the road represented in multiple region; And the attribute information of each above-mentioned multiple traffic route, guide place information. The attribute information of traffic route can comprise for represent above-mentioned traffic route be whether the track line line quantity information road corresponding with above-mentioned traffic route of the information of two-way traffic route or unidirectional traffic route, above-mentioned traffic route kind of information (such as, motorway, city expressway, national highway, local highway, common road etc.). Such as, guide the boot code (information of speed limit guiding, deceleration strip guiding etc.) that the information in place can comprise the positional information guiding place, guide place.
Wherein, guide place can comprise hypervelocity and check to test the speed place, intersection mouth place, place, branch road etc. in place, deceleration strip place, place, level crossing, interval. and, when being presented as between the boot section comprising and guiding and start place and guide end place in guiding place, can comprise interval test the speed section beginning place and terminate place, the beginning place in protection of the child region and end place, the beginning place of old man protection zone and end place, the beginning place of construction section and end place, the beginning place in foggy section and end place, the beginning place of accident-prone road section and end place, the beginning place in falling rock section and terminate place, the beginning place in zig zag section and end place, the beginning place of easy ways section and end place, note the beginning place in wildlife section and terminate place, the beginning place in limit for height section and end place etc.
On the other hand, the electronic installation 100 of one embodiment of the invention can comprise the enhancing reality providing unit 160 strengthening real view pattern for providing. Wherein, such as, strengthen reality can for providing the figure key element in Additional Information (place (PointOfInterest:POI) paid close attention to), expression to the figure key element etc. in path of point of destination in the picture of real world presenting the actual viewing of use personnel in the way of visually overlap) method. To this, specifically describe with reference to Fig. 2.
Fig. 2 is the block diagram of the enhancing reality providing unit 160 specifically representing one embodiment of the invention. With reference to Fig. 2, enhancing display providing unit 160 can comprise all or part of in calibration portion 161, three-dimensional space generating unit 162, object generating unit 163, mapping portion 164.
Calibration portion 161 can perform calibration, estimates the camera parameter corresponding with camera from the filmed image taken by camera. Wherein, camera parameter is the parameter forming camera matrix, above-mentioned camera matrix is that above-mentioned camera parameter can comprise for representing that real space is mapped in the information of the relation of photo: camera external parameter (extrinsicparameters) and camera inner parameter (intrinsicparameters).
Three-dimensional space generating unit 162 can generate virtual three-dimensional space based on the filmed image taken by camera. Specifically, three-dimensional space generating unit 162 is applicable to the filmed image of two dimension by the camera parameter estimated in calibration portion 161, generates virtual three-dimensional space.
Object generating unit 163 can generate the object for guiding in enhancing reality, and such as, navigation object, driveway change introductory object, track line departs from introductory object etc. Especially, object generating unit 163 can generate for representing by benchmark of the position of vehicle to be positioned at the object in the guiding place of front predetermined distance scope.Wherein, object can be presented as three dimensional object, image or art lines etc.
Mapping portion 164 can be mapped in, in the virtual three-dimensional space generated by three-dimensional space generating unit 162, the object that object generating unit 163 generates. Specifically, mapping portion 164 can determine the position of the object generated in object generating unit 163 in virtual three-dimensional space, and at determined position mapping object.
On the other hand, control portion 170 controls the whole work of electronic installation 100. Specifically, control portion 170 can control all or part of in storage portion 110, input portion 120, output portion 130, detection portion 140, enhancing reality providing unit 160, communication portion 180, sensing portion 190.
Especially, if the close distance guiding of the vehicle in running place reaches the scope within predetermined distance, then control portion 170 controllable objects generating unit 163 generates the object guiding place for representing, and, control portion can control display portion 131, and by strengthening, reality shows the object generated.
Specifically, the positional information that control portion 170 can utilize the vehicle obtained from position data portion 181 and the positional information in guiding place that obtains from detection portion 140, to calculate both alternate position spike information, judge the vehicle in running whether close to apart from the scope within guiding place to reach predetermined distance based on the alternate position spike information calculated.
If the close distance guiding of the vehicle in operation place reaches the scope within predetermined distance, then control portion 170 can utilize the alternate position spike information calculated to determine the position in above-mentioned guiding place in the virtual three-dimensional space generated by three-dimensional space generating unit 162. As an example, taking the X (dimension degree) in the three-dimensional space corresponding with real world, Y (longitude), Z (highly) coordinate figure as benchmark, positional information at the vehicle of position data portion 181 acquisition is (10,20,30), the positional information guiding place is (20,30,40), when, control portion 170 can calculate the alternate position spike information (10 of the difference as positional information, 10,10). And, control portion 170 can utilize the alternate position spike information calculated to determine the position in above-mentioned guiding place in the virtual three-dimensional space generated by three-dimensional space generating unit 162. Wherein, the positional information (10 of vehicle, 20,30) and guide place positional information (20,30,40) it is calculate taking the X (dimension degree) in the three-dimensional space corresponding with real world, Y (longitude), Z (highly) coordinate figure as benchmark respectively, therefore, such as in the positional information (10 of vehicle, 20,30), in, 10 is the numerical value corresponding with dimension values, 20 is the numerical value corresponding with longitude, and 30 is the numerical value corresponding with height value.
Further, if the vehicle in running is close to apart from guiding place to reach the scope within predetermined distance, then control portion 170 controllable objects generating unit 163 generates the introductory object guiding place for representing. Specifically, control portion 170 controllable objects generating unit 163 generates the first object being used for representing the position guiding place in the enhancing reality corresponding with real world. Further, the boot code that control portion 170 controllable objects generating unit 163 obtains in detection portion 140 by utilizing generates the 2nd object for guiding place. As an example, when being hypervelocity inspection place when guiding place, the 2nd object can comprise: the object of text modality, for guiding hypervelocity to check the speed limit in place; The object of camera image form, for guiding hypervelocity to check the inspection method in place.
On the other hand, control portion 170 can control mapping portion 164 and is mapped in, based on the position in guiding place determined in virtual three-dimensional space, the introductory object that object generating unit 163 generates.
And, control portion 170 can carry out following control: utilizes camera matrix, the virtual three-dimensional space mapping introductory object according to the mapping in mapping portion 164 is transformed to two dimensional image, generate the enhancing show image of two dimension with this, and shown the enhancing reality imagery generated by display portion 131.
Like this, according to one embodiment of the invention, strengthening, by the range difference between reflection vehicle and guiding place, the display position three-dimensionally presenting object in reality picture, thus more effectively can transmit vehicle to navigating mate and guide the range difference between place.
On the other hand, can according to vehicle with guide place range difference move change in the enhancing reality corresponding with real world represent guide place position the first object manifest position. Such as, along with the operation of vehicle, if vehicle is with guiding, the distance in place becomes short, then the position that control portion 170 can control to move change the first object according to the range difference of vehicle and guiding place in mapping portion 164 maps. That is, along with the traveling of vehicle, if the distance in vehicle and guiding place becomes short, then the first object can be apparent in gradually near the position of vehicle in enhancing reality picture.
Further, if vehicle is through guiding place, then for represent the object in guiding place of process can disappear strengthening in picture. That is, along with the traveling of vehicle, if vehicle through guiding place, then for represent process guiding place position the first object and for guide process guiding place the 2nd object can strengthen reality picture in disappear.
Like this, according to one embodiment of the invention, by reflection vehicle and guide the range difference between place strengthen in reality picture mobile change object manifest position, such that it is able to provide guiding with method more intuitively to navigating mate.
On the other hand, in the operational process of vehicle, if guiding place to enter in the distance set in advance, then can activate the work manifesting introductory object in above-mentioned enhancing reality picture.
Further, above-mentioned guiding place can be presented as only to be needed the form that single place guides such as what hypervelocity checked place etc., or also can be presented as the form comprising and guiding between starting place and guiding the boot section terminating place. like this, if embodying above-mentioned guiding place with the form between boot section, then control portion 170 control object generating unit 163 utilizes and guides the information starting place and guide the information terminating place to generate for the object guided between boot section, and control portion 170 and can carry out following control: during vehicle is positioned between boot section, export, by strengthening reality, the object generated. such as, when between boot section for interval test the speed section, if the interval beginning place of testing the speed of the close distance of the vehicle in travelling reaches the scope within predetermined distance, then control portion 170 exports and starts first object of position in place by strengthening reality for representing to test the speed in interval, if the interval end place of testing the speed of the close distance of the vehicle in travelling reaches the scope within predetermined distance, then control portion 170 can carry out following control: exports and terminates first object of position in place by strengthening reality for representing to test the speed in interval, and during vehicle is positioned between boot section, export for the 2nd object guided between boot section by strengthening reality, if the vehicle in travelling tests the speed through interval terminates place, then can not export above-mentioned first object by strengthening reality, 2nd object.
Fig. 3 is the figure of the network for illustration of the system being connected with the electronic installation of one embodiment of the invention. With reference to Fig. 3, the electronic installation 100 of one embodiment of the invention can be presented as that navigating instrument, black box, smart mobile phone or other vehicles strengthen the various devices that reality interface generator etc. is arranged at vehicle, and can be connected with multiple communications net and other electronicss 61,62,63,64.
Further, electronic installation 100 can be connected with global positioning system (GPS) according to the electric wave signal received from moonlet 20, thus calculates current position and current time.
Each moonlet 20 can the different L-band frequency of transmission frequency wave band. Electronic installation 100 can calculate current position based on the time needed for the L-band frequency arrival electronic installation 100 sent from each moonlet 20.
On the other hand, electronic installation 100 is by communication portion 180, and wirelessly to be connected with network 30 by control station (ACR) 40, base station (RAS) 50 etc. If electronic installation 100 is connected with network 30, then also can be connected with other electronicss 61,62 being connected with network 30 in an indirect way, and exchange data.
On the other hand, electronic installation 100 can also to be connected with network 30 in an indirect way by having other equipment 63 of communication function. Such as, not there is the module can being connected with network 30 at electronic installation, communicate with other equipment 63 with the function that communicates by closely communication etc.
Fig. 4 is the schema of the control method of the electronic installation briefly expressing one embodiment of the invention. With reference to Fig. 4, electronic installation 100 can determine the position (step S101) of the vehicle in running. Specifically, the position data portion 181 of electronic installation 100 is by Global Positioning System (GPS, GlobalPositioningSystem)/global navigation satellite system (GMSS, GlobalNavigationSatelliteSystem) obtains position data.
And, electronic installation 100 taking the position of determined vehicle as benchmark, can utilize ground diagram data to detect the information (step S102) in the guiding place being positioned at front predetermined distance scope. Specifically, the positional information of the vehicle obtained from position data portion 181 can be applicable to ground diagram data by the detection portion 140 of electronic installation 100, thus is positioned at the information in the guiding place of front predetermined distance scope taking the position of vehicle as benchmark detects. Such as, wherein, the boot code (information) for speed limit guiding, deceleration strip guiding etc. being guided etc. that the information in place can comprise the positional information guiding place, guide place is guided.
And, electronic installation 100 can utilize and guide the information in place to generate the object (step S103) guiding place for representing. Specifically, the object generating unit 163 of electronic installation 100 can generate for the first object of the position in expression guiding place in the enhancing reality corresponding with real world and at least one in the 2nd object guiding place to guide. Wherein, object can be presented as three dimensional object, image or art lines.
And, by strengthening, reality shows the object (step S104) generated to electronic installation 100. In the case, the control portion 170 of electronic installation 100 calculates vehicle and guides the alternate position spike information in place, and the above-mentioned object utilizing the alternate position spike information calculated to determine to generate in virtual three-dimensional space is wanted mapped position, thus export, by strengthening reality, the object generated. Specifically illustrate that this kind strengthens the output of reality picture with reference to Fig. 5 to Fig. 6.
Fig. 5 is the schema of the method mapping the object guiding place for representing in enhancing reality specifically representing one embodiment of the invention. Fig. 6 is the figure of the conversion relation represented between the two dimension shooting image of one embodiment of the invention and virtual three-dimensional space.
With reference to Fig. 5 to Fig. 6, electronic installation 100, by camera is performed calibration, calculates camera parameter (step S201). Specifically, the calibration portion 161 of electronic installation 100 can perform calibration, from the camera parameter that the filmed image presumption taken by camera is corresponding with camera. Wherein, camera parameter can for forming the parameter of camera matrix, and above-mentioned camera matrix is for representing that real space is mapped in the information of the relation of photo. As shown in (a) part of Fig. 6, above-mentioned camera parameter can comprise camera external parameter 601, camera inner parameter 602. Wherein, fx, fy of camera inner parameter 602 can be focus distance (focallength), cx, cy can be principal point (principalpoint), skew_c=tan �� can be coefficient skewness (skewcoefficient). And, camera external parameter 601 can be for the coordinate (X by the three-dimensional point on world's system of coordinates 605 (worldcoordinatesystem), Y, coordinate (the Xc of the three-dimensional point Z) being transformed on camera system of coordinates 604 (CameraCoordinateSystem), Yc, Zc) rotation/movement transformation matrix. Like this, owing to camera external parameter is not the parameter that camera is intrinsic, therefore, above-mentioned camera external parameter can be different according to the arranging position and setting direction of camera, and, it is possible to according to how defining world's system of coordinates and different.
And, electronic installation 100 can generate the virtual three-dimensional space (step S202) of the filmed image of camera based on camera parameter. Specifically, the filmed image that the three-dimensional space generating unit 162 of electronic installation 100 is applicable to two dimension by the camera parameter estimated in calibration portion 161 generates virtual three-dimensional space. That is, with reference to (b) part of Fig. 6, camera filmed image is by obtaining some perspective projection (perspectiveprojection) on the three-dimensional space of world's system of coordinates 605 in two dimensional image plane. Therefore, the three-dimensional space generating unit 162 of electronic installation 100 by performing the inverse process of above-mentioned work based on camera parameter, thus generates the virtual three-dimensional space of world's system of coordinates 605 of the filmed image of camera.
And, electronic installation 100 can calculate the position of vehicle and guide the alternate position spike information (step S203) in place. Specifically, the control portion 170 of electronic installation 100 can utilize the vehicle obtained in position data portion 181 positional information and the positional information in guiding place that obtains in detection portion 140 are to calculate both alternate position spike information. As an example, the positional information at the vehicle of position data portion 181 acquisition is (10,20,30), when the positional information in guiding place is (20,30,40), control portion 170 can calculate alternate position spike information (10,10,10).
And, electronic installation 100 can utilize alternate position spike information to determine to guide the position (step S204) in place in virtual three-dimensional space. Specifically, if calculating the alternate position spike information of the alternate position spike as the position and vehicle guiding place, then can calculate the coordinate of alternate position spike information in the virtual three-dimensional space of world's system of coordinates 605, thus in virtual three-dimensional space, determine to guide the position in place.
And, electronic installation 100 can map, based on the position in the guiding place in virtual three-dimensional space, the object (step S205) generated in virtual three-dimensional space.
And, by the virtual three-dimensional space of mapping object being transformed to, two dimensional image generates enhancing reality imagery (step S206) to electronic installation 100. Specifically, the control portion 170 of electronic installation 100 can utilize camera matrix that the virtual three-dimensional space mapping introductory object according to the mapping in mapping portion 164 is transformed to two dimensional image, thus generates the enhancing reality imagery of two dimension.
And, electronic installation 100 can show the enhancing reality imagery (step S207) generated.
Fig. 7 is the schema of the enhancing reality picture display process of the electronic installation specifically representing one embodiment of the invention. With reference to Fig. 7, electronic installation 100 can determine the position (step S301) of the vehicle in running.
And, electronic installation 100 taking the position of determined vehicle as benchmark, can utilize ground diagram data to detect the information (step S302) in the guiding place being positioned at front predetermined distance scope.
Further, electronic installation 100 can utilize and guide the positional information in place to generate the first object (step S303) for representing the position guiding place in the enhancing reality corresponding with real world.
And, electronic installation 100 can utilize and guide the boot code in place to generate for the 2nd object (step S304) guiding place to guide.
Further, by strengthening, reality shows the object (step S305) generated to electronic installation 100.
And, if vehicle is through guiding place, then electronic installation 100 can strengthen in display frame remove for represent the object (step S306) in guiding place of process.
Hereinafter, the enhancing reality picture of various embodiments of the present invention is specifically described with reference to Fig. 8 to Figure 15.
Fig. 8 is the figure representing the enhancing reality picture that the display hypervelocity of one embodiment of the invention checks place. With reference to Fig. 8, by strengthening, reality shows for representing that in the enhancing reality corresponding with real world hypervelocity checks the first object 820 of the position in place, comprises the 2nd object 810 for hypervelocity checks the text that the speed limit in place guides electronic installation 100.
Especially, with reference to Fig. 8, can according to vehicle and guide the range difference in place move change the first object 820 manifest position. That is, along with the traveling of vehicle, if the distance in vehicle and guiding place becomes short, then the first object 820 can be apparent in gradually near the position of vehicle in enhancing reality picture.
Further, as shown in (c) part of Fig. 8, along with the traveling of vehicle, if vehicle and guiding place are closely, then by regulating the transparency of the first object, the 2nd object next transparent it are apparent in and strengthen in reality picture.
On the other hand, although not illustrating at Fig. 8, but, if vehicle is through guiding place, then for represent first object in guiding place of process, the 2nd object can disappear from strengthening reality picture.
Fig. 9 is the figure representing the place, display branch road of one embodiment of the invention, the enhancing reality picture of intermediate location. With reference to (a) part of Fig. 9, electronic installation 100 is by strengthening reality display for representing the first object 920 of the position in the place, branch road of the driving path being positioned at vehicle in the enhancing reality corresponding with real world, comprise for the 2nd object 910 to the text that the direction in place, branch road guides. And, with reference to (b) part of Fig. 9, electronic installation 100 is by strengthening the first object 940 that reality display is positioned at the position of the intermediate location of the driving path of vehicle for expression in the enhancing reality corresponding with real world, the 2nd object 930 comprising the text guided by intermediate location.
Figure 10 is the figure representing the enhancing reality picture that the display hypervelocity of one embodiment of the invention checks place. With reference to Figure 10, by strengthening, reality shows for representing that in the enhancing reality corresponding with real world hypervelocity checks the first object 1020 of the position in place, comprises the 2nd object 1010 that hypervelocity checks the text that the speed limit in place guides and comprise the 3rd object 1031,1032,1033 that hypervelocity checks the image that the inspection method in place guides electronic installation 100.
More specifically, when the inspection method checking place that exceeds the speed limit is fixed camera, by strengthening reality display such as the object of the Reference numeral 1031 in (a) part of Figure 10, when the inspection method checking place that exceeds the speed limit is box camera, by strengthening reality display such as the object of the Reference numeral 1032 of (b) part of Figure 10, when the inspection method checking place that exceeds the speed limit is mobile camera, by strengthening reality display such as the object of the Reference numeral 1033 of (c) part of Figure 10.
Figure 11 is the figure of the enhancing reality picture of the display road traffic direction board representing one embodiment of the invention. With reference to Figure 11, by strengthening, reality shows the road traffic direction board object 1101 for requiring navigating mate to note in the enhancing reality corresponding with real world (such as to electronic installation 100, shown in (b) part of Figure 11, for represent accident-prone road section direction board, for represent easy slideway road direction board, for represent level crossing direction board, for representing the direction board etc. of river bank road).
In the case, the control portion 170 of electronic installation 100 can carry out the control of the road area of the non-travel making road traffic direction board object 1101 be apparent in vehicle.
Figure 12 is the figure of the enhancing reality picture representing the display construction section of one embodiment of the invention, foggy section. With reference to (a) part of Figure 12, by strengthening, reality shows the object 1201 comprising the image guided by construction section to electronic installation 100. Or, with reference to (b) part of Figure 12, by strengthening, reality expression comprises the object 1202 to the image that foggy section guides to electronic installation 100.
Like this, only during vehicle is positioned between boot section, the object 1201,1202 for guiding between to boot section can be shown by strengthening reality.
And, although not figure 12 illustrates, but according to one embodiment of the invention, when vehicle start place close to the guiding between boot section and guide terminate place, by strengthening the object that reality display guides, for representing, the position starting place and the object of position guiding terminate place for representing.
Figure 13 be represent the display accident-prone road section of one embodiment of the invention, the figure of the enhancing reality picture in note falling section, falling rock section. With reference to (a) part of Figure 13, electronic installation 100 comprises the object 1301 of the image guided accident-prone road section by strengthening reality display. Or, with reference to (b) part of Figure 13, electronic installation 100 comprises the object 1302 of the image that section of attention being fallen guides by strengthening reality display. Or, with reference to (c) part of Figure 13, by strengthening, reality display comprises the object 1303 to falling rock image that section guides to electronic installation 100.
Figure 14 is the display zig zag section, easily the ways section that represent one embodiment of the invention, the figure noting the enhancing display frame in wildlife section.With reference to (a) part of Figure 14, by strengthening, reality display comprises the object 1401 to the image that zig zag section guides to electronic installation 100. Or (b) part with reference to Figure 14, by strengthening, reality display comprises the object 1402 to the image that easy ways section guides to electronic installation 100. Or, with reference to (c) part of Figure 14, by strengthening, reality display comprises the object 1403 noting the image that wildlife section guides electronic installation.
Figure 15 is the figure of the enhancing reality picture of the display level crossing representing one embodiment of the invention. With reference to Figure 15, by strengthening, reality display comprises the object 1501 to the image that place, level crossing guides to electronic installation 100.
Like this, various embodiments according to the present invention, by reflection vehicle and guide the range difference between place strengthen reality picture three-dimensionally presents object manifest position, thus more effectively can transmit the range difference between vehicle and guiding place to navigating mate.
Further, by reflection vehicle and guide the range difference between place strengthen reality picture changes object movably manifest position, such that it is able to provide guiding with method more intuitively to navigating mate.
And, check to test the speed section, easily ways section etc. in place, interval in hypervelocity, position and the guidance information in place is dynamically manifested by strengthening practical method, thus effectively can provide to navigating mate and guide, and the interest of navigating mate can be caused, but also navigating mate can be sought the safety of vehicle is driven and accessibility.
Figure 16 is that represent one embodiment of the invention is the figure of embodiments when divergence type at camera and electronic installation. With reference to Figure 16, the vehicle navigating instrument device 100 arranged respectively and vehicle black box 200 can utilize wire/wireless communication mode to form the system of one embodiment of the invention.
Vehicle navigating instrument 100 can comprise: display portion 131, is located at the forward face of the shell 191 of navigating instrument; Navigating instrument operated key 121; And navigating instrument microphone 123.
Vehicle black box 200 can comprise black box camera 222, black box microphone 224 and facies posterior hepatis 281.
Figure 17 is the figure of the embodiments when camera and electronic installation are integrated type representing one embodiment of the invention. With reference to Figure 17, when navigating instrument device 100 comprises shooting portion 150, it may also be useful to personnel can arrange navigating instrument device 100 as follows, namely, the shooting portion 150 of navigating instrument device 100 is made to take the front of vehicle, and the display section making navigating instrument device 100 can identify use personnel. With this, the system of one embodiment of the invention can be embodied.
Figure 18 represents to utilize the head-up display of one embodiment of the invention and the figure of the embodiments of electronic installation. With reference to Figure 18, head-up display to show on head-up display to strengthen reality guide picture by the wire/wireless communication between other equipment.
As an example, strengthen reality by utilizing the head-up display of vehicle front windshield or utilize the image superposition etc. of other image output devices to provide, like this, strengthen reality providing unit 160 and can generate reality imagery or be superimposed on the interface image etc. of glass. With this, can embody and strengthen reality navigating instrument or vehicle infotainment system etc.
On the other hand, it is possible to embody the control method of the electronic installation of above-mentioned various embodiments of the present invention with program, thus provide to server or equipment. With this, each device can be connected with the server having program stored therein or equipment and download said procedure.
And, it is possible to embody the control method of the electronic installation of the various embodiments of above-mentioned the present invention with program, thus the computer-readable recording medium (non-transitorycomputerreadablemedium) being stored in multiple non-transitory provides.The computer-readable recording medium of non-transitory does not also mean that the short period of time such as register, cache memory, storer store the medium of data, but means that semipermanent stores data, and can read the medium of (reding) by equipment. Specifically, the computer-readable recording medium that above-mentioned multiple application or program can be stored in the non-transitory such as CD (CD), digital versatile disc (DVD), hard disk, Blu-ray Disc, general serial bus, memory card, read-only storage provides.
And; above the preferred embodiments of the present invention are illustrated and illustrated; but the present invention is not limited to above-mentioned specific embodiment; when not departing from the purport of the present invention of application in the claimed scope of invention; can by general technical staff of the technical field of the invention to the invention process various deformation; further, the prospect of technological thought or the present invention that these deformation implementation modes should not depart from the present invention is understood separately.
Claims (18)
1. the control method of an electronic installation, it is characterised in that, comprising:
Determine the step of the position of the vehicle in running;
Taking the position of determined above-mentioned vehicle as benchmark, utilization ground diagram data detects the step of the information in the guiding place being positioned at front predetermined distance scope;
The information in above-mentioned guiding place is utilized to generate the step of the object for representing above-mentioned guiding place; And
The step of the above-mentioned object generated is exported by strengthening reality.
2. the control method of electronic installation according to claim 1, it is characterised in that,
Comprise above by strengthening the real step exporting the above-mentioned object generated:
By camera is performed calibration, calculate the step of camera parameter;
Based on above-mentioned camera parameter, generate the step of the virtual three-dimensional space of the filmed image of above-mentioned camera; And
The step of the above-mentioned object generated is mapped to above-mentioned virtual three-dimensional space.
3. the control method of electronic installation according to claim 2, it is characterised in that, also comprise:
Calculate the step of the alternate position spike information between the position of above-mentioned vehicle and above-mentioned guiding place; And
Above-mentioned alternate position spike information is utilized to determine the step of position of the above-mentioned object generated in above-mentioned virtual three-dimensional space.
4. the control method of electronic installation according to claim 3, it is characterised in that, above-mentioned object comprises the first object, and above-mentioned first object for representing the position in above-mentioned guiding place in the enhancing reality corresponding with real world.
5. the control method of electronic installation according to claim 4, it is characterised in that, according to the range difference of above-mentioned vehicle and above-mentioned guiding place move change above-mentioned first object manifest position.
6. the control method of electronic installation according to claim 1, it is characterised in that, if above-mentioned vehicle is through above-mentioned guiding place, then for represent the object in above-mentioned guiding place of process disappear from above-mentioned enhancing reality.
7. the control method of electronic installation according to claim 4, it is characterised in that, above-mentioned object also comprises the 2nd object, and above-mentioned 2nd object is for guiding above-mentioned guiding place.
8. the control method of electronic installation according to claim 1, it is characterized in that, in the operational process of above-mentioned vehicle, if above-mentioned guiding place enters in the distance set in advance, then activate above by strengthening the real step exporting the above-mentioned object generated.
9. the control method of electronic installation according to claim 1, it is characterised in that,
When being presented as between the boot section comprising and guiding and start place and guide end place in above-mentioned guiding place,
In the above-mentioned step utilizing the information in above-mentioned guiding place to generate the object for representing above-mentioned guiding place, utilize above-mentioned guiding to start the information in place and above-mentioned guiding terminates the information in place, generate for guiding the object between above-mentioned boot section,
Above by strengthening in the real step exporting the above-mentioned object generated, during above-mentioned vehicle is positioned between above-mentioned boot section, export, by strengthening reality, the above-mentioned object generated.
10. an electronic installation, it is characterised in that, comprising:
Display portion, for display frame;
Detection portion, taking the position of the vehicle in running as benchmark, utilizes ground diagram data to detect the information in the guiding place being positioned at front predetermined distance scope;
Object generating unit, utilizes the information in above-mentioned guiding place to generate the object for representing above-mentioned guiding place; And
Control portion, reality shows the above-mentioned object generated by strengthening to control above-mentioned display portion.
11. electronic installations according to claim 10, it is characterised in that, also comprise:
Calibration portion, by camera is performed calibration, calculates camera parameter;
Three-dimensional space generating unit, based on above-mentioned camera parameter, generates the virtual three-dimensional space of the filmed image of above-mentioned camera; And
Mapping portion, for mapping the object generated to the above-mentioned virtual three-dimensional space generated.
12. electronic installations according to claim 11, it is characterized in that, above-mentioned control portion calculates the alternate position spike information between the position of above-mentioned vehicle and above-mentioned guiding place, and utilizes above-mentioned alternate position spike information to determine the position of the above-mentioned object generated in above-mentioned virtual three-dimensional space.
13. electronic installations according to claim 12, it is characterised in that, above-mentioned object comprises the first object, and above-mentioned first object for representing the position in above-mentioned guiding place in the enhancing reality corresponding with real world.
14. electronic installations according to claim 13, it is characterised in that, according to the range difference of above-mentioned vehicle and above-mentioned guiding place move change above-mentioned first object manifest position.
15. electronic installations according to claim 10, it is characterised in that, if above-mentioned vehicle is through above-mentioned guiding place, then for represent the object in above-mentioned guiding place of process disappear from above-mentioned enhancing reality.
16. electronic installations according to claim 13, it is characterised in that, also comprise the 2nd object for guiding above-mentioned guiding place.
17. electronic installations according to claim 10, it is characterised in that, in the operational process of above-mentioned vehicle, if above-mentioned guiding place enters in the distance set in advance, then activate and manifest above-mentioned object in above-mentioned enhancing reality.
18. electronic installations according to claim 10, it is characterised in that,
When being presented as between the boot section comprising and guiding and start place and guide end place in above-mentioned guiding place,
Above-mentioned object generating unit utilizes above-mentioned guiding to start the information in place and above-mentioned guiding terminates the information in place, generates for guiding the object between above-mentioned boot section,
Above-mentioned control portion controls above-mentioned display portion, makes during above-mentioned vehicle is positioned between above-mentioned boot section, shows, by strengthening reality, the above-mentioned object generated.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910496468.7A CN110263688B (en) | 2014-12-01 | 2015-12-01 | Driving related guidance providing method and apparatus, and computer readable recording medium |
CN201910496805.2A CN110260877B (en) | 2014-12-01 | 2015-12-01 | Driving related guidance providing method and apparatus, and computer readable recording medium |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2014-0170050 | 2014-12-01 | ||
KR20140170050 | 2014-12-01 | ||
KR10-2015-0036151 | 2015-03-16 | ||
KR1020150036151A KR102406491B1 (en) | 2014-12-01 | 2015-03-16 | Electronic apparatus, control method of electronic apparatus, computer program and computer readable recording medium |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910496468.7A Division CN110263688B (en) | 2014-12-01 | 2015-12-01 | Driving related guidance providing method and apparatus, and computer readable recording medium |
CN201910496805.2A Division CN110260877B (en) | 2014-12-01 | 2015-12-01 | Driving related guidance providing method and apparatus, and computer readable recording medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105654030A true CN105654030A (en) | 2016-06-08 |
CN105654030B CN105654030B (en) | 2019-07-05 |
Family
ID=56138967
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510868227.2A Active CN105654030B (en) | 2014-12-01 | 2015-12-01 | Electronic device, the control method of electronic device, computer program and computer readable recording medium |
CN201910496468.7A Active CN110263688B (en) | 2014-12-01 | 2015-12-01 | Driving related guidance providing method and apparatus, and computer readable recording medium |
CN201910496805.2A Active CN110260877B (en) | 2014-12-01 | 2015-12-01 | Driving related guidance providing method and apparatus, and computer readable recording medium |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910496468.7A Active CN110263688B (en) | 2014-12-01 | 2015-12-01 | Driving related guidance providing method and apparatus, and computer readable recording medium |
CN201910496805.2A Active CN110260877B (en) | 2014-12-01 | 2015-12-01 | Driving related guidance providing method and apparatus, and computer readable recording medium |
Country Status (2)
Country | Link |
---|---|
KR (1) | KR102406491B1 (en) |
CN (3) | CN105654030B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109029488A (en) * | 2018-06-29 | 2018-12-18 | 百度在线网络技术(北京)有限公司 | Navigating electronic map generating method, equipment and storage medium |
CN110473415A (en) * | 2019-08-26 | 2019-11-19 | 安徽因特维可信息科技股份有限公司 | Signal lamp early warning system based on V2I |
CN110672112A (en) * | 2019-09-29 | 2020-01-10 | 百度在线网络技术(北京)有限公司 | Guide wire switching method, device, apparatus, and medium |
CN111094898A (en) * | 2017-09-21 | 2020-05-01 | 大众汽车有限公司 | Method, device, and computer-readable storage medium having instructions for controlling display of an augmented reality heads-up display device for a motor vehicle |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20210087271A (en) * | 2020-01-02 | 2021-07-12 | 삼성전자주식회사 | Apparatus and method for displaying navigation information of three dimention augmented reality |
CN112163466B (en) * | 2020-09-11 | 2024-03-15 | 杭州鸿泉物联网技术股份有限公司 | Height limiting determining method, device and system based on UWB |
KR102481075B1 (en) * | 2020-10-08 | 2022-12-26 | 네이버랩스 주식회사 | Method and system for controlling head up display |
CN112325893A (en) * | 2020-10-27 | 2021-02-05 | 李亚军 | Electronic map system, electronic map generation method, navigation method and navigation equipment |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101033978A (en) * | 2007-01-30 | 2007-09-12 | 珠海市智汽电子科技有限公司 | Assistant navigation of intelligent vehicle and automatically concurrently assisted driving system |
US20090140845A1 (en) * | 2007-12-04 | 2009-06-04 | Calsonic Kansei Corporation | Head-up display device for vehicle |
US20110052042A1 (en) * | 2009-08-26 | 2011-03-03 | Ben Tzvi Jacob | Projecting location based elements over a heads up display |
US20140285523A1 (en) * | 2011-10-11 | 2014-09-25 | Daimler Ag | Method for Integrating Virtual Object into Vehicle Displays |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3496418B2 (en) * | 1996-12-24 | 2004-02-09 | 住友電気工業株式会社 | Three-dimensional CG map display device and in-vehicle navigation device |
JP2007094045A (en) * | 2005-09-29 | 2007-04-12 | Matsushita Electric Ind Co Ltd | Navigation apparatus, navigation method and vehicle |
JP5376223B2 (en) * | 2009-05-18 | 2013-12-25 | アイシン精機株式会社 | Driving assistance device |
KR20130027367A (en) * | 2011-09-07 | 2013-03-15 | 동국대학교 산학협력단 | A navigation apparatus and method for displaying course thereof |
KR101318651B1 (en) * | 2011-11-15 | 2013-10-16 | 현대자동차주식회사 | Navigation System and Displaying Method Thereof |
KR101271235B1 (en) * | 2011-12-12 | 2013-06-10 | 자동차부품연구원 | Apparatus and method for providing driving imformation |
WO2013145072A1 (en) * | 2012-03-26 | 2013-10-03 | 三菱電機株式会社 | Camera calibration method, camera calibration program and camera calibration device |
JP5906988B2 (en) * | 2012-07-31 | 2016-04-20 | アイシン・エィ・ダブリュ株式会社 | Road shape guidance system, method and program |
-
2015
- 2015-03-16 KR KR1020150036151A patent/KR102406491B1/en active IP Right Grant
- 2015-12-01 CN CN201510868227.2A patent/CN105654030B/en active Active
- 2015-12-01 CN CN201910496468.7A patent/CN110263688B/en active Active
- 2015-12-01 CN CN201910496805.2A patent/CN110260877B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101033978A (en) * | 2007-01-30 | 2007-09-12 | 珠海市智汽电子科技有限公司 | Assistant navigation of intelligent vehicle and automatically concurrently assisted driving system |
US20090140845A1 (en) * | 2007-12-04 | 2009-06-04 | Calsonic Kansei Corporation | Head-up display device for vehicle |
US20110052042A1 (en) * | 2009-08-26 | 2011-03-03 | Ben Tzvi Jacob | Projecting location based elements over a heads up display |
US20140285523A1 (en) * | 2011-10-11 | 2014-09-25 | Daimler Ag | Method for Integrating Virtual Object into Vehicle Displays |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111094898A (en) * | 2017-09-21 | 2020-05-01 | 大众汽车有限公司 | Method, device, and computer-readable storage medium having instructions for controlling display of an augmented reality heads-up display device for a motor vehicle |
CN111094898B (en) * | 2017-09-21 | 2023-10-13 | 大众汽车有限公司 | Method and device for controlling the display of an augmented reality head-up display device for a motor vehicle |
CN109029488A (en) * | 2018-06-29 | 2018-12-18 | 百度在线网络技术(北京)有限公司 | Navigating electronic map generating method, equipment and storage medium |
CN110473415A (en) * | 2019-08-26 | 2019-11-19 | 安徽因特维可信息科技股份有限公司 | Signal lamp early warning system based on V2I |
CN110672112A (en) * | 2019-09-29 | 2020-01-10 | 百度在线网络技术(北京)有限公司 | Guide wire switching method, device, apparatus, and medium |
CN110672112B (en) * | 2019-09-29 | 2021-11-12 | 阿波罗智联(北京)科技有限公司 | Guide wire switching method, device, apparatus, and medium |
Also Published As
Publication number | Publication date |
---|---|
KR20160065724A (en) | 2016-06-09 |
CN105654030B (en) | 2019-07-05 |
KR102406491B1 (en) | 2022-06-10 |
CN110263688A (en) | 2019-09-20 |
CN110260877B (en) | 2023-07-21 |
CN110263688B (en) | 2024-05-31 |
CN110260877A (en) | 2019-09-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105654030A (en) | Electronic apparatus, control method thereof, computer program, and computer-readable recording medium | |
CN112740134B (en) | Electronic device, vehicle control method of electronic device, server, and method of providing accurate map data of server | |
US10145703B2 (en) | Electronic apparatus, control method thereof, computer program, and computer-readable recording medium | |
CN105185134A (en) | Electronic Apparatus, Control Method Of Electronic Apparatus And Computer Readable Recording Medium | |
KR102255432B1 (en) | Electronic apparatus and control method thereof | |
CN105185137A (en) | Analytical Instrument Inductors And Methods For Manufacturing Same | |
KR102123844B1 (en) | Electronic apparatus, control method of electronic apparatus and computer readable recording medium | |
KR20120079341A (en) | Method, electronic device and recorded medium for updating map data | |
KR20180090610A (en) | Method and apparatus for outputting information about a lane | |
KR102682772B1 (en) | Curve guidance method, curve guidance apparatus, electronic apparatus and program stored in the computer-readable recording meduim | |
KR20190078664A (en) | Method and apparatus for displaying content | |
CN108335507A (en) | Utilize the driving guiding providing method and device of the filmed image of camera | |
CN105651299A (en) | Electronic apparatus and control method thereof | |
CN105651298A (en) | Electronic apparatus and control method thereof | |
CN113715817B (en) | Vehicle control method, vehicle control device, computer equipment and storage medium | |
CN114422936A (en) | Tunnel traffic management method, device and storage medium | |
CN110399688A (en) | The environmental working condition of automatic Pilot determines method, apparatus and storage medium | |
KR102299501B1 (en) | Electronic apparatus, control method of electronic apparatus and computer readable recording medium | |
CN204833707U (en) | Traffic thing networking geographic information characteristic points cluster system | |
US20220035050A1 (en) | Server, non-transitory computer readable medium, communication apparatus, and vehicle | |
KR20120071857A (en) | Electronic device and mehtod of shooting pictures thereof | |
KR102091017B1 (en) | Electronic device and mehtod of shooting pictures thereof | |
CN117809463A (en) | Vehicle positioning method and electronic equipment | |
CN116972873A (en) | Navigation information display method, apparatus, device, storage medium and program product | |
CN116899230A (en) | Scene vehicle simulation system and method for automatic driving virtual test |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20210818 Address after: Seoul, South Kerean Patentee after: Hyundai Motor Co.,Ltd. Patentee after: Kia Co.,Ltd. Address before: Gyeonggi Do, South Korea Patentee before: THINKWARE SYSTEMS Corp. |
|
TR01 | Transfer of patent right |