CN110260877A - Drive related guidance providing method and device, computer readable recording medium - Google Patents

Drive related guidance providing method and device, computer readable recording medium Download PDF

Info

Publication number
CN110260877A
CN110260877A CN201910496805.2A CN201910496805A CN110260877A CN 110260877 A CN110260877 A CN 110260877A CN 201910496805 A CN201910496805 A CN 201910496805A CN 110260877 A CN110260877 A CN 110260877A
Authority
CN
China
Prior art keywords
place
guidance
mentioned
section
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910496805.2A
Other languages
Chinese (zh)
Other versions
CN110260877B (en
Inventor
趙浩亨
高锡弼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hyundai Motor Co
Kia Corp
Original Assignee
Thinkware Systems Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thinkware Systems Corp filed Critical Thinkware Systems Corp
Publication of CN110260877A publication Critical patent/CN110260877A/en
Application granted granted Critical
Publication of CN110260877B publication Critical patent/CN110260877B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/365Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/3446Details of route searching algorithms, e.g. Dijkstra, A*, arc-flags, using precalculated routes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/3647Guidance involving output of stored or live camera images or video streams
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

The present invention discloses the related guidance providing method of driving and device, computer readable recording medium.The step of related guidance providing method of driving of the invention comprises determining that the position of vehicle;On the basis of the position of above-mentioned determination, the step of detection using map datum positioned at the information in the guidance place of front predetermined distance range;The step of object for indicating above-mentioned guidance place is generated using the information in the guidance place of above-mentioned detection;And show the step of position shows the object of above-mentioned generation corresponding with the position in above-mentioned guidance place in the real world.

Description

Drive related guidance providing method and device, computer readable recording medium
It is on December 1st, 2015 that the application, which is the applying date, application No. is 201510868227.2, entitled " electronics The division Shen of the application for a patent for invention of device, the control method of electronic device, computer program and computer readable recording medium " Please.
Technical field
The present invention relates to drive correlation providing method and device, computer readable recording medium is guided to be related in more detail Electronic device, the control method of electronic device, calculating that vehicle drive correlation guides are executed to user of service on augmented reality Machine program and computer readable recording medium.
Background technique
When the vehicle is running, it is most important that safety traffic and prevention traffic accident execute control for this purpose, being equipped in vehicle The safety dresses such as a variety of auxiliary devices and safety belt, air bag of the posture of vehicle processed, the function of controlling vehicle structure device etc. It sets.
Moreover, in the recent period, it is set to the traveling image of the device storage vehicle of black box of vehicle etc. and from various biographies The data of sensor transmission, thus in the cause of accident when vehicle setting is when vehicle generation traffic accident for finding out vehicle The trend of device.Due to that can also be answered in the portable terminals such as smart phone, tablet computer installation black box or navigator With etc., thus it is used as vehicle device as described above.
But in fact, the utilization rate of the traveling image in this vehicle device is very low at present.More specifically, even if The traveling image of vehicle is obtained by the visual sensor of the camera that is installed on vehicle at present etc., the electronic device of vehicle is only It stays in and merely shows, transmits this image or only stay in whether generation is detached from the simple periphery notice letter such as lane line Breath.
Also, as new vehicle electronics concerned at present, it is also proposed that head-up display (HUD, Head-Up Display) or augmented reality interface, but in these devices, the utilization rate of the traveling image of vehicle is also only rested on merely Show or generate the level of simple notification information.
Summary of the invention
The present invention proposes according to above-mentioned necessity, if the object of the present invention is to provide running vehicle close to away from It guides place up to the range within predetermined distance, then generates the object for indicating guidance place, and by augmented reality come defeated The electronic device of above-mentioned object generated, the control method of electronic device, computer program and computer-readable record are situated between out Matter.
The control method of the electronic device of one embodiment of the invention for achieving the above object comprises determining that running The step of position of vehicle;On the basis of the position of identified above-mentioned vehicle, is detected using map datum and advised positioned at front The step of information in the guidance place of set a distance range;It is generated using the information in above-mentioned guidance place for indicating above-mentioned guidance The step of object in place;And by augmented reality come the step of exporting above-mentioned object generated.
Moreover, above by augmented reality come the step of exporting above-mentioned object generated can include: by camera Calibration (Calibration) is executed, the step of to calculate camera parameter;It is above-mentioned to generate based on above-mentioned camera parameter The step of virtual three-dimensional space of the filmed image of camera;And it is reflected to the space above-mentioned virtual three-dimensional (3-Dimensional) The step of penetrating above-mentioned object generated.
Also, the control method of electronic device of the invention may also include that the position for calculating above-mentioned vehicle and above-mentioned draw The step of leading the alternate position spike information between place;And it is determined in above-mentioned virtual three-dimensional space using above-mentioned alternate position spike information The step of position of above-mentioned object generated.
Moreover, above-mentioned object may include the first object, above-mentioned first object is used in enhancing corresponding with real world The position in above-mentioned guidance place is indicated in reality.
Also, above-mentioned first object can be changed according to above-mentioned vehicle and the movement of the range difference in above-mentioned guidance place shows position It sets.
Moreover, if above-mentioned vehicle passes through above-mentioned guidance place, the object in the above-mentioned guidance place for indicating to be passed through It can disappear from above-mentioned augmented reality.
Also, above-mentioned object may also include the second object, and above-mentioned second object is for guiding above-mentioned guidance place.
Moreover, if above-mentioned guidance place enters in preset distance, can swash in the operational process of above-mentioned vehicle It lives above by augmented reality come the step of exporting above-mentioned object generated.
Also, the guidance section including guidance beginning place and guidance end place can be presented as in above-mentioned guidance place In the case of, in the step of above-mentioned information using above-mentioned guidance place is to generate the object for indicating above-mentioned guidance place, Start the information in place and the information of above-mentioned guidance end place, using above-mentioned guidance to generate for guiding above-mentioned guidance section Object be located in above-mentioned vehicle and above-mentioned draw in the step of above by augmented reality to export above-mentioned object generated During leading section, above-mentioned object generated is exported by augmented reality.
On the other hand, the electronic device of one embodiment of the invention for achieving the above object includes: display unit, for showing Show picture;Test section is detected using map datum on the basis of the position of running vehicle positioned at front predetermined distance model The information in the guidance place enclosed;Object generating unit is generated using the information in above-mentioned guidance place for indicating above-mentioned guidance The object of point;And control unit, above-mentioned display unit is controlled to show above-mentioned object generated by augmented reality.
Moreover, electronic device of the invention may also include that calibration portion, by executing calibration to camera, taken the photograph to calculate As head parameter;Three-dimensional space generating unit, be based on above-mentioned camera parameter, come generate above-mentioned camera filmed image virtual three Dimension space;And mapping portion, for mapping object generated to above-mentioned virtual three-dimensional space generated.
Also, above-mentioned control unit can calculate the alternate position spike information between the position of above-mentioned vehicle and above-mentioned guidance place, And the position of above-mentioned object generated is determined in above-mentioned virtual three-dimensional space using above-mentioned alternate position spike information.
Moreover, above-mentioned object may include the first object, above-mentioned first object is used in enhancing corresponding with real world The position in above-mentioned guidance place is indicated in reality.
Also, above-mentioned first object can be changed according to above-mentioned vehicle and the movement of the range difference in above-mentioned guidance place shows position It sets.
Moreover, if above-mentioned vehicle passes through above-mentioned guidance place, the object in the above-mentioned guidance place for indicating to be passed through It can disappear from above-mentioned augmented reality.
Also, electronic device of the invention may also include the second object for guiding above-mentioned guidance place.
Moreover, if above-mentioned guidance place enters in preset distance, can swash in the operational process of above-mentioned vehicle Work shows above-mentioned object in above-mentioned augmented reality.
Also, the guidance section including guidance beginning place and guidance end place can be presented as in above-mentioned guidance place In the case of, above-mentioned object generating unit starts the information in place and the information of above-mentioned guidance end place, next life using above-mentioned guidance At for guiding the object in above-mentioned guidance section, above-mentioned control unit controls above-mentioned display unit, comes so that being located in above-mentioned vehicle upper During stating guidance section, above-mentioned object generated is shown by augmented reality.
On the other hand, the computer program for being stored in recording medium of one embodiment of the invention for achieving the above object Following steps can be executed by combining with electronic device: the step of determining the position of running vehicle;With identified On the basis of the position of above-mentioned vehicle, the information positioned at the guidance place of front predetermined distance range is detected using map datum Step;The step of object for indicating above-mentioned guidance place is generated using the information in above-mentioned guidance place;And pass through increasing Strong reality is come the step of exporting above-mentioned object generated.
On the other hand, being stored with for executing electronic device in one embodiment of the invention for achieving the above object In the computer readable recording medium of the computer program of control method, above-mentioned control method comprises determining that running vehicle Position the step of;On the basis of the position of identified above-mentioned vehicle, detected using map datum positioned at front regulation away from The step of information in the guidance place from range;It is generated using the information in above-mentioned guidance place for indicating above-mentioned guidance place Object the step of;And by augmented reality come the step of exporting above-mentioned object generated.
Above-mentioned various embodiments according to the present invention can increased by the distance between reflection vehicle and guidance place difference Object is presented to strong reality picture neutral body shows position, to more efficiently transmit vehicle and guidance ground to driver The distance between point difference.
Also, above-mentioned various embodiments according to the present invention, by reflection vehicle and guidance the distance between place difference come Make object shows position mobile change in augmented reality picture, so as to mention in more intuitive method to driver For guidance.
Also, above-mentioned various embodiments according to the present invention check that place, section are tested the speed section, easy ways section in hypervelocity Deng, position and the guidance information in place are dynamically shown by augmented reality method, so as to effectively to driver provide Guidance, and the interest of driver can be caused, but also safe driving and convenience of the driver to vehicle can be sought.
Detailed description of the invention
Fig. 1 is the block diagram for indicating the electronic device of one embodiment of the invention.
Fig. 2 provides the block diagram in portion for the specific augmented reality for indicating one embodiment of the invention.
Fig. 3 is the figure of the network of the system for illustrating to be connected with the electronic device of one embodiment of the invention.
Fig. 4 is the flow chart for briefly expressing the control method of electronic device of one embodiment of the invention.
Fig. 5 is the specific mapping in augmented reality for indicating one embodiment of the invention for indicating the object in guidance place The flow chart of method.
Fig. 6 is the transformation relation indicated between the two dimension shooting image of one embodiment of the invention and virtual three-dimensional space Figure.
Fig. 7 is the flow chart of the augmented reality picture display process of the specific electronic device for indicating one embodiment of the invention.
Fig. 8 is to indicate that the display hypervelocity of one embodiment of the invention checks the figure of the augmented reality picture in place.
Fig. 9 is the figure in the display branch road place for indicating one embodiment of the invention, the augmented reality picture of intermediate location.
Figure 10 is to indicate that the display hypervelocity of one embodiment of the invention checks the figure of the augmented reality picture in place.
Figure 11 is the figure for indicating the augmented reality picture of display road traffic direction board of one embodiment of the invention.
Figure 12 is the figure of the display construction section for indicating one embodiment of the invention, the augmented reality picture of Foggy Area.
Figure 13 is the display accident-prone road section for indicating one embodiment of the invention, pays attention to fall section, falling rock section Augmented reality picture figure.
Figure 14 is the display zig zag section for indicating one embodiment of the invention, easy ways section, pays attention to wild animal section The figure of enhancing display picture.
Figure 15 is the figure for indicating the augmented reality picture of display level crossing of one embodiment of the invention.
Figure 16 is the embodiment shape in the case where camera and electronic device are divergence type for indicating one embodiment of the invention The figure of state.
Figure 17 is the embodiment shape in the case where camera and electronic device are integrated type for indicating one embodiment of the invention The figure of state.
Figure 18 is the figure indicated using the head-up display of one embodiment of the invention and the embodiments of electronic device.
Specific embodiment
Content below is merely exemplary the principle of the present invention.Therefore, those skilled in the art can send out Although it is bright go out do not clearly state or illustrate in this specification, the principle of the present invention can be embodied and be contained in idea of the invention and A variety of devices of range.Also, the term and embodiment of all conditions enumerated in the present invention are specifically used for managing in principle Idea of the invention is solved, and, it is thus understood that do not limit the embodiment and state especially enumerated in the manner.
Also, for enumerating the principle of the present invention, viewpoint and embodiment, and enumerate all detailed description of specific embodiment It should be understood the structural and functional equivalent technical solutions comprising this item.Also, this equivalent technical solutions are answered Be understood to include presently disclosed equivalent technical solutions, further include the equivalent technical solutions that will be developed from now on, that is, with knot All elements that the mode that structure independently executes identical function is invented.
Thus, for example, the block diagram of this specification should be understood to mean the illustrative of the principle of the present invention materialization The viewpoint of the concept in circuit.Similar, all flow charts, state transition graph, pseudocode etc. should be understood regardless of whether real Be shown in computer-readable medium to matter, regardless of whether be explicitly illustrated computer or processor, indicate by computer or Handle the multiple programs executed.
Processor or include the functional block shown with concept similar with processor Various Components shown in the drawings Function not only can provide as specialized hardware, and can provide for software appropriate relatively using have can runs software function The hardware of energy.It, can be by single application specific processor, single shared processor or multiple when providing above-mentioned function by processor Respective processors provide above-mentioned function, and a part in these can be shared.
Also, with processing, control or concept similarly come the term that proposes clearly using should not be to exclude to have Can the mode of hardware of ability of runs software explain, should in a manner of unrestricted being construed as to imply that property include number letter Number processor (DSP) hardware, the read-only memory (ROM) for storing software, random access memory (RAM) and non-volatile Memory.It may also include other known usual hardware.
It is claimed in range, is shown as executing the documented function in detailed description in the invention of this specification The structural element of the mechanism of energy includes such as executing the combination of the loop element of above-mentioned function or containing firmware/microcode including executing Form of ownership software function all methods, and combined with the circuit appropriate for running above-mentioned software, to hold The above-mentioned function of row.The present invention that range is claimed by this invention to define, comes by the method enumerated in many ways The function of offer combines, and combines with inventing mode required by claimed range, thus can provide above-mentioned function Any method it will be also be appreciated that be equal to from this specification grasp method it is identical.
By following detailed description of relevant to attached drawing, can definitely above-mentioned objects, features and advantages, as a result, General technical staff of the technical field of the invention can easily implement technical idea of the invention.Also, to the present invention It, will if judging illustrating there is a possibility that purport of the invention thickens to well-known technique during being illustrated Description is omitted.
Hereinafter, various embodiments of the invention are described in detail referring to attached drawing.
Fig. 1 is the block diagram for indicating the electronic device of one embodiment of the invention.Referring to Fig.1, electronic device 100 includes storage unit 110, input unit 120, output section 130, test section 140, augmented reality offer portion 160, control unit 170, communication unit 180, sensing All or part of in portion 190, power supply unit 195.
Herein, electronic device 100, which can be presented as provide to the vehicle operator in driving condition, drives phase Close smart phone, the tablet computer, laptop, personal digital assistant (PDA, personal digital of guidance Assistant), portable media player (PMP, portable multimedia player), intelligent glasses, expansion are existing A variety of devices such as real glasses, navigator (navigation), black box (Black-box), above-mentioned electronic device 100 can be set to vehicle ?.
Herein, the operating status of vehicle may include the shape of parking of the dead ship condition of vehicle, the operating status of vehicle, vehicle The various states for the vehicle that state etc. is driven by driver.
The guidance of vehicle drive correlation may include set out such as navigation, lane line disengaging guidance, front vehicles guidance, signal lamp change It more guides, prevent from colliding guidance, driveway change guidance, driveway guidance, the oil consumption of vehicle, moment acceleration with front vehicles Degree, traffic information, the current driving speed of current vehicle, away from front locality until distance, reach front locality Until time-consuming it is equal for assisting driver to drive a variety of guidance of vehicle.
Herein, it navigates can include: augmented reality navigation is tied in the image in the front for shooting the vehicle in being currently running The various information such as position, the direction of user of service are closed to execute navigation;And two-dimentional (2D, 2-Dimensional) or three-dimensional (3D, 3-Dimensional) navigation, is used in combination the various letters such as position, the direction of personnel in two-dimensionally or three-dimensionally diagram data Breath is to execute navigation.Wherein, navigation is interpreted as not only including leading in the case where user of service's ride-on vehicles drive Boat further includes the concept of the navigation in the case that user of service is mobile in a manner of walking or run.
Also, it can be to guide to whether the vehicle in traveling is detached from lane line that lane line, which is detached from guidance,.
Also, front vehicles set out guidance whether can set out for the vehicle in the front of vehicle of the contraposition in parking into Capable guidance.
Also, signal lamp change guidance whether can be changed for the signal lamp in the front of vehicle of the contraposition in parking into Capable guidance.As an example, if from indicating that the Status Change that the red light of stop signal lights is the green light for indicating starting signal, This can be guided.
If also, preventing the guidance collided with front vehicles can be parking or the vehicle in traveling and the vehicle positioned at front The distance between within predetermined distance, then in order to prevent with front vehicles collide and carry out guidance.
Also, driveway change guidance can be to guide vehicle locating for the vehicle in order to guide the path until destination Driveway be altered to other driveways.
Also, driveway guidance can be the guidance that is carried out to the driveway that vehicle is presently in.
This driving coherent video that can provide a variety of guidance can be by the camera placed towards the front of vehicle come real When shoot.Herein, camera can be for be formed as one with the electronic device 100 for being placed in vehicle, and shoots vehicle The camera in front.In this case, camera can be formed as one with smart phone, navigator or black box, electronics Device 100 can receive image captured by the camera being formed as one.
As another example, camera can be to be respectively placed in vehicle with electronic device 100, and shoot the front of vehicle Camera.In this case, camera can be the individual black box placed towards the front of vehicle, electronic device 100 Image captured by individually placed black box is received by wire/wireless communication, if or for storing captured by black box The storage medium of image be inserted in electronic device 100, then electronic device 100 can receive image captured by black box.
Hereinafter, being based on above content, the electronic device 100 of one embodiment of the invention is more specifically illustrated.
A variety of data and the function of application needed for storage unit 110 executes the work of storage electronics 100.In particular, depositing Storage portion 110 can data needed for the work of storage electronics 100, such as operating system (OS), track search application, map datum Deng.Also, the data that storage unit 110 can store the work by electronic device 100 to generate, such as the number of path explored According to, received image of institute etc..
Wherein, storage unit 110 can not only be presented as random access memory (RAM, Random Access Memory), Flash memory, read-only memory (ROM, Read Only Memory), erasable programmable read-only memory (EPROM, Erasable Programmable ROM), electrically erasable formula read-only memory (EEPROM, Electronically Erasable And Programmable ROM), register, hard disk, moveable magnetic disc, RAM card, Universal Subscriber Identity Module (USIM, Universal Subscriber Identity Module) etc. internally-arranged types memory element, it is total to may be embodied in general serial The memory element of the removable form such as linear memory.
The execution of input unit 120 will be converted to specific electric signal from externally input be physically entered of electronic device 100 Function.Wherein, input unit 120 may include all or part of in user of service's input unit 121 and microphone portion 123.
User of service's input unit 121 can receive the input of the users of service such as touch, pushing action.Herein, user of service Input unit 121 can using a variety of buttons form, receive touch input touch sensor, receive close to movement close to biography At least one of sensor embodies.
The sound that microphone portion 123 can receive the sound of user of service and generate from the inside and outside of vehicle.
Output section 130 is the device for exporting the data of electronic device 100.Wherein, output section 130 may include display unit 131 and audio output part 133 in all or part of.
Display unit 131 is the device that electronic device 100 exports the data that can be identified in a manner of sense of vision.Display unit 131 can be presented as the display unit before the shell of electronic device 100.Also, display unit 131 can be with electronic device 100 are formed as one, and export the identification data of sense of vision, can also be separately provided to come with electronic device 100 such as head-up display Export the identification data of sense of vision.
Audio output part 133 is the device that electronic device 100 exports the data that can be identified in a manner of audio.Audio Output section 133 can embody the data that should inform user of service of electronic device 100 by showing the loudspeaker of sound.
Communication unit 180 can be set to communicate electronic device 100 with other equipment.Communication unit 180 may include Position data portion 181, broadcast receiving and transmitting portion 185, mobile division 186, short-range communication portion 187, has wireless interconnected wet end 183 All or part of in line communication unit 189.
Position data portion 181 is to pass through Global Navigation Satellite System (GNSS, Global Navigation Satellite System) device of position data is obtained.Global Navigation Satellite System means available from the received electric wave of moonlet Signal come calculate receive terminal position navigation system.It, can be according to operation as the concrete example of Global Navigation Satellite System Main body is divided into GPS (GPS, Global Positioning System), GALILEO positioning system (Galileo), GLONASS satellite navigation system (GLONASS, Global Orbiting Navigational Satellite System), Beidou satellite navigation system (COMPASS), India area navigation satellite system (IRNSS, Indian Regional Navigational Satellite System), quasi- zenith satellite system (QZSS, Quasi-Zenith Satellite System) etc..The position data portion 181 of the electronic device 100 of one embodiment of the invention can be by receiving to using electronic device 100 area provides the signal of the Global Navigation Satellite System of service to obtain location information.
Wireless interconnected wet end 183 is the device for obtaining data by being connected with wireless Internet or sending information.It can The wireless Internet connected by wireless interconnected wet end 183 can be WLAN (WLAN, Wireless LAN), wireless Broadband (Wibro, Wireless broadband), worldwide interoperability for microwave accesses (Wimax, World interoperability For microwave acess), high-speed slender body theory (HSDPA, High Speed Downlink Packet Acess) Deng.
Broadcast receiving and transmitting portion 185 is the device that broadcast singal is received and dispatched by various broadcast systems.Broadcast receiving and transmitting portion can be passed through The broadcast system of 185 transmitting-receivings can be T-DMB (DMBT, Digital Multimedia Broadcasting Terrestrial), digital multimedia satellite broadcast (DMBS, Digital Multimedia Broadcasting Satellite), high pass propose mobile TV standard (MediaFLO, Media Forward Link Only), hand-held digital video broadcast (DVBH, Digital Video Broadcast Handheld), Japanese Digital audio are wide Broadcast scheme (ISDBT, Integrated Services Digital Broadcast Tereestrial) etc..It is received by broadcast The broadcast singal that hair portion 185 is received and dispatched may include traffic data, life data etc..
Mobile division 186 can be according to 3rd generation mobile communication technology (3G, 3rd Generation), third generation cooperation partner With plan (3GPP, 3rd Generation Partnership Project), long term evolution plan (LTE, Long Term ) etc. Evoloution various kinds of mobile communication specification is connected and is communicated with mobile radio communication.
Short-range communication portion 187 is the device for carrying out short-range communication.As described above, short-range communication portion 187 can Pass through bluetooth (Bluetooth), radio frequency identification (RFID, Radio Frequency Idntification), infrared data tissue It is (IrDA, Infraed Data Association), ultra wide band (UWB, Ultra WidBand), ZigBee protocol (ZigBee), close Field communicates (NFC, Near Field Communication), Wireless Fidelity (Wi-Fi) etc. to be communicated.
Wire communication portion 189 is the interface arrangement that electronic device 100 can be made in a wired fashion to be connected with other equipment. Wire communication portion 189 can be the universal serial bus mould that can be communicated by USB port (USB Port) Block.
This communication unit 180 can be logical using position data portion 181, wireless interconnected wet end 183, broadcast receiving and transmitting portion 185, movement At least one of letter portion 186, short-range communication portion 187, wire communication portion 189 to communicate with other equipment.
As an example, in the case where electronic device 100 does not include camera function, using short-range communication portion 187, have At least one of line communication unit 189 come receive the vehicles camera such as black box shooting image.
As another example, in the case where communicating with multiple equipment, short-range communication portion 187 can also be passed through by an equipment It communicates, another equipment passes through wire communication portion 189 and communicates.
Detecting means 190 are the device of the current state of detectable electronic device 100.Detecting means 190 may include movement sensing All or part of in portion 191, light sensing portion 193.
Movement detecting means 191 can detect the movement on the three-dimensional space of electronic device 100.Acting detecting means 191 may include Three axis geomagnetic sensors and 3-axis acceleration sensor.It can will pass through the exercise data and pass through position for acting that detecting means 191 obtain The position data for setting the acquisition of data portion 191 combines, to calculate the more accurate rail for the vehicle for being attached with electronic device 100 Mark.
Light sensing portion 193 is the device for measuring the periphery illumination (illuminance) of electronic device 100.Using passing through light The illumination data that detecting means 193 obtain, can make the brightness of display unit 195 correspondingly change with periphery brightness.
Power supply unit 195 is the other equipment for supplying the work of electronic device 100 or being connected with electronic device 100 The device of power supply needed for work.Power supply unit 195 can be from external power supplies such as the batteries or vehicle for being built in electronic device 100 Place receives the device of power supply.Also, according to the form for receiving power supply, power supply unit 195 can be presented as wire communication module 119 or body The now device wirelessly to receive power supply.
Test section 140 can be detected using map datum and be advised positioned at front on the basis of the position of running vehicle The information in the guidance place of set a distance range.Specifically, test section 140 can be by the vehicle that will obtain from position data portion 181 Location information be suitable for map datum, on the basis of the position of vehicle, detection be located at front predetermined distance range guidance The information in place.
Wherein, map datum can be obtained from the storage unit 110 in electronic device 100, or can be other than electronic device 100 Other external map data bases (DB, Database) in obtain, or map datum can be obtained from other electronic devices.It is this Map datum is the data for indicating the map of current location and surrounding area, above-mentioned map datum can include: multiple traffic Route, for indicating the road in multiple regions;And each above-mentioned multiple traffic routes attribute information, guide place letter Breath.The attribute information of traffic route may include for indicating whether above-mentioned traffic route is two-way traffic route or one-way traffic road The information of the information of line, the lane line line quantity information of above-mentioned traffic route, road corresponding with above-mentioned traffic route (for example, highway, city expressway, national highway, local road, common road etc.).The information in guidance place may include guidance The location information in place, the boot code (for example, information of speed limit guidance, deceleration strip guidance etc.) for guiding place.
Wherein, guidance place may include hypervelocity check place, deceleration strip place, level crossing place, section test the speed place, Intersection place, branch road place etc..Also, it is presented as in guidance place and starts place and guidance end place including guidance Guidance section in the case where, it may include section test the speed section beginning place and end place, the beginning of children protection area Place and end place, the beginning place of old man protection zone and end place, the beginning place of construction section and end place, The beginning place of Foggy Area and end place, the beginning place of accident-prone road section and end place, falling rock section Start place and end place, the beginning place in zig zag section and end place, the beginning place of easy ways section and end ground Point, the beginning place and end place, the beginning place in limit for height section and end place etc. for paying attention to wild animal section.
On the other hand, the electronic device 100 of one embodiment of the invention may include for providing augmented reality view mode Augmented reality offer portion 160.Wherein, augmented reality can be in the picture that the practical real world watched of user of service is presented Additional information (for example, the place (Point Of Interest:POI) paid close attention to) is provided in a manner of being visually overlapped Graphical element, indicate to the graphical element in path of destination etc.) method.In this regard, will be carried out specifically referring to Fig. 2 It is bright.
Fig. 2 provides the block diagram in portion 160 for the specific augmented reality for indicating one embodiment of the invention.Referring to Fig. 2, enhancing display Offer portion 160 may include calibration portion 161, three-dimensional space generating unit 162, object generating unit 163, the whole in mapping portion 164 or A part.
The executable calibration in calibration portion 161, it is corresponding with camera to be estimated from the filmed image shot by camera Camera parameter.Wherein, camera parameter is to constitute the parameter of camera matrix, and above-mentioned camera matrix is for indicating true Information of the space reflection in the relationship of photo, above-mentioned camera parameter can include: camera external parameter (extrinsic ) and camera inner parameter (intrinsic parameters) parameters.
Three-dimensional space generating unit 162 can generate virtual three-dimensional space based on the filmed image shot by camera.Specifically, Three-dimensional space generating unit 162 can be suitable for two-dimensional filmed image, next life by the camera parameter for being estimated calibration portion 161 At virtual three-dimensional space.
Object generating unit 163 can generate the object for guidance on augmented reality, for example, navigation object, driveway become Object, lane line is more guided to be detached from guidance object etc..In particular, object generating unit 163 is produced for indicating the position with vehicle On the basis of come be located at front predetermined distance range guidance place object.Wherein, object can be presented as three dimensional object, image or Line art etc..
Mapping portion 164 can be mapped in object generating unit by the virtual three-dimensional space generated of three-dimensional space generating unit 162 163 objects generated.Specifically, mapping portion 164 can determine in the object generated of object generating unit 163 in virtual three-dimensional sky Between in position, and in identified position mapping object.
On the other hand, control unit 170 controls the entire work of electronic device 100.Specifically, control unit 170 is controllable deposits Storage portion 110, input unit 120, output section 130, test section 140, augmented reality offer portion 160, communication unit 180, in detecting means 190 All or part of.
In particular, if running vehicle is close to away from guidance place, up to the range within predetermined distance, control unit 170 is controllable Object generating unit 163 processed generates the object for indicating guidance place, also, control unit can control display unit 131 to pass through enhancing Reality shows object generated.
Specifically, control unit 170 is using the location information of vehicle obtained from position data portion 181 and from test section The location information in the 140 guidance places obtained come the alternate position spike information that both calculates, based on calculated alternate position spike information To judge whether running vehicle approaches the range reached within predetermined distance away from guidance place.
If running vehicle is close to away from guidance place, up to the range within predetermined distance, then control unit 170 can utilize institute Calculated alternate position spike information is come by with determining above-mentioned guidance in the virtual three-dimensional space generated of three-dimensional space generating unit 162 The position of point.As an example, with X (dimension), Y (longitude), Z (height) coordinate in three-dimensional space corresponding with real world On the basis of value, the location information for the vehicle that data portion 181 obtains in position is (10,20,30), guides the location information in place to be In the case where (20,30,40), control unit 170 can be calculated as the alternate position spike information (10,10,10) of the difference of location information.And And control unit 170 can be using the calculated alternate position spike information of institute come by the virtual three-dimensional generated of three-dimensional space generating unit 162 The position in above-mentioned guidance place is determined in space.Wherein, the location information (10,20,30) of vehicle and the position letter in guidance place Ceasing (20,30,40) is with X (dimension), Y (longitude), Z (height) coordinate in three-dimensional space corresponding with real world respectively It is calculated on the basis of value, thus, for example 10 be number corresponding with dimension values in the location information (10,20,30) of vehicle Value, 20 be numerical value corresponding with longitude, and 30 be numerical value corresponding with height value.
If also, running vehicle is close to away from guidance place, up to the range within predetermined distance, control unit 170 is controllable Object generating unit 163 processed generates the guidance object for indicating guidance place.Specifically, 170 controllable objects of control unit generate Portion 163 generates the first object for indicating the position in guidance place in augmented reality corresponding with real world.Also, Control unit 170 controllable objects generating unit 163 is by utilizing the boot code obtained in test section 140 to generate for drawing Lead second object in place.As an example, when guidance place is the second object Ke Bao in the case that hypervelocity checks place It includes: the object of text modality, for guiding hypervelocity to check the speed limit in place;The object of camera image form is super for guiding Speed checks the inspection method in place.
On the other hand, control unit 170 can control mapping portion 164 based on guidance identified in virtual three-dimensional space place Position be mapped in the guidance object generated of object generating unit 163.
Moreover, control unit 170 can carry out following control: utilize camera matrix, by according to the mapping in mapping portion 164 come The virtual three-dimensional space of mapping guidance object is transformed to two dimensional image, generates two-dimensional enhancing with this and shows image, and by aobvious Show portion 131 to show augmented reality image generated.
Like this, an embodiment according to the present invention, can by reflection vehicle and guidance the distance between place difference come The display position of object is presented, augmented reality picture neutral body so as to more efficiently transmit vehicle to driver and draw Lead the distance between place difference.
On the other hand, according to vehicle and the mobile change of range difference in place can be guided for corresponding with real world The first object of the position in guidance place is indicated in augmented reality shows position.For example, with the operation of vehicle, if vehicle and The distance in guidance place shortens, then control unit 170 can control mapping portion 164 according to the mobile change of range difference of vehicle and guidance place The more position of the first object is mapped.That is, with the traveling of vehicle, if the distance in vehicle and guidance place shortens, the An object can be apparent in the position for moving closer to vehicle in augmented reality picture.
Also, if vehicle, by guidance place, the object for guiding place for indicating passed through can be in enhancing picture Middle disappearance.That is, with the traveling of vehicle, if vehicle by guidance place, is used to indicate the position in passed through guidance place The first object and for guiding second object in passed through guidance place that can disappear in augmented reality picture.
Like this, an embodiment according to the present invention is being increased by the distance between reflection vehicle and guidance place difference Mobile change object shows position in strong reality picture, draws so as to provide in more intuitive method to driver It leads.
On the other hand, it in the operational process of vehicle, if guidance place enters in preset distance, can activate Show the work of guidance object in above-mentioned augmented reality picture.
Also, above-mentioned guidance place can be presented as hypervelocity check place only need to solely point guide Form, or can also be presented as the form for starting place including guidance and guiding the guidance section of end place.Like this, if with The form in section is guided to embody above-mentioned guidance place, then 170 control object generating unit 163 of control unit starts place using guidance Information and the information of end place is guided to generate for the object that guides of guidance section, and control unit 170 can be into The following control of row: during vehicle is located at guidance section, object generated is exported by augmented reality.For example, Guidance section is tested the speed for section in the case where section, if the vehicle in traveling starts place up to predetermined distance close to testing the speed away from section Within range, then control unit 170 exported by augmented reality for indicate section test the speed start place position first Object, if vehicle in traveling tests the speed end place up to the range within predetermined distance close to away from section, control unit 170 can be into The following control of row: exported by augmented reality for indicate section test the speed end place position the first object, and During vehicle is located at guidance section, the second object for guiding to guidance section is exported by augmented reality, If the vehicle in traveling tests the speed end place by section, above-mentioned first object, second can not be exported by augmented reality Object.
Fig. 3 is the figure of the network of the system for illustrating to be connected with the electronic device of one embodiment of the invention.Referring to figure 3, the electronic device 100 of one embodiment of the invention can be presented as navigator, black box, smart phone or the enhancing of other vehicles Reality interface provides the various devices that device etc. is set to vehicle, and can with a variety of communication networks and other electronic equipments 61,62, 63,64 are connected.
Also, electronic device 100 can be connected according to from the received electric wave signal of moonlet 20 with global positioning system It is dynamic, to calculate current position and current time.
The different L-band frequency of frequency band can be transmitted in each moonlet 20.Electronic device 100 can be based on from each artificial Time needed for the L-band frequency that satellite 20 is sent reaches electronic device 100 calculates current position.
On the other hand, electronic device 100 can be by communication unit 180, and by control station (ACR) 40, base station (RAS) 50 etc. To be wirelessly connected with network 30.If electronic device 100 is connected with network 30, can also in an indirect way with Other electronic equipments 61,62 that network 30 is connected are connected, and exchange data.
On the other hand, electronic device 100 can also be by the other equipment 63 with communication function come in an indirect way It is connected with network 30.For example, in the case where electronic device does not have the module that can be connected with network 30, it can be by close Distance communication etc. is communicated with the other equipment 63 with communication function.
Fig. 4 is the flow chart for briefly expressing the control method of electronic device of one embodiment of the invention.Referring to Fig. 4, electronics Device 100 can determine the position (step S101) of running vehicle.Specifically, the position data portion 181 of electronic device 100 can By GPS (GPS, Global Positioning System)/Global Navigation Satellite System (GMSS, Global Navigation Satellite System) obtain position data.
Moreover, electronic device 100 can be located on the basis of the position of identified vehicle using map datum to detect The information (step S102) in the guidance place of front predetermined distance range.Specifically, the test section 140 of electronic device 100 can incite somebody to action The location information of the vehicle obtained from position data portion 181 is suitable for map datum, to be examined on the basis of the position of vehicle Location is in the information in the guidance place of front predetermined distance range.Wherein, the information for guiding place may include guiding the position in place Confidence breath, the boot code (for example, information for being guided to speed limit guidance, deceleration strip guidance etc.) for guiding place Deng.
Moreover, electronic device 100 can utilize the information in guidance place to generate the object (step for indicating guidance place S103).Specifically, the object generating unit 163 of electronic device 100 is produced in augmented reality corresponding with real world Middle expression guides the first object of the position in place and at least one of the second object for guiding to guidance place. Wherein, object can be presented as three dimensional object, image or line art.
Moreover, electronic device 100 can show object (step S104) generated by augmented reality.In this situation Under, the control unit 170 of electronic device 100 calculates vehicle and guides the alternate position spike information in place, and utilizes the calculated position of institute It sets poor information and to determine above-mentioned object generated position to be mapped in virtual three-dimensional space, so as to pass through enhancing Reality exports object generated.The output of this augmented reality picture is illustrated referring to Fig. 5 to Fig. 6.
Fig. 5 is the specific mapping in augmented reality for indicating one embodiment of the invention for indicating the object in guidance place The flow chart of method.Fig. 6 is to indicate that the transformation between the two dimension shooting image of one embodiment of the invention and virtual three-dimensional space is closed The figure of system.
Referring to Fig. 5 to Fig. 6, electronic device 100 can be by executing calibration to camera, to calculate camera parameter (step Rapid S201).Specifically, the executable calibration in the calibration portion 161 of electronic device 100, to be pushed away from the filmed image shot by camera Fixed camera parameter corresponding with camera.Wherein, camera parameter can be the parameter of composition camera matrix, above-mentioned to take the photograph As head matrix is for indicating that real space is mapped in the information of the relationship of photo.As shown in part (a) of Fig. 6, above-mentioned camera shooting Head parameter may include camera external parameter 601, camera inner parameter 602.Wherein, fx, fy of camera inner parameter 602 It can be focal length (focal length) that cx, cy can for principal point (principal point), skew_c=tan α Think coefficient skewness (skew coefficient).Also, camera external parameter 601 can be for for by world coordinate system The coordinate (X, Y, Z) of three-dimensional point on 605 (world coordinate system) is transformed to camera coordinate system 604 Rotation/running transform matrix of the coordinate (Xc, Yc, Zc) of three-dimensional point on (Camera Coordinate System).As this Sample, not being due to camera external parameter is the intrinsic parameter of camera, above-mentioned camera external parameter can be according to camera shooting The setting position of head and setting direction and difference, also, can also be according to how defining world coordinate system and different.
Moreover, electronic device 100 can generate the virtual three-dimensional space of the filmed image of camera based on camera parameter (step S202).Specifically, the three-dimensional space generating unit 162 of electronic device 100 can be by the camera that estimates calibration portion 161 Parameter is suitable for two-dimensional filmed image to generate virtual three-dimensional space.That is, referring to part (b) of Fig. 6, camera filmed image Can by by the point perspective projection (perspective projection) on the three-dimensional space of world coordinate system 605 in X-Y scheme It is obtained as plane.Therefore, the three-dimensional space generating unit 162 of electronic device 100 can be by being executed based on camera parameter The inverse process of work is stated, to generate the virtual three-dimensional space of the world coordinate system 605 of the filmed image of camera.
Moreover, electronic device 100 can calculate the position of vehicle and the alternate position spike information (step S203) in guidance place.Tool Body, the control unit 170 of electronic device 100 using the vehicle obtained in position data portion 181 location information and detecting Portion 140 obtain guidance place location information come calculate the two alternate position spike information.As an example, in position data portion The location information of 181 vehicles obtained is (10,20,30), in the case where guiding the location information in place to be (20,30,40), control Portion 170 processed can calculate alternate position spike information (10,10,10).
Moreover, electronic device 100 can determine the position in guidance place using alternate position spike information in virtual three-dimensional space (step S204).It specifically, can be if being calculated as the alternate position spike information of the position in guidance place and the alternate position spike of vehicle The coordinate of alternate position spike information is calculated in the virtual three-dimensional space of world coordinate system 605, to determine in virtual three-dimensional space Guide the position in place.
Moreover, electronic device 100 can be based on the position in the guidance place in virtual three-dimensional space come in virtual three-dimensional space Map object (step S205) generated.
Moreover, electronic device 100 can generate increasing by the way that the virtual three-dimensional space of mapping object is transformed to two dimensional image Strong reality imagery (step S206).Specifically, the control unit 170 of electronic device 100 can be reflected basis using camera matrix It penetrates the mapping in portion 164 and is transformed to two dimensional image to map the virtual three-dimensional space of guidance object, so that it is existing to generate two-dimensional enhancing Real image.
Moreover, electronic device 100 can show augmented reality image (step S207) generated.
Fig. 7 is the flow chart of the augmented reality picture display process of the specific electronic device for indicating one embodiment of the invention. Referring to Fig. 7, electronic device 100 can determine the position (step S301) of running vehicle.
Moreover, electronic device 100 can be located on the basis of the position of identified vehicle using map datum to detect The information (step S302) in the guidance place of front predetermined distance range.
Also, electronic device 100 can utilize the location information in guidance place to generate for corresponding with real world Augmented reality in indicate guidance place position the first object (step S303).
Moreover, electronic device 100 can utilize the boot code in guidance place to generate for carrying out to guidance place Second object (step S304) of guidance.
Also, electronic device 100 can show object (step S305) generated by augmented reality.
Moreover, electronic device 100 can remove in enhancing display picture for indicating if vehicle is by guidance place The object (step S306) in the guidance place of process.
Hereinafter, illustrating the augmented reality picture of various embodiments of the present invention referring to Fig. 8 to Figure 15.
Fig. 8 is to indicate that the display hypervelocity of one embodiment of the invention checks the figure of the augmented reality picture in place.Reference Fig. 8, Electronic device 100 can be shown by augmented reality for indicating that hypervelocity checks in augmented reality corresponding with real world First object 820 of the position in place includes for the second object to the text for checking that the speed limit in place guides that exceeds the speed limit 810。
In particular, can change the first object 820 according to the range difference movement in vehicle and guidance place shows position referring to Fig. 8 It sets.That is, if the distance in vehicle and guidance place shortens, the first object 820 can be in augmented reality picture with the traveling of vehicle In be apparent in the position for moving closer to vehicle.
It,, can if vehicle and guidance place are very close with the traveling of vehicle also, as shown in the part (c) of Fig. 8 It is pellucidly apparent in augmented reality picture by adjusting the transparency of the first object, the second object.
On the other hand, although not shown in Fig. 8, if vehicle by guidance place, is used to indicate that is passed through draws Lead first object in place, the second object can disappear from augmented reality picture.
Fig. 9 is the figure in the display branch road place for indicating one embodiment of the invention, the augmented reality picture of intermediate location.Reference Part (a) of Fig. 9, electronic device 100 can be shown by augmented reality in augmented reality corresponding with real world It indicates the first object 920 of the position in the branch road place of the driving path positioned at vehicle, include for the direction to branch road place Second object 910 of the text guided.Also, referring to the part (b) of Fig. 9, electronic device 100 can be aobvious by augmented reality Show the position for indicating to be located at the intermediate location of the driving path of vehicle in augmented reality corresponding with real world First object 940, include the text that intermediate location is guided the second object 930.
Figure 10 is to indicate that the display hypervelocity of one embodiment of the invention checks the figure of the augmented reality picture in place.Referring to figure 10, electronic device 100 can be shown by augmented reality for indicating hypervelocity in augmented reality corresponding with real world It checks the first object 1020 of the position in place, include the second object to the text for checking that the speed limit in place guides that exceeds the speed limit 1010 and include checking hypervelocity the third object 1031,1032,1033 of image that the inspection method in place guides.
More specifically, in the case where hypervelocity checks that the inspection method in place is fixed camera, it can be existing by enhancing The object of appended drawing reference 1031 in real display such as part (a) of Figure 10 checks that the inspection method in place is box takes the photograph in hypervelocity In the case where as head, the object of the appended drawing reference 1032 of part (b) such as Figure 10 can be shown by augmented reality, checked in hypervelocity In the case that the inspection method in place is mobile camera, the attached drawing of part (c) such as Figure 10 can be shown by augmented reality The object of label 1033.
Figure 11 is the figure for indicating the augmented reality picture of display road traffic direction board of one embodiment of the invention.Referring to figure 11, electronic device 100 can be shown by augmented reality for requiring to drive in augmented reality corresponding with real world Road traffic direction board object 1101 that personnel pay attention to (for example, shown in part (b) of Figure 11, for indicating accident-prone road section Direction board, the direction board for indicating easy slideway road, the direction board for indicating level crossing, for indicating river bank road Direction board etc.).
In the case, the control unit 170 of electronic device 100 can carry out being apparent in road traffic direction board object 1101 The control of the road area of the non-travel of vehicle.
Figure 12 is the figure of the display construction section for indicating one embodiment of the invention, the augmented reality picture of Foggy Area.Ginseng According to part (a) of Figure 12, electronic device 100 can be shown by augmented reality including the image that guides to construction section Object 1201.Alternatively, 2 part (b) referring to Fig.1, electronic device 100 can be indicated by augmented reality include to Foggy Area into The object 1202 of the image of row guidance.
Like this, can only be shown during vehicle is located at guidance section by augmented reality for guidance section into The object 1201,1202 of row guidance.
Although also, not being shown in FIG. 12, an embodiment according to the present invention, in drawing for vehicle close control section It leads in the case where starting place and guidance end place, can be shown by augmented reality for indicating that guidance starts the position in place Object and for indicate guidance end place position object.
Figure 13 is the display accident-prone road section for indicating one embodiment of the invention, pays attention to fall section, falling rock section Augmented reality picture figure.3 part (a), electronic device 100 can be shown by augmented reality including to accident referring to Fig.1 The object 1301 for the image that multi-happening section guides.Alternatively, 3 part (b), electronic device 100 can pass through enhancing referring to Fig.1 Reality display includes the object 1302 of image that section guides of falling to attention.Alternatively, 3 part (c) referring to Fig.1, electricity Sub-device 100 can be shown by augmented reality including the object 1303 to falling rock image that section guides.
Figure 14 is the display zig zag section for indicating one embodiment of the invention, easy ways section, pays attention to wild animal section The figure of enhancing display picture.4 part (a), electronic device 100 can be shown by augmented reality including to zig zag referring to Fig.1 The object 1401 for the image that section guides.Or 4 part (b), electronic device 100 can pass through augmented reality referring to Fig.1 Display includes the object 1402 of the image guided to easy ways section.Alternatively, 4 part (c) referring to Fig.1, electronic device can The object 1403 of the image including guiding to attention wild animal section is shown by augmented reality.
Figure 15 is the figure for indicating the augmented reality picture of display level crossing of one embodiment of the invention.Referring to Fig.1 5, electricity Sub-device 100 can show the object 1501 of the image including guiding to level crossing place by augmented reality.
Like this, various embodiments according to the present invention, by reflection vehicle and guidance the distance between place difference come Object is presented to augmented reality picture neutral body shows position, so as to more efficiently transmit vehicle to driver and draw Lead the distance between place difference.
Also, by the distance between reflection vehicle and guidance place difference come the movably change pair in augmented reality picture Elephant shows position, so as to provide guidance to driver in more intuitive method.
Also, check that place, section are tested the speed section, easy ways section etc., are dynamically shown by augmented reality method in hypervelocity The position in existing place and guidance information, so as to effectively provide guidance to driver, and can cause the interest of driver, But also safe driving and convenience of the driver to vehicle can be sought.
Figure 16 is the embodiment shape in the case where camera and electronic device are divergence type for indicating one embodiment of the invention The figure of state.Referring to Fig.1 6, respectively arranged vehicle navigator device 100 and vehicle black box 200 can utilize wire/wireless Communication mode is come the system that constitutes one embodiment of the invention.
Vehicle navigator 100 can include: display unit 131, set on the forward face of the shell 191 of navigator;Navigator behaviour Make key 121;And navigator microphone 123.
Vehicle black box 200 may include black box camera 222, black box microphone 224 and facies posterior hepatis 281.
Figure 17 is the embodiment shape in the case where camera and electronic device are integrated type for indicating one embodiment of the invention The figure of state.Referring to Fig.1 7, in the case where navigator device 100 includes shoot part 150, navigator can be arranged in user of service as follows Device 100, that is, make the shoot part 150 of navigator device 100 shoot the front of vehicle, and make the display unit of navigator device 100 Divide and can recognize user of service.With this, the system of one embodiment of the invention can be embodied.
Figure 18 is the figure indicated using the head-up display of one embodiment of the invention and the embodiments of electronic device.Reference Figure 18, head-up display can show that enhancing is existing by the wire/wireless communication between other equipment on head-up display Real guide picture.
As an example, augmented reality can be by utilizing the head-up display of front windshield of vehicle or utilizing other images defeated The image superposition etc. of device provides out, and like this, augmented reality offer portion 160 produces reality imagery or is superimposed on glass Interface image etc..With this, augmented reality navigator or vehicle infotainment system etc. can be embodied.
On the other hand, the control method of the electronic device of aforementioned present invention various embodiments can be embodied with program, thus It is provided to server or equipment.With this, each device can be connected to download above-mentioned journey with the server or equipment for being stored with program Sequence.
And it is possible to the control method of the electronic device of the various embodiments of aforementioned present invention be embodied with program, to deposit The readable medium (non-transitory computer readable medium) of a variety of non-transitories is stored in provide.It is non- Provisional readable medium is not meant to the medium of the short time storing data such as register, cache memory, memory, But mean semipermanent storing data, and the medium of (reding) can be read by equipment.Specifically, above-mentioned a variety of Using or program can be stored in CD (CD), digital versatile disc (DVD), hard disk, Blu-ray Disc, universal serial bus, note The readable medium of the non-transitories such as card, read-only memory is recalled to provide.
Also, the preferred embodiment of the present invention is had been shown and described above, but the invention is not limited to above-mentioned Specific embodiment can be by the present invention in the case where not departing from the purport of the invention invented and applied in claimed range Person of an ordinary skill in the technical field implements various deformation to the present invention, also, these variant embodiments should not be detached from Technical idea of the invention or prospect of the invention individually understand.

Claims (15)

1. a kind of related guidance providing method of driving, comprising:
The step of determining the position of vehicle;
On the basis of the position of above-mentioned determination, detected using map datum positioned at the guidance place of front predetermined distance range The step of information;
The step of object for indicating above-mentioned guidance place is generated using the information in the guidance place of above-mentioned detection;And
In the step for showing position and showing the object of above-mentioned generation corresponding with the position in above-mentioned guidance place in the real world Suddenly.
2. the related guidance providing method of driving according to claim 1, which is characterized in that
Above-mentioned guidance place is that guidance starts and guidance terminates identical single place.
3. the related guidance providing method of driving according to claim 2, which is characterized in that
Above-mentioned guidance place includes that hypervelocity checks that test the speed place, road of place, deceleration strip place, level crossing place, section is handed over At least one of prong place and branch road place.
4. the related guidance providing method of driving according to claim 1, which is characterized in that
Above-mentioned guidance place is the guidance section for including guidance beginning place and guidance end place.
5. the related guidance providing method of driving according to claim 4, which is characterized in that
Above-mentioned guidance place be guidance section in the case where, including section test the speed section beginning place and end place, youngster The beginning place of virgin protection zone and end place, the beginning place of old man protection zone and end place, construction section are opened Beginning place and end place, Foggy Area start place and end place, accident-prone road section beginning place and terminate ground Point, falling rock section start place and end place, zig zag section starts place and end place, easy ways section Start place and end place, pay attention to wild animal section start place and end place, limit for height section beginning place and At least one of end place.
6. the related guidance providing method of driving according to claim 3, which is characterized in that
In the above-mentioned generation the step of, the image pair for changing in the lane of the above-mentioned above-mentioned vehicle of branch road venue guiding is generated As.
7. the related guidance providing method of driving according to claim 3, which is characterized in that
In the above-mentioned generation the step of, marking plate image object corresponding with above-mentioned guidance place is generated.
8. a kind of related guidance of driving provides device comprising:
Display unit shows the data that can be identified in a manner of sense of vision;
Position determining portions determines the position of vehicle;
Test section detects drawing positioned at front predetermined distance range using map datum on the basis of the position of above-mentioned determination Lead the information in place;
Object generating unit generates the object for indicating above-mentioned guidance place using the information in the guidance place of above-mentioned detection; And
Control unit controls above-mentioned display unit, so that showing corresponding with the position in above-mentioned guidance place in the real world Position shows the object of above-mentioned generation.
9. the related guidance of driving according to claim 8 provides device, which is characterized in that
Above-mentioned guidance place is that guidance starts and guidance terminates identical single place.
10. the related guidance of driving according to claim 9 provides device, which is characterized in that above-mentioned guidance place includes super Speed checks that place, deceleration strip place, level crossing place, section are tested the speed in place, intersection place and branch road place At least one.
11. the related guidance of driving according to claim 8 provides device, which is characterized in that
Above-mentioned guidance place is the guidance section for including guidance beginning place and guidance end place.
12. the related guidance of driving according to claim 11 provides device, which is characterized in that
Above-mentioned guidance place be guidance section in the case where, including section test the speed section beginning place and end place, youngster The beginning place of virgin protection zone and end place, the beginning place of old man protection zone and end place, construction section are opened Beginning place and end place, Foggy Area start place and end place, accident-prone road section beginning place and terminate ground Point, falling rock section start place and end place, zig zag section starts place and end place, easy ways section Start place and end place, pay attention to wild animal section start place and end place, limit for height section beginning place and At least one of end place.
13. the related guidance of driving according to claim 10 provides device, which is characterized in that
Above-mentioned object generating unit generates the image object for changing in the lane of the above-mentioned above-mentioned vehicle of branch road venue guiding.
14. the related guidance of driving according to claim 10 provides device, which is characterized in that
Above-mentioned object generating unit generates marking plate image object corresponding with above-mentioned guidance place.
15. a kind of computer readable recording medium, record has for executing the program code for driving related guidance providing method, Above-mentioned driving correlation guidance providing method includes:
The step of determining the position of vehicle;
On the basis of the position of above-mentioned determination, detected using map datum positioned at the guidance place of front predetermined distance range The step of information;
The step of object for indicating above-mentioned guidance place is generated using the information in the guidance place of above-mentioned detection;And
In the step for showing position and showing the object of above-mentioned generation corresponding with the position in above-mentioned guidance place in the real world Suddenly.
CN201910496805.2A 2014-12-01 2015-12-01 Driving related guidance providing method and apparatus, and computer readable recording medium Active CN110260877B (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
KR10-2014-0170050 2014-12-01
KR20140170050 2014-12-01
KR1020150036151A KR102406491B1 (en) 2014-12-01 2015-03-16 Electronic apparatus, control method of electronic apparatus, computer program and computer readable recording medium
KR10-2015-0036151 2015-03-16
CN201510868227.2A CN105654030B (en) 2014-12-01 2015-12-01 Electronic device, the control method of electronic device, computer program and computer readable recording medium

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201510868227.2A Division CN105654030B (en) 2014-12-01 2015-12-01 Electronic device, the control method of electronic device, computer program and computer readable recording medium

Publications (2)

Publication Number Publication Date
CN110260877A true CN110260877A (en) 2019-09-20
CN110260877B CN110260877B (en) 2023-07-21

Family

ID=56138967

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201510868227.2A Active CN105654030B (en) 2014-12-01 2015-12-01 Electronic device, the control method of electronic device, computer program and computer readable recording medium
CN201910496805.2A Active CN110260877B (en) 2014-12-01 2015-12-01 Driving related guidance providing method and apparatus, and computer readable recording medium
CN201910496468.7A Active CN110263688B (en) 2014-12-01 2015-12-01 Driving related guidance providing method and apparatus, and computer readable recording medium

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201510868227.2A Active CN105654030B (en) 2014-12-01 2015-12-01 Electronic device, the control method of electronic device, computer program and computer readable recording medium

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201910496468.7A Active CN110263688B (en) 2014-12-01 2015-12-01 Driving related guidance providing method and apparatus, and computer readable recording medium

Country Status (2)

Country Link
KR (1) KR102406491B1 (en)
CN (3) CN105654030B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112163466A (en) * 2020-09-11 2021-01-01 杭州鸿泉物联网技术股份有限公司 Height limiting height determining method, device and system based on UWB
CN112325893A (en) * 2020-10-27 2021-02-05 李亚军 Electronic map system, electronic map generation method, navigation method and navigation equipment

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017216775A1 (en) * 2017-09-21 2019-03-21 Volkswagen Aktiengesellschaft A method, apparatus and computer readable storage medium having instructions for controlling a display of an augmented reality head-up display device for a motor vehicle
CN109029488A (en) * 2018-06-29 2018-12-18 百度在线网络技术(北京)有限公司 Navigating electronic map generating method, equipment and storage medium
CN110473415A (en) * 2019-08-26 2019-11-19 安徽因特维可信息科技股份有限公司 Signal lamp early warning system based on V2I
CN110672112B (en) * 2019-09-29 2021-11-12 阿波罗智联(北京)科技有限公司 Guide wire switching method, device, apparatus, and medium
KR20210087271A (en) * 2020-01-02 2021-07-12 삼성전자주식회사 Apparatus and method for displaying navigation information of three dimention augmented reality
KR102481075B1 (en) * 2020-10-08 2022-12-26 네이버랩스 주식회사 Method and system for controlling head up display

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110052042A1 (en) * 2009-08-26 2011-03-03 Ben Tzvi Jacob Projecting location based elements over a heads up display
CN103105171A (en) * 2011-11-15 2013-05-15 现代自动车株式会社 Navigation system and displaying method thereof
KR101271235B1 (en) * 2011-12-12 2013-06-10 자동차부품연구원 Apparatus and method for providing driving imformation
WO2013145072A1 (en) * 2012-03-26 2013-10-03 三菱電機株式会社 Camera calibration method, camera calibration program and camera calibration device
US20140285523A1 (en) * 2011-10-11 2014-09-25 Daimler Ag Method for Integrating Virtual Object into Vehicle Displays

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3496418B2 (en) * 1996-12-24 2004-02-09 住友電気工業株式会社 Three-dimensional CG map display device and in-vehicle navigation device
JP2007094045A (en) * 2005-09-29 2007-04-12 Matsushita Electric Ind Co Ltd Navigation apparatus, navigation method and vehicle
CN101033978B (en) * 2007-01-30 2010-10-13 珠海市智汽电子科技有限公司 Assistant navigation of intelligent vehicle and automatically concurrently assisted driving system
JP4480755B2 (en) * 2007-12-04 2010-06-16 カルソニックカンセイ株式会社 Head-up display device for vehicle
JP5376223B2 (en) * 2009-05-18 2013-12-25 アイシン精機株式会社 Driving assistance device
KR20130027367A (en) * 2011-09-07 2013-03-15 동국대학교 산학협력단 A navigation apparatus and method for displaying course thereof
JP5906988B2 (en) 2012-07-31 2016-04-20 アイシン・エィ・ダブリュ株式会社 Road shape guidance system, method and program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110052042A1 (en) * 2009-08-26 2011-03-03 Ben Tzvi Jacob Projecting location based elements over a heads up display
US20140285523A1 (en) * 2011-10-11 2014-09-25 Daimler Ag Method for Integrating Virtual Object into Vehicle Displays
CN103105171A (en) * 2011-11-15 2013-05-15 现代自动车株式会社 Navigation system and displaying method thereof
KR101271235B1 (en) * 2011-12-12 2013-06-10 자동차부품연구원 Apparatus and method for providing driving imformation
WO2013145072A1 (en) * 2012-03-26 2013-10-03 三菱電機株式会社 Camera calibration method, camera calibration program and camera calibration device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112163466A (en) * 2020-09-11 2021-01-01 杭州鸿泉物联网技术股份有限公司 Height limiting height determining method, device and system based on UWB
CN112163466B (en) * 2020-09-11 2024-03-15 杭州鸿泉物联网技术股份有限公司 Height limiting determining method, device and system based on UWB
CN112325893A (en) * 2020-10-27 2021-02-05 李亚军 Electronic map system, electronic map generation method, navigation method and navigation equipment

Also Published As

Publication number Publication date
CN110260877B (en) 2023-07-21
KR20160065724A (en) 2016-06-09
KR102406491B1 (en) 2022-06-10
CN105654030A (en) 2016-06-08
CN105654030B (en) 2019-07-05
CN110263688A (en) 2019-09-20
CN110263688B (en) 2024-05-31

Similar Documents

Publication Publication Date Title
CN105654030B (en) Electronic device, the control method of electronic device, computer program and computer readable recording medium
CN105185134B (en) Electronic device, the control method of electronic device and computer readable recording medium storing program for performing
CN105300401B (en) Electronic device and its control method
US10145703B2 (en) Electronic apparatus, control method thereof, computer program, and computer-readable recording medium
CN106993181B (en) More VR/AR equipment collaboration systems and Synergistic method
CN110091798A (en) Electronic device, the control method of electronic device and computer readable storage medium
CN105185137B (en) Electronic device, the control method of electronic device and computer readable recording medium storing program for performing
CN109895850A (en) Bend guidance method, bend guiding device, bend guiding electronic device and computer readable recording medium
CN105651299B (en) The control method of electronic device, electronic device
CN109785654A (en) Vehicle guidance based on locational space model
CN108335507A (en) Utilize the driving guiding providing method and device of the filmed image of camera
CN105651298B (en) The control method of electronic device, electronic device
US20210173095A1 (en) Method and apparatus for determining location by correcting global navigation satellite system based location and electronic device thereof
KR102276082B1 (en) Navigation device, black-box and control method thereof
CN114755670A (en) System and method for assisting a driver and a passenger in positioning each other
KR102299501B1 (en) Electronic apparatus, control method of electronic apparatus and computer readable recording medium
CN113945220A (en) Navigation method and device
JP2023058334A (en) Pedestrian device, mobile device, positioning system, and positioning method
CN117809463A (en) Vehicle positioning method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210823

Address after: Seoul, South Kerean

Applicant after: Hyundai Motor Co.,Ltd.

Applicant after: Kia Co.,Ltd.

Address before: Gyeonggi Do, South Korea

Applicant before: THINKWARE SYSTEMS Corp.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant