KR20150124527A - Electronic apparatus, control method of electronic apparatus and computer readable recording medium - Google Patents

Abstract

Disclosed is a control method of an electronic device. The present control method comprises the following steps: determining a vanishing point of an image photographed by a camera during driving of a vehicle; determining a reference position which is an optimized position of the determined vanishing point; and guiding a holding position of the camera by using the determined vanishing position and the reference position.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an electronic apparatus, a control method of the electronic apparatus, and a computer readable recording medium.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic apparatus, a method of controlling an electronic apparatus, and a computer readable recording medium, and more particularly, to an electronic apparatus, a method of controlling an electronic apparatus and a computer- .

Various kinds of electronic devices and technologies have been developed and spread by the development of electronic technologies. In particular, recently, a technique of providing geographical information in the form of Augmented Reality (AR) in which additional information such as computer graphics (CG) and characters are displayed on a photographed image photographed in real time has been introduced There is a bar.

According to this augmented reality technique, additional information (for example, a graphical element indicating a point of interest (POI), a graphical element indicating a path to a destination, etc.) is displayed on a screen containing a real world that the user actually sees, It is possible to provide the geographical information in a more intuitive manner to the user.

In addition to the augmented reality technology, various technologies such as lane departure guidance, forward vehicle collision guidance, traffic light change guidance, and forward vehicle collision prevention guidance are introduced to assist the driver in safe driving.

However, in order to provide the various techniques described above, the image captured by the camera mounted on the vehicle must be suitable for providing the various technologies described above.

Therefore, there is a need for a method for mounting a camera for photographing an image at an optimum position.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned needs, and it is an object of the present invention to provide an electronic apparatus, a control method of the electronic apparatus, and a computer readable recording medium which provide a mounting method by which a user can easily mount an in- .

According to another aspect of the present invention, there is provided a method of controlling an electronic device, the method including determining a vanishing point of an image captured by a camera during driving of a vehicle, Determining a reference position, and guiding the mount position of the camera using the determined position of the vanishing point and the reference position.

The reference position may be a position of a vanishing point capable of providing an optimal driving-related guidance using an image photographed by the camera during driving of the vehicle.

The driving-related guidance may include at least one of an augmented reality route guidance, a lane departure guidance, a forward vehicle departure guidance, a traffic light change guidance, and a front vehicle collision prevention guide, Can be located within a distance.

Further, the method may further include receiving a user input requesting a placement position guidance of the camera, and the guiding step may be performed when the speed of the vehicle is equal to or less than a predetermined speed.

The guiding step may include calculating a positional difference between the determined position of the vanishing point and the reference position, and moving the position of the determined vanishing point relative to the existing mounting position of the camera to the reference position Calculating a distance and a direction using the calculated positional difference, and displaying the calculated distance and direction as a voice or a guide object indicating a calculated distance and direction on the screen.

And updating the distance and direction by reflecting the result of the camera movement of the user when the user moves the camera on the basis of the guidance and providing the updated distance and direction by voice or by using the updated And displaying a guide object representing a distance and a direction on a screen.

The guiding step may include calculating a positional difference between the determined position of the vanishing point and the reference position, capturing an image photographed in real time at the existing mount position of the camera, Determining a predetermined region in a screen for displaying a capturing image, displaying the real-time captured image on the screen, and superimposing the capturing image on the determined region.

Calculating a distance and a direction to be moved based on the existing mount position of the camera so as to position the determined vanishing point position to the reference position, and displaying a guide object indicating the calculated distance and direction on the screen The method comprising the steps of:

The method may further include the steps of: matching the real-time image with the capturing image; updating the distance and direction by reflecting the matching result; and displaying a fog object indicating the updated distance and direction on the screen .

According to another aspect of the present invention, there is provided an electronic device for determining a vanishing point of an image photographed by a camera during operation of a vehicle, A storage unit for storing the position of the determined vanishing point and the reference position, and a controller for guiding the mounting position of the camera using the determined position and reference position of the vanishing point.

The reference position may be a position of a vanishing point capable of providing an optimal driving-related guide by using the image photographed by the camera while the vehicle is in operation.

Further, the driving-related guidance may include at least one of an augmented reality route guidance, a lane departure guidance, a forward vehicle departure guidance, a traffic light change guidance, and a front vehicle collision prevention guide, Can be located within a distance.

The control unit may further include an input unit for receiving a user input requesting the placement position guidance of the camera, and the control unit may control the guidance to be performed when the speed of the vehicle is equal to or less than a predetermined speed.

In addition, it is also possible to provide an audio output unit for outputting audio, a display unit for displaying a screen, and a control unit for calculating a positional difference between the determined position of the vanishing point and the reference position and for determining the position of the determined vanishing point at the reference position Further comprising a calculating unit that calculates a distance and a direction that should be moved based on the stationary position using the calculated position difference, and the control unit controls the audio output unit to provide the calculated distance and direction by voice or The display unit may be controlled to display the guide object indicating the calculated distance and direction on the screen.

If the user moves the camera on the basis of the guidance, the calculating unit updates the distance and the direction reflecting the result of the camera movement of the user, and the control unit sets the updated distance and direction as voice Or to control the display unit to display a guide object indicating the updated distance and direction on the screen.

And a calculating unit for calculating a positional difference between the determined position of the vanishing point and the reference position and determining a predetermined area in the screen for displaying the captured image using the positional difference, Wherein the capturing image is an image captured in an image photographed in real time at an existing mount position of the camera, the control unit displays the real-time photographed image on the screen, superimposes the capturing image on the determined area, It is possible to control the display unit to display it.

The calculating unit may calculate a distance and a direction that should be moved based on the existing mount position of the camera in order to position the determined vanishing point position to the reference position, The display unit can be controlled to display the guide object on the screen.

The image processing apparatus may further include an image matching unit for matching the real-time image and the capturing image, and the calculating unit updates the distance and the direction by reflecting the matching result, The control unit may control the display unit to display a fog object indicating the direction on the screen.

According to another aspect of the present invention, there is provided a computer-readable recording medium having recorded thereon a program code for performing an electronic device control method according to an embodiment of the present invention, Determining a vanishing point of the photographed image, determining a reference position that is an optimal position of the determined vanishing point, and guiding a mounting position of the camera using the determined position and reference position of the vanishing point .

According to various embodiments of the present invention described above, it is possible for a user to mount the vehicle camera so that it can be easily mounted at an optimum position.

Accordingly, the electronic device can use the photographed image of the camera placed at the optimum position to perform a lane departure guidance function, a forward vehicle departure guidance function, a traffic light change guidance function, a forward vehicle collision avoidance guidance function, Thereby accurately providing a function for assisting safe operation of the vehicle.

1 is a block diagram illustrating an electronic device according to an embodiment of the present invention.
2 is a block diagram specifically illustrating an electronic device according to an embodiment of the present invention.
3 is a diagram illustrating a method for determining a vanishing point according to an embodiment of the present invention.
4 is a view showing positions and reference positions of a vanishing point according to an embodiment of the present invention.
5 is a diagram illustrating a position difference calculation method according to an embodiment of the present invention.
6 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention.
7 is a flowchart showing a specific control method of an electronic device according to an embodiment of the present invention.
8 is a view showing a UI (User Interface) screen showing a guidance method according to an embodiment of the present invention.
9 is a flowchart specifically illustrating a control method of an electronic device according to an embodiment of the present invention.
10 is a view showing a UI (User Interface) screen showing a guidance method according to an embodiment of the present invention.
11 is a flowchart specifically illustrating a control method of an electronic device according to an embodiment of the present invention.
12 is a view showing an embodiment in which a camera and an electronic device are separated from each other according to an embodiment of the present invention.
13 is a view illustrating an embodiment in which a camera and an electronic device according to an embodiment of the present invention are integrated.
FIG. 14 is a diagram illustrating an embodiment using an HUD (Head-Up Display) and an electronic device according to an embodiment of the present invention.

The following merely illustrates the principles of the invention. Thus, those skilled in the art will be able to devise various apparatuses which, although not explicitly described or shown herein, embody the principles of the invention and are included in the concept and scope of the invention. Furthermore, all of the conditional terms and embodiments listed herein are, in principle, only intended for the purpose of enabling understanding of the concepts of the present invention, and are not to be construed as being limited to such specifically recited embodiments and conditions do.

It is also to be understood that the detailed description, as well as the principles, aspects and embodiments of the invention, as well as specific embodiments thereof, are intended to cover structural and functional equivalents thereof. It is also to be understood that such equivalents include all elements contemplated to perform the same function irrespective of the currently known equivalents as well as the equivalents to be developed in the future, i.e., the structure.

Thus, for example, it should be understood that the block diagrams herein represent conceptual views of exemplary circuits embodying the principles of the invention. Similarly, all flowcharts, state transition diagrams, pseudo code, and the like are representative of various processes that may be substantially represented on a computer-readable medium and executed by a computer or processor, whether or not the computer or processor is explicitly shown .

The functions of the various elements shown in the figures, including the functional blocks depicted in the processor or similar concept, may be provided by use of dedicated hardware as well as hardware capable of executing software in connection with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

Also, the explicit use of terms such as processor, control, or similar concepts should not be interpreted exclusively as hardware capable of running software, and may be used without limitation as a digital signal processor (DSP) (ROM), random access memory (RAM), and non-volatile memory. Other hardware may also be included.

In the claims hereof, the elements represented as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements performing the function or firmware / microcode etc. , And is coupled with appropriate circuitry to execute the software to perform the function. It is to be understood that the invention defined by the appended claims is not to be construed as encompassing any means capable of providing such functionality, as the functions provided by the various listed means are combined and combined with the manner in which the claims require .

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings, in which: There will be. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating an electronic device according to an embodiment of the present invention. 1, an electronic device 100 includes a storage unit 110, an input unit 120, an output unit 130, a determination unit 140, a calculation unit 150, an image matching unit 160, 170).

Here, the electronic device 100 may be a smart phone, a tablet computer, a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a smart glass, a project glass, navigation, black-box, and the like.

Here, the driving state of the vehicle may include various states in which the vehicle is being driven by the driver, such as a vehicle stopping state, a running state of the vehicle, a parking state of the vehicle, and the like.

The driving-related guidance may include various guidance for assisting the driver of the vehicle such as a route guidance, a lane departure guidance, a forward vehicle departure guidance, a traffic light change guidance, a front vehicle collision prevention guide, and the like.

Here, the route guidance includes augmented reality route guidance for performing route guidance by combining various information such as a user's position, direction, and the like to an image taken in front of the vehicle in operation, and a 2D (2-Dimensional) (2-Dimensional) or 3D (3-Dimensional) path guidance that combines various information such as the user's location, direction, Here, the route guidance can be interpreted not only as a case in which the user rides on the vehicle but also includes a route guidance in the case where the user moves or jumps.

Further, the lane departure guidance may be to guide whether or not the vehicle being driven has departed from the lane.

In addition, the forward vehicle departure guidance may be to guide the departure of the vehicle located in front of the vehicle being stopped.

Further, the traffic light change guidance may be to guide the change of the traffic light located in front of the vehicle being stopped. For example, when the red light indicating the stop signal is changed from a lighted state to a blue light representing the start signal, or the like, it may be guided.

The front vehicle collision avoidance guidance may be to guide the vehicle to avoid a collision with the preceding vehicle when the distance to the vehicle located in front of the stopped or running vehicle is within a certain distance.

Such a forward image of the vehicle enabling the provision of various guides can be photographed in a camera mounted on the vehicle. Here, the camera may be a camera that is integrally formed with the electronic device 100 mounted on the vehicle and photographs the front of the vehicle. In this case, the camera may be integrally formed with a smart phone, a navigation device, or a black box, and the electronic device 100 may receive an image photographed by a camera formed integrally.

As another example, the camera may be a camera that is mounted on the vehicle separately from the electronic device 100 and photographs the front of the vehicle. In this case, the camera may be a separate black box that is mounted toward the front of the vehicle, and the electronic device 100 may receive the photographed image through wired / wireless communication with the separately mounted black box, When the storage medium to be stored is inserted into the electronic device 100, the electronic device 100 can receive a photographed image.

Hereinafter, the electronic device 100 according to one embodiment of the present invention will be described in more detail based on the above description.

The storage unit 110 functions to store various data and applications necessary for the operation of the electronic device 100. In particular, the storage unit 110 may store data necessary for the operation of the electronic device 100, for example, an OS, a path search application, a map, and the like. Also, the storage unit 110 may store data generated by the operation of the electronic device 100, for example, the detected route data, the received image, and the like. In addition, the storage unit 110 may store the positions and reference positions of the novel points determined by the determination unit 140.

Herein, the storage unit 110 may be implemented as a random access memory (RAM), a flash memory, a ROM, an erasable programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), a register, a hard disk, Card, a Universal Subscriber Identity Module (USIM), or the like, as well as a detachable type storage device such as a USB memory.

The input unit 120 functions to convert a physical input from the outside of the electronic device 100 into a specific electric signal. Accordingly, the input unit 120 can receive a user input requesting the placement position guidance of the camera. Here, the input unit 120 may include all or some of the user input unit 121 and the microphone unit 123.

The user input unit 121 can receive user inputs such as touch, push operation, and the like. The user input unit 120 may be implemented using at least one of various types of buttons, a touch sensor for receiving a touch input, and a proximity sensor for receiving an approaching motion.

The microphone unit 123 can receive the user's voice and the sound generated from the inside and the outside of the vehicle.

The output unit 130 is a device for outputting data of the electronic device 100. Here, the output unit 130 may include all or a part of the display unit 131 and the audio output unit 133.

The display unit 131 is a device that outputs data that the electronic device 100 can visually recognize. The display unit 131 may be implemented as a display unit provided on the front surface of the housing of the electronic device 100. The display unit 131 may be formed integrally with the electronic device 100 to output visual recognition data and may be installed separately from the electronic device 100 such as a HUD (Head Up Display) to output visual recognition data It is possible.

The audio output unit 133 is a device that outputs data that the electronic device 100 can perceive audibly. The audio output unit 133 may be implemented as a speaker for expressing sound data to be notified to the user of the electronic device 100.

The determination unit 140 may determine a vanishing point of the image photographed by the camera during operation of the vehicle. Specifically, the determining unit 140 may extract a lane from the photographed image photographed by the camera during driving of the vehicle, and extend the extracted lane to determine a vanishing point that intersects with the lane.

In addition, the determination unit 140 can determine the position of the vanishing point, which is the position of the vanishing point determined in the photographed image.

Here, the position of the determined vanishing point can be changed in accordance with the mounting position of the camera in the vehicle. The determination of the vanishing point and the determination of the position of the vanishing point of the determining unit 140 will be described later with reference to FIG.

On the other hand, the determination unit 140 can determine the reference position that is the optimal position of the vanishing point. Here, the reference position may be a position of a vanishing point which can provide an optimal driving-related guidance by using the image photographed by the camera while the vehicle is in operation. Here, the driving-related guidance may include at least one of an augmented reality route guidance, a lane departure guidance, a forward vehicle departure guidance, a traffic light change guidance, and a front vehicle collision prevention guide.

Such a reference position may be determined according to the driving-related information important rank selected by the driver. For example, when the driver selects the important ranking of the lane departure guidance as the first rank, the reference position is set to the upper side with respect to the horizontal center line of the photographed image so that the electronic device 100 can accurately perform lane detection on the photographed image Can be located. As another example, when the driver selects the important ranking of the traffic light change guidance as the first rank, the reference position is set to the lower side with respect to the horizontal center line of the photographed image so that the electronic device 100 can accurately perform the traffic light detection on the photographed image Can be located.

As another example, when the driver selects the important ranking of the augmented reality route guidance, the lane departure guidance, the forward vehicle departure guidance, the traffic light change guidance, and the front vehicle collision prevention guidance as the first rank, the electronic device 100 selects The reference position may be located within a predetermined distance from the center of the photographed image so that all of the above-described guidance can be accurately performed.

The reference position determination of the determination unit 140 will be described later with reference to FIG.

The calculating unit 150 may calculate the positional difference between the position of the vanishing point determined by the determining unit 140 and the reference position. Specifically, the calculating unit 150 may compare the position and the reference position of the vanishing point determined by the determining unit 140, and calculate the position difference between the position of the vanishing point and the reference position.

For example, the calculating unit 150 can set the position of the vanishing point as a reference, and calculate the position difference indicating the distance and direction from the vanishing point position to the reference position. That is, the calculating unit 150 sets the coordinates (X1, Y1) corresponding to the position of the vanishing point as a reference, and calculates the distance from the coordinates corresponding to the position of the vanishing point to the coordinates (X2, Y2) (X1-X2, Y1-Y2) representing the positional difference.

As another example, the calculating unit 150 may set a reference position as a reference, and calculate a position difference indicating a distance and a direction from the reference position to the vanishing point position. That is, the calculating unit 150 sets the coordinates (X2, Y2) corresponding to the reference position as a reference and sets the distance and direction from the coordinates corresponding to the reference position to the coordinates (X1, Y1) corresponding to the position of the vanishing point as (X2-X1, Y2-Y1). The operation of the calculating unit 150 will be described later with reference to FIG.

Meanwhile, the calculating unit 150 may calculate the distance and direction in which the camera should be moved based on the existing mounting position so as to position the determined vanishing point position at the reference position.

Specifically, the calculating unit 150 may calculate a distance and a direction to be moved based on the existing mounting position of the camera using the calculated position difference. For example, when the position difference indicating the distance and direction from the position of the vanishing point to the reference position is (X1-X2, Y1-Y2) based on the position of the vanishing point, the calculating unit 150 uses the calculated position difference The distance and direction to be moved based on the existing mounting position of the camera can be calculated as X cm to the left and Y cm to the upper side, for example. This will be described later with reference to FIG.

Alternatively, the calculating unit 150 may calculate the distance and direction in which the camera should be moved based on the matching position of the camera using the matching result of the image matching unit 160. Specifically, the calculating unit 150 may determine a predetermined area in the screen on which the capturing image is to be displayed by using the calculated position difference. Here, the capturing image may be a captured image in an image captured in real time at an existing mount position of the camera. The predetermined area in the screen on which the capturing image is to be displayed may be an area that reflects the distance and direction that should be moved based on the existing mounting position of the camera in order to position the determined position of the vanishing point at the reference position. The controller 170 may control the display unit 131 to display the real-time photographic image on the screen and display the captured image on the determined area in a superimposed manner. In this case, the image matching unit 160 may perform image matching between the real-time image and the capturing image to calculate a moving pixel and a moving direction between the real-time image and the capturing image. The calculating unit 150 calculates the distance and direction in which the moving position of the camera is to be moved based on the moving pixel and moving direction calculated as a result of image matching, for example, X cm to the left and Y cm to the upper side , Can be calculated. This will be described later with reference to FIG.

On the other hand, the controller 170 controls the overall operation of the electronic device 100. More specifically, the control unit 170 can control all or a part of the storage unit 110, the input unit 120, the output unit 130, the determination unit 140, the calculation unit 150, and the image matching unit 160 have.

In particular, the control unit 170 may guide the position of the camera using the position and the reference position of the vanishing point determined by the determining unit 140. [

Here, the control unit 170 can control to perform the guidance only when the speed of the vehicle is equal to or less than a predetermined speed. For example, when a user input requesting the placement position guidance of the camera is received through the input unit 120, the control unit 170 determines the speed of the vehicle and controls the controller 170 to perform guidance when the speed of the vehicle is equal to or less than a predetermined speed can do. Here, the predetermined speed may be the speed at which the vehicle does not move or the speed at which the vehicle is parked, but is not limited thereto.

On the other hand, the control unit 170 controls the audio output unit 133 to provide audio by using the distance and direction that should be moved based on the existing mount position of the camera calculated by the calculating unit 150, The guidance can be performed by controlling the display unit 131 to display the guide object on the screen. In this case, the user can confirm the distance and direction in which the camera should be moved through the voice or the screen, and then move the camera by a corresponding distance and direction to mount the camera at a new position. This will be described later with reference to FIG.

Alternatively, the control unit 170 may display the real-time photographic image on the screen, and perform the guidance by controlling the display unit 131 to display the captured image on the area determined by the calculation unit 150 in a superimposed manner. Here, the overlaid screen can display the guide objects indicating the calculated distance and direction together. In this case, the user can confirm the real-time shot image and the captured image through the screen, and move the camera by the corresponding distance and direction so as to display the real-time shot image and the captured image exactly coinciding with each other. This will be described later with reference to FIG.

Meanwhile, when the user who confirmed the above-described camera mounting instruction moves the camera, the calculating unit 150 can update the distance and direction to be moved in accordance with the result of the camera movement of the user.

Specifically, the calculating unit 150 may update the distance and the direction to be moved, reflecting the result of the camera movement of the user based on the sensing value of the sensing unit 190 according to the movement of the camera. For example, when the camera is a camera that is formed integrally with an electronic device 100 mounted on a vehicle and captures the front of the vehicle, the calculating unit 150 calculates the sensing value of the motion sensing unit 191 of the electronic device 100 The distance and direction to be moved can be updated by reflecting the result of the camera movement of the user. As another example, when the camera is a black box that is mounted on a vehicle separately from the electronic device 100 and photographs the front of the vehicle, the calculation unit 150 calculates the three-axis geomagnetic sensor and the three-axis acceleration sensor The distance and direction to be moved can be updated by reflecting the result of the user's camera movement.

Alternatively, the calculating unit 150 may update the distance and direction to be moved using the image matching result in the image matching unit 160 according to the movement of the camera. Specifically, the image matching unit 160 may perform image matching of a real-time image and a capturing image to calculate a moving pixel and a moving direction between the real-time image and the capturing image. The calculating unit 150 may calculate the result of the camera movement of the user using the moving pixel and the moving direction calculated as a result of the image matching, and update the distance and the direction by reflecting the result.

2 is a block diagram specifically illustrating an electronic device according to an embodiment of the present invention. 2, the electronic device 100 includes a storage unit 110, an input unit 120, an output unit 130, a determination unit 140, a calculation unit 150, an image matching unit 160, 170, a communication unit 180, a sensing unit 190, and a power supply unit 195. Hereinafter, an electronic device 100 according to an embodiment of the present invention will be described with reference to FIG. However, in the description of FIG. 2, a detailed description of the configuration shown in FIG. 1 will be omitted.

The communication unit 180 may be provided for the electronic device 100 to communicate with other devices. The communication unit 180 includes a position data unit 181, a wireless Internet unit 183, a broadcast transmission / reception unit 185, a mobile communication unit 186, a short range communication unit 187, and a wired communication unit 189 . ≪ / RTI >

The position data section 181 is a device for acquiring position data through a Global Navigation Satellite System (GNSS). GNSS means a navigation system capable of calculating the position of a receiving terminal using a radio signal received from a satellite. A specific example of GNSS is a GPS (Global Positioning System), a Galileo, a GLONASS (Global Orbiting Navigational Satellite System), a COMPASS, an Indian Regional Navigational Satellite System (IRNSS), a Quasi-Zenith Satellite System . The location data portion 181 of the electronic device 100 according to an embodiment of the present invention may receive the GNSS signal serviced in the area where the electronic device 100 is used to obtain location data.

The wireless Internet unit 183 is a device that connects to the wireless Internet to acquire or transmit data. The wireless Internet that can be accessed through the wireless Internet unit 183 may be a wireless LAN (WLAN), a wireless broadband (Wibro), a world interoperability for microwave access (Wimax), or a high speed downlink packet access (HSDPA).

The broadcast transmitting and receiving unit 185 is a device for transmitting and receiving broadcast signals through various broadcasting systems. The broadcasting system that can transmit and receive through the broadcasting transmission and reception unit 185 may be a Digital Multimedia Broadcasting Terrestrial (DMBT), a Digital Multimedia Broadcasting Satellite (DMBS), a Media FoW Link Only (DVFH), a Digital Video Broadcast Handheld Integrated Services Digital Broadcast Tereestrial). The broadcast signal transmitted / received through the broadcast transmission / reception unit 185 may include traffic data, living data, and the like.

The mobile communication unit 186 can access and communicate with a mobile communication network according to various mobile communication standards such as 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evolution (LTE)

The short-range communication unit 187 is a device for short-range communication. As described above, the short-range communication unit 187 is a communication unit that transmits and receives data to and from a mobile communication terminal such as Bluetooth, Radio Frequency Identification (RFID), Infra Data Association (IrDA), Ultra WidBand (UWB), ZigBee, Near Field Communication -Fi or the like.

The wired communication unit 189 is an interface device capable of connecting the electronic device 100 with another device by wire. The wired communication unit 119 may be a USB module capable of communicating via a USB port.

The communication unit 180 includes at least one of the location data unit 181, the wireless Internet unit 183, the broadcast transmission / reception unit 185, the mobile communication unit 186, the short-range communication unit 187, and the wired communication unit 189 To communicate with other devices.

For example, when the electronic device 100 does not include a camera function, an image photographed by a vehicle camera such as a black box can be received using at least one of the short-range communication unit 187 and the wired communication unit 189. [

As another example, in the case of communicating with a plurality of devices, either one may communicate with the short-range communication unit 187 and the other may communicate via the wired communication unit 119. [

The sensing unit 190 is a device capable of sensing the current state of the electronic device 100. The sensing unit 190 may include all or some of the motion sensing unit 191 and the optical sensing unit 193.

The motion sensing unit 191 can sense movement of the electronic device 100 in a three-dimensional space. The motion sensing unit 191 may include a three-axis geomagnetic sensor and a three-axis acceleration sensor. The motion data obtained through the motion sensing unit 191 can be combined with the position data acquired through the position data unit 191 to calculate a more accurate trajectory of the vehicle to which the electronic device 100 is attached.

The optical sensing unit 193 is a device for measuring the ambient illuminance of the electronic device 100. The brightness of the display unit 195 can be changed to correspond to the surrounding brightness by using the illuminance data acquired through the optical sensing unit 193. [

The power supply unit 195 is a device for supplying power necessary for operation of the electronic device 100 or operation of another device connected to the electronic device 100. [ The power supply unit 195 may be a battery built in the electronic device 100, or a device that receives power from an external power source such as a vehicle. The power supply unit 195 may be implemented as a wired communication module 119 according to the type of the power supply, or may be implemented as a wirelessly supplied device.

3 is a diagram illustrating a method for determining a vanishing point according to an embodiment of the present invention. 3, the decision unit 140 extracts lanes 310 and 320 from the photographed image 300 photographed by the camera during driving of the vehicle, and extends the extracted lane to intersect the vanishing point ) ≪ / RTI >

In addition, the determining unit 140 can determine the position of the vanishing point, which is the position of the vanishing point 330 determined in the photographed image 300. [

4 is a view showing positions and reference positions of a vanishing point according to an embodiment of the present invention. 4, the position of the vanishing point 330 determined in the photographed image 300 can be changed according to the vehicle mount position of the camera that photographs the image during driving of the vehicle, and the optimal position of the vanishing point 330 May be different from the location of the reference 340.

On the other hand, the position of the reference 340 can be determined according to the driving-related information important rank selected by the driver. However, it is preferable that the electronic device 100 can accurately perform both the augmented reality route guidance, the lane departure guidance, the forward vehicle departure guidance, the traffic light change guidance, and the front vehicle collision prevention guidance by using the photographed image 300 , The reference position 340 may be located within a predetermined distance 350 from the center of the captured image 300 as shown in FIG.

5 is a diagram illustrating a position difference calculation method according to an embodiment of the present invention. For example, when the coordinate corresponding to the position of the vanishing point 330 is (0, 0) and the coordinate corresponding to the reference position 340 is (20, -20), the calculating unit 150 calculates the vanishing point 330, (-20, 20) 360 indicating the distance and the direction to the coordinates (20, -20) corresponding to the position of the reference 340 on the basis of the coordinates (0, 0) .

As another example, when the coordinate corresponding to the position of the vanishing point 330 is (0, 0) and the coordinate corresponding to the reference position 340 is (20, -20) (20, -20) 370 indicating the distance and direction to the coordinates (0, 0) corresponding to the position of the vanishing point 330 on the basis of the coordinates (20, -20) .

Accordingly, the calculating unit 150 sets one of the position of the vanishing point or the reference position as a reference, and if the position of the vanishing point is located at the reference position, it can be calculated that the position of the vanishing point is shifted to the right 20 and downward 20 have.

Also, the calculating unit 150 may calculate the distance and the direction to be moved based on the existing mounting position of the camera, using the calculated position difference. 5, the calculating unit 150 calculates a difference between the position of the vanishing point and the reference position by using the calculated positional difference to move the camera X cm to the left with respect to the existing mounting position and Y cm to the upper side Can be calculated.

6 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention. Referring to FIG. 6, first, the electronic device 100 may determine a vanishing point of an image photographed by a camera during operation of the vehicle (S601).

Then, the reference position, which is the optimal position of the determined vanishing point, can be determined (S602).

Here, the reference position may be a position of a vanishing point that can provide an optimal driving-related guidance using the image photographed by the camera while the vehicle is in operation, and the driving-related guidance may include augmented reality route guidance, A vehicle start guide, a traffic light change guide, and a front vehicle collision avoidance guide.

On the other hand, preferably, the reference position may be located within a predetermined distance from the center of the photographed image.

Then, the position of the camera can be guided using the determined position of the vanishing point and the reference position (S603).

7 is a flowchart specifically showing a control method of an electronic device according to an embodiment of the present invention. Referring to FIG. 7, first, the electronic device 100 may determine a vanishing point of an image photographed by a camera during operation of the vehicle (S701).

Then, the electronic device 100 can determine a reference position that is an optimal position of the determined vanishing point (S702).

Then, the electronic device 100 can calculate the position difference between the determined position of the vanishing point and the reference position (S703).

In step S704, the electronic device 100 may calculate a distance and a direction to move the determined vanishing point to the reference position based on the existing mounting position of the camera, using the calculated position difference.

Then, the electronic device 100 can display the calculated distance and direction as a voice or display the guidance object indicating the calculated distance and direction on the screen (S705).

If the user moves the camera based on the guidance, the electronic device 100 can update the distance and the direction by reflecting the result of the user's camera movement (S706).

In this case, the electronic device 100 may provide the updated distance and direction by voice or may display a guide object on the screen indicating the updated distance and direction (S707).

8 is a view showing a UI (User Interface) screen showing a guidance method according to an embodiment of the present invention. 8A, the electronic device 100 includes a guide object 322 for indicating the distance and direction in which the position of the vanishing point 330 should be moved with respect to the existing mount position of the camera in order to position the position of the vanishing point 330 at the reference position 340 801, 802) can be displayed on the screen. Accordingly, after confirming the displayed screen, the user can move the camera 3 cm to the left and 2 cm to the upper side based on the existing mounting position.

On the other hand, when the user moves the camera based on the guidance, the electronic device 100 reflects the result of the camera movement of the user and displays the guide object indicating the updated distance and direction on the screen as shown in FIG. 8 (b) . That is, when the user moves the camera 1 cm to the left and 1 cm to the upper side, the electronic device 100 moves 2 cm to the left side and 1 cm to the upper side, reflecting the result (the sensing value of the motion detection sensor 191) The guidance objects 803 and 804 can be displayed on the screen as shown in FIG. 8 (b). Accordingly, the user can move the camera 2 cm to the left and 1 cm to the upper side with respect to the current position.

9 is a flowchart specifically illustrating a control method of an electronic device according to an embodiment of the present invention. Referring to FIG. 9, first, the electronic device 100 can determine a vanishing point of an image photographed by a camera during operation of the vehicle (S901).

Then, the electronic device 100 can determine a reference position that is an optimal position of the determined vanishing point (S902).

Then, the electronic device 100 can calculate the positional difference between the determined position of the vanishing point and the reference position (S903).

Then, the electronic device 100 can capture an image photographed in real time at the existing mount position of the camera (S904).

Then, the electronic device 100 can determine a predetermined area in the screen for displaying the capturing image using the position difference (S905).

Then, the electronic device 100 can display a real-time photographed image on the screen, and display the captured image on the determined area in a superimposed manner (S906).

Then, the electronic device 100 may calculate the distance and direction in which the position of the determined vanishing point should be moved with reference to the existing mounting position of the camera in order to position the position of the vanishing point at the reference position (S907).

Then, the electronic device 100 can display a guide object indicating the calculated distance and direction on the screen (S908).

Then, the electronic device 100 can match the real-time image and the capturing image, and update the distance and direction by reflecting the matching result (S909).

Then, the electronic device 100 can display a fog object indicating the updated distance and direction on the screen (S910).

10 is a view showing a UI (User Interface) screen showing a guidance method according to an embodiment of the present invention. Referring to FIG. 10 (a), the electronic device 100 may overlap and display a capturing image 1020 and a real-time image 1010 of an image photographed in real time at an existing mount position of the camera. Here, the capturing image 1020 may be displayed in an area that reflects a distance and a direction that should be moved based on the existing mounting position of the camera in order to position the position of the determined vanishing point at the reference position.

10B, the electronic device 100 includes a guide object 1030 indicating the distance and direction in which the position of the vanishing point should be moved based on the existing mount position of the camera, Can be displayed.

On the other hand, if the user moves the camera on the basis of the above guidance, the guiding object shown in Fig. 10 (b) can be updated to reflect the result of the camera movement of the user. Specifically, the image matching unit 160 may perform image matching between a real-time image and a capturing image to calculate a moving pixel and a moving direction between the real-time image and the capturing image, and the calculating unit 150 may calculate an image matching result The calculated result of the camera movement of the user can be calculated using the calculated moving pixel and the moving direction, and the distance and the direction can be updated by reflecting the result.

On the other hand, after confirming the real-time shot image and the captured image through the screen of FIG. 10 (a) or 10 (b), the user can see the captured image , The camera can be moved to the left side by a predetermined distance and upward by a predetermined distance and can be mounted at a new position.

11 is a flowchart specifically illustrating a control method of an electronic device according to an embodiment of the present invention. Referring to FIG. 11, the electronic device 100 may determine a vanishing point of an image photographed by a camera during operation of the vehicle (S1101).

Then, the electronic device 100 can determine a reference position that is an optimal position of the determined vanishing point (S1102).

Then, the electronic device 100 may receive a user input requesting a placement position guidance of the camera (S1103).

Then, the electronic device 100 can determine whether the speed of the vehicle is less than a predetermined speed (S1104).

If the speed of the vehicle is equal to or less than the predetermined speed (S1104: Y), the electronic device 100 can guide the mount position of the camera using the determined position of the vanishing point and the reference position (S1105).

However, if the speed of the vehicle is not less than the preset speed (S1104: N), the electronic device 100 may not perform the placement position guidance of the camera (S1106)

Accordingly, when the user is in a safe state to move the existing mount position of the camera to a new position, for example, a stop state, the electronic device 100 can perform the camera mount position guidance.

12 is a view showing an embodiment in which a camera and an electronic device are separated from each other according to an embodiment of the present invention. Referring to FIG. 12, a vehicle black box 200 provided separately from the navigation system 100 for a vehicle may constitute a system according to an embodiment of the present invention using a wired / wireless communication system.

The vehicle navigation system 100 may include a display unit 145 provided on the front surface of the navigation housing 191, a navigation operation key 193, and a navigation microphone 195.

The vehicle black box 200 can acquire the data of the vehicle during driving and stopping. That is, it is possible not only to shoot a moving image of a vehicle, but also to shoot an image even when the vehicle is stationary. The image quality of the image obtained through the vehicle black box 200 may be constant or changed. For example, it is possible to store a core image while minimizing a required storage space by increasing the image quality before and after occurrence of an accident, and lowering the image quality in a normal case.

The vehicle black box 200 may include a black box camera 222, a black box microphone 224, and an attaching portion 281. [

12, the navigation system 100 for a vehicle and the black box 200 for a vehicle provided separately from the vehicle 100 are connected to each other via a wire / wireless communication system. However, May not be connected to each other. In this case, when the storage medium storing the photographed image of the black box 200 is inserted into the electronic device 100, the electronic device 100 can receive the photographed image. On the other hand, it is also possible that the vehicle black box 200 has the function of the vehicle navigation 100 or the vehicle navigation 100 is integrated with the camera. This will be described in detail with reference to FIG.

13 is a diagram illustrating an embodiment in which the camera and the electronic device are integrated according to an embodiment of the present invention. Referring to FIG. 13, when the electronic device includes a camera function, It is possible to photograph the front of the vehicle and to mount the electronic device such that the display portion of the electronic device is user-recognizable. Accordingly, a system according to an embodiment of the present invention can be implemented.

FIG. 14 is a diagram illustrating an embodiment using an HUD (Head-Up Display) and an electronic device according to an embodiment of the present invention. Referring to FIG. 14, an electronic device can display an augmented reality route guidance screen on a head-up display through a head-up display and wired / wireless communication.

Meanwhile, the method of controlling an electronic device according to various embodiments of the present invention described above may be implemented in program code and provided to each server or devices in a state stored in various non-transitory computer readable media have.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

100: electronic device 110: storage unit
120: input unit 130: output unit
140: Decision section 150:
160: image matching unit 170:
180: communication unit 190: sensing unit
195:

Claims (19)

A method of controlling an electronic device,
Determining a vanishing point of an image photographed by a camera during driving of the vehicle;
Determining a reference position that is an optimal position of the determined vanishing point; And
And guiding the stationary position of the camera using the determined position and the reference position of the vanishing point. The method according to claim 1,
Wherein,
Wherein the position of the vanishing point is a position of the vanishing point that can provide an optimal driving-related guidance by using the image photographed by the camera during operation of the vehicle. 3. The method of claim 2,
The driving-
An augmented reality route guidance, a lane departure guidance, a forward vehicle departure guidance, a traffic light change guidance, and a front vehicle collision prevention guide,
Wherein,
Wherein the control means is located within a predetermined distance from the center of the photographed image. The method according to claim 1,
Further comprising: receiving a user input requesting a placement position guidance of the camera,
Wherein the step of guiding comprises:
And when the speed of the vehicle is equal to or less than a predetermined speed. The method according to claim 1,
Wherein the step of guiding comprises:
Calculating a positional difference between the determined position of the vanishing point and the reference position;
Calculating a distance and a direction to be moved on the basis of the existing mounting position of the camera to position the determined vanishing point at the reference position using the calculated position difference; And
And displaying the calculated distance and direction as a voice or a guide object indicating the calculated distance and direction on the screen. 6. The method of claim 5,
If the user moves the camera based on the guidance, updating the distance and the direction reflecting the result of the camera movement of the user; And
Further comprising the step of providing the updated distance and direction by voice or displaying a guide object on the screen indicating the updated distance and direction. The method according to claim 1,
Wherein the step of guiding comprises:
Calculating a positional difference between the determined position of the vanishing point and the reference position;
Capturing an image photographed in real time at an existing mount position of the camera;
Determining a predetermined area in a screen for displaying the capturing image using the position difference; And
Displaying the real-time shot image on the screen, and superimposing and displaying the captured image on the determined area. 8. The method of claim 7,
Calculating a distance and a direction to be moved based on the existing mounting position of the camera to position the determined vanishing point position at the reference position; And
And displaying a guide object indicating the calculated distance and direction on the screen. 9. The method of claim 8,
Matching the real-time image with the capturing image;
Updating the distance and direction by reflecting the matching result; And
And displaying a fog object indicating the updated distance and direction on the screen. In an electronic device,
A determining unit that determines a vanishing point of an image photographed by a camera during driving of the vehicle and determines a reference position that is an optimal position of the determined vanishing point;
A storage unit for storing the determined position of the vanishing point and the reference position; And
And a controller for guiding the position of the camera using the determined position and the reference position of the vanishing point. 11. The method of claim 10,
Wherein,
Wherein the position of the vanishing point is a position of the vanishing point which can provide an optimal driving-related guide by using the image photographed by the camera during driving of the vehicle. 12. The method of claim 11,
The driving-
An augmented reality route guidance, a lane departure guidance, a forward vehicle departure guidance, a traffic light change guidance, and a front vehicle collision prevention guide,
Wherein,
Wherein the electronic device is located within a predetermined distance from the center of the photographed image. 11. The method of claim 10,
Further comprising: an input unit for receiving a user input requesting a placement position guidance of the camera,
Wherein,
And performs the guidance when the speed of the vehicle is equal to or less than a predetermined speed. 11. The method of claim 10,
An audio output unit for outputting audio;
A display unit for displaying a screen; And
Calculating a positional difference between the determined position of the vanishing point and the reference position and calculating a distance and a direction to be moved based on the existing mounting position of the camera in order to position the determined vanishing point position at the reference position, And a calculation unit for calculating the number of times of use,
Wherein,
And controls the display unit to control the audio output unit to provide the calculated distance and direction as a voice or to display a guide object indicating the calculated distance and direction on the screen. 15. The method of claim 14,
The calculating unit calculates,
When the user moves the camera on the basis of the guidance, updates the distance and the direction reflecting the result of the camera movement of the user,
Wherein,
And controls the display unit to control the audio output unit to provide the updated distance and direction by voice or to display a guide object indicating the updated distance and direction on the screen. 11. The method of claim 10,
A display unit for displaying a screen; And
And a calculating unit for calculating a positional difference between the determined position of the vanishing point and the reference position and for determining a predetermined area in a screen for displaying the captured image using the positional difference,
Wherein the capturing image is a captured image in an image captured in real time at an existing mount position of the camera,
Wherein,
Displays the real-time shot image on the screen, and controls the display unit to display the captured image in a superimposed manner on the determined area. 17. The method of claim 16,
The calculating unit calculates,
Calculating a distance and a direction to be moved based on the existing mounting position of the camera to position the determined vanishing point position to the reference position,
Wherein,
And controls the display unit to display a guide object indicating the calculated distance and direction on the screen. 18. The method of claim 17,
And an image matching unit for matching the real-time image and the capturing image,
The calculating unit calculates,
Updates the distance and direction by reflecting the matching result,
Wherein,
And controls the display unit to display a fog object indicating the updated distance and direction on the screen. A computer-readable recording medium having recorded thereon a program code for performing a control method of an electronic apparatus,
In the control method,
Determining a vanishing point of an image photographed by a camera during driving of the vehicle;
Determining a reference position that is an optimal position of the determined vanishing point; And
And guiding the stationary position of the camera using the determined position and the reference position of the vanishing point.

Images