KR102536865B1 - Electronic device and method for controlling the same - Google Patents

Abstract

The present invention relates to an electronic device and an operating method thereof. The electronic device may project an infrared grid onto the road and photograph the projected infrared grid. The electronic device may determine the road condition of the road based on the photographed infrared grid, and project information on the road condition onto the road based on the determined road condition.

Description

Electronic device and its control method {ELECTRONIC DEVICE AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to an electronic device and a control method thereof. More specifically, the present invention relates to an electronic device for projecting information related to a personal mobility device onto a road surface and a method for controlling the same.

A personal mobility device means a means of transportation for one person, and is becoming a new means of transportation through recognition as a means of leisure, commuting, and short-distance transportation, as well as an eco-friendly means of transportation.

Personal mobility devices (hereinafter, referred to as "personal mobility") are not affected by traffic congestion, enabling rapid movement in the city center, and are convenient to carry, so they are free from parking problems. In addition, personal mobility is economical and eco-friendly because it can use power such as an electric battery.

Personal mobility has various forms and products applied with various principles, and there are largely one-wheeled products and two-wheeled products, and there are also forms in which existing means of transportation have evolved, such as electric kickboards, electric bicycles, and micro-cars. .

Personal mobility like this has its own display and displays various information. There is a difficult problem.

In addition, personal mobility is characterized by convenient portability and a small size and light weight due to the characteristics of a means of transportation for one or two people, so it is inevitably greatly affected by irregularities or obstacles on the road surface. Therefore, obstacles or bumps on the road can be a great danger to the driving of personal mobility.

An object of various embodiments of the present invention is to project and display various information related to driving of personal mobility on a road surface.

In addition, an object of the present invention is to recognize risk factors on the road and to provide information on the recognized risk factors.

In addition, an object of the present invention is to provide information corresponding to the driving of personal mobility based on the driving state, performance and user information of the personal mobility.

In addition, an object of the present invention is to provide an intuitive and convenient input means to the user without impairing the portability of personal mobility.

An operating method of an electronic device according to an embodiment of the present invention includes projecting an infrared grid on a road; photographing the projected infrared grid; determining a road condition of the road based on the photographed infrared grid; and projecting information on the road condition on the road based on the determined road condition.

An operating method of an electronic device according to an embodiment of the present invention includes detecting a moving speed of a mobile device on which the electronic device is mounted; and projecting information related to driving of the mobile device onto the road at a distance corresponding to the detected movement speed.

An electronic device according to an embodiment of the present invention includes a projector for projecting an image; a light emitting module that projects an infrared grid onto the road; a camera photographing the projected infrared grid; and a control unit that determines road conditions of the road based on the photographed infrared grid and controls the projector to project information on the road conditions onto the road based on the determined road conditions. can

An electronic device according to an embodiment of the present invention includes a projector for projecting an image; a sensing module for sensing a moving speed of a mobile device on which the electronic device is mounted; and a control unit controlling the projector to project information related to driving of the mobile device onto the road at a distance corresponding to the detected movement speed.

An electronic device according to an embodiment of the present invention may project and display various information related to driving of personal mobility on a road surface, so that a user of personal mobility can easily check necessary information.

In addition, the present invention can recognize risk factors on the road and provide information on the recognized risk factors, so that users of personal mobility can drive safely.

In addition, the present invention can provide information related to personal mobility driving at an appropriate distance and at an appropriate time based on the driving state, performance, and user information of the personal mobility.

In addition, the present invention can provide an intuitive and convenient input means to the user without compromising the portability of personal mobility.

A further scope of the applicability of the present invention will become apparent from the detailed description that follows. However, since various changes and modifications within the spirit and scope of the present invention can be clearly understood by those skilled in the art, it should be understood that the detailed description and specific examples such as preferred embodiments of the present invention are given as examples only.

1 is a block diagram illustrating an electronic device related to the present invention.
2 is a block diagram illustrating the configuration of an electronic device according to various embodiments of the present disclosure.
3 is a block diagram showing the configuration of a personal mobility device according to various embodiments of the present invention.
4 is an exemplary view of a combination of an electronic device and personal mobility according to various embodiments of the present disclosure.
5 is a flowchart illustrating road state determination and road state information projection by an electronic device according to various embodiments of the present disclosure.
6 shows a road surface according to various embodiments of the present invention.
7 shows a photographed IR grid according to various embodiments of the present invention.
8 is an exemplary view of risk area determination according to sensitivity control according to various embodiments of the present invention.
9 is an exemplary view of image projection of an electronic device according to various embodiments of the present disclosure.
10 is an exemplary view of a projected image according to various embodiments of the present invention.
11 is a flowchart of projection distance adjustment according to moving speed according to various embodiments of the present invention.
12 is an exemplary view of an operation of projecting an image at a distance corresponding to a moving speed according to various embodiments of the present disclosure.
13 is a flowchart illustrating an operation of determining a braking distance and adjusting a projection distance according to various embodiments of the present disclosure.
14 is a flowchart of gesture recognition and a function execution operation according to the recognized gesture according to various embodiments of the present invention.
15 is an exemplary view of gesture recognition according to various embodiments of the present invention.
16 is an exemplary view of a scan operation for gesture recognition according to various embodiments of the present invention.
17 to 18 are exemplary views of sensing range adjustment according to various embodiments of the present disclosure.
19 shows the configuration of a control sensor module according to various embodiments of the present invention.
20 is an exemplary view illustrating manual rotation of a radar sensor according to various embodiments of the present disclosure.
21 illustrates a sensing range for each user according to various embodiments of the present disclosure.
22 and 23 are exemplary views of screen display according to gestures according to various embodiments of the present invention.
24 is an exemplary diagram of a gesture for a driving function according to various embodiments of the present disclosure.
25 to 26 are exemplary diagrams for projecting movement path information according to various embodiments of the present invention.
27 is an exemplary view of conversion of a projection direction according to various embodiments of the present disclosure.

Hereinafter, the embodiments disclosed in this specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are given the same reference numerals regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used together in consideration of ease of writing the specification, and do not have meanings or roles that are distinct from each other by themselves. In addition, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of a related known technology may obscure the gist of the embodiment disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in this specification, the technical idea disclosed in this specification is not limited by the accompanying drawings, and all changes included in the spirit and technical scope of the present invention , it should be understood to include equivalents or substitutes.

Terms including ordinal numbers, such as first and second, may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another.

It is understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle. It should be. On the other hand, when an element is referred to as “directly connected” or “directly connected” to another element, it should be understood that no other element exists in the middle.

Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this application, terms such as "comprise" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Electronic devices described in this specification include, for example, mobile phones, smart phones, laptop computers, electronic devices for digital broadcasting, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation devices, and slate PCs. (slate PC), tablet PC (tablet PC), ultrabook (ultrabook), wearable device (for example, watch type electronic device (smartwatch), glass type electronic device (smart glass), HMD (head mounted display) )), etc. may be included.

However, those skilled in the art can easily recognize that the configuration according to the embodiments described in this specification may be applied to fixed electronic devices such as digital TVs, desktop computers, digital signage, etc., except when applicable only to electronic devices. There will be.

1 is a block diagram illustrating an electronic device related to the present invention.

The electronic device 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and a power supply unit 190. ) and the like. The components shown in FIG. 1 are not essential to implement the electronic device, so the electronic device described in this specification may have more or fewer components than the components listed above. The communication unit 110 may be used for communication between the electronic device 100 and a wireless communication system, between the electronic device 100 and another electronic device 100, between the electronic device 100 and an external server, or between the electronic device 100 and the personal mobility device. 300 may include one or more modules that enable wireless communication between them. Also, the wireless communication unit 110 may include one or more modules that connect the electronic device 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-distance communication module 114, and a location information module 115. .

The input unit 120 includes a camera 121 or video input unit for inputting a video signal, a microphone 122 for inputting an audio signal, or a user input unit 123 for receiving information from a user, for example , a touch key, a push key (mechanical key, etc.). Voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information within the electronic device, surrounding environment information surrounding the electronic device, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. Sensor (G-sensor), gyroscope sensor (gyroscope sensor), motion sensor (motion sensor), RGB sensor, infrared sensor (IR sensor), finger scan sensor, ultrasonic sensor , an optical sensor (eg, a camera (see 121)), a microphone (see 122), a battery gauge, an environmental sensor (eg, a barometer, a hygrometer, a thermometer, a radiation detection sensor, It may include at least one of a heat detection sensor, a gas detection sensor, etc.), a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the electronic device disclosed in this specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 150 is for generating an output related to sight, hearing, or touch, and includes at least one of a display unit 151, a sound output unit 152, a haptic module 153, and an optical output unit 154. can do. The display unit 151 may implement a touch screen by forming a mutual layer structure or integrally with the touch sensor. Such a touch screen may function as a user input unit 123 providing an input interface between the electronic device 100 and the user and provide an output interface between the electronic device 100 and the user.

The interface unit 160 serves as a passage for various types of external devices connected to the electronic device 100 . The interface unit 160 connects a device equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In response to the external device being connected to the interface unit 160, the electronic device 100 may perform appropriate control related to the connected external device.

Also, the memory 170 stores data supporting various functions of the electronic device 100 . The memory 170 may store a plurality of application programs (applications) running in the electronic device 100 , data for operating the electronic device 100 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the electronic device 100 from the time of shipment for the basic functions of the electronic device 100 (eg, incoming and outgoing calls, outgoing functions, message receiving, and outgoing functions). Meanwhile, the application program may be stored in the memory 170, installed on the electronic device 100, and driven by the control unit 180 to perform an operation (or function) of the electronic device.

The controller 180 controls general operations of the electronic device 100 in addition to operations related to the application program. The control unit 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the components described above or by running an application program stored in the memory 170.

In addition, the controller 180 may control at least some of the components discussed in conjunction with FIG. 1 in order to drive an application program stored in the memory 170 . Furthermore, the controller 180 may combine and operate at least two or more of the components included in the electronic device 100 to drive the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to each component included in the electronic device 100 . The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other in order to implement an operation, control, or control method of an electronic device according to various embodiments described below. Also, the operation, control, or control method of the electronic device may be implemented on the electronic device by driving at least one application program stored in the memory 170 .

Hereinafter, prior to examining various embodiments implemented through the electronic device 100 described above, the above-listed components will be described in more detail with reference to FIG. 1 .

First, looking at the wireless communication unit 110, the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast reception modules may be provided in the mobile electronic device 100 to receive simultaneous broadcasting of at least two broadcast channels or to switch broadcast channels.

The broadcast management server may refer to a server that generates and transmits a broadcast signal and/or broadcast-related information or a server that receives and transmits a previously generated broadcast signal and/or broadcast-related information to an electronic device. The broadcast signal includes not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a TV broadcast signal or a broadcast signal in which a data broadcast signal is combined with a radio broadcast signal.

The broadcast signal may be encoded according to at least one of technical standards for transmission and reception of digital broadcast signals (or a broadcast method, eg, ISO, IEC, DVB, ATSC, etc.), and the broadcast reception module 111 The digital broadcasting signal can be received using a method suitable for technical standards determined by technical standards.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it can be received by the mobile communication module 112.

The broadcast-related information may exist in various forms, such as, for example, an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). Broadcast signals received through the broadcast receiving module 111 and/or broadcast-related information may be stored in the memory 170 .

The mobile communication module 112 complies with technical standards or communication methods for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV) -DO(Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA(Wideband CDMA), HSDPA(High Speed Downlink Packet Access), HSUPA(High Speed Uplink Packet Access), LTE(Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.) to transmit and receive radio signals with at least one of a base station, an external terminal, and a server on a mobile communication network.

The wireless signal may include a voice call signal, a video call signal, or various types of data according to text/multimedia message transmission/reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built into or external to the electronic device 100 . The wireless Internet module 113 is configured to transmit and receive radio signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the viewpoint that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module (113) performing wireless Internet access through the mobile communication network ) may be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC. Near Field Communication (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and wireless USB (Wireless Universal Serial Bus) technology may be used to support short-distance communication. The short-range communication module 114 may be used to communicate between the electronic device 100 and a wireless communication system, between the electronic device 100 and other electronic devices 100, and the electronic device 100 through wireless area networks. and the personal mobility device 300, or between the electronic device 100 and a network in which other electronic devices 100 (or external servers) are located. The local area wireless communication network may be a local area wireless personal area network (Wireless Personal Area Networks).

Here, the other electronic device 100 is a wearable device capable of exchanging (or interlocking) data with the electronic device 100 according to the present invention (for example, a smartwatch, smart glasses) (smart glass) or HMD (head mounted display). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the electronic device 100 in the vicinity of the electronic device 100 . Furthermore, if the detected wearable device is a device authorized to communicate with the electronic device 100 according to the present invention, the control unit 180 transmits at least a portion of data processed by the electronic device 100 to the short-range communication module ( 114) can be transmitted to the wearable device. Accordingly, a user of the wearable device may use data processed by the electronic device 100 through the wearable device. For example, according to this, when a call is received in the electronic device 100, the user makes a phone call through the wearable device, or when a message is received in the electronic device 100, the user receives the received message through the wearable device. It is possible to check the message.

The location information module 115 is a module for acquiring the location (or current location) of the electronic device, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, the electronic device may obtain the location of the electronic device using a signal transmitted from a GPS satellite by using a GPS module. As another example, if the electronic device utilizes the Wi-Fi module, the location of the electronic device may be obtained based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function among other modules of the wireless communication unit 110 to obtain data on the location of the electronic device in substitution or addition. The location information module 115 is a module used to obtain the location (or current location) of the electronic device, and is not limited to a module that directly calculates or obtains the location of the electronic device.

Next, the input unit 120 is for inputting image information (or signals), audio information (or signals), data, or information input from a user. For inputting image information, the electronic device 100 has one Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170 . Meanwhile, the plurality of cameras 121 provided in the electronic device 100 may be arranged to form a matrix structure, and through the cameras 121 forming the matrix structure, various angles or focal points may be provided to the electronic device 100. A plurality of image information having may be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to obtain left and right images for realizing a stereoscopic image.

The microphone 122 processes external sound signals into electrical voice data. The processed voice data may be utilized in various ways according to the function (or application program being executed) being performed in the electronic device 100 . Meanwhile, various noise cancellation algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122 .

The user input unit 123 is for receiving information from a user, and when information is input through the user input unit 123, the control unit 180 can control the operation of the electronic device 100 to correspond to the input information. . The user input unit 123 is a mechanical input means (or a mechanical key, for example, a button located on the front or rear side of the electronic device 100, a dome switch, a jog wheel, jog switch, etc.) and a touch input means. As an example, the touch input means consists of a virtual key, soft key, or visual key displayed on a touch screen through software processing, or a part other than the touch screen. It can be made of a touch key (touch key) disposed on. On the other hand, the virtual key or visual key can be displayed on the touch screen while having various forms, for example, graphic (graphic), text (text), icon (icon), video (video) or these can be made of a combination of

Meanwhile, the sensing unit 140 senses at least one of information in the electronic device, surrounding environment information surrounding the electronic device, and user information, and generates a sensing signal corresponding thereto. Based on these sensing signals, the controller 180 may control driving or operation of the electronic device 100 or may process data, function, or operate related to an application program installed in the electronic device 100 . Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing nearby without mechanical contact by using the force of an electromagnetic field or infrared rays. The proximity sensor 141 may be disposed in an inner area of the electronic device covered by the touch screen as described above or in the vicinity of the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitance type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. If the touch screen is a capacitive type, the proximity sensor 141 may be configured to detect the proximity of a conductive object as a change in electric field according to the proximity of the object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, an action of approaching a touch screen without contacting an object to recognize that the object is located on the touch screen is referred to as a "proximity touch", and the touch An act of actually touching an object on a screen is called a "contact touch". The location at which an object is proximity-touched on the touch screen means a location at which the object corresponds vertically to the touch screen when the object is proximity-touched. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.) there is. Meanwhile, as described above, the controller 180 processes data (or information) corresponding to the proximity touch operation and proximity touch pattern detected through the proximity sensor 141, and furthermore, visual information corresponding to the processed data. It can be output on the touch screen. Furthermore, the controller 180 may control the electronic device 100 to process different operations or data (or information) depending on whether a touch to the same point on the touch screen is a proximity touch or a contact touch. .

The touch sensor detects a touch (or touch input) applied to the touch screen (or the display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. detect

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or capacitance generated in a specific part into an electrical input signal. The touch sensor may be configured to detect a location, area, pressure upon touch, capacitance upon touch, and the like, at which a touch object that applies a touch to the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

As such, when there is a touch input to the touch sensor, the corresponding signal(s) is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180. Thus, the controller 180 can know which area of the display unit 151 has been touched. Here, the touch controller may be a component separate from the controller 180 or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or the same control according to the type of the touch object that touches the touch screen (or a touch key provided other than the touch screen). Whether different or the same control is to be performed according to the type of touch object may be determined according to an operating state of the electronic device 100 or an application program being executed.

On the other hand, the touch sensor and proximity sensor described above are independently or combined, short (or tap) touch, long touch, multi-touch, drag touch on the touch screen ), flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. Touch can be sensed.

The ultrasonic sensor may recognize location information of a sensing object by using ultrasonic waves. Meanwhile, the controller 180 may calculate the location of the wave generating source through information detected by the optical sensor and the plurality of ultrasonic sensors. The position of the wave generating source can be calculated using the property that light is much faster than ultrasonic waves, that is, the time for light to reach the optical sensor is much faster than the time for ultrasonic waves to reach the ultrasonic sensor. More specifically, the location of the wave generating source may be calculated by using light as a reference signal and a time difference between the arrival time of ultrasonic waves.

Meanwhile, looking at the configuration of the input unit 120, the camera 121 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. A photo sensor may be stacked on a display device, and the photo sensor is configured to scan a motion of a sensing target close to the touch screen. More specifically, the photo sensor scans the content placed on the photo sensor by mounting photo diodes and transistors (TRs) in rows/columns and using electrical signals that change according to the amount of light applied to the photo diodes. That is, the photo sensor calculates the coordinates of the sensing object according to the change in light, and through this, the location information of the sensing object can be obtained.

The display unit 151 displays (outputs) information processed by the electronic device 100 . For example, the display unit 151 may display execution screen information of an application program driven in the electronic device 100 or UI (User Interface) and GUI (Graphic User Interface) information according to such execution screen information. .

Also, the display unit 151 may be configured as a 3D display unit that displays a 3D image.

A 3D display method such as a stereoscopic method (glasses method), an auto stereoscopic method (non-glasses method), or a projection method (holographic method) may be applied to the 3D display unit.

In general, a 3D stereoscopic image is composed of a left image (image for the left eye) and a right image (image for the right eye). According to the method of combining the left and right images into a 3D stereoscopic image, top-down method in which the left and right images are arranged up and down in one frame, left and right images in one frame L-to-R (left-to-right, side by side) method for arranging left and right images, checker board method for arranging pieces of left and right images in tile form, and left and right images in units of columns Alternatively, it is divided into an interlaced method that alternately arranges rows, and a time-sequential, frame-by-frame method that alternately displays a left image and a right image by time.

Also, the 3D thumbnail image may be generated as a single image by generating left and right image thumbnails from the left and right images of the original image frame, respectively, and combining them. In general, a thumbnail refers to a reduced image or a reduced still image. The generated left and right image thumbnails are displayed with a left and right distance difference on the screen by a depth corresponding to the parallax between the left and right images, thereby representing a three-dimensional sense of space.

A left image and a right image necessary for implementing a 3D stereoscopic image may be displayed on a stereoscopic display unit by a stereoscopic processing unit. The stereoscopic processing unit receives 3D images (images at a reference point and images at an extended point of view) and sets left and right images therefrom, or receives 2D images and converts them into left and right images.

The audio output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 also outputs sound signals related to functions performed by the electronic device 100 (eg, call signal reception sound, message reception sound, etc.). The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that a user can feel. A representative example of the tactile effect generated by the haptic module 153 may be vibration. The strength and pattern of the vibration generated by the haptic module 153 may be controlled by a user's selection or a setting of a controller. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output them.

In addition to vibration, the haptic module 153 responds to stimuli such as an array of pins that move vertically with respect to the contact skin surface, air blowing force or suction force through a nozzle or suction port, rubbing against the skin surface, electrode contact, and electrostatic force. It is possible to generate various tactile effects, such as the effect of heat absorption and the effect of reproducing the feeling of coolness and warmth using an element capable of absorbing heat or generating heat.

The haptic module 153 not only transmits a tactile effect through direct contact, but also can be implemented so that a user can feel a tactile effect through a muscle sense such as a finger or an arm. Two or more haptic modules 153 may be provided according to configuration aspects of the electronic device 100 .

The light output unit 154 outputs a signal for notifying occurrence of an event using light from a light source of the electronic device 100 . Examples of events occurring in the electronic device 100 may include message reception, call signal reception, missed calls, alarms, schedule notifications, e-mail reception, and information reception through applications.

A signal output from the light output unit 154 is implemented as the electronic device emits light of a single color or multiple colors to the front or back side. The signal output may be terminated when the electronic device detects the user's confirmation of the event.

The interface unit 160 serves as a passage for all external devices connected to the electronic device 100 . The interface unit 160 receives data from an external device, receives power and transmits it to each component inside the electronic device 100, or transmits data inside the electronic device 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and a port for connecting a device having an identification module. The interface unit 160 may include an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, and the like.

On the other hand, the identification module is a chip that stores various types of information for authenticating the right to use the electronic device 100, and includes a user identification module (UIM), a subscriber identity module (SIM), and universal user authentication. module (universal subscriber identity module; USIM) and the like. A device equipped with an identification module (hereinafter referred to as 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the electronic device 100 through the interface unit 160 .

In addition, when the electronic device 100 is connected to an external cradle, the interface unit 160 serves as a passage through which power from the cradle is supplied to the electronic device 100 or is input from the cradle by a user. It may be a passage through which various command signals are transmitted to the electronic device 100 . Various command signals or the power input from the cradle may operate as a signal for recognizing that the electronic device 100 is correctly mounted on the cradle.

The memory 170 may store programs for operation of the controller 180 and may temporarily store input/output data (eg, phonebook, message, still image, video, etc.). The memory 170 may store data related to vibration and sound of various patterns output when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, a silicon disk drive type, or a multimedia card micro type. ), card-type memory (eg SD or XD memory, etc.), RAM (random access memory; RAM), SRAM (static random access memory), ROM (read-only memory; ROM), EEPROM (electrically erasable programmable read -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. The electronic device 100 may operate in relation to a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls operations related to application programs and general operations of the electronic device 100 in general. For example, if the state of the electronic device satisfies a set condition, the controller 180 may execute or release a locked state that restricts a user's control command input to applications.

In addition, the controller 180 may perform control and processing related to voice calls, data communications, video calls, etc., or perform pattern recognition processing capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. can Furthermore, the control unit 180 may control any one or a combination of the components described above in order to implement various embodiments described below on the electronic device 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for the operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery capable of being charged, and may be detachably coupled to the body of the electronic device for charging.

In addition, the power supply unit 190 may have a connection port, and the connection port may be configured as an example of an interface 160 electrically connected to an external charger that supplies power to charge the battery.

As another example, the power supply unit 190 may charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 uses at least one of an inductive coupling method based on magnetic induction from an external wireless power transmitter or a magnetic resonance coupling method based on electromagnetic resonance. power can be delivered.

Meanwhile, various embodiments hereinafter may be embodied in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

An electronic device according to various embodiments of the present disclosure may be included in or combined with a personal mobility device to project various pieces of information related to the personal mobility device onto a road. The electronic device may be the above-described electronic device 100, or may include only some components of the above-described electronic device 100. An electronic device may be referred to as a navigator or navigation in that it provides information related to a means of transportation, but may be different from a navigator or navigation in that it provides various information as well as route information. Hereinafter, the configuration of the electronic device will be described with reference to FIG. 2 .

2 is a block diagram illustrating the configuration of an electronic device according to various embodiments of the present disclosure.

The electronic device 200 may include a camera 220, a light emitting module 230, a sensor module 240, a projector 250, a control sensor module 260, a memory 270, and a controller 280. The electronic device 200 may include only some of the above-described components as needed, or may further include other components.

The camera 220 may capture an image. For example, the camera 220 may capture an image of the driving direction of the personal mobility device 300 to which the electronic device 200 is coupled or installed or the surroundings. Accordingly, the camera 220 may capture an infrared grid projected by the IR light emitting module 230 to be described later.

The light emitting module 230 may project an IR (Infrared) grid. For example, the light emitting module 230 may project an IR grid onto the road surface in the driving direction of the personal mobility device 300 to which the electronic device 200 is coupled or provided. The total size of the IR grid projected by the light emitting module 230 and the size of one grid may be variously set. In addition, the IR light emitting module 230 may project grids of various wavelengths as well as IR grids. For example, the IR light emitting module 230 may project a visible ray grid and an ultraviolet ray grid as well as infrared rays.

The sensor module 240 may include one or more sensors for sensing at least one of information within the electronic device 200, surrounding environment information surrounding the electronic device 200, and user information. For example, the sensor module 240 may include a proximity sensor, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, and a gravity sensor ( G-sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor, finger scan sensor, ultrasonic sensor, optical sensor Sensors (optical sensor (eg camera), microphone, battery gauge, environmental sensor (eg barometer, hygrometer, thermometer, radiation detection sensor, heat detection sensor, gas detection sensor, etc.) , chemical sensors (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the electronic device disclosed in this specification may combine and utilize information sensed by at least two or more of these sensors. The sensor module 240 may correspond to the above-described sensing unit 140 .

The projector 250 may project an image. The projector 250 may project an image in the traveling direction of the personal mobility device 300 to which the electronic device 200 is coupled or provided. For example, the projector 250 may project an image onto a road or onto a surface such as a wall. The projector 250 can manually or automatically adjust the projection direction and projection angle for projecting an image, and also adjust the projection distance. In addition, the projector 250 may emit light illuminating one direction, and may project the above-described image and light illuminating one direction at once. Accordingly, the projector 250 may function as a headlight as well as project an image. This will be described later.

The control sensor module 260 may recognize various inputs to the electronic device 200 . The control sensor module 260 may recognize a user's gesture within a certain distance. For example, the control sensor module 260 may emit electromagnetic waves and receive reflection of the emitted electromagnetic waves from an object, thereby recognizing a movement such as a user's gesture. In one embodiment, the control sensor module 260 may detect a user's gesture based on the time and interval at which the emitted electromagnetic waves return. Accordingly, the control sensor module 260 may include an electromagnetic wave module emitting electromagnetic waves and a radar module receiving reflected electromagnetic waves. The electromagnetic wave module emitting electromagnetic waves and the radar module receiving reflected electromagnetic waves included in the control sensor module 260 may be one module, and the radar module may emit electromagnetic waves and receive reflected electromagnetic waves.

The control sensor module 260 may adjust the direction of the emitted electromagnetic wave and the distance the electromagnetic wave travels. This will be described later.

Meanwhile, the control sensor module 260 and the sensor module 240 described above may be configured as one module.

The memory 270 stores data supporting various functions of the electronic device 200 . The memory 270 may store a plurality of application programs (applications) running in the electronic device 200 , data for operating the electronic device 200 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the electronic device 200 from the time of shipment for basic functions (eg, a navigation function and an information display function) of the electronic device 200 . Meanwhile, the application program may be stored in the memory 270, installed on the electronic device 200, and driven by the control unit 280 to perform an operation (or function) of the electronic device. The memory 270 may correspond to the memory 170 described above.

The controller 280 controls general operations of the electronic device 200 in addition to operations related to the application program. The control unit 280 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the components described above or by running an application program stored in the memory 270. A detailed operation of the controller 280 will be described later.

The electronic device 200 may further include some of the components described in the electronic device 100 in addition to the above-described components. For example, the electronic device 200 may further include a communication module for communication, and the communication module may correspond to the wireless communication unit 110 described above.

In addition, the electronic device 200 may receive a broadcast signal through the added communication module, and may receive various information such as route information, map information, and traffic information based on the received broadcast signal. Also, the electronic device 200 may receive update data of a program for driving. For example, the electronic device 200 may use TPEG (Transport Protocol Expert Group) technology for receiving the DMB frequency to receive various information described above, and may receive various information and update program data as described above. there is.

The electronic device 200 may be coupled to the personal mobility device or may be provided as one component with the personal mobility device. Hereinafter, the configuration of the personal mobility device will be described.

3 is a block diagram showing the configuration of a personal mobility device according to various embodiments of the present invention.

Referring to FIG. 3 , the personal mobility device 300 (hereinafter, referred to as "personal mobility") includes a motor 310, a braking module 320, an aero module 330, a steering module 340, and a memory 350. , the battery 360 may be included. Depending on the shape and driving principle of the personal mobility 300, some components may be excluded or other components may be further included.

The motor 310 may generate power for the personal mobility 300 to move. The motor 310 may generate power by receiving power from a battery 360 to be described later, or may generate power by receiving fossil fuel. The motor 310 may be controlled by the control module 330, and power generation may be reduced or stopped by the braking module 320. Power generated by the motor 310 is transmitted to wheels 390 to be described later, so that the personal mobility 300 can move.

The braking module 320 may reduce the movement speed of the personal mobility 300 or stop the movement. The braking module 320 may reduce the movement speed of the personal mobility 300 or stop the movement of the personal mobility 300 through the wheel 390 or a braking unit connected to the wheel 390 . Also, the braking module 320 may reduce or stop the driving of the motor 310 .

The control module 330 controls the overall operation of the personal mobility 300 . For example, the control module 330 may control the personal mobility 300 to move and may maintain the balance of the personal mobility 300 . The control module 330 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the components described above or by running an application program stored in the memory 350. .

The steering module 340 may adjust the moving direction of the personal mobility 300 . For example, the steering module 340 may adjust the movement direction of the personal mobility 300 by adjusting the rotation direction of the wheel 390 . The steering module 340 may adjust the moving direction of the personal mobility 300 according to user manipulation, or may adjust the moving direction of the personal mobility 300 according to the control of the control module 330 . In addition, the steering module 340 together with the braking module 320 may adjust the moving direction of the personal mobility 300 for autonomous driving according to the control of the control module 330 .

The memory 350 stores data supporting various functions of the personal mobility 300 . The memory 350 may store a plurality of application programs (applications) running in the personal mobility 300 , data for operation of the personal mobility 300 , and instructions. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the personal mobility 300 from the time of shipment for basic functions (eg, driving function, autonomous driving function) of the personal mobility 300 . Meanwhile, the application program may be stored in the memory 350, installed on the personal mobility 300, and driven by the control module 330 to perform the operation (or function) of the electronic device. The memory 350 may correspond to the memory 170 described above.

The battery 360 may store electrical energy. Also, the battery 360 may store fossil fuel.

In addition to the above configuration, the personal mobility 300 may further include any one of a display and a communication module for communication.

The personal mobility 300 may be a means of movement that is equipped with a motor and moves, or a means of movement that is not equipped with a motor and moves by the user's kinetic energy. Accordingly, the personal mobility 300 may mean a means of transportation for one or two people. Also, the personal mobility 300 may be combined with the aforementioned electronic device 200 or may include the electronic device 200 . Referring to FIG. 4 , the combination of the electronic device 200 and the personal mobility 300 will be described.

4 is an exemplary view of a combination of an electronic device and personal mobility according to various embodiments of the present disclosure.

Referring to FIG. 4 , the personal mobility 300 may include a body 380 and wheels 390, and the body 380 may be combined with the electronic device 200. For example, the body 380 or the case of the electronic device 200 may include a fastening module for coupling, and the body 380 of the personal mobility 300 and the electronic device 200 are coupled through the fastening module. It can be. The fastening module may be a component included in at least one of the electronic device 200 and the personal mobility 300, or may be coupled to each of the electronic device 200 and the personal mobility 300 as a separate component. As the electronic device 200 and the personal mobility 300 are coupled, the camera 220, the light emitting module 230, and the projector 250 of the electronic device 200 are provided to face the traveling direction of the personal mobility 300 It can be. For example, the camera 220 may photograph the traveling direction of the personal mobility 300, for example, the front. The light emitting module 230 may project an IR grid onto the road surface in the direction in which the personal mobility 300 travels. The projector 250 may project an image in the forward direction of the personal mobility 300 , for example. In addition, the control sensor module 260 may be provided to emit electromagnetic waves in a direction in which a gesture of a user riding at a position corresponding to the body 380 can be recognized.

Based on the above description, an operating method of the electronic device 200 according to various embodiments will be described. The electronic device 200 may be combined with the aforementioned personal mobility 300 or included in the personal mobility 300 .

5 is a flowchart illustrating road state determination and road state information projection by an electronic device according to various embodiments of the present disclosure.

Referring to FIG. 5 , the electronic device 200 may project an infrared grid onto the road surface in the direction of travel of the personal mobility 300 to which the electronic device 200 is coupled (S510).

For example, the light emitting module 230 may project an infrared grid onto the road surface in the traveling direction of the personal mobility 300 to which the electronic device 200 is coupled. The light emitting module 230 may adjust the projection distance of the infrared grid according to the speed of the personal mobility 300 . For example, the light emitting module 230 may project an infrared grid on a road surface within a short distance from the personal mobility 300 when the speed of the personal mobility 300 is slow, and if the speed of the personal mobility 300 is fast, the personal mobility ( 300) and the infrared grid can be projected on the road surface at a long distance. Here, the distance that is the standard for the near or far distance to the personal mobility 300 may be set in various ways according to the user or designer's choice, and the performance of the personal mobility 300 or the body of the occupant riding the personal mobility 300 It may be set differently according to conditions.

As described above, the light emitting module 230 may project grids of various wavelengths in addition to the IR grid, and the size of the grid and the spacing of one grid may be adjusted.

The electronic device 200 may capture the projected infrared grid (S530).

The electronic device 200 may capture the IR grid projected on the road surface through the camera 220 . For example, the camera 220 may further include an infrared filter, so that the IR grid projected onto the road may be captured. Meanwhile, when the light emitting module 230 projects a grid of a different wavelength than the IR grid, the camera 220 may further include a filter corresponding to the projected wavelength.

The electronic device 200 may determine the road condition based on the photographed infrared grid (S550).

The controller 280 of the electronic device 200 may determine the road condition of the road onto which the IR grid is projected, based on the photographed grid. For example, the controller 280 may determine that the road conditions are abnormal when IR grids are projected at regular intervals or sizes, but the projected grids are not maintained. Here, abnormal road conditions may mean that there are obstacles on the road or irregularities on the road. Specifically, the control unit 280 controls the road surface when the size of the captured grid is not constant, when a portion of the grid is not captured, or when the captured grid line is deformed into a shape other than a straight line. It can be judged that the condition is uneven. This will be described with reference to FIGS. 6 to 7 .

6 shows a road surface according to various embodiments of the present invention.

Referring to FIG. 6 , road 10 may have a concave or convex area in one area compared to other areas. For example, there may be a protruding portion compared to other areas, such as the convex portion 61, and a recessed portion compared to other areas, such as the concave portion 62. The convex part 61 may be an obstacle or a part of the road protruding, and the concave part 62 may be a part of the road that is depressed.

7 shows a photographed IR grid according to various embodiments of the present invention.

Referring to FIG. 7 , the camera 220 may capture the IR grid 70 projected onto the road 10 . The controller 280 may recognize an area in which the shape of the grid is not maintained in the photographed IR grid 70 . For example, the controller 280 may recognize the first area 71 and the second area 72 in which the shape of the projected IR grid is not maintained. Here, the first area 71 may be an area corresponding to the convex portion 61 described above, and the second area 72 may be an area corresponding to the concave portion 62 described above. Accordingly, it can be confirmed that the shape of the IR grid projected on the first region 71 is deformed into a shape corresponding to the convex portion 61, and the shape of the IR grid projected on the second region 72 is also a concave portion ( 62). Accordingly, the controller 280 may determine that the first region 71 is a protruding portion compared to other regions, and may determine that the second region 72 is a recessed portion compared to other regions. . Accordingly, the controller 280 may determine the convex portion 61 corresponding to the first area 71 and the concave portion 62 corresponding to the second area 72 on the road 10 as a dangerous area. Here, the dangerous area may mean a dangerous area that may affect driving of the personal mobility 300 .

Meanwhile, the electronic device 200 according to various embodiments may adjust the sensitivity for determining whether the road conditions are abnormal, for example, a criterion for determining whether the road conditions are abnormal, and determine whether the road conditions are abnormal based on the adjusted sensitivity. can

As an embodiment, the electronic device 200 may adjust sensitivity for determining whether the road condition is abnormal based on the driving history of the personal mobility 300 . For example, when passing through a dangerous area, the electronic device 200 may adjust the sensitivity for determining whether the road condition is abnormal based on the frequency of reducing the speed of the personal mobility 300, the deceleration distance, and the reduced speed. there is.

In another embodiment, when the electronic device 200 passes through a dangerous area, based on a sensing value measured by the sensor module 230, the electronic device 200 may adjust sensitivity for determining whether the road conditions are abnormal. For example, when the electronic device 200 passes through a dangerous area, it detects the Z-axis movement measured by the sensor module 230 as vibration, and determines whether the road condition is abnormal based on the detected Z-axis movement. You can adjust the sensitivity of

As another embodiment, the electronic device 200 may adjust sensitivity for determining whether the road conditions are abnormal based on the performance or characteristics of the personal mobility 300 . Depending on the performance or characteristics of the personal mobility 300, since vibrations or disturbances generated when passing the same danger zone are different, the electronic device 200 determines road conditions based on the performance or characteristics of the personal mobility 300. It is possible to adjust the sensitivity for determining whether or not there is an abnormality. Here, the performance or characteristics of the personal mobility 300 may include various characteristics related to the personal mobility 300, such as a driving method of the personal mobility 300, the number of wheels, maximum speed, shock absorption performance, and braking ability.

As another embodiment, the electronic device 200 may adjust sensitivity for determining whether the road condition is abnormal based on the passenger information of the personal mobility 300 . For example, the electronic device 200 may adjust sensitivity for determining whether the road conditions are abnormal based on body information such as the height and weight of the passenger of the personal mobility 300 . As an embodiment, the electronic device 200 may increase the sensitivity as the weight of the occupant of the personal mobility 300 is heavier, and decrease the sensitivity as the weight of the occupant of the personal mobility 300 is lighter.

As another embodiment, the electronic device 200 may adjust sensitivity for determining whether the road condition is abnormal according to the speed of the personal mobility 300 . For example, the electronic device 200 may lower the sensitivity when the speed of the personal mobility 300 is slow, and increase the sensitivity when the speed of the personal mobility 300 is fast.

As another embodiment, the electronic device 200 may adjust the sensitivity of determining whether the road conditions are abnormal according to the road type and slope of the road on which the personal mobility 300 moves. For example, the electronic device 200 may increase sensitivity when the type of road surface on which the personal mobility 300 moves is not appropriate for the movement of the personal mobility 300 . In addition, the electronic device 200 may increase sensitivity when the slope of the road is high.

In this way, the electronic device 200 determines whether the road condition is abnormal based on at least one of the driving history, performance and characteristics of the personal mobility 300, the sensed value of the electronic device 200, and the occupant information. can be adjusted Accordingly, the electronic device 200 can determine whether the road conditions are abnormal with sensitivity suitable for the personal mobility 300 and the occupants on which the electronic device 200 is mounted.

The description of the above-described sensitivity adjustment is not limited thereto as an example for explanation. Accordingly, various embodiments of the above-described sensitivity adjustment may be implemented according to a combination of a plurality of embodiments as well as each embodiment.

Referring to FIG. 8 , determination of a risk area according to sensitivity adjustment of an electronic device according to various embodiments will be described.

8 is an exemplary view of risk area determination according to sensitivity control according to various embodiments of the present invention.

Referring to FIG. 8 , there may be a plurality of danger areas 81 , 82 , 83 , and 84 on the road 20 , and each of the plurality of danger areas 81 , 82 , 83 , and 84 has different concave degrees. Alternatively, it may be a risk area having a degree of convexity. In one embodiment, when the sensitivity of determining whether the road conditions are abnormal is high, the electronic device 200 determines the first danger area 811 based on an image of the IR grid 810 projected onto the road 20. ), the second danger area 812, the third danger area 813, and the fourth danger area 814 may be determined as the danger area. In another embodiment, when the sensitivity of determining whether the road conditions are abnormal is low, the electronic device 200 may determine the first danger area 821 based on an image of the IR grid 820 projected onto the road 20. ) can be judged as a risk area. Here, the area of the first danger area 821 may be smaller than that of the first danger area 811 . As described above, depending on the sensitivity setting, the risk area determination may be different even for the same road, and the degree of abnormality of the danger area or the area of the danger area may be determined differently for the same danger area (811, 821).

Again refer to FIG. 5 .

Referring to FIG. 5 , the electronic device 200 may project information on the road condition onto the road based on the determined road condition (S570).

Based on the determined road conditions, the control unit 280 of the electronic device 200 may project information on the road conditions through the projector 250 onto the road in the traveling direction of the personal mobility 300 . Here, the road condition information may include information about a dangerous area of the road.

As an embodiment, the electronic device 200 may project an image of a color that distinguishes the determined danger area from other areas on the road, or may project a flickering image on the determined danger area.

The electronic device 200 may project images of different colors according to the type of danger area. For example, the electronic device 200 may project a first color if the danger area is more convex than other areas, and project a third color if the danger area is more concave than other areas. Also, if the danger area is an obstacle, the electronic device 200 may project a third color.

The above-described image projection of the electronic device 200 on the danger area will be described in detail with reference to FIGS. 9 to 10 .

9 is an exemplary view of image projection of an electronic device according to various embodiments of the present disclosure.

Referring to FIG. 9 , the electronic device 200 may be combined with the personal mobility 300 . The projector 250 of the electronic device 200 may project an image 980 onto the road 10 in the direction in which the personal mobility 300 travels. Here, the size of the projected image 980 and the distance between the projected image 980 and the electronic device 200 may be adjusted. In addition, the projector 250 may not only project an image, but also project light forward as a headlight. Therefore, the projector 250 may project light as a headlight and an image of information related to the road together.

10 is an exemplary view of a projected image according to various embodiments of the present invention.

Referring to FIG. 10 , the projector 250 of the electronic device 200 may project an image 1080 onto the road 10 . Here, the image 1080 may include information related to the road and light as a headlight. The controller 280 may project the first image 1081 on the first area 71, which is the determined risk area on the road 10, and project the second image 1082 on the second area 72. can Here, the first image 1081 and the second image 1082 may be images having at least one of color, brightness, and flicker that are distinguished from other regions of the image 1080 . Also, the first image 1081 and the second image 1082 may have different colors. For example, the first image 1081 may be a first color corresponding to a convex area, and the second image 1082 may be a second color corresponding to a concave area. Accordingly, the occupant of the personal mobility 300 may recognize the danger areas 71 and 72 on the road 10 in the traveling direction based on the projected images 1080 , 1081 , and 1082 . In addition, the occupant can recognize that each of the danger areas 71 and 72 is a convex area and a concave area.

The electronic device 200 may notify the occupants of the personal mobility 300 of the determined risk area through various methods as well as the above-described projected image. For example, the electronic device 200 may output a notification sound informing of a danger area through a speaker (not shown) or may cause a vibration module (not shown) to vibrate.

Meanwhile, the electronic device 200 may adjust the projection distance of the projected image in response to the speed of the personal mobility 300 . This will be described later.

Again refer to FIG. 5 .

The electronic device 200 may control driving of the personal mobility 300 based on the determined road condition (S590).

The control unit 280 of the electronic device 200 may control driving of the personal mobility 300 in response to the determined risk area. For example, the electronic device 200 may control the personal mobility 300 to reduce the speed of the personal mobility 300 before passing through the determined danger zone or to avoid the danger zone and drive. For example, the controller 280 may control the personal mobility 300 by controlling at least one of the motor 310, the braking module 320, and the steering module 340 of the personal mobility 300. The module 330 may also control to control other components of the personal mobility 300 .

The electronic device 200 according to various embodiments may adjust a projection distance of an image of driving information projected on a road in response to a moving speed of the personal mobility 300 . explain this.

11 is a flowchart of projection distance adjustment according to moving speed according to various embodiments of the present invention.

Referring to FIG. 11 , the electronic device 200 may detect the moving speed of the personal mobility 300 (S1110).

The control unit 280 of the electronic device 200 may detect the moving speed of the personal mobility 300 based on the sensing value of the sensor module 240 . For example, the controller 280 may detect a moving speed of the personal mobility 300 using a Doppler shift of a GPS signal. In addition, the controller 280 may detect the moving speed of the personal mobility 300 based on the acceleration sensed by the acceleration sensor, and determine the movement of the personal mobility 300 based on the GPS signal and the moving time measured by the GPS module. You can also detect speed.

The electronic device 200 may project driving information to a distance corresponding to the detected movement speed (S1130).

The control unit 280 of the electronic device 200 may project driving information to a distance corresponding to the detected movement speed on the road in the direction of travel of the personal mobility 300 . For example, the electronic device 200 may project driving information on a road close to the personal mobility 300 when the moving speed of the personal mobility 300 is slow, and if the moving speed is high, the electronic device 200 may project driving information on a road close to the personal mobility 300 . Driving information can be projected on a long-distance road. In addition, the electronic device 200 may not project driving information when the moving speed of the personal mobility 300 exceeds a certain speed. Accordingly, the electronic device 200 may variably project driving information according to the driving speed, and may not project driving information in order not to distract the occupant's gaze when the personal mobility 300 is traveling at high speed. This will be described with reference to FIG. 12 .

12 is an exemplary view of an operation of projecting an image at a distance corresponding to a moving speed according to various embodiments of the present disclosure.

Referring to FIG. 12(a), when the speed of the personal mobility 300 is the first speed, the electronic device 200 may project an image 1210 at a distance within d1 from the personal mobility 300. there is. Here, the first speed may be a speed slower than the first reference speed for projecting an image within d1 with the personal mobility 300 .

Referring to FIG. 12(b), when the speed of the personal mobility 300 is the second speed, the electronic device 200 displays an image ( 1210) can be projected. Here, the second speed may be faster than the first reference speed for projecting an image within the personal mobility 300 and d1, and may be slower than the second reference speed for not projecting an image.

Referring to FIG. 12(c) , the electronic device 200 may not project an image 1210 when the speed of the personal mobility 300 is the third speed. Here, the third speed may be faster than the second reference speed for not projecting an image.

The description of the embodiment of projecting an image at a distance corresponding to the above-described moving speed is not limited thereto as an example for explanation. Accordingly, the above-described first reference speed, second reference speed, and distances d1 and d2 may be set in various ways according to a user's or designer's choice, and the projection distance may be set in various stages.

The electronic device 200 according to various embodiments determines a braking distance of the personal mobility 300 based on at least one of performance of the personal mobility 300 and body information of the user, and travels based on the determined braking distance. The distance at which information is projected can be adjusted.

13 is a flowchart illustrating an operation of determining a braking distance and adjusting a projection distance according to various embodiments of the present disclosure.

Referring to FIG. 13 , the electronic device 200 may determine a braking distance of the personal mobility 300 based on at least one of performance of the personal mobility 300 and body information of the user (S1310).

The controller 280 of the electronic device 200 controls movement performance such as driving performance, steering performance, and braking performance of the personal mobility 300 and physical specifications such as length, width, height, and weight of the personal mobility 300. A braking distance of the personal mobility 300 may be determined based on the performance of the personal mobility 300 . Therefore, the electronic device 200 may operate in consideration of the braking distance according to the performance of the personal mobility 300 .

In addition, the control unit 280 of the electronic device 200 determines the braking distance of the personal mobility 300 based on at least one of body information such as height and weight of at least one user riding the personal mobility 300 can do. Accordingly, the electronic device 200 may operate in consideration of a braking distance that increases in proportion to the weight of the user riding the personal mobility 300 .

Also, the control unit 280 of the electronic device 200 may determine the braking distance of the personal mobility 300 based on the aforementioned performance of the personal mobility 300 and the user's body information.

The electronic device 200 may project driving information at a distance corresponding to the determined braking distance and at a display time (S1330).

The control unit 280 of the electronic device 200 may project various information related to driving of the personal mobility 300 onto the road in consideration of the determined braking distance of the personal mobility 300 . For example, if it is determined that the determined braking distance of the personal mobility 300 is longer than the reference distance, the control unit 280 of the electronic device 200 sets the display time point earlier than the reference time point and sets the projection distance longer than the reference distance. can do. As another example, if the controller 280 of the electronic device 200 determines that the determined braking distance of the personal mobility 300 is shorter than the reference distance, the display time is slower than the reference time and the projection distance is shorter than the reference distance. can Here, various information related to the driving of the personal mobility 300 may include various information such as information on the above-described risk area, information on the driving route, driving speed, and information related to the state of the personal mobility 300.

As such, the electronic device 200 may project information related to driving of the personal mobility 300 onto the road at a projection distance corresponding to the determined braking distance and a display time point. In addition, the electronic device 200 may project information related to driving of the personal mobility 300 onto the road at a projection distance corresponding to the determined braking distance or a display time point. Therefore, the user of the personal mobility 300 can check information related to driving of the personal mobility 300 at an appropriate time, providing sufficient time for actions such as changing a route, avoiding an abnormal area, or braking.

The electronic device 200 according to various embodiments may recognize a user's gesture and perform a function or operation based on the recognized gesture. explain this.

14 is a flowchart of gesture recognition and a function execution operation according to the recognized gesture according to various embodiments of the present invention.

Referring to FIG. 14 , the electronic device 200 may sense a user's gesture based on one direction (S1410).

The control sensor module 260 of the electronic device 200 may emit electromagnetic waves in one direction and receive reflected electromagnetic waves from the gesturing hand. Accordingly, the control sensor module 260 may sense the user's gesture, and the controller 280 may recognize the user's gesture based on the sensed gesture. Here, one direction is a preset direction, and may be a direction in which a user's hand gesturing is positioned. For example, one direction may be a direction in which a hand gesturing is most likely to be located based on a value of a standard body, and a hand gesturing of a user may be located based on a numerical value input for user's body information. It may be the most likely direction. Also, one direction may be a direction in which the user's gesturing hand is scanned, such as a direction from the road surface to the user's head or from the user's head direction to the road surface direction. This will be described with reference to FIGS. 15 and 16 .

15 is an exemplary view of gesture recognition according to various embodiments of the present invention.

Referring to FIG. 15 , the control sensor module 260 of the electronic device 200 determines the possibility that the hand of the user riding the personal mobility 300 is located in one direction, for example, based on a standard body value. Electromagnetic waves 1500 may be emitted based on the center line 1550 in the highest direction. Here, the control sensor module 260 may emit electromagnetic waves 1500 radially. In addition, the control sensor module 260 may receive a reflection of the emitted electromagnetic wave 1500 on a user's hand, for example, a gesturing hand. As an example, the gesture may be a gesture of a user rubbing his or her thumb and index finger. Accordingly, the control sensor 260 may sense the gesture. In detail, the control sensor 260 may recognize the movement speed, direction, and degree of contact of a user's hand gesture.

As an embodiment, the electronic device 200 may initially determine a direction to emit the electromagnetic wave 1500 based on standard body shape data, and may emit the electromagnetic wave 1500 in the determined direction. Also, the electronic device 200 may determine a direction to emit the electromagnetic wave 1500 based on standard body shape data such as country, age, and gender, and may emit the electromagnetic wave 1500 in the determined direction.

Meanwhile, the electronic device 200 may scan the user's gesturing hand in one direction.

16 is an exemplary view of a scan operation for gesture recognition according to various embodiments of the present invention.

Referring to FIG. 16 , the electronic device 200 may emit electromagnetic waves 1500 emitted by the control sensor module 260 to sequentially move from a first position 1641 to a second position 1642 . Also, the electronic device 200 may emit the electromagnetic waves 1500 emitted by the control sensor module 260 to sequentially move from the second position 1642 to the first position 1641 . Accordingly, the control sensor module 260 transmits electromagnetic waves sequentially emitted from the first position 1641 to the second position 1641 or from the second position 1642 to the first position 1641 to the user's hand, for example. For example, a reflection of the gesturing hand may be received, and an accurate position of the user's hand may be recognized based on the received reflected wave. For example, the control sensor module 260 sequentially rotates and recognizes a location where reflected waves of emitted electromagnetic waves are the largest as the location of the user's hand. Accordingly, the electronic device 200 can recognize the exact position where the user's hand, for example, the gesturing hand is located.

See FIG. 14 again.

The electronic device 200 may adjust the sensing range to a range corresponding to the position of the sensed gesture (S1430).

The controller 280 of the electronic device 200 may adjust the sensing range to a range corresponding to the position of the sensed gesture and the position of the user's hand. For example, the controller 280 may adjust the range of the electromagnetic wave 1500 emitted by the control sensor module 260 .

This will be described with reference to FIGS. 17 to 18 .

17 to 18 are exemplary views of sensing range adjustment according to various embodiments of the present disclosure.

Referring to FIG. 17 , if the position of the sensed gesture is higher than the center line 1550 of the emitted electromagnetic wave 1500, the electronic device 200 sets the center line 1550 of the emitted electromagnetic wave 1500 as the center line 1550 of the sensed gesture. It can be adjusted in an upward direction to correspond to the position. Accordingly, the center line 1550 of the electromagnetic wave 1500 emitted by the control sensor module 260 may be adjusted to correspond to the sensed gesture, for example, the position of the user's hand.

Referring to FIG. 18 , if the position of the sensed gesture is lower than the center line 1550 of the emitted electromagnetic wave 1500, the electronic device 200 sets the center line 1550 of the emitted electromagnetic wave 1500 as the center line 1550 of the sensed gesture. It can be adjusted in the downward direction to correspond to the position. Accordingly, the center line 1550 of the electromagnetic wave 1500 emitted by the control sensor module 260 may be adjusted to correspond to the sensed gesture, for example, the position of the user's hand.

Meanwhile, for the aforementioned sensing range adjustment and gesture scan, the control sensor module 260 according to various embodiments may have a structure and configuration for changing the range of the electromagnetic wave 1500 emitted by the control sensor module 260. there is. This will be described with reference to FIGS. 19 to 20 .

19 shows the configuration of a control sensor module according to various embodiments of the present invention.

Referring to FIG. 19 , the control sensor module 260 may include a radar sensor 261 , a first rotating body 263 , a second rotating body 264 and a servo motor 265 .

The radar sensor 261 may emit electromagnetic waves and receive reflected waves according to the emitted electromagnetic waves. In addition, the radar sensor 261 may emit electromagnetic waves and receive reflected waves according to rotations of the first rotating body 263 and the second rotating body 264 .

The first rotating body 263 is connected to the radar sensor 261 and can be rotated so that directions of emission of electromagnetic waves and reception of reflected waves of the radar sensor 261 are adjusted.

The second rotating body 264 may rotate based on power transmitted from the server motor 265 and may transmit rotation to the first rotating body 263 .

The first rotating body 263 and the second rotating body 264 may be composed of one rotating body or may be composed of a plurality of rotating bodies.

The servo motor 265 may be driven under the control of the control sensor module 260 or the control unit 280 and may rotate the second rotating body 264 .

The electronic device 200 may control the rotation of the servo motor 265 to adjust the electromagnetic wave emission and reflected wave reception directions of the radar sensor 261 . Accordingly, as described above, the electronic device 200 may adjust a sensing range for sensing a gesture and perform an operation for scanning a gesture.

Meanwhile, the control sensor module 260 may adjust the electromagnetic wave emission direction and the reflected wave reception direction based on a manual input such as a user manipulation without a driving body such as the servo motor 265 .

20 is an exemplary view illustrating manual rotation of a radar sensor according to various embodiments of the present disclosure.

Referring to FIG. 20 , the control sensor module 260 may be connected to dial buttons 2040, 2041, and 2402, and may adjust the electromagnetic wave emission and reflected wave reception directions of the radar sensor 261 according to the rotation of the dial button. In addition, the dial buttons 2041 and 2042 have keys or reference numbers written thereon, and through manipulation of the written keys or reference numbers, the user can adjust the electromagnetic wave emission and reflected wave reception directions of the radar sensor 261. there is.

Referring to FIG. 20(a) , numerical values for reference keys are written on a dial button 2041. The user may rotate the dial button 2041 so that the value closest to his or her height is at the reference marker 2050, and adjust the electromagnetic wave emission and reflected wave reception directions of the radar sensor 261 to come to a position corresponding to the user's hand.

Referring to FIG. 20 (b), the reference number is written on the dial button 2041. The user rotates the dial button 2041 so that a number close to the user's height comes to the reference marker 2050 by rotating the reference number, so that the electromagnetic wave emission and reflected wave reception direction of the radar sensor 261 corresponds to the position corresponding to the user's hand. can be adjusted to come to

Referring to FIG. 20(c), a detailed operation of adjusting the radar sensor 261 using the dial buttons 2040, 2041, and 2042 will be described.

Referring to FIG. 20(c) , when the dial button 2040 rotates, the second rotating body 264 and the first rotating body 263 may rotate sequentially. In addition, the direction of electromagnetic wave emission and reflection wave reception of the radar sensor 261 may be adjusted according to the rotation of the first rotating body 263 . Accordingly, directions of emission of electromagnetic waves and reception of reflected waves of the radar sensor 261 may be adjusted according to rotation of the dial buttons 2040 , 2041 , and 2042 .

The method using the above-described servo motor 265 and the method using the dial button 2040 may be mixed. For example, after being primarily adjusted through the dial button 2040, it may be secondarily adjusted using the servo motor 265, and after being primarily adjusted through the servo motor 265, the dial button ( 2040) may be secondarily adjusted.

In addition, the electronic device 200 may further include a reset button, and when the reset button is input, the user may be guided to perform a specific gesture and recognize the user's specific gesture through user guidance such as voice guidance. In addition, the electronic device 200 may determine the central point of the user's hand according to the recognized specific gesture, and guide the above-described dial buttons 2040, 2041, and 2042 to be adjusted to correspond to the determined central point.

Through such a sensing range adjustment, the electronic device 200 may adjust a sensing range capable of accurately recognizing the gestures of each user with a different physical condition.

21 illustrates a sensing range for each user according to various embodiments of the present disclosure.

Referring to FIG. 21 , the electronic device 200 may adjust a sensing range to a range corresponding to each of a first user 2101 and a second user 2102 having different physical conditions. For example, the electronic device 200 emits a first electromagnetic wave 2161 based on a first center line 2165 as a sensing range for the first user 2101 and generates a reflected wave according to the emitted electromagnetic wave 2161. can receive The electronic device 200 may emit a second electromagnetic wave 2171 with respect to the second center line 2175 as a sensing range for the second user 2102 and receive a reflected wave according to the emitted electromagnetic wave 2171. . As such, the electronic device 200 may adjust the sensing range to a range suitable for the user's physical condition.

Meanwhile, as described above, the electronic device 200 may adjust the sensing range to a range corresponding to the position of the sensed gesture, and may also adjust the sensing range to a more accurate position by sensing additional gestures of the user.

Also, the electronic device 200 may store the adjusted sensing range together with user information, and when the user gets on board, the electronic device 200 may adjust the sensing range of the control sensor module 260 using the stored sensing range.

See FIG. 14 again.

The electronic device 200 may recognize a user's gesture within the adjusted sensing range (S1450) and may perform a function corresponding to the recognized gesture (S1470).

The electronic device 200 may recognize the user's gesture within the adjusted sensing range through the control sensor module 260 . For example, the electronic device 200 may recognize the movement according to the user's gesture, the speed of the movement, the direction of the movement, and the degree of contact according to the movement through the control sensor module 260 . In addition, the electronic device 200 may determine a function or operation corresponding to the recognized gesture and perform the determined function or operation. Here, the function or operation corresponding to the gesture may include not only the operation or function of the electronic device 200 but also the operation or function of the personal mobility 300 . This will be described with reference to FIGS. 22 to 24 .

22 and 23 are exemplary views of screen display according to gestures according to various embodiments of the present invention.

Referring to FIG. 22 , the electronic device 200 may recognize a gesture 2200 of swiping the user's palm in a left direction through the control sensor module 260 . The electronic device 200 may project the image 2210 moved to the left as a function corresponding to the recognized gesture. Accordingly, a map moved to the left than before the gesture may be displayed on the image 2210 projected by the electronic device 200 through the projector 250 .

Referring to FIG. 23 , the electronic device 200 may recognize a user's pinch-out gesture 2300 through the control sensor module 260 . The electronic device 200 may enlarge the projected image 2311 as a function corresponding to the recognized gesture. Accordingly, the electronic device 200 may project an enlarged image 2312 through the projector 250 than before the gesture. Here, the enlarged image 2312 may have a larger size than the previous image 2311 .

The electronic device 200 according to various embodiments may perform an operation or function related to driving of the personal mobility 300 as a function or operation corresponding to the recognized gesture.

24 is an exemplary diagram of a gesture for a driving function according to various embodiments of the present disclosure.

Referring to FIG. 24(a) , the electronic device 200 may recognize a gesture of spreading both palms and execute a selected menu or function with an operation corresponding to the recognized gesture. In addition, when recognizing a gesture of spreading both palms while driving, the electronic device 200 may control the personal mobility 300 to stop or decelerate. Meanwhile, the electronic device 200 may recognize the gesture of spreading both palms as a gesture for driving control of the personal mobility 300 .

Referring to FIG. 24(b) , the electronic device 200 may recognize a gesture of grasping an open palm, and may increase the driving speed of the personal mobility 300 through an operation corresponding to the recognized gesture. In addition, the electronic device 200 may increase the traveling speed of the personal mobility 300 in response to the speed of clenching a fist in a gesture of clenching an open palm. The electronic device 200 may linearly increase the driving speed of the personal mobility 300 so that the occupant of the personal mobility 300 does not lose a sense of balance.

Referring to FIG. 24(c) , the electronic device 200 may recognize a gesture of pushing one of the two hands into a fist forward, and the personal mobility 300 rotates in one direction in an operation corresponding to the recognized gesture. can be controlled to For example, the electronic device 200 may control the personal mobility 300 to rotate to the left when recognizing a gesture of sticking out a fist with the left hand, and when recognizing a gesture of sticking out a fist with the right hand, the electronic device 200 may rotate the personal mobility 300 to the right. can be controlled to rotate.

Referring to FIG. 24(d), the electronic device 200 may recognize a gesture of sticking out a thumb of a clenched fist, and transmits a direction indicator of the personal mobility 300 in one direction as an operation corresponding to the recognized gesture. can light up For example, the electronic device 200 may turn on a left direction indicator when recognizing a gesture of sticking out the thumb of a clenched hand in a left direction, and when recognizing a gesture of sticking out a thumb of a clenched hand in a right direction, the electronic device 200 may turn on a right direction indicator light. Turn indicators can be turned on.

While recognizing a gesture related to the driving function, the electronic device 200 may output a notification in the form of sound, vibration, or light when one hand of the user moves out of the sensing range, and if the gesture continues for a predetermined time or more, the personal mobility 300 You can stop driving. In addition, the electronic device 200 may stop the movement of the personal mobility 300 when both hands of the user move out of the sensing range while recognizing a gesture related to a driving function.

When recognizing a user's gesture, the electronic device 200 may output feedback according to the gesture recognition. For example, the electronic device 200 may output sound, vibration, or light as feedback according to gesture recognition. Thus, the user may recognize whether the electronic device 200 recognizes the user's gesture.

In addition, when the electronic device 200 recognizes the user's palm as a gesture recognition area while the personal mobility 300 is driving or waiting, and the control sensor module 260 recognizes the palm, a signal that gesture recognition is possible is sent. It can also be output as sound, vibration, or light.

As described above, the electronic device 200 may recognize a user's gesture and perform various functions or operations corresponding to the recognized gesture.

The electronic device 200 according to various embodiments may project information on a movement path onto a road when the personal mobility 300 is autonomously or automatically driven. Accordingly, when the occupant of the personal mobility 300 changes direction according to autonomous driving or automatic driving, it is possible to recognize the direction change in advance. This will be described with reference to FIGS. 25 to 26 .

25 to 26 are exemplary diagrams for projecting movement path information according to various embodiments of the present invention.

Referring to FIG. 25 , the electronic device 200 may project path conversion information according to a moving path of the personal mobility 300 onto the road according to the automatic driving of the personal mobility 300 . For example, when the personal mobility 300 makes a left turn 20 meters ahead according to the automatic driving of the personal mobility 300, the electronic device 200 displays information that a left turn 20 meters ahead is displayed on the road as an image 2510. can be projected with Accordingly, the occupant of the personal mobility 300 may recognize in advance that the personal mobility 300 makes a left turn 20 meters ahead.

Referring to FIG. 26 , the electronic device 200 may project a movement path of the personal mobility 300 onto the road according to the automatic driving of the personal mobility 300 . For example, the electronic device 200 may project a moving path of the personal mobility 300 on the road as an image 2610 according to the automatic driving of the personal mobility 300 . Accordingly, the occupant of the personal mobility 300 may recognize in advance a path along which the personal mobility 300 moves according to the automatic driving.

When it is difficult to project an image on the road surface, the electronic device 200 according to various embodiments may project the image on a projectable area by changing an image projection direction. For example, when it is difficult to project an image due to foreign substances or water on the road surface, the electronic device 200 may project the image onto an area such as a wall. This will be described with reference to FIG. 27 .

27 is an exemplary view of conversion of a projection direction according to various embodiments of the present disclosure.

Referring to FIG. 27 , the electronic device 200 may determine that it is difficult to project an image onto the road surface 30 when water 2700 is piling up on the road surface 30 . The electronic device 200 may search for an area for projecting an image and project an image on the searched area. For example, the electronic device 200 may search the wall 40 in front of the electronic device 200 as an area capable of projecting an image, and project the image 2710 on the wall 40. . Specifically, the electronic device 200 changes the projection direction of the projector 250 from the direction of the road surface 30 to the direction of the wall surface 40, and controls the projector 250 whose projection direction is switched to project the image 2710. can do. In addition, the electronic device 200 may change the image projection direction according to manual manipulation of the projection direction of the projector 250 or may change the image projection direction through gesture recognition. In this way, the electronic device 200 may change the projection direction of the image when it is difficult to project the image onto the road. Thus, the electronic device 200 can control the projector 250 to project an image on a projectable area.

The above-described present invention can be implemented as computer readable code on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. , and also includes those implemented in the form of a carrier wave (eg, transmission over the Internet). Also, the computer may include the controllers 180 and 280 of the electronic device. Accordingly, the above detailed description should not be construed as limiting in all respects and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (20)

projecting an infrared grid onto the road;
photographing the projected infrared grid;
determining a road condition of the road based on the photographed infrared grid; and
Based on the determined road condition, projecting information on the road condition onto the road;
The step of determining the road condition is
Recognizing an area where the shape of the grid is not maintained based on the grid shape of the captured infrared grid; and
Determining an area in which the shape of the recognized grid is not maintained as a dangerous area based on sensitivity for determining whether the road condition is abnormal,
Projecting information on the road condition onto the road
Projecting an image including at least one of a predetermined color, brightness, and flickering to distinguish the determined danger area from other areas on the road
Methods of operating electronic devices. delete delete According to claim 1,
The step of determining the road condition of the road
Determining the road condition of the road based on the performance of the mobile device on which the electronic device is mounted, a driving history of the mobile device, and body information of a user riding on the mobile device
Methods of operating electronic devices. According to claim 1,
Further comprising the step of detecting the moving speed of the electronic device,
Projecting information on the road condition onto the road
Projecting information on the road condition to a distance corresponding to the detected travel speed.
Methods of operating electronic devices. delete delete delete delete delete a projector that projects images;
a light emitting module that projects an infrared grid onto the road;
a camera photographing the projected infrared grid; and
A control unit determining road conditions of the road based on the photographed infrared grid and controlling the projector to project information on the road conditions on the road based on the determined road conditions;
The control unit
Recognizing an area where the shape of the grid is not maintained based on the grid shape of the photographed infrared grid;
Determining an area in which the shape of the recognized grid is not maintained as a dangerous area based on the sensitivity of determining whether the road condition is abnormal,
Projecting an image including at least one of preset colors, brightness, and flickering to distinguish the determined danger area from other areas on the road.
electronic device. delete delete According to claim 11,
The control unit
Determining the road condition of the road based on the performance of the mobile device on which the electronic device is mounted, a driving history of the mobile device, and body information of a user riding on the mobile device
electronic device. According to claim 11,
Further comprising a sensor module for detecting the moving speed of the electronic device,
The control unit
Controlling the projector to project information on the road condition at a distance corresponding to the detected moving speed
electronic device. delete delete delete delete delete

Images