WO2017014475A1 - Dispositif électronique et son procédé de commande - Google Patents

Dispositif électronique et son procédé de commande Download PDF

Info

Publication number
WO2017014475A1
WO2017014475A1 PCT/KR2016/007536 KR2016007536W WO2017014475A1 WO 2017014475 A1 WO2017014475 A1 WO 2017014475A1 KR 2016007536 W KR2016007536 W KR 2016007536W WO 2017014475 A1 WO2017014475 A1 WO 2017014475A1
Authority
WO
WIPO (PCT)
Prior art keywords
display area
touch
main display
electronic device
processor
Prior art date
Application number
PCT/KR2016/007536
Other languages
English (en)
Korean (ko)
Inventor
박정록
조시연
김대현
노완호
박진형
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020150168552A external-priority patent/KR20170009688A/ko
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2017014475A1 publication Critical patent/WO2017014475A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device having a touch display including a main display area and a plurality of auxiliary display areas positioned on a side of the main display area, and a control method thereof. It is about.
  • a wearable electronic device worn and operated by a user such as a smart watch
  • the wearable electronic device has a problem in that the user always has a high portability but a small touch display.
  • the present disclosure has been made to solve the above-described problem, and an object of the present disclosure is to provide a UI for inputting a character to a plurality of auxiliary display areas of a touch display, thereby allowing a user to perform text input more conveniently and intuitively.
  • An electronic device and a control method thereof are provided.
  • an electronic device includes a touch display including a main display area and a plurality of auxiliary display areas positioned on side surfaces of the main display area; And controlling the touch display to provide a UI for inputting text to the plurality of sub display areas of the touch display, and when a touch interaction for the UI is input, inputs the input characters according to the touch interaction. And a processor for controlling the touch display to provide the main display area.
  • the touch display may be integrally extended from the main display area and bent toward the first side of the main display area and integrally extended from the main display area and the first curved auxiliary display area smaller than the main display area.
  • the display device may include a second curved auxiliary display area that is bent to a second side of the display area and smaller than the main display area.
  • the UI may include a plurality of UI elements, and each of the plurality of UI elements may correspond to at least one character.
  • the processor may provide a UI element corresponding to a collection among the plurality of UI elements to the first curved auxiliary display area, and provide a UI element corresponding to a consonant among the plurality of UI elements in the second curved auxiliary display area.
  • the touch display can be controlled to provide to.
  • the processor may provide a character corresponding to the touched UI element to the main display area when a user touch of one of the plurality of UI elements is detected and swipes toward the main display area. To control the touch display.
  • the processor may delete a character provided in the main display area when a user touch is swiped in a predetermined direction in the main display area.
  • the processor may execute a specific application according to the user touch when a user touch for simultaneously swiping the first curved auxiliary display area and the second curved auxiliary display area is detected.
  • the processor may execute a camera application according to the user touch when a user touch for simultaneously swiping the first curved auxiliary display area and the second curved auxiliary display area in a left and right direction is detected.
  • the processor may detect a direction of the electronic device while the camera application is running and display a live view image on at least a portion of the main display area and the plurality of auxiliary display areas based on the detected direction of the electronic device.
  • the touch display may be controlled to display the touch screen.
  • a control method of an electronic device having a touch display including a main display area and a plurality of auxiliary display areas located on the side of the main display area, Providing a UI for text input in the plurality of auxiliary display regions of the touch display; And when a touch interaction with respect to the UI is input, providing a character input according to the touch interaction to the main display area of the touch display.
  • the touch display may be integrally extended from the main display area and bent toward the first side of the main display area and integrally extended from the main display area and the first curved auxiliary display area smaller than the main display area.
  • the display device may include a second curved auxiliary display area bent to a second side of the display area and smaller than the main display area.
  • the UI may include a plurality of UI elements, and each of the plurality of UI elements may correspond to at least one character.
  • the providing of the UI may include providing a UI element corresponding to a collection among the plurality of UI elements to the first curved auxiliary display area, and displaying a UI element corresponding to a consonant among the plurality of UI elements. It may be provided to the curved auxiliary display area.
  • the main display area when a user touch of one of the plurality of UI elements is swiped and then swipe toward the main display area is detected, a character corresponding to the touched UI element is detected.
  • the main display area may be provided.
  • the method may further include deleting a character provided in the main display area when a user touch is swiped in a predetermined direction in the main display area.
  • the method may further include executing a specific application according to the user touch when a user touch for simultaneously swiping the first curved auxiliary display area and the second curved auxiliary display area is detected.
  • the executing may include executing a camera application according to the user touch when a user touch for simultaneously swiping the first curved auxiliary display area and the second curved auxiliary display area in a left and right direction is detected.
  • the method may further include detecting a direction of the electronic device while the camera application is running; The method may further include displaying a live view image on at least a portion of the main display area and the plurality of auxiliary display areas based on the detected direction of the electronic device.
  • a user may more conveniently input text and execute various functions by using the auxiliary display area of the electronic device.
  • FIG. 1 is a block diagram schematically illustrating a configuration of an electronic device according to an embodiment of the present disclosure
  • FIGS. 2A-2C illustrate types of touch displays, according to various embodiments of the present disclosure
  • FIG. 3 is a block diagram illustrating a configuration of an electronic device in detail according to an embodiment of the present disclosure
  • FIG. 4 is a diagram illustrating an example of a software configuration of an electronic device according to an embodiment of the present disclosure
  • 5A to 10 are diagrams for describing an embodiment of performing various functions using an auxiliary display area of an electronic device according to various embodiments of the present disclosure
  • FIG. 11 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.
  • first and second may be used to describe various components, but the components should not be limited by the terms. The terms are only used to distinguish one component from another.
  • the module or unit performs at least one function or operation, and may be implemented by hardware or software, or a combination of hardware and software.
  • the plurality of modules or the plurality of units may be integrated into at least one module except for the modules or units that need to be implemented with specific hardware, and are implemented as at least one processor (not shown). Can be.
  • the UI may include at least one of a configuration for receiving a user interaction and a configuration indicating notification information.
  • the UI may include a UI element, and the UI element may include elements for providing notification information as well as elements capable of interacting with the user and allowing feedback such as visual, audio, and olfactory according to a user input.
  • the UI element may be expressed in the form of at least one of an image, a text, and a video, or if there is an area in which the above information is not displayed but feedback is possible according to a user input, the area may be referred to as a UI element.
  • the electronic device 100 includes a touch display 110 and a processor 120.
  • the electronic device 100 of FIG. 1 may be a wearable device such as a smart watch, but this is only an example, and may be a TV, a PC, a laptop PC, a mobile phone, a tablet PC, a PDA, an MP3 player, a kiosk, an electronic photo frame, and the like. It may be implemented in various types of devices, such as a table display device.
  • the mobile terminal may be referred to as a portable terminal.
  • the touch display 110 outputs image data and receives a user touch.
  • the touch display 110 may include a main display area and a plurality of auxiliary display areas.
  • the main display area may mean an area disposed on the front surface of the electronic device 100, and the auxiliary display area may be disposed on the side of the main display area.
  • the main display area and the sub display area may be interpreted in different meanings. For example, a relatively large area of the two areas may be referred to as a main display area, and a small area may be defined as an auxiliary display area.
  • the touch display 110 may be implemented as a flexible display, and includes a main display area provided on the front surface of the electronic device 100 and a first curved surface extending from the main display area and bent to the first side of the electronic device 100.
  • the display device may be configured as a second curved auxiliary display area extending from the auxiliary display area and the main display area and bent to the second side surface of the electronic device 100.
  • the first auxiliary display area and the second auxiliary display area may include only a portion which is bent and fixed in the side direction of the electronic device 100, but this is only an example and may correspond to the side direction of the electronic device 100. It may include not only a bent and fixed portion but also a flat portion located in front of the electronic device 100.
  • an area of each of the sub display areas may be smaller than that of the main display area.
  • the plurality of curved display areas may form different surfaces from the main display area.
  • the plurality of auxiliary display areas may include a right side surface, among the surfaces forming the appearance of the electronic device 100. It may be disposed on different surfaces such as a left side surface, an upper side surface, a lower side surface, and the like.
  • the surface including the main display area and the surface including the at least one auxiliary display area may be fixed to form an obtuse angle.
  • the shape, location, and number of auxiliary display areas may be variously implemented according to embodiments.
  • the auxiliary display area when the auxiliary display area is located on the side surface of the surfaces forming the appearance of the electronic device 100, the auxiliary display area may be referred to as an edge area. Also, the auxiliary display area may be modified in various terms, such as a sub area and a side area, according to an exemplary embodiment.
  • FIGS. 2A to 2C are diagrams illustrating examples of external appearance of an electronic device 100 including a touch display 110 divided into a main display area 111 and two sub display areas 113-1 and 113-2. to be.
  • the main display area 111 is disposed on the front surface, and the auxiliary display areas 113-1 and 113-2 are disposed on the upper side and the lower side, respectively.
  • the main display area 111 and the sub display areas 113-1 and 113-2 are divided by boundary lines 115-1 and 115-2.
  • each of the auxiliary display regions 113-1 and 113-2 may be disposed at an obtuse angle with the main display region 111 so as to be viewed from the front direction.
  • the curved auxiliary display area is only an example, and the auxiliary display area may be implemented in other forms. For example, according to FIG.
  • the main display area 111 and the plurality of auxiliary display areas 113-1 and 113-2 may be disposed on one surface. That is, one display may be divided into a main display area 111 and two sub display areas 113-1 and 113-2 through the boundary surfaces 115-1 and 115-2.
  • the first auxiliary display area 113-1 of the plurality of auxiliary display areas 113-1 and 113-2 may be disposed on the same plane as the main display area 111, and the second The auxiliary display area 113-2 may be bent to the lower side of the main display area 111.
  • the touch display 110 displays a UI for inputting characters in the auxiliary display areas 113-1 and 113-2.
  • the UI may include a plurality of UI elements, and each of the plurality of UI elements may correspond to at least one character.
  • the processor 120 controls the overall operation of the electronic device 100 using the main display area and the plurality of auxiliary display areas of the touch display 100.
  • the processor 120 may provide the touch display 110 to provide a UI for text input to the plurality of auxiliary display areas 113-1 and 113-2 of the touch display 110. Can be controlled.
  • the processor 120 may provide various types of UIs according to a type of language or a text input method. This will be described later.
  • the processor 120 provides a UI element corresponding to a collection among a plurality of UI elements to the first curved auxiliary display area 113-1, and provides a UI element corresponding to a consonant among the plurality of UI elements to a second curved auxiliary surface.
  • the touch display 110 may be controlled to provide the display area 113-2.
  • the processor 120 touches the character corresponding to the touched UI element 110.
  • the touch display 110 may be controlled to provide the main display area 111 of FIG. This will be described later in detail with reference to the drawings.
  • the processor 120 may delete the input character.
  • the processor 120 may perform a space bar function.
  • the processor 120 may execute a specific application according to the user touch. For example, when a user touch for simultaneously swiping the first curved auxiliary display area 113-1 and the second curved auxiliary display area 113-2 in the right direction is detected, the processor 120 according to the user touch. You can run the camera application.
  • the processor 120 detects a direction of the electronic device 100 while the camera application is executed and based on the detected direction of the electronic device 100, the main display area 111 and the plurality of auxiliary display areas 113.
  • the touch display 110 may be controlled to display a live view image on at least some of the -1,113-2.
  • the electronic device 200 may include a memory 210, a GPS chip 220, a communication unit 230, a video processor 240, an audio processor 250, a button 260, a microphone unit 270,
  • the camera 280 includes a speaker 290, a touch display 300, a sensor 310, and a processor 320.
  • the memory 210 may store various programs and data necessary for the operation of the electronic device 200. Specifically, the memory 210 may store programs, data, and the like for configuring various screens to be displayed in the main display area and the sub display area.
  • the processor 320 displays contents in each of the main display area and the sub display area of the touch display 300 using the programs and data stored in the memory 210. In other words, the processor 320 may control the touch display 300 to display content. In particular, the processor 320 may display a UI for text input on the auxiliary display area of the touch display 300. In addition, when a user touch is made to a boundary line corresponding to a main display area, an auxiliary display area, and a boundary therebetween, the processor 320 performs a control operation corresponding to the touch.
  • the GPS chip 220 is a component for receiving a GPS signal from a global positioning system (GPS) satellite and calculating a current position of the electronic device 200.
  • the processor 320 may calculate the user location using the GPS chip 220 when using a navigation program or when the current location of the user is required.
  • GPS global positioning system
  • the communication unit 230 is a component that performs communication with various types of external devices according to various types of communication methods.
  • the communication unit 230 includes a Wi-Fi chip 231, a Bluetooth chip 232, a wireless communication chip 233, an NFC chip 234, and the like.
  • the processor 320 communicates with various external devices using the communication unit 230.
  • the Wi-Fi chip 231 and the Bluetooth chip 232 communicate with each other by WiFi and Bluetooth.
  • various connection information such as SSID and session key may be transmitted and received first, and then various communication information may be transmitted and received using the same.
  • the wireless communication chip 233 refers to a chip that performs communication according to various communication standards such as IEEE, zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evoloution (LTE), and the like.
  • the NFC chip 234 refers to a chip operating in a near field communication (NFC) scheme using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860-960 MHz, 2.45 GHz, and the like.
  • NFC near field communication
  • the video processor 240 is a component for processing video data included in content received through the communication unit 230 or content stored in the memory 210.
  • the video processor 240 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on the video data.
  • the audio processor 250 is a component for processing audio data included in content received through the communication unit 230 or content stored in the memory 210.
  • the audio processor 250 may perform various processing such as decoding, amplification, noise filtering, and the like on the audio data.
  • the processor 320 may drive the video processor 240 and the audio processor 250 to play the content.
  • the touch display 300 may display an image frame generated by the video processor 340 in at least one of the main display area and the sub display area.
  • the speaker 290 outputs audio data generated by the audio processor 250.
  • the button 260 may be various types of buttons such as a mechanical button, a touch pad, a wheel, and the like formed in an arbitrary area such as a front part, a side part, a back part, etc. of the main body of the electronic device 200.
  • the microphone 270 is a component for receiving a user voice or other sound and converting the same into audio data.
  • the processor 320 may use a user's voice input through the microphone unit 270 in a call process or convert the user's voice into audio data and store it in the memory 210.
  • the camera 280 is a component for capturing a still image or a moving image under the control of a user.
  • the camera 280 may be implemented in plurality, such as a front camera, a rear camera, and a side camera. As described above, the camera 280 may be used as a means for acquiring an image of the user in an embodiment for tracking the gaze of the user.
  • the processor 320 may perform a control operation according to a user voice input through the microphone 270 or a user motion recognized by the camera 280. That is, the electronic device 200 may operate in a motion control mode or a voice control mode. When operating in the motion control mode, the processor 320 activates the camera 280 to photograph the user, tracks the user's motion change, and performs a control operation corresponding thereto. When operating in the voice control mode, the processor 320 may operate in a voice recognition mode that analyzes a user voice input through the microphone 270 and performs a control operation according to the analyzed user voice.
  • a voice recognition technology or a motion recognition technology may be used in the above-described various embodiments. For example, when a user takes a motion as if selecting an object displayed on a home screen or pronounces a voice command corresponding to the object, it may be determined that the object is selected and a control operation matched to the object may be performed. .
  • the touch display 300 may be divided into a main area and a plurality of sub display areas.
  • the touch display 300 may be implemented as various types of displays such as a liquid crystal display (LCD), an organic light emitting diodes (OLED) display, a plasma display panel (PDP), and the like.
  • the touch display 300 may also include a driving circuit, a backlight unit, and the like, which may be implemented in the form of an a-si TFT, a low temperature poly silicon (LTPS) TFT, an organic TFT (OTFT), or the like.
  • the touch display 300 may be implemented as a touch screen in combination with a touch sensor included in the sensor 310.
  • the touch sensor may include at least one of a touch panel and a pen recognition panel.
  • the touch panel may detect a user's finger gesture input and output a touch event value corresponding to the detected touch signal.
  • the touch panel may be mounted under both the main sub region and the sub display area of the touch display 300 or may be mounted only under the sub display area of the touch display 300.
  • the touch panel detects a user's finger gesture input may be a capacitive type or a pressure sensitive type.
  • the electrostatic type is a method of calculating touch coordinates by sensing fine electricity generated by a user's human body.
  • the pressure-sensitive type includes two electrode plates embedded in the touch panel and calculates touch coordinates by detecting that the upper and lower plates of the touched point are in contact with each other so that current flows.
  • the pen recognition panel detects a user's pen gesture input according to the operation of the user's touch pen (eg, a stylus pen or a digitizer pen), and outputs a pen proximity event value or a pen touch event value. can do.
  • the pen recognition panel may be mounted under at least one of the main area and the plurality of auxiliary display areas of the touch display 300.
  • the pen recognition panel may be implemented by, for example, an EMR method, and detect a touch or a proximity input according to a change in the intensity of the electromagnetic field due to the proximity or touch of the pen.
  • the pen recognition panel includes an electromagnetic induction coil sensor (not shown) having a grid structure and an electronic signal processor (not shown) that sequentially provides an AC signal having a predetermined frequency to each loop coil of the electromagnetic induction coil sensor.
  • an electromagnetic induction coil sensor (not shown) having a grid structure
  • an electronic signal processor (not shown) that sequentially provides an AC signal having a predetermined frequency to each loop coil of the electromagnetic induction coil sensor.
  • the electronic device 200 has been described as being implemented as a flexible display including a main display area and a plurality of auxiliary display areas.
  • this is only an example and may include a plurality of general displays.
  • the main display area and the plurality of sub display areas can be configured using the?.
  • a plurality of displays may be connected to each other to form a curved display.
  • the sensor 310 detects various states and user interactions of the electronic device 200.
  • the sensor 310 may detect a holding state in which the user is holding the electronic device 200.
  • the electronic device 200 may be rotated or tilted in various directions.
  • the sensor 310 may detect a tilt of the electronic device 100 held by the user based on the rotational movement or the gravity direction using at least one of various sensors such as a geomagnetic sensor, a gyro sensor, an acceleration sensor, and the like. Can be.
  • the sensor 310 may detect the touch area and the grip pressure distribution of the auxiliary display area.
  • the processor 320 includes a RAM 321, a ROM 322, a CPU 323, a graphics processing unit (GPU) 324, and a bus 325.
  • the RAM 321, the ROM 322, the CPU 323, and the Graphic Processing Unit (GPU) 324 may be connected to each other through the bus 325.
  • the CPU 323 accesses the memory 210 and performs booting using an operating system stored in the memory 210. In addition, various operations are performed using various programs, contents, data, etc. stored in the memory 210.
  • the ROM 322 stores a command set for system booting.
  • the CPU 323 copies the O / S stored in the memory 210 to the RAM 321 according to the command stored in the ROM 322, and executes the O / S to execute the system.
  • Boot up When the booting is completed, the CPU 323 copies various programs stored in the memory 210 to the RAM 321 and executes the programs copied to the RAM 321 to perform various operations.
  • the GPU 324 displays a UI screen in an activated area of the main area and the auxiliary display area.
  • the GPU 324 may generate a screen including various objects such as an icon, an image, and a text by using a calculator (not shown) and a renderer (not shown).
  • the calculator calculates attribute values such as coordinates, shapes, sizes, and colors for displaying the objects according to the layout of the screen.
  • the renderer generates screens of various layouts including objects based on the attribute values calculated by the calculator.
  • the screen generated by the renderer is provided to the touch display 300 and displayed on the main area and the sub display area, respectively.
  • various external input ports for connecting to a USB port through which a USB connector may be connected in the electronic device 200, or various external terminals such as a headset, a mouse, and a LAN may be used.
  • it may further include a DMB chip, various sensors, etc. to receive and process a Digital Multimedia Broadcasting (DMB) signal.
  • DMB Digital Multimedia Broadcasting
  • the memory 210 may store software including an OS 410, a kernel 420, middleware 430, an application 440, and the like.
  • An operating system (OS) 410 performs a function of controlling and managing overall operations of hardware.
  • the OS 410 is a layer that performs basic functions such as hardware management, memory, and security.
  • the kernel 420 serves as a path for transmitting various signals including the touch signal sensed by the sensor 310 to the middleware 430.
  • the middleware 430 includes various software modules for controlling the operation of the electronic device 200.
  • the middleware 430 includes an X11 module 430-1, an APP manager 430-2, a connection manager 430-3, a security module 430-4, a system manager 430-5,
  • the multimedia framework 430-6, the UI framework 430-7, the window manager 430-8, and the handwriting recognition module 430-9 are included.
  • the X11 module 430-1 is a module that receives various event signals from various hardware included in the electronic device 200.
  • the event may be variously set, such as an event in which a user gesture is detected, an event in which a system alarm occurs, an event in which a specific program is executed or terminated, and the like.
  • the APP manager 430-2 is a module that manages execution states of various applications 440 installed in the memory 210. When the application execution event is detected from the X11 module 430-1, the APP manager 430-2 calls and executes an application corresponding to the event.
  • connection manager 430-3 is a module for supporting a wired or wireless network connection.
  • the connection manager 430-3 may include various detailed modules such as a DNET module and a UPnP module.
  • the security module 430-4 is a module supporting certification, request permission, secure storage, and the like for hardware.
  • the system manager 430-5 monitors the state of each component in the electronic device 200, and provides the monitoring result to other modules. For example, when the battery level is low, or when an error occurs, when the communication connection state is lost, the system manager 430-5 sends the monitoring result to the main UI framework 430-7 or the subUI frame. Provided to the walk (430-9) can output a notification message or notification sound.
  • the multimedia framework 430-6 is a module for playing multimedia content stored in the electronic device 200 or provided from an external source.
  • the multimedia framework 430-6 may include a player module, a camcorder module, a sound processing module, and the like. Accordingly, an operation of reproducing and reproducing a screen and sound by reproducing various multimedia contents may be performed.
  • the main UI framework 430-7 is a module for providing various UIs to be displayed on the main display area of the touch display 300, and the sub UI framework 430-9 is used to display various UIs to be displayed on the auxiliary display area. Module to provide.
  • the main UI framework 430-7 and the sub UI framework 430-9 include an image compositor module constituting various objects, a coordinate synthesizer for calculating coordinates at which the object is to be displayed, and coordinates for calculating the configured object.
  • a 2D / 3D UI toolkit that provides a tool for constructing a UI in 2D or 3D form, and a rendering module for rendering.
  • the window manager 430-8 may detect a touch event or other input event using a user's body or a pen. When such an event is detected, the window manager 430-8 transmits an event signal to the main UI framework 430-7 or the sub UI framework 430-9 to perform an operation corresponding to the event.
  • a pitch module, a roll angle, a yaw angle, or the like is calculated based on a writing module for drawing a line according to the drag trajectory or a sensor value detected by the sensor 310.
  • Various program modules may be stored, such as an angle calculation module.
  • the application module 440 includes applications 440-1 through 440-n to support various functions.
  • it may include a program module for providing various services such as a navigation program module, a game module, an e-book module, a calendar module, an alarm management module, and the like.
  • These applications may be installed by default, or may be arbitrarily installed and used by a user during use.
  • the CPU 423 may execute an application corresponding to the selected object by using the application module 440.
  • the memory 210 includes a sensing module for analyzing signals sensed by various sensors, a messaging module such as a messenger program, a short message service (SMS) & multimedia message service (MMS) program, an e-mail program, and a phone information collector.
  • SMS short message service
  • MMS multimedia message service
  • e-mail e-mail
  • phone information collector e.g., phone information collector
  • Various programs may be additionally provided, such as a program module, a VoIP module, a web browser module, and the like.
  • the electronic device 200 may be implemented as various types of devices such as a mobile phone, a tablet PC, a laptop PC, a PDA, an MP3 player, an electronic picture frame device, a TV, a PC, a kiosk, and the like. Therefore, the configuration described with reference to FIGS. 3 and 4 may be variously modified according to the type of the electronic device 200.
  • the processor 320 may control the touch display 300 to provide a UI for text input in the plurality of auxiliary display areas.
  • the processor 320 may display FIG. 5B.
  • the touch display 300 may be controlled to provide a UI for text input in the plurality of auxiliary display regions 520-1 and 520-2.
  • the situation in which the character input is required is described as the situation in which the character input window 505 is displayed.
  • this is only an example and may be determined as a situation in which the character input is required in other situations.
  • various situations such as a situation for entering a phone number and a situation for entering a text message, may be determined as a situation in which text input is required.
  • the UI for text input includes a plurality of UI elements as shown in FIG. 5B, and each UI element may correspond to at least one letter, symbol, or function.
  • the first UI element may correspond to “.”, “,”, “?", “!
  • the second UI element may correspond to "a", “b", and “c”.
  • the third UI element may correspond to “d”, “e” and “f”
  • the fourth UI element may correspond to “g”, “h” and “i”
  • the fifth UI element May correspond to “j”, “k” and “l”
  • the sixth UI element may correspond to “m”, “n” and “o”
  • the seventh UI element may correspond to “p”, ” q “,” r “, and” s ".
  • the eighth UI element may correspond to" t “,” u “, and” v.
  • the ninth UI element may correspond to" w “and” x. " , “y”, “z”, and the tenth UI element may correspond to the "enter” function.
  • the character array shown in Figure 5b is only one embodiment, other character array can be applied to the present invention.
  • the processor 320 may input a character according to a user touch input through the UI displayed on the plurality of auxiliary display areas 520-1 and 520-2.
  • the processor 320 may detect the user's touch. A character corresponding to the touched UI element may be input.
  • the processor 320 may input characters through touch input and swipe input.
  • the processor 320 may display the fourth UI through the sensor 310 as illustrated in FIG. 5C. A user's touch on an element can be detected.
  • the processor 320 may display FIG. 5E. As shown in FIG. 2, "g" may be input to the text input window 505. In this case, when the user touches the fourth UI element once, the processor 320 may control the touch display 300 to provide an indicator indicating that "g" is selected for the fourth UI element.
  • the processor 320 may detect the user's touch. "h” may be input to the character input window 505. In this case, when the user touches the fourth UI element once, the processor 320 may control the touch display 300 to provide an indicator indicating that "h" is selected for the fourth UI element.
  • the processor 320 may detect a user touch. "i" may be input to the text input window 505. In this case, when the user touches the fourth UI element once, the processor 320 may control the touch display 300 to provide an indicator indicating that "i" is selected for the fourth UI element.
  • the user may input text with one hand through the touch input and the swipe input, and the text input may be performed without covering the main display area 510. It can also have an entertaining element that bounces the abacus through the swipe input.
  • the processor 320 may perform various character input functions according to a user touch input to the main display area while the UI for text input is displayed on the plurality of auxiliary display areas.
  • a swipe input in a left direction after touching an area of the main display area 610 is performed. If 630 is detected, the processor 320 may delete the most recently input character. At this time, if a swipe input is detected more than a predetermined number of times, the processor 320 may delete all the input characters.
  • a swipe input 640 in a right direction after touching an area of the main display area 610 is performed. If detected, the processor 320 may perform a space function corresponding to a space bar.
  • the delete function and the space bar function have been described, but this is only an example, and various functions such as a copy function and a cut function may be performed according to a user input input to the main display area. .
  • the UI for text input is described as being English. However, this is only an example, and the UI for text input may be another language. For example, as illustrated in FIGS. 7A and 7B, a UI for inputting Korean may be provided.
  • FIG. 7A displays a UI for inputting Korean in a narrative manner.
  • a UI element for inputting a consonant in Korean is provided with a UI element for inputting a consonant in the first auxiliary display area 720-1 and a UI for inputting a vowel in the second auxiliary display area 720-2.
  • the element can be placed.
  • a UI for Korean input in a celestial manner is displayed.
  • auxiliary display areas may display a UI for inserting various texts such as numbers and special symbols instead of characters.
  • the processor 320 may execute a preset application according to the user touch.
  • the processor 320 may execute the camera application and control the touch display 810 to display a live view image as shown in FIG. 8B.
  • the processor 320 may execute another application according to the position of the sub display area where the swipe input is detected or the direction of the swipe input.
  • the processor displays the processor.
  • 320 may execute the telephone application.
  • the processor 320 may execute a schedule application.
  • the processor 320 may execute a memo application.
  • the type of the user touch for quick application execution is described as a swipe input.
  • this is only an example and may be applied to another touch such as a long press input for touching the auxiliary display area for a predetermined time.
  • the application executed according to the user touch may be set at the time of manufacture, but this is only an embodiment and may be set by the user.
  • the processor 320 detects the direction of the electronic device 200 through the sensor 310 while the camera application is running, and at least one of the main display area and the plurality of auxiliary display areas based on the detected direction of the electronic device.
  • the touch display 300 may be controlled to display a live view image on a portion. In an embodiment of the present disclosure, as shown in FIG. 9A, the touch display 300 divides the main display area into two, and thus, the first main display area 910-1 and the second main display area 910-2. ), A first auxiliary display area 920-1 and a second auxiliary display area 920-2.
  • the processor 320 may detect the direction of the electronic device 200. In this case, the processor 320 may detect the direction of the electronic device 200 through the motion sensor, but this is only an example. The processor 320 captures a user's eye by using the camera 280 to capture the user's gaze. By detecting, the direction of the electronic device 200 may be detected.
  • the processor 320 may control the touch display 300 to display a live view image on at least a portion of the touch display 300 according to the orientation of the electronic device 200.
  • the processor 320 displays a live view image on the first main display area 910-1 and the second main display area 910-2, as shown in FIG. 9B.
  • the touch display 300 may be controlled.
  • the processor 320 may display the first main display area 910-1.
  • the touch display 300 to display the live view image on the first auxiliary display area 920-1.
  • the processor 320 may include the second main display area 910-2 and the second auxiliary display area.
  • the touch display 300 may be controlled to display a live view image at 920-2. That is, the processor 320 may control the touch display 300 to detect a change in posture of the electronic device 200 and to display the live view image by moving another area of the touch display 300.
  • the live view image is moved according to the direction of the electronic device 200.
  • images for example, a web page image and a message window screen
  • Etc. may move along the direction of the electronic device 200.
  • the user can more conveniently check the live view image and take a picture.
  • the processor 320 may display a plurality of live view images captured by the plurality of cameras in the plurality of main display areas. Can be controlled. In detail, as illustrated in FIG. 10, the processor 320 displays a live view image captured by the first camera in the first main display area 1010-1, and the second main display area 1010-2. ), The touch display 300 may be controlled to display a live view image captured by the second camera.
  • the first auxiliary display area 1020-1 may display a UI for capturing a live view image displayed on the first camera
  • the second auxiliary display area 1020-2 may be displayed on the second camera.
  • a UI for capturing a live view image may be displayed.
  • the main display area 1010 of the electronic device As described above, by dividing the main display area 1010 of the electronic device into a plurality of areas and capturing a plurality of live view images, it is possible to take a picture in more various environments.
  • the electronic device 100 may include a touch display including a main display area and a plurality of auxiliary display areas positioned on side surfaces of the main display area.
  • the electronic device 100 provides a UI for text input on a plurality of auxiliary display areas of the touch display in operation S1110.
  • the UI for text input includes a plurality of UI elements, and each of the plurality of UI elements may correspond to at least one letter, number, symbol, or special character.
  • the electronic device 100 determines whether a touch interaction is input through the UI.
  • the touch interaction may be a swipe interaction that touches one of the plurality of UI elements and swipes toward the main display area.
  • the electronic device 100 When a touch interaction is input through the UI (S1120-Y), the electronic device 100 inputs a character according to the touch interaction (S1130). That is, the electronic device 100 may provide the input text according to the touch interaction to the main display area 111 of the touch display 110.
  • a user may more conveniently input text using the auxiliary display area of the electronic device 100 without disturbing viewing of the main display area.
  • control method of the electronic device may be implemented as a program and provided to a display device or an input device.
  • the program including the control method of the display apparatus may be stored and provided in a non-transitory computer readable medium.
  • the non-transitory readable medium refers to a medium that stores data semi-permanently and is readable by a device, not a medium storing data for a short time such as a register, a cache, a memory, and the like.
  • a non-transitory readable medium such as a CD, a DVD, a hard disk, a Blu-ray disk, a USB, a memory card, a ROM, or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne un dispositif électronique et un procédé de commande associé. Le dispositif électronique de la présente invention comprend : un dispositif d'affichage tactile comprenant une zone d'affichage principale et une pluralité de zones d'affichage auxiliaires positionnées au niveau d'une surface latérale de la zone d'affichage principale; et un processeur pour commander l'affichage tactile de telle sorte qu'une Interface Utilisateur (UI) pour saisie de texte est prévue dans la pluralité de zones d'affichage auxiliaires de l'écran tactile, et pour commander l'affichage tactile de telle sorte qu'un texte entré selon une interaction tactile est prévu dans la zone d'affichage principale de l'écran tactile, lorsque l'interaction tactile avec l'UI est entrée.
PCT/KR2016/007536 2015-07-17 2016-07-12 Dispositif électronique et son procédé de commande WO2017014475A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201562193806P 2015-07-17 2015-07-17
US62/193,806 2015-07-17
KR1020150168552A KR20170009688A (ko) 2015-07-17 2015-11-30 전자 장치 및 이의 제어 방법
KR10-2015-0168552 2015-11-30

Publications (1)

Publication Number Publication Date
WO2017014475A1 true WO2017014475A1 (fr) 2017-01-26

Family

ID=57834061

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/007536 WO2017014475A1 (fr) 2015-07-17 2016-07-12 Dispositif électronique et son procédé de commande

Country Status (1)

Country Link
WO (1) WO2017014475A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018182287A1 (fr) * 2017-03-28 2018-10-04 삼성전자 주식회사 Procédé de commande à faible puissance d'un dispositif d'affichage et dispositif électronique pour la mise en oeuvre de ce procédé

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130285927A1 (en) * 2012-04-30 2013-10-31 Research In Motion Limited Touchscreen keyboard with correction of previously input text
US20130300668A1 (en) * 2012-01-17 2013-11-14 Microsoft Corporation Grip-Based Device Adaptations
KR20140106285A (ko) * 2013-02-26 2014-09-03 삼성디스플레이 주식회사 휴대용 표시 장치
US20150121285A1 (en) * 2013-10-24 2015-04-30 Fleksy, Inc. User interface for text input and virtual keyboard manipulation
KR101515620B1 (ko) * 2014-12-29 2015-05-04 삼성전자주식회사 사용자 단말 장치 및 그의 제어 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130300668A1 (en) * 2012-01-17 2013-11-14 Microsoft Corporation Grip-Based Device Adaptations
US20130285927A1 (en) * 2012-04-30 2013-10-31 Research In Motion Limited Touchscreen keyboard with correction of previously input text
KR20140106285A (ko) * 2013-02-26 2014-09-03 삼성디스플레이 주식회사 휴대용 표시 장치
US20150121285A1 (en) * 2013-10-24 2015-04-30 Fleksy, Inc. User interface for text input and virtual keyboard manipulation
KR101515620B1 (ko) * 2014-12-29 2015-05-04 삼성전자주식회사 사용자 단말 장치 및 그의 제어 방법

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018182287A1 (fr) * 2017-03-28 2018-10-04 삼성전자 주식회사 Procédé de commande à faible puissance d'un dispositif d'affichage et dispositif électronique pour la mise en oeuvre de ce procédé
CN110476138A (zh) * 2017-03-28 2019-11-19 三星电子株式会社 显示器的低功率驱动方法和用于执行该方法的电子设备
US11106307B2 (en) 2017-03-28 2021-08-31 Samsung Electronics Co., Ltd. Method for low power driving of display and electronic device for performing same
CN110476138B (zh) * 2017-03-28 2024-02-13 三星电子株式会社 显示器的低功率驱动方法和用于执行该方法的电子设备

Similar Documents

Publication Publication Date Title
US11360728B2 (en) Head mounted display apparatus and method for displaying a content
US10698564B2 (en) User terminal device and displaying method thereof
US9696899B2 (en) Multi display apparatus and multi display method
KR102129374B1 (ko) 사용자 인터페이스 제공 방법 및 기계로 읽을 수 있는 저장 매체 및 휴대 단말
KR102264444B1 (ko) 전자 장치에서 기능 실행 방법 및 장치
WO2014017722A1 (fr) Dispositif d'affichage permettant une exécution de multiples applications et son procédé de commande
KR102318610B1 (ko) 모바일 디바이스 및 모바일 디바이스의 디스플레이 방법
WO2014088355A1 (fr) Appareil de terminal utilisateur et son procédé de commande
US20140359493A1 (en) Method, storage medium, and electronic device for mirroring screen data
KR20160032611A (ko) 터치 입력을 이용하여 전자 장치를 제어하는 방법 및 장치
KR20160028338A (ko) 벤디드 디스플레이를 구비한 휴대 단말기의 제어 방법 및 장치
WO2014129828A1 (fr) Procédé de fourniture d'un retour d'informations en réponse à une entrée d'un utilisateur et terminal le mettant en œuvre
KR102308201B1 (ko) 사용자 단말 장치 및 그 제어 방법
WO2018194275A1 (fr) Appareil apte à détecter un toucher et à détecter une pression de toucher, et son procédé de commande
WO2014129787A1 (fr) Dispositif électronique à interface utilisateur tactile et son procédé de fonctionnement
WO2018004140A1 (fr) Dispositif électronique et son procédé de fonctionnement
KR101559091B1 (ko) 벤디드 디스플레이를 구비한 휴대 단말기의 제어 방법 및 장치
WO2016072678A1 (fr) Dispositif de terminal utilisateur et son procédé de commande
KR20120024299A (ko) 사용자 인터페이스 제공 방법 및 이를 이용하는 이동 단말기
KR102183445B1 (ko) 투과 영역을 포함하는 커버를 가지는 휴대 단말기의 디스플레이 방법 및 장치
KR102216127B1 (ko) 문자 입력 방법 및 장치
KR20170004220A (ko) 키패드를 표시하는 전자장치 및 그의 키패드 표시 방법
KR102247667B1 (ko) 플렉서블 디스플레이 장치 및 플렉서블 디스플레이 장치의 제어 방법.
WO2014035123A1 (fr) Dispositif terminal utilisateur et procédé de commande associé
KR20150025105A (ko) 전자 장치에서 입력 기능 운영 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16827979

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16827979

Country of ref document: EP

Kind code of ref document: A1