WO2022124615A1 - Appareil électronique, système de gestion de commande et procédé de commande associé - Google Patents

Appareil électronique, système de gestion de commande et procédé de commande associé Download PDF

Info

Publication number
WO2022124615A1
WO2022124615A1 PCT/KR2021/016783 KR2021016783W WO2022124615A1 WO 2022124615 A1 WO2022124615 A1 WO 2022124615A1 KR 2021016783 W KR2021016783 W KR 2021016783W WO 2022124615 A1 WO2022124615 A1 WO 2022124615A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
screen
electronic device
touch
identified
Prior art date
Application number
PCT/KR2021/016783
Other languages
English (en)
Korean (ko)
Inventor
김호연
이태영
한화진
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Publication of WO2022124615A1 publication Critical patent/WO2022124615A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
    • G07F17/40—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for devices for accepting orders, advertisements, or the like

Definitions

  • the present invention relates to an electronic device including a touch screen, an order management system, and a control method thereof.
  • the existing electronic device eg, a kiosk
  • the existing electronic device has a problem in that it cannot receive a user's input when a mechanical failure occurs in a part of the touch screen and thus cannot be touched, and thus cannot provide an interaction according to the manipulation. Accordingly, the user cannot receive the desired service, so there is a continuous demand for a method of smoothly providing the service to the user even when a malfunction occurs in the touch screen.
  • an object of the present invention is to provide an electronic device, an order management system, and a control method for providing a UI screen so that an object is displayed in a touchable area with respect to a touch screen in which a mechanical failure occurs. have.
  • An electronic device for achieving the above object controls the display to display a display including a touch screen and a UI screen including an object selectable through a touch input, and When it is identified that an error has occurred in touch sensing of an area on the screen, it is identified whether the identified area includes the object, and when it is identified that the object is included in the identified area, the display position of the object is It may include a processor controlling the display to display the changed UI screen.
  • the processor may control the display to display the object in an area where there is no error in touch sensing within the touch screen.
  • the apparatus further includes a communication interface, wherein when the display position of the object is changed, the processor transmits the changed display position information of the object to an external device through the communication interface, wherein the external device and the electronic device It may be a device providing the same UI screen.
  • the processor may control the display to display a GUI (Guide User Interface) for guiding a touch error state in the identified area.
  • GUI Guide User Interface
  • the display position of the object is changed to a second position different from the first position
  • the display can be controlled to display.
  • the processor counts the number of touch inputs on the object included in the UI screen, and controls the display to change and display the display position of the object included in the UI screen when the number of touch inputs is greater than or equal to a threshold number can do.
  • the processor may control the display to change and display positions of other objects included in the layout so that the preset layout is maintained.
  • the processor may control the display to change and display at least one of a size or shape of the object based on at least one of a size or shape of a region in which the object is to be displayed.
  • the electronic device may be a kiosk located in a store.
  • an order management system including an electronic device and a server according to an embodiment of the present invention displays a UI screen including an object selectable through a touch input on a touch screen, and touches an area on the touch screen.
  • a UI screen including an object selectable through a touch input on a touch screen, and touches an area on the touch screen.
  • the method of controlling an electronic device includes the steps of displaying a UI screen including a selectable object through a touch input, and when it is identified that an error has occurred in detecting a touch in an area on the touch screen , identifying whether the object is included in the identified area, and when it is identified that the object is included in the identified area, displaying a UI screen in which the display position of the object is changed.
  • the object in the displaying of the UI screen, the object may be displayed in an area where there is no error in touch sensing within the touch screen.
  • the method may further include transmitting, when the display position of the object is changed, the changed display position information of the object to an external device, wherein the external device may be a device that provides the same UI screen as that of the electronic device.
  • the method may further include displaying a GUI (Guide User Interface) for guiding a touch error state in the identified area.
  • GUI Guide User Interface
  • changing the display position of the object to a second position different from the first position and displaying the same may include more.
  • 1 is a diagram for explaining a mechanism for providing a service to a user in a store.
  • FIG. 2 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure.
  • 3A to 3D are diagrams for explaining a UI change operation of an electronic device according to an embodiment of the present disclosure.
  • FIG. 4 is a diagram for explaining that a plurality of electronic devices provide the same UI screen according to an embodiment of the present disclosure.
  • FIG. 5 is a diagram for explaining an operation of displaying a GUI for guiding a touch error state of an electronic device according to an embodiment of the present disclosure.
  • 6A and 6B are diagrams for explaining an additional UI change operation of an electronic device according to an embodiment of the present disclosure.
  • FIG. 7 is a block diagram for specifically explaining a functional configuration of an electronic device according to an embodiment of the present disclosure.
  • FIG. 8 is a flowchart illustrating an operation of an order management system according to an embodiment of the present disclosure.
  • FIG. 9 is a flowchart illustrating an operation of an order management system according to another embodiment of the present disclosure.
  • FIG. 10 is a flowchart illustrating a control method according to an embodiment of the present disclosure.
  • expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of a corresponding characteristic (eg, a numerical value, function, operation, or component such as a part). and does not exclude the presence of additional features.
  • a component eg, a first component
  • another component eg, a second component
  • an element may be directly connected to another element or may be connected through another element (eg, a third element).
  • a “module” or “unit” performs at least one function or operation, and may be implemented as hardware or software, or a combination of hardware and software.
  • a plurality of “modules” or a plurality of “units” are integrated into at least one module and implemented with at least one processor (not shown) except for “modules” or “units” that need to be implemented with specific hardware.
  • the term user may refer to a person who uses an electronic device.
  • an embodiment of the present disclosure will be described in more detail with reference to the accompanying drawings.
  • 1 is a diagram for explaining a mechanism for providing a service to a user in a store.
  • a store providing a service based on an order of a user 40 may receive an order from the user 40 through a plurality of kiosks 10 , 20 , 30 including a touch screen.
  • the plurality of kiosks 10 , 20 , and 30 may provide the same UI to the user 40 , and the user 40 may place a service-related order through a kiosk that is expected to have the shortest waiting time.
  • a mechanical failure occurs in the kiosk, it is difficult to provide a smooth service to the user 40 .
  • a typical failure type is a case in which a failure (hereinafter, touch error) occurs in a touch screen provided in the kiosk.
  • a touch error may occur due to a physical external impact, an influence of an electromagnetic field, frequent touch input, etc., and various embodiments for solving a case in which a touch error occurs due to frequent touch input will be described herein.
  • the kiosk cannot perform a corresponding interaction according to the user's touch operation, so the store manager must repair the malfunctioning kiosk, and the kiosk cannot be used during the repair process. In this state, it becomes difficult to provide a smooth service to users.
  • the electronic device can provide a UI screen to display an object in a touchable area.
  • FIG. 2 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure.
  • the electronic device 100 may include a display 110 and a processor 120 .
  • the display 110 may be implemented as a display of various types, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a quantum dot light-emitting diode (QLED) display, a plasma display panel (PDP), and the like.
  • the display 110 may include a driving circuit, a backlight unit, and the like, which may be implemented in the form of a TFT, a low temperature poly silicon (LTPS) TFT, an organic TFT (OTFT), and the like. Meanwhile, the display 110 may be implemented as a flexible display, a three-dimensional display, or the like.
  • the display 110 may include a touch screen combined with a touch sensor.
  • the processor 120 controls the overall operation of the electronic device 100 .
  • the processor 120 may be connected to each component of the electronic device 100 to control the overall operation of the electronic device 100 .
  • the processor 120 may be connected to the display 110 to control the operation of the electronic device 100 .
  • the processor 120 includes a digital signal processor (DSP), a microprocessor, a central processing unit (CPU), a micro controller unit (MCU), and a micro processing unit (MPU). unit), a Neural Processing Unit (NPU), a controller, an application processor (application processor (AP)), etc. may be named various names, but in the present specification, the processor 120 is described.
  • DSP digital signal processor
  • CPU central processing unit
  • MCU micro controller unit
  • MPU micro processing unit
  • unit a Neural Processing Unit
  • controller an application processor (application processor (AP)), etc.
  • AP application processor
  • the processor 120 may be implemented as a system on chip (SoC), large scale integration (LSI), or a field programmable gate array (FPGA) type.
  • SoC system on chip
  • LSI large scale integration
  • FPGA field programmable gate array
  • the processor 120 may include a volatile memory such as SRAM.
  • the processor 120 may control the display 110 to display a user interface (UI) screen including an object selectable through a touch input.
  • UI user interface
  • the object may be an individual icon included in the UI.
  • the electronic device 100 may provide an interaction corresponding to a corresponding object based on a user's touch manipulation of an area where an object included in the UI is displayed.
  • the UI may be a visual UI screen provided through the display 110 .
  • the UI may include at least one object, and when a plurality of objects are included in the UI, the plurality of objects may be displayed based on a preset layout.
  • the processor 120 may identify that an error has occurred in detecting a touch in an area on the touch screen.
  • error There are two types of errors in touch sensing: errors in hardware and errors in software. In this specification, it is assumed that an error in hardware (touch sensor) occurs in the touch screen.
  • Coordinates corresponding to a region on the touch screen in which an error in touch detection occurs may be stored in a memory (not shown) in which a history of a device failure history is stored, and an output value obtained in a test mode for identifying a touch error It may be identified by the processor 120 based on
  • the processor 120 may identify whether at least one object is included in the identified region.
  • the processor 120 may control the display 110 to display a UI screen in which the display position of the object is changed.
  • the processor 120 may control the display 110 to display an object in an area where there is no error in touch sensing within the touch screen.
  • the processor 120 may provide the user with a UI screen in which the display position of the object is changed to a region other than the identified region.
  • the electronic device 100 further includes a communication interface, and when the display position of the object is changed, the processor 120 transmits the changed display position information of the object through the communication interface. It can be transmitted to an external device.
  • the external device may be a device that provides the same UI screen as the electronic device 100 .
  • the processor 120 may control the display 110 to display a GUI (Guide User Interface) for guiding a touch error state in the identified area.
  • GUI Guide User Interface
  • the processor 120 sets the display position of the object to a second position different from the first position.
  • the display 110 may be controlled to display by changing to two positions.
  • the processor 120 counts the number of touch inputs for an object included in the UI screen, and when the number of touch inputs is equal to or greater than a threshold number, by changing the display position of the object included in the UI screen
  • the display 110 may be controlled to display.
  • the electronic device 100 changes the position of the object displayed on the UI screen in order to prevent a touch error on the area on the touch screen where the object frequently selected by the user is displayed on the UI screen.
  • a UI screen can be displayed.
  • the processor 120 may count the number of times of touch input to an object included in the UI screen for a preset time. In this case, the processor 120 may count the number of times of touch input to the object based on the history of touch input to the touch screen. On the other hand, the processor 120 according to another example counts the number of touch inputs to the object based on the time when the position of the object is changed, and when the number of touch inputs is equal to or greater than the threshold number of times, the display position of the object is changed and displayed. can
  • the processor 120 controls the display 110 to display while changing the positions of other objects included in the layout so that the preset layout is maintained when the object is included in the preset layout. can do.
  • the processor 120 may control the display 110 to change and display at least one of the size or shape of the object based on at least one of the size or shape of the area in which the object is to be displayed.
  • the processor 120 may enlarge or reduce the overall size of the UI screen including the object together with the size of the object and display it. Also, the processor 120 may change and display the shape of a preset layout including the object.
  • the electronic device 100 may be a kiosk located in a store.
  • 3A to 3D are diagrams for explaining a UI change operation of an electronic device according to an embodiment of the present disclosure.
  • 3A to 3D when an error occurs in detecting a touch in one area on the display 110 while one electronic device 100 displays the existing UI screen 310, the UI screen 320 in which the position of the object is changed is shown. The display operation is shown.
  • the electronic device 100 may display a UI screen 310 including an object 311 through the display 110 .
  • the electronic device 100 may identify that an error has occurred in detecting a touch of one area 200 on the display 110 .
  • the electronic device 100 may display the area in which the object 311 is identified ( 200) and the display position of the object is changed to a position 321 different from the existing position 311 may be displayed.
  • the different location 321 may be one of the areas excluding the identified area 200 among the areas on the display 110 .
  • the processor 120 is a region spaced apart from the identified region 200 by a threshold distance or more among regions on the display 110 .
  • the display 110 may be controlled so that the object 321 whose position has been changed is displayed.
  • the electronic device 100 displays a UI screen 320 in which an object 321 is located in a normally touchable area other than the area 200 identified as having an error in touch detection.
  • a smooth service can be provided to users.
  • the electronic device 100 when an object included in an area 200 identified as having an error in touch sensing is included in a preset layout 312 , The positions of other objects included in the layout may be changed and displayed so that the set layout is maintained.
  • the layout 312 may be a layout in which three objects are arranged in a line in a horizontal direction. Even when only the rightmost object among the objects included in the layout 312 is included in the identified area 200 , the electronic device 100 maintains the layout 312 in three ways included in the layout 312 . The position of the object can be changed and displayed.
  • the processor 120 may control the display 110 to display the UI screen 320 in which the changed positions 322 of the objects are not included in the identified region 200 .
  • the electronic device 100 may provide a service corresponding to each object included in the UI screen 320 while maintaining a preset layout.
  • the electronic device 100 may change the size of an object and display it based on at least one of a size or a shape of a region in which the object is to be displayed.
  • the processor 120 determines the size or shape of the object on the display 110 based on the size or shape of the remaining area except for the area 200 identified as having an error in touch sensing.
  • the display 110 may be controlled to display by changing the size.
  • the electronic device 100 may change and display only the size of each object while maintaining the size of the UI screen 310.
  • the size of the UI screen itself including the object as well as the object may be displayed. It may be displayed by changing 320 .
  • the processor 120 is configured to display the existing UI screen 310 on the left area of the area on the display 110 based on the point that the identified area 200 is biased to the right of the area on the display 110 . ) may be controlled to display the UI screen 320 reduced by a certain ratio.
  • the processor 120 according to an example enlarges the existing UI screen 310 at a certain ratio so that the object included in the UI screen is not included in the identified area 200 after the change.
  • the display 110 may be controlled to display a screen.
  • the electronic device 100 may provide a service corresponding to each object included in the changed UI screen 320 while maintaining the arrangement of a plurality of objects included in the existing UI screen.
  • the electronic device 100 may change and display a shape of an object based on at least one of a size or a shape of a region in which the object is to be displayed.
  • the processor 120 changes and displays the shape of the object based on the size or shape of the remaining area except for the area 200 identified as having an error in touch sensing among areas on the display 110 . (110) can be controlled.
  • the processor 120 is configured to display the existing UI screen 310 on the left area of the area on the display 110 based on the point that the identified area 200 is biased to the right of the area on the display 110 . ), the display 110 may be controlled to display the UI screen 320 in which the layout is changed.
  • the processor 120 controls the display 110 to display the UI screen 320 in which objects are arranged based on a vertical layout different from the horizontal layout corresponding to the existing UI screen 310 . can do.
  • the electronic device 100 since objects are displayed in the remaining areas except for the identified area 200 , the electronic device 100 according to an example can provide a smooth service to the user.
  • an object identified as being included in the region 200 identified as having an error in touch sensing among regions on the display 110-1 is located at an existing location.
  • a UI screen 401 that is changed to a location 420 different from that of 410 may be displayed.
  • the UI displayed by the two electronic devices 100-1 and 100-2 when the other electronic device 100-2 in which an error does not occur in the area on the display 110-2 displays the existing UI screen.
  • the screens are different from each other.
  • the electronic device 100-1 further includes a communication interface (not shown), and displays the changed object display location information 400 . It may be transmitted to the other electronic device 100 - 2 through the communication interface.
  • the display location information 400 may be information about a location 420 in which an object corresponding to a whole chicken dish is displayed on the changed UI screen 401 .
  • Another electronic device 100-2 may be a device having the same specifications as the electronic device 100-1 according to an embodiment.
  • the other electronic device 100 - 2 may include a communication interface (not shown), and the other electronic device 100 - 2 receives a display position from the electronic device 100 - 1 through the communication interface. Based on the information 400 , the same UI screen 402 as the UI screen 401 provided by the electronic device 100 - 1 may be provided through the display 110 - 2 .
  • the electronic device 100-1 and the other electronic device 100-2 have the same UI screens 401 and 402 in response to a touch error occurring in the electronic device 100-1. ) can be provided, so the user's satisfaction with the service can be increased.
  • a touch error may also occur in the other electronic device 100 - 2 according to an embodiment of the present disclosure.
  • the other electronic device 100 - 2 may transmit display position information of the changed object on the display 110 - 2 to the electronic device 100 - 1 through the communication interface.
  • the electronic device 100 - 1 and the other electronic device 100 - 2 may provide the same UI screen based on information transmitted by each device to the other device and information received from the other device.
  • each device may provide a UI screen in which the existing UI screen is changed so that an object is not displayed on the display 110-1 of the electronic device and the display 110-2 of another electronic device so that an object is not displayed in an area where a touch error occurs. have.
  • FIG. 5 is a diagram for explaining an operation of displaying a GUI for guiding a touch error state of an electronic device according to an embodiment of the present disclosure.
  • the processor 120 displays a GUI (Guide User Interface) 500 for guiding a touch error in the region 200 identified as having an error in touch sensing among regions on the display 110 .
  • the display 110 may be controlled to do so.
  • GUI 500 may include an entire visual UI including text or images in addition to that shown in FIG. 5 .
  • the electronic device 100 may display the GUI 500 having a shape that exactly corresponds to the identified region 200 , but has a shape corresponding to the region occupied by an object included in the identified region 200 .
  • a GUI 500 may be displayed.
  • the UI screen according to an embodiment of the present disclosure may be a slide UI screen that moves in response to a user input.
  • a user's touch input corresponding to a slide operation of the UI is made on the identified region 200 , the electronic device 100 according to an example cannot provide a UI screen for performing a slide operation.
  • the processor 120 controls the display 110 to display a GUI for guiding a touch error in the identified region 200 , the user controls the display 110 except for the identified region 200 . ), a touch input may be performed on the upper region, and accordingly, a smooth service may be provided from the electronic device 100 .
  • 6A and 6B are diagrams for explaining an additional UI change operation of an electronic device according to an embodiment of the present disclosure.
  • the object identified as being included in the area 200 identified as having an error in touch sensing is existing.
  • a UI screen displayed after being changed to a first position 621 different from the position 611 of may be displayed.
  • the processor 120 sets the display position of the object to the first position 621 when the UI screen is provided after a threshold time after the display position of the object is changed to the first position 621 and displayed ) and the display 110 can be controlled to change to a different second position 631 and display.
  • the object included in the identified area 200 may be an object with a high frequency selected through a user's touch input. Therefore, even after the position of the object included in the identified region 200 is changed to the first position 621 and displayed, an additional touch error may occur in the first position 621 due to frequent touch input to the corresponding object.
  • the electronic device 100 sets the display position of the object located in the first position 621 to a second position different from the first position 621 . It can be displayed by changing to (631).
  • the electronic device 100 may provide a UI screen in which objects are arranged based on a preset layout.
  • the electronic device 100 may identify an object included in the region 200 identified as having an error in touch sensing among regions on the display 110 .
  • the electronic device 100 changes the positions of the plurality of objects included in the layout to a first position 622 different from the existing position 612 so that the layout including the objects included in the identified region 200 is maintained.
  • the displayed UI screen can be displayed.
  • the processor 120 changes the display positions of the plurality of objects included in the layout to the first position 622 and displays the UI screen after a threshold time.
  • the display 110 may be controlled to display by changing the display position to a second position 632 different from the first position 622 .
  • the processor 120 In addition to those described with reference to FIGS. 6A and 6B , the processor 120 according to an embodiment of the present disclosure counts the number of touch inputs for an object included in the UI screen, and if the number of touch inputs is greater than or equal to the threshold number of times, the object included in the UI screen
  • the display 110 may be controlled to display by changing the display position of the .
  • the electronic device 100 can prevent an additional touch error from occurring in an area on the display 110 occupied by an object frequently selected by the user.
  • FIG. 7 is a block diagram for specifically explaining a functional configuration of an electronic device according to an embodiment of the present disclosure.
  • the electronic device 100 ′ includes a display 110 , a processor 120 , a communication interface 130 , a speaker 140 , and a payment module 150 .
  • a display 110 the electronic device 100 ′ includes a display 110 , a processor 120 , a communication interface 130 , a speaker 140 , and a payment module 150 .
  • a communication interface 130 the electronic device 100 ′ includes a display 110 , a processor 120 , a communication interface 130 , a speaker 140 , and a payment module 150 .
  • the communication interface 130 may input and output various types of data.
  • the communication interface 130 is AP-based Wi-Fi (Wi-Fi, Wireless LAN network), Bluetooth (Bluetooth), Zigbee (Zigbee), wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), MHL (Mobile High-Definition Link), AES/EBU (Audio Engineering Society/ European Broadcasting Union), Optical , Coaxial, etc. to communicate various types of data with external devices (eg, source devices), external storage media (eg, USB memory), and external servers (eg, web hard drives). can send and receive and receive various types of data with external devices (eg, source devices), external storage media (eg, USB memory), and external servers (eg, web hard drives).
  • external devices eg, source devices
  • external storage media eg, USB memory
  • external servers eg, web hard drives
  • the speaker 140 is a device that converts the electroacoustic signal of the electronic device 100 into sound waves.
  • the speaker 140 may include a permanent magnet, a coil, and a diaphragm, and may output sound by vibrating the diaphragm due to electromagnetic interaction between the permanent magnet and the coil.
  • the speaker 140 may output a guide voice corresponding to a user's order related to a service provided by the electronic device 100 , and corresponds to a UI screen provided through the display 110 . It is also possible to provide an auditory UI.
  • the payment module 150 is a configuration for the electronic device 100 to receive payment of an amount corresponding to a service from a user who desires to receive the service.
  • the payment module 150 may include a sensor corresponding to a payment method using cash, a card, and FinTech.
  • the payment module 150 may include an NFC antenna, a barcode scanner, and a magnetic sensor.
  • FIG. 8 is a flowchart illustrating an operation of an order management system according to an embodiment of the present disclosure.
  • the order management system may include an electronic device 100 - 1 , another electronic device 100 - 2 and a server 1000 .
  • the electronic device 100-1 may display a UI screen including an object selectable through a touch input on the touch screen (S811).
  • the other electronic device 100-2 may also display the same UI screen as the electronic device 100-1 (S812).
  • the electronic device 100 - 1 may identify whether an object is included in the identified area when it is identified that an error has occurred in touch sensing of an area on the touch screen ( S820 ) ( S830 ).
  • the electronic device 100-1 may change the display position of the object to display (S840), and transmit the changed display position information of the object to the server 1000 (S850).
  • the server 100 is a device capable of electrically communicating with the electronic device 100 - 1 and another electronic device 100 - 2 .
  • the server 1000 may generate a changed UI screen based on the changed display position information of the object received from the electronic device 100-1 (S860). Also, the server 1000 may transmit information on the generated UI screen to the other electronic device 100-2 (S870).
  • the other electronic device 100-2 may be a device having the same specifications as the electronic device 100-1 according to an embodiment.
  • the other electronic device 100-2 according to an example may provide the same UI screen as that of the electronic device 100-1 based on the information received from the server 1000 (S880).
  • FIG. 9 is a flowchart illustrating an operation of an order management system according to another embodiment of the present disclosure.
  • the electronic device 100-1 may display a UI screen including an object selectable through a touch input on the touch screen (S911).
  • the other electronic device 100-2 may also display the same UI screen as the electronic device 100-1 (S912).
  • the electronic device 100 - 1 may transmit location information of the area in which the error has occurred to the server 1000 ( S930 ). ).
  • the server 1000 may identify whether an object is included in an area in which an error occurs based on information received from the electronic device 100-1 (S940). Also, the server 1000 may generate a UI screen in which the display position of the object is changed ( S950 ).
  • the server 1000 may transmit information on the generated UI screen to the electronic device 100-1 and the other electronic device 100-2 (S960).
  • the electronic device 100-1 and the other electronic device 100-2 may provide a changed UI screen based on the received information (S971, S972).
  • FIG. 10 is a flowchart illustrating a control method according to an embodiment of the present disclosure.
  • a UI screen including an object selectable through a touch input is displayed ( S1010 ). Then, when it is identified that an error has occurred in touch sensing in one area on the touch screen, it is identified whether an object is included in the identified area (S1020). Finally, when it is identified that the object is included in the identified area, the UI screen in which the display position of the object is changed is displayed (S1030).
  • the object in the step of displaying the UI screen ( S1030 ), the object may be displayed in an area where there is no error in touch sensing within the touch screen.
  • the method may further include transmitting the changed display position information of the object to an external device when the display position of the object is changed, and the external device may be a device that provides the same UI screen as that of the electronic device.
  • the method may further include displaying a GUI (Guide User Interface) for guiding a touch error state in the identified area.
  • GUI Guide User Interface
  • the method may further include changing the display position of the object to a second position different from the first position and displaying it have.
  • the method may further include counting the number of touch inputs on the object included in the UI screen, and changing the display position of the object included in the UI screen to display if the number of touch inputs is equal to or greater than a threshold number of times.
  • the positions of other objects included in the layout may be changed and displayed so that the preset layout is maintained.
  • At least one of the size or shape of the object may be changed and displayed based on at least one of the size or shape of the area in which the object is to be displayed.
  • the electronic device may be a kiosk device located in a store.
  • the various embodiments described above may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof.
  • the embodiments described herein may be implemented by the processor 120 itself.
  • embodiments such as the procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.
  • computer instructions for performing the processing operation of the electronic device 100 according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. have.
  • the specific device performs the processing operation in the electronic device 100 according to the various embodiments described above.
  • the non-transitory computer-readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, a cache, a memory, and can be read by a device.
  • Specific examples of the non-transitory computer-readable medium may include a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention divulgue un appareil électronique. L'appareil électronique comprend un dispositif d'affichage comprenant un écran tactile, et un processeur. Le processeur commande le dispositif d'affichage pour afficher un écran d'interface utilisateur comprenant un objet qui peut être sélectionné au moyen d'une entrée tactile, et lorsqu'il est identifié qu'une erreur s'est produite lors de la détection tactile d'une région sur l'écran tactile, identifie si l'objet est inclus dans la région identifiée, et lorsqu'il est identifié que l'objet est inclus dans la région identifiée, commande le dispositif d'affichage pour afficher un écran d'interface utilisateur dans lequel la position d'affichage de l'objet est modifiée.
PCT/KR2021/016783 2020-12-09 2021-11-16 Appareil électronique, système de gestion de commande et procédé de commande associé WO2022124615A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020200171532A KR20220081723A (ko) 2020-12-09 2020-12-09 전자 장치, 주문 관리 시스템 및 그 제어 방법
KR10-2020-0171532 2020-12-09

Publications (1)

Publication Number Publication Date
WO2022124615A1 true WO2022124615A1 (fr) 2022-06-16

Family

ID=81974678

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/016783 WO2022124615A1 (fr) 2020-12-09 2021-11-16 Appareil électronique, système de gestion de commande et procédé de commande associé

Country Status (2)

Country Link
KR (1) KR20220081723A (fr)
WO (1) WO2022124615A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090022037A (ko) * 2007-08-29 2009-03-04 엘지전자 주식회사 터치스크린을 구비한 이동 통신 단말기 및 터치스크린 보호방법
KR20140018514A (ko) * 2012-08-02 2014-02-13 엘지전자 주식회사 이동 단말기 및 그 제어방법
KR20140123168A (ko) * 2013-04-11 2014-10-22 엘지전자 주식회사 단말기 및 그 동작 방법
KR20150081523A (ko) * 2014-01-06 2015-07-15 엘지전자 주식회사 단말기 및 그 제어 방법
KR102037415B1 (ko) * 2012-04-07 2019-10-28 삼성전자주식회사 디스플레이 디바이스 제어 방법 및 시스템과 기록 매체

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090022037A (ko) * 2007-08-29 2009-03-04 엘지전자 주식회사 터치스크린을 구비한 이동 통신 단말기 및 터치스크린 보호방법
KR102037415B1 (ko) * 2012-04-07 2019-10-28 삼성전자주식회사 디스플레이 디바이스 제어 방법 및 시스템과 기록 매체
KR20140018514A (ko) * 2012-08-02 2014-02-13 엘지전자 주식회사 이동 단말기 및 그 제어방법
KR20140123168A (ko) * 2013-04-11 2014-10-22 엘지전자 주식회사 단말기 및 그 동작 방법
KR20150081523A (ko) * 2014-01-06 2015-07-15 엘지전자 주식회사 단말기 및 그 제어 방법

Also Published As

Publication number Publication date
KR20220081723A (ko) 2022-06-16

Similar Documents

Publication Publication Date Title
WO2016052875A1 (fr) Appareil d'affichage et son procédé de commande
WO2015111790A1 (fr) Montre intelligente, dispositif d'affichage et son procédé de commande
WO2014025108A1 (fr) Visiocasque pour ajuster une sortie audio et une sortie vidéo l'une par rapport à l'autre et son procédé de commande
WO2019074260A1 (fr) Télécommande, appareil d'affichage, système et procédé de commande de celui-ci
WO2015005537A1 (fr) Dispositif mobile, afficheur de tête et procédé de commande associé
WO2015009128A1 (fr) Dispositif souple, procédé de commande d'un dispositif, et procédé et appareil conçus pour l'affichage d'un objet par un dispositif souple
WO2015046900A1 (fr) Procédé et dispositif de partage de contenu
WO2013094881A1 (fr) Procédé et dispositif pour assurer la commande d'exécution d'applications
WO2020197012A1 (fr) Appareil d'affichage et procédé de commande de celui-ci
WO2015115698A1 (fr) Dispositif portatif et procédé de commande associé
WO2022124615A1 (fr) Appareil électronique, système de gestion de commande et procédé de commande associé
WO2019074181A1 (fr) Dispositif de traitement d'image et dispositif d'affichage le comprenant, et son procédé de commande
WO2019045362A1 (fr) Appareil d'affichage permettant de fournir une ui de prévisualisation et procédé de commande d'appareil d'affichage
WO2018034535A1 (fr) Appareil d'affichage et procédé d'affichage de contenu correspondant
EP3529994A1 (fr) Appareil d'affichage présentant l'état d'un appareil électronique externe et son procédé de commande
WO2023128656A1 (fr) Dispositif d'affichage et son procédé de commande
WO2017047985A1 (fr) Appareil d'affichage et son procédé de commande
WO2019088471A1 (fr) Dispositif électronique et son procédé de commande
WO2022060023A1 (fr) Dispositif électronique et son procédé de commande
WO2019093658A1 (fr) Serveur, dispositif électronique et procédé de commande associé
WO2017065522A1 (fr) Appareil d'affichage et son procédé de commande
WO2021118267A1 (fr) Dispositif électronique et procédé de commande associé
WO2013065912A1 (fr) Procédé, terminal et support d'enregistrement pour commander une sortie d'écran
WO2023055225A1 (fr) Appareil électronique et son procédé de commande
WO2018052225A1 (fr) Dispositif d'affichage et procédé de commande correspondant

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21903661

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21903661

Country of ref document: EP

Kind code of ref document: A1