KR20200069071A - A method for controlling a kit by generating a command for controlling the kit on the kit control terminal - Google Patents

Abstract

According to an embodiment of the present invention, provided is a method of controlling a kit by generating a command for kit control on a kit control terminal, comprising the following steps of: displaying a user interface for block control by executing an application installed in a terminal; displaying a plurality of detection icons in response to selection of any one among a plurality of detection method icons on which the user interface for block control is displayed; displaying a plurality of detailed detection method icons in response to selection of any one among the detection icons; displaying a driving system icon corresponding to a driving means included in a kit in response to selection of any one among the detailed detection method icons; displaying a plurality of driving method icons in response to selection of the driving system icon; generating a plurality of commands for controlling a driving means corresponding to the selected driving system icon according to a detection method preset to the detailed detection method icons in response to selection of any one among the driving method icons and selection of an icon which has completed generation of a control signal; and transmitting a command matched to a command signal among the commands to the kit to control the driving means when the command signal matched to a detection method connected to the selected detailed detection method icon is received.

Description

A method for controlling a kit by generating a command for controlling the kit on the kit control terminal}

The present invention relates to a terminal for controlling a kit and a kit, and more particularly, to a method for generating a command for controlling a kit on a terminal for controlling a kit and a system for controlling the kit.

Conventionally, play blocks for learning and learning are widely spread by assembling a desired shape by combining projections and recesses on surfaces of polyhedrons such as cuboids, cubes, and triangular columns, and fitting projections into recesses. In addition, recently, it is becoming popular to provide a motor in an assembly block to operate a movable part by a motor.

For example, in Patent Document 1, an assembly block kit of a locomotive mounted with a motor and traveling along a toothed rail is proposed. This is to move the locomotive by attaching a cogwheel to a drive shaft driven by a motor and rotating the cogwheel by engaging the cogwheel. In addition, in Patent Document 2, in addition to the function expressing means in which functions such as a servo motor or a buzzer are expressed, control means for controlling the function expressing means and communication means for communicating with other assembly blocks through a network are incorporated. By virtue of it, an assembly block capable of complex operation with simple wiring has been proposed. In Patent Document 2, an embodiment in which a caterpillar of a bulldozer is driven through a gear by a motor is introduced. In addition, the block toy kit for learning in Patent Literature 3 can be easily assembled between each block, each frame, or between each block and frame even without the use of a separate screw or adhesive. This makes it possible. However, in such a conventional kit, the driving of the kit is determined according to a predetermined driving method, and a method for individually controlling various driving parts in the kit is not disclosed. According to patent document 4, a technology using a computer has appeared to develop a control program for a robot, but the development of the control program for the robot has a limitation that it is difficult for a beginner to approach, and a lot of knowledge is required for program control, which limits the target of using the kit. Became.

Japanese Patent Publication No. Hei 7-61382 Japanese Patent Application Publication No. 10-108985 Korean Patent Publication No. 10-2011-0101739 Korean Patent Publication No. 10-2012-0036680

An object of the present invention is to provide a kit control method and a system therefor for simplifying kit production by removing cables and wires that have been complicated in the related art, and improving convenience of kit control.

In addition, an object of the present invention is to provide a kit control method and a system for improving the convenience of generating a kit control instruction through an interactive coding method.

In addition, an object of the present invention is to provide a method and system that enables control of a kit without space limitations through kit control using communication.

In addition, an object of the present invention is to provide a method for generating a command for controlling a kit through a simple icon selection process of a user interface and a system therefor.

An embodiment includes displaying a user interface for block control by executing an application installed in a terminal; Displaying a plurality of detection icons in response to selection of any one of a plurality of detection method icons displayed on the block control user interface; Displaying a plurality of detailed detection type icons in response to selection of any one of the plurality of detection icons; Displaying a drive system icon corresponding to the drive means included in the kit in response to selection of any one of the plurality of detailed detection method icons; Displaying a plurality of driving method icons in response to the selection of the driving system icon; A plurality of driving means corresponding to the selected drive system icon in response to the selection of any one of the plurality of driving method icons and the selection of the control signal generation completed icon is controlled according to a detection method preset to the detailed detection method icon. Generating a command; And controlling the driving means by transmitting a command matched to the command signal among the plurality of commands to the kit when a command signal matching a sensing method linked to the selected detailed sensing method icon is received. It is possible to provide a method of controlling a kit by generating a command for controlling the kit on a control terminal.

In another aspect, when a user's command signal matching a detection method associated with the selected detailed detection method icon is received through a touch input of the selected detection icon, a command matched with the user's command signal among the plurality of commands is selected. It is possible to provide a method for controlling a kit by generating a command for controlling the kit on a kit control terminal that transmits to the kit to control the driving means.

In another aspect, when a user's command signal matching a detection method linked to the selected detailed detection method icon is received through a change in the position of the terminal, the kit matching the command signal of the user among the plurality of instructions is provided in the kit. It is possible to provide a method of controlling a kit by generating a command for controlling the kit on a kit control terminal that controls the driving means by transmitting.

In another aspect, when sensing information matching the input method linked to the selected detailed input method icon is received from the kit, a command matching the sensing information among the plurality of commands is transmitted to the kit to control the driving means doing

It is possible to provide a method of controlling a kit by generating a command for controlling the kit on a kit control terminal.

In another aspect, when sensing information matching the input method linked to the selected detailed input method icon is sensed from the sensor unit of the terminal, the command matching the sensing information among the plurality of instructions is transmitted to the kit to drive the sensor. It is possible to provide a method of controlling a kit by generating a command for controlling the kit on a kit control terminal that controls means.

In another aspect, when a user's command signal matching a detection method associated with the selected detailed detection method icon is received through a touch input of the selected detection icon, the kit's location information and the user satisfying a preset condition A method of controlling a kit by generating a command for kit control on a kit control terminal that controls the driving means by transmitting a command matched to the user's command signal among the plurality of commands based on the gaze information of the Can provide.

The embodiment can simplify the kit production by removing cables and wires, which were conventionally complicated, and improve the convenience of kit control.

In addition, the convenience of generating instructions for controlling the kit through the interactive coding method is enhanced.

Also, it is possible to control the kit without space limitations through kit control using communication.

In addition, a command for controlling a kit can be generated through a simple icon selection process through a user interface.

In addition, it applies a sequential coding technique to create sentences, introduces a graphic user interface such as various icons to supplement sentence complexity, and allows users to quickly and easily kit without recognizing programming areas such as loops that are basically required when creating commands. Control commands can be created.

1 shows a system for implementing a method of controlling a kit by generating a command for controlling a kit on a kit control terminal according to an embodiment of the present invention.
2 is an exemplary view of a kit according to an embodiment of the present invention.
3 is an exemplary view of components constituting the kit.
4 is an exemplary view showing a connection relationship between blocks constituting the kit.
5 is a block diagram of the main control unit in the main block.
6 and 7 provide descriptions of exemplary terminals.
8 is an exemplary view of a first user interface.
9 is an exemplary view of a second user interface.
10 is an exemplary diagram of a third user interface.
11 is an exemplary diagram of a fourth user interface.
12 is an exemplary diagram of a 5-1 user interface.
13 is an exemplary diagram of a 5-2 user interface.
14 is an exemplary diagram of a sixth user interface.
15 is an exemplary view of a seventh user interface.
16 is an illustration of another example of a seventh user interface.
17 is an exemplary view of an eighth user interface.
18 is an exemplary view of a ninth user interface.
19 is an exemplary view of a tenth user interface.

The present invention can be applied to a variety of transformations and may have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. Effects and features of the present invention and methods for achieving them will be clarified with reference to embodiments described below in detail with reference to the drawings. However, the present invention is not limited to the embodiments disclosed below and can be implemented in various forms. In the following examples, terms such as first and second are not used in a limiting sense, but for the purpose of distinguishing one component from other components. Also, a singular expression includes a plural expression unless the context clearly indicates otherwise. In addition, terms such as include or have means that a feature or component described in the specification exists, and does not preclude the possibility of adding one or more other features or components in advance. In addition, in the drawings, the size of components may be exaggerated or reduced for convenience of description. For example, since the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of description, the present invention is not necessarily limited to what is illustrated.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or corresponding components will be denoted by the same reference numerals, and redundant description thereof will be omitted. .

1 shows a system for implementing a method for controlling a kit by generating a command for controlling a kit on a kit control terminal according to an embodiment of the present invention, and FIG. 2 is a kit according to an embodiment of the present invention. 3 is an exemplary diagram for components constituting the kit, FIG. 4 is an exemplary diagram showing a connection relationship between blocks constituting the kit, and FIG. 5 is a block diagram for the main control unit in the main block. 6 and 7 also provide descriptions of exemplary terminals.

Now, embodiments will be referred to in detail, and examples of embodiments are illustrated in the accompanying drawings. In the following detailed description, many specific details are set forth to provide a thorough understanding of variously described embodiments. However, it will be apparent to those skilled in the art to which the present invention pertains that various described embodiments may be practiced without these specific details. In other examples, well-known methods, procedures, components, circuits, and networks have not been described in detail in order not to unnecessarily obscure aspects of the embodiments.

In some examples, terms, first, second, etc. are used herein to describe various elements, but it will also be understood that these elements should not be limited to these terms. These terms are only used to distinguish one element from another. For example, a first contact can be referred to as a second contact, and similarly, a second contact can be referred to as a first contact, without departing from the scope of various described embodiments. The first contact and the second contact are both contacts, but they are not the same contact.

The terms used in the description of the various embodiments described herein are for the purpose of describing specific embodiments only, and are not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular form is intended to include the plural form as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. As used herein, the term includes the recited features, integers, steps, operations, elements, and/or components to be included, but includes one or more other features, integers, steps, operations. It will be further understood that it does not exclude the presence or addition of elements, components, and/or groups thereof.

As used herein, the term “if” means, alternatively, “when” or “when” or “in response to determining” or “in response to detecting” depending on context. It is interpreted as. Similarly, the phrases “when determined” or “when [the stated condition or event] is detected” are, optionally, depending on the context, “at decision” or “in response to determining” or “[mentioned condition or Event] on detection" or "in response to detecting [mentioned condition or event]".

The kit 10 is composed of a plurality of blocks. The kit 10 may be composed of at least one base block 11, at least one main block 12, at least one drivetrain block 13, and at least one moving block 14.

The coupling grooves 1 and the coupling protrusions 2 are formed on the outer surface of each block, and the coupling protrusions 2 of the other block are coupled to each other, and the blocks are assembled to each other. This assembly enables the user to assemble the block in a desired position or direction and physically combine the various types of blocks.

Various electronic devices may be provided inside the block. For example, the main control unit 129 including the block processor 121, the block memory 122, and the block communication unit 123 may be installed in the main block 12. Various components constituting the main control unit 129 may be independently configured in a plurality of main blocks rather than in one main block 12.

The block memory 122 includes instructions (eg, executable instructions), such as computer readable instructions or processor readable instructions. The instructions may include one or more instructions executable by each of the one or more block processors 121.

A drive means may be installed in the drive system block 13. The driving means may be a device that converts electrical signals into physical signals, such as various servo motors. However, the present invention is not limited thereto, and the driving system block 13 may include a light source device or a display device for visual, aural, and physical display.

The main control unit 129 may generate a control signal and transmit the control signal to the driving means in the drive system block 13. The driving means can be driven based on the control signal. The moving block 14 is connected to the drive system block 13, and more specifically, coupled to the drive means inside the drive system block 13, the position of the move block 14 may be moved according to the drive of the drive means. Exemplarily, the moving block 14 can rotate about the driving means by the rotational force from the driving means.

The kit 10 may further include a communication cable 15 for data transmission between blocks. The communication cable 15 is coupled to a connection terminal provided in blocks for electrical signal exchange between blocks incorporating an electronic device to enable data communication between blocks. However, it should be noted that the communication is not limited to the wired method and can be performed by the wireless method.

In some embodiments, the kit 10 may further include a connection block 16, and the kit 10 may be modified in various shapes by the connection block 16.

In some embodiments, kit 10 may further include a sensor block 17. The sensor block 17 may be a block containing at least one of a camera device, sensors for sensing various information, and a microphone device.

Embodiments of terminals, user interfaces for such terminals, and associated processes for using such terminals are described.

In the following discussion, a terminal comprising a display and a touch-sensitive surface is described. However, it should be understood that the terminal optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and/or joystick.

Terminals typically support a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website authoring applications, disk authoring applications, spreadsheet applications, game applications, phone applications, video conferencing applications, email Application, instant messaging application, exercise support application, photo management application, digital camera application, digital video camera application, web browsing application, digital music player application, and/or digital video player application.

Various applications running on the terminal, optionally, use at least one universal physical user interface device, such as a touch-sensitive surface. The one or more functions of the touch-sensitive surface as well as the corresponding information displayed on the device are, optionally, adjusted and/or changed from one application to the next and/or within each application. In this way, the device's universal physical architecture (such as a touch-sensitive surface) optionally supports a variety of applications using user interfaces that are intuitive and clear to the user.

Attention is now directed towards embodiments of portable terminals with touch-sensitive displays. 6 is a block diagram illustrating a portable terminal 10 with touch-sensitive displays 110 in accordance with some embodiments. The touch-sensitive display 110 is sometimes referred to as a “touch screen” for convenience, and is sometimes known or referred to as a touch-sensitive display system. Terminal 10 includes memory 190 (optionally including one or more computer-readable storage media), memory controller 191, one or more processing units (CPUs) 180, peripheral interfaces 120, and RF circuitry 170, input/output (I/O) subsystem 130, other input or control devices 140, and camera system 150. The terminal 10 is, optionally, one or more intensity sensors 160 for detecting the intensity of the contacts on the terminal 10 (eg, touch-sensitive, such as the touch-sensitive display system 110 of the terminal 10). Mold surface). The terminal 10 is, optionally, on a touch-sensitive surface such as the touch-sensitive display system 110 or touchpad of the terminal 10 to generate tactile outputs on the terminal 10. It includes one or more tactile output generators (for generating tactile outputs). These components optionally communicate over one or more communication buses or signal lines.

The terminal 10 is only an example, and the terminal 10 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of components. Should be recognized. The various components shown in FIG. 6 are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and/or application specific integrated circuits.

The memory 190 optionally includes high-speed random access memory, and, optionally, non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Access to memory 190 by other components of terminal 10, such as CPU 180 and peripherals interface 120, is optionally controlled by memory controller 191.

The peripheral interface 120 may be used to connect input and output peripherals of the device to the CPU 180 and the memory 190. The one or more processors 180 drive or execute various sets of software programs and/or instructions stored in the memory 190 to perform various functions for the terminal 10 and process data.

In some embodiments, peripheral interface 120, CPU 180 and memory controller 191 are, optionally, implemented on a single chip, such as a chip. In some other embodiments, they are optionally implemented on separate chips.

The radio frequency (RF) circuit 170 receives and transmits RF signals, also called electromagnetic signals. The RF circuit 170 converts electrical signals to/from electromagnetic signals and communicates with the communication networks and other communication devices via electromagnetic signals. The RF circuit 170 optionally includes, but is not limited to, an antenna system, RF transceiver, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC chipsets, subscriber identity module (SIM) cards, memory, etc. It includes, but is not limited to, well-known circuits for performing these functions. RF circuit 107 may optionally be networks, such as the Internet, intranet, and/or wireless networks, also referred to as the World Wide Web (WWW), such as cellular telephone networks, wireless local area networks (LANs), and/or It communicates by wireless communication with a metropolitan area network (MAN), and other devices. Wireless communication, optionally, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), evolution (EV-DO), Data-Only, HSPA, HSPA+, DC-HSPDA (Dual-Cell HSPA), long term evolution (LTE), near field communication (NFC), wideband code division multiple access (W-CDMA), code division multiple access (CDMA) ), time division multiple access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), voice over Internet Protocol (VoiP) , Wi-MAX, protocols for e-mail (e.g. Internet message access protocol (IMAP) and/or post office protocol (POP)), instant messaging (e.g. XMPP (extensible messaging and presence protocol), SIMPLE (Session) Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (IMPS), Instant Messaging and Presence Service (IMPS), and/or Short Message Service (SMS), or any other suitable communication protocols that have not been developed as of the filing date of this document. Multiple communication standards, protocols and technologies, including but not limited to communication protocols Use any of these.

The camera system 150 provides a camera interface between the user and the terminal 10. The camera system 150 converts the photographed image into an electric signal, processes the electric signal, and transmits the image to the display 110 or the memory 190. The camera system 150 converts the electrical signal into image data and transmits it to the peripheral interface 120 for processing. The image data is selectively fetched from the memory 190 by the peripheral interface 120 and/or transmitted to the memory 190.

The I/O subsystem 130 connects input/output peripherals on the terminal 10, such as the touch screen 110 and other input control devices 140, to the peripheral interface 120. I/O subsystem 130 optionally includes display controller 111, one or more input controllers 112. One or more input controllers 112 receive/transmit electrical signals to/from other input or control devices 140. Other input control devices 140 optionally include physical buttons (eg, push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and the like. In some alternative embodiments, input controller(s) 160 is optionally connected to (or not connected to) any of the pointer device, such as a keyboard, infrared port, USB port, and mouse.

The touch-sensitive display 110 provides an input interface and an output interface between the terminal 10 and the user.

The display controller 111 receives and/or transmits electrical signals to/from the touch screen 110. The touch screen 110 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects.

The touch screen 110 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and/or tactile contact. Touch screen 110 and display controller 111 contact (and any move or abort of contact) on touch screen 110 (with any associated modules and/or sets of instructions in memory 190). Detects and converts the detected contact into interaction with user interface objects (eg, one or more soft keys, icons, web pages or images) displayed on the touch screen 110. In an exemplary embodiment, the point of contact between the touch screen 110 and the user corresponds to the user's finger.

The touch screen 110 optionally uses LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies are used in other embodiments. The touch screen 110 and the display controller 111 may optionally include capacitive, resistive, infrared and surface acoustic wave technologies and other proximity sensor arrays to determine one or more contact points with the touch screen 110 or Contact and any movement or interruption thereof is detected using any of a plurality of touch sensing techniques currently known or to be developed later, including but not limited to other elements.

The touch screen 110 optionally contacts the touch screen 110 using any suitable object or accessory, such as a stylus, finger, or the like. In some embodiments, the user interface is designed to operate primarily using finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, terminal 10 converts the coarse finger-based input into a precise pointer/cursor position or command to perform the actions desired by the user.

In some embodiments, in addition to the touch screen, the terminal 10 optionally includes a touchpad (not shown) for activating or deactivating certain functions. In some embodiments, a touchpad is a touch-sensitive area of a device that does not display visual output unlike a touch screen. The touchpad is, optionally, a touch-sensitive surface separated from the touch screen 110 or an extension of the touch-sensitive surface formed by the touch screen.

Terminal 10 also includes a power system 101 for supplying power to various components. The power system 101 is optionally a power management system, one or more power sources (eg, batteries, alternating current (AC)), recharging systems, power failure detection circuits, power converters or inverters, power status indicators (eg , Light emitting diodes (LEDs), and any other components associated with the generation, management and distribution of power in portable terminals.

Terminal 10 also optionally includes one or more accelerometers 102. 6 shows accelerometer 102 connected to peripherals interface 120. Alternatively, accelerometer 102 is optionally connected to input controller 112 in I/O subsystem 130. In some embodiments, information is displayed in a portrait view or landscape view on a touch screen display based on analysis of data received from one or more accelerometers.

The terminal 10 is, optionally, a magnetometer (not shown) in addition to the accelerometer(s) 102, and a GPS for obtaining information about the position and orientation (eg, portrait or landscape) of the terminal 10 (Or GLONASS or other global navigation system) receiver 103.

Also, the terminal 10 may use the GPS receiver 103 to detect the location information of the terminal 10.

In some embodiments, software components stored in memory 190 include operating system 192, communication module (or set of instructions) 193, contact/motion module (or set of instructions) 194, graphics module ( Or set of instructions) 195, text input module (or set of instructions) 196, satellite positioning system (GPS) module (or set of instructions) 197, and applications (or sets of instructions) (198).

In some embodiments, memory 190 includes an event classifier 199 and an application.

The event classifier 199 receives event information and determines an application that delivers the event information. The event classifier 199 includes an event monitor 199a. In some embodiments, event monitor 199a receives event information from peripherals interface 120. The event information includes information on a specific location of the terminal 10. Accordingly, the information that the event monitor 199a receives from the peripheral interface 120 includes information from the GPS receiver 103.

7 illustrates a terminal 10 with a touch screen 110 in accordance with some embodiments. The touch screen 110 optionally displays one or more graphics within the user interface (UI) 200. In this embodiment, as well as in other embodiments described below, the user may graphically use, for example, one or more fingers (not shown to scale in the drawing) or one or more stylus (not shown to scale in the drawing). By making a gesture on the image, it becomes possible to select one or more of the graphics. In some embodiments, selection of one or more graphics occurs when the user stops contact with one or more graphics. In some embodiments, the gesture is optionally one or more taps of the finger that have contacted the terminal 10, one or more swipes (from left to right, right to left, up and/or down) and/or (from the right) Left, right to left, up and/or down). In some implementations or situations, unintentional contact with the graphic does not select the graphic. For example, if the gesture corresponding to the selection is a tap, the swipe gesture swiping over the application icon optionally does not select the corresponding application.

The server 40 transmits and receives data through the terminal 10 and the network. More specifically, the server 40 may transmit various data necessary for the execution of the application of the terminal 10. In addition, it is possible to database the information received from the terminal 10. Also, the server 40 may act as a relay for transmitting information received from another terminal to another terminal. In addition, the server 40 may serve as a relay for transmitting information received from any one terminal 10 to the kit 10 and/or transmitting information received from the kit 10 to the terminal 10. . In addition, the server 40 may function to provide the application execution file to the terminal 10 in response to the request of the terminal 10. In addition, the server 40 may perform overall management of the application running on the terminal 10 through communication.

Attention is now directed to embodiments of user interfaces (“UI”) that are selectively implemented on the terminal 10.

The user interface may include a user interface 31 for block connection and a user interface 32 for block control.

The user interface is displayed according to the execution of the application 198 installed in the terminal 10.

8 is an exemplary view of the first user interface, FIG. 9 is an exemplary view of the second user interface, FIG. 10 is an exemplary view of the third user interface, FIG. 11 is an exemplary view of the fourth user interface, and FIG. 12 Is an exemplary view of the 5-1 user interface, FIG. 13 is an exemplary view of the 5-2 user interface, FIG. 14 is an exemplary view of the sixth user interface, and FIG. 15 is an exemplary view of the seventh user interface, 16 is an exemplary view of a seventh user interface of another example, FIG. 17 is an exemplary view of an eighth user interface, FIG. 18 is an exemplary view of a ninth user interface, and FIG. 19 is an exemplary view of a tenth user interface .

8 to 10, the first user interface 100 may be displayed after the application 198 is executed. The first user interface 100 may display a plurality of block icons 101 and detect selection of at least one of the plurality of block icons 101. The plurality of block icons 101 are icons corresponding to shapes of various blocks, so that a user can easily check the type of blocks each of the block icons means through the display of the block icons. The terminal 120 may display the second user interface 200 in response to the selection of a plurality of block icons among the plurality of block icons 101. Only the block icon 210 selected by the user through the first user interface 100 may be displayed on the second user interface 200. The terminal 20 may exemplarily display a third user interface 300 for defining a connection relationship between two selected block icons in response to the selection of two block icons among the displayed block icons.

The third user interface 300 may include a connection block icon 310 and a connection relationship selection affordance 320. The terminal 20 may establish a connection relationship between blocks in response to detection of selection of the connection relationship selection affordance 320 and store the established connection relationship information.

In some embodiments, the third user interface 300 may further display information conducive to establishing a connection to facilitate establishing a connection between blocks.

Referring to FIG. 11, when connection establishment between blocks is completed, the terminal 10 may display the fourth user interface 400.

The fourth user interface 400 may be divided into a detection method icon display area 410 and an edit board area 420. A plurality of detection method icons 411 may be displayed on the detection method icon display area 410.

As illustrated in FIG. 11, the sensing type icon 411 may include a button type sensing type icon, a sliding touch sensing type icon, and an event sensing type icon. However, it is not limited to this.

The user may input a command signal for controlling the kit 10 based on the presence or absence of the user's touch, the user's sliding touch, the position change of the terminal 20, and external environment information. The user may determine a method of generating a command signal according to the selection of the detection method icon 411.

Referring to FIG. 12, the terminal 20 may display the 5-1 user interface 501 in response to the selection of the detection method icon 411. The 5-1 user interface 501 may display a plurality of detection icons 511 in the detection icon display area 510. The plurality of detection icons 511 are configured with icons including images of various shapes so that the user can easily distinguish driving means to be controlled among driving means in the kit 10.

Referring to FIG. 13, the terminal 20 may display the 5-2 user interface 502 in response to selection of any one of a plurality of detection icons 511. The 5-2 user interface 502 may include a first selected icon display area 520 and a detailed detection type icon display area 530. The sensing icon 521 selected through the 5-1 user interface 501 may be displayed on the first selected icon display area 520. The detailed detection method icon 531 may be displayed on the detailed detection method icon display area 530. The terminal 20 may display a plurality of detailed detection method icons 531 previously matched with the detection method icon selected by the user in the fourth user interface 400. Accordingly, when the detection method icon selected by the user in the fourth user interface 400 changes, a plurality of detailed detection method icons 531 displayed in the 5-2 user interface 502 may vary. As illustrated, if the user selects the button type detection method icon 411, a plurality of detailed detection method icons 531 related to the operation of the button is displayed. The illustrated detailed detection method icon 531 may include a detailed detection method icon indicating when a button is pressed and a detailed detection method icon indicating a case where the button is released. When the button is pressed, it means that the user touches the selected sensing icon 511 on the touch screen 110 using a touch tool such as a body or a stylus, and when the button is released, the selected sensing icon It means a case in which the touch of 511 is released.

As another example not shown, when a sensing type icon of a sliding touch type is selected, a plurality of detailed sensing type icons may be configured as detailed sensing type icons representing various sliding touch types. The plurality of detailed sensing type icons may be configured as icons representing the time of the sliding touch, the length of the sliding touch, and the directions of the sliding touch. The user may input a command signal by sliding touching the selected sensing icon 511 on the touch screen 110.

As another example, not shown, when various types of event type detection icons are selected, the plurality of detailed detection type icons may include a plurality of detailed detection type icons representing various events. The plurality of detailed sensing method icons may be configured as icons representing various external environment information, various sensing information received from the kit 10, and various sensing information sensed by the terminal 20.

The terminal 20 receives various environment information, such as weather information and temperature information, received from the server 40 when the user sets the event condition set by the user through the block control user interface 32 or from the kit 10 When the various types of sensing information satisfy the conditions of the event set by the user through the user interface 32 for block control, or various sensing information sensed by the terminal 20 is set by the user through the block control user interface 32 When the condition of one event is satisfied, a driving signal for driving the kit 10 may be generated.

For example, with respect to various sensing information received from the kit 10, sensing information received from a sensor in the sensor block 17 of the kit 10, for example, the distance between the kit 10 and surrounding objects When sensing information, ambient illumination information, ambient sound information, etc. satisfy the condition of the event set by the user through the user interface 32 for block control, the terminal 20 generates a driving signal for driving the kit 10 can do.

For example, in connection with various sensing information received from the kit 10, sensing information received from various sensors of the terminal 20, for example, shaking information of the terminal 20, tilt information of the terminal 20 When the location information of the terminal 20, the angle information of the terminal 20, the ambient illumination information, the ambient sound information, the time information, etc. satisfy the conditions of the event set by the user through the user interface 32 for block control The terminal 20 may generate a driving signal for driving the kit 10.

Referring to FIG. 14, the terminal 20 may display the sixth user interface 600 in response to the selection of any one of the detailed detection type icons 531.

The sixth user interface 600 may include a second selected icon display area 610 and a driving system icon display area 620.

The second selected icon display area 610 may display a second selected icon 611 that is all icons selected by the user, and a plurality of drive system icons 621 may be displayed in the drive system icon display area 620. The plurality of driving system icons 621 may be icons representing each of various driving means in the kit 10 identified through the first to third user interfaces 100, 200, and 300.

The user may select an icon that matches the driving means to be controlled from among the driving means in the kit 10 among the displayed plurality of driving system icons 621.

Referring to FIG. 15, the terminal 20 may display the seventh user interface 700 in response to the selection of any one of the plurality of driving system icons 621.

The seventh user interface 700 may include a third selected icon display area 710 and a driving method icon display area 720.

All icons selected by the user may be displayed on the third selected icon display area 710.

A driving method icon 721 may be displayed on the driving method icon display area 720.

The terminal 20 may display a plurality of driving method icons matching the driving system icon selected by the user on the sixth user interface 600. For example, when the icon of the drive system selected by the user is a servo motor, the icon means the advance of the kit 10 according to the rotation of the servo motor in one direction and the kit 20 according to the rotation of the servo motor in the other direction. A plurality of driving method icons consisting of icons may be displayed. In addition, an icon indicating stop of driving may be further displayed.

Referring to FIG. 16, in some embodiments, the seventh user interface 700 may display a plurality of additional driving method icons 731 in the additional driving method icon display area 730. The terminal 20 deletes the driving system icon represented by the driving means displayed on the third selected icon display area 710 in response to the selection of any one of the plurality of additional driving method icons 731, the sixth user interface 600 ), and the location of the driving means displayed on the third selected icon display area 710 can be performed. When the user wants to add a driving means for controlling, the user can select an icon that means adding the driving means, and the terminal 20 responds in response to displaying the sixth user interface 600 again, thereby further selecting the driving means. You can make it possible.

Referring to FIG. 17, the terminal 20 may display the eighth user interface 800 in response to selection of any one of the driving method icons 721.

The eighth user interface 800 may include a fourth selected icon display area 810 and an icon display area 820 for additional control check.

Icons selected by the user may be displayed on the fourth selected icon display area 810.

An additional control icon 821 may be displayed on the icon display area 820 for checking whether additional control is performed. The additional control icon 821 may include an additional progress icon 822 and a control signal generation complete icon 823.

The user may generate control information of the driving means through the fourth to seventh user interfaces, and may select an additional progress icon 822 to generate control information of the additional driving means. As another example, when the generation of the control information is completed, the control signal generation complete icon 823 may be selected.

According to the illustrated example of FIG. 17, it can be seen that icons representing a driving method of a driving means according to a detailed sensing method icon selected corresponding to one sensing icon are displayed.

The terminal 20 may execute the fourth user interface 400 or the 5-2 user interface 502 in response to the selection of the user's additional progress icon 822.

Referring to FIG. 18, the terminal 20 may display the ninth user interface 900 in response to the selection of the control signal generation complete icon 823. A control target icon 911 may be included on the edit board area 420 of the ninth user interface 900. The control target icon 911 may be a control target icon 911 that is an icon including summary information of selected icons displayed on the eighth user interface 800. The user can control a plurality of driving means through different processes through the above-described process. In addition, control target icons 911 corresponding to a plurality of detection methods may be displayed. In addition, the user can repeat the above-described process for further controlling the driving means by selecting the sensing method icon 411 on the sensing method icon display area 410.

The terminal 20 may execute the tenth user interface 1000 illustrated in FIG. 19 in response to the selection of the execution icon 912.

The tenth user interface 1000 may display a sensing icon 511 selected by the user.

When the command signal matching the detection method linked to the selected detailed detection method icon is received, the terminal 20 generates a command matching the command signal and transmits it to the kit 10 to control the driving means of the kit 10 can do.

For example, the terminal 20 matches the user's command signal when a user's command signal matching the detection method associated with the selected detailed detection method icon is received through the touch input of the detection icon 511 of FIG. 19. It is possible to control the driving means by sending the command to the kit (10).

As illustrated in FIG. 17, when the user touches the detection icon 511, a command signal for advancing the kit 10 is transmitted to the kit 10, and when the touch is released, the movement of the kit 10 is stopped. Command signals can be sent to the kit 10.

As another example, when the user's command signal matching the detection method associated with the selected detailed detection method icon is received through the positional change of the terminal 20, the terminal 20 sets the command matching the user's command signal to the kit 10. The transmission means can be controlled.

In detail, different command words are generated according to the rotation, shaking, angle change, and position change of the terminal 20 and transmitted to the kit 10, and the kit 10 may be controlled in response to the motion of the terminal 20. .

In detail, different command words are generated and transmitted to the kit 10 according to various sensing information sensed by the terminal 20, and the kit 10 may be controlled in response to the motion of the terminal 20.

As another example, when the sensing information serving as a user's command signal matching the detection method linked to the selected detailed detection method icon is received from the kit 10, the terminal 20 sets the command matching the sensing information to the kit 10 ) To control the driving means.

In detail, different command words are generated and transmitted to the kit 10 according to various sensing information sensed by the kit 10, and the kit 10 may be controlled in response to the motion of the terminal 20.

In some embodiments, when the terminal 20 receives a user's command signal matching a detection method linked to a selected detailed detection method icon through a touch input of a selected detection icon, the terminal 20 is configured from the kit 10 to the kit 10. Current location information can be received. In addition, the terminal 20 may detect the user's gaze information from a sensor provided on the terminal 20. In order to detect the user's gaze information, the gaze viewed by the user may be estimated based on at least one of the eye sensor, the sensing information of the face recognition sensor, and the analysis information of the captured image of the camera.

For example, the terminal 20 analyzes a user's face image to analyze whether it is a front region image of a face, a side image of one side of the face, or a side image of the other side of the face, The user's gaze may be estimated by comprehensively analyzing whether the user's gaze is facing the camera according to whether sensing is performed.

In addition, the terminal 20 may determine whether the estimated user's gaze matches the current location of the kit 10, that is, whether the user's gaze is directed to an area where the kit 10 is currently located. At this time, the terminal 20 may determine the relative positional relationship between the terminal 20 and the kit 10 by additionally using its location information.

When the terminal 20 determines that the user's gaze is directed to the kit 10, the terminal 20 transmits a command matched to the command signal of the user received through the user's touch input to the kit 10 to control the kit 10. Can be. In addition, when the kit 10 moves, the terminal 20 may continuously monitor the position of the kit 10 according to the movement of the kit 10 and simultaneously monitor the direction of the user's gaze. In addition, when it is estimated that the user's gaze is not directed toward the kit 10, the terminal 20 may generate a command signal to stop control of the kit 10 and transmit it to the kit 10. The embodiment may widen the use range of the kit through estimation of the user's gaze. For example, when the camera is mounted on the kit 10, when the user's gaze is directed to the kit 10, the photographing function of the camera provided in the kit 10 can be driven so that the user can take a selfie camera. In addition, at the same time, various applications are possible, such as being able to photograph the user while moving around the user's periphery according to the movement control of the kit 10, or to photograph the user while moving away from or near the user.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and can be recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, or the like alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention or may be known and usable by those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. medium), and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes produced by a compiler, but also high-level language codes executable by a computer using an interpreter or the like. The hardware device can be changed to one or more software modules to perform the processing according to the present invention, and vice versa.

The specific implementations described in the present invention are exemplary embodiments, and do not limit the scope of the present invention in any way. For brevity of the specification, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of the lines between the components shown in the drawings are illustrative examples of functional connections and/or physical or circuit connections. In the actual device, alternative or additional various functional connections, physical It can be represented as a connection, or circuit connections. In addition, unless specifically mentioned, such as “essential”, “importantly”, etc., it may not be a necessary component for application of the present invention.

In addition, the detailed description of the present invention has been described with reference to preferred embodiments of the present invention, but those skilled in the art or those of ordinary skill in the art will appreciate the spirit of the present invention as set forth in the claims below. And it will be understood that various modifications and changes can be made to the present invention without departing from the technical scope. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

Coupling groove (1)
Combined projection (2)
Kit (10)
At least one base block (11)
At least one main block (12)
Block Processor(121)
Block memory (122)
Block communication unit (123)
Main control unit (129)
At least one drivetrain block (13)
At least one moving block (14)
Driving means (141)
Communication cable(15)
Connection block (16)
Sensor Block(17)
Terminal (100)
Power System(101)
Accelerometer(102)
GPS Receiver(103)
Display (110)
Display controller (111)
Input controller (112)
Peripheral interface (120)
Input/output (I/O) subsystem 130
Camera System(150)
Sensor (160)
RF Circuit(170)
Processor(180)
Memory (190)
Memory controller (191)
Operating System(192)
Communication module (or set of instructions) 193
Contact/motion module (or set of instructions) 194
Graphics module (or set of instructions) 195
Text input module (or set of instructions) 196
Global Positioning System (GPS) module (or set of instructions) 197
Applications (or sets of instructions) 198
Event Classifier(199)
Event monitor (199a)
Server(40)
User interface for connecting blocks (31)
First user interface 100
Multiple block icon (101)
Second user interface 200
Selected block icon (210)
Third user interface 300
Connection block icon (310)
Connection relationship selection affordance (320)
User Interface for Block Control(32)
Fourth user interface 400
Detection Icon Display Area (410)
Detection Method Icon(411)
Edit Board Area (420)
5-1 User Interface (501)
Detection icon display area (510)
Detection Icon(511)
5-2 User Interface 502
First selected icon display area 520
Selected Icon (521)
Detailed detection method icon display area (530)
Detailed detection method icon(531)
Sixth user interface (600)
Second selected icon display area 610
Second selected icon (611)
Drive system icon display area (620)
Drivetrain icon(621)
Seventh user interface 700
Third selected icon display area 710
Driving method icon display area (720)
Driving method icon(721)
Additional driving method icon display area (730)
Additional driving method icon(731)
Eighth User Interface (800)
The fourth selected icon display area 810
Icon display area for additional control check (820)
Additional control icons (821)
Additional progress icons (822)
Control signal generation complete icon (823)
9th user interface (900)
Control target icon (911)
Tenth user interface (1000)

Claims (6)

Executing an application installed in the terminal to display a user interface for block control;
Displaying a plurality of detection icons in response to selection of any one of a plurality of detection method icons displayed on the block control user interface;
Displaying a plurality of detailed detection type icons in response to selection of any one of the plurality of detection icons;
Displaying a driving system icon corresponding to the driving means included in the kit in response to selection of any one of the plurality of detailed sensing method icons;
Displaying a plurality of driving method icons in response to the selection of the driving system icon;
A plurality of driving means corresponding to the selected drive system icon in response to the selection of any one of the plurality of driving method icons and the selection of the control signal generation complete icon is controlled according to a detection method preset to the detailed detection method icon. Generating a command; And
And receiving a command signal matching the command signal among the plurality of commands to the kit when a command signal matching the sensing method associated with the selected detailed sensing method icon is received.
A method for controlling a kit by generating a command for controlling the kit on a kit control terminal. According to claim 1,
When a user's command signal matching the detection method associated with the selected detailed detection method icon is received through a touch input of the selected detection icon, a command matching the user's command signal among the plurality of commands is transmitted to the kit To control the drive means
A method of controlling a kit by generating a command for controlling the kit on the terminal for controlling the kit. According to claim 1,
When a user's command signal matching the detection method linked to the selected detailed detection method icon is received through a change in the position of the terminal, the command matching the user's command signal among the plurality of commands is transmitted to the kit to drive Controlling means
A method of controlling a kit by generating a command for controlling the kit on the terminal for controlling the kit. According to claim 1,
When sensing information matching the input method associated with the selected detailed input method icon is received from the kit, a command matching the sensing information among the plurality of commands is transmitted to the kit to control the driving means
A method for controlling a kit by generating a command for controlling the kit on a kit control terminal. According to claim 1,
When sensing information matching the input method linked to the selected detailed input method icon is sensed from the sensor unit of the terminal, the command matching the sensing information among the plurality of commands is transmitted to the kit to control the driving means
A method of controlling a kit by generating a command for controlling the kit on the terminal for controlling the kit. According to claim 1,
When a user's command signal matching a detection method linked to the selected detailed detection method icon is received through a touch input of the selected detection icon, it is based on the location information of the kit that satisfies a preset condition and the user's gaze information. To control the driving means by transmitting a command matched to the user's command signal among the plurality of commands to the kit
A method of controlling a kit by generating a command for controlling the kit on the terminal for controlling the kit.

Images