KR102164853B1 - A method for controlling a kit by generating a command for controlling the kit on the kit control terminal - Google Patents

Abstract

The embodiment includes the steps of executing an application installed in a terminal to display a block control user interface; Displaying a plurality of detection icons in response to selection of one of a plurality of detection method icons displayed on the block control user interface; Displaying a plurality of detailed sensing method icons in response to selection of one of the plurality of sensing icons; Displaying a driving system icon corresponding to a driving means included in the kit in response to selection of one of the plurality of detailed sensing method icons; Displaying a plurality of driving method icons in response to selection of the driving system icon; In response to selection of one of the plurality of driving method icons and selection of a control signal generation completion icon, a plurality of driving means corresponding to the selected driving system icon are controlled according to a detection method preset in the detailed sensing method icon. Generating an instruction; And when a command signal matching a detection method linked to the selected detailed detection method icon is received, transmitting a command matched to the command signal among the plurality of commands to the kit to control the driving means; It is possible to provide a method of controlling a kit by generating a command for controlling the kit on a control terminal.

Description

A method for controlling a kit by generating a command for controlling the kit on the kit control terminal}

The present invention relates to a kit and a terminal for controlling the kit, and more particularly, to a method and a system for controlling a kit by generating a command for controlling the kit on a terminal for controlling the kit.

BACKGROUND ART Conventionally, assembling blocks for play and learning have been widely used, in which protrusions and concave portions are provided on the surface of a polyhedron such as a rectangular parallelepiped, a cube, and a triangular pillar, and assembled into a desired shape by fitting the protrusions into the concave portions. In addition, in recent years, it has become popular to include a motor in an assembly block to operate a movable part by a motor.

For example, in Patent Document 1, an assembly block kit for a locomotive mounted with a motor and traveling along a toothed rail is proposed. This is to drive the locomotive by attaching a cogwheel to a drive shaft driven by a motor and rotating the cogwheel by engaging the cog rail. In addition, in Patent Document 2, in addition to the function expression means for expressing functions such as a servo motor or a buzzer, a control means for controlling the function expression means and a communication means for communicating with other assembly blocks through a network are built-in. As a result, an assembling block has been proposed in which a complicated operation is possible with simple wiring. In Patent Document 2, an embodiment of driving a caterpillar of a bulldozer through a gear by a motor is introduced. In addition, the block toy kit for learning in Patent Document 3 makes it possible to easily assemble between each block, between each frame, or between each block and frame, even without using additional screws or adhesives, and rotation of each connection part. Makes this possible. However, in such a conventional kit, the drive of the kit is determined according to a predetermined driving method, and a method for individually controlling various driving parts in the kit is not disclosed. According to Patent Document 4, a technology that uses a computer to develop a control program for a robot has emerged, but the development of a control program for a robot has a limitation that is difficult for beginners to approach, and a lot of knowledge is required for program control, which limits the person who uses the kit. Became.

Japanese Patent Publication No. Hei 7-61382 Japanese Unexamined Patent Application Publication No. Hei 10-108985 Korean Patent Application Publication No. 10-2011-0101739 Korean Patent Application Publication No. 10-2012-0036680

An object of the present invention is to provide a kit control method and a system for the same, simplifying kit manufacturing by removing cables and wires, which were complicated in the related art, and improving the convenience of kit control.

In addition, an object of the present invention is to provide a kit control method and a system for the same, with improved convenience in generating a kit control instruction through an interactive coding method.

In addition, an object of the present invention is to provide a method and system for enabling the control of a kit without space limitation through the kit control using communication.

In addition, an object of the present invention is to provide a method and a system for generating a kit control command through a simple icon selection process of a user interface.

The embodiment includes the steps of executing an application installed in a terminal to display a block control user interface; Displaying a plurality of detection icons in response to selection of one of a plurality of detection method icons displayed on the block control user interface; Displaying a plurality of detailed sensing method icons in response to selection of one of the plurality of sensing icons; Displaying a driving system icon corresponding to a driving means included in the kit in response to selection of one of the plurality of detailed sensing method icons; Displaying a plurality of driving method icons in response to selection of the driving system icon; In response to selection of one of the plurality of driving method icons and selection of a control signal generation completion icon, a plurality of driving means corresponding to the selected driving system icon are controlled according to a detection method preset in the detailed sensing method icon. Generating an instruction; And when a command signal matching a detection method linked to the selected detailed detection method icon is received, transmitting a command matched to the command signal among the plurality of commands to the kit to control the driving means; It is possible to provide a method of controlling a kit by generating a command for controlling the kit on a control terminal.

In another aspect, when a user's command signal matching the sensing method linked with the selected detailed sensing method icon is received through a touch input of the selected sensing icon, a command matching the user's command signal among the plurality of commands is transmitted. It is possible to provide a method of controlling a kit by generating a command for kit control on a kit control terminal that transmits to the kit and controls the driving means.

In another aspect, when a user's command signal matching the sensing method linked to the selected detailed sensing method icon is received through a position change of the terminal, the kit is provided with a command matched to the user's command signal among the plurality of commands. It is possible to provide a method of controlling a kit by generating a command for kit control on a kit control terminal that transmits to and controls the driving means.

In another aspect, when sensing information matching the input method linked to the selected detailed input method icon is received from the kit, a command matching the sensing information among the plurality of commands is transmitted to the kit to control the driving means doing

It is possible to provide a method of controlling a kit by generating a command for kit control on a kit control terminal.

In another aspect, when sensing information matching the input method linked to the selected detailed input method icon is sensed from the sensor unit of the terminal, a command matching the sensing information among the plurality of commands is transmitted to the kit and the drive It is possible to provide a method of controlling a kit by generating a command for kit control on a kit control terminal for controlling the means.

In another aspect, when a user's command signal matching the sensing method linked with the selected detailed sensing method icon is received through a touch input of the selected sensing icon, the location information of the kit and the user satisfying a preset condition A method of controlling a kit by generating a command for kit control on a kit control terminal that controls the driving means by transmitting a command matched to the command signal of the user among the plurality of commands based on gaze information of Can provide.

The embodiment simplifies kit manufacturing by removing cables and wires, which have been complicated in the related art, and improves the convenience of kit control.

In addition, the convenience of generating a kit control instruction through an interactive coding method is improved.

In addition, it is possible to control the kit without space constraints through the kit control using communication.

In addition, it is possible to generate a command for controlling the kit through a simple icon selection process through the user interface.

In addition, it applies a sequential coding technique to create sentences, introduces graphic user interfaces such as various icons to complement sentence complexity, and allows users to quickly and easily kit without knowing the programming areas such as repetitions that are basically required when generating commands. You can create control commands.

1 illustrates a system for implementing a method of controlling a kit by generating a command for controlling a kit on a kit control terminal according to an embodiment of the present invention.
2 is an exemplary diagram for a kit according to an embodiment of the present invention.
3 is an exemplary view of components constituting the kit.
4 is an exemplary diagram showing a connection relationship between blocks constituting a kit.
5 is a block diagram of a main control unit in a main block.
6 and 7 provide a description of an exemplary terminal.
8 is an exemplary diagram of a first user interface.
9 is an exemplary diagram of a second user interface.
10 is an exemplary diagram of a third user interface.
11 is an exemplary diagram of a fourth user interface.
12 is an exemplary diagram of a 5-1 user interface.
13 is an exemplary diagram of a 5-2 user interface.
14 is an exemplary diagram of a sixth user interface.
15 is an exemplary diagram of a seventh user interface.
16 is an exemplary diagram of a seventh user interface of still another example.
17 is an exemplary diagram of an eighth user interface.
18 is an exemplary diagram of a ninth user interface.
19 is an exemplary diagram of a tenth user interface.

Since the present invention can apply various transformations and have various embodiments, specific embodiments are illustrated in the drawings and will be described in detail in the detailed description. Effects and features of the present invention, and a method of achieving them will be apparent with reference to the embodiments described later in detail together with the drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various forms. In the following embodiments, terms such as first and second are not used in a limiting meaning, but for the purpose of distinguishing one component from another component. In addition, expressions in the singular include plural expressions unless the context clearly indicates otherwise. In addition, terms such as include or have means that the features or elements described in the specification are present, and do not preclude the possibility of adding one or more other features or elements in advance. In addition, in the drawings, the size of components may be exaggerated or reduced for convenience of description. For example, the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of description, and the present invention is not necessarily limited to what is shown.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, and when describing with reference to the drawings, the same or corresponding constituent elements are assigned the same reference numerals, and redundant descriptions thereof will be omitted. .

1 is a diagram showing a system for implementing a method of controlling a kit by generating a command for kit control on a kit control terminal according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating a kit according to an embodiment of the present invention. FIG. 3 is an exemplary view of components constituting a kit, FIG. 4 is an exemplary view showing a connection relationship between blocks constituting a kit, and FIG. 5 is a block diagram of a main control unit in a main block. In addition, FIGS. 6 and 7 provide a description of an exemplary terminal.

Now, the embodiments will be referred to in detail, and examples of the embodiments are illustrated in the accompanying drawings. In the detailed description that follows, many specific details are set forth to provide a thorough understanding of the various described embodiments. However, it will be apparent to those of ordinary skill in the art to which the present invention pertains that various described embodiments can be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.

In some examples, the terms, first, second, etc. are used herein to describe various elements, but it will also be understood that these elements should not be limited to these terms. These terms are only used to distinguish one element from another. For example, a first contact may be referred to as a second contact, and similarly, a second contact may be referred to as a first contact without departing from the scope of the various described embodiments. The first contact and the second contact are both contacts, but they are not the same contact.

Terms used in the description of the various embodiments described herein are for the purpose of describing specific embodiments only, and are not intended to be limiting. As used in the description of the variously described embodiments and in the appended claims, the singular form is intended to include the plural forms as well, unless the context clearly indicates otherwise. In addition, it will be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated items listed. As used herein, the terms include the stated features, integers, steps, actions, elements, and/or components that specify the presence of, but one or more other features, integers, steps, actions It will be further understood that the presence or addition of, elements, components, and/or groups thereof is not excluded.

As used herein, the term "if" means "when ..." or "when ..." or "in response to determining" or "in response to detecting," depending on the context. Is interpreted as doing. Similarly, the phrase "when determined" or "when [the stated condition or event] is detected" is, optionally, depending on the context, "at the time of determination" or "in response to the determining" or "[the stated condition or Event] is construed to mean "on detection" or "in response to detecting [the mentioned condition or event]".

The kit 10 is composed of a plurality of blocks. The kit 10 may include at least one base block 11, at least one main block 12, at least one drive system block 13, and at least one moving block 14.

A coupling groove (1) and a coupling protrusion (2) are formed on the outer surface of each block, and the coupling protrusions (2) of another block are coupled to each other to the coupling groove (1) of one block, thereby assembling the blocks to each other. This assembly enables the assembly of the block in a location or direction desired by the user and physical coupling between various types of blocks.

Various electronic devices may be provided inside the block. For example, a main control unit 129 including a block processor 121, a block memory 122, and a block communication unit 123 may be installed in the main block 12. Various components constituting the main control unit 129 may be independently configured in a plurality of main blocks instead of one main block 12.

Block memory 122 includes instructions (eg, executable instructions) such as computer-readable instructions or processor-readable instructions. The instructions may include one or more instructions executable by each of the one or more block processors 121.

Drive means may be installed in the drive system block 13. The driving means may be a device that converts electrical signals into physical signals, such as various servo motors. However, the present invention is not limited thereto, and the drive system block 13 may include a light source device or a display device for visual, auditory, and physical display.

The main control unit 129 may generate a control signal and transmit the control signal to a driving means in the drive system block 13. The driving means can be driven based on the control signal. The movable block 14 is connected to the drive system block 13, more specifically, is coupled to a driving means inside the drive system block 13, so that the movable block 14 may be moved in position according to the driving of the driving means. Exemplarily, the moving block 14 may rotate about the driving means by rotational force from the driving means.

The kit 10 may further include a communication cable 15 for data transmission between blocks. The communication cable 15 is coupled to connection terminals provided in the blocks to exchange electric signals between blocks incorporating an electronic device, thereby enabling data communication between the blocks. However, it should be noted that the communication is not limited to the wired method and can be communicated by the wireless method.

In some embodiments, the kit 10 may further include a connection block 16, and the kit 10 may be transformed into various shapes by the connection block 16.

In some embodiments, the kit 10 may further include a sensor block 17. The sensor block 17 may be a block in which at least one of a camera device, sensors for sensing various types of information, and a microphone device is embedded.

Embodiments of terminals, user interfaces for such terminals, and associated processes for using such terminals are described.

In the discussion below, a terminal comprising a display and a touch-sensitive surface is described. However, it should be understood that the terminal optionally includes one or more other physical user interface devices such as a physical keyboard, mouse and/or joystick.

Terminals typically support a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disc authoring applications, spreadsheet applications, game applications, phone applications, video conferencing applications, and email. Applications, instant messaging applications, exercise support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and/or digital video player applications.

Various applications running on the terminal, optionally, use at least one universal physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface as well as corresponding information displayed on the device are, optionally, adjusted and/or varied from one application to the next and/or within each application. In this way, the universal physical architecture of the device (such as a touch-sensitive surface) supports a variety of applications, optionally using user interfaces that are intuitive and clear to the user.

Attention is now directed to embodiments of portable terminals with touch-sensitive displays. 6 is a block diagram illustrating a portable terminal 10 having touch-sensitive displays 110 according to some embodiments. The touch-sensitive display 110 is sometimes referred to as a “touch screen” for convenience, and is sometimes known or referred to as a touch-sensitive display system. The terminal 10 includes a memory 190 (optionally including one or more computer-readable storage media), a memory controller 191, one or more processing units (CPUs) 180, a peripheral device interface 120, and an RF circuit. 170, an input/output (I/O) subsystem 130, other input or control devices 140, and a camera system 150. The terminal 10 is, optionally, one or more intensity sensors 160 for detecting the intensity of the contacts on the terminal 10 (for example, touch-sensitive, such as the touch-sensitive display system 110 of the terminal 10). Mold surface). Terminal 10 is, optionally, for generating tactile outputs on terminal 10 (for example, on a touch-sensitive display system 110 of terminal 10 or on a touch-sensitive surface such as a touchpad). And one or more tactile output generators) for generating tactile outputs. These components optionally communicate via one or more communication buses or signal lines.

The terminal 10 is just an example, and the terminal 10 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of components. It should be recognized. The various components shown in FIG. 6 are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and/or application specific integrated circuits.

The memory 190 optionally includes a high speed random access memory, and optionally, also includes a nonvolatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other nonvolatile solid state memory devices. Access to memory 190 by other components of terminal 10 such as CPU 180 and peripherals interface 120 is, optionally, controlled by memory controller 191.

The peripheral device interface 120 may be used to connect input and output peripheral devices of the device to the CPU 180 and the memory 190. One or more processors 180 drive or execute various software programs and/or sets of instructions stored in the memory 190 to perform various functions for the terminal 10 and process data.

In some embodiments, the peripherals interface 120, CPU 180 and memory controller 191 are, optionally, implemented on a single chip, such as a chip. In some other embodiments, they are optionally implemented on separate chips.

The radio frequency (RF) circuit 170 receives and transmits RF signals, also referred to as electromagnetic signals. The RF circuit 170 converts electrical signals to/from electromagnetic signals, and communicates with communication networks and other communication devices via the electromagnetic signals. The RF circuit 170 optionally includes an antenna system, an RF transceiver, one or more amplifiers, tuners, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. Includes, but not limited to, well-known circuits for performing these functions. The RF circuit 107 optionally includes networks such as the Internet, an intranet, and/or a wireless network, also referred to as the World Wide Web (WWW), such as a cellular telephone network, a wireless local area network (LAN), and/or It communicates with a metropolitan area network (MAN), and other devices by wireless communication. Wireless communication, optionally, GSM (Global System for Mobile Communications), EDGE (Enhanced Data GSM Environment), HSDPA (high-speed downlink packet access), HSUPA (high-speed uplink packet access), EV-DO (Evolution, Data-Only), HSPA, HSPA+, DC-HSPDA (Dual-Cell HSPA), LTE (long term evolution), NFC (near field communication), W-CDMA (wideband code division multiple access), CDMA (code division multiple access) ), time division multiple access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), voice over Internet Protocol (VoiP) , Wi-MAX, protocols for email (e.g., Internet message access protocol (IMAP) and/or post office protocol (POP)), instant messaging (e.g., extensible messaging and presence protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions), Instant Messaging and Presence Service (IMPS)), and/or Short Message Service (SMS), or any other suitable communication protocols not yet developed as of the filing date of this document. Multiple communication standards, protocols and technologies, including but not limited to communication protocols Use any of these.

The camera system 150 provides a camera interface between the user and the terminal 10. The camera system 150 converts the captured image into an electrical signal, processes the electrical signal, and transmits the image to the display 110 or the memory 190. The camera system 150 converts the electrical signal into image data and transmits it to the peripheral device interface 120 for processing. The image data is selectively fetched from and/or transmitted to the memory 190 by the peripheral device interface 120.

I/O subsystem 130 connects input/output peripherals on terminal 10 to peripherals interface 120, such as touch screen 110 and other input control devices 140. The I/O subsystem 130 optionally includes a display controller 111 and one or more input controllers 112. One or more input controllers 112 receive/transmit electrical signals from/to other input or control devices 140. Other input control devices 140 optionally include physical buttons (eg, push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and the like. In some alternative embodiments, the input controller(s) 160 is optionally connected (or not connected to any) to any of a keyboard, infrared port, USB port, and pointer device such as a mouse.

The touch-sensitive display 110 provides an input interface and an output interface between the terminal 10 and a user.

The display controller 111 receives and/or transmits electrical signals from/to the touch screen 110. The touch screen 110 displays a visual output to the user. Visual output, optionally, includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects.

The touch screen 110 has a touch-sensitive surface, sensor or set of sensors that accept input from a user based on haptic and/or tactile contact. The touch screen 110 and the display controller 111 (along with any associated modules and/or sets of instructions in the memory 190) contact on the touch screen 110 (and any movement or interruption of the contact). And converts the detected contact into an interaction with user interface objects (eg, one or more soft keys, icons, web pages, or images) displayed on the touch screen 110. In an exemplary embodiment, the point of contact between the touch screen 110 and the user corresponds to the user's finger.

The touch screen 110 optionally uses LCD (liquid crystal display) technology, LPD (light-emitting polymer display) technology, or LED (light-emitting diode) technology, but other display technologies are used in other embodiments. The touch screen 110 and the display controller 111 may optionally include proximity sensor arrays other than capacitive, resistive, infrared and surface acoustic wave technologies to determine one or more points of contact with the touch screen 110 or Detect contact and any movement or interruption thereof using any of a plurality of touch sensing technologies currently known or to be developed in the future, including, but not limited to, other elements.

The touch screen 110 is, optionally, in contact with the touch screen 110 using any suitable object or attachment such as a stylus, a finger, or the like. In some embodiments, the user interface is designed to operate primarily using finger-based contacts and gestures, which may be less precise than stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the terminal 10 converts the rough finger-based input into a precise pointer/cursor position or command for performing the user's desired actions.

In some embodiments, in addition to the touch screen, the terminal 10 optionally includes a touch pad (not shown) for activating or deactivating certain functions. In some embodiments, the touchpad is a touch-sensitive area of the device that does not display a visual output unlike a touch screen. The touchpad is, optionally, a touch-sensitive surface separated from the touch screen 110 or an extension of the touch-sensitive surface formed by the touch screen.

Terminal 10 also includes a power system 101 for supplying power to various components. Power system 101 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g. , Light emitting diodes (LEDs)), and any other components associated with the generation, management and distribution of power within portable terminals.

Terminal 10 also optionally includes one or more accelerometers 102. 6 shows the accelerometer 102 connected to the peripherals interface 120. Alternatively, accelerometer 102 is optionally connected to input controller 112 in I/O subsystem 130. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on analysis of data received from one or more accelerometers.

Terminal 10, optionally, in addition to the accelerometer(s) 102, a magnetometer (not shown), and a GPS for acquiring information about the position and orientation (e.g., vertical or horizontal) of the terminal 10 (Or GLONASS or other global navigation system) and includes a receiver 103.

In addition, the terminal 10 may use the GPS receiver 103 to detect location information of the terminal 10.

In some embodiments, software components stored in memory 190 include operating system 192, communication module (or set of instructions) 193, contact/motion module (or set of instructions) 194, graphics module ( Or a set of instructions) 195, a text input module (or set of instructions) 196, a satellite positioning system (GPS) module (or set of instructions) 197, and applications (or sets of instructions). (198).

In some embodiments, memory 190 includes event classifier 199 and an application.

The event classifier 199 receives event information and determines an application that has delivered the event information. The event classifier 199 includes an event monitor 199a. In some embodiments, event monitor 199a receives event information from peripherals interface 120. The event information includes information on a specific location of the terminal 10. Accordingly, the information that the event monitor 199a receives from the peripheral device interface 120 includes information from the GPS receiver 103.

7 illustrates a terminal 10 having a touch screen 110 according to some embodiments. The touch screen 110 optionally displays one or more graphics within the user interface (UI) 200. In other embodiments described below, but not only in this embodiment, the user may use, for example, one or more fingers (not drawn to scale in the drawings) or one or more stylus (not drawn to scale in the drawings). By making a gesture on the image it becomes possible to select one or more of the graphics. In some embodiments, the selection of one or more graphics occurs when the user stops contacting the one or more graphics. In some embodiments, the gesture may optionally be one or more taps of a finger in contact with the terminal 10, one or more swipes (from left to right, right to left, up and/or down) and/or (to the right). Left, left to right, up and/or down) rolling. In some implementations or situations, unintended contact with the graphic does not select the graphic. For example, if the gesture corresponding to the selection is a tap, the swipe gesture swiping over the application icon, optionally, does not select the corresponding application.

The server 40 transmits and receives data to and from the terminal 10 through a network. In more detail, the server 40 may transmit various types of data required to execute an application of the terminal 10. In addition, information received from the terminal 10 may be converted into a database. In addition, the server 40 may serve as a relay for transmitting information received from another terminal to another terminal. In addition, the server 40 may serve as a relay for transmitting information received from any one terminal 10 to the kit 10 and/or transmitting information received from the kit 10 to the terminal 10. . In addition, the server 40 may function to provide an application executable file to the terminal 10 in response to a request from the terminal 10. In addition, the server 40 may perform overall management of an application executed in the terminal 10 through communication.

Attention is now directed to embodiments of user interfaces (“UI”) that are selectively implemented on the terminal 10.

The user interface may include a user interface 31 for block connection and a user interface 32 for block control.

The user interface is displayed according to the execution of the application 198 installed in the terminal 10.

8 is an exemplary diagram of a first user interface, FIG. 9 is an exemplary diagram of a second user interface, FIG. 10 is an exemplary diagram of a third user interface, FIG. 11 is an exemplary diagram of a fourth user interface, and FIG. 12 Is an exemplary diagram of a 5-1 user interface, FIG. 13 is an exemplary diagram of a 5-2 user interface, FIG. 14 is an exemplary diagram of a sixth user interface, and FIG. 15 is an exemplary diagram of a seventh user interface, 16 is an exemplary diagram of a seventh user interface of another example, FIG. 17 is an exemplary diagram of an eighth user interface, FIG. 18 is an exemplary diagram of a ninth user interface, and FIG. 19 is an exemplary diagram of a tenth user interface .

8 to 10, the first user interface 100 may be displayed after the application 198 is executed. The first user interface 100 may display a plurality of block icons 101 and detect selection of at least one of the plurality of block icons 101. The plurality of block icons 101 are icons corresponding to the shapes of various blocks, so that the user can easily check the type of block that each of the block icons means through the display of the block icons. The terminal 120 may display the second user interface 200 in response to selection of a plurality of block icons among the plurality of block icons 101. Only the block icon 210 selected by the user through the first user interface 100 may be displayed on the second user interface 200. The terminal 20 may display a third user interface 300 for defining a connection relationship between the selected two block icons in response to selection of two block icons among the displayed block icons.

The third user interface 300 may include a connection block icon 310 and a connection relationship selection affordance 320. The terminal 20 may establish a connection relationship between blocks in response to detection of the selection of the access relationship selection affordance 320 and store the established connection relationship information.

In some embodiments, the third user interface 300 may additionally display information useful for establishing a connection in order to facilitate establishing a connection between blocks.

Referring to FIG. 11, when connection establishment between blocks is completed, the terminal 10 may display a fourth user interface 400.

The fourth user interface 400 may be divided into a sensing method icon display area 410 and an edit board area 420. A plurality of sensing method icons 411 may be displayed in the sensing method icon display area 410.

As illustrated in FIG. 11, the sensing method icon 411 may include a button type sensing method icon, a sliding touch sensing method icon, and an event sensing method icon. However, it is not limited thereto.

The user may input a command signal for controlling the kit 10 based on the presence or absence of a user's touch, a user's sliding touch, a position change of the terminal 20, external environment information, and the like. The user may determine a method of generating a command signal according to the selection of the sensing method icon 411.

Referring to FIG. 12, the terminal 20 may display a 5-1 th user interface 501 in response to a selection of a detection method icon 411. The 5-1 th user interface 501 may display a plurality of sensing icons 511 in the sensing icon display area 510. The plurality of icons for detection 511 is composed of icons including images of various shapes in order for the user to easily identify the driving means to be controlled among the driving means in the kit 10.

Referring to FIG. 13, the terminal 20 may display a 5-2 user interface 502 in response to a selection of one of a plurality of sensing icons 511. The 5-2th user interface 502 may include a first selected icon display area 520 and a detailed detection method icon display area 530. The sensing icon 521 selected through the 5-1 user interface 501 may be displayed in the first selected icon display area 520. The detailed sensing method icon 531 may be displayed in the detailed sensing method icon display area 530. The terminal 20 may display a plurality of detailed sensing method icons 531 previously matched with the sensing method icon selected by the user in the fourth user interface 400. Accordingly, when the sensing method icon selected by the user in the fourth user interface 400 is different, the plurality of detailed sensing method icons 531 displayed in the 5-2 user interface 502 may be different. As illustrated, when the user selects the button-type sensing method icon 411, a plurality of detailed sensing method icons 531 related to button manipulation are displayed. The illustrated detailed sensing method icon 531 may include a detailed sensing method icon indicating when a button is pressed and a detailed sensing method icon indicating a case in which the button is released. When the button is pressed, it means that the user touches the selected detection icon 511 on the touch screen 110 using a touch tool such as a body or a stylus, and when the button is released, the selected detection icon It means the case of releasing the touch of 511.

As another example not shown, when a sliding touch-type sensing method icon is selected, the plurality of detailed sensing method icons may be composed of detailed sensing method icons indicating various sliding touch types. The plurality of detailed sensing method icons may be composed of icons indicating each of the sliding touch time, the sliding touch length, and the sliding touch directions. The user may input a command signal by slidingly touching the selected sensing icon 511 on the touch screen 110.

As another example not shown, when a detection method icon of various event types is selected, the plurality of detailed detection method icons may be composed of a plurality of detailed detection method icons indicating various events. The plurality of detailed sensing method icons may be composed of icons representing various external environment information, various sensing information received from the kit 10, and various sensing information sensed by the terminal 20.

When the terminal 20 satisfies the conditions of an event set by the user through the user interface 32 for block control, or received from the kit 10, various environmental information such as weather information and temperature information received from the server 40 When various sensed information is satisfied with the condition of an event set by the user through the user interface 32 for block control, or various sensing information sensed by the terminal 20 is set by the user through the user interface 32 for block control When the condition of one event is satisfied, a driving signal for driving the kit 10 may be generated.

Exemplarily, in relation to various sensing information received from the kit 10, sensing information received from a sensor in the sensor block 17 of the kit 10, for example, the distance between the kit 10 and surrounding objects When sensing information, ambient illuminance information, ambient sound information, etc. are satisfied with the conditions of an event set by the user through the block control user interface 32, the terminal 20 generates a driving signal for driving the kit 10 can do.

For example, in relation to the various sensing information received from the kit 10, sensing information received from various sensors of the terminal 20, for example, shaking information of the terminal 20, tilt information of the terminal 20 , When the location information of the terminal 20, angle information of the terminal 20, ambient illumination information, ambient sound information, time information, etc. are satisfied with the event conditions set by the user through the block control user interface 32 The terminal 20 may generate a driving signal for driving the kit 10.

Referring to FIG. 14, the terminal 20 may display a sixth user interface 600 in response to a selection of one of the detailed sensing method icons 531.

The sixth user interface 600 may include a second selected icon display area 610 and a driving system icon display area 620.

A second selected icon 611, which is all icons selected by the user, may be displayed in the second selected icon display area 610, and a plurality of driving system icons 621 may be displayed in the driving system icon display area 620. The plurality of drive system icons 621 may be icons representing each of various driving means in the kit 10 identified through the first to third user interfaces 100, 200, and 300.

The user may select an icon matching the driving means to be controlled from among the driving means in the kit 10 from among the displayed plurality of drive system icons 621.

Referring to FIG. 15, the terminal 20 may display a seventh user interface 700 in response to a selection of one of a plurality of driveline icons 621.

The seventh user interface 700 may include a third selected icon display area 710 and a driving method icon display area 720.

All icons selected by the user may be displayed in the third selected icon display area 710.

A driving method icon 721 may be displayed in the driving method icon display area 720.

The terminal 20 may display a plurality of driving method icons matching the driving system icon selected by the user on the sixth user interface 600. For example, if the drive system icon selected by the user is a servo motor, an icon representing the advance of the kit 10 according to the rotation of the servo motor in one direction and the backward movement of the kit 20 according to the rotation of the servo motor in the other direction. A plurality of driving method icons composed of icons indicating "may be displayed. In addition, an icon indicating stop of driving may be further displayed.

Referring to FIG. 16, in some embodiments, the seventh user interface 700 may display a plurality of additional driving method icons 731 in the additional driving method icon display area 730. The terminal 20 deletes a driving system icon represented by a driving means displayed in the third selected icon display area 710 in response to a selection of any one of the plurality of additional driving mode icons 731, and the sixth user interface 600 ), the position of driving means displayed in the third selected icon display area 710 may be changed. When the user wants to add a driving means for control, the user can select an icon indicating the addition of the driving means, and the terminal 20 displays the sixth user interface 600 again in response to this, so that additional selection of the driving means is possible. You can make it possible.

Referring to FIG. 17, the terminal 20 may display an eighth user interface 800 in response to a selection of one of the driving type icons 721.

The eighth user interface 800 may include a fourth selected icon display area 810 and an icon display area 820 for checking whether additional control is performed.

Icons selected by the user may be displayed in the fourth selected icon display area 810.

An additional control icon 821 may be displayed in the icon display area 820 for checking whether or not additional control is performed. The additional control icon 821 may include an additional progress icon 822 and a control signal generation completion icon 823.

The user may generate control information of the driving means through the fourth to seventh user interfaces, and select an additional progress icon 822 to generate control information of the additional driving means. As another example, when the generation of control information is completed, the control signal generation completion icon 823 may be selected.

According to the example illustrated in FIG. 17, it can be seen that icons indicating a driving method of a driving means according to a detailed sensing method icon selected in correspondence with one sensing icon are displayed.

The terminal 20 may execute the fourth user interface 400 or the 5-2 user interface 502 in response to the user's selection of the additional progress icon 822.

Referring to FIG. 18, the terminal 20 may display a ninth user interface 900 in response to selection of a control signal generation completion icon 823. A control target icon 911 may be included on the edit board area 420 of the ninth user interface 900. The control target icon 911 may display a control target icon 911 that is an icon including summary information of selected icons displayed in the eighth user interface 800. The user can control the plurality of driving means through different sensing methods through the above-described process. In addition, control target icons 911 corresponding to a plurality of sensing methods may be displayed. In addition, the user may repeat the above-described process for additionally controlling the driving means by selecting the sensing method icon 411 on the sensing method icon display area 410.

The terminal 20 may execute the tenth user interface 1000 illustrated in FIG. 19 in response to selection of the execution icon 912.

The tenth user interface 1000 may display a sensing icon 511 selected by a user.

When a command signal matching the detection method linked to the selected detailed detection method icon is received, the terminal 20 generates a command matching the command signal and transmits the command to the kit 10 to control the driving means of the kit 10 can do.

Exemplarily, the terminal 20 matches the user's command signal when a user's command signal matching the sensing method linked with the selected detailed sensing method icon is received through the touch input of the sensing icon 511 of FIG. 19. The command can be transmitted to the kit 10 to control the driving means.

As illustrated in FIG. 17, when the user touches the detection icon 511, a command signal for advancing the kit 10 is transmitted to the kit 10, and when the touch is released, the movement of the kit 10 is stopped. A command signal may be transmitted to the kit 10.

As another example, when the user's command signal matching the detection method linked with the selected detailed detection method icon is received through the position change of the terminal 20, the kit 10 sends the command matched to the user's command signal. Can be transferred to control the drive means.

In detail, different commands are generated according to the rotation, shaking, angle change, and position change of the terminal 20 and transmitted to the kit 10, and the kit 10 may be controlled in response to the motion of the terminal 20. .

In detail, different commands are generated according to various sensing information sensed by the terminal 20 and transmitted to the kit 10, and the kit 10 may be controlled in response to the motion of the terminal 20.

As another example, when sensing information that functions as a user's command signal matching the detection method linked to the selected detailed detection method icon is received from the kit 10, the terminal 20 sends the command matched to the sensing information to the kit 10 ) To control the drive means.

In detail, different commands are generated according to various kinds of sensing information sensed by the kit 10 and transmitted to the kit 10, and the kit 10 may be controlled in response to the motion of the terminal 20.

In some embodiments, the terminal 20 receives the user's command signal matching the sensing method linked with the selected detailed sensing method icon through the touch input of the selected sensing icon, the kit 10 from the kit 10 You can receive current location information. In addition, the terminal 20 may detect gaze information of a user from a sensor provided on the terminal 20. In order to detect the user's gaze information, the gaze viewed by the user may be estimated based on at least one of the eye sensor, the sensing information of the face recognition sensor, and the analysis information of the captured image of the camera.

Exemplarily, the terminal 20 analyzes the photographed image of the user's face to analyze whether it is a photographed image of the front region of the face, a photographed image of one side region of the face, and a photographed image of the other side region of the face. The user's gaze may be estimated by comprehensively analyzing whether the user's gaze is directed at the camera according to the sensing status.

In addition, the terminal 20 may determine whether the estimated gaze of the user matches the current location of the kit 10, that is, whether the gaze of the user is directed to an area where the kit 10 is currently located. In this case, the terminal 20 may determine a relative positional relationship between the terminal 20 and the kit 10 by additionally using its own location information.

When determining that the user's gaze is toward the kit 10, the terminal 20 transmits a command matched to the user's command signal received through the user's touch input to the kit 10 to control the kit 10. I can. In addition, when the kit 10 moves, the terminal 20 may continuously monitor the position of the kit 10 according to the movement of the kit 10 and monitor a direction in which the user's gaze is directed. In addition, when it is estimated that the user's gaze is not directed toward the kit 10, the terminal 20 may generate a command signal for stopping control of the kit 10 and transmit it to the kit 10. The embodiment can broaden the range of use of the kit through estimation of the user's gaze. For example, when a camera is mounted on the kit 10, when the user's gaze is directed toward the kit 10, the camera provided in the kit 10 may be operated with a shooting function, so that a user selfie camera can be taken. In addition, various applications are possible, such as photographing the user while moving around the user according to the movement control of the kit 10, or photographing the user while moving away from or closer to the user.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded in the computer-readable recording medium may be specially designed and configured for the present invention or may be known and usable to those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magnetic-optical media such as floptical disks. medium), and a hardware device specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device can be changed to one or more software modules to perform the processing according to the present invention, and vice versa.

The specific implementations described in the present invention are examples, and do not limit the scope of the present invention in any way. For brevity of the specification, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of the lines between the components shown in the drawings exemplarily represent functional connections and/or physical or circuit connections, and in an actual device, various functional connections that can be replaced or additionally It may be referred to as a connection, or circuit connections. In addition, if there is no specific mention such as “essential” or “importantly”, it may not be an essential component for the application of the present invention.

In addition, although the detailed description of the present invention has been described with reference to a preferred embodiment of the present invention, the spirit of the present invention described in the claims to be described later if one skilled in the art or those of ordinary skill in the art And it will be appreciated that various modifications and changes can be made to the present invention within a range not departing from the technical field. Therefore, the technical scope of the present invention should not be limited to the content described in the detailed description of the specification, but should be determined by the claims.

Coupling groove (1)
Coupling protrusion (2)
Kit(10)
At least one base block (11)
At least one main block (12)
Block Processor(121)
Block memory(122)
Block communication unit 123
Main control unit 129
At least one drivetrain block (13)
At least one moving block (14)
Drive means(141)
Communication cable(15)
Connection block(16)
Sensor block(17)
Terminal (100)
Power System(101)
Accelerometer(102)
GPS receiver(103)
Display (110)
Display controller (111)
Input controller (112)
Peripheral Device Interface (120)
Input/Output (I/O) subsystem (130)
Camera system (150)
Sensor(160)
RF circuit(170)
Processor(180)
Memory(190)
Memory controller(191)
Operating system(192)
Communication module (or set of instructions) 193
Contact/motion module (or set of instructions) 194
Graphics module (or set of instructions) 195
Text input module (or set of instructions) 196
Satellite positioning system (GPS) module (or set of instructions) 197
Applications (or sets of instructions) 198
Event Classifier(199)
Event monitor (199a)
Server(40)
User interface for block connection (31)
First user interface 100
Multiple block icons (101)
Second user interface 200
Selected block icon (210)
Third user interface 300
Connection block icon 310
Connection relationship selection affordance (320)
User interface for block control (32)
The fourth user interface 400
Detection method icon display area 410
Detection method icon (411)
Edit board area (420)
5-1 user interface 501
Icon display area for detection (510)
Icon for detection (511)
The 5-2 user interface 502
First selected icon display area 520
Selected Icon (521)
Detailed detection method icon display area (530)
Detailed detection method icon (531)
6th user interface 600
Second selected icon display area 610
The second selected icon 611
Drive system icon display area 620
Drivetrain icon (621)
Seventh user interface 700
Third selected icon display area 710
Driving method icon display area 720
Drive method icon (721)
Additional driving method icon display area 730
Additional drive method icon (731)
Eighth user interface 800
The fourth selected icon display area 810
Icon display area 820 for checking whether additional control is present
Additional Control Icon (821)
Additional Progress Icon (822)
Control signal generation complete icon (823)
9th user interface 900
Control target icon (911)
The tenth user interface 1000

Claims (6)

Executing an application installed in the terminal to display a block control user interface;
Displaying a plurality of detection icons in response to selection of one of a plurality of detection method icons displayed on the block control user interface;
Displaying a plurality of detailed sensing method icons in response to selection of one of the plurality of sensing icons;
Displaying a driving system icon corresponding to a driving means included in the kit in response to selection of one of the plurality of detailed sensing method icons;
Displaying a plurality of driving method icons in response to selection of the driving system icon;
In response to selection of one of the plurality of driving method icons and selection of a control signal generation completion icon, a plurality of driving means corresponding to the selected driving system icon are controlled according to a detection method preset in the detailed sensing method icon. Generating an instruction; And
When a command signal matching the detection method linked to the selected detailed detection method icon is received, transmitting a command matched to the command signal among the plurality of commands to the kit to control the driving means; and
A method of controlling a kit by generating a command for controlling the kit on a kit control terminal. The method of claim 1,
When a user's command signal matching a detection method linked with the selected detailed detection method icon is received through a touch input of the selected detection icon, a command matched with the user's command signal among the plurality of commands is transmitted to the kit. To control the driving means
A method of controlling a kit by generating a command for controlling the kit on a kit control terminal. The method of claim 1,
When a user's command signal matching the sensing method linked to the selected detailed sensing method icon is received through the position change of the terminal, the command matching the user's command signal among the plurality of commands is transmitted to the kit and the drive Means to control
A method of controlling a kit by generating a command for controlling the kit on a kit control terminal. The method of claim 1,
When sensing information matching the input method linked to the selected detailed input method icon is received from the kit, a command matching the sensing information among the plurality of commands is transmitted to the kit to control the driving means.
A method of controlling a kit by generating a command for controlling the kit on a kit control terminal. The method of claim 1,
When sensing information matching the input method linked to the selected detailed input method icon is sensed from the sensor unit of the terminal, a command matching the sensing information among the plurality of commands is transmitted to the kit to control the driving means.
A method of controlling a kit by generating a command for controlling the kit on a kit control terminal. The method of claim 1,
When a user's command signal matching the detection method linked with the selected detailed detection method icon is received through a touch input of the selected detection icon, based on the location information of the kit that satisfies a preset condition and the user's gaze information To control the driving means by transmitting a command matched to the command signal of the user among the plurality of commands to the kit
A method of controlling a kit by generating a command for controlling the kit on a kit control terminal.

Images