KR102348584B1 - Smart trash bin control method, device and program - Google Patents

Abstract

A method for controlling a system including an electronic device and a smart trash bin is disclosed. The smart trash bin comprises: a main body; a photovoltaic rechargeable battery; a photovoltaic panel; an ultrasonic sensor; a servomotor; a connection unit which connects the main body with the servomotor; and a control unit. The control method comprises: a step in which the ultrasonic sensor detects an object around the main body; a step in which the servomotor operates to open a lid of the main body when the object around the main body is detected by the ultrasonic sensor; a step in which the control unit transmits a control signal for maintaining the servomotor for a preset time to the servomotor after the lid is opened and closed; and a step in which the control unit controls the servomotor to close the lid of the main body when the preset time has elapsed. According to the present invention, by means of the method, a user can easily throw away waste.

Description

Smart trash bin control method, device and program {Smart trash bin control method, device and program}

The present invention relates to a method, apparatus and program for controlling a smart trash can.

In general, the trash can is provided with a lid. This is to prevent odors generated from the garbage inside the trash can or the internal garbage from leaking out due to external factors in the case of a trash can without a lid.

A user who uses such a trash can with a lid does not open the lid of the trash can by hand, but pushes the trash can and throws out the trash. Accordingly, it often occurs that the lid of the trash can is contaminated or the trash does not properly enter the trash can during the waste discharging process.

Accordingly, there is a need for a smart trash bin that automatically opens the trash bin lid when a motion to dispose of the trash is detected.

Registered Patent Publication No. 10-2047180, 2019.11.20

The problem to be solved by the present invention is to provide a method, apparatus and program for controlling a smart trash bin.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

The control method of a system including an electronic device and a smart trash bin according to an aspect of the present invention for solving the above-mentioned problems, the smart trash bin includes a main body, a solar rechargeable battery, a solar panel, an ultrasonic sensor, a servo motor, detecting, by the ultrasonic sensor, an object around the main body, including a connection unit and a controller connecting the main body and the servomotor; when the servomotor detects an object around the main body from the ultrasonic sensor, operating to open the lid of the main body; transmitting, by the control unit, a control signal for maintaining the servomotor for a preset time to the servomotor after the lid is opened and closed; and controlling, by the control unit, when the preset time elapses, controlling the servomotor to close the lid of the main body; includes

In this case, the smart trash bin may receive power from the solar rechargeable battery and the solar panel.

In this case, the controller may be configured with an Arduino board, and may control the servomotor and the ultrasonic sensor.

Other specific details of the invention are included in the detailed description and drawings.

According to various embodiments of the present invention described above, the system interlocked with the smart trash bin can provide entertainment to the user while allowing the user to easily dispose of the trash.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a system diagram according to an embodiment of the present invention.
2 is a block diagram of an electronic device according to an embodiment of the present invention.
3 is a block diagram of a smart trash can according to an embodiment of the present invention.
4 is a flowchart for explaining the operation of a smart trash can according to an embodiment of the present invention.
5 and 6 are exemplary views for explaining the opening and closing process of the smart trash can according to an embodiment of the present invention.
7 is an exemplary diagram for explaining an electronic device interworking with a smart trash can according to an embodiment of the present invention.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present invention to be complete, and those of ordinary skill in the art to which the present invention pertains. It is provided to fully understand the scope of the present invention to those skilled in the art, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein will have the meaning commonly understood by those of ordinary skill in the art to which this invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

As used herein, the term “unit” or “module” refers to a hardware component such as software, FPGA, or ASIC, and “unit” or “module” performs certain roles. However, “part” or “module” is not meant to be limited to software or hardware. A “unit” or “module” may be configured to reside on an addressable storage medium or to reproduce one or more processors. Thus, as an example, “part” or “module” refers to components such as software components, object-oriented software components, class components and task components, processes, functions, properties, Includes procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. Components and functionality provided within “parts” or “modules” may be combined into a smaller number of components and “parts” or “modules” or as additional components and “parts” or “modules”. can be further separated.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc. It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms including different directions of components during use or operation in addition to the directions shown in the drawings. For example, when a component shown in the drawing is turned over, a component described as “beneath” or “beneath” of another component may be placed “above” of the other component. can Accordingly, the exemplary term “below” may include both directions below and above. Components may also be oriented in other orientations, and thus spatially relative terms may be interpreted according to orientation.

In this specification, a computer refers to all types of hardware devices including at least one processor, and may be understood as encompassing software configurations operating in the corresponding hardware device according to embodiments. For example, a computer may be understood to include, but is not limited to, smart phones, tablet PCs, desktops, notebooks, and user clients and applications running on each device.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Each step described in this specification is described as being performed by a computer, but the subject of each step is not limited thereto, and at least a portion of each step may be performed in different devices according to embodiments.

1 is a system diagram according to an embodiment of the present invention.

As shown in FIG. 1 , the system according to the present invention may include an electronic device 100 and a smart trash can 200 . In one embodiment, the smart trash bin 200 may open and close the trash bin by sensing a person's approach. As another embodiment, the smart trash bin 200 may open and close the trash bin by sensing the approach of the electronic device 100 . Hereinafter, the configuration of the electronic device 100 and the smart trash can 200 will be described in detail.

2 , the electronic device 100 includes a camera 110 , a processor 120 , a display 130 , an input unit 140 , a microphone 150 , a speaker 160 , a memory 170 , and a communication unit. may contain 180

The camera 110 may capture a background image. Specifically, the camera 110 may capture images of the smart trash bin 200 and surrounding areas according to various embodiments to be described later.

The camera 110 is configured to take an image as described above. The camera 110 may include a lens, a shutter, an aperture, an image sensor, an analog front end (AFE), and a timing generator (TG).

Specifically, the lens (not shown) may include at least one of a zoom lens and a focus lens as a configuration through which light reflected on a subject is incident. A shutter (not shown) controls the time for which light enters the image photographing apparatus 100 . The shutter speed determines the amount of light accumulated in the exposed pixels of the image sensor. The aperture (not shown) is a configuration for controlling the amount of light incident into the image photographing apparatus 100 through the lens. An image sensor (not shown) is configured to form an image of a subject passing through a lens.

The image processing unit 170 may process raw image data photographed by the camera 110 to create YCbCr data. In addition, the image black level is determined, and the sensitivity ratio for each color can be adjusted. In addition, the image processing unit 170 may adjust white balance, and perform gamma correction, color interpolation, color correction, and resolution conversion.

The processor 120 controls the overall operation of the electronic device 100 .

The processor 120 may include a RAM, a ROM, a main CPU, first to n interfaces, and a bus. In this case, the RAM, ROM, main CPU, first to n interfaces, etc. may be connected to each other through a bus.

The ROM stores an instruction set for booting the system, and the like. When a turn-on command is input and power is supplied, the main CPU copies the O/S stored in the memory 170 to the RAM according to the command stored in the ROM, and executes the O/S to boot the system. When booting is completed, the main CPU copies various application programs stored in the memory 170 to the RAM, and executes the application programs copied to the RAM to perform various operations.

The main CPU accesses the memory 170 and performs booting using the O/S stored in the memory 170 . In addition, the main CPU performs various operations using various programs, contents, data, etc. stored in the memory 170 .

The first to n interfaces are connected to the various components described above. One of the interfaces may be a network interface connected to an external device through a network.

The display 130 may be implemented as various types of display panels. For example, the display panel is a Liquid Crystal Display (LCD), Organic Light Emitting Diodes (OLED), Active-Matrix Organic Light-Emitting Diode (AM-OLED), Liquid Crystal on Silicon (LcoS), or Digital Light Processing (DLP). It may be implemented with various display technologies, such as. Also, the display 130 may be coupled to at least one of a front area, a side area, and a rear area of the electronic device 100 in the form of a flexible display.

The input unit 140 may receive a user command. The input unit 140 may be configured in various forms. For example, the input unit 140 may be implemented as a touch screen in combination with the display 130 and the touch sensing unit (not shown). However, it is not limited to this configuration, and the input unit 140 includes a button or may be configured as an external remote control, may be configured as a microphone 150 for voice input, and may be combined with the camera 110 to input motion. can also be performed.

The memory 170 may store an operating system (O/S) for driving the electronic device 100 . Also, the memory 170 may store various software programs or applications for operating the electronic device 100 according to various embodiments of the present disclosure. The memory 170 may store various information such as various data input, set, or generated during execution of a program or application.

In addition, the memory 170 may include various software modules for operating the electronic device 100 according to various embodiments of the present disclosure, and the processor 120 executes various software modules stored in the memory 170 to The operation of the electronic device 100 according to various embodiments of the present disclosure may be performed.

Also, the memory 170 may store spatial images captured by the camera 110 and various images received from the outside. To this end, the memory 150 may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

The communication unit 180 may communicate with an external device. In particular, the communication unit 180 may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, an NFC chip, and a wireless communication chip. At this time, the Wi-Fi chip, the Bluetooth chip, and the NFC chip perform communication in a LAN method, a WiFi method, a Bluetooth method, and an NFC method, respectively. In the case of using a Wi-Fi chip or a Bluetooth chip, various types of connection information such as an SSID and a session key are first transmitted and received, and then various types of information can be transmitted and received after a communication connection using this. The wireless communication chip refers to a chip that performs communication according to various communication standards, such as IEEE, ZigBee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evolution (LTE).

Meanwhile, as shown in FIG. 3 , the smart trash bin 200 may include an ultrasonic sensor 210 , a control unit 220 , a servo motor 230 , a connection unit 240 , and a body 250 .

The ultrasonic sensor 210 is configured to detect a user around the smart trash bin 200 , and senses the surrounding environment under the control of the controller 220 .

Specifically, as shown in FIG. 6 , the ultrasonic sensor 210 may be located at the top of the smart trash bin 200 . However, this is only an example, and according to an embodiment, the ultrasonic sensor 210 may be located on the left, right or bottom of the smart trash bin 200 of course.

The controller 220 is configured to control the ultrasonic sensor 210 and the servomotor 230 . According to an embodiment, the controller 220 may be implemented as an Arduino board.

The ultrasonic sensor 210 is a sensor using the characteristics of ultrasonic waves, which are sounds of a high frequency (about 20 KHz or more) that are inaudible to the human ear. Ultrasound can be used for air, liquids or solids. Because the frequency is high and the wavelength is short, it has the characteristic of being able to measure high resolution. The wavelength used in the ultrasonic sensor is determined by the speed of sound in the medium and the frequency of the sound wave. The ultrasonic sensor has the same ultrasonic wave transmitting element and receiving element, and a magnetostrictive material (ferrite, etc.) or a voltage or electrostrictive material (Rochelle salt, barium titanate, etc.) may be used as the sensor material.

Arduino is a type of microcontroller, a tool for creating interactive objects and digital devices that can sense and control the physical world. It is an open source computing platform and software development environment based on a simple microcontroller board. Arduino can create objects that can interact with the environment by receiving input values from various switches or sensors and controlling the output with electronic devices such as LEDs or motors. For example, various products such as simple robots, thermo-hygrometers, motion sensors, music and sound devices, smart home implementation, infant toys and robot education programs can be developed based on Arduino. Also, Arduino has the advantage that anyone can make and modify the board directly because the circuit is open as an open source.

Arduino board is inexpensive compared to other microcontroller platforms, Arduino software is compatible with Windows, Mac OSX, and Linux operating systems Ease of use is corrected, such as providing flexibility for software development, and since an integrated development environment (IDE) is provided for software development, compiled firmware (software that runs on specific hardware) can be easily uploaded via USB and Arduino hardware And since the software is an open source tool, extended software libraries written by advanced programmers can be obtained, and circuit designers can easily create and improve their own modules, making it possible to manufacture low-cost and high-efficiency smart trash cans 200 do.

However, according to various embodiments of the present invention, it goes without saying that the controller 220 may use various microcontrollers other than the Arduino board. Furthermore, it goes without saying that the control unit 220 may be implemented as a separate circuit diagram in which only the functions of the ultrasonic sensor and the servo motor are performed in addition to the microcontroller.

The connection unit 240 is connected to the servo motor 230 and the main body 250 to open and close the lid of the smart trash can 200 .

Specifically, as shown in FIG. 5 , the server motor 230 may be attached to the inside of the main body 250 , and one end of the connection part 240 may be connected to the inside surface of the trash can lid, and the other end may be connected to the servomotor 230 . have.

According to various embodiments, the smart trash can 200 may include a solar rechargeable battery and a solar panel to supply power for the operation of the control unit 220 and the servo motor 230 .

4 is a flowchart for explaining the operation of a smart trash can according to an embodiment of the present invention.

In step S110 , the ultrasonic sensor 210 may detect an object around the main body 250 .

In step S120 , when the servomotor 230 detects an object around the body from the ultrasonic sensor 210 , it may operate to open the lid of the body.

In step S130 , the controller 220 may transmit a control signal for maintaining the servomotor 230 to the servomotor 230 for a preset time after the lid is opened.

Specifically, when the ultrasonic sensor 210 detects a person who intends to throw away the trash, the lid of the trash bin must be opened for a sufficient time to dispose of the trash. Accordingly, as described above, the control unit 220 may transmit a control signal for maintaining the servomotor 230 to the servomotor 230 for a preset time after the lid is opened.

According to an embodiment, the servomotor 230 may operate according to the following algorithm.

[Figure 1]

In step S140 , the controller 220 may close the lid of the main body 250 by controlling the servomotor 230 when a preset time has elapsed.

Meanwhile, according to various embodiments of the present disclosure, the smart trash can 200 may perform various operations in conjunction with the electronic device 100 . According to an embodiment of the present invention, the smart trash can 200 may include a QR code. In this case, the electronic device 100 may recognize the QR code attached to the smart trash can 200 and display augmented reality related to the smart trash can 200 .

Specifically, the camera 110 may acquire an image including the smart trash bin 200 including the QR code and the surrounding area.

Thereafter, the processor 120 may acquire a QR code image attached to the smart trash bin 200 .

Thereafter, the processor 120 may obtain information on the smart trash bin 200 , and may acquire information on the size of the QR code corresponding to the smart trash bin 200 . In this case, of course, the size information of the QR code may be pre-stored in the memory 170 .

Then, the processor 120, based on the pre-stored size information of the QR code and the image information of the QR code, to obtain the size and gaze information (or tilt information) of the smart trash bin 200 displayed on the display 130. can

Thereafter, the processor 120 may acquire information on the object corresponding to the QR code based on the size and gaze information (or tilt information) of the smart trash bin 200 displayed on the display 130 .

Specifically, even when the same product is photographed, the shape of the smart trash can 200 displayed on the display may be different depending on the photographing angle. For example, when the electronic device 100 and the smart trash bin 200 are photographed on a parallel plane and when the electronic device 100 and the product are photographed on a non-parallel (ie, oblique) plane, the electronic device 100 The shape of the smart trash can 200 displayed in may be different.

Accordingly, the electronic device 100 pre-stores information on the size of the QR code (eg, a square of 4 cm in width and 4 cm in height) in the memory 170 , and the size of the QR code on the image captured by the camera 110 . Based on the information, it is possible to determine the size and inclination of the beautifying agent object, which will be described later.

Thereafter, the processor 120 may acquire an area in which the beauty salon object is to be displayed based on the size and gaze information (or tilt information) of the smart trash bin 200 displayed on the display 130 .

That is, the electronic device 100 may determine the size and inclination of the object based on the size information of the QR code on the image captured by the camera 110 as well as determine the area in which the object is to be displayed.

Thereafter, the display 130 may display the obtained object in the area.

According to various embodiments of the present disclosure, when the camera 110 recognizes a QR code attached to the smart trash bin 200 , the electronic device 100 may acquire information about trash around the smart trash bin 200 .

Specifically, the electronic device 100 may acquire floor information (ground surface information) among image information acquired through the camera 110 . Thereafter, the electronic device 100 may acquire information about a plurality of objects adjacent to the ground surface. The plurality of object information adjacent to the ground surface may be object information of a preset size or less.

Alternatively, the electronic device 100 may acquire an object within a preset size within a preset distance from the smart trash bin 200 as garbage information.

When a user command is input, the electronic device 100 may move the beauty salon object displayed in augmented reality to the vicinity of the garbage object. In this case, the user command may be a voice command, but is not limited thereto.

For example, the user command may be a command to move the beauty salon displayed on the display 130 by dragging. Alternatively, it goes without saying that the user command may be a hovering command, a double tap input, or the like.

Hereinafter, a process of moving a cleaning agent object based on a voice command will be described.

The electronic device 100 may receive a voice signal from a user and generate voice recognition data. In one embodiment, the processor 120 displays a voice command input button from the user on the display 130 , and when a command is input through the voice command input button from the user, the microphone 150 is activated to receive a voice command input. can do it

Here, the voice recognition data may be data generated by preprocessing a voice signal by the processor 120, extracting voice features from the preprocessed voice signal, comparing the extracted voice features with a voice model, and generating based on the comparison result. have. For example, the voice recognition data may be text corresponding to a voice command.

In this case, the type of the voice recognition method used by the processor 120 to generate the voice recognition data corresponding to the voice command is not limited as long as the voice recognition data is generated.

In an embodiment, the processor 120 may control the display 130 to display a voice recognition data image representing the recognized voice recognition data.

In another embodiment, the processor 120 may control the display 130 to display a confirmation input area through which a user may input whether the recognized voice recognition data corresponds to a voice command.

When a confirmation input indicating that the recognized voice recognition data corresponds to a voice command is input, the processor 120 may perform a process of generating a movement control block. Conversely, when an unconfirmed input indicating that the recognized voice recognition data does not correspond to the voice command is input, the processor 120 may perform a process of re-inputting the voice command.

Thereafter, the processor 120 may generate a movement control block for controlling the movement of the cleaning agent object based on the voice recognition data and a command corresponding to the movement control block, and control the movement of the cleaning agent object in response to the movement control block. .

Thereafter, the processor 120 may generate a command block image representing the movement control block and control the display 130 to display the command block image.

In this case, the movement control block may include at least one of a movement type control statement, a movement speed control statement, and a movement repetition number control statement corresponding to the set programming language type.

In addition, the movement type control statement includes a movement type control command and movement type control variable corresponding to the set programming language type, and the movement speed control statement includes a movement speed control command and movement speed control variable corresponding to the set programming language type. And, the movement repetition number control command may include a movement repetition number control command and movement repetition number control variable corresponding to the set programming language type.

The processor 120 may search for movement type information from the voice recognition data, and when the movement type information is retrieved, generate a movement type control command corresponding to the searched movement type information.

For example, when the voice recognition data is “move quickly to the right”, the movement type information may be “right”, and the movement type control command corresponding to the movement type information may be “#move right”. To this end, the text corresponding to the movement type information may be stored in the memory 170 by matching the movement type control command for each programming language type.

Meanwhile, when the movement control block includes a movement speed control command, the processor 120 may generate a movement speed control command corresponding to the movement speed information when the movement speed information is included in the voice recognition data.

On the other hand, when the movement speed information is not included in the voice recognition data, the processor 120 generates syllable spacing information based on the voice recognition data, generates movement speed information in response to the syllable spacing information, and generates the generated A movement speed control statement corresponding to the movement speed information may be generated.

Specifically, the processor 120 may search for movement speed information from the voice recognition data, and when the movement speed information is retrieved, generate a movement speed control command corresponding to the searched movement speed information. For example, when the voice recognition data is "move fast to the right", the movement speed information may be "fast", and the movement type control command corresponding to the movement speed information may be "#speed up".

To this end, the text corresponding to the movement speed information may be matched with the movement speed control command for each programming language type) and stored in the memory 170 .

Conversely, if the movement speed information is not found in the voice recognition data, the processor 120 generates syllable spacing information based on the voice recognition data, generates movement speed information in response to the syllable spacing information, and generates movement speed information It is possible to generate a movement speed control statement corresponding to .

Specifically, the processor 120 calculates a first time difference between the end time of one syllable and the start time of the next syllable of any one syllable among the syllables included in the voice recognition data, and the average time difference of the plurality of first time differences can be generated as syllable spacing information.

Thereafter, the processor 120 may calculate a time difference ratio of the average time difference indicated by the syllable interval information compared to the reference time difference, and may generate the movement speed information by applying the time difference ratio to the basic movement speed.

For example, when the average time difference is "12 msec", the reference time difference is "10 msec", and the basic movement speed is "1x speed", the processor 120 calculates the time difference ratio as "120%", and the basic movement speed By applying the time difference ratio "120%" to "1x speed", it is possible to generate movement speed information at "1.2x speed".

On the other hand, when the movement control block includes a movement repetition number control command, the processor 120 generates a movement repetition number control command corresponding to the movement repetition number information when the voice recognition data includes movement repetition number information. can

On the other hand, when the movement repetition number information is not included in the voice recognition data, the processor 120 generates signal strength information based on the voice signal, generates movement repetition number information in response to the signal strength information, and generates the generated A movement repetition number control statement corresponding to the movement repetition number information may be generated.

Specifically, the processor 120 may search for movement repetition number information from the voice recognition data, and when the movement repetition number information is retrieved, generate a movement repetition number control command corresponding to the searched movement repetition number information. For example, when the voice recognition data is "Two round trips from the trash can to the garbage", the movement repetition number information may be "twice", and the movement type control command corresponding to the movement repetition number information may be "#two".

To this end, the text corresponding to the movement repetition number information may be stored in the memory 170 by matching the movement repetition number control command for each programming language type.

Conversely, if the movement repetition number information is not retrieved from the voice recognition data, the processor 120 generates signal strength information based on the voice signal, generates movement repetition number information in response to the signal strength information, and generates the movement repetition number information. A movement repetition number control statement corresponding to the information may be generated.

Specifically, the processor 120 may generate the maximum signal strength among signal strengths according to time of the voice signal as signal strength information.

Thereafter, the processor 120 may calculate the signal strength ratio of the maximum signal strength indicated by the signal strength information to the reference signal strength, and may generate the movement repetition number information by applying the signal strength ratio to the basic movement repetition number.

For example, the processor 120 calculates the signal strength ratio as "200%" when the maximum signal strength is "200DB", the reference signal strength is "100DB", and the basic movement repetition number is "one time", By applying the signal strength ratio "200%" to the basic movement repetition number "one time", it is possible to generate movement repetition number information as "2 times". In this case, the movement repetition number information may be rounded to generate a natural number.

Meanwhile, the processor 120 may generate user characteristic information of the user based on the voice signal and set the programming language type of the movement control block in response to the user characteristic information.

Here, the user characteristic information may include user gender information and user age information.

Specifically, the processor 120 calculates the average frequency from the frequency according to the time of the voice signal, and reads the user age information of the user corresponding to the average frequency from the frequency-user characteristic table to which the user age information is mapped for each voice frequency. can

Meanwhile, according to various embodiments of the present invention, it goes without saying that the movement control block may include various statements. In an embodiment, the processor 120 may control the object to perform a specific operation according to the frequency of the input voice. For example, when the frequency of the input voice is less than a preset value (for example, less than 60 hertz), the processor 120 may control the object to perform an operation to put the cleaning agent object into the trash. Alternatively, when the input frequency exceeds 60 hertz, the processor 120 may control the objects displayed on the display 130 to jump out of the trash can.

Meanwhile, according to another embodiment of the present invention, the electronic device 100 may differently display the beautifying agent object according to the focal length of the background image displayed on the display 130 . For example, when the camera 110 is focused on the smart trash can 200 displayed on the display 130, the processor 120 clearly displays the object, and the smart trash can 200 displayed on the display 130 is When the camera 110 is focused on an area other than this, the processor 120 may display the object of the beauty salon in a blurry manner.

Meanwhile, according to various embodiments of the present disclosure, when the cleaning agent object arrives at the garbage object, the cleaning agent object may take a motion to clean the garbage.

Meanwhile, according to various embodiments of the present disclosure, if actual garbage corresponding to the garbage object moves while the cleaning agent object arrives at the garbage object and stays there, the cleaning agent object may move together in the moving direction of the garbage object. In this case, it goes without saying that the sanitation worker object may take a motion to clean the garbage.

The augmented reality image displaying the cleaning agent object according to the present invention may be used as content for children's education. Although the cleaning agent object displayed in augmented reality cannot actually remove the garbage, by manipulating the cleaning agent object and displaying the operation of the operated cleaning agent object to remove the garbage on the display 130, the system according to the present invention can remove garbage conveniently Not only that, but also content for children's education can be provided.

The steps of a method or algorithm described in relation to an embodiment of the present invention may be implemented directly in hardware, as a software module executed by hardware, or by a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present invention pertains.

The components of the present invention may be implemented as a program (or application) to be executed in combination with a computer, which is hardware, and stored in a medium. Components of the present invention may be implemented as software programming or software components, and similarly, embodiments may include various algorithms implemented as data structures, processes, routines, or combinations of other programming constructs, including C, C++ , may be implemented in a programming or scripting language such as Java, assembler, or the like. Functional aspects may be implemented in an algorithm running on one or more processors.

In the above, the embodiments of the present invention have been described with reference to the accompanying drawings, but those skilled in the art to which the present invention pertains know that the present invention may be embodied in other specific forms without changing the technical spirit or essential features thereof. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

100: electronic device
200: smart trash can

Claims (13)

A method of controlling a system including an electronic device and a smart trash can, the method comprising:
The smart trash bin includes a main body, a solar rechargeable battery, a solar panel, an ultrasonic sensor, a servo motor, a connection unit and a control unit for connecting the main body and the servo motor,
detecting, by the ultrasonic sensor, an object around the body;
when the servomotor detects an object around the main body from the ultrasonic sensor, operating to open the lid of the main body;
transmitting, by the control unit, a control signal for maintaining the servomotor for a preset time to the servomotor after the lid is opened and closed; and
When the preset time elapses, the control unit controlling the servomotor to close the lid of the main body; A control method comprising a. According to claim 1,
The smart trash bin is a control method, characterized in that receiving power from the solar rechargeable battery and the solar panel. According to claim 1,
The control unit is composed of an Arduino board, the control method, characterized in that for controlling the servomotor and the ultrasonic sensor. According to claim 1,
The electronic device includes a camera, a memory, a display and a processor,
The smart trash bin includes a QR code,
The control method is
acquiring, by the camera, an image including a smart trash bin including a QR code and a surrounding area;
obtaining, by the processor, the QR code image;
obtaining, by the processor, size information of a pre-stored QR code from the memory;
obtaining, by the processor, size information and gaze information of the smart trash bin displayed on the display based on the pre-stored size information of the QR code and image information of the QR code;
obtaining, by the processor, information on the object corresponding to the QR code based on the size and gaze information of the smart trash bin displayed on the display;
obtaining, by the processor, an area in which the object is to be displayed based on the size and gaze information of the smart trash bin displayed on the display; and
displaying, by the display, the obtained object on the area; A control method comprising a. 5. The method of claim 4,
When the object is a beautifying agent object, the displaying step includes:
moving the beauty salon object within the acquired area; and
when a user command for controlling the beauty salon object is input, moving the cleaning agent object to correspond to the user command; including,
The control method is
obtaining, by the electronic device, information about garbage around the smart trash bin;
moving, by the electronic device, the cleaning agent object to a garbage object corresponding to the garbage information displayed on the display when the user command is a command to move the cleaning agent object to the garbage information around the smart trash bin; A control method comprising a. 6. The method of claim 5,
The step of moving the beautifying agent object comprises:
generating voice recognition data by receiving a voice signal from a user of the electronic device;
generating a movement control block for controlling movement of the cleaning agent object and a command corresponding to the movement control block based on the voice recognition data;
controlling the movement of the cleaning agent object in response to the movement control block;
generating a command block image representing the movement control block; and
displaying the command block image; A control method comprising a. 7. The method of claim 6,
When the movement control block includes a movement speed control statement, generating the movement control block and a statement corresponding to the movement control block includes:
generating a movement speed control command corresponding to the movement speed information when the voice recognition data includes movement speed information; and
When the movement speed information is not included in the voice recognition data, syllable spacing information is generated based on the voice recognition data, the movement speed information is generated in response to the syllable spacing information, and the generated movement speed information generating a movement speed control statement corresponding to ; including,
When the movement control block includes a movement repetition number control statement, generating the movement control block and a statement corresponding to the movement control block includes:
generating a movement repetition number control command corresponding to the movement repetition number information when the speech recognition data includes movement repetition number information; and
When the movement repetition number information is not included in the voice recognition data, signal strength information is generated based on the voice signal, the movement repetition number information is generated in response to the signal strength information, and the generated movement repetition number information is generated. A control method comprising a; generating a movement repetition number control statement corresponding to the information. a memory storing one or more instructions; and
a processor executing the one or more instructions stored in the memory;
The processor by executing the one or more instructions,
An apparatus for performing the method of claim 1 . A computer program stored in a computer-readable recording medium in combination with a computer, which is hardware, to perform the method of claim 1 . In the control method of the smart trash can,
detecting, by the smart trash can, an object around the main body;
when the smart trash bin detects an object around the body from the ultrasonic sensor, operating to open the lid of the body;
transmitting, by the smart trash bin, a control signal for maintaining the servomotor for a preset time to the servomotor after the lid is opened and closed; and
closing the lid of the main body by controlling the servomotor when the preset time has elapsed, by the smart trash bin; A control method comprising a. a memory storing one or more instructions; and
a processor executing the one or more instructions stored in the memory;
The processor by executing the one or more instructions,
An apparatus for performing the method of claim 11 . A computer program stored in a computer-readable recording medium in combination with a computer, which is hardware, to perform the method of claim 11. A method for controlling an electronic device including a camera, a memory, a display and a processor, the method comprising:
acquiring, by the camera, an image including a smart trash bin including a QR code and a surrounding area;
obtaining, by the processor, the QR code image;
obtaining, by the processor, size information of a pre-stored QR code from the memory;
obtaining, by the processor, information on an object corresponding to the QR code based on the pre-stored size information of the QR code and image information of the QR code;
displaying, by the display, an object corresponding to the obtained information on the object; A control method comprising a.

Images