KR102516702B1 - Method for providing experimental information using artificial intelligence and apparatus using the same - Google Patents

Abstract

A method for providing experiment information using artificial intelligence according to an embodiment of the present invention includes the step of photographing at least one of a plurality of experimental tools by a photographing unit in real time, the step of displaying a photographed image taken by the photographing unit in real time by a display unit, and comprising the steps of: The method may include determining a first experiment tool from a photographed image taken by a photographing unit, and displaying information on the first experiment tool by a display unit. Accordingly, information on the experiment tool to be photographed is displayed on the display unit in real time, so that the user can conveniently check it.

Description

Method for providing experimental information using artificial intelligence and device using the same

The present invention relates to a method for providing experiment information using artificial intelligence and an apparatus using the same. More specifically, a user who wants to conduct an experiment photographs an experiment tool using a terminal, and the terminal uses a display unit to capture the experiment tool and experiment in real time. It relates to a method for providing experimental information using artificial intelligence capable of displaying information about a tool and providing it to a user, and a device using the same.

In general, many experimental tools are used in the process of conducting a scientific experiment. Experimental tools used in science experiments may have different names, definitions, usage methods, and notes, and are not tools commonly used in real life, so students who are new to science experiments may have difficulty using experiment tools. can

Various information on experimental tools can be obtained through books or Internet searches, but it is not easy to know the names of experimental tools only through the appearance of the experimental tools. It may not be easy to obtain information about tools.

Accordingly, the need for a user performing a scientific experiment to obtain various information about an experiment tool based only on the information about the appearance of the experiment tool placed in front of the user is increasing.

An object to be solved by the present invention is that a user performing a scientific experiment can photograph an experiment tool with a terminal such as a mobile phone and obtain information about the experiment tool in real time using the photographed image.

The tasks of the present invention are not limited to the tasks mentioned above, and other tasks not mentioned will be clearly understood by those skilled in the art from the following description.

In order to solve the above problems, a method for providing experiment information using artificial intelligence according to an embodiment of the present invention includes the steps of photographing at least one of a plurality of experimental tools by a photographing unit in real time, and a photographed image captured by a photographing unit by a display unit. It may include a step of displaying in real time, a step of determining, by a control unit, a first experiment tool from a photographed image taken by a photographing unit, and a step of displaying information on the first experiment tool by a display unit. Accordingly, information on the experiment tool to be photographed is displayed on the display unit in real time, so that the user can conveniently check it.

In order to solve the above problems, an apparatus for providing experiment information using artificial intelligence according to an embodiment of the present invention displays a photographing unit that photographs at least one of a plurality of experimental tools in real time and an image captured by the photographing unit in real time. and a control unit for determining a first experiment tool from an image captured by the photographing unit, and the display unit may display information on the first experiment tool and provide the information to the user. Accordingly, information on the experiment tool to be photographed is displayed on the display unit in real time, so that the user can conveniently check it.

Other embodiment specifics are included in the detailed description and drawings.

According to the present invention as described above, it has various effects as follows.

In the present invention, an experiment tool is photographed with a terminal, and an image of the experiment tool captured is displayed on the terminal in real time, and at the same time, various information on the experiment tool may be displayed together in real time.

Effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the present specification.

1 is a block diagram showing a schematic configuration of an apparatus for providing experiment information using artificial intelligence according to an embodiment of the present invention.
2 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to an embodiment of the present invention.
3A to 3C are diagrams illustrating an apparatus for providing experiment information using artificial intelligence according to an embodiment of the present invention.
4 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to another embodiment of the present invention.
5 is a diagram illustrating an experiment information providing apparatus using artificial intelligence according to another embodiment of the present invention.
6 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to another embodiment of the present invention.
7 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to another embodiment of the present invention.
8 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to another embodiment of the present invention.
9 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to another embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention, and methods of achieving them, will become clear with reference to the detailed description of the following embodiments taken in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various different forms, only these embodiments make the disclosure of the present invention complete, and common knowledge in the art to which the present invention belongs. It is provided to fully inform the holder of the scope of the invention, and the present invention is only defined by the scope of the claims.

The shapes, sizes, ratios, angles, numbers, etc. disclosed in the drawings for explaining the embodiments of the present invention are illustrative, so the present invention is not limited to the details shown. Like reference numbers designate like elements throughout the specification. In addition, in describing the present invention, if it is determined that a detailed description of related known technologies may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. When 'includes', 'has', 'consists of', etc. mentioned in this specification is used, other parts may be added unless 'only' is used. In the case where a component is expressed in the singular, the case including the plural is included unless otherwise explicitly stated.

In interpreting the components, even if there is no separate explicit description, it is interpreted as including the error range.

In the case of a description of a positional relationship, for example, 'on top of', 'on top of', 'at the bottom of', 'next to', etc. Or, unless 'directly' is used, one or more other parts may be located between the two parts.

When an element or layer is referred to as “on” another element or layer, it includes all cases where another element or layer is directly on top of another element or another layer or other element intervenes therebetween.

Although first, second, etc. are used to describe various components, these components are not limited by these terms. These terms are only used to distinguish one component from another. Therefore, the first component mentioned below may also be the second component within the technical spirit of the present invention.

Like reference numbers designate like elements throughout the specification.

The size and thickness of each component shown in the drawings are shown for convenience of description, and the present invention is not necessarily limited to the size and thickness of the illustrated components.

Each feature of the various embodiments of the present invention can be partially or entirely combined or combined with each other, and as those skilled in the art can fully understand, various interlocking and driving operations are possible, and each embodiment can be implemented independently of each other. It may be possible to implement together in an association relationship.

1 is a block diagram showing a schematic configuration of an apparatus for providing experiment information using artificial intelligence according to an embodiment of the present invention.

Referring to FIG. 1 , an experiment information providing apparatus 100 is a device capable of identifying experiment tools included in an image captured in real time and providing information on the experiment tools to a user. Specifically, the experiment information providing device 100 includes a photographing unit 110 , a display unit 120 , and a control unit 130 .

The photographing unit 110 of the experiment information providing device 100 is a component for photographing the experiment tool. The photographing unit 110 may photograph the outside of the experiment information providing device 100 in real time, and transmit the photographed image to the control unit 130 and the display unit 120 .

The control unit 130 of the apparatus 100 for providing experiment information is a component that determines experiment tools included in the captured image based on the captured image taken by the photographing unit 110 . The control unit 130 may receive information on the determined experiment tool from the storage unit of the experiment information providing device 100 or from an external server.

The display unit 120 of the experiment information providing device 100 is a component that displays a real-time photographed image captured by the photographing unit 110 . In addition, the display unit 120 may display information about the experiment tool received from the control unit 130 of the experiment information providing device 100 together with the photographed image.

The display unit 120 of the experiment information providing apparatus 100 may be a touch screen, and a user may transmit a touch input to the display unit 120 using a finger or the like. In this case, the display unit 120 may even perform the function of an input unit.

The experiment information providing device 100 may include a microphone as another input unit. The microphone may receive sound input around the experiment information providing device 100, and thus may receive user voice data.

The experiment information providing apparatus 100 may form an experiment information providing system together with an external server. The experiment information providing system may include the experiment information providing device 100 and an external server managed by a manager or the like. The external server exchanges signals and information with the experiment information providing device 100, determines the experiment tool using the captured image received from the experiment information providing device 100, and uses the experiment information providing device 100 to determine the information about the experiment tool. It is the main external server that provides information.

The experiment information providing device 100 may be an electronic terminal such as a mobile phone or a tablet PC used by a user using the experiment information providing system. The experiment information providing device 100 may communicate with an external server by accessing the Internet. The experiment information providing apparatus 100 may include a communication unit that exchanges information with an external device such as an external server.

Next, the experiment information providing method of the experiment information providing apparatus 100 will be described in detail.

2 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to an embodiment of the present invention. 3A to 3C are diagrams illustrating an apparatus for providing experiment information using artificial intelligence according to an embodiment of the present invention. For convenience of explanation, it will be described with reference to FIG. 1 .

First, the photographing unit 110 of the experiment information providing device 100 photographs at least one of a plurality of experiment tools in real time (S110). Referring to FIG. 3A , the experiment information providing apparatus 100 may include a photographing unit 110 such as a camera capable of taking pictures and videos. The photographing unit 110 of the experiment information providing device 100 may photograph the experiment tool. The photographing unit 110 may face the experiment tool, and the experiment tool, for example, an igniter, may be photographed by the photographing unit 110 .

Subsequently, the display unit 120 of the experiment information providing device 100 displays the captured image captured by the photographing unit 110 in real time (S120). Experimental instruments illuminated by the photographing unit 110 may be displayed on the display unit 120 . The display unit 120 of the apparatus 100 for providing experiment information may include a first area in which an image captured by the photographing unit 110 in real time is displayed. An image of an igniter photographed by the photographing unit 110 in real time may be displayed in the first area of the display unit 120 as shown in FIG. 3A .

Next, the control unit 130 of the experiment information providing device 100 determines the first experiment tool from the photographed image (S130). A photographed image displayed on the first area of the display unit 120 of the experiment information providing apparatus 100 may be transmitted to the controller 130 in real time.

The controller 130 may determine the experiment tool being captured in real time based on the real time captured image. Specifically, the control unit 130 may determine a first experiment tool from among several tools included in a photographed image received from the experiment information providing device 100 . The experiment information providing device 100 may include a storage unit, and the controller 130 may compare a specific tool included in the captured image with images of various experiment tools stored in the storage unit. The controller 130 may determine the specific tool as the first experiment tool when images of various experiment tools stored in the storage unit match the images of the specific tool included in the photographed image. For example, the controller 130 may extract an igniter image from a photographed image and compare the igniter image with various experiment tool images stored in the storage unit. The control unit 130 may determine that an experiment tool image called an igniter matches among a plurality of experiment tool images. Accordingly, the controller 130 may determine that the tool included in the photographed image is the first experimental tool, that is, the igniter.

The control unit 130 may transmit information about the first experiment tool to the display unit 120 of the experiment information providing device 100 . In the case of FIG. 3A , the controller 130 may determine that the tool included in the photographed image is the first experimental tool, that is, the igniter, and transmit information about the igniter to the display unit 120 . The information on the first experimental tool may include at least one of the name, definition, precautions for use, and usage method of the first experimental tool.

Next, the display unit 120 of the experiment information providing device 100 displays information about the first experiment tool (S150). Referring to FIGS. 3A to 3C , the experiment information providing device 100 may display information about the first experiment tool on the display unit 120 of the experiment information providing device 100 . Specifically, the display unit 120 of the experiment information providing device 100 may include a second area adjacent to the first area, and may display the name and definition of the first experiment tool in the second area. In FIG. 3A , the display unit 120 may include a second area adjacent to the first area where the photographed image is displayed, and in the second area, 'igniter', which is the name of the first experimental tool, and the first experimental tool. The definition 'a laboratory instrument used to spark a gas and set it on fire' may be displayed.

The display unit 120 of the apparatus 100 for providing experiment information may include a third area adjacent to the second area, and a plurality of icons for obtaining information on the first experiment tool may be displayed in the third area. there is. A plurality of icons may be displayed in the third region, for example, a note icon, a usage method icon, a web page icon, and a chatbot icon. The user may touch one of the plurality of icons displayed on the third area of the display unit 120 with a finger or the like. When the user selects and touches the point to keep in mind icon, information on the point to keep in mind of the first experiment tool may be displayed on the display unit 120 as shown in FIG. 3B. When the user selects and touches the method of use icon, the method of using the first experiment tool may be displayed on the display unit 120 as shown in FIG. 3C . When the user selects and touches the webpage icon, the display unit 120 may display a webpage related to the first experiment tool. In addition, when the user selects and touches the chatbot icon, the display unit 120 may display an artificial intelligence chatting screen capable of providing various other information about the first experiment tool. The user may request more various information about the first experiment tool on the artificial intelligence chatting screen, and the experiment information providing device 100 may provide information using an artificial intelligence chatbot in response to the user's request.

A method for providing experiment information according to an embodiment of the present invention and an apparatus 100 using the same is a display unit of the apparatus 100 for providing experiment information, in which a photographing unit 110 of the apparatus 100 for providing experiment information captures a photographed image in real time. 120 may be displayed, and the controller 130 may determine the first experiment tool included in the captured image in real time. The experiment information providing device 100 may display information on the first experiment tool on the display unit 120 in real time and provide the information to the user. Accordingly, the user may use the experiment information providing apparatus 100 to photograph a specific experiment tool for which information is desired, and obtain information on the experiment tool in real time. Accordingly, the user can easily acquire information on various experimental tools in real time by simply photographing the experiment tool for which information is desired.

According to an embodiment, the above-described step (S130) may be performed by at least one of the experiment information providing apparatus 100 and an external server. That is, step S130 may be performed only by the experiment information providing device 100 as described above, and, in contrast, step S130 may be performed only by an external server. Alternatively, step S130 may be performed by both the experiment information providing device 100 and an external server.

If the operation of operation S130 is described in more detail by an external server, the experiment information providing apparatus 100 may include a communication unit that communicates with an external server managed by a manager or the like. The communication unit of the experiment information providing device 100 may transfer the captured image to an external server in real time after step S110 is performed. That is, the captured image displayed on the first area of the display unit 120 of the apparatus 100 for providing experiment information may be transmitted to an external server in real time by the communication unit.

Next, the experiment information providing apparatus 100 may receive information about the first experiment tool determined by the external server from the photographed image from the external server. The external server may determine the experiment tool being captured in real time based on the real time captured image. Specifically, the external server may determine a first experiment tool from among several tools included in the photographed image received from the experiment information providing device 100 . The external server may include a storage unit, and the external server may compare a specific tool included in the captured image with images of various experimental tools stored in the storage unit. The external server may determine the specific tool as the first experiment tool when images of various experiment tools stored in the storage unit match the image of the specific tool included in the photographed image. For example, the external server may extract an igniter image from a photographed image and compare the igniter image with images of various experimental tools stored in the storage unit. The external server may determine that an experiment tool image called an igniter matches among a plurality of experiment tool images. Accordingly, the external server may determine that the tool included in the captured image is the first experimental tool, that is, the igniter. Also, the external server may transmit information about the first experiment tool to the experiment information providing device 100 .

4 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to another embodiment of the present invention. 5 is a diagram illustrating an experiment information providing apparatus using artificial intelligence according to another embodiment of the present invention. Compared to the method for providing experiment information of FIGS. 4 to 5 and the apparatus using the same, the method for providing experiment information further includes steps S260 and S270 compared to the method for providing experiment information of FIGS. 1 to 3C and the apparatus 100 using the same. Except that the bar is substantially the same, redundant description will be omitted. For convenience of explanation, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information photographs at least one of a plurality of experimental tools in real time (S110). Next, the display unit of the experiment information providing device displays the captured image captured by the recording unit in real time (S120). Next, the control unit of the experiment information providing device determines the first experiment tool from the photographed image (S130). Then, the display unit of the experiment information providing device displays information about the first experiment tool (S150). Since these steps (S110 to S150) are substantially the same as the steps (S110 to S150) described with reference to FIGS. 1 to 3C, duplicate descriptions are omitted.

Next, when the experiment tool included in the captured image is changed from the first experiment tool to the second experiment tool in real time, the controller determines the second experiment tool from the captured image (S260). The photographing unit of the experiment information providing device may change the experiment tool to be photographed from the first experiment tool to the second experiment tool. That is, the user may photograph the first experiment tool using the photographing unit of the experiment information providing device, and then use the second experiment tool to change the direction of the photographing unit to photograph the second experiment tool. Referring to FIG. 5 , the display unit may display the first experiment tool in the first area and then display the second experiment tool in the first area in response to the change of the photographing object of the photographing unit. The second experiment tool may be an eyedropper, and the eyedropper may be displayed in the first area of the display unit.

At this time, the controller may determine the experiment tool from the photographed image displayed in the first area in real time. The controller may compare and analyze the image of the object included in the photographed image and the image of the experiment tool stored in the storage unit to determine the second experiment tool. For example, the controller may compare the image of the second experiment tool included in the photographed image, that is, the eyedropper, with the images of various experiment tools included in the storage unit, and determine that the second experiment tool is the eyedropper.

Subsequently, the display unit of the experiment information providing device displays information on the second experiment tool (S270). The display unit may display the name and definition of the second experiment tool in the second area, and as shown in FIG. 5, the name of the second experiment tool is 'eyedropper', and the definition of the second experiment tool is 'a rubber stopper is attached to one end. It can be a 'experimental instrument' with a glass tube that has a tapered end and a tapered end.

A plurality of icons for acquiring information on the second experiment tool may be displayed on the third area of the display unit of the apparatus for providing experiment information. A plurality of icons may be displayed in the third region, for example, a note icon, a usage method icon, a web page icon, and a chatbot icon. The user may touch one of the plurality of icons displayed on the third region of the display unit with a finger or the like. When the user selects and touches the point to keep in mind icon, information on the point to keep in mind of the second experimental tool may be displayed on the display unit as shown in FIG. 3B. When the user selects and touches the method of use icon, the method of using the second experiment tool may be displayed on the display unit as shown in FIG. 3C . When the user selects and touches the webpage icon, the display unit may display a webpage related to the second experiment tool. In addition, when the user selects and touches the chatbot icon, the display unit may display an artificial intelligence chatting screen capable of providing various other information about the second experiment tool. The user can request more diverse information about the second experiment tool on the artificial intelligence chatting screen, and the display unit can provide information using an artificial intelligence chatbot in response to the user's request.

A method for providing experiment information and a device using the same according to another embodiment of the present invention, when an experiment tool photographed by a photographing unit is changed from a first experiment tool to a second experiment tool, a real-time image captured by the photographing unit on the display of the apparatus for providing experiment information. By displaying as it is, the image displayed by the display unit can be changed from the first experiment tool to the second experiment tool. Also, the controller may determine the second experiment tool from the photographed image displayed in real time. The display unit may display information about the second experiment tool while displaying information about the first experiment tool. Accordingly, the user may change while filming the first experiment tool and take a picture of the second experiment tool, and in response thereto, information on the second experiment tool displayed on the display unit may be quickly provided in real time.

According to an embodiment, the above-described step (S260) may be performed by at least one of a control unit and an external server of the experiment information providing device. That is, step S130 may be performed only by the experiment information providing device as described above, and step S260 may be performed only by an external server. And, unlike this, step S260 may be performed by both the experiment information providing device and the external server.

If the step S260 is performed by the external server in more detail, when the experiment tool included in the captured image is changed from the first experiment tool to the second experiment tool in real time, the experiment information providing device receives information from the external server. The external server may receive information about the second experimental tool determined from the photographed image. The photographing unit of the experiment information providing device may change the experiment tool to be photographed from the first experiment tool to the second experiment tool. That is, the user may photograph the first experiment tool using the photographing unit of the experiment information providing device, and then use the second experiment tool to change the direction of the photographing unit to photograph the second experiment tool.

In this case, the external server may receive information about the captured image displayed in the first area by the display unit in real time from the communication unit of the experiment information providing device. The external server may determine the experiment tool from the photographed image displayed in the first area in real time. The external server may include a storage unit in which information on various experiment tools is stored, and the second experiment tool may be determined by comparing and analyzing an image of an object included in a photographed image and an experiment tool image stored in the storage unit. For example, the external server may compare the image of the second experiment tool included in the captured image, that is, the eyedropper, with the images of various experiment tools included in the storage unit, and determine that the second experiment tool is the eyedropper. The external server may transmit information about the second experiment tool to the experiment information providing device.

6 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to another embodiment of the present invention. The experiment information providing method of FIG. 6 and the system using the same are substantially different from the experiment information providing method and system using the same of FIGS. 1 to 3C except that the experiment information providing method further includes steps S360 to S380. Since it is the same, redundant description is omitted. For convenience of explanation, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information photographs at least one of a plurality of experimental tools in real time (S110). Next, the display unit of the experiment information providing device displays the captured image captured by the recording unit in real time (S120). Next, the control unit of the experiment information providing device determines the first experiment tool from the photographed image (S130). Then, the display unit of the experiment information providing device displays information about the first experiment tool (S150). Since these steps (S110 to S150) are substantially the same as the steps (S110 to S150) described with reference to FIGS. 1 to 3C, duplicate descriptions are omitted.

Next, the experiment information providing device receives a selection input for a first experiment among a plurality of experiments from the user (S360). In detail, the storage unit of the experiment information providing device may store an experiment list. The experiment list may be a list including names of a plurality of experiments. The display unit of the experiment information providing device may display the experiment list stored in the storage unit and provide it to the user. The user may select one experiment, eg, the first experiment, from the experiment list displayed on the display unit, and the apparatus for providing experiment information may receive a selection input for the first experiment from the user.

Subsequently, a confirmation mark is displayed on the experimental preparation for the first experiment among the captured images displayed on the display unit of the experiment information providing device (S370). Subsequently, the photographing unit of the apparatus for providing experiment information may photograph at least one of the plurality of preparations for experimentation, and the at least one preparation for experiment photographed by the photographing unit may be displayed on the display unit in real time. That is, the user can take a picture of the experiment preparation placed around the experiment using the photographing unit of the experiment information providing device, and the experiment preparation photographed by the user can be displayed on the display unit.

In this case, the experimental preparation may include an experiment preparation for the first experiment and an article other than the experiment preparation for the first experiment. That is, some of the test preparations may be test preparations used in the first experiment, and others may be items not used in the first experiment.

Experiment preparations photographed by the photographing unit and displayed by the display unit may be delivered to the control unit in real time. The controller may determine the preparation for experiment of the first experiment based on the received image of the preparation for experiment. The storage unit may store information on preparation materials for each experiment included in the experiment list. Information on preparations for experiments may include images, names, definitions, methods of use, notes, etc. of preparations for experiments used in each experiment. The control unit compares the image of the preparation for experimentation in real time with the image of the preparation for experimentation 1 of the first experiment stored in the storage unit, and discriminates between the preparation for the first experiment and the items that are not the preparation for the first experiment among the preparations for the first experiment displayed on the display unit. can do.

The experiment information providing device may display a confirmation mark on the preparation for the first experiment among the preparations for the experiment displayed on the display unit in real time based on the information on the preparation for the first experiment. The confirmation mark may be a mark that can be visually confirmed that it is an experimental preparation for the first experiment. For example, the confirmation mark may be a circle mark such as 'Ο' or a check mark such as 'V'. The display unit of the apparatus for providing experiment information may display in real time the experimental preparations photographed by the photographing unit, and may display a confirmation mark on the experimental preparations of the first experiment among the displayed experimental preparations. The confirmation mark is not limited to the above example, and may be replaced with other shapes if necessary.

Subsequently, among the photographed images displayed on the display unit of the experiment information providing device, an unconfirmed mark is displayed on an article that is not an experiment preparation for the first experiment (S380). The apparatus for providing experiment information may display an unchecked mark on an item other than the preparation for the first experiment among the preparations for the experiment displayed on the display unit in real time based on the information on the preparation for the first experiment. The non-confirmation mark may be a mark that can be visually confirmed that it is not an experimental preparation for the first experiment. For example, the unconfirmed mark may be an X mark such as 'X'. The display unit of the apparatus for providing experiment information may display in real time the experimental preparations photographed by the photographing unit, and may display an unchecked mark on items other than the experimental preparations of the first experiment among the displayed experiment preparations. The unconfirmed mark is not limited to the above example, and may be replaced with other shapes if necessary.

A method for providing experiment information and a device using the same according to another embodiment of the present invention, wherein the device for providing experiment information receives a selection input for a first experiment, displays a check mark on an experiment preparation for a first experiment among a photographed image, and , Unchecked marks may be displayed on items that are not test preparations for the first experiment among the photographed images. The user can photograph the preparation for experiment using the photographing unit, and can confirm which preparation for experiment is for the first experiment among the preparations for experiment prepared through the display unit through a confirmation mark displayed in real time. In addition, the user can check which items, other than the experimental preparations for the first experiment, among the experimental preparations through the display unit are displayed in real time through the unconfirmed mark.

According to an embodiment, in step S360, the experiment information providing device may receive an experiment list from an external server. The external server may store the aforementioned experiment list in the storage unit of the external server, and the communication unit of the experiment information providing device may receive the experiment list from the external server. Also, the experiment information providing device may transmit information indicating that the user has selected the first experiment to an external server. Subsequently, in step S370, the experiment information providing device may deliver the experiment preparation displayed on the display unit to the external server in real time. The external server may determine the preparation for experiment of the first experiment based on the received image of the preparation for experiment. Information on preparation materials for each experiment included in the experiment list may be stored in the storage unit of the external server. The external server compares the image of the preparation for experimentation of the first experiment stored in the storage unit of the external server with the image of the preparation for experiment in real time received from the experiment information providing device, and among the preparations for experimentation displayed on the display unit, the preparation for experiment of the first experiment, and 1 Can identify each item that is not a test preparation for the experiment. In addition, the external server may transmit information on each of the identified preparation for experiment of the first experiment and an item that is not a preparation for experiment of the first experiment to the experiment information providing device.

According to an embodiment, in the step of displaying a check mark on the experimental preparation for the first experiment among the captured images displayed by the display unit of the experiment information providing device (S370), the display unit further displays a highlight mark on the experimental preparation for the first experiment. You may. The highlight mark may be a mark highlighting the experimental preparation of the first experiment so that it can be compared with other experimental preparations. For example, the highlight mark may be a thick border of a specific color, for example, blue, displayed on the edge of the test preparation of the first experiment. In contrast, the highlight mark is displayed on the entire area of the test preparation of the first experiment. It may be a filter having transparency of a specific color, for example, blue. When the display unit of the experiment information providing device displays a highlight mark on the preparation material for the first experiment, the user may more clearly recognize the preparation material for the first experiment.

According to an embodiment, in the step of displaying a non-confirmed mark on an item that is not a test preparation for the first experiment among the photographed images displayed by the display unit of the experiment information providing device (S380), the display unit is not a test preparation for the first experiment. Non-emphasis may be further displayed on the article. The non-highlighted mark may be a mark highlighting an article that is not a preparation for the first experiment so that it can be compared with other preparations for the experiment. For example, the non-emphasis mark may be a thick border of a specific color, for example, red, displayed on the edge of an article that is not a test preparation of the first experiment. It may be a filter having transparency of a specific color, for example, red, displayed on the entire area of the article. Since the display unit of the experiment information providing device displays a non-emphasis mark on an article that is not a test preparation for the first experiment, the user can more clearly recognize the article that is not a test preparation for the first experiment.

According to one embodiment, the manufacturing method described in FIG. 6 and the apparatus using the same may further include, after step S380, displaying a list of test preparations to be prepared on the display unit of the experiment information providing device. The list of preparations for experiments to be prepared may be a list of other preparations for experiments more necessary as preparations for the first experiment in addition to the preparations for the first experiment marked with a check mark in step S370. That is, the user may check the experimental preparations prepared for the first experiment in step S370, but may not prepare all the experimental preparations for the first experiment. In this case, the user may need information about the remaining experimental preparations of the first experiment that were not prepared. The controller may transmit a list of preparations for experiments other than the preparations for experiments marked with the confirmation mark among the preparations for the first experiment to the display unit of the experiment information providing device. The display unit of the experiment information providing device may display test preparations to be prepared, and thus, the user may check test preparations to be further prepared in order to proceed with the first experiment.

According to an embodiment, in the manufacturing method described in FIG. 6 and the apparatus using the same, after step S380, when a confirmation mark is displayed on all of the experimental preparations for the first experiment, the display unit of the experiment information providing device proceeds with the first experiment. A step of displaying may be further included. Specifically, in step S370, a check mark may be displayed on the test preparations for the first experiment, and through this process, check marks may be displayed on all test preparations for the first experiment. In this case, it may be determined that all experimental preparations for performing the first experiment are prepared. The display unit of the experiment information providing device may display a message to the user indicating that all preparations for the experiment are prepared and may display a message indicating that the first experiment is in progress. Accordingly, the user may recognize that all materials for the first experiment have been prepared, and the first experiment can be performed at last.

7 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to another embodiment of the present invention. The experiment information providing method of FIG. 7 and the system using the same are compared to the experiment information providing method and system using the same of FIGS. Since they are substantially the same, redundant descriptions are omitted. For convenience of explanation, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information photographs at least one of a plurality of experimental tools in real time (S110). Next, the display unit of the experiment information providing device displays the captured image captured by the recording unit in real time (S120). Next, the control unit of the experiment information providing device determines the first experiment tool from the photographed image (S130). Then, the display unit of the experiment information providing device displays information about the first experiment tool (S150). Since these steps (S110 to S150) are substantially the same as the steps (S110 to S150) described with reference to FIGS. 1 to 3C, duplicate descriptions are omitted.

Next, the experiment information providing device receives a selection input for a first experiment among a plurality of experiments from the user (S360). In detail, the storage unit of the experiment information providing device may store an experiment list. The experiment list may be a list including names of a plurality of experiments. The display unit of the experiment information providing device may display the experiment list stored in the storage unit and provide it to the user. The user may select one experiment, eg, the first experiment, from the experiment list displayed on the display unit, and the apparatus for providing experiment information may receive a selection input for the first experiment from the user.

Next, the photographing unit of the experiment information providing device photographs the user's appearance (S470). The photographing unit of the apparatus for providing experiment information may photograph the appearance of a user performing the first experiment.

Next, the display unit of the experiment information providing device displays the user's external image in real time (S480). The display unit of the apparatus for providing experiment information may display an image of the user's appearance captured by the photographing unit in real time.

Next, the control unit of the experiment information providing device determines at least one of a plurality of wearable items for a first experiment among the external images of the user (S491). In order to conduct the first experiment, the user may be wearing an experimental wearable item necessary for conducting the first experiment. The control unit of the experiment information providing device may determine a plurality of experimental wearables of the first experiment from among wearables included in the external image of the user based on the user's external image displayed on the display unit.

Subsequently, the display unit of the experiment information providing device displays a confirmation mark on at least one wearable item for experimentation determined by the control unit among the user's external image (S492). The control unit may determine a wearable item for the first experiment among wearable items included in the user's external image, and the display unit may display a confirmation mark on the determined wearable item for the first experiment in real time. The confirmation mark may be a mark by which it can be visually confirmed that the test wearable product of the first experiment is worn. For example, the confirmation mark may be a circle mark such as 'Ο' or a check mark such as 'V'. The display unit of the experiment information providing device may display a confirmation mark on the wearable items for the first experiment among the wearable items displayed on the display unit. The confirmation mark is not limited to the above example, and may be replaced with other shapes if necessary.

According to another embodiment of the present invention, in a method for providing experiment information and a device using the same, a photographing unit of the apparatus for providing experiment information may capture an external image of a user and a display unit may display the external image in real time. In addition, the control unit may determine a wearable test item of the first experiment necessary for performing the first experiment among wearable items included in the external image, and the display unit may display a check mark on the wearable test item of the first experiment in real time. can Therefore, in order to proceed with the first experiment, the user may be able to confirm which wearable item to perform the first experiment among the worn items currently worn by the user through the confirmation mark.

According to an embodiment, in the method for providing experiment information described in FIG. 7 and the device using the same, the control unit generates information on the experimental wearables that need to be changed based on the external image of the user displayed by the display unit of the experiment information providing device, and , the display unit can display this. The information on the experimental wearables to be changed may be information on the experimental wearables to be changed by the user based on the information on the experimental wearables required for the first experiment. For example, the user should be wearing clothes that cover all of the arms, but may be wearing clothes that expose part of the arms. In this case, the controller may generate information about the experimental wearable that needs to be changed including a message indicating that the user should wear clothes that cover the entire arm, based on the external image of the user in which a part of the arm is exposed.

And, the display unit may display information on the experimental wearables requiring such a change. In detail, the display unit may display information about the experimental wearables that need to be changed in writing. In this case, the user can check the text displayed on the display unit.

However, unlike this, the display unit may display an unconfirmed mark in real time on the user's external image displayed based on the information on the experimental wearables that need to be changed. The unconfirmed mark may be an X mark such as 'X'. The display unit of the experiment information providing device may display an unconfirmed mark on the experimental wearables that need to be changed among the displayed external images of the user. The unconfirmed mark is not limited to the above example, and may be replaced with other shapes if necessary.

8 is a flowchart illustrating a method for providing experiment information using artificial intelligence according to another embodiment of the present invention. The experiment information providing method of FIG. 8 and the apparatus using the same are compared to the experiment information providing method of FIGS. 1 to 3C and the apparatus 100 using the same, except that the experiment information providing method further includes steps S560 to S580 If it is substantially the same bar, redundant description will be omitted. For convenience of explanation, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information photographs at least one of a plurality of experimental tools in real time (S110). Next, the display unit of the experiment information providing device displays the captured image captured by the recording unit in real time (S120). Next, the control unit of the experiment information providing device determines the first experiment tool from the photographed image (S130). Then, the display unit of the experiment information providing device displays information about the first experiment tool (S150). Since these steps (S110 to S150) are substantially the same as the steps (S110 to S150) described with reference to FIGS. 1 to 3C, duplicate descriptions are omitted.

Then, the photographing unit of the experiment information providing device photographs the user's experiment process while conducting the first experiment (S560). The user may proceed with each step of the first experiment, and the image of the user proceeding with each step may be photographed by the photographing unit. The display unit may display the user's experimental process being photographed in real time. The experiment information providing device may transmit the image of the user's experiment process displayed on the display unit to the control unit in real time, and the control unit performs the user's performance during a plurality of steps of the first experiment based on the received image of the user's experiment process. You can determine what steps you are taking.

Next, the control unit of the experiment information providing device generates information about the user's erroneous experiment performance in real time based on the user's experiment process (S570). The controller may determine whether the experiment step is performed correctly based on the received image of the user's experiment process in real time. For example, the user's experiment process may be the first step of the first experiment, and the controller may determine whether the first step is correctly performed using an image of the user's experiment process.

If the user does not correctly perform the first step, the controller may recognize the incorrect performance of the first step in real time. The controller may generate information about the user's incorrect experiment performance based on the specific information about the incorrect performance of the first step. The information on the wrong experiment performance may include at least one of incorrect use of an experiment tool and experiment performance out of the order of the first experiment.

Subsequently, the display unit of the experiment information providing device provides information about the erroneous experiment in real time to the user conducting the first experiment (S580). The display unit of the experiment information providing device may display information about the user's incorrect experiment performance generated by the controller and provide the information to the user. For example, the user may be using the eyedropper in a method other than the proper method of using the eyedropper and proceeding with the first step of the first experiment. In this case, the display unit may display information indicating that the user is using the eyedropper in an incorrect way.

In addition, the display unit may further display information on correct experiment execution as well as information on incorrect experiment performance and provide the information to the user. The information on performing the correct experiment may be information on a method for improving an erroneous experiment method being performed by the user in real time. For example, if the user is using the eyedropper in an incorrect way, the information about performing the experiment correctly may be a method of using the eyedropper. The display unit may display the method of using the eyedropper on the display unit, and the user may proceed to the first step again according to the correct method of using the eyedropper.

According to an embodiment, in operation S560, the experiment information providing device may transfer the image of the user's experiment process displayed on the display unit to at least one of the control unit and the external server in real time. In the case of transmission to an external server, the external server may determine a step the user is performing among a plurality of steps of the first experiment based on the received image of the user's experiment process. Subsequently, in step S570, the external server may determine whether or not the experiment step is performed correctly based on the received image of the user's experiment process in real time. If the user does not correctly perform the first step, the external server may recognize the incorrect execution of the first step in real time. The external server may deliver specific information about the incorrect execution of the first step to the experiment information providing device.

9 is a flowchart illustrating a method for providing experimental information using artificial intelligence according to another embodiment of the present invention. Compared to the method for providing experimental information in FIG. 9 and the apparatus using the same, the method for providing experimental information in comparison with the method for providing experimental information in FIGS. 1 to 3C and the apparatus 100 using the same except that the method for providing experimental information further includes steps S660 to S680. If it is substantially the same bar, redundant description will be omitted. For convenience of explanation, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information photographs at least one of a plurality of experimental tools in real time (S110). Next, the display unit of the experiment information providing device displays the captured image captured by the recording unit in real time (S120). Next, the control unit of the experiment information providing device determines the first experiment tool from the photographed image (S130). Then, the display unit of the experiment information providing device displays information about the first experiment tool (S150). Since these steps (S110 to S150) are substantially the same as the steps (S110 to S150) described with reference to FIGS. 1 to 3C, redundant descriptions are omitted.

Next, the microphone of the experiment information providing device receives a voice input of experimental values for each of a plurality of steps included in the first experiment from the user (S660). Specifically, the first experiment may include a plurality of steps, and a first step of the plurality of steps of the first experiment may be performed. While performing the first step, the user may obtain an experimental numerical value as a result of performing the experiment. The microphone of the experiment information providing device may receive a voice input for the experiment value from the user. The user may say the experimental value aloud, and the microphone of the experiment information providing device may receive and transfer the voice input to the control unit.

Next, the control unit of the experiment information providing device generates experiment data based on the audio input of the experiment value (S670). The control unit may convert the audio input of the experimental value into experimental data composed of text. For example, the experimental values may consist of numbers, and the control unit may convert a voice input reading the numbers into experimental data that is text including the numbers.

The experiment information providing device may subsequently receive a voice input of experimental values for each of a plurality of stages of the first experiment, and the controller may generate experiment data for each of a plurality of stages based on the voice input.

Subsequently, the display unit of the experiment information providing device provides experiment data to the user after the first experiment ends (S680). The control unit of the experiment information providing device may generate all experiment data of the first experiment by using the generated experiment data for each of a plurality of stages of the first experiment. The display unit of the experiment information providing device may display and provide the experiment data to the user after the user completes the first experiment.

A method for providing experiment information and a device using the same according to another embodiment of the present invention may generate experiment data according to a user's voice input. That is, the user may perform each step of the first experiment and directly input the experiment value into the microphone of the experiment information providing device by voice without writing and recording the experiment value in a notebook. The experiment information providing device may generate all experiment values as experiment data while the first experiment continues. The experiment information providing device may provide the experiment data to the user after the first experiment is finished, and the user may conveniently obtain the experiment data without directly writing the experiment data.

According to an embodiment, in the method of providing experimental information and the apparatus using the same, when an experimental value out of the error range is generated compared to the ideal experimental value in step S670, a message indicating that the experimental value is out of the error range is generated to the user. can be conveyed Specifically, the control unit of the experiment information providing device may generate experiment data based on a voice input of the experiment value. The controller may compare the generated experimental data with the ideal data, and calculate an error as a percentage. The ideal data may be numerical data when the first stage of the first experiment proceeds ideally. The control unit may compare the experimental data generated through step S670 with the ideal data, and calculate an error of the experimental data numerically deviating from the ideal data as a percentage. When the error of the experimental data with respect to the ideal data is greater than a predetermined error range, the display unit may display a message indicating that the experimental data is out of the error range. Accordingly, the user can effectively recognize that the specific step of the first experiment performed by the user is incorrectly performed, and the user can perform the experiment again.

The method for providing experimental information using artificial intelligence and the device using the same according to the present invention may include a new embodiment in which one or more of all the embodiments described in FIGS. 1 to 9 are combined. For example, the steps (S260 to S270) of the experiment information providing method described in FIGS. 4 to 5, the steps (S360 to S380) of the experiment information providing method described in FIG. 6, and the experiment information providing method described in FIG. 7 At least two of the steps S360 to S492, the steps S560 to S580 of the method for providing experimental information described with reference to FIG. 8, and the steps S660 to S680 of the method for providing experimental information described with reference to FIG. 9 are shown in FIGS. Following the steps (S110 to S150) described in 3c, they can be combined and performed in various ways regardless of the order, and a new embodiment can be achieved.

A method for providing experiment information using artificial intelligence according to various embodiments of the present disclosure includes: photographing at least one of a plurality of experimental tools by a photographing unit in real time; displaying, by a display unit, a photographed image captured by the photographing unit in real time; The method may include determining a first experiment tool from a photographed image taken by a photographing unit, and displaying information on the first experiment tool by a display unit.

According to another feature of the present invention, the information on the first experiment tool may include at least one of the name, definition, notes, and usage method of the first experiment tool.

According to another feature of the present invention, the method for providing experimental information includes the step of determining, by a controller, a second experimental tool from the captured image when an experimental tool included in a captured image is changed from a first experimental tool to a second experimental tool in real time. , and displaying information on the second experiment tool by the display unit.

According to another feature of the present invention, a method for providing experiment information includes receiving a selection input for a first experiment among a plurality of experiments from a user, displaying a confirmation mark on an experimental preparation for a first experiment among photographed images displayed on a display unit. The method may further include displaying an unchecked mark on an article that is not an experimental preparation for the first experiment among the photographed images displayed on the display unit.

According to another feature of the present invention, a method for providing experiment information includes receiving a selection input for a first experiment among a plurality of experiments from a user, photographing the user's appearance by a photographing unit, and photographing the user's appearance by a display unit. Displaying an external image in real time, determining, by a controller, at least one of a plurality of experimental wearables of the first experiment among the external images of the user, and determining, by the display unit, at least one experiment determined by the controller among the external images of the user A step of displaying an identification mark on the wearable product may be further included.

According to another feature of the present invention, a method for providing experiment information includes the step of photographing, by a photographing unit, an experiment process of a user conducting a first experiment; and information about a user's incorrect experiment performance in real time based on the user's experiment process, by a controller. The method may further include generating an , and providing information on an erroneous experiment in real time to a user performing the first experiment through a display unit.

According to another feature of the present invention, a method for providing experiment information includes receiving, by a microphone, a voice input of experimental values for each of a plurality of steps included in a first experiment from a user; The method may include generating experimental data, and providing the experimental data to a user after the first experiment is finished by a display unit.

An apparatus for providing experiment information using artificial intelligence according to various embodiments of the present disclosure includes a photographing unit that photographs at least one of a plurality of experimental tools in real time, a display unit that displays an image captured by the photographing unit in real time, and an image captured by the photographing unit. and a control unit for determining the first experimental tool from the display unit, and the display unit may display information on the first experimental tool.

In the above, the present invention has been described with specific details such as specific components and limited embodiments and drawings, but these are provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. No, and those skilled in the art to which the present invention pertains may seek various modifications and variations from these descriptions.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and it should be said that not only the claims to be described later, but also all modifications equivalent or equivalent to these claims fall within the scope of the spirit of the present invention. will be.

100: experiment information providing device
110: shooting unit
120: display unit
130: control unit

Claims (8)

photographing at least one of a plurality of experimental tools by a photographing unit in real time;
displaying, by a display unit, the photographed image taken by the photographing unit in real time;
determining, by a controller, a first experiment tool from the photographed image taken by the photographing unit; and
Including the step of displaying information on the first experiment tool by the display unit,
Receiving a selection input for a first experiment among a plurality of experiments from a user;
displaying, by the display unit, a confirmation mark on an experiment preparation corresponding to an experiment preparation of the first experiment among the experiment preparations displayed on the display unit;
The step of displaying, by the display unit, an unchecked mark on the test preparations corresponding to the test preparations other than the test preparations for the first experiment among the test preparations displayed on the display unit;
In the experiment preparation displayed on the display unit, at least one experiment preparation included in a photographed image captured through the photographing unit is displayed on the display unit in real time,
The control unit compares the image of at least one preparation for experiment included in the photographed image with the image of the preparation for experiment of the first experiment stored in the storage unit, and the preparation for experiment of the first experiment among the preparations for experiment displayed on the display unit. Determining the experimental preparation corresponding to the test preparation and the experimental preparation corresponding to the article excluding the experimental preparation of the first experiment,
The display unit displays a list of experimental preparations to be prepared excluding the experimental preparations marked with the confirmation mark among the experimental preparations of the first experiment, and when all of the experimental preparations of the first experiment are marked with a confirmation mark, the first A method for providing experiment information to display the progress of an experiment. According to claim 1,
The information on the first experiment tool includes at least one of the name, definition, notes, and usage method of the first experiment tool. According to claim 1,
determining, by the controller, the second experiment tool from the captured image when the experiment tool included in the captured image is changed from the first experiment tool to the second experiment tool; and
Further comprising the step of displaying information on the second experiment tool by the display unit, the experiment information providing method. delete According to claim 1,
receiving a selection input for a first experiment among a plurality of experiments from the user;
photographing the external appearance of the user by the photographing unit;
displaying, by the display unit, the external image of the user photographed by the photographing unit in real time;
determining, by the control unit, at least one of a plurality of experimental wearable items of the first experiment from among the external image of the user; and
The method of providing experiment information further comprising displaying, by the display unit, a confirmation mark on at least one experimental wearable item determined by the control unit among the external image of the user. According to claim 1,
photographing, by the photographing unit, an experiment process of the user performing a first experiment;
The control unit detects the user's erroneous experiment performance in real time based on at least one of the experiment sequence and the use of experiment tools of the experiment performed during the photographed user's experiment process, and the incorrect performance of the first experiment. Generating information about; and
The method of providing experiment information further comprising providing, by the display unit, information on the erroneous experiment performance to the user performing the first experiment in real time. According to claim 1,
receiving, by means of a microphone, a voice input of experimental values for each of a plurality of steps included in the first experiment from the user;
generating, by the control unit, experimental data based on the voice input of the experimental values; and
and providing, by the display unit, the experiment data to the user after the first experiment is finished. A photographing unit that photographs at least one of the plurality of experimental tools in real time;
a display unit that displays the image taken by the photographing unit in real time; and
Including a control unit for determining a first experiment tool from the image taken by the photographing unit,
The display unit displays information about the first experiment tool,
The control unit receives a selection input for a first experiment among a plurality of experiments from a user, displays a check mark on an experiment preparation corresponding to the experiment preparation of the first experiment among the experiment preparations displayed on the display unit, and displays a confirmation mark on the display unit. Among the displayed experimental preparations, a non-confirmation mark is displayed on the experimental preparations corresponding to the items other than the experimental preparations of the first experiment,
In the experiment preparation displayed on the display unit, at least one experiment preparation included in a photographed image captured through the photographing unit is displayed on the display unit in real time,
The control unit compares the image of at least one preparation for experiment included in the photographed image with the image of the preparation for experiment of the first experiment stored in the storage unit, and corresponds to the preparation for experiment of the first experiment among the preparations for experiment displayed on the display unit. Determine the experimental preparations corresponding to the experimental preparations and the items other than the experimental preparations of the first experiment,
The control unit displays a list of test preparations to be prepared excluding the test preparations marked with the check mark among the test preparations for the first experiment through the display unit, and all of the test preparations for the first experiment are marked with check marks. In this case, the experiment information providing device for displaying the progress of the first experiment.

Images