KR20220062868A - Method for providing experimental information using artificial intelligence and apparatus using the same - Google Patents

Abstract

A method for providing experimental information using artificial intelligence according to one embodiment of the present invention includes the steps of: photographing at least one of a plurality of experimental tools by a photographing unit in real time; displaying, in real time, a photographed image photographed by the photographing unit by a display unit; determining, by a control unit, a first experiment tool from the photographed image photographed by the photographing unit; and displaying information on the first experimental tool by the display unit. Accordingly, information on the experiment tool to be photographed is displayed on the display unit in real time, so that a user can conveniently check the information.

Description

A method for providing experimental information using artificial intelligence and a device using the same

The present invention relates to a method for providing experimental information using artificial intelligence and an apparatus using the same, and in more detail, a user who wants to conduct an experiment uses a terminal to photograph an experiment tool, and the terminal uses a display unit to perform an experiment with the experiment tool in real time To a method for providing experimental information using artificial intelligence that can display information about a tool and provide it to a user, and an apparatus using the same.

In general, many experimental tools are used in the process of conducting scientific experiments. Experimental tools used in science experiments may have different names, definitions, usage methods, and precautions, and they are not commonly used in real life. can

Various information about the experimental tool can be obtained through books or Internet searches, but it is not easy to know the name of the experimental tool only through the appearance of the experimental tool. It may not be easy to obtain information about the tool.

Accordingly, there is an increasing need for a user who conducts a scientific experiment to obtain various information about an experimental tool based only on information about the appearance of the experimental tool placed in front of him.

The object to be solved by the present invention is that a user conducting a scientific experiment can photograph an experimental tool with a terminal such as his or her mobile phone, and obtain information about the experimental tool in real time using the captured image.

The problems of the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

In order to solve the above problems, the method for providing experimental information using artificial intelligence according to an embodiment of the present invention includes the steps of: a photographing unit photographing at least one of a plurality of experimental tools in real time, and a photographed image photographed by a display unit photographing unit It may include the step of displaying in real time, the step of the control unit determining the first experiment tool from the photographed image taken by the photographing unit, and the step of displaying the information on the first experiment tool by the display unit. Accordingly, information about the experimental tool to be photographed is displayed on the display unit in real time, so that the user can easily check it.

In order to solve the above problems, the apparatus for providing experimental information using artificial intelligence according to an embodiment of the present invention displays a photographing unit that captures at least one of a plurality of experimental tools in real time, and an image captured by the photographing unit in real time and a control unit for determining the first experimental tool from the image taken by the photographing unit, and the display unit may display information about the first experimental tool and provide it to the user. Accordingly, information about the experimental tool to be photographed is displayed on the display unit in real time, so that the user can easily check it.

Details of other embodiments are included in the detailed description and drawings.

According to the present invention as described above, it has various effects as follows.

According to the present invention, an experiment tool is photographed with a terminal, and an image of the photographed experiment tool is displayed on the terminal in real time, and at the same time, various information about the experiment tool can be displayed together in real time.

The effect according to the present invention is not limited by the contents exemplified above, and more various effects are included in the present specification.

1 is a block diagram illustrating a schematic configuration of an apparatus for providing experimental information using artificial intelligence according to an embodiment of the present invention.
2 is a flowchart illustrating a method for providing experimental information using artificial intelligence according to an embodiment of the present invention.
3A to 3C are diagrams illustrating an apparatus for providing experimental information using artificial intelligence according to an embodiment of the present invention.
4 is a flowchart illustrating a method for providing experimental information using artificial intelligence according to another embodiment of the present invention.
5 is a diagram illustrating an apparatus for providing experimental information using artificial intelligence according to another embodiment of the present invention.
6 is a flowchart illustrating a method of providing experimental information using artificial intelligence according to another embodiment of the present invention.
7 is a flowchart illustrating a method for providing experimental information using artificial intelligence according to another embodiment of the present invention.
8 is a flowchart illustrating a method for providing experimental information using artificial intelligence according to another embodiment of the present invention.
9 is a flowchart illustrating a method for providing experimental information using artificial intelligence according to another embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in a variety of different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the technical field to which the present invention belongs It is provided to fully inform the possessor of the scope of the invention, and the present invention is only defined by the scope of the claims.

The shapes, sizes, proportions, angles, numbers, etc. disclosed in the drawings for explaining the embodiments of the present invention are illustrative and the present invention is not limited to the illustrated matters. Like reference numerals refer to like elements throughout. In addition, in describing the present invention, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. When 'including', 'having', 'consisting', etc. mentioned in this specification are used, other parts may be added unless 'only' is used. When a component is expressed in the singular, cases including the plural are included unless otherwise explicitly stated.

In interpreting the components, it is construed as including an error range even if there is no separate explicit description.

In the case of a description of the positional relationship, for example, when the positional relationship of two parts is described as 'on', 'on', 'on', 'beside', etc., 'right' Alternatively, one or more other parts may be positioned between two parts unless 'directly' is used.

Reference to a device or layer “on” another device or layer includes any intervening layer or other device directly on or in the middle of the other device or layer.

Although first, second, etc. are used to describe various elements, these elements are not limited by these terms. These terms are only used to distinguish one component from another. Accordingly, the first component mentioned below may be the second component within the spirit of the present invention.

Like reference numerals refer to like elements throughout.

The size and thickness of each component shown in the drawings are illustrated for convenience of description, and the present invention is not necessarily limited to the size and thickness of the illustrated component.

Each feature of the various embodiments of the present invention may be partially or wholly combined or combined with each other, and as those skilled in the art will fully understand, technically various interlocking and driving are possible, and each embodiment may be implemented independently of each other, It may be possible to implement together in a related relationship.

1 is a block diagram illustrating a schematic configuration of an apparatus for providing experimental information using artificial intelligence according to an embodiment of the present invention.

Referring to FIG. 1 , an experiment information providing apparatus 100 is a device capable of identifying an experiment tool included in an image captured in real time and providing information about the experiment tool to a user. Specifically, the apparatus 100 for providing experimental information includes a photographing unit 110 , a display unit 120 , and a control unit 130 .

The photographing unit 110 of the apparatus for providing experiment information 100 is configured to photograph an experiment tool. The photographing unit 110 may photograph the outside of the experimental information providing apparatus 100 in real time, and transmit the photographed image to the control unit 130 and the display unit 120 .

The control unit 130 of the apparatus for providing experimental information 100 is configured to determine an experiment tool included in the photographed image based on the photographed image photographed by the photographing unit 110 . The control unit 130 may receive information on the determined experiment tool from the storage unit of the apparatus 100 for providing experiment information or may be transmitted from an external server.

The display unit 120 of the apparatus 100 for providing experimental information is configured to display a real-time photographed image captured by the photographing unit 110 . In addition, the display unit 120 may display information about the experiment tool received from the control unit 130 of the apparatus 100 for providing experimental information together with the photographed image.

The display unit 120 of the apparatus 100 for providing experimental information may be a touch screen, and the user may transmit a touch input to the display unit 120 using a finger or the like. In this case, the display unit 120 may also perform the function of the input unit.

The experiment information providing apparatus 100 may include a microphone as another input unit. The microphone may receive a sound input around the experimental information providing apparatus 100, and thus may receive the user's voice data.

The experiment information providing apparatus 100 may form an experiment information providing system together with an external server. The experiment information providing system may include the experiment information providing apparatus 100 and an external server managed by a manager or the like. The external server exchanges signals and information with the experiment information providing device 100 , and uses the photographed image received from the experiment information providing device 100 to determine the experiment tool, and uses the experiment information providing device 100 for the experiment tool. This is the main external server that provides information.

The experimental information providing apparatus 100 may be an electronic terminal such as a mobile phone or a tablet PC used by a user using the experimental information providing system. The experiment information providing apparatus 100 may communicate with an external server by accessing the Internet. The experiment information providing apparatus 100 may include a communication unit for exchanging information with an external device such as an external server.

Next, a method for providing experimental information by the experimental information providing apparatus 100 will be described in detail.

2 is a flowchart illustrating a method for providing experimental information using artificial intelligence according to an embodiment of the present invention. 3A to 3C are diagrams illustrating an apparatus for providing experimental information using artificial intelligence according to an embodiment of the present invention. For convenience of description, it will be described with reference to FIG. 1 .

First, the photographing unit 110 of the apparatus 100 for providing experimental information captures at least one of the plurality of experimental tools in real time (S110). Referring to FIG. 3A , the apparatus 100 for providing experimental information may include a photographing unit 110 such as a camera capable of photographing pictures and images. The photographing unit 110 of the apparatus 100 for providing experiment information may photograph an experiment tool. The photographing unit 110 may face the experimental tool, and the experimental tool, for example, the igniter may be photographed by the photographing unit 110 .

Then, the display unit 120 of the experimental information providing apparatus 100 displays the captured image captured by the photographing unit 110 in real time (S120). Experimental tools illuminated by the photographing unit 110 may be displayed on the display unit 120 . The display unit 120 of the apparatus 100 for providing experimental information may include a first area in which an image captured by the photographing unit 110 in real time is displayed. In the first area of the display unit 120 , as shown in FIG. 3A , an igniter image captured by the photographing unit 110 in real time may be displayed.

Next, the control unit 130 of the apparatus 100 for providing experimental information determines the first experimental tool from the photographed image (S130). The captured image displayed on the first area of the display unit 120 of the apparatus 100 for providing experimental information may be transmitted to the controller 130 in real time.

The controller 130 may determine the experimental tool being photographed in real time based on the real-time photographed image. Specifically, the controller 130 may determine the first experimental tool from among various tools included in the captured image received from the experimental information providing apparatus 100 . The experiment information providing apparatus 100 may include a storage unit, and the controller 130 may compare a specific tool included in the captured image with images of various experimental tools stored in the storage unit. When the images of the various experimental tools stored in the storage and the images of the specific tool included in the photographed image match, the controller 130 may determine the specific tool as the first experimental tool. For example, the controller 130 may extract an igniter image from the photographed image, and may compare the igniter image with various experimental tool images stored in the storage unit. The controller 130 may determine that an image of an experimental tool called an igniter is matched among the plurality of experimental tool images. Accordingly, the controller 130 may determine that the tool included in the photographed image is the first experimental tool, that is, the igniter.

The control unit 130 may transmit information on the first experiment tool to the display unit 120 of the apparatus 100 for providing experimental information. In the case of FIG. 3A , the controller 130 may determine that the tool included in the photographed image is the first experimental tool, that is, the igniter, and may transmit information about the igniter to the display unit 120 . The information on the first experiment tool may include at least one of a name, a definition, notes for use, and a usage method of the first experiment tool.

Next, the display unit 120 of the experiment information providing apparatus 100 displays information on the first experiment tool (S150). 3A to 3C , the experiment information providing apparatus 100 may display information on the first experiment tool on the display unit 120 of the experiment information providing apparatus 100 . Specifically, the display unit 120 of the experiment information providing apparatus 100 may include a second area adjacent to the first area, and display the name and definition of the first experiment tool in the second area. In FIG. 3A , the display unit 120 may include a second area adjacent to a first area on which a photographed image is displayed, and in the second area, 'igniter', which is the name of the first experiment tool, and the first experiment tool. A definition, 'a laboratory instrument used to ignite a gas by igniting it' may be displayed.

The display unit 120 of the apparatus 100 for providing experiment information may include a third area adjacent to the second area, and a plurality of icons for obtaining information about the first experiment tool may be displayed in the third area. there is. In the third area, a plurality of icons, for example, a note icon, a usage method icon, a web page icon, and a chatbot icon may be displayed. The user may touch one of the plurality of icons displayed on the third area of the display unit 120 with a finger or the like. When the user selects and touches the note icon, information on the note point of the first experimental tool may be displayed on the display unit 120 as shown in FIG. 3B . When the user selects and touches the usage method icon, the usage method of the first experimental tool may be displayed on the display unit 120 as shown in FIG. 3C . When the user selects and touches a webpage icon, the display unit 120 may display a webpage related to the first experiment tool. In addition, when the user selects and touches the chatbot icon, the display unit 120 may display an artificial intelligence chatting screen that can provide various other information about the first experimental tool. The user may request more various information about the first experiment tool on the AI chatting screen, and the experiment information providing apparatus 100 may provide information using the artificial intelligence chatbot in response to the user's request.

The experimental information providing method and the apparatus 100 using the same according to an embodiment of the present invention display a captured image captured in real time by the photographing unit 110 of the experimental information providing apparatus 100 on the display unit of the experimental information providing apparatus 100 . 120 may display, and the controller 130 may determine the first experimental tool included in the captured image in real time. The experiment information providing apparatus 100 may display information on the first experiment tool on the display unit 120 in real time and provide it to the user. Accordingly, the user may photograph a specific experimental tool from which he/she wants to obtain information by using the experiment information providing apparatus 100 , and may obtain information about the experiment tool in real time. Accordingly, the user can easily acquire information on various experimental tools in real time by simply photographing the experimental tools from which he or she wants to obtain information.

According to an embodiment, the above-described step S130 may be performed by at least one of the experimental information providing apparatus 100 and an external server. That is, step S130 may be performed only by the apparatus 100 for providing experimental information as described above, whereas step S130 may be performed only by an external server. Alternatively, step S130 may be performed by both the experimental information providing apparatus 100 and the external server.

If step S130 is described in more detail with respect to being performed by an external server, the apparatus 100 for providing experimental information may include a communication unit that communicates with an external server managed by an administrator or the like. The communication unit of the experimental information providing apparatus 100 may transmit the captured image to an external server in real time after step S110 is performed. That is, the captured image displayed on the first area of the display unit 120 of the experiment information providing apparatus 100 may be transmitted to an external server in real time by the communication unit.

Subsequently, the experiment information providing apparatus 100 may receive information about the first experiment tool determined by the external server from the photographed image from the external server. The external server may determine the experimental tool being photographed in real time based on the real-time photographed image. Specifically, the external server may determine the first experimental tool from among various tools included in the photographed image received from the experimental information providing apparatus 100 . The external server may include a storage unit, and the external server may compare images of a specific tool included in the photographed image with various experimental tools stored in the storage unit. When the images of the various experimental tools stored in the storage and the images of the specific tool included in the photographed image match, the external server may determine the specific tool as the first experimental tool. For example, the external server may extract the igniter image from the photographed image, and may compare the igniter image with the images of various experimental tools stored in the storage unit. The external server may determine that the image of the experimental tool called the igniter is matched among the plurality of experimental tool images. Accordingly, the external server may determine that the tool included in the photographed image is the first experimental tool, that is, the igniter. In addition, the external server may transmit information about the first experiment tool to the experiment information providing apparatus 100 .

4 is a flowchart illustrating a method for providing experimental information using artificial intelligence according to another embodiment of the present invention. 5 is a diagram illustrating an apparatus for providing experimental information using artificial intelligence according to another embodiment of the present invention. The experimental information providing method of FIGS. 4 to 5 and the apparatus using the same are compared with the experimental information providing method of FIGS. 1 to 3C and the apparatus 100 using the same, and the experimental information providing method further includes steps S260 and S270 It is substantially the same except for that, and redundant descriptions are omitted. For convenience of description, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information captures at least one of the plurality of experimental tools in real time (S110). Next, the display unit of the apparatus for providing experimental information displays the captured image captured by the photographing unit in real time ( S120 ). Next, the control unit of the apparatus for providing experimental information determines the first experimental tool from the photographed image (S130). Next, the display unit of the apparatus for providing experimental information displays information on the first experimental tool (S150). These steps ( S110 to S150 ) are substantially the same as the steps ( S110 to S150 ) described with reference to FIGS. 1 to 3C , and thus redundant descriptions are omitted.

Next, when the experimental tool included in the captured image is changed from the first experimental tool to the second experimental tool in real time, the controller determines the second experimental tool from the captured image ( S260 ). The photographing unit of the apparatus for providing experiment information may change the experiment tool to be photographed from the first experiment tool to the second experiment tool. That is, the user may photograph the first experiment tool by using the photographing unit of the apparatus for providing experimental information, and then change the direction in which the photographing unit faces to the second experiment tool to photograph the second experiment tool. Referring to FIG. 5 , the display unit may display the first experiment tool in the first area and display the second experiment tool in the first area in response to a change in the object to be photographed by the photographing unit. The second experimental tool may be an eyedropper, and the eyedropper may be displayed on the first area of the display unit.

In this case, the controller may determine the experimental tool from the captured image displayed on the first area in real time. The controller may determine the second experimental tool by comparing and analyzing the image of the object included in the photographed image and the image of the experimental tool stored in the storage unit. For example, the control unit may compare the image of the second experiment tool included in the photographed image, that is, the eyedropper, with the images of various experiment tools included in the storage unit, and determine that the second experiment tool is the eyedropper.

Next, the display unit of the apparatus for providing experimental information displays information on the second experimental tool (S270). The display unit may display the name and definition of the second experiment tool in the second area, as shown in FIG. 5 , the name of the second experiment tool is 'eyedropper', and the definition of the second experiment tool is 'A rubber stopper is attached to one end. and a tapered glass tube at the other end.

A plurality of icons for obtaining information on the second experiment tool may be displayed on the third area of the display unit of the apparatus for providing experiment information. In the third area, a plurality of icons, for example, a note icon, a usage method icon, a web page icon, and a chatbot icon may be displayed. The user may touch one of the plurality of icons displayed on the third area of the display unit with a finger or the like. When the user selects and touches the note icon, information about the note point of the second experimental tool may be displayed on the display unit as shown in FIG. 3B. When the user selects and touches the usage method icon, the usage method of the second experimental tool may be displayed on the display unit as shown in FIG. 3C . When the user selects and touches the webpage icon, the display unit may display a webpage related to the second experimental tool. In addition, when the user selects and touches the chatbot icon, the display unit may display an artificial intelligence chatting screen that can provide various other information about the second experimental tool. The user may request more various information about the second experimental tool on the artificial intelligence chatting screen, and the display unit may provide information using the artificial intelligence chatbot in response to the user's request.

Experimental information providing method and apparatus using the same according to another embodiment of the present invention, when the experimental tool photographed by the photographing unit is changed from the first experimental tool to the second experimental tool, a real-time image captured by the photographing unit by the display unit of the experimental information providing device By displaying as it is, the image displayed by the display unit may be changed from the first experiment tool to the second experiment tool. In addition, the control unit may determine the second experimental tool from the captured image displayed in real time. The display unit may display information about the second experiment tool while displaying information about the first experiment tool. Accordingly, the user can change the shooting of the first experiment tool to take a picture of the second experiment tool, and in response to this, information about the second experiment tool displayed on the display unit can be quickly provided in real time.

According to an embodiment, the above-described step ( S260 ) may be performed by at least one of a control unit of the apparatus for providing experimental information and an external server. That is, step S130 may be performed only by the apparatus for providing experimental information as described above, whereas step S260 may be performed only by an external server. Alternatively, step S260 may be performed by both the experimental information providing device and the external server.

In more detail with respect to the step S260 being performed by the external server, when the experimental tool included in the photographed image is changed from the first experimental tool to the second experimental tool in real time, the experiment information providing device is sent from the external server. The external server may receive information about the second experimental tool determined from the photographed image. The photographing unit of the apparatus for providing experiment information may change the experiment tool to be photographed from the first experiment tool to the second experiment tool. That is, the user may photograph the first experiment tool by using the photographing unit of the apparatus for providing experimental information, and then change the direction in which the photographing unit faces to the second experiment tool to photograph the second experiment tool.

In this case, the external server may receive information about the captured image displayed on the first area by the display unit in real time from the communication unit of the experiment information providing apparatus. The external server may determine the experimental tool from the captured image displayed in the first area in real time. The external server may include a storage unit storing information on various experimental tools, and may determine the second experimental tool by comparing and analyzing the image of the object included in the photographed image and the image of the experimental tool stored in the storage unit. For example, the external server may compare the image of the second experiment tool included in the photographed image, that is, the eyedropper, with the image of various experiment tools included in the storage unit, and determine that the second experiment tool is the eyedropper. The external server may transmit information on the second experiment tool to the experiment information providing device.

6 is a flowchart illustrating a method for providing experimental information using artificial intelligence according to another embodiment of the present invention. The experimental information providing method of FIG. 6 and the system using the same are substantially compared to the experimental information providing method of FIGS. 1 to 3C and the system using the same, except that the experimental information providing method further includes steps S360 to S380. Since it is the same, a duplicate description will be omitted. For convenience of description, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information captures at least one of the plurality of experimental tools in real time (S110). Next, the display unit of the apparatus for providing experimental information displays the captured image captured by the photographing unit in real time ( S120 ). Next, the control unit of the apparatus for providing experimental information determines the first experimental tool from the photographed image (S130). Next, the display unit of the apparatus for providing experimental information displays information on the first experimental tool (S150). These steps ( S110 to S150 ) are substantially the same as the steps ( S110 to S150 ) described with reference to FIGS. 1 to 3C , and thus redundant descriptions are omitted.

Then, the experiment information providing apparatus receives a selection input for a first experiment among a plurality of experiments from the user (S360). In more detail, the storage unit of the apparatus for providing experiment information may store an experiment list. The experiment list may be a list including names of a plurality of experiments. The display unit of the apparatus for providing experiment information may display an experiment list stored in the storage unit and provide it to the user. The user may select one experiment, for example, the first experiment from the experiment list displayed on the display unit, and the experiment information providing apparatus may receive a selection input for the first experiment from the user.

Next, a confirmation mark is displayed on the experimental preparations of the first experiment among the captured images displayed by the display unit of the apparatus for providing experimental information (S370). Subsequently, the photographing unit of the apparatus for providing experimental information may photograph at least one of the plurality of experimental preparations, and the at least one experimental preparation photographed by the photographing unit may be displayed on the display unit in real time. That is, the user may photograph the experimental preparations placed around it using the photographing unit of the apparatus for providing experimental information, and the experimental preparations photographed by the user may be displayed on the display unit.

In this case, the experimental preparations may include the experimental preparations for the first experiment and articles other than the experimental preparations for the first experiment. That is, some of the experimental preparations may be experimental preparations used in the first experiment, and other parts may be items not used in the first experiment.

Experiment preparations photographed by the photographing unit and displayed by the display unit may be delivered to the control unit in real time. The controller may determine the experimental preparation for the first experiment based on the image of the received experimental preparation. The storage unit may store information about preparations for each experiment included in the experiment list. The information on the experimental preparations may include images, names, definitions, usage methods, precautions, etc. of the experimental preparations used for each experiment. The control unit compares the image of the real-time experimental preparation with the image of the experimental preparation for the first experiment stored in the storage unit to determine the experimental preparation for the first experiment and the article other than the experimental preparation for the first experiment among the experimental preparations displayed on the display unit, respectively can do.

The apparatus for providing experimental information may display a confirmation mark on the preparations for the first experiment among the preparations for the first experiment displayed on the display unit in real time, based on the information on the preparations for the first experiment. The confirmation mark may be a mark that can be visually confirmed as the preparation for the first experiment. For example, the confirmation mark may be a circle mark such as 'Ο' or a check mark such as 'V'. The display unit of the apparatus for providing experimental information may display the experimental preparations photographed by the photographing unit in real time, and may display a confirmation mark on the experimental preparations of the first experiment among the displayed experimental preparations. The confirmation mark is not limited to the above example, and may be replaced with a mark of another shape if necessary.

Next, a non-confirmation mark is displayed on an article that is not an experimental preparation for the first experiment among the photographed images displayed by the display unit of the apparatus for providing experimental information (S380). The apparatus for providing experimental information may display, in real time, an unconfirmed mark on items other than the preparations for the first experiment among the preparations for the experiment displayed on the display unit based on the information on the preparations for the first experiment. The non-confirmation mark may be a mark by which it can be visually confirmed that it is not the experimental preparation of the first experiment. For example, the non-confirmation mark may be an X mark such as 'X'. The display unit of the apparatus for providing experimental information may display the experimental preparations photographed by the photographing unit in real time, and may display an unconfirmed mark on items other than the experimental preparations of the first experiment among the displayed experimental preparations. The non-confirmation mark is not limited to the above example, and may be replaced with a mark of another shape if necessary.

Experimental information providing method and apparatus using the same according to another embodiment of the present invention, the apparatus for providing experimental information receives a selection input for the first experiment, and the display unit displays a confirmation mark on the experimental preparations for the first experiment among the photographed images, , a non-confirmation mark may be displayed on items not prepared for the first experiment among the photographed images. The user may photograph the experimental preparations by using the photographing unit, and may check the experimental preparations for the first experiment among the experimental preparations prepared through the display unit through the confirmation mark displayed in real time. In addition, the user can check through the non-confirmation mark displayed in real time what is not the experimental preparation for the first experiment among the experimental preparations through the display unit.

According to an embodiment, the apparatus for providing experiment information in step S360 may receive an experiment list from an external server. The external server may store the above-described experiment list in a storage unit of the external server, and the communication unit of the apparatus for providing experiment information may receive the experiment list from the external server. Also, the experiment information providing apparatus may transmit information that the user has selected the first experiment to an external server. Subsequently, in step S370 , the experiment information providing apparatus may deliver the experiment preparation displayed on the display unit to an external server in real time. The external server may determine the experimental preparations of the first experiment based on the image of the received experimental preparations. The storage unit of the external server may store information on the preparations for each experiment included in the experiment list. The external server compares the images of the real-time experimental preparations received from the experimental information providing device with the images of the experimental preparations of the first experiment stored in the storage of the external server, and among the experimental preparations displayed on the display unit, the experimental preparations for the first experiment, and the second 1 Each item that is not an experimental preparation for the experiment can be identified. In addition, the external server may transmit information on each of the determined experimental preparations for the first experiment and items that are not the experimental preparations for the first experiment to the experiment information providing device.

According to one embodiment, in the step (S370) of displaying a confirmation mark on the experimental preparations of the first experiment among the photographed images displayed by the display unit of the apparatus for providing experimental information, the display unit further displays a highlighting mark on the experimental preparations of the first experiment You may. The highlighting may be an indication that highlights the experimental preparation of the first experiment so that it can be compared with other experimental preparations. For example, the highlighting mark may be a bold border of a specific color, for example, blue, displayed on the border of the experimental preparation of the first experiment, in contrast, the highlighting mark is displayed on the entire area of the experimental preparation of the first experiment It may be a filter having transparency of a specific color, for example, blue. By displaying a highlight on the experimental preparations of the first experiment by the display unit of the experimental information providing device, the user may more clearly recognize the experimental preparations of the first experiment.

According to an embodiment, in the step (S380) of displaying a non-confirmation mark on an article that is not a preparation for the first experiment among the photographed images displayed by the display unit of the apparatus for providing experimental information, the display unit is not the preparation for the first experiment The article may be further marked with an unemphasized statement. The de-emphasis mark may be a mark highlighting an article that is not the experimental preparation of the first experiment so that it can be compared with other experimental preparations. For example, the non-emphasis mark may be a bold border of a specific color, for example, red, displayed on the border of an article that is not the test preparation of the first experiment; It may be a filter having a specific color displayed on the entire area of the article, for example, red transparency. By displaying a non-emphasis mark on the non-experimental preparations for the first experiment by the display unit of the experiment information providing device, the user may more clearly recognize the non-experimental preparations for the first experiment.

According to an embodiment, the manufacturing method described in FIG. 6 and the apparatus using the same may further include, after step S380 , displaying a list of experimental preparations to be prepared by the display unit of the apparatus for providing experimental information. The list of experimental preparations to be prepared may be a list of other experimental preparations that are more necessary as experimental preparations for the first experiment in addition to the experimental preparations for the first experiment marked with a confirmation mark in step S370 . That is, the user may receive the experimental preparations prepared for the first experiment in step S370, but may not have prepared all the experimental preparations for the first experiment. In this case, the user may need information about the remaining experimental preparations of the first experiment that have not been prepared. The control unit may transmit a list of other experimental preparations in addition to the experimental preparations marked with a confirmation mark among the experimental preparations for the first experiment to the display unit of the experimental information providing device. The display unit of the apparatus for providing experimental information may display the preparations for the experiment to be prepared, and thus, the user may check the preparations for the experiment to be further prepared in order to proceed with the first experiment.

According to an embodiment, in the manufacturing method described in FIG. 6 and the apparatus using the same, after step S380, when confirmation marks are displayed on all of the experimental preparations for the first experiment, the display unit of the experiment information providing device proceeds with the first experiment It may further include the step of displaying. Specifically, a confirmation mark may be displayed on the experimental preparations of the first experiment in step S370, and the confirmation mark may be displayed on all the experimental preparations of the first experiment through this process. In this case, it may be determined that all experimental preparations for performing the first experiment are ready. The display unit of the apparatus for providing experimental information may display a message that all preparations for the experiment are ready to the user, and may display a message indicating that the first experiment is being performed. Accordingly, the user can recognize that all of the preparations for the first experiment are ready, and can only proceed with the first experiment.

7 is a flowchart illustrating a method of providing experimental information using artificial intelligence according to another embodiment of the present invention. The experimental information providing method of FIG. 7 and the system using the same are compared with the experimental information providing method of FIGS. 1 to 3C and the system using the same, except that the experimental information providing method further includes steps S360, S470 to S492 Since they are substantially the same, duplicate descriptions will be omitted. For convenience of description, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information captures at least one of the plurality of experimental tools in real time (S110). Next, the display unit of the apparatus for providing experimental information displays the captured image captured by the photographing unit in real time ( S120 ). Next, the control unit of the apparatus for providing experimental information determines the first experimental tool from the photographed image (S130). Next, the display unit of the apparatus for providing experimental information displays information on the first experimental tool (S150). These steps ( S110 to S150 ) are substantially the same as the steps ( S110 to S150 ) described with reference to FIGS. 1 to 3C , and thus redundant descriptions are omitted.

Then, the experiment information providing apparatus receives a selection input for a first experiment among a plurality of experiments from the user (S360). In more detail, the storage unit of the apparatus for providing experiment information may store an experiment list. The experiment list may be a list including names of a plurality of experiments. The display unit of the apparatus for providing experiment information may display an experiment list stored in the storage unit and provide it to the user. The user may select one experiment, for example, the first experiment from the experiment list displayed on the display unit, and the experiment information providing apparatus may receive a selection input for the first experiment from the user.

Next, the photographing unit of the apparatus for providing experimental information captures the user's appearance (S470). The photographing unit of the apparatus for providing experiment information may photograph the appearance of the user who will perform the first experiment.

Next, the display unit of the apparatus for providing experimental information displays the user's external image in real time (S480). The display unit of the apparatus for providing experimental information may display an image of the user's appearance captured by the photographing unit in real time.

Next, the control unit of the experiment information providing apparatus determines at least one of the plurality of experimental wear items of the first experiment among the external image of the user (S491). The user may be wearing the experimental wear necessary to proceed with the first experiment in order to proceed with the first experiment. The control unit of the apparatus for providing experimental information may determine, based on the user's external image displayed on the display unit, a plurality of experimental wearables of the first experiment from among the wearables included in the external image.

Next, the display unit of the apparatus for providing experimental information displays a confirmation mark on at least one experimental wear item determined by the control unit among the external images of the user (S492). The experimental wearables of the first experiment may be discriminated by the control unit among the wearables included in the user's external image, and the display unit may display a confirmation mark on the determined experimental wearables of the first experiment in real time. The confirmation mark may be a mark that can be visually confirmed that it is the experimental wear item of the first experiment. For example, the confirmation mark may be a circle mark such as 'Ο' or a check mark such as 'V'. The display unit of the apparatus for providing experimental information may display a confirmation mark on the experimental wearable article of the first experiment among the wearable articles displayed on the display unit. The confirmation mark is not limited to the above example, and may be replaced with a mark of another shape if necessary.

According to another embodiment of the present invention, a method for providing experimental information and an apparatus using the same may include a photographing unit of the apparatus for providing experimental information, and a display unit displaying the external image in real time. In addition, the control unit may determine the experimental wear item of the first experiment required to perform the first experiment among the wear items included in the external image, and the display unit displays a confirmation mark on the experimental wear item of the first experiment in real time. can Accordingly, the user may be confirmed through the confirmation mark which wear item is worn for performing the first experiment among the wear items currently worn by the user in order to proceed with the first experiment.

According to one embodiment, in the method for providing experimental information described in FIG. 7 and the apparatus using the same, the control unit generates information on the experimental wearable items that need to be changed, based on the external image of the user displayed by the display unit of the apparatus for providing experimental information, and , the display unit may display it. The information on the experimental wearables that needs to be changed may be information on the experimental wearables to be changed by the user based on the information on the experimental wearables required to proceed with the first experiment. For example, the user may be wearing clothes that cover all of the arms, but part of the arms are exposed. In this case, the control unit may generate information about the experimental wearable item that needs to be changed including a message indicating that the entire arm should be worn based on the user's external image in which a part of the arm is exposed.

In addition, the display unit may display information about the experimental wear that requires such a change. Specifically, the display unit may display information about the experimental wear item that needs to be changed in writing. In this case, the user can check the text displayed on the display unit.

However, unlike this, the display unit may display the non-confirmation mark in real time on the user's external image displayed based on the information on the experimental wear item that needs to be changed. The non-confirmation mark may be an X mark such as 'X'. The display unit of the apparatus for providing experimental information may display a non-confirmation mark on the experimental wearable item that needs to be changed among the displayed external images of the user. The non-confirmation mark is not limited to the above example, and may be replaced with a mark of another shape if necessary.

8 is a flowchart illustrating a method of providing experimental information using artificial intelligence using artificial intelligence according to another embodiment of the present invention. The experimental information providing method of FIG. 8 and the apparatus using the same are compared with the experimental information providing method of FIGS. 1 to 3C and the apparatus 100 using the same, except that the experimental information providing method further includes steps S560 to S580 When it is substantially the same, a duplicate description will be omitted. For convenience of description, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information captures at least one of the plurality of experimental tools in real time (S110). Next, the display unit of the apparatus for providing experimental information displays the captured image captured by the photographing unit in real time ( S120 ). Next, the control unit of the apparatus for providing experimental information determines the first experimental tool from the photographed image (S130). Next, the display unit of the apparatus for providing experimental information displays information on the first experimental tool (S150). These steps ( S110 to S150 ) are substantially the same as the steps ( S110 to S150 ) described with reference to FIGS. 1 to 3C , and thus redundant descriptions are omitted.

Next, the photographing unit of the apparatus for providing experiment information captures the user's experimentation process in the first experiment ( S560 ). The user may proceed with each step of the first experiment, and the image of the user performing each step may be photographed by the photographing unit. The display unit may display the user's experimental process being photographed in real time. The experimental information providing apparatus may transmit an image of the user's experimental process displayed on the display unit to the control unit in real time, and the control unit performs the user's operation among a plurality of steps of the first experiment based on the received image of the user's experimental procedure. You can determine the steps you are taking.

Next, the control unit of the experiment information providing apparatus generates information about the user's erroneous experimentation in real time based on the user's experiment process (S570). The controller may determine whether the experimental step performed is correctly performed based on the image of the user's experimental process received in real time. For example, the user's experimental process may be a first stage among the first experiments, and the controller may determine whether the first stage is correctly performed using an image of the user's experimental process.

If the user does not correctly perform the first step, the controller may recognize the incorrect execution of the first step in real time. The control unit may generate information about the user's erroneous experimentation based on specific information about the incorrect performance of the first step. The information on the erroneous experimentation may include at least one of an erroneous use of an experimental tool and an experiment performed out of the experimental sequence of the first experiment.

Next, the display unit of the experiment information providing device provides information on erroneous experimentation to the user conducting the first experiment in real time (S580). The display unit of the experiment information providing apparatus may display information about the user's erroneous experimentation generated by the control unit and provide it to the user. For example, the user may be using the eyedropper in a way other than the correct way of using the eyedropper and performing the first stage of the first experiment. In this case, the display unit may display information indicating that the eyedropper is being used in a way other than the correct way to the user.

In addition, the display unit may further display information on correct experimentation along with information on incorrect experimentation to provide to the user. The information on the correct experimentation may be information on how the user can improve the wrong experimentation method being performed in real time. For example, if the user is using the eyedropper in an incorrect way, information on correct experimentation may be the method of using the eyedropper. The display unit may display the method of using the dropper on the display unit, and the user may proceed with the first step again according to the correct method of using the eyedropper.

According to an embodiment, in step S560 , the apparatus for providing experiment information may transmit the image of the user's experiment process displayed on the display unit to at least one of the control unit and the external server in real time. In the case of transmission to the external server, the external server may determine the step the user is performing among the plurality of steps of the first experiment based on the received image of the user's experimental process. Subsequently, in step S570 , the external server may determine whether the experimental step performed on the basis of the image of the user's experimental process received in real time is correctly performed. If the user does not correctly perform the first step, the external server may recognize the incorrect execution of the first step in real time. The external server may deliver specific information about incorrect performance of the first step to the experiment information providing device.

9 is a flowchart illustrating a method of providing experimental information using artificial intelligence using artificial intelligence according to another embodiment of the present invention. The experimental information providing method of FIG. 9 and the apparatus using the same are compared with the experimental information providing method of FIGS. 1 to 3C and the apparatus 100 using the same, except that the experimental information providing method further includes steps S660 to S680 When it is substantially the same, a duplicate description will be omitted. For convenience of description, it will be described with reference to FIGS. 1 to 3C.

First, the photographing unit of the apparatus for providing experimental information captures at least one of the plurality of experimental tools in real time (S110). Next, the display unit of the apparatus for providing experimental information displays the captured image captured by the photographing unit in real time ( S120 ). Next, the control unit of the apparatus for providing experimental information determines the first experimental tool from the photographed image (S130). Next, the display unit of the apparatus for providing experimental information displays information on the first experimental tool (S150). These steps ( S110 to S150 ) are substantially the same as the steps ( S110 to S150 ) described with reference to FIGS. 1 to 3C , and thus redundant descriptions are omitted.

Next, the microphone of the apparatus for providing experimental information receives a voice input of an experimental value for each of a plurality of steps included in the first experiment from the user ( S660 ). Specifically, the first experiment may include a plurality of steps, and a first step among the plurality of steps of the first experiment may be performed. The user may obtain an experimental value that is a result of performing an experiment while performing the first step. The microphone of the apparatus for providing experimental information may receive a voice input for the experimental value by the user. The user may speak the experimental value aloud, and the microphone of the apparatus for providing experimental information may receive the voice input and transmit it to the control unit.

Next, the control unit of the apparatus for providing experimental information generates experimental data based on the voice input of the experimental value (S670). The controller may convert the voice input of the experimental value into experimental data composed of text. For example, the experimental value may be made of numbers, and the control unit may convert a voice input for reading the number into experimental data that is text including numbers.

The apparatus for providing experimental information may subsequently receive a voice input of an experimental value for each of the plurality of stages of the first experiment, and the controller may generate experimental data for each of the plurality of stages based on the voice input.

Then, the display unit of the experiment information providing device provides the experiment data to the user after the end of the first experiment (S680). The control unit of the experiment information providing apparatus may generate the entire experiment data of the first experiment by using the experimental data for each of a plurality of stages of the generated first experiment. The display unit of the experiment information providing apparatus may display and provide the experiment data to the user after the user completes the first experiment.

A method for providing experimental information and an apparatus using the same according to another embodiment of the present invention may generate experimental data in response to a user's voice input. That is, the user may perform each step of the first experiment and directly input the experimental value into a microphone of the experimental information providing device by voice, without writing and recording the experimental value in a notebook. The experimental information providing device may generate all experimental values as experimental data while the first experiment continues. The apparatus for providing experimental information may provide experimental data to the user after the first experiment is completed, and the user may conveniently obtain experimental data without directly writing the experimental data.

According to one embodiment, the experimental information providing method and the device using the same, when compared with the ideal experimental value and the experimental value out of the error range is generated in step (S670), a message to the user that the experimental value is out of the error range can transmit Specifically, the control unit of the apparatus for providing experimental information may generate experimental data based on the voice input of the experimental value. The controller may compare the generated experimental data with the ideal data, and may calculate the error as a percentage. The ideal data may be numerical data when the first stage of the first experiment was performed ideally. The controller may compare the experimental data generated through step S670 with the ideal data to calculate an error of the experimental data numerically deviating from the ideal data as a percentage. When the error with respect to the ideal data of the experimental data is greater than a predetermined error range, the display unit may display a message indicating that the experimental value is out of the error range. Accordingly, the user can effectively recognize that a specific step of the first experiment performed by the user was erroneously performed, and can proceed with the experiment again.

The method for providing experimental information using artificial intelligence of the present invention and an apparatus using the same may include a new embodiment in which one or more of the embodiments described with reference to FIGS. 1 to 9 are combined. For example, steps S260 to S270 of the method for providing experimental information described in FIGS. 4 to 5 , steps S360 to S380 of the method for providing experiment information described with reference to FIG. 6 , and steps S360 to S380 of the method for providing experimental information described in FIG. At least two of the steps S360 to S492, the steps S560 to S580 of the method for providing experimental information described in FIG. 8, and the steps S660 to S680 of the method for providing the experimental information described in FIG. Following the steps S110 to S150 described in 3c, various combinations may be performed regardless of the order, and a new embodiment may be achieved.

The method for providing experimental information using artificial intelligence according to various embodiments of the present invention includes the steps of: a photographing unit photographing at least one of a plurality of experimental tools in real time; displaying a photographed image captured by the photographing unit in real time; It may include the steps of determining the first experiment tool from the photographed image taken by the photographing unit, and displaying information on the first experiment tool by the display unit.

According to another feature of the present invention, the information on the first experiment tool may include at least one of a name, definition, notes, and usage method of the first experiment tool.

According to another feature of the present invention, in the method for providing experimental information, when the experimental tool included in the photographed image is changed from the first experiment tool to the second experiment tool in real time, the control unit determines the second experiment tool from the photographed image , and the display unit may further include displaying information about the second experimental tool.

According to another feature of the present invention, the experiment information providing method includes the steps of receiving a selection input for a first experiment among a plurality of experiments from a user, and displaying a confirmation mark on the experimental preparations for the first experiment among the photographed images on which the display unit is displayed The method may further include displaying a non-confirmation mark on an article that is not an experimental preparation for the first experiment among the photographed images on which the display unit is displayed.

According to another feature of the present invention, the experiment information providing method includes the steps of: receiving a selection input for a first experiment among a plurality of experiments from a user; The step of displaying the appearance image in real time, the step of determining, by the controller, at least one of a plurality of test wear items of the first experiment among the user's external images, and at least one experiment determined by the controller among the external images of the user by the display unit The method may further include displaying a confirmation mark on the wearable article.

According to another feature of the present invention, the experimental information providing method includes the steps of: a photographing unit photographing a user's experimental process in which a first experiment is performed; It may further include the step of generating, and the display unit providing information on erroneous experimentation in real time to a user who conducts the first experiment.

According to another feature of the present invention, in the experimental information providing method, the microphone receives a voice input of an experimental value for each of a plurality of steps included in the first experiment from a user, the control unit based on the voice input of the experimental value It may include generating the experimental data, and the display unit providing the experimental data to the user after the end of the first experiment.

An apparatus for providing experimental information using artificial intelligence according to various embodiments of the present disclosure includes a photographing unit that captures at least one of a plurality of experimental tools in real time, a display unit that displays images photographed by the photographing unit in real time, and an image captured by the photographing unit and a control unit for discriminating the first experiment tool from the display unit may display information about the first experiment tool.

In the above, the present invention has been described with specific matters such as specific components and limited embodiments and drawings, but these are only provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments No, those of ordinary skill in the art to which the present invention pertains can devise various modifications and variations from these descriptions.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and not only the claims described below, but also all modifications equivalently or equivalent to the claims described below are said to be within the scope of the spirit of the present invention. will be.

100: Experimental information providing device
110: shooting department
120: display unit
130: control unit

Claims (8)

A step of the photographing unit photographing at least one of the plurality of experimental tools in real time;
displaying, by a display unit, a captured image captured by the photographing unit in real time;
determining, by the control unit, a first experimental tool from the photographed image photographed by the photographing unit; and
The method of providing experimental information using artificial intelligence, comprising the step of the display unit displaying information on the first experimental tool. According to claim 1,
The information on the first experimental tool includes at least one of a name, definition, notes, and usage method of the first experimental tool, a method for providing experimental information using artificial intelligence. According to claim 1,
determining, by the controller, the second experimental tool from the captured image when the experimental tool included in the photographed image is changed from the first experimental tool to the second experimental tool in real time; and
The method of providing experimental information using artificial intelligence, further comprising the step of the display unit displaying information on the second experimental tool. According to claim 1,
receiving a selection input for a first experiment among a plurality of experiments from a user;
displaying a confirmation mark on the experimental preparations for the first experiment among the photographed images on which the display unit is displayed;
The method of providing experimental information using artificial intelligence, further comprising the step of displaying an unconfirmed mark on articles other than the experimental preparations for the first experiment among the photographed images displayed by the display unit. The method of claim 1,
receiving a selection input for a first experiment among a plurality of experiments from a user;
photographing, by the photographing unit, an appearance of the user;
displaying, by the display unit, an external image of the user captured by the photographing unit in real time;
determining, by the control unit, at least one of a plurality of experimental wearables of the first experiment from among the external images of the user; and
The method of providing experimental information using artificial intelligence, further comprising the step of displaying, by the display unit, a confirmation mark on at least one experimental wear item determined by the control unit among the external image of the user. According to claim 1,
photographing, by the photographing unit, an experiment process of a user conducting a first experiment;
generating, by the controller, information on the user's erroneous experimentation in real time based on the user's experimental process; and
The method of providing experiment information using artificial intelligence, further comprising the step of providing, by the display unit, information on the erroneous experimentation in real time to the user conducting the first experiment. According to claim 1,
receiving, by a microphone, a voice input of an experimental value for each of a plurality of steps included in the first experiment from a user;
generating, by the controller, experimental data based on the voice input of the experimental value; and
Comprising the step of the display unit providing the experiment data to the user after the end of the first experiment, experiment information providing method using artificial intelligence. a photographing unit for photographing at least one of a plurality of experimental tools in real time;
a display unit for displaying the image captured by the photographing unit in real time; and
And a control unit for determining the first experimental tool from the image taken by the photographing unit,
The display unit displays information on the first experimental tool, an apparatus for providing experimental information using artificial intelligence.

Images