AU2021200532A9 - Visualization System Based on Artificial Intelligence Inference and Method Thereof - Google Patents

Visualization System Based on Artificial Intelligence Inference and Method Thereof Download PDF

Info

Publication number
AU2021200532A9
AU2021200532A9 AU2021200532A AU2021200532A AU2021200532A9 AU 2021200532 A9 AU2021200532 A9 AU 2021200532A9 AU 2021200532 A AU2021200532 A AU 2021200532A AU 2021200532 A AU2021200532 A AU 2021200532A AU 2021200532 A9 AU2021200532 A9 AU 2021200532A9
Authority
AU
Australia
Prior art keywords
image data
specified
precision
recommended template
data set
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
AU2021200532A
Other versions
AU2021200532A1 (en
Inventor
Hsi Yu Chen
Guan Yi Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitac Information Technology Corp
Original Assignee
Mitac Information Technology Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitac Information Technology Corp filed Critical Mitac Information Technology Corp
Priority to AU2021200532A priority Critical patent/AU2021200532A1/en
Publication of AU2021200532A1 publication Critical patent/AU2021200532A1/en
Publication of AU2021200532A9 publication Critical patent/AU2021200532A9/en
Abandoned legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/20Drawing from basic elements, e.g. lines or circles
    • G06T11/206Drawing of charts or graphs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A visualization system based on artificial intelligence inference and a method thereof are disclosed. In the visualization system, a graphical user interface can provide a user to drag and select an image data set, to load and display the recommended template matching the selection result. The recommended template automatically specifies an Al model and a dashboard for the selected image data set, and after an inference calculation is performed, an inference result and a precision of the recommended template is displayed to be a basis of adjusting the recommended template, so as to achieve the technical effect of improving convenience in model selection and operation. -18- 1/8 110 Storage module 120 130 140 150 [nitializatio Loading Executing Display module module module module FIG. 1

Description

1/8
110
Storage module
120 130 140 150
[nitializatio Loading Executing Display module module module module
FIG. 1
P/00/011 Regulation 3.2 AUSTRALIA
Patents Act 1990
COMPLETE SPECIFICATION FORASTANDARDPATENT ORIGINAL TO BE COMPLETED BY APPLICANT
Invention Title: Visualization System Based on Artificial Intelligence Inference and Method Thereof
Name of Applicant: Mitac Information Technology Corp.
Address for Service: A.P.T. Patent and Trade Mark Attorneys PO Box 833, Blackwood, SA 5051
The following statement is a full description of this invention, including the best method of performing it known to me/us:
la
VISUALIZATION SYSTEM BASED ON ARTIFICIAL INTELLIGENCE INFERENCE AND METHOD THEREOF BACKGROUND OF THE INVENTION
1. Field of the Invention
[0001] The present invention relates to a visualization system and a method thereof, and
more particularly to a visualization system based on artificial intelligence inference and a
method thereof.
2. Description of the Related Art
[0002] In recent years, with the popularization and rapid development of artificial
intelligence (AI), various applications that combine artificial intelligence have sprung up.
However, there are certain thresholds for using artificial intelligence, so how to use artificial
intelligence more conveniently has become one of the problems that manufacturers urgently
want to solve.
[0003] Generally speaking, the conventional method of using artificial intelligence requires
the user to train the model first, and then store the trained model in the file directory of the
inference system, and then the inference system selects the trained model for deployment of
application programming interface (API) services. However, the conventional inference
system does not have a visual interface part, the user must link the source data with the API
service by a program and check the identification result on a graphical interface of the
program. In other words, when the user wants to apply Al to a new situation, the user needs to
re-train a new model, the conventional method does not permit the user to directly deploy the
model by a dragging manner, and the user cannot quickly and intuitively view the recognition
results and accuracy of the applied model. Therefore, the conventional method has a problem
of insufficient convenience in model selection and operation.
[0004] According to above-mentioned contents, what is needed is to develop an improved
technical solution to solve the conventional technical problem of insufficient convenience in model selection and operation.
SUMMARY OF THE INVENTION
[0005] The present invention discloses a visualization system based on artificial intelligence inference. The visualization system includes a storage module, an initialization module, a
loading module, an executing module and display module. The storage module is configured
to store at least one recommended template, a plurality of image data sets from different
sources, a plurality of Al models trained with different identification algorithms, and a
plurality of dashboards. The at least one recommended template comprises specified at least
one of the plurality of image data sets, specified at least one of the plurality of Al models and
specified at least one of the plurality of dashboards. The initialization module is connected to
the storage module and configured to, in initial, generate a graphical user interface (GUI) to
display the plurality of image data sets, and permit to drag and drop the displayed image data
set to a candidate block of the graphical user interface as a dragged unit. The loading module
is connected to the storage module and the initialization module configured to select one, which comprises the dragged unit, of the at least one recommended template, and load the
specified image data set, the specified Al model and the specified dashboard comprised in the
selected recommended template. The executing module is connected to the loading module
and configured to when an execution command is triggered, input the loaded image data set to
the loaded Al model to perform an inference calculation, and generate an inference result
based on the inference calculation, and detect whether the selected recommended template has
a precision. When the selected recommended template has a precision, the executing module
directly load the precision, and when the selected recommended template does not have the
precision, the executing module calculates the precision corresponding to the inference result,
and set the calculated precision as the precision of the selected recommended template. The
display module is connected to the loading module and the executing module, and configured
to use the loaded dashboard to display the inference result and the precision, which is directly
loaded or calculated, on the GUI.
[0006] Furthermore, the present invention discloses a visualization method based on artificial intelligence inference, and the visualization method including following steps of: providing at least one recommended template, a plurality of image data sets from different sources, a plurality of Al models trained with different identification algorithms, and a plurality of dashboards, wherein the at least one recommended template comprises specified at least one of the plurality of image data sets, specified at least one of the plurality of Al models and specified at least one of the plurality of dashboards; in initial, generating a graphical user interface to display the plurality of image data sets, and permitting to drag and drop one of the plurality of displayed image data sets to a candidate block of the graphical user interface as a dragged unit; selecting one, comprising the dragged unit, of the at least one recommended template, and loading the specified image data set, the specified Al model and the specified dashboard of the selected recommended template; when an execution command is triggered, inputting the loaded image data set into the loaded Al model to perform an inference calculation, and generating an inference result based on the inference calculation; detecting whether the selected recommended template has a precision, and when the selected recommended template has the precision, directly loading the precision, and when the selected recommended template does not have the precision, calculating the precision corresponding to the inference result, and setting the calculated precision as the precision of the selected recommended template; using the loaded dashboard to display the inference result and the precision, which is directly loaded or calculated, on the graphical user interface.
[0007] According to above-mentioned system and method of the present invention, the
difference between the system and method of the present invention and the conventional
technology is that in the system and method of the present invention the GUI can provide a
user to drag and select the image data set, and load and display the recommended template
matching the selection result, the recommended template automatically specifies the Al model
and the dashboard for the selected image data set, and after the inference calculation is
performed, the inference result and the precision of the recommended template are displayed
as the basis of adjusting the recommended template.
[0008] The aforementioned technical solution of the present invention can achieve the technical effect of improving convenience in model selection and operation.
BRIEF DESCRIPTION OF THE DRAWINGS
[0009] The structure, operating principle and effects of the present invention will be
described in detail by way of various embodiments which are illustrated in the accompanying
drawings.
[0010] FIG. 1 is a system block diagram of a visualization system based on artificial
intelligence inference, according to the present invention.
[0011] FIGS. 2A and 2B are flowcharts of a visualization method based on artificial
intelligence inference, according to the present invention.
[0012] FIG. 3 is a system block diagram of a visualization system based on artificial
intelligence inference, according to another embodiment of the present invention.
[0013] FIGS. 4A and 4B are schematic views showing an operation of displaying a
recommended template of the present invention.
[0014] FIGS. 5A and 5B are schematic views showing an operation of creating a new
recommended template, according to the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] The following embodiments of the present invention are herein described in detail
with reference to the accompanying drawings. These drawings show specific examples of the
embodiments of the present invention. These embodiments are provided so that this
disclosure will be thorough and complete, and will fully convey the scope of the invention to
those skilled in the art. It is to be acknowledged that these embodiments are exemplary
implementations and are not to be construed as limiting the scope of the present invention in
any way. Further modifications to the disclosed embodiments, as well as other embodiments,
are also included within the scope of the appended claims.
[0016] These embodiments are provided so that this disclosure is thorough and complete, and
fully conveys the inventive concept to those skilled in the art. Regarding the drawings, the
relative proportions and ratios of elements in the drawings may be exaggerated or diminished
in size for the sake of clarity and convenience. Such arbitrary proportions are only illustrative and not limiting in any way. The same reference numbers are used in the drawings and description to refer to the same or like parts. As used herein, the singular forms "a", "an" and
"the" are intended to include the plural forms as well, unless the context clearly indicates
otherwise. As used herein, the term "or" includes any and all combinations of one or more of
the associated listed items.
[0017] It will be acknowledged that when an element or layer is referred to as being "on," "connected to" or "coupled to" another element or layer, it can be directly on, connected or
coupled to the other element or layer, or intervening elements or layers may be present. In
contrast, when an element is referred to as being "directly on," "directly connected to" or
"directly coupled to" another element or layer, there are no intervening elements or layers
present.
[0018] In addition, unless explicitly described to the contrary, the words "comprise" and
"include", and variations such as "comprises", "comprising", "includes", or "including", will
be acknowledged to imply the inclusion of stated elements but not the exclusion of any other
elements.
[0019] The environment where the present invention is applied is described before
illustration of the visualization system based on artificial intelligence inference and a method
thereof. The present invention applies a GUI to permit a user to drag and drop image data sets
from different sources, for example, images of traffic flow, images of parts or images of the
defect parts, and also permit the user to select the image data set from different sources at the
same time, for example, the user can select the images of parts and the images of the defect
parts at the same time, so that the suitable one of the recommended templates can be
automatically loaded according to the selected image data sets, and the Al model appropriate
for the image data sets can be used. As a result, the present invention can improve
convenience in Al model selection and operation.
[0020] The visualization system based on artificial intelligence inference and a method
thereof of the present invention will hereinafter be described in more detail with reference to
the accompanying drawings. Please refer to FIG. 1, which is a system block diagram of a
visualization system based on artificial intelligence inference, according to the present invention. As show in FIG. 1, the application system includes a storage module 110, an initialization module 120, a loading module 130, an executing module 140 and a display module 150. The storage module 110 is configured to store recommended templates, image data sets from different sources, Al models trained with different identification algorithms, and dashboards. Each of the recommended templates includes a specified image data set, a specified Al model, and a specified dashboard, such as a bar chart, a pie chart or a radar chart.
In actual implementation, the storage module 110 can be implemented by a hard disk, an
optical disk, or nonvolatile memory. Furthermore, the image data sets include image
streaming data or defect image data from different image capture devices, for example, the
image streaming data can be images of traffic flow or parts, and defect image data can be
images of protruding points, pits, or eccentric holes. The Al model can be a model trained
with different identification algorithm, such as YOLO, Fast R-CNN, Mask R-CNN or other
similar algorithm.
[0021] The initialization module 120 is connected to the storage module 110, and configured
to in initial, generate a graphical user interface (GUI) to display the image data sets, and
permit to drag and drop the displayed image data sets to a candidate block of the GUI as a
dragged unit. In actual implementation, displaying the image data sets on the GUI is
performed by image blocks, and different image blocks represent different image data sets,
respectively. The user can use a cursor to drag and drop the image block representing for the
selected image data set, to achieve the purpose of selecting the image data set, and the image
block dragged to the candidate block is used as the dragged unit. Furthermore, a data link
relationship between the image data set and the Al model in the candidate block is permitted
to re-adjust by a dragging-and-dropping manner, and the inference calculation is performed
again based on the re-adjusted data link relationship.
[0022] The loading module 130 is connected to the storage module 110 and the initialization
module 120 and configured to screen out and select the recommended template which
includes the dragged unit, and then load the specified image data set, the Al model and the
dashboard of the selected recommended template based on the selected recommended
template. For example, suppose that a recommended template includes the specified image data set being part A, the Al model being YOLO, the dashboard being a bar chart, when the image data set represented by the dragged unit is also images of part A, the recommended template is selected to load because of including the image data set being the part A.
[0023] The executing module 140 is connected to the loading module 130, and when an execution command is triggered, the executing module 140 is configured to input the loaded
image data set to the loaded Al model, so that inference calculation is performed and an
inference result is generated based on the inference calculation. The executing module 140
also detects whether the selected recommended template has a precision, if the selected
recommended template has the precision, the precision is directly loaded; otherwise, the
precision corresponding to the inference result is calculated, and the calculated precision is set
as the precision of the selected recommended template. In actual implementation, an image
block or graphical button can be generated on the GUI for the user to click, and when the
image block or the graphical button is clicked, the execution command is triggered to perform
evaluation and inference. Furthermore, the calculation of the precision of the recommended
template can be implemented by using confusion matrix or other similar performance measure
index, and even the calculation result can be stored as the history record corresponding to the
recommended template. Furthermore, when the precision is lower than a preset value, the
corresponding recommended template can be loaded to display the specified image data set,
the specified Al model and the specified dashboard thereof in the candidate block as the
dragged units, and the user is permitted to add, delete or adjust the dragged units.
[0024] The display module 150 is connected to the loading module 130 and the executing module 140, and configured to use the loaded dashboard to display the inference result and
the precision, which is directly loaded or calculated, on the GUI together. For example, in a
condition that the dashboard is a bar chart, the inference result and the precision can be
digitized and then expressed in a form of the bar chart. In actual implementation, the
dashboard can display various messages in a dashboard at the same time.
[0025] It is to be noted that it is to be particularly noted that, in actual implementation, the modules of the present invention can be implemented by various manners, including software,
hardware or any combination thereof, for example, in an embodiment, the module can be
'-7 implemented by software and hardware, or one of software and hardware. Furthermore, the present invention can be implemented fully or partly based on hardware, for example, one or more module of the system can be implemented by integrated circuit chip, system on chip
(SOC), a complex programmable logic device (CPLD), or a field programmable gate array
(FPGA). The concept of the present invention can be implemented by a system, a method
and/or a computer program. The computer program can include computer-readable storage
medium which records computer readable program instructions, and the processor can
execute the computer readable program instructions to implement concepts of the present
invention. The computer-readable storage medium can be a tangible apparatus for holding and
storing the instructions executable of an instruction executing apparatus. The
computer-readable storage medium can be, but not limited to electronic storage apparatus,
magnetic storage apparatus, optical storage apparatus, electromagnetic storage apparatus,
semiconductor storage apparatus, or any appropriate combination thereof. More particularly,
the computer-readable storage medium can include a hard disk, a RAM memory, a
read-only-memory, a flash memory, an optical disk, a floppy disc or any appropriate
combination thereof, but this exemplary list is not an exhaustive list. The computer-readable
storage medium is not interpreted as the instantaneous signal such as a radio wave or other
freely propagating electromagnetic wave, or electromagnetic wave propagated through
waveguide, or other transmission medium (such as optical signal transmitted through fiber
cable) or electric signal transmitted through electric wire. Furthermore, the computer readable
program instruction can be downloaded from the computer-readable storage medium to each
calculating/processing apparatus, or downloaded through network, such as internet network,
local area network, wide area network and/or wireless network, to external computer
equipment or external storage apparatus. The network includes copper transmission cable,
fiber transmission, wireless transmission, router, firewall, switch, hub and/or gateway. The
network card or network interface of each calculating/processing apparatus can receive the
computer readable program instructions from network, and forward the computer readable
program instruction to store in computer-readable storage medium of each
calculating/processing apparatus. The computer program instructions for executing the operation of the present invention can include source codes or object code programmed by assembly language instructions, instruction-set-structure instructions, machine instructions, machine-related instructions, micro instructions, firmware instructions or any combination of one or more programming language. The programming language include object oriented programming language, such as Common Lisp, Python, C++, Objective-C, Smalltalk, Delphi, Java, Swift, C#, Perl, Ruby, and PHP, or regular procedural programming language such as C language or similar programming language. The computer readable program instruction can be fully or partially executed in a computer, or executed as independent software, or partially executed in the client-end computer and partially executed in a remote computer, or fully executed in a remote computer or a server.
[0026] Please refer to FIGS. 2A and 2B, which are flowcharts of a visualization method based on artificial intelligence inference, according to the present invention. As shown in FIGS. 2A
and 2B, the visualization method includes following steps. In a step 210, a plurality of
recommended templates, a plurality of image data sets from different sources, a plurality of
Al models trained with different identification algorithms, and a plurality of dashboards are
provided, and each recommended template includes the specified image data set, the specified
Al model and the specified dashboard. In a step 220, in initial, a graphical user interface (GUI)
is generated to display the plurality of image data sets, and the displayed image data set is
permitted to drag and drop to a candidate block of the GUI as a dragged unit. In a step 230,
the recommended template including the dragged unit is screened out and selected, and the
specified image data set, the specified Al model and the specified dashboard of the selected
recommended template is loaded. In a step 240, when an execution command is triggered, the
loaded image data set is inputted to the loaded Al model for performing an inference
calculation, so as to generate an inference result based on the inference calculation. In a step
250, the selected recommended template is detected to check whether the selected
recommended template has a precision, and when the selected recommended template has a
precision, the precision is directly load; otherwise, the precision corresponding to the
inference result is calculated and the calculated precision is set as the precision of the selected
recommended template. In a step 260, the loaded dashboard is used to display the inference result and the precision, which is directly loaded or calculated, on the GUI together. Through aforementioned steps, the GUI can provide a user to drag and select the image data set, the recommended template matching the selection result is loaded and displayed, and the recommended template automatically specifies the Al model and the dashboard for the selected image data set, and after the inference calculation is performed, the inference result and the precision of the recommended template are displayed as the basis of adjusting the recommended template.
[0027] In an embodiment, a step 270 can be performed after the step 260. When a creation
command is executed, the image data sets, the Al models and the dashboards are permitted to
drag and drop to the candidate block, the data pre-processing is then performed on the image
data set, and image features of the pre-processed image data set are analyzed, so that the Al
model can be selected to be the new recommended template based on the image features. The
data pre-processing can improve the identification speed and the precision, to facilitate to
select the appropriate Al model based on the image content.
[0028] The embodiment of the present invention will be described in following paragraphs
with reference to FIGS. 3 to 5B. Please refer to FIG. 3, which is a system block diagram of
visualization system, according to another embodiment the present invention. In actual
implementation, the difference between the embodiment of FIG. 3 and the embodiment of
FIG. 1 is that the embodiment of FIG. 3 additionally includes an operation record learning
module 160 connected to the storage module 110 and the executing module 140, and the
operation record learning module 160 is configured to store a history record corresponding to
the recommended template, the history record is generated by the inference calculation
performed by the executing module 140, and the history record includes an identification
speed and a precision of the Al model in identification of the image data set, and the specified
Al model in the recommended template is permitted to adjust based on the image data set, the
identification speed, and the precision. For example, for different image data set, a user can
select the Al model with highest identification speed and the highest precision, or the Al
model with the highest identification speed but normal precision, or the Al model with high
precision but slow identification speed, or the Al model with normal identification speed and
1 () normal precision. Next, the adjustment result is displayed on the GUI in a form of, for example, dialog window or pop-up window. In actual implementation, besides the identification speed and the precision, the history record can include other evaluation index such as a mAP, and the difference between mAP and the average precision (AP) is that the mAP is an average of AP of all objects.
[0029] Please refer to FIGS. 4A and 4B, which are schematic views showing an operation of
displaying a recommended template of the present invention. In an automated optical
inspection (AOI) scenario, the image data set can include images of parts and images of
defects. In order to use the recommended template, the user can click, in sequential order, the
recommended template component 321, the part data set component 323 and the defect data
set component 324, so that the image data set is displayed in the GUI 300 for providing the
user to select, shown in FIG. 4A. The user is permitted to drag and drop the displayed image
data sets, such as an image data set of the part A, an image data set of pit, and an image data
set of eccentric hole, to the candidate block 330 of the GUI 300 as the dragged units 331-333,
so that the recommended template including the dragged units 331~333 can be screened out
and selected, and the specified image data set, the specified Al model and the specified
dashboard of the selected recommended template are displayed in the display block 340 with
different image units 341~346, respectively. When the user wants to evaluate the quality of
the selected recommended template, the user can click the template evaluation component 311
to trigger the execution command, the loaded image data set is then inputted to the loaded Al
model to perform an inference calculation, and an inference result is generated based on the
inference calculation. Next, the selected recommended template is detected to check whether
the selected recommended template has a precision, and when the selected recommended
template has a precision, the precision is directly loaded; otherwise, the precision
corresponding to the inference result is calculated and the calculated precision is set as the
precision of the selected recommended template. As shown in FIG. 4B, the loaded dashboard
is used to display the inference result, the precision which is directly loaded or calculated, in
the inference result display block 350 and the precision display block 360 of the GUI 300
together. It is to further explain that the user can click the part data set component 323, the
1 1 defect data set component 324, the Al model component 325 and the dashboard component
326 to adjust the different image data set, Al model and dashboard.
[0030] Please refer to FIGS. 5A and 5B, which are schematic views showing an operation of
creating a new recommended template, according to the present invention. In order to create a
new recommended template, a user can click a template creation component 322 to trigger a
creation command, to generate a plurality of selection blocks 410, 420, 430 and 440. After
clicking the part data set component 323, the user can select an image data set, such as the
data set of the part images, and drag the selected image data set to the selection block 410.
After clicking the defect data set component 324, the user can select an image data set, such
as the data set of protruding point defect images, and drag and drop the selected image data
set to the selection block 420. After clicking the Al model component 325, the user can select
an Al model, such as the model using YOLO algorithm, and drag the selected Al model to the
selection block 430. After clicking the dashboard component 326, the user can select a
dashboard, such as a bar chart, a pie chart or a line chart. After all selection operations are
completed, the user can click the template storage component 312, and store the
above-mentioned selections as a new recommended template. It is to be noted that each of the
selection blocks 410, 420, 430 and 440 has an adding component 421 and a setting
component 422, and the user can click the adding component 421 to add another image data
set, Al model and dashboard, and the user can click the setting component 422 to change
parameter. For example, when the user clicks the adding component 421, another branch with
a selection blocks 520, 530 and 540, and an adding component 521 and a setting component
522 is displayed, as shown in FIG. 5B.
[0031] According to above-mentioned contents, the difference between the present invention
and conventional technology is that in the system and method of the present invention the
GUI can provide a user to drag and select the image data set, and load and display the
recommended template matching the selection result, the recommended template
automatically specifies the Al model and the dashboard for the selected image data set, and
after the inference calculation is performed, the inference result and the precision of the
recommended template are displayed as the basis of adjusting the recommended template.
11)
Therefore, the aforementioned technical solution of the present invention can solve the
conventional technical problems, so as to achieve the technical effect of improving
convenience in model selection and operation.
[0032] The present invention disclosed herein has been described by means of specific
embodiments. However, numerous modifications, variations and enhancements can be made
thereto by those skilled in the art without departing from the spirit and scope of the disclosure
set forth in the claims.

Claims (10)

  1. WHAT IS CLAIMED IS:
    1 A visualization system based on artificial intelligence inference, comprising
    a storage module configured to store at least one recommended template, a plurality of
    image data sets from different sources, a plurality of Al models trained with different
    identification algorithms, and a plurality of dashboards, wherein the at least one
    recommended template comprises specified at least one of the plurality of image data
    sets, specified at least one of the plurality of Al models and specified at least one of the
    plurality of dashboards;
    an initialization module connected to the storage module and configured to, in initial,
    generate a graphical user interface (GUI) to display the plurality of image data sets, and
    permit to drag and drop the displayed image data set to a candidate block of the graphical
    user interface as a dragged unit;
    a loading module connected to the storage module and the initialization module
    configured to select one, which comprises the dragged unit, of the at least one
    recommended template, and load the specified image data set, the specified Al model
    and the specified dashboard comprised in the selected recommended template;
    an executing module connected to the loading module and configured to when an
    execution command is triggered, input the loaded image data set to the loaded Al model
    to perform an inference calculation, and generate an inference result based on the
    inference calculation, and detect whether the selected recommended template has a
    precision, wherein when the selected recommended template has the precision, the
    executing module directly load the precision, and when the selected recommended
    template does not have the precision, the executing module calculates the precision
    corresponding to the inference result, and set the calculated precision as the precision of
    the selected recommended template; and
    a display module connected to the loading module and the executing module, and
    configured to use the loaded dashboard to display the inference result and the precision,
    which is directly loaded or calculated, on the GUI.
  2. 2. The visualization system based on artificial intelligence inference according to claim 1,
    1 A further comprising an operation record learning module connected to the storage module and the executing module, wherein the operation record learning module is configured to store a history record corresponding to the at least one recommended template, the history record comprises an identification speed and the precision of the specified Al model in identification of the specified image data set, and the specified Al model of the at least one recommended template is permitted to adjust based on the specified image data set, the identification speed and the precision, and an adjustment result is displayed on the GUI.
  3. 3. The visualization system based on artificial intelligence inference according to claim 1,
    wherein a data link relationship between the specified image data set and the specified
    Al model in the candidate block is permitted to re-adjust by a dragging-and-dropping
    manner, and the inference calculation is performed again based on the adjusted data link
    relationship.
  4. 4. The visualization system based on artificial intelligence inference according to claim 1,
    wherein when the executing module performs a creation command, one of the plurality
    of image data sets, one of the plurality of Al models and one of the plurality of
    dashboards are permitted to drag and drop to the candidate block, data pre-processing is
    performed on the image data set in the candidate block to analyze an image feature of the
    pre-processed image data set, and the Al models within the candidate block is selected to
    generate a new recommended template according to the image feature.
  5. 5. The visualization system based on artificial intelligence inference according to claim 1,
    wherein when the precision is lower than a preset value, the corresponding
    recommended template is loaded to display the specified image data set, the specified Al
    model and the specified dashboard of the recommended template on the candidate block
    as the dragged unit, and the dragged unit is permitted to add, delete or adjust.
  6. 6. A visualization method based on artificial intelligence inference, comprising:
    providing at least one recommended template, a plurality of image data sets from
    different sources, a plurality of Al models trained with different identification algorithms,
    and a plurality of dashboards, wherein the at least one recommended template comprises
    1 CZ specified at least one of the plurality of image data sets, specified at least one of the plurality of Al models and specified at least one of the plurality of dashboards; in initial, generating a graphical user interface to display the plurality of image data sets, and permitting to drag and drop one of the plurality of displayed image data sets to a candidate block of the graphical user interface as a dragged unit; selecting one, comprising the dragged unit, of the at least one recommended template, and loading the specified image data set, the specified Al model and the specified dashboard of the selected recommended template; when an execution command is triggered, inputting the loaded image data set into the loaded Al model to perform an inference calculation, and generating an inference result based on the inference calculation; detecting whether the selected recommended template has a precision, and when the selected recommended template has the precision, directly loading the precision, and when the selected recommended template does not have the precision, calculating the precision corresponding to the inference result, and setting the calculated precision as the precision of the selected recommended template; and using the loaded dashboard to display the inference result and the precision, which is directly loaded or calculated, on the graphical user interface.
  7. 7. The visualization method based on artificial intelligence inference according to claim 6,
    wherein the at least one recommended template comprises a history record, the history
    record comprises an identification speed and the precision of the specified Al model in
    identification of the specified image data set, and the specified Al model of the at least
    one recommended template is permitted to adjust based on the specified image data set,
    the identification speed and the precision, and an adjustment result is displayed on the
    graphical user interface.
  8. 8. The visualization method based on artificial intelligence inference according to claim 6,
    wherein a data link relationship between the image data set and the Al model in the
    candidate block is permitted to re-adjust by a dragging-and-dropping manner, and the
    inference calculation is performed again based on the adjusted data link relationship.
  9. 9. The visualization method based on artificial intelligence inference according to claim 6, further comprising:
    when a creation command is executed, permitting to drag and drop one of the plurality
    of image data sets, one of the plurality of Al models and one of the plurality of
    dashboards to the candidate block, performing data pre-processing on the image data set in the candidate block to analyze an image feature of the pre-processed image data set,
    and selecting one of the Al models in the candidate block based on the image feature, to
    generate a new recommended template.
  10. 10. The visualization method based on artificial intelligence inference according to claim 6,
    wherein when the precision is lower than a preset value, loading the corresponding recommended template, displaying the specified image data set, the specified Al model
    and the specified dashboard of the loaded recommended template on the candidate block
    as the dragged units, and permitting to add, delete or adjust the dragged units.
AU2021200532A 2021-01-28 2021-01-28 Visualization System Based on Artificial Intelligence Inference and Method Thereof Abandoned AU2021200532A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2021200532A AU2021200532A1 (en) 2021-01-28 2021-01-28 Visualization System Based on Artificial Intelligence Inference and Method Thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
AU2021200532A AU2021200532A1 (en) 2021-01-28 2021-01-28 Visualization System Based on Artificial Intelligence Inference and Method Thereof

Publications (2)

Publication Number Publication Date
AU2021200532A1 AU2021200532A1 (en) 2022-08-11
AU2021200532A9 true AU2021200532A9 (en) 2022-10-27

Family

ID=82703223

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2021200532A Abandoned AU2021200532A1 (en) 2021-01-28 2021-01-28 Visualization System Based on Artificial Intelligence Inference and Method Thereof

Country Status (1)

Country Link
AU (1) AU2021200532A1 (en)

Also Published As

Publication number Publication date
AU2021200532A1 (en) 2022-08-11

Similar Documents

Publication Publication Date Title
US20220236860A1 (en) Visualization system based on artificial intelligence inference and method thereof
US20190188119A1 (en) System and a method for providing automated performance detection of application programming interfaces
CN106547678B (en) Method and apparatus for white-box testing
US9342588B2 (en) Reclassification of training data to improve classifier accuracy
US20220351083A1 (en) Gui for configuring machine-learning services
CN106020811A (en) Development method and device of algorithm model
US11182697B1 (en) GUI for interacting with analytics provided by machine-learning services
US20160283353A1 (en) Automated software testing
US20210073108A1 (en) Virtualized device-based test system and method thereof
CN110991649A (en) Deep learning model building method, device, equipment and storage medium
US20150212929A1 (en) Systems and methods for processing software application metadata associated with a software application
US20170177466A1 (en) Volume testing
JP5820451B2 (en) System and method for selecting and displaying segmentation parameters for optical character recognition
CN108268373A (en) Automatic test cases management method, device, equipment and storage medium
US20230048386A1 (en) Method for detecting defect and method for training model
US9703683B2 (en) Software testing coverage
CN109901996A (en) Method, apparatus, electronic equipment and the readable storage medium storing program for executing of subtest
US20190163499A1 (en) Simulating human interface interaction resilient to user interface changes
US20230206122A1 (en) Apparatus and method for reinforcement learning based on user learning environment in semiconductor design
US11381677B2 (en) Systems and methods to manage models for call data
US20240311277A1 (en) Automated testing of mobile devices using visual analysis
US20200160098A1 (en) Human-Assisted Machine Learning Through Geometric Manipulation and Refinement
KR20180076020A (en) Apparatus and method for application test automation
US20230267255A1 (en) Semiconductor equipment modeling method and device
EP4036711A1 (en) Visualization system based on artificial intelligence inference and method thereof

Legal Events

Date Code Title Description
SREP Specification republished
MK5 Application lapsed section 142(2)(e) - patent request and compl. specification not accepted