WO2022156389A1

WO2022156389A1 - Graphic display method, apparatus and device, and medium

Info

Publication number: WO2022156389A1
Application number: PCT/CN2021/135688
Authority: WO
Inventors: 郭冠军
Original assignee: 北京字跳网络技术有限公司
Priority date: 2021-01-22
Filing date: 2021-12-06
Publication date: 2022-07-28
Also published as: CN114797084A

Abstract

The present disclosure relates to a graphic display method, apparatus and device, and a medium. The graphic display method comprises: displaying a target graphic; obtaining a real-time image, the real-time image being an image comprising puzzle piece physical objects to be detected; and when it is determined that a target puzzle piece physical object that is correctly placed is present in the puzzle piece physical objects to be detected, displaying a target filling pattern in a target shape region in the target graphic, the target shape region being a relative placement region of the target puzzle piece physical object in the target graphic. According to the embodiments of the present disclosure, during a jigsaw puzzle process conducted by a user, real-time prompting can be performed on the target puzzle piece physical object that is correctly placed by the user, so that real-time interaction with the user is implemented.

Description

Graphic display method, device, equipment and medium

This application claims the priority of the Chinese patent application with the application number 202110091009.8 and the application name "Graphic Display Method, Apparatus, Equipment and Medium" filed on January 22, 2021, the entire contents of which are incorporated into this application by reference.

technical field

The present disclosure relates to the technical field of image processing, and in particular, to a graphic display method, apparatus, device, and medium.

Background technique

At present, puzzle games often appear in various educational games as a kind of educational aids. After the user enters the puzzle game, a puzzle title will be given, and the user can make a puzzle according to the puzzle title. However, in the current puzzle game, in the process of users doing puzzles, due to the irregularity of the puzzles, there will be various problems in answer matching, and there is no interactive function, so that the playability and interactivity of the puzzle game is low, reducing the user experience.

SUMMARY OF THE INVENTION

In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a graphic display method, apparatus, device and medium.

In a first aspect, the present disclosure provides a graphic display method, including:

display target graphics;

Obtain a real-time image, and the real-time image is an image including the real object to be detected;

When it is determined that there is a correctly placed target piece in the object to be detected, the target fill pattern is displayed in the target shape area in the target graphic, and the target shape area is the relative position of the target piece in the target graphic. placement area.

In a second aspect, the present disclosure provides a graphic display device, comprising:

a first display unit, configured to display a target graphic;

an image acquisition unit configured to acquire a real-time image, the real-time image being an image including the actual pieces to be detected; and

The second display unit is configured to display the target fill pattern in the target shape area in the target graphic, and the target shape area is the target block when it is determined that there is a correctly placed target block in the actual block to be detected. The relative placement area of the object in the target graphic.

In a third aspect, the present disclosure provides a graphics display device, comprising:

processor;

memory for storing executable instructions;

The processor is configured to read executable instructions from the memory and execute the executable instructions to implement the graphic display method described in the first aspect.

In a fourth aspect, the present disclosure provides a computer-readable storage medium, where the storage medium stores a computer program, and when the computer program is executed by a processor, enables the processor to implement the graphic display method described in the first aspect.

In a fifth aspect, the present disclosure provides a computer program product, the computer program product includes a computer program, and when the computer program is executed by a processor, causes the processor to implement the graphic display method described in the first aspect.

Compared with the prior art, the technical solutions provided by the embodiments of the present disclosure have at least the following advantages:

The graphic display method, device, device, and medium of the embodiments of the present disclosure can display the target graphic, and in the process of the user performing the puzzle, obtain a real-time image including the real object to be detected, and then determine the existence of the real object to be detected. In the case of placing the correct target piece, the target fill pattern will be displayed in the target shape area in the target figure. Since the target shape area is the relative placement area of the target piece in the target figure, the trick is In the process of jigsaw puzzles, the game can not only automatically and accurately match the answers, but also give real-time prompts to the user to place the correct target pieces, which realizes real-time interaction with users and improves the quality of puzzle games. Playability and interactivity, thereby enhancing the user experience.

Description of drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent when taken in conjunction with the accompanying drawings and with reference to the following detailed description. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

1 is a scene diagram of a graphical display in the related art;

FIG. 2 is a schematic flowchart of a graphic display method according to an embodiment of the present disclosure;

3 is a schematic diagram of a game interface provided by an embodiment of the present disclosure;

4 is a schematic diagram of a center of gravity distance according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of another game interface provided by an embodiment of the present disclosure;

6 is a schematic diagram of a physical angle parameter provided by an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a matching puzzle pattern provided by an embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a geometric parameter provided by an embodiment of the present disclosure;

FIG. 9 is a schematic diagram of another game interface provided by an embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of a graphic display device according to an embodiment of the present disclosure;

FIG. 11 is a schematic structural diagram of a graphic display device according to an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for the purpose of A more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes, and are not intended to limit the protection scope of the present disclosure.

It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this regard.

As used herein, the term "including" and variations thereof are open-ended inclusions, ie, "including but not limited to". The term "based on" is "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the description below.

It should be noted that concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or interdependence.

It should be noted that the modifications of "a" and "a plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless the context clearly indicates otherwise, they should be understood as "one or a plurality of". multiple".

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes, and are not intended to limit the scope of these messages or information.

FIG. 1 shows a scene graph of a graphical display in the related art.

As shown in FIG. 1 , after the user enters the game interface 102 of the puzzle game through the electronic device 101, a designated graphic 103 will be displayed in the game interface 102, and the graphic 103 is a puzzle problem, and the user can use the puzzle puzzle Block 104 puzzles against graph 103 .

After the user completes the puzzle, the user can enter the answer display interface of the puzzle game through the electronic device 101. The answer display interface can display the pre-designed puzzle answer of the puzzle title, and the user can compare the puzzle pattern with the puzzle answer. Yes, if the puzzle pattern is the same as any one of the puzzle answers, it can be determined that the puzzle is correct, and then the self-check of the puzzle result can be realized.

It can be seen that in the current puzzle game, in the process of users doing puzzles, there may be various problems in answer matching due to the irregularity of the puzzles, and there is no interactive function, which makes the playability and interactivity of the puzzle game relatively low. low, reducing the user experience.

In order to solve the above problems, the embodiments of the present disclosure provide a graphic display method, apparatus, device and medium capable of real-time interaction with a user.

Below, the graphic display method provided by the embodiment of the present disclosure is first described.

In some embodiments of the present disclosure, the graphic display method may be performed by an electronic device. Among them, electronic devices may include mobile phones, tablet computers, desktop computers, notebook computers, vehicle-mounted terminals, wearable electronic devices, all-in-one computers, smart home devices and other devices with communication functions, and may also be virtual machines or devices simulated by simulators .

FIG. 2 shows a schematic flowchart of a graphic display method provided by an embodiment of the present disclosure.

As shown in FIG. 2 , the graphic display method may include the following steps.

S210. Display the target graphic.

In the embodiment of the present disclosure, the electronic device may display the target graphic, and the user may use the puzzle pieces to perform puzzles against the target graphic.

Wherein, the puzzles can be any type of puzzles, for example, the target puzzles can be four puzzles, pentagons, tangrams, thirteen puzzles, etc., which are not limited here.

In this embodiment of the present disclosure, the target graphic may be displayed at any position, which is not limited herein.

S220. Acquire a real-time image, where the real-time image is an image including the real object to be detected.

In the process of the user's puzzle, the user can also collect real-time images including the real objects to be detected through the camera of the electronic device, such as a rear camera, so that the electronic device can obtain the real-time image synchronously in real time.

In some embodiments, the electronic device may not display the real-time image after acquiring the real-time image.

In other embodiments, after acquiring the real-time image, the electronic device may display the real-time image synchronously with the target graphic in real time.

Taking the puzzle game as an example, after the user enters the game interface of the puzzle game through the electronic device, a specified target graphic will be displayed in the game interface, and the target graphic is a jigsaw puzzle. The blocks are puzzled against the target graphics. In the process of the user's puzzle, the user can also collect the real-time image including the real object to be detected through the camera of the electronic device in real time, and can further enable the real-time image to be displayed in the game interface in real time, so that the electronic device can real-time display the real-time image. Simultaneous display of target graphics and live images within the game interface.

Optionally, the target graphics and real-time images can be displayed on the electronic device in a preset display manner. The preset display mode may be preset as required, which is not limited herein.

In some embodiments, the preset display mode may be full-screen display of the real-time image, and the target graphic is displayed at any position on the real-time image. For example, the display screen of the electronic device can display the real-time image in full screen, and the target graphics can be superimposed and displayed in a corner of the real-time image.

Continuing to take the puzzle game as an example, the game interface can display the shooting preview interface in full screen, and the real-time image collected by the camera in the working state of the electronic device can be displayed in the shooting preview interface in real time, and the target graphics can be superimposed and displayed in a corner of the shooting preview interface. .

FIG. 3 shows a schematic diagram of a game interface provided by an embodiment of the present disclosure.

As shown in FIG. 3 , the electronic device 301 can display a game interface 302 of a puzzle game, a real-time image 303 can be displayed in full screen in the game interface 302 , and a target graphic 304 can be superimposed on the lower left corner of the real-time image 303 .

In other embodiments, the preset display manner may also be split-screen display of the target graphics and the real-time image. Specifically, the display screen of the electronic device can be divided into two display areas, one display area displays the target graphic, and the other display area displays the real-time image.

Continuing to take the puzzle game as an example, the game interface can be divided into two display areas, one display area can display the target graphics, the other display area can display the shooting preview interface, and the shooting preview interface can display the working electronic equipment in real time. The real-time image captured by the status camera.

In still other embodiments, the preset display manner may also be other display manners, and the present disclosure does not limit the specific display manner.

S230. In the case where it is determined that there is a correctly placed target piece in the real pieces to be detected, display the target fill pattern in the target shape area in the target graphic, and the target shape area is the target piece in the target graphic. relative placement area.

In the embodiment of the present disclosure, the electronic device can detect in real time whether there is a correctly placed target piece in the real pieces to be detected, and if it is determined that there is a target piece in the real pieces to be detected, the target piece can be The relative placement area of the object in the target graphic is used as the target shape area in the target graphic, and the target fill pattern is displayed in the target shape area to light up the relative placement area of the target piece in the target graphic.

Optionally, the target filling pattern may be a filling pattern corresponding to the target shape area.

In some embodiments, the filling pattern corresponding to each shape region in the target graphic is the same, that is, the target filling pattern is a preset fixed filling pattern.

Optionally, the filling pattern may include at least one of a solid color pattern and a pattern pattern.

Continuing to refer to FIG. 3 , the electronic device 301 can display the target graphic 304 when it is detected that the first real object 305 , the second real object 306 , the third real object 307 and the fourth real object 308 are placed correctly. The first shape region 309 , the second shape region 310 , the third shape region 311 , and the fourth shape region 312 are displayed in gray, respectively. The first shape area 309 is the relative placement area of the first real piece 305 in the target graphic 304, the second shape area 310 is the relative placement area of the second real patch 306 in the target graphic 304, and the third The shape area 311 is the relative placement area of the third physical piece 307 in the target graphic 304 , and the fourth shape area 312 is the relative placement area of the fourth physical real piece 308 in the target graphic 304 .

Therefore, in the embodiment of the present disclosure, the preset fixed filling pattern can be displayed in the target shape area, so as to achieve the effect of lighting up the relative placement area of the target piece in the target shape.

In other embodiments, the filling pattern corresponding to each shape region in the target graphic may be different, one shape region may correspond to one filling pattern, and the filling pattern corresponding to each shape region may be based on the actual piece of the piece corresponding to the shape region The actual pattern is determined. In one example, the filling pattern corresponding to a shape area may be a solid color pattern having the actual color of the actual piece of the piece corresponding to the shape area. In another example, the filling pattern corresponding to a shape area may be the actual pattern of the actual piece of the block corresponding to the shape area.

Therefore, in the embodiment of the present disclosure, by displaying the filling pattern specified by the target shape region in the target shape region, while achieving the effect of lighting up the relative placement region of the target piece in the target shape, further Improves the lighting effect of target graphics.

In the embodiment of the present disclosure, the target graphic can be displayed, and in the process of the user performing the puzzle, the real-time image including the real object to be detected is obtained, and then it is determined that there is a correct placement of the real object of the object to be detected in the real object to be detected. In this case, in the target shape area in the target graph, the target fill pattern is displayed. Since the target shape area is the relative placement area of the target piece in the target graph, the puzzle game is in the process of the user doing the jigsaw puzzle. , not only can automatically and accurately match the answer, but also can prompt the user to place the correct target piece in real time, realize real-time interaction with the user, improve the playability and interactivity of puzzle games, and further improve the user experience.

In an embodiment of the present disclosure, the real-time image may further be an image including at least two physical objects.

In some embodiments, at least two physical pieces can be used as the physical pieces to be detected.

In these embodiments, the electronic device can detect the correctly placed target piece among all the pieces displayed in the real-time image.

In other embodiments, a part of the real pieces of the at least two real pieces can be used as the real pieces to be detected, and the other part of the real pieces can be used as the real pieces of the non-to-be-detected pieces. Wherein, the actual pieces to be detected may be the actual pieces used for the physical detection of the target pieces, and the actual pieces of the non-to-be-detected pieces may be the actual pieces that are not used for the physical detection of the target pieces.

In these embodiments, the actual pieces to be detected may be the actual pieces determined according to the distance between the centers of gravity of the actual pieces.

FIG. 4 shows a schematic diagram of a center of gravity distance provided by an embodiment of the present disclosure.

As shown in FIG. 4 , the first real piece 401 and the second real piece 402 are both isosceles right-angled triangles. Therefore, the center of gravity of the first real piece 401 and the second real piece 402 is the midpoint of the hypotenuse, The center of gravity distance between the first real piece 401 and the second real piece 402 may be the length of the line 403 connecting the midpoints of the hypotenuses of the first real piece 401 and the second real piece 402 .

In some embodiments of the present disclosure, in order to reliably detect the actual target piece, before determining that there is a correctly placed target piece in the actual piece to be detected in S220 shown in FIG. 2 , the graphic display method further includes: Can include:

According to the center-of-gravity distance between the actual pieces, the actual pieces to be detected in the actual pieces are determined.

In the embodiment of the present disclosure, after acquiring the real-time image, the electronic device may determine the center-of-gravity distance between the actual pieces in the real-time image, and determine the distance between the centers of gravity of the actual pieces to be determined according to the distance between the centers of gravity between the actual pieces Detect the actual pieces of the puzzle to avoid the problem of inaccurate answer matching caused by irregular puzzle pieces.

Optionally, according to the center-of-gravity distance between the actual pieces, it is determined that the actual pieces to be detected in the actual pieces may specifically include:

According to the distance of the center of gravity, the physical pieces are grouped to obtain at least one group of physical pieces, and the distance of the center of gravity between the physical pieces of each group of physical pieces is less than or equal to the preset distance threshold;

The actual pieces in the actual piece group with the largest number of pieces are taken as the actual pieces to be detected.

In the embodiment of the present disclosure, the electronic device is preset with a maximum center-of-gravity distance corresponding to the target graphic, and the maximum center-of-gravity distance is a preset distance threshold. After the electronic device determines the center-of-gravity distance between the physical pieces in the real-time image, it can group the physical pieces whose center-of-gravity distance is less than or equal to the preset distance threshold into a group, and obtain at least one group of physical pieces. , and take the actual jigsaw puzzle formed by the actual pieces in the group with the largest number of pieces as the actual jigsaw to be detected, and the actual jigsaw to be detected is the largest connected sub-picture in the real-time image, and will The physical pieces in the physical piece group with the largest number of physical pieces are used as the physical pieces to be detected.

It should be noted that the preset distance threshold may be a distance value that can be set as required and can determine the maximum connected sub-graph in the real-time image, which is not limited herein.

FIG. 5 shows a schematic diagram of another game interface provided by an embodiment of the present disclosure.

As shown in FIG. 5 , the electronic device 501 can display a game interface 502 of a puzzle game, a real-time image 503 can be displayed in full screen in the game interface 502 , and a target graphic 504 can be superimposed on the lower left corner of the real-time image 503 . The real-time image 503 displays the first real piece 505 , the second real piece 506 , the third real piece 507 , the fourth real piece 508 , the fifth real piece 509 and the sixth real piece 510 . The electronic device 501 can compare the first physical piece 505, the second physical piece 506, the third physical piece 507, the fourth physical piece 508, the fifth physical piece 509, and the The sixth physical pieces 510 are clustered, and several physical pieces of which the distance between the centers of gravity is less than or equal to the preset distance threshold are grouped into a group. Because the distance between the center of gravity of the four physical pieces of the first piece 505, the second piece 506, the third piece 507 and the fourth piece 508 is less than or equal to the preset distance threshold, the The center-of-gravity distance between the five physical pieces 509 and the sixth physical piece 510 is less than or equal to the preset distance threshold, while the first physical piece 505, the second physical piece 506, the third physical piece 506 and the third The distance between the center of gravity of at least one physical piece and the fifth physical piece 509 is greater than the preset distance threshold, the first physical piece 505, the physical second piece 506, In the third physical piece 507 and the fourth physical piece 508, there is at least one physical piece and the distance between the center of gravity of the physical piece 510 and the sixth physical piece 510 is greater than the preset distance threshold, so that the six physical pieces can be divided into two A group of physical pieces. Among them, the number of physical pieces in the physical piece group of the first piece 505, the second piece 506, the third piece 507 and the fourth piece 508 is higher than that of the fifth piece 509 and the sixth piece. The actual pieces 510 have a large number of pieces in this group of actual pieces. Therefore, the first piece 505, the second piece 506, the third piece 507, and the fourth piece 508 can be used as the waiting pieces. The actual pieces of the pieces are detected, and the actual pieces of the fifth piece 509 and the actual pieces of the sixth piece 510 are regarded as the actual pieces of the pieces not to be detected.

Therefore, in the embodiment of the present disclosure, the electronic device can accurately find the real object to be detected that needs to be detected in the real-time image, and then detect the real object of the target mosaic in the real object to be detected, which can not only improve the accuracy of the target mosaic The detection efficiency of the actual block can also be improved, and the reliability of the detection result of the target block can be improved.

In another embodiment of the present disclosure, in S220 shown in FIG. 2 , determining that there is a correctly placed target piece in the real pieces to be detected may specifically include:

According to the distance of the center of gravity between the objects to be detected and the physical angle parameters of the objects to be detected, detect the object objects in the objects to be detected;

In the case of detecting the physical object of the target piece, it is determined that there is a physical object of the target piece in the physical piece to be detected.

In this embodiment of the present disclosure, after acquiring the real-time image, the electronic device may determine the center of gravity distance between the real pieces of the real-time image and the physical angle parameters of each real piece to be detected, and determine the distance between the centers of gravity and the real object angle according to the distance between the centers of gravity and the real object angle parameter, to detect the target piece in the object to be detected, if the object of the object to be detected is detected, it is determined that the object of the object to be detected exists in the object of the object to be detected, otherwise, it is determined that there is no object of the object to be detected. Block real objects to avoid the problem of inaccurate answers due to irregular puzzles.

Wherein, the physical angle parameter of the actual piece to be detected may include at least one of a physical angle value of the actual piece to be detected and a physical angle vector corresponding to the actual piece to be detected.

In the embodiment of the present disclosure, each physical piece to be detected is preset with a preset number of vertices. The preset number may be the maximum number of corner points among the number of corner points of the actual corner points of each piece in the puzzle.

Taking the tangram as an example, the tangram can be composed of 7 pieces, and one piece corresponds to a real pattern. The 7 pieces can be respectively two first triangle pieces, one second triangle piece, two third triangle pieces, one square piece and one parallelogram piece. Among them, the two first triangle blocks are blocks with the same attributes, and the two third triangle blocks are blocks with the same attributes. The tile areas of the first triangular tile, the second triangular tile, and the third triangular tile decrease sequentially. The second triangular, square and parallelogram tiles have the same tile area. It can be seen that the maximum number of corner points of each piece in the tangram is 4, so the preset number can be 4.

In some embodiments, if the preset number is greater than the number of corner points of the physical piece itself, the vertices exceeding the number of corner points can be randomly allocated to each edge of the physical piece, and the vertices on each edge are evenly arranged .

In other embodiments, if the preset number is greater than the number of corner points of the actual piece of the puzzle itself, the vertices exceeding the number of corner points can be allocated to each edge of the actual piece of the puzzle according to the preset allocation rules, and each edge The vertices are evenly arranged. The preset allocation rules may be preset as required, which is not limited here.

Continuing to take the tangram as an example, each corner of the triangular piece can be used as a vertex, and the fourth vertex can be set on the midpoint of the hypotenuse of the triangular piece.

Wherein, the starting vertex and the preset vertex sequence of each actual piece to be detected can be preset as required, which is not limited here. For example, the preset vertex order can be either clockwise or counterclockwise.

Optionally, the physical angle value may be the angle value of the first included angle between the connecting line between the first target vertex and the second target vertex in the physical piece to be detected and the horizontal positive direction.

The positive horizontal direction can be preset as required, which is not limited here.

Further, the first target vertex can be the vertex with the first number in the real piece of the piece to be detected, and the second target vertex can be the vertex with the second number in the real piece of the piece to be detected.

Wherein, the first number and the second number can be preset according to requirements, respectively, and the first number and the second number are different.

In the embodiment of the present disclosure, the physical angle vector corresponding to the physical object to be detected may be generated according to the relative angle between the physical object to be detected and each of the physical objects to be detected.

Specifically, the relative angle between each two real pieces to be detected may be the angle of the second included angle between the connecting line between the first target vertex and the second target vertex of the two real pieces to be detected value.

FIG. 6 shows a schematic diagram of a physical angle parameter provided by an embodiment of the present disclosure.

As shown in FIG. 6 , the first angle between the first connecting line 603 between the first vertex and the third vertex of the first physical piece 601 and the horizontal positive direction in the right direction along the horizontal line 608 in the figure 605 is the physical angle value of the first block object 601 . The second angle 606 between the second connecting line 604 between the first vertex and the third vertex of the second block object 602 and the horizontal positive direction in the right direction along the horizontal line 608 as shown in the figure is the second block The object angle value of the object 602 . Among them, the direction of the arrow in the figure refers to the connection direction.

Continuing to refer to FIG. 6 , the third angle 607 between the first connecting line 603 and the second connecting line 604 is the relative angle between the first real piece 601 and the second real piece 602 .

Further, the center-of-gravity distance between the actual pieces to be detected has been described above, and will not be repeated here.

In the embodiment of the present disclosure, optionally, according to the distance of the center of gravity between the physical pieces to be detected and the physical angle parameters of the physical pieces to be detected, detecting the physical object of the physical pieces to be detected may specifically include:

According to the center-of-gravity distance, in the reference puzzle figure corresponding to the target figure, identify the puzzle figure to be matched, each puzzle figure to be matched includes a plurality of piece figures to be matched, and one piece figure to be matched in each puzzle figure to be matched corresponds to A piece of material to be detected;

In the actual pieces to be detected, the angle parameters of the detected objects and the target pieces corresponding to the pattern of the pieces to be matched meet the preset angle consistency condition.

In the embodiment of the present disclosure, at least one reference puzzle figure corresponding to the target figure may be preset in the electronic device, and the reference puzzle figure is the puzzle answer corresponding to the target figure.

The electronic device can first identify the puzzle graphics to be matched that are similar to the center-of-gravity distance between the real objects to be detected in the reference puzzle graphics corresponding to the target graphics, and then, in the real objects to be detected, detect the angle parameters of the real objects and the objects to be detected. Matching puzzle graphics include the target puzzle pieces whose attributes are the same as the pieces to be matched and meet the preset angle consistency condition. The target piece is the right piece. In the case of detecting the physical object of the target piece, it is determined that there is a physical object of the target piece in the physical piece to be detected.

Optionally, according to the center of gravity distance, in the reference jigsaw graph corresponding to the target graph, identifying the jigsaw graph to be matched may specifically include:

Generate the physical adjacency matrix corresponding to the center of gravity distance;

Perform bitwise AND calculation on the reference adjacency matrix corresponding to each reference jigsaw pattern with the physical adjacency matrix, to obtain the calculation result corresponding to each reference adjacency matrix;

The reference puzzle figure corresponding to the reference adjacency matrix with the largest calculation result is used as the puzzle figure to be matched.

In the embodiment of the present disclosure, the electronic device may be preset with a preset adjacency distance corresponding to each physical piece. The electronic device can compare the center of gravity distance between each two objects to be detected with the preset neighbor distance, and if the center of gravity distance is greater than the preset neighbor distance, the adjacency value of the center of gravity distance is set to 0, otherwise, Set the adjacency value for this barycentric distance to 1. After obtaining the adjacency values corresponding to the center-of-gravity distances between all the objects to be detected, the electronic device can arrange them according to the preset order of the blocks corresponding to the objects to be detected, and generate an adjacency matrix of objects corresponding to the center-of-gravity distances.

After the electronic device generates the physical adjacency matrix, it can obtain the reference adjacency matrix corresponding to each reference puzzle pattern, and perform bitwise AND calculation between the reference adjacency matrix corresponding to each reference puzzle pattern and the physical adjacency matrix to obtain each reference adjacency matrix. The calculation result corresponding to the matrix, and then the reference puzzle figure corresponding to the reference adjacency matrix with the largest calculation result is used as the puzzle figure to be matched.

Wherein, the reference angle vector corresponding to the pattern of the pieces to be matched can be generated before S210 shown in FIG. 2 , or can also be generated before it is determined in S220 that there is a correctly placed target piece in the actual pieces to be detected, here No restrictions. And the generation method of the reference adjacency matrix is similar to the generation method of the real adjacency matrix, and will not be repeated here.

Optionally, the number of puzzle graphics to be matched may be at least one, that is, the number of puzzle graphics to be matched may be one or multiple, which is not limited herein.

FIG. 7 shows a schematic diagram of a matching puzzle pattern provided by an embodiment of the present disclosure.

As shown in FIG. 7 , the center of gravity distance between each of the to-be-matched pieces in the first to-be-matched puzzle figure 705 and the second to-be-matched puzzle figure 706 is the The distance between the center of gravity of the third piece 703 and the fourth piece 704 is the most similar, so that the first piece 701, the second piece 702, the third piece 703 and the fourth piece 704 are respectively The placement positions of the images to be matched with the same attributes in the first to-be-matched puzzle figure 705 and the second to-be-matched puzzle figure 706 are the same. The actual puzzle to be detected obtained by splicing the third real piece 703 and the fourth real piece 704 may have two to-be-matched puzzle figures, a first to-be-matched puzzle figure 705 and a second to-be-matched puzzle figure 706 .

Further, the angle consistency condition may include that the weighted sum of the target parameter difference is less than or equal to the target weighted sum threshold, and the target parameter difference is the parameter difference between the physical angle parameter and the reference angle parameter corresponding to the tile graphics to be matched, The target weight and threshold are preset weights and thresholds corresponding to the physical angle parameters.

In some embodiments, when the physical angle parameter of the real piece to be detected includes the physical angle value of the real piece to be detected, the reference angle parameter of the graphic to be matched may include the reference angle value of the graphic to be matched .

Wherein, the reference angle value of the pattern of the pieces to be matched may be determined before S210 shown in FIG. 2 , or may be determined before the actual object of the pieces to be detected is determined in S220 before a correctly placed target piece exists. make restrictions. In addition, the method for determining the reference angle value of the pattern of the pieces to be matched is similar to the method for determining the angle value of the actual object of the piece to be detected, and details are not described here.

In these embodiments, optionally, the angular consistency condition may include that the weighted sum of the angular differences between the physical angular value of the actual piece to be detected and the reference angular value of the pattern to be matched is less than or equal to the corresponding angular value. preset weights and thresholds.

In other embodiments, when the physical angle parameter of the real piece to be detected includes the physical angle vector corresponding to the real piece to be detected, the reference angle parameter of the graphic to be matched may include the corresponding angle of the graphic to be matched. Reference angle vector.

Wherein, the reference angle vector corresponding to the pattern of the pieces to be matched may be determined before S210 shown in FIG. 2 , or it may be determined before the actual object of the pieces to be detected is determined in S220 before a correctly placed target piece exists, here No restrictions. And the method for determining the reference angle vector corresponding to the pattern of the patch to be matched is similar to the method for determining the angle vector of the real object corresponding to the real object to be detected, and will not be repeated here.

In these embodiments, optionally, the angle consistency condition may include that the weighted sum of the vector differences between the physical angle vector corresponding to the actual piece to be detected and the reference angle vector corresponding to the pattern of the to-be-matched piece is less than or equal to the angle The preset weight and threshold corresponding to the vector.

In still other embodiments, when the physical angle parameters of the real pieces to be detected include the physical angle value of the real pieces to be detected and the physical angle vectors corresponding to the real pieces to be detected, the reference angle of the graphics of the pieces to be matched The parameters may include a reference angle value of the tile pattern to be matched and a reference angle vector corresponding to the tile pattern to be matched.

In these embodiments, optionally, the angle consistency condition may include that the above-mentioned weighted sum of the angle difference and the vector difference is less than or equal to a preset weighted sum threshold corresponding to the angle difference and the vector difference.

It should be noted that, in the embodiment of the present disclosure, the weight coefficients of each angle parameter may be preset as required, and each weight coefficient is any value in (0, 1], which is not limited here.

Therefore, in the embodiment of the present disclosure, the actual object pieces of the target pieces that match the pieces to be matched in the pieces of the puzzle pieces to be matched can be accurately detected by using the angular consistency condition, that is, the correctly placed target can be accurately detected. Pieces of real objects.

In yet another embodiment of the present disclosure, in order to accurately obtain the center of gravity distance between the physical pieces and the physical angle parameters of each physical piece, in the determination of the physical pieces to be detected in S220 shown in FIG. 2 , Until the correct physical object placement exists, the graphic display method may also include:

Perform geometric analysis on the real-time image to obtain the vertex position of each piece;

According to the vertex position, calculate the distance of the center of gravity between the physical pieces and the physical angle parameters of the physical pieces.

In the embodiment of the present disclosure, after acquiring the real-time image, the electronic device can perform geometric analysis on the real-time image to obtain the vertex positions of the real pieces of the real-time image, such as vertex coordinates, and then, for each real piece of the real-time image, use The vertex position of the actual piece, calculate the position of the center of gravity of the piece, such as the coordinates of the center of gravity and the angle value of the object, and then use the position of the center of gravity and the angle value of the actual piece to obtain the distance between the center of gravity and the angle of each piece. The physical angle parameters of the actual piece.

In the embodiment of the present disclosure, each physical piece is preset with a preset number of vertices. The preset number may be the maximum number of corner points among the number of corner points of the actual corner points of each piece in the puzzle.

In the embodiment of the present disclosure, the vertices of each physical piece may start from the starting vertex and be numbered according to the preset vertex sequence.

Wherein, the starting vertex and the preset vertex sequence of each physical piece can be preset as required, which is not limited here. For example, the preset vertex order can be either clockwise or counterclockwise.

Specifically, after obtaining the positions of the vertices of the physical pieces, the electronic device can store the positions of the vertices of the physical pieces in the sequence of numbers.

Optionally, the physical angle value may be the angle value of the first included angle between the connecting line between the first target vertex and the second target vertex in the physical piece and the positive horizontal direction. The positive horizontal direction can be preset as required, which is not limited here.

Further, the first target vertex may be the vertex with the first number in the actual piece, and the second target vertex may be the vertex with the second number in the real piece. Wherein, the first number and the second number can be preset according to requirements, respectively, and the first number and the second number are different.

Continue to take the tangram as an example, the first number can be 1, and the second number can be 3, that is, the actual angle value can be the connection between the first vertex and the third vertex of the block and the positive horizontal direction The angle value of the included angle between.

FIG. 8 shows a schematic diagram of a geometric parameter provided by an embodiment of the present disclosure.

As shown in FIG. 8 , the electronic device can detect the vertices of the first real object 801, the second real object 802, the third real object 803 and the fourth real object 804 in the real-time image (as shown in the figure). The vertex position of each dot), for example, the vertex 805 is a vertex of the fourth real object 804, the position of the vertex 805 is a vertex position of the fourth real object 804, and the first real object 801 is determined. , the connection line between the first vertex and the third vertex in the second physical piece 802, the third physical piece 803 and the fourth physical piece 804 (as shown by the dotted arrows in the figure), for example The connection line 806 is the connection line between the first vertex and the third vertex of the second physical piece 802 .

Continue to refer to FIG. 8 , the positive horizontal direction can be the direction to the right along the horizontal line 807. Therefore, taking the second physical piece 802 as an example, the physical angle value of the second physical piece 802 can be the connecting line 806 and the horizontal line 807 to the right The angle value of the angle 808 between the directions.

In the embodiment of the present disclosure, optionally, the specific process of performing geometric analysis on the real-time image may include: inputting the real-time image into an image segmentation model obtained by pre-training to obtain a plurality of image segmentation regions, where one image segmentation region corresponds to one mosaic Block attributes, each block attribute corresponds to a block shape, a block area and a physical pattern of the actual block. Then, for each image segmentation area, input the image segmentation area into the vertex detection model obtained by pre-training the corresponding patch attribute, and obtain the vertex position of the actual patch of the patch attribute corresponding to the image segmentation area. Therefore, in the embodiment of the present disclosure, the electronic device can use the image segmentation model and the vertex detection model obtained by pre-training to realize the geometric analysis of the real-time image, which improves the efficiency and accuracy of the geometric analysis. It should be understood by those skilled in the art that the present disclosure does not limit the specific geometric analysis process and method.

In the embodiment of the present disclosure, for each physical piece, the electronic device can calculate the average vertex position of each vertex position of the physical piece, and use the average vertex position as the center of gravity of the physical piece. Taking the vertex position as the vertex coordinate as an example, the electronic device can calculate the mean value of the vertex coordinates of the vertex coordinates of each physical piece, and then use the mean value of the vertex coordinates as the barycentric coordinate of the physical piece.

In the embodiment of the present disclosure, for each physical piece, the electronic device may calculate the first target of the physical piece based on the vertex position corresponding to the first target vertex and the vertex position corresponding to the second target vertex of the physical piece The first included angle between the connecting line between the vertex and the second target vertex and the positive horizontal direction, and the first included angle is taken as the actual angle value of the actual piece.

Further, the electronic device can calculate the first difference between the positions of the centers of gravity of every two physical pieces according to the position of the center of gravity of each physical piece, and then use the absolute value of the first difference as the difference between the two physical pieces. The distance of the center of gravity between the pieces, and then the distance of the center of gravity between the objects of each piece is obtained.

Further, when the physical angle parameter does not include the physical angle vector corresponding to the physical piece, the electronic device can directly use the physical angle value of each physical piece as the physical angle parameter of the physical piece.

Further, when the physical angle parameter includes the physical angle vector corresponding to the physical piece, the electronic device can also calculate the second difference between the physical angle values of each two physical pieces according to the physical angle value of each physical piece. difference, and then take the absolute value of the second difference as the relative angle between the two real objects, and the relative angle is the connection between the first target vertex and the second target vertex of the two real objects. The angle value of the second included angle between the lines, so that the relative angle between each physical piece and other physical pieces can be arranged in the order of the preset pieces corresponding to each physical piece to generate each piece. The physical angle vector corresponding to the physical object of the piece. If the physical angle parameter does not include the physical angle value of the physical piece, the electronic device can use the physical angle vector corresponding to each physical piece as the physical angle parameter of the physical piece, otherwise, the electronic device can The physical angle value of , and its corresponding physical angle vector are used as the physical angle parameters of the piece.

Therefore, in the embodiment of the present disclosure, the electronic device can use the vertex positions to accurately and efficiently calculate the geometric parameters corresponding to the actual pieces of each piece, such as the distance of the center of gravity, the angle value of the object, the angle vector of the object, etc., thereby improving the detected target pieces. Physical reliability for reliable answer matching to live images.

In yet another embodiment of the present disclosure, in order to further improve the interactivity of the puzzle game, after S220 shown in FIG. 2 , the graphic display method may further include:

In the case that the target graphic is completely filled, the target prompt information is displayed, and the target prompt information is used to prompt that the objects to be detected are all spliced correctly.

In the embodiment of the present disclosure, after displaying the target filling pattern in the target shape area, the electronic device can detect in real time whether the target figure is completely filled, and if it is determined that the target figure is completely filled, it can display a real object for prompting the block to be detected. All stitching correct target prompt information.

Optionally, the target prompt information may include at least one of prompt text and prompt identifier.

For example, the target prompt information may be the prompt text "Congratulations on passing the level!".

FIG. 9 shows a schematic diagram of still another game interface provided by an embodiment of the present disclosure.

As shown in FIG. 9 , the electronic device 901 can display a game interface 902 of a puzzle game, a real-time image 903 can be displayed in full screen in the game interface 902 , and a target graphic 904 can be superimposed on the lower left corner of the real-time image 903 . When the electronic device detects that the target graphic 904 is completely filled, the prompt text "Congratulations for passing the level!" may be superimposed and displayed on the real-time image 903 to prompt the user that the puzzle pattern in the real-time image 903 is correctly spliced.

In this embodiment of the present disclosure, optionally, before displaying the target prompt information, the electronic device also needs to detect whether the target graphic is completely filled.

In some embodiments, the electronic device may be preset with the total number of puzzle pieces used for splicing the target graphics. The electronic device can obtain the physical quantity of the correct target piece, and judge whether the physical quantity is the same as the preset total number of pieces. If it is the same, it can be determined that the target figure is completely filled; is completely filled.

In other embodiments, the total number of shape regions of the target graphic may be preset in the electronic device. The electronic device can obtain the number of shape regions of the filled target shape region, and judge whether the number of shape regions is the same as the preset total number of shape regions. If it is the same, it can be determined that the target shape is completely filled; is completely filled.

In still other embodiments, the electronic device may perform image recognition on the target graphic to detect whether there is an initial fill color of the target graphic in the target graphic, and if it is detected that the initial fill color exists, it may be determined that the target graphic is not completely filled, Otherwise, it can be determined that the target shape is completely filled.

Therefore, in the embodiment of the present disclosure, the electronic device can quickly and accurately detect whether the target graphic is completely filled, thereby improving the reliability of the detection result of whether the objects to be detected are all spliced correctly.

An embodiment of the present disclosure further provides a graphic display device, which will be described below with reference to FIG. 10 .

In some embodiments of the present disclosure, the graphic display device may be an electronic device, such as the electronic device 110 shown in FIG. 1 . The electronic device may be a mobile phone, a tablet computer, a desktop computer, a notebook computer, a vehicle-mounted terminal, a wearable device, an all-in-one computer, a smart home device, or other device with communication functions, or a device simulated by a virtual machine or a simulator.

FIG. 10 shows a schematic structural diagram of a graphic display device provided by an embodiment of the present disclosure.

As shown in FIG. 10 , the graphic display device 1000 may include a first display unit 1010 , an image acquisition unit 1020 and a second display unit 1030 .

The first display unit 1010 can be configured to display target graphics.

The image acquisition unit 1020 may be configured to acquire a real-time image, and the real-time image is an image including the real object to be detected.

The second display unit 1030 can be configured to display the target fill pattern in the target shape area in the target graphic, and the target shape area is the target when it is determined that there is a correctly placed target piece in the actual pieces to be detected. The relative placement area of the actual pieces in the target graphics.

In the embodiment of the present disclosure, the target graphics can be displayed during the jigsaw puzzle process by the user, and the real-time image including the actual pieces of the pieces to be detected can be obtained during the jigsaw puzzle process by the user, and then in determining the actual pieces of the to-be-detected pieces In the case of the correct placement of the target piece, the target fill pattern is displayed in the target shape area in the target figure. Since the target shape area is the relative placement area of the target piece in the target figure, the clever In the process of jigsaw puzzles, board games can not only automatically and accurately match the answers, but also give real-time prompts to the user to place the correct target pieces, realizing real-time interaction with users and improving the puzzle game. The playability and interactivity of the game enhance the user experience.

In some embodiments of the present disclosure, the real-time image may also be an image including at least two physical pieces.

Correspondingly, the graphic display device 1000 may further include a first processing unit, and the first processing unit may be configured to determine the actual pieces to be detected in the actual pieces according to the distance of the center of gravity between the actual pieces.

In some embodiments of the present disclosure, the first processing unit may include a first sub-processing unit and a second sub-processing unit.

The first sub-processing unit may be configured to group the physical pieces according to the distance of the center of gravity, to obtain at least one group of physical pieces of the pieces, and the distance between the physical pieces of each piece in each group of physical pieces is less than or equal to Preset distance threshold.

The second sub-processing unit may be configured to use the actual pieces in the group of actual pieces with the largest number of pieces as the actual pieces to be detected.

In some embodiments of the present disclosure, the graphic display apparatus 1000 may further include a second processing unit and a third processing unit.

The second processing unit can be configured to detect the target piece in the pieces to be detected according to the distance between the centers of gravity of the pieces to be detected and the physical angle parameter of the piece to be detected.

The third processing unit may be configured to, in the case of detecting the physical object of the target piece, determine that there is a physical object of the target piece in the physical piece to be detected.

In some embodiments of the present disclosure, the second processing unit may include a third sub-processing unit and a fourth sub-processing unit.

The third sub-processing unit may be configured to identify the puzzle graphics to be matched in the reference puzzle graphics corresponding to the target graphics according to the center of gravity distance, each puzzle graphics to be matched includes a plurality of puzzle graphics to be matched, and each puzzle graphics to be matched One of the block graphics to be matched corresponds to an actual block to be detected.

The fourth sub-processing unit may be configured to detect, among the actual pieces to be detected, the actual angular parameters of the object and the target pieces corresponding to the pattern of the pieces to be matched that satisfy a preset angle consistency condition.

In some embodiments of the present disclosure, the third sub-processing unit may be further configured to generate a physical adjacency matrix corresponding to the center-of-gravity distance; perform bitwise AND calculation on the reference adjacency matrix corresponding to each reference mosaic image and the physical adjacency matrix to obtain The calculation result corresponding to each reference adjacency matrix; the reference mosaic image corresponding to the reference adjacency matrix with the largest calculation result is used as the mosaic image to be matched.

In some embodiments of the present disclosure, the physical angle parameter of the physical object to be detected may include at least one of the physical angle value of the physical object to be detected and the physical angle vector corresponding to the physical object to be detected. The physical angle vector corresponding to the physical object can be generated according to the relative angle between the physical object to be detected and each of the physical objects to be detected.

In some embodiments of the present disclosure, the angle consistency condition may include that the weighted sum of target parameter differences is less than or equal to the target weighted sum threshold, and the target parameter difference may be the actual angle parameter and the reference angle corresponding to the tile pattern to be matched The parameter difference between parameters, the target weighted sum threshold may be a preset weighted sum threshold corresponding to the physical angle parameter.

In some embodiments of the present disclosure, the graphic display device 1000 may further include a geometric analysis unit and a parameter calculation unit.

The geometric analysis unit can be configured to perform geometric analysis on the real-time image to obtain the vertex positions of the actual pieces of each piece.

The parameter calculation unit can be configured to calculate the center of gravity distance between the real pieces and the physical angle parameters of the real pieces according to the vertex positions.

In some embodiments of the present disclosure, the graphic display apparatus 1000 may further include a third display unit, and the third display unit may be configured to display target prompt information when the target graphic is completely filled, and the target prompt information can be used for Prompt that all the pieces to be detected are spliced correctly.

It should be noted that, the graphic display device 1000 shown in FIG. 10 can execute various steps in the method embodiments shown in FIGS. 2 to 9 , and implement various processes and processes in the method embodiments shown in FIGS. The effect will not be repeated here.

Embodiments of the present disclosure also provide a graphics display device, where the graphics display device may include a processor and a memory, and the memory may be used to store executable instructions. The processor may be configured to read executable instructions from the memory, and execute the executable instructions to implement the graphic display method in the foregoing embodiment.

FIG. 11 shows a schematic structural diagram of a graphic display device provided by an embodiment of the present disclosure. Referring specifically to FIG. 11 below, it shows a schematic structural diagram of a graphic display device 1100 suitable for implementing an embodiment of the present disclosure.

The graphic display device 1100 in the embodiment of the present disclosure may be an electronic device. Wherein, the electronic equipment may include, but not limited to, such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), in-vehicle terminals (such as in-vehicle navigation terminals) , wearable devices, etc., as well as stationary terminals such as digital TVs, desktop computers, smart home devices, and the like.

In some embodiments, the graphic display device 1100 may be the electronic device 110 shown in FIG. 1 .

It should be noted that the graphic display device 1100 shown in FIG. 11 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG. 11 , the graphics display device 1100 may include a processing device (eg, a central processing unit, a graphics processor, etc.) 1101 , which may be loaded from a storage device 1108 according to a program stored in a read only memory (ROM) 1102 or from a storage device 1108 . A program in a random access memory (RAM) 1103 executes various appropriate actions and processes to realize the graphic display method in the above-described embodiment. In the RAM 1103, various programs and data necessary for the operation of the information processing apparatus 1100 are also stored. The processing device 1101, the ROM 1102, and the RAM 1103 are connected to each other through a bus 1104. An input/output (I/O) interface 1105 is also connected to the bus 1104 .

Typically, the following devices can be connected to the I/O interface 1105: input devices 1106 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibration An output device 1107 such as a computer; a storage device 1108 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1109. Communication means 1109 may allow graphics display device 1100 to communicate wirelessly or by wire with other devices to exchange data. Although FIG. 11 shows the graphics display device 1100 having various means, it should be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

Embodiments of the present disclosure further provide a computer-readable storage medium, where a computer program is stored in the storage medium, and when the computer program is executed by the processor, the processor can implement the graphic display method in the above-mentioned embodiment.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs.

Embodiments of the present disclosure also provide a computer program product, where the computer program product may include a computer program, which, when executed by a processor, causes the processor to implement the graphic display method in the foregoing embodiments.

For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network via the communication device 1109, or from the storage device 1108, or from the ROM 1102. When the computer program is executed by the processing device 1101, the above-mentioned functions defined in the graphic display method of the embodiment of the present disclosure are executed.

It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, electrical wire, optical fiber cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, clients, servers can communicate using any currently known or future developed network protocol, such as HTTP, and can be interconnected with any form or medium of digital data communication (eg, a communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (eg, the Internet), and peer-to-peer networks (eg, ad hoc peer-to-peer networks), as well as any currently known or future development network of.

The above-mentioned computer-readable medium may be included in the above-mentioned graphic display device; or may exist alone without being incorporated into the graphic display device.

The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the graphics display device, the graphics display device is caused to execute:

Display the target graphic; obtain a real-time image, the real-time image is an image including the real object to be detected; when it is determined that there is a correctly placed target object in the real object to be detected, the real-time image is in the target shape area in the target graphics. , displays the target fill pattern, and the target shape area is the relative placement area of the target piece in the target figure.

In embodiments of the present disclosure, computer program code for performing operations of the present disclosure may be written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and also conventional procedural programming languages - such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through Internet connection).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or operations , or can be implemented in a combination of dedicated hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented in a software manner, and may also be implemented in a hardware manner. Among them, the name of the unit does not constitute a limitation of the unit itself under certain circumstances.

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), Complex Programmable Logical Devices (CPLDs) and more.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of the disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, and should also cover, without departing from the above-mentioned disclosed concept, the technical solutions formed by the above-mentioned technical features or Other technical solutions formed by any combination of its equivalent features. For example, a technical solution is formed by replacing the above features with the technical features disclosed in the present disclosure (but not limited to) with similar functions.

Additionally, although operations are depicted in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although the above discussion contains several implementation-specific details, these should not be construed as limitations on the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or logical acts of method, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

A graphic display method, comprising:

display target graphics;

Acquiring a real-time image, the real-time image is an image including the real object to be detected;

In the case where it is determined that there is a correctly placed target piece in the actual pieces to be detected, the target fill pattern is displayed in the target shape area in the target graphic, and the target shape area is the target piece The relative placement area of the physical block in the target graphic.
The method according to claim 1, wherein the real-time image is an image comprising at least two real objects;

Wherein, before determining that there is a correctly placed target piece in the actual pieces to be detected, the method further includes:

According to the distance of the center of gravity between the actual pieces of the pieces, the actual pieces of the pieces to be detected in the actual pieces of the pieces are determined.
The method according to claim 2, characterized in that, determining the physical pieces to be detected in the physical pieces according to the center of gravity distance between the physical pieces, comprising:

According to the distance of the center of gravity, the physical pieces are grouped to obtain at least one group of physical pieces, and the distance between the physical pieces of each group of the physical pieces of each group is less than or equal to the preset distance. threshold;

The actual pieces in the group of actual pieces with the largest number of pieces are used as the actual pieces to be detected.
The method according to claim 1, wherein the determining that there is a correctly placed target piece in the physical pieces to be detected includes:

According to the distance of the center of gravity between the actual pieces to be detected and the physical angle parameter of the actual pieces to be detected, detect the actual target piece in the actual pieces to be detected;

In the case of detecting the physical object of the target piece, it is determined that the physical object of the target piece exists in the physical piece of the to-be-detected piece.
The method according to claim 4, characterized in that, according to the distance of the center of gravity between the actual pieces to be detected and the physical angle parameters of the actual pieces to be detected, the detection of the actual pieces to be detected The said target piece in kind, including:

According to the center-of-gravity distance, in the reference puzzle figure corresponding to the target figure, identify the puzzle figure to be matched, each of the to-be-matched puzzle figures includes a plurality of to-be-matched puzzle figures, and each of the to-be-matched puzzle figures A patch graph to be matched corresponds to a patch object to be detected;

In the actual pieces to be detected, the angle parameters of the detected objects and the actual pieces of the target pieces corresponding to the patterns of the pieces to be matched meet a preset angle consistency condition.
The method according to claim 5, wherein, according to the center of gravity distance, identifying the puzzle figure to be matched in the reference puzzle figure corresponding to the target figure comprises:

generating a physical adjacency matrix corresponding to the center of gravity distance;

Perform bitwise AND calculation on the reference adjacency matrix corresponding to each of the reference puzzle graphics with the physical adjacency matrix, to obtain a calculation result corresponding to each of the reference adjacency matrices;

The reference puzzle figure corresponding to the reference adjacency matrix with the largest calculation result is used as the to-be-matched puzzle figure.
The method according to claim 5, wherein the physical angle parameter of the actual piece to be detected includes the physical angle value of the actual piece to be detected and the physical angle vector corresponding to the actual piece to be detected. At least one of the physical object angle vectors corresponding to the object to be detected is generated according to the relative angle between the object to be detected and each of the other objects to be detected.
The method according to claim 7, wherein the actual angle value of the actual piece to be detected is the connection line and the horizontal line between the first target vertex and the second target vertex in the actual piece to be detected The angle value of the first included angle between the positive directions, the first target vertex can be the vertex with the first number in the actual piece to be detected, and the second target vertex can be the second number in the real piece to be detected. vertices.
The method according to claim 8, wherein the relative angle between the actual piece to be detected and each of the other pieces to be detected is the first target vertex and the second target of the two actual pieces to be detected The angle value of the second included angle between the lines connecting the vertices.
The method according to any one of claims 5-9, wherein the angular consistency condition comprises that a weighted sum of target parameter differences is less than or equal to a target weighted sum threshold, and the target parameter difference is the physical object The parameter difference between the angle parameter and the reference angle parameter corresponding to the tile graphics to be matched, and the target weighted sum threshold is a preset weighted sum threshold corresponding to the physical angle parameter.
The method according to claim 2 or 4, characterized in that, before determining that there is a correctly placed target piece in the real pieces to be detected, the method further comprises:

Perform geometric analysis on the real-time image to obtain the vertex position of each of the actual pieces;

According to the position of the vertex, the distance of the center of gravity between the physical pieces and the physical angle parameters of the physical pieces are calculated.
The method according to claim 1, wherein after displaying the target filling pattern in the target shape area in the target graphic, the method further comprises:

In the case that the target graphic is completely filled, target prompt information is displayed, and the target prompt information is used to prompt that all the objects to be detected are spliced correctly.
The method according to claim 1, wherein after acquiring the real-time image, the method further comprises:

The live image is displayed.
The method according to claim 1, wherein the filling patterns corresponding to each shape area in the target graphic are the same, or the filling patterns corresponding to each shape area in the target graphic are different.
A graphic display device, comprising:

a first display unit, configured to display a target graphic;

an image acquisition unit, configured to acquire a real-time image, the real-time image being an image including the actual pieces of the pieces to be detected; and

The second display unit is configured to display the target fill pattern in the target shape area in the target graphic when it is determined that there is a correctly placed target piece in the actual pieces to be detected, and the target The shape area is the relative placement area of the target piece in the target figure.
A graphic display device, comprising:

processor;

memory for storing executable instructions;

Wherein, the processor is configured to read the executable instructions from the memory, and execute the executable instructions to implement the graphic display method according to any one of the above claims 1-14.
A computer-readable storage medium, characterized in that the storage medium stores a computer program, which, when executed by a processor, causes the processor to implement the graphics according to any one of the preceding claims 1-14 Display method.
A computer program product, characterized in that the computer program product includes a computer program that, when the computer program is executed by a processor, causes the processor to implement the graphic display method according to any one of the preceding claims 1-14 .