JP2024014161A - How to output the blueprint of a block object - Google Patents

Abstract

An object of the present invention is to provide a method that allows a user to easily assemble block objects using block parts. [Solution] A method for outputting a blueprint of a block object composed of multiple types of block parts that can be assembled and executed by a processing unit of a server terminal connected to multiple user terminals via a network. The processing unit of the server terminal acquires information regarding the block object from the user terminal, displays an image of the block object in the augmented reality space displayed on the user terminal, and acquires information about the block object from the user terminal. Information regarding the part is received, and an image of the block part is displayed in the augmented reality space so as to be distinguishable from the block object. [Selection diagram] Figure 6

Description

The present invention relates to a method for outputting a blueprint of a block object.

2. Description of the Related Art Toys that allow users to assemble block object models such as animals, buildings, and vehicles using block parts such as Lego bricks have become popular.

For example, Patent Document 1 discloses a method for streamlining the design of block parts that constitute a block object.

Patent No. 5665872

However, although it is possible to realize the efficiency and visualization of the design of block parts using the technology disclosed in Patent Document 1, it is not possible to realize a method for visualizing an image of assembling block objects from the user's perspective. The method was not disclosed.

Therefore, an object of the present invention is to provide a method that allows a user to easily assemble block objects using block parts.

In one aspect of the present invention, a method for outputting a blueprint of a block object composed of multiple types of block parts that can be assembled is executed by a processing unit of a server terminal connected to a user terminal via a network. The processing unit of the server terminal acquires information regarding block parts from the user terminal, determines an assembleable block object based on the information regarding the block parts, and acquires blueprint information and information about the block object. Information about the block parts is displayed, blueprint information of the block object is updated, information about the block parts is updated based on the updated blueprint information, and information about the updated block parts is displayed. In one aspect of the present invention, a method for outputting a blueprint of a block object composed of multiple types of block parts that can be assembled is executed by a processing unit of a server terminal connected to a user terminal via a network. The processing unit of the server terminal acquires information regarding the block object from the user terminal, displays an image of the block object in the augmented reality space displayed on the user terminal, and from the user terminal, Information regarding the block part is received, and an image of the block part is displayed in the augmented reality space so as to be distinguishable from the block object.

According to the present invention, it is possible to provide a method that allows a user to easily assemble block objects using block parts.

FIG. 1 is a block configuration diagram showing a system that provides a method for recommending block objects according to a first embodiment of the present invention. 2 is a functional block configuration diagram showing the server terminal 100 of FIG. 1. FIG. 2 is a functional block configuration diagram showing the user terminal 200 of FIG. 1. FIG. 3 is a diagram showing an example of object model information stored in the server 100. FIG. 3 is a diagram showing an example of block parts information stored in the server 100. FIG. It is an example of the flowchart which shows the detail of the method of outputting the blueprint of a block object based on 1st embodiment of this invention. It is another example of a flowchart showing details of a method for outputting a design drawing of a block object according to the first embodiment of the present invention. 1 is an example of a block object displayed on a user terminal according to the first embodiment of the present invention. It is a figure explaining an example of basic block parts concerning a first embodiment of the present invention. This is an example of identifying and displaying block parts with respect to a block object displayed on a user terminal according to the first embodiment of the present invention.

Embodiments of the present invention will be described below with reference to the drawings. Note that the embodiments described below do not unduly limit the content of the present invention described in the claims. Furthermore, not all of the components shown in the embodiments are essential components of the present invention.

<Configuration>
FIG. 1 is a block configuration diagram showing a system that provides a method for recommending block objects according to a first embodiment of the present invention. This system 1 includes a server terminal 100 that generates blueprint information of a block object based on coordinate information of block parts acquired from a user terminal 200 or a sensor device 300, and a user associated with each user who assembles the block object. It is composed of terminals 200A and 200B. Hereinafter, for convenience of explanation, the user terminals 200A and 200B will be collectively referred to as the user terminal 200.

Here, in this embodiment, an animal object will be explained as an example of a block object composed of a plurality of block parts, but other examples include people, robots, vehicles, buildings, etc. Not limited.

Server terminal 100 and user terminal 200 are each connected via network NW. The network NW includes the Internet, an intranet, a wireless LAN (Local Area Network), a WAN (Wide Area Network), and the like.

The server terminal 100 may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing. In this embodiment, one server terminal is illustrated for convenience of explanation, but the number is not limited to this, and a plurality of server terminals may be used.

The user terminal 200 is, for example, an information processing device such as a personal computer or a tablet terminal, but may also be configured by a smartphone, a mobile phone, a PDA, or the like.

In this embodiment, the system 1 will be described as having a server terminal 100 and a user terminal 200, and a user uses the user terminal 200 to operate the server terminal 100, but the server terminal 100 is standalone. The server terminal itself may have a function that each user can directly operate.

FIG. 2 is a functional block diagram of the server terminal 100 in FIG. 1. As shown in FIG. The server terminal 100 includes a communication section 110, a storage section 120, and a control section 130.

The communication unit 110 is a communication interface for communicating with the user terminal 200 via the network NW, and communication is performed according to a communication protocol such as TCP/IP (Transmission Control Protocol/Internet Protocol).

The storage unit 120 stores programs, input data, etc. for executing various control processes and functions within the control unit 130, and is composed of RAM (Random Access Memory), ROM (Read Only Memory), etc. Ru. The storage unit 120 also includes an object model information storage unit 121 that stores information related to the object model, and a block parts information storage unit 122 that stores block parts information generated based on the object model. . Note that a database (not shown) storing various data may be constructed outside the storage unit 120 or the server terminal 100.

The control unit 130 controls the overall operation of the server terminal 100 by executing a program stored in the storage unit 120, and is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc. be done. The functions of the control unit 130 include an information reception unit 131 that receives information such as instructions from the user terminal 200, an object model information processing unit 132 that refers to and processes various information related to object models, and various types related to block parts. It includes a block part information processing unit 133 that refers to and processes information, and an output processing unit 134 that performs a process of transmitting blueprint information related to a block object to be outputted to a user terminal. The information reception unit 131, object model information processing unit 132, block parts information processing unit 133, and output processing unit 134 are activated by a program stored in the storage unit 120 and are connected to the server terminal 100, which is a computer (electronic computer). Executed by

The information reception unit 131 is provided by the server terminal 100, and allows the user (to enter text or press an icon) through a user interface such as a screen displayed via a web browser or application on the user terminal 200. When a predetermined request is made (e.g.), information is received from the user terminal 200, or coordinate information of the block parts generated by the sensor device 300 is received via the user terminal 200 and the communication unit 110.

The object model processing unit 132 stores information related to object models in the object model information storage unit 121 and performs processing to refer to stored object model information.

The block parts information processing unit 133 stores information related to block parts in the block parts information storage unit 122, and performs processing to refer to the stored block parts information.

The output processing unit 134 performs a process of transmitting necessary information to the user terminal 200 in order to display blueprint information related to the block object on the user terminal 200. At this time, the output processing unit 134 uses the image and text data stored in the storage unit 120 as materials and arranges various images and texts in a predetermined area of the user interface based on predetermined layout rules. Screen information necessary to be displayed on the interface of the terminal 200 can be generated. This screen information generation process can also be executed by a GPU (Graphics Processing Unit).

FIG. 3 is a functional block configuration diagram showing the user terminal 200 of FIG. 1. The user terminal 200 includes a communication section 210, a display operation section 220, a storage section 230, and a control section 240.

The communication unit 210 is a communication interface for communicating with the server terminal 100 via the network NW, and communication is performed according to a communication protocol such as TCP/IP. Further, the communication unit 210 can also include a communication interface for communicating with the sensor device 300 via short-range wireless communication or the like.

The display operation unit 220 is a user interface used by the user to input instructions and display text, images, etc. in accordance with input data from the control unit 240, and the user terminal 200 is configured with a personal computer. If the user terminal 200 is a smart phone or a tablet device, the user terminal 200 is composed of a touch panel or the like. This display operation section 220 is activated by a control program stored in a storage section 230 and executed by the user terminal 200, which is a computer (electronic computer).

The storage unit 230 stores programs, input data, etc. for executing various control processes and functions within the control unit 240, and is composed of a RAM, a ROM, and the like. Furthermore, the storage unit 230 temporarily stores the contents of communication with the server terminal 100.

The control unit 240 controls the overall operation of the user terminal 200 by executing a program stored in the storage unit 230, and is composed of a CPU, a GPU, and the like.

Note that the configuration may be such that the server terminal 100 is provided with the function of a display operation section, or in this case, the configuration may be such that the user terminal 200 is not provided. In addition, the user terminal 200 may be equipped with a camera (not shown), and in this case, the camera captures an image of an AR marker provided on the block parts to determine the shape, color, etc. of the block parts. It is possible to identify the type, etc.) and determine the coordinates in augmented reality (AR) space.

FIG. 4 is a diagram showing an example of object model information stored in the server 100.

Object model information 1000 shown in FIG. 4 stores information related to an object model generated by a service operator associated with server terminal 100 or a user associated with user terminal 200. In FIG. 4, for convenience of explanation, an example of one object model (a user identified by object ID "10001") is shown, but information on a plurality of object models can be stored. Various data related to the object model include 3D model data of the object model, cross-sectional data of the object model, data related to one or more types of block parts and their number, and layers of the cross-section necessary to assemble the object model. Information such as blueprint information related to block parts arranged for each (layer) can be included. Here, the 3D model data can also be stored as 2D model data converted into a 3D model by predetermined processing.

FIG. 5 is a diagram showing an example of block parts information stored in the server 100.

Block parts information 2000 shown in FIG. 5 stores information related to the shape, size, color, weight, etc. of block parts. In FIG. 5, for convenience of explanation, an example of one block part (block part identified by ID "20001") is shown, but information related to a plurality of block parts can be stored. Various data related to block parts may include, for example, data related to block parts corresponding to parts for assembling a block object (consisting of shape, size, color, number of each block part, etc.) . Here, each of the plurality of types of block parts can be associated with a unique color, but the invention is not limited thereto.

FIG. 6 is an example of a flowchart illustrating a method for outputting a blueprint of a block object according to the first embodiment of the present invention.

As a preliminary process, the user accesses the server terminal 100 using the web browser of the user terminal 200 or an application (if installing an application). A predetermined screen is displayed on a user interface via a website, application, or the like. The user already has basic block parts, which will be described later, on hand, and information regarding the basic block parts is stored in the block parts information storage section 122 of the storage section 120 of the server terminal 100.

Then, as the process of step S101, the information reception unit 131 of the control unit 130 of the server terminal 100 receives information regarding the block object that the user wants to assemble from the user terminal 200 via the network and communication unit 110. Receive. Here, the user can select a desired block object from among the plurality of block objects on the user interface screen displayed on the user terminal 200. In this example, the user wants to assemble a frog block object as shown in FIG. When the input operation is performed, the server terminal 100 receives information regarding the block object corresponding to the frog.

Subsequently, as processing in step S102, the object model information processing section 132 of the control section 130 of the server terminal 100 refers to the object model information storage section 121 of the storage section 120 based on the received information regarding the block object model. , executes a process of displaying the block object on the user terminal 200 based on the 3D data of the block object selected by the user. Here, an AR space is displayed on the user interface screen of the user terminal 200, and an image of the block object generated based on the 3D data is displayed in the real space imaged by the camera equipped on the user terminal 200. be done. Here, the user can enlarge, reduce, rotate, etc. the image of the block object displayed in the AR space by pinching, zooming, or other operations on a predetermined controller or touch panel.

Subsequently, as processing in step S103, the information reception unit 131 of the control unit 130 of the server terminal 100 receives information regarding one block part owned by the user from the user terminal 200 via the network and communication unit 110. . Here, when the user photographs a block part that he or she owns using a camera installed in the user terminal 200, the user identifies the AR marker affixed to the block part, and the identified information is transmitted to the server terminal 100. . Based on the information identified through the AR mark, the block parts information processing unit 133 of the server terminal 100 identifies the type of block parts (the type defined by any one or a combination of shape, color, and size). do. Further, the block parts information processing unit 133 can also identify the coordinates of the block parts in the AR space.

Subsequently, as processing in step S104, the object model information processing unit 132 of the control unit 130 of the server terminal 100 refers to the object model blueprint information stored in the object model information storage unit 121 of the storage unit 120, Based on the information about the block parts identified from the received information about the block parts, it is determined whether the block part is a block part necessary for assembling the block object, and the block part necessary for assembling the block object is determined. In this case, the output processing unit 134 of the control unit 130 of the server terminal 100 displays the block parts in color in the block object arranged in the AR space displayed via the user interface screen of the user terminal 200. The block parts are identified by displaying them in a flashing or flashing manner.

For example, FIG. 8(b) is an example of part of the blueprint data of a frog object model. The blueprint data indicates, in each layer, the arrangement areas of block parts necessary for configuring the object model by color together with coordinate information. Along with the main design drawing data, the block parts information processing section 133 refers to the block parts information stored in the block parts information storage section 122 of the storage section 120, and selects among the predetermined block parts as shown in FIG. , determine which block part is used in which area of the block part placement area included in the blueprint information, and determine whether the received block part matches the determined block part. confirm. Here, when it is confirmed that the block parts match each other, that is, when it is confirmed that the block parts owned by the user are used to assemble the block object, the output processing unit 134 outputs the AR In order to identify where the block part is used among the user objects displayed in the space, the image of the block part is displayed in different colors or blinks for identification.

FIG. 7 is another example of a flowchart showing a method for outputting a design drawing of a block object according to the first embodiment of the present invention.

In this example, in the process of step S104, when displaying the block parts in an identifying manner, when displaying the block parts held by the user in the AR space, the block parts are adjusted according to the actual size of the displayed block parts. , which also allows users to easily assemble block objects using the block parts they have by readjusting the size of block objects displayed in AR space and displaying them overlapping block parts. It is.

First, in the process of step S201, the object model information processing section 132 of the control section 130 of the server terminal 100 refers to the 3D model information of the object model stored in the object model information storage section 121 of the storage section 120, and Based on the received coordinate information of the block part in the AR space via the AR marker provided on the block part held by the user, the size of the block part is determined and the object model to be displayed in the AR space is determined. The size is readjusted (resized) so that the size of the block parts constituting the object model matches the size of the actual block parts owned by the user.

Subsequently, in the process of step S202, the output processing unit 134 of the control unit 130 of the server terminal 100 displays the image of the block object whose size has been readjusted as described above on the user interface screen of the user terminal 200. It is displayed superimposed on the image of the block parts in the AR space. Here, the output processing unit 134 can display the block objects in a semi-transparent manner so that the block objects and the block parts can be displayed in a distinguishable manner, so that the user can more easily assemble the block objects. .

As described above, according to the present embodiment, when a user assembles a block object, the user can identify and display the used block parts together with the block object in the AR space. , you can easily assemble block objects.

Although the embodiments according to the invention have been described above, they can be implemented in various other forms, and can be implemented with various omissions, substitutions, and changes. These embodiments and modifications, as well as omissions, substitutions, and changes, are included within the technical scope of the claims and their equivalents.

1 system 100 server terminal, 110 communication unit, 120 storage unit, 130 control unit, 200 user terminal, NW network

Claims (5)

A method for outputting a blueprint of a block object composed of a plurality of types of block parts that can be assembled, the method being executed by a processing unit of a server terminal connected to a user terminal via a network, the method comprising:
The processing unit of the server terminal includes:
obtaining information regarding the block object from the user terminal;
displaying an image of the block object in an augmented reality space displayed on the user terminal;
receiving information regarding block parts from the user terminal;
A method for displaying an image of the block part in a manner distinguishable from the block object in the augmented reality space. The method according to claim 1, wherein images of the block parts are displayed at locations necessary for assembling the block object. The method according to claim 1, wherein the user terminal images the block part and receives information about the block part via an AR marker provided on the block part. The method according to claim 1, wherein the image of the object model is resized to match the size of the image of the block part. The method of claim 1, wherein the image of the block object is made translucent.