JP7470466B1 - How to generate blueprints for block objects - Google Patents

Abstract

[Problem] To provide a method for making it easier for users to assemble block objects using block parts. [Solution] A method for distributing a video of assembling a block object, which is made up of a plurality of types of block parts, is executed by a processor of a server terminal connected via a network to a distributor terminal of a distributor who distributes an assembly method for the block object and a user terminal of a user who assembles the block object, in which the processor of the server terminal accepts a request from the distributor terminal to access design plan information for assembling the block object, transmits the design plan information to the distributor terminal, accepts a request from the distributor terminal to distribute a video for assembling the block object, and executes video distribution by the distributor. [Selected Figure] Figure 7

Description

The present invention relates to a method for recommending block objects.

Toys that allow users to assemble block object models such as animals, buildings, vehicles, etc. using block parts such as Lego bricks have become popular.

For example, Patent Document 1 discloses a method for improving the efficiency of designing block parts that make up a block object.

Patent No. 5665872

However, while the technology disclosed in the above-mentioned Patent Document 1 makes it possible to improve the efficiency and visualization of block part design, it does not disclose a method for visualizing the image of assembling block objects from a user's perspective.

The present invention aims to provide a method that makes it easier for users to assemble block objects using block parts.

In one aspect of the present invention, a method for distributing a video of assembling a block object, the method being executed by a processor of a server terminal connected via a network to a distributor terminal of a distributor distributing a method of assembling a block object made up of multiple types of block parts and a user terminal of a user assembling the block object, in which the processor of the server terminal accepts a request from the distributor terminal to access blueprint information for assembling the block object, transmits the blueprint information to the distributor terminal, accepts a request from the distributor terminal to distribute a video for assembling the block object, and executes video distribution by the distributor.

The present invention provides a method that makes it easier for users to assemble block objects using block parts.

1 is a block diagram showing a system for providing a method for recommending a block object according to a first embodiment of the present invention; FIG. 2 is a functional block diagram showing the server terminal 100 of FIG. 1 . FIG. 2 is a functional block diagram showing a user terminal 200 of FIG. 1. FIG. 2 is a functional block diagram showing the sensor device 300 of FIG. 1 . FIG. 2 is a diagram showing an example of object model information stored in the server 100. FIG. 2 is a diagram showing an example of block part information stored in the server 100. 10 is an example of a flowchart showing details of a method for delivering a video of assembling a block object according to the first embodiment of the present invention. 11 is another example of a flowchart illustrating details of the method for delivering a video of assembling block objects according to the first embodiment of the present invention. 4 is an example of a video distribution screen displayed on a user terminal according to the first embodiment of the present invention. 13 is another example of a video distribution screen displayed on a user terminal according to the first embodiment of the present invention. 13 is yet another example of a video distribution screen displayed on a user terminal according to the first embodiment of the present invention.

The following describes an embodiment of the present invention with reference to the drawings. Note that the embodiment described below does not unduly limit the content of the present invention described in the claims. Furthermore, not all of the components shown in the embodiment are necessarily essential components of the present invention.

<Configuration>
1 is a block diagram showing a system for providing a method for distributing a video of assembling a block object according to a first embodiment of the present invention. The system 1 includes a distributor terminal 200A of a distributor who distributes a method of assembling a block object composed of a plurality of block parts, a user terminal 200B of a user who assembles the block object, a sensor device 300 connected to the distributor terminal 200A, and a server terminal 100 connected to the distributor terminal 200A and the user terminal 200B via a network, stores design drawing information for assembling the block object, and distributes a video of assembling the block object. Here, as a configuration of the system 1, a server that performs video distribution may be provided as a video distribution terminal separately from the server terminal 100. Also, the distributor terminal 200A and the user terminal 200B are described as singular, but a terminal corresponding to each of a plurality of distributors and users may be provided separately.

Here, as an example of a block object made up of multiple block parts, in this embodiment, a video distribution by a distributor disguised as a character, so-called Vtuber, is assumed, and an object with a character motif will be described as an example, but other characters, people, robots, vehicles, food, buildings, etc. can also be used, and the example is not limited to this one.

The server terminal 100, the distributor terminal 200A, and the user terminal 200B are each connected via a network NW. The network NW is composed of the Internet, an intranet, a wireless LAN (Local Area Network), a WAN (Wide Area Network), etc.

The server terminal 100 may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing. In this embodiment, for convenience of explanation, one server terminal is illustrated as an example, but this is not limited to this and multiple servers may be used.

The distributor terminal 200A and the user terminal 200B are, for example, information processing devices such as personal computers or tablet terminals, but may also be configured as smartphones, mobile phones, PDAs, etc.

The sensor device 300 is, for example, a mouse-like device that operates the distributor terminal 200A, and is equipped with a base on which a block part can be placed and a sensor such as an acceleration sensor that can generate coordinate information for the base, and is connected to and paired with the distributor terminal 200A via short-range wireless communication such as Bluetooth (registered trademark). Here, instead of the sensor device 300, an acceleration sensor may be attached to the block part by pasting, etc.

Figure 2 is a functional block diagram of the server terminal 100 in Figure 1. The server terminal 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

The communication unit 110 is a communication interface for communicating with the user terminal 200 via the network NW, and communication is performed according to a communication protocol such as TCP/IP (Transmission Control Protocol/Internet Protocol).

The storage unit 120 stores programs for executing various control processes and functions in the control unit 130, input data, etc., and is composed of a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The storage unit 120 also has an object model information storage unit 121 that stores information related to the object model, and a block part information storage unit 122 that stores block part information generated based on the object model, etc. A database (not shown) that stores various data may be constructed outside the storage unit 120 or the server terminal 100.

The control unit 130 controls the overall operation of the server terminal 100 by executing the programs stored in the storage unit 120, and is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc. The functions of the control unit 130 include an information receiving unit 131 that receives information such as instructions from the distributor terminal 200A and the user terminal 200B, an object model information processing unit 132 that refers to and processes various information related to the object model, a block part information processing unit 133 that refers to and processes various information related to the block parts, an output processing unit 134 that transmits design drawing information related to the block object to be output to the user terminal and processes an assembly video of the block object, and a coordinate analysis unit 135 that analyzes coordinate information related to the block parts received from the distributor terminal 200A and the user terminal 200B. The information receiving unit 131, object model information processing unit 132, block part information processing unit 133, output processing unit 134, and coordinate analysis unit 135 are started by a program stored in the storage unit 120 and executed by the server terminal 100, which is a computer (electronic calculator).

The information receiving unit 131 receives information from the user terminal 200 when a broadcaster or user makes a specific request (by entering text, pressing an icon, etc.) via a user interface such as a screen provided by the server terminal 100 and displayed via a web browser or application on the broadcaster terminal 200A and the user terminal 200B, or receives coordinate information of block parts generated by the sensor device 300 via the broadcaster terminal 200A and the communication unit 110.

The object model processing unit 132 stores information related to the object model in the object model information storage unit 121 and performs processing to reference the stored object model information.

The block part information processing unit 133 stores information related to block parts in the block part information storage unit 122 and performs processing to refer to the stored block part information.

The output processing unit 134 performs processing to transmit necessary information to the broadcaster terminal 200A or the user terminal 200B in order to display blueprint information related to the block object on the broadcaster terminal 200A or the user terminal 200B, and also performs processing required to distribute an assembly video of the block object to the user terminal 200B. At this time, the output processing unit 134 can generate screen information required to be displayed on the interface of the user terminal 200 by using the image and text data stored in the memory unit 120 as material and arranging various images and text in a predetermined area of the user interface based on a predetermined layout rule. This screen information generation processing can also be performed by a GPU (Graphics Processing Unit).

The coordinate analysis unit 135 analyzes coordinate information related to block parts acquired from the sensor device 300 or the broadcaster terminal 200A, and performs processing to determine the inclination of the displayed block object when displaying blueprint information related to the block object on the broadcaster terminal 200A.

Figure 3 is a functional block diagram showing the broadcaster terminal 200A of Figure 1. The broadcaster terminal 200A includes a communication unit 210, a display operation unit 220, a storage unit 230, and a control unit 240.

The communication unit 210 is a communication interface for communicating with the server terminal 100 via the network NW, and communication is performed according to a communication protocol such as TCP/IP. The communication unit 210 can also be provided with a communication interface for communicating with the sensor device 300 via short-range wireless communication or the like.

The display operation unit 220 is a user interface used by the distributor to input instructions and display text, images, etc. according to input data from the control unit 240, and is composed of a display, keyboard, and mouse if the distributor terminal 200A is configured as a personal computer, and is composed of a touch panel, etc. if the distributor terminal 200A is configured as a smartphone or tablet terminal. This display operation unit 220 is started up by a control program stored in the memory unit 230 and executed by the distributor terminal 200A, which is a computer (electronic calculator).

The storage unit 230 stores programs for executing various control processes and functions in the control unit 240, input data, etc., and is composed of RAM, ROM, etc. The storage unit 230 also temporarily stores the contents of communication with the server terminal 100.

The control unit 240 controls the overall operation of the user terminal 200 by executing the programs stored in the memory unit 230, and is composed of a CPU, GPU, etc.

The user terminal 200B can be configured substantially the same as the distributor terminal 200A, so a description of it will be omitted.

Figure 4 is a functional block diagram showing the sensor device 300 of Figure 1. The sensor device 300 includes a communication unit 310, an acceleration sensor 320, an input unit 330, and a control unit 340.

The communication unit 310 is a communication interface for communicating with the server terminal 100 via the network NW, and communication is performed according to a communication protocol such as TCP/IP. The communication unit 210 can also be equipped with a communication interface for communicating with the user terminal 200 via short-range wireless communication, etc.

The acceleration sensor 320 measures the inclination of the X-axis, Y-axis, and Z-axis of the base on which the user places the block parts, which is provided on the sensor device 300 (not shown), relative to the plane on which the sensor device 300 is placed, and generates coordinate information. Note that the sensor is not limited to an acceleration sensor, and other sensors capable of detecting the inclination of the base relative to the plane, such as an angular velocity sensor, can also be used.

The input unit 330 is an interface for inputting instructions to perform operations on the screen displayed on the user terminal 200, and may be, for example, a physical button or a button displayed on an LCD screen.

The control unit 340 controls the overall operation of the sensor device 300 by executing a program stored in a memory unit (not shown), and is composed of a CPU, GPU, etc.

Figure 5 shows an example of object model information stored in server 100.

The object model information 1000 shown in FIG. 5 stores information related to an object model generated by a service operator or a distributor terminal 200A and/or a user terminal 200B related to the server terminal 100. For convenience of explanation, FIG. 4 shows an example of one object model (a user identified by object ID "10001"), but information on multiple object models can be stored. Various data related to an object model can include 3D model data of the object model, cross-sectional data of the object model, data related to one or more types of block parts and the number of parts required to assemble the object model, design drawing information related to block parts arranged in each layer of the cross section, and other information. Here, the 3D model data can also be stored as 2D model data converted into a 3D model by a predetermined process.

Figure 6 shows an example of block part information stored in server 100.

The block part information 2000 shown in FIG. 6 stores information related to the shape, size, color, and weight of the block part. For ease of explanation, FIG. 6 shows an example of one block part (a block part identified by ID "20001"), but information related to multiple block parts can be stored. The various data related to the block parts can include, for example, data related to the block parts that correspond to the parts used to assemble a block object (consisting of the shape, size, color, etc. of the block parts). Here, each of the multiple types of block parts can be associated with a unique color, but is not limited to this.

Figure 7 is an example of a flowchart showing details of a method for delivering an assembly video of a block object according to a first embodiment of the present invention.

To use this system 1, the distributor pairs the distributor terminal 200A with the sensor device 300 by short-range wireless communication or the like, and places the user's handheld block part on the base (not shown) of the sensor device 300. Here, the base may have a protrusion on the surface on which the block part is placed so that the block part can fit together when placed. Also, as described above, an acceleration sensor may be attached to the block part instead of the sensor device 300.

As a preliminary process, the distributor accesses the server terminal 100 using the web browser of the distributor terminal 200A or an application (if an application is installed). A specific screen is displayed on the user interface via the website or application. Following the instructions displayed on the specific screen, the distributor activates the camera built into the distributor terminal 200A to capture a two-dimensional code such as a QR code (registered trademark) printed on a package containing block parts that the distributor purchased as a product, and link information (URL) of a website for accessing blueprint information for assembling the block object is displayed on the user interface of the distributor terminal 200A. The distributor selects the link information to access the blueprint information for assembling the block object.

In step S101, the information receiving unit 131 of the control unit 130 of the server terminal 100 receives a request to access blueprint information for assembling a block object from the distributor terminal 200A via the communication unit 110. This access request may include an ID that identifies the block object.

Next, in step S102, the object model information processing unit 132 of the control unit 130 of the server terminal 100 refers to the blueprint information stored in the object model information storage unit 121 of the memory unit 120 in response to the access request, and when it identifies the blueprint information corresponding to the ID that identifies the block object, the output processing unit 134 of the control unit 130 transmits the blueprint information to the distributor terminal 200A.

Next, in step S103, the distributor inputs the necessary information via the user interface of the distributor terminal 200A to distribute a video of assembling block objects, and the information receiving unit 131 of the control unit 130 of the server terminal 100 receives a video distribution request from the distributor terminal 200A via the communication unit 110. The necessary information may include the distributor's name, the names of the block objects to be assembled, the distribution date (in the case of real-time distribution), and the distribution URL (if already generated and assigned).

Next, in step S104, the output processing unit 134 of the control unit 130 of the server terminal 100 performs processing to distribute a video of assembling the block object to the user in response to the request. In this processing, when the distributor distributes in real time, the output processing unit 134 stores distribution information such as the distributor's name, the name of the block object to be assembled, the distribution date, and the distribution URL, together with the blueprint information, as object model information 1000 in the object model information storage unit 121 based on the received information, and transmits the distribution information via the user terminal 200B to the user who has received the request to assemble the block object. Here, the distribution information can also be displayed on a website that displays blueprint information for assembling the block object.

In addition to the distribution information, if the distributor distributes a recorded video, the output processing unit 134 can also upload a video file of the assembly of the block object, which the distributor has previously filmed and recorded, to the website where the blueprint information is displayed or the video distribution website.

Through the above process, a user can purchase a product for assembling a block object of a character of a Vtuber or other person they like, and by accessing the QR code (registered trademark) printed on the product package, they can refer to blueprint information for assembling the character and assemble the character's block object while watching the Vtuber's assembly video broadcast.

Figure 8 is another example of a flowchart showing details of a method for distributing a video of assembling a block object according to the first embodiment of the present invention. In this example, the process when a distributor actually distributes a video is described. Regarding video distribution, when the server terminal 100 receives a video distribution request from the user terminal 200B on the distribution date specified in the distribution information set above, the server terminal 100 distributes a video of the distributor demonstrating the assembly of a block object via a video distribution application.

As an aid in explaining how to assemble a block object, the distributor selects a function in a video distribution application launched on the distributor terminal 200A to request screen sharing of a blueprint of the block object. In the process of step S201, the information receiving unit 131 of the control unit 130 of the server terminal 100 receives a request for screen sharing of blueprint information for assembling the block object from the distributor terminal 200A via the communication unit 110.

Subsequently, in the process of step S202, the object model information processing unit 132 of the control unit 130 of the server terminal 100 refers to the blueprint information stored in the object model information storage unit 121 of the storage unit 120 in response to the above-mentioned sharing request, and identifies the blueprint information corresponding to the ID that identifies the block object. Here, in order to identify the blueprint information, the distributor can input the name or identification ID of the block object when making a screen sharing request, and the object model information processing unit 132 can refer to and identify the corresponding blueprint information. However, in the process of step S102, if the distributor has already accessed the blueprint information and the blueprint information is displayed on the distributor terminal 200A, the distributor can select the screen sharing function in the video distribution application and select the window screen in which the blueprint information is displayed or the entire screen of the distributor terminal 200A to identify the blueprint information as screen information.

Subsequently, in step S203, the output processing unit 134 of the control unit 130 of the server terminal 100 transmits the identified blueprint information to the user terminal 200B via the screen sharing screen of the video distribution application. This allows the distributor to share the blueprint information with the user terminal 200 while assembling the block object.

As shown in FIG. 9, the screen 1000 of the video distribution application displayed on the user terminal 200B is composed of at least a distributor screen display area 1010 in which the distributor (or a character played by the distributor) assembling the block object is displayed, and a blueprint information display area 1020 in which blueprint information for assembling the block object is displayed.

The distributor can also assemble block objects by placing block parts on a base provided via a rotation mechanism in the sensor device 300, which is paired with the distributor terminal 200A by short-range wireless communication or the like, and rotating or tilting the base. As the base is tilted or rotated, the acceleration sensor 320 built into the sensor device 300 detects coordinates (position information of the base in the X-, Y-, and Z-axis directions relative to the ground) according to the tilt or rotation of the base relative to the ground, such as a tabletop on which the sensor device 300 is placed, and generates coordinate information. The sensor device 300 transmits the generated coordinate information to the distributor terminal 200A via short-range wireless communication or the like, and when the server terminal 100 receives the coordinate information generated by the sensor device 300 from the distributor terminal 200A via the network and communication unit 110, the coordinate analysis unit 135 of the control unit 130 of the server terminal 100 analyzes the received coordinate information and converts it into coordinate information of an object model composed of block parts in the 3D space of the design drawing information display area 1020, which is displayed as a design drawing of a block object on the distributor terminal 200A. The output processing unit 134 of the control unit 130 of the server terminal 100 performs output processing by generating screen information by arranging the object model in the design drawing information display area 1020 as design drawing information to be displayed on the distributor terminal 200A based on the analyzed coordinate information.

10 is an example of an object model displayed in the blueprint information display area 1020. The distributor can easily assemble the block object while referring to the blueprint information corresponding to the inclination of the block object placed on the sensor device 300 on the distributor terminal 200A so that the block object is tilted as shown in FIG. 10(b) from the front view of the block object as shown in FIG. 10(a). Even from the user's perspective, the user can easily assemble the block object while enjoying a sense of realism, since the block object as blueprint information, which could only be referred to as a still image in the past, is displayed in a dynamic form linked to the distributor's movement as in this example, while the distributor is demonstrating the assembly of the block object. The broadcaster terminal 200 may also be equipped with a camera (not shown). In this case, the camera can capture an image of an AR marker provided on the block part, thereby identifying the type of the block part (determined by its shape, color, etc.), and share corresponding design information on the screen as well as determine coordinates in an augmented reality (AR) space. This makes it possible to determine the inclination of the block object and share design information according to the inclination.

Furthermore, the distributor can operate the input unit 330 provided in the sensor device 300 (for example, by operating a mouse click button or performing a tap operation on a smartphone) to make a request to update a block object in the blueprint information displayed on the distributor terminal 200A, whereby the object model processing unit 132 of the control unit 130 of the server terminal 100 references the blueprint information and references the corresponding blueprint information, and the output processing unit 134 performs processing to display the updated blueprint information on the distributor terminal 200A.

For example, as shown in FIG. 11, on the user interface screen of the video distribution application of the distributor terminal 200A, the blueprint information of the block object is displayed in the blueprint display area 1020, and the distributor assembles the block parts according to the blueprint of the object model displayed in FIG. 11(a), and can request an update of the blueprint information of a desired state during the assembly of the block object by specifying an arbitrary point with the blueprint information instruction button 1022 of the display guide gauge 1021 for blueprint information from the start (START) of assembly of the block parts to the completion (GOAL). As shown in FIG. 11(b), the output processing unit 134 can output the blueprint information according to the request. Since the blueprint information is shared with users who watch the video distribution via the video distribution application, the users can dynamically refer to the blueprint information according to the progress of the assembly while watching the distributor's assembly distribution of the block object, as in this example, which could only be referred to as a still image in the past, and can easily assemble the block object while enjoying a sense of realism.

Although the above describes the embodiments of the invention, these can be embodied in various other forms and can be implemented with various omissions, substitutions, and modifications. These embodiments and modifications, as well as omissions, substitutions, and modifications, are included within the technical scope of the claims and their equivalents. For example, in this example, an example has been described in which a broadcaster broadcasts a method for assembling a specific block object while sharing blueprint information via the broadcaster terminal 200, but as long as it does not deviate from the essence of this embodiment, it can also be applied to an example in which users, other than broadcasters such as Vtubers, share assembly methods with each other.

1 System 100 Server terminal, 110 Communication unit, 120 Storage unit, 130 Control unit, 200 Distributor terminal (user terminal), 300 Sensor device, NW Network

Claims (4)

A method for delivering a real-time video of assembling a block object constituted by a plurality of types of block parts, the method being executed by a processor of a server terminal connected via a network to a distributor terminal of a distributor who delivers a method of assembling the block object and a user terminal of a user who assembles the block object, the processor comprising:
The processing unit of the server terminal
receiving a request from the distributor terminal to access design drawing information for assembling the block object;
Transmitting the design drawing information to the distributor terminal and at least causing the distributor terminal to display the design drawing information;
receiving a request from the distributor terminal to distribute a video for assembling the block object;
A method for executing a video distribution process by the distributor. The method of claim 1, further comprising: performing a process of screen-sharing the design information in the video. The method according to claim 1, further comprising: receiving a request to update the design information from the distributor terminal; and updating the design information based on the request to update. The method according to claim 1, further comprising accepting a request for access to the video distribution from the user terminal and distributing the video.