KR101271421B1 - Contents providing apparatus using auto puzzle recognition - Google Patents

Abstract

PURPOSE: A content providing device with automatic puzzle recognition is provided to determine the completion of a puzzle set regardless of the shapes and sizes of the puzzle blocks included in the set by recognizing the image code displayed on the blocks. CONSTITUTION: A puzzle block accepting unit(301) locates puzzle blocks and transmits light. An image sensing unit(303) captures an image on a side of a puzzle block located in the puzzle block accepting unit. A control unit(319) determines the assembly completion of a puzzle set corresponding to the puzzle block from the image. The puzzle block accepting unit includes displayed marks and the control unit determines the positions of the puzzle blocks in the accepting unit using the marks. [Reference numerals] (301) Puzzle block accepting unit; (303) Image sensing unit; (305) Infrared ray emitting unit; (307) Program storage unit; (309) Content storage unit; (311-1) First image display unit; (311-3) Second image display unit; (311-5) Audio output unit; (313) Content/program update unit; (315) Control linking unit; (317) Control command receiving unit; (319) Control unit; (AA) Emission control

Description

Content providing device through automatic puzzle recognition {CONTENTS PROVIDING APPARATUS USING AUTO PUZZLE RECOGNITION}

The present invention relates to a device for providing content through puzzle recognition, and specifically, by recognizing image codes displayed on one surface of puzzle blocks by using a camera sensor, it is possible to determine whether the puzzle is completed and provide various feedback to the user. It relates to a device for providing content through puzzle recognition.

Generally, a puzzle toy can fit a puzzle board made of paper or plastic with a number of puzzle blocks (or puzzle pieces, puzzle pieces, hereinafter referred to as "puzzle blocks") in the same way as the images given on the puzzle board. Toys are provided so that.

Such puzzle toys can be provided for leisure for adults and as a means of education for children or toddlers.

On the other hand, as the electronic technology has developed, some techniques have been disclosed in which the puzzle toy can be automatically determined by integrating the electronic technology with the puzzle toy.

Republic of Korea Patent No. 1005344 (Puzzle Toys), a plurality of lattice is formed on the back of each puzzle block constituting the puzzle set, and in order to determine whether the puzzle set assembling the puzzle toy, the light emitting element consisting of a pair and Puzzle sets by arranging a plurality of light receiving elements in a main body at a fixed position and judging the colors from a plurality of grids of puzzle blocks placed on the main body using light emitting elements and light receiving elements, and determining a unique number (ID) of a binary number from them. The content of determining whether is completed as a whole is disclosed.

Such Patent No. 1005344 contains some advanced contents to determine the completion, but there are some problems. For example, the puzzle blocks included in the puzzle set must have a plurality of lattices formed on the back side thereof to match the positions of the paired light emitting elements and the light receiving elements. There is a problem in that various types or forms of puzzle sets cannot be configured or have a separate main body in order to be configured.

Accordingly, in order to construct a new type of puzzle set, Patent No. 1005344 further needs a main body in which a pair of light-emitting elements and a light-receiving element are arranged according to a new type of arrangement, and the number of puzzle blocks included in the puzzle set is increased. As the number increases, the number of such light-emitting elements and light-receiving elements also increases, and thus the cost thereof increases.

On the other hand, the puzzle toy is also used to educate an infant or child, the content of the puzzle block that is used by the infant or child or the puzzle set composed of the puzzle block after the completion of the puzzle set or the puzzle set It would be more useful from an educational point of view if it could be provided during its completion.

Therefore, there is a need for a content providing device through puzzle recognition to solve (resolve) these problems and to increase the effectiveness of education for infants and children.

The present invention has been made to solve the above problems, to provide a content providing apparatus through the puzzle recognition to determine whether the puzzle set is completed regardless of the size and shape of the puzzle block included in the puzzle set. The purpose is.

Another object of the present invention is to provide an apparatus for providing contents through puzzle recognition, which enables to determine whether to complete various kinds or types of puzzle sets at an economical cost.

Another object of the present invention is to provide a device for providing contents through puzzle recognition, which enables the user to provide various kinds of feedback when assembling the puzzle set.

In another aspect, the present invention, by providing the information or feedback associated with the puzzle set or puzzle block to the user at the time of assembly of the puzzle set to provide content through the puzzle recognition to improve the educational effect to children or toddlers Another object is to provide a device.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

In order to achieve the above object, the apparatus for providing contents through puzzle recognition includes: a puzzle block accommodating part capable of locating one or more puzzle blocks and transmitting light and one or more puzzle blocks positioned in the puzzle block accommodating part; And an image sensing unit for capturing an image of the controller and a controller for determining whether to complete assembly of a puzzle set corresponding to one or more puzzle blocks from the captured image.

In addition, the content providing device through the puzzle recognition for achieving the above object, is located in the puzzle block receiving portion including a puzzle block receiving portion and an infrared filter capable of positioning one or more puzzle blocks and transmit light. And an image sensing unit for capturing an infrared image of one or more puzzle blocks, and a control unit for determining feedback to be provided to a user based on the captured infrared image.

In addition, the content providing device through the puzzle recognition for achieving the above object, the puzzle block receiving portion that can position one or more puzzle blocks and transmit light and at least one puzzle block located in the puzzle block receiving portion And an image sensing unit for capturing an image of one surface and a controller for identifying contents corresponding to one or more puzzle blocks from the captured image.

In addition, the content providing apparatus through the puzzle recognition for achieving the above object, the display unit capable of displaying the image associated with the puzzle set and transmit light and transmitted through the display unit at a position below the display unit An image sensing unit for capturing an image of at least one puzzle block back side and a controller for identifying at least one puzzle block from the captured image.

The content providing apparatus according to the present invention as described above has the effect of determining whether the puzzle set is completed regardless of the size and shape of the puzzle blocks included in the puzzle set.

In addition, the content providing apparatus according to the present invention as described above, there is an effect that can determine whether to complete the puzzle set of various types or forms at an economical cost.

In addition, the content providing apparatus according to the present invention as described above, it is possible to provide a variety of feedback to the user when assembling the puzzle set has the effect of allowing the user to interact with each other when assembling the puzzle set.

In addition, the content providing apparatus according to the present invention, to provide information or feedback related to the puzzle set or puzzle block to the user at the time of assembly of the puzzle set to improve the educational effect to children or toddlers It works.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a diagram showing an exemplary appearance of a content providing device and a puzzle set that can be used in the content providing device.
FIG. 2 is an exemplary exploded view showing an exploded view of the main component blocks included in the content providing device.
3 is a block diagram illustrating example hardware blocks included or coupled to a control module.
4 is a diagram illustrating an exemplary functional block diagram for implementing a function provided in a content providing device.
FIG. 5 is a diagram illustrating an embodiment of a puzzle set including an image code to recognize puzzle blocks of the puzzle set.
6 is a diagram showing an exemplary format of an image code included in each puzzle block.
7 to 13 are diagrams illustrating an image form displayed on a puzzle set after a puzzle set to be used in various recognition methods used to determine whether the puzzle set is completed.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described in detail. However, the spirit of the present invention is not limited to the embodiments in which the present invention is presented, and those skilled in the art who understand the spirit of the present invention may easily add other embodiments by adding, changing, deleting or adding components within the scope of the same idea. It may be suggested, but this will also fall within the scope of the spirit of the present invention.

1 illustrates an exemplary appearance of a content providing device 100 and a puzzle set 200 that may be used in the content providing device 100.

Referring to the content providing apparatus 100 in brief with reference to the exemplary appearance of FIG. 1, the content providing apparatus 100 includes a puzzle set 200 that is completed by assembling puzzle blocks 210 such as an infant, a child, or an adult. To the user who wants to construct a space area to place the puzzle block 210 to position the puzzle block 210 so that the puzzle block 210 can be configured to comprise a fully assembled puzzle set 200 ( For example, two-dimensional rectangular or square regions of constant size).

This space area is configured to have a step with the surface case of the content providing device 100 so that the puzzle blocks 210 can be stably fixed without being disturbed out of the case surface.

In addition, the content providing apparatus 100 may identify or recognize the puzzle blocks 210 placed in the space area in which the puzzle blocks 210 may be placed. Accordingly, the puzzle block 210 or the puzzle block 210 may be recognized. Play the contents related to the puzzle set 200, including a video file, a still image file, an audio file, or the like through a display panel included in a content providing device to a user, or through a speaker or earphone. Outputs

In particular, the content providing apparatus 100 uses one or more cameras mounted inside the content providing apparatus 100 to determine whether the puzzle block 210 is placed or the puzzle block 210 is placed at a predetermined correct position. In addition, as the puzzle block 210 is located in the spatial region of the content providing apparatus 100, whether the assembly is completed may be determined as an image from the camera (sensor).

In this way, the entire camera (or part) of the space area in which the puzzle blocks 210 can be placed can be photographed using the camera, and whether the puzzle block 210 exists from the image captured by the camera, and the puzzle block 210 is configured. The puzzle set 200 can be configured to know whether the puzzle set 200 is completed or the like, and to configure the puzzle set 200 composed of various types of puzzle blocks 210.

The content providing apparatus 100 may also include a display panel, on which the border line representing the shape of the image (or each puzzle block 210) corresponding to the puzzle set 200 currently being assembled by the user. An image including the) may be displayed.

In addition, the content providing device 100 may receive a control command from the user and may be controlled according to the control command. For example, the content providing device 100 may receive a specific control command from a user in the form of a button or a touch panel, and for example, power on / off, volume up / down, start playback, stop playback, language selection, Control commands for initial menu return, scenario selection, etc. may be received from the user.

In addition, the content providing device 100 may be provided with various external interfaces to interoperate with various external devices. For example, the content providing device 100 may include an interface for connecting to an external device such as a personal PC or a laptop, a mobile phone, a smartphone, a server, and the like, and may be used in the content providing device 100 through this interface. The content providing device 100 may be controlled by downloading various contents or programs, or by interworking with an external device.

More details about the content providing apparatus 100 will be described with reference to FIGS. 2 to 7.

Meanwhile, the puzzle blocks 210 illustrated in FIG. 1 may be placed in a space area in which the puzzle blocks 210 of the content providing device 100 may be placed, and these puzzle blocks 210 may be assembled by a user. The puzzle set 200 may be configured.

Such a puzzle set 200 is composed of one or more puzzle blocks 210, when the puzzle block 210 is located at all of the predetermined position expected by the content providing device 100, the completion of the puzzle set 200 Let this be done.

The puzzle blocks 210 constituting the puzzle set 200 do not necessarily have the same size or the same shape, and may be configured in various sizes or in various shapes without additional configuration of different hardware components. It can be easily configured according to the various uses of the set 200.

Meanwhile, an image (for example, a part of a specific picture or a part of an alphabet, etc.) that the user can visually identify on a specific surface (front) of the puzzle blocks 210 to induce assembly of the puzzle block 210. On the other side, may include an image code that can be recognized and decoded (identified) by the content providing device 100, and the image code includes a puzzle set for identifying the puzzle set 200 currently being assembled. It may include an identifier of 200 or an identifier of a corresponding puzzle block 210 in the puzzle set 200.

Such image codes are, for example, codes in a promised format, with dots (circular or square) at a number of specific locations in a rectangular form that can be mapped to a binary code to represent an alphabet, or other QR. It may be code encoded in a standardized format such as code.

Of course, such an image code may be displayed together on one surface on which an image is displayed. In this case, the image code may be displayed on a specific region using infrared ink or the like to distinguish the image.

The image code will be described further with reference to FIG. 6.

As described above, the content providing device 100 according to the present invention is not limited to the shape of the puzzle set 200 and the shape and size of the puzzle block 210, but the completion of the puzzle set 200 or the puzzle set ( It is possible to play the content related to the 200 or the puzzle block 210, and thus it is possible to interact with the user and improve the educational effect.

FIG. 2 is an exemplary exploded view illustrating an exploded view of main component blocks included in the content providing apparatus 100.

According to FIG. 2, the content providing device 100 may include a floodlight panel 110 that may transmit light, a first display panel 120 that may display or display an image, etc. to the user, and currently assembled to the user. The user is assembling the second display panel 130 and the second display panel 130 that can display the outer boundary lines of the puzzle blocks 210 so as to know a predetermined position at which each puzzle block 210 for the puzzle set 200 is to be located. One or more camera sensors 140 capable of capturing an image of the back side of the puzzle blocks 210 and a control module 150 capable of controlling or receiving data from the major parts are included as main part blocks. .

More specifically, with respect to the main component blocks, the floodlight panel 110 allows the user to place the puzzle blocks 210, and the backside (for example, the backside of the puzzle block 210 overlying the floodlight panel 110). It is a plate that is made of a transparent material, for example, glass or acrylic material so that the camera sensor 140 can sense the image displayed on the back side), and is coupled to the front case of the content providing device 100 to be exposed to the user.

The floodlight panel 110 may transmit visible light and / or infrared light. For example, an infrared filter may be disposed on a surface of the glass or acrylic material facing the camera sensor 140 to transmit infrared light. It can also be attached.

In addition, on the back surface of the floodlight 110 (for example, a surface facing toward the camera), a plurality of marks that can be captured by the camera sensor 140 are visible light ink (visually identifiable) or It can be printed with infrared ink (not visible to the naked eye). The plurality of marks include the position identification mark 111 used to determine the position of the puzzle block 210 and in addition, the recognizable area of each camera sensor 140 when using the plurality of camera sensors 140. It includes a region separation mark 112 that can be used to distinguish the.

This position identification mark 111 is printed at regular intervals along the outer side of the floodlight panel 110, for example, on two sides (left side and bottom side) or 4 sides (left side) of the floodlight 110. , Right, up, and down sides). The number of sides on which the position identification mark 111 is located may be increased or decreased depending on the number of camera sensors 140 and the divided form of the region, and the number of sides of each puzzle block may be reduced by using the position identification mark 111. Allows you to determine the location or location of a dimension.

Here, the interval of the position identification mark 111 printed on the outer side of the floodlight panel 110 can be used as a resolution for distinguishing the position by the content storage device, in particular the control module 150, and thus The denser the spacing, the higher the resolution of the puzzle block 210 can be determined.

The area separation mark 112 is a mark printed on the outer side of the light transmitting plate 110 together with the position identification mark 111, and may be different in shape from the position identification mark 111.

The area separation mark 112 may be used to combine each captured image into one image when the areas captured by the camera sensor 140 are separated from each other. For example, the plurality of images are separated from the plurality of images (for example, in the case of four images, the upper left side, the lower left side, the upper right side, and the lower right side) on which the region separation mark 112 is displayed. By extracting an image of a designated area (for example, a rectangle, A, B, C, D of FIG. 2) based on the mark 112, and combining the extracted plurality of images based on this area separation mark 112 You can create one image.

The second display panel 130 is positioned below the floodlight panel 110 to display an image related to the puzzle set 200. This second display panel 130 is also configured to transmit visible and / or infrared light such that the camera sensor 140 can capture images of the puzzle blocks 210, for example omitting the backlight. It may be a liquid crystal display (LCD) or an electronic ink panel.

The second display panel 130 is connected to the control module 150 and, according to the control of the control module 150, for example, the puzzle blocks 210 of the puzzle set 200 currently enjoyed by the user must be placed. A boundary line (or an outline) may be displayed so as to know a position to be performed.

Here, the floodlight panel 110 and the second display panel 130 do not necessarily have to be arranged together, for example, when the second display panel 130 is included in the content providing device 100, the floodlight is provided. The plate 110 may be omitted, and the second display panel 130 may also function as a floodlight plate. In this case, the position identification mark 111 or the area separation mark 112 may be printed on the rear surface of the second display panel 130 (the surface facing the camera sensor 140), and the second display panel 130 may be a floodlight plate. It may serve as a plate to place the puzzle blocks 210 in place of the (110).

Camera sensor 140 captures an image received through a lens (eg, a wide-angle optical lens having a wide viewing angle), such as a CMOS or CCD sensor. The camera sensor 140 may capture an image of the puzzle blocks 210 placed on the floodlight panel 110 or the second display panel 130, and the captured image is transmitted to the control module 150.

Here, the number of cameras that may be included in the content providing apparatus 100 may be one or more. For example, the number of cameras may be considered in consideration of the side thickness of the content providing apparatus 100 and the size of the puzzle set 200 to be accommodated. Dogs can be deployed.

For example, if there are four camera sensors 140 (only two are shown in FIG. 2 and two are not displayed), each camera sensor 140 is assigned to a designated spatial area (A, B of FIG. 2). , C and D) are fixedly positioned to capture the image, and capture and transmit the image to the control module 150 according to the control of the control module 150.

As such, by using the plurality of camera sensors 140, it is possible to reduce the thickness of the content providing apparatus 100 and to handle the puzzle set 200 having a larger size.

Here, when the camera sensor 140 captures an image, the content providing device 100 may further include a light source to increase the contrast of the captured image. The light source may be a light emitting diode, which is directed toward the floodlight panel 110 or the second display panel 130 at a position adjacent to the position where the camera sensor 140 is fixed, or the floodlight panel 110 or the second light source. The light source may be disposed on the floodlight panel 110 or the second display panel 130 in a horizontal direction on the side of the display panel 130. When placed on the side can reduce the visual inconvenience to the user according to the light source.

Such a light source may be a visible light and / or an infrared light source, for example, when using an infrared light source may further eliminate visual inconvenience to the user.

In addition, the camera sensor 140 may be attached to the lens of the camera sensor 140 further includes an infrared filter to receive only the image of the infrared band. Therefore, when the infrared filter is used, the image captured by the camera sensor 140 may obtain an image excluding the visible light band or only an image of the infrared band.

Although FIG. 2 illustrates that the camera sensor 140 is positioned below the floodlight panel 110 or the second display panel 130, the camera sensor 140 need not be limited thereto. It may be installed outside the case of the providing apparatus 100 to capture an image in a direction in which the user views the floodlight panel 110 of the content providing apparatus 100 (above). In this case, for example, infrared ink may be used to print an image code for identifying the puzzle blocks 210 on the front surface (with the image for assembly) of the puzzle blocks 210.

The first display panel 120 is connected to the control module 150 to display an image according to the control of the control module 150. The first display panel 120 may further display an image of the entire puzzle set 200 that the user is currently assembling or boundary lines between the puzzle blocks 210 required to assemble the puzzle set 200 to the image. Can be.

The first display panel 120 may be LCD or light emitting diode (LED) panels. In addition, the surface of the first display panel 120 may further include a touch panel for receiving a touch from the user, and the touch panel may select a menu displayed on the first display panel 120 and accordingly It is possible to provide a control command from the user to the control module 150.

The first display panel 120 is disposed on the surface of the case of the content providing device 100 so that the user can see it. For example, the first display panel 120 is disposed at a position separated from the floodlight panel or the second display panel 130 (see FIG. 1). Can be

The control module 150 is connected to another main component block using, for example, a wired signal line and a connector, and receives data such as an image or a control command captured from each main component block, An image to be displayed on the first display panel 120 or the second display panel 130 is generated and provided (or provided), and the camera sensor 140 or the light emitting diode is controlled to operate.

The control module 150 may take the form of a board, may be comprised of one or more chipsets within the board, and disposed at, for example, a position below the first display panel 120 in the content providing device 100. Can be.

An exemplary hardware block diagram related to the control module 150 will be described in greater detail with reference to FIG. 3.

3 is a block diagram illustrating an example hardware block included in or coupled to the control module 150. According to FIG. 3, the control module 150 includes a nonvolatile memory 151, a volatile memory 152, a hard disk 153, an external communication interface 154, an input interface 155, an output interface 156, and a camera. Sensor interface 157, processor 158, and system bus / control bus 159. Some of these blocks may be omitted (eg, volatile memory 152 or hard disk 153) for functional implementation or the like, and similarly, blocks not included may be further included in this control module 150. .

Looking briefly at each of the hardware blocks included in the control module 150, the nonvolatile memory 151 may be, for example, a NAND flash type that does not lose data even when power supply is interrupted. Or NOR flash type memory. The nonvolatile memory 151 may store an initial program at boot time and setting data necessary for using the content providing device 100.

Volatile memory 152 is a temporary memory in which data is lost when power supply is interrupted, for example, a DRAM type memory. The volatile memory 152 temporarily stores a program or data stored in the nonvolatile memory 151 or the hard disk 153 and makes it accessible at a high speed.

The hard disk 153 may store contents related to the puzzle set 200 in the form of a file, and may further store various programs to be used in the content providing apparatus 100. The content stored in the hard disk 153 may include a compressed video file and a compressed music file. In addition, the content stored in the hard disk 153 may be related to the puzzle set 200 or the puzzle block 210 included in the puzzle set 200. It may include a content mapping table indicating a corresponding relationship between the content (file) to be reproduced.

In addition, a scenario file indicating the assembling order of the series (plural) puzzle sets 200 may be further included according to a preset order. Various data or contents stored in the hard disk 153 may be constructed through a database, for example.

The external communication interface 154 is a chipset or connector (connection jack) required to provide, for example, a universal serial bus (USB), Wi-Fi (WiFi) and / or Bluetooth interface as an interface for communicating with an external device. ) And an antenna including an antenna.

Through such an external communication interface 154, various contents such as a hard disk 153, a memory 151, 152 or the like in conjunction with an external device such as a smart phone, a personal computer (PC), a notebook, a set-top box or an external server, A program may be stored, and in addition, the external device may perform some of the functions performed by the content providing device 100 in association with the external device.

On the other hand, when the external communication interface 154 includes a USB interface, the content providing device 100 further includes a USB memory connected through the USB interface, and various programs included in the hard disk 153 in the USB memory. It may also be configured to store content.

The input interface 155 is an interface provided for receiving control commands for power on / off, volume up / down, playback start, playback stop, language selection, initial menu return, scenario selection, and the like, for example. For example, it may include one or more buttons, a pressure sensitive or corrective touch panel, and the like, and may further include a connector or a buffer for providing the control command to the processor 158.

The output interface 156 is an interface for outputting feedback such as a response or a result according to the operation of the content providing apparatus 100 to the user. The output interface 156 may include a block for changing to a signal format used in the first display panel 120 or the second display panel 130, in addition to the first display panel 120 or the second display. The panel 130 may further include a connector for outputting the changed signal.

In addition, the output interface 156 may include a speaker for allowing a user to listen to audio, an audio amplifier for amplifying an audio signal with earphones, an e-phone (headphone) terminal connected to the audio amplifier, and a user for recognizing vibration. The display device may further include a light emitting diode capable of notifying a state of the vibrating element or the content providing device 100.

In addition, the output interface 156 may include a control signal for turning on / off a light source (for example, a light emitting diode) that may be used for the camera sensor 140 or the image capturing of the camera sensor 140. 140 or a light source, or may further include a connection terminal (for a standard video, composite video output signal) for outputting a video signal and connecting to an external TV.

The camera sensor interface 157 enables to receive an image signal from the camera sensor 140 and pass it to the processor 158. The camera sensor interface 157 may be a specific analog video signal, a digital video signal in a frame unit, or a series of digital data in each frame unit.

The processor 158 uses contents and programs stored in the nonvolatile memory 151 or the hard disk 153 or the like based on the control command or the image received from the input interface 155 or the camera sensor interface 157. The hardware blocks are controlled and the result of the execution of the program is output through the output interface 156.

The processor 158 may be configured in the form of, for example, a chipset having one or more execution units therein and allowing the execution unit to load and execute a program into the volatile memory 152.

Various functions that may be performed within the processor 158 will be described in greater detail below with reference to FIG. 4.

The system bus / control bus 159 is a bus that connects each hardware block with signal lines to transmit or receive data or control data to other blocks. Such a bus may be a one-to-one bus per block or a bus connected between a plurality of shared blocks.

The system bus / control bus 159 may be a serial bus or a parallel bus centered on the processor 158, or a single or multiple signal buses configured as outputs or inputs to a general purpose input output (GPIO).

In the above, the hardware blocks have been described. Of course, in addition to the exemplary hardware blocks in FIG. 3, other blocks may be further included, and for example, may further include specialized hardware logic used for decoding a compressed video or audio file.

In addition, the content providing device 100 may include a power supply circuit for supplying power to each hardware block, and may further include a power terminal for receiving AC power or DC power to the power supply circuit.

4 is a diagram illustrating an exemplary functional block diagram for implementing a function provided by the content providing apparatus 100. This functional block diagram of FIG. 4 may be implemented using or including the major component blocks of FIG. 2 and exemplary hardware blocks such as FIG. 3.

Here, the reference numerals of the functional blocks included in the content providing apparatus 100 are allocated to the 300th number to distinguish them from the hardware blocks.

According to FIG. 4, the content providing device 100 includes a puzzle block receiving unit 301, an image sensing unit 303, an (infrared) light emitting unit 305, a program storage unit 307, and a content storage unit 309. An output unit 311, a content / program update unit 313, a control linkage unit 315, a control command receiver 317, and a controller 319 are included. Some of these blocks may be omitted according to the implementation, and functional blocks not included in FIG. 4 may be further included in the content providing device 100.

Looking at each of the functional blocks in detail, the puzzle block receiver 301 allows one or more puzzle blocks 210 to be positioned and from the image displayed on the back side (front or back) of the puzzle block 210. It allows transmission of reflected (or colored) light.

The puzzle block accommodating part 301 is located on the floodlight panel 110 and / or the second display panel 130, for example, and the front case of the content providing device 100 and the floodlight panel 110 and And / or have a step between the second display panel 130 so as not to be disturbed when the puzzle blocks 210 are positioned.

The puzzle block accommodating part 301 may further include a mark displayed on at least two sides of the rear surface (front side or back side) of the floodlight panel 110 and / or the second display panel 130. Such a mark may be a position identification mark 111 with a constant spacing or a region separation mark 112 to be used for extraction and combining of an image of a constant region.

Since the position identification mark 111 is comprised so that it may have a fixed space here, this position identification mark 111 is recognized from the captured image, and the position (region) of the specific puzzle block 210 is used using this mark. To make a decision.

The image sensing unit 303 may include one or more camera sensors 140, and / or the back surface of the one or more puzzle blocks 210 located in the puzzle block receiving unit 301 at regular intervals and / or under the control of the controller 319. Preferably captures an image of the back side, on which some images of the puzzle set 200 are not displayed.

The image captured by the image sensing unit 303 may be composed of one or a plurality of images periodically according to the number of cameras.

In addition, the image sensing unit 303 may be configured to include an infrared filter in the lens of the camera to capture only the infrared image, and the image captured by the image sensing unit 303 may be configured to cover the floodlight panel 110. It may be an image of the puzzle blocks 210 transmitted through and / or through the second display panel 130.

The image from the image sensing unit 303 may be temporarily stored in a memory or the like in units of image frames.

The infrared light emitting unit 305 is periodically and / or under the control of the control unit 319 to easily identify the infrared image of the backside of the displayed (printed) puzzle block 210 using infrared ink or the like. Emits.

The infrared light emitting unit 305 emits light fixed at a position adjacent to the same plane as the camera sensor 140 or at a position below the floodlight panel 110 or below the second display panel 130 in a horizontal direction. It may be configured in the form of a diode. The infrared light emitting unit 305 may be replaced to emit white visible light instead of emitting infrared light according to the type of ink or the like (infrared or visible light ink) printed on the puzzle block 210.

The program storage unit 307 stores various programs that can be used in the content providing apparatus 100, and uses various types of programs such as the nonvolatile memory 151, the hard disk 153, and / or the USB memory. Program can be saved.

The programs stored in the program storage unit 307 include, for example, a setting program for setting a program configuration of the content providing apparatus 100, a program which is different according to the set configuration, and a control command. A control program for controlling the control, a puzzle identification program for identifying the puzzle block 210 from the image from the image sensing unit 303 or determining whether the puzzle set 200 is completed or not, to play a video or an audio file. A database program for playing a file in a video format or an audio format, and a content player program for generating and outputting an image corresponding to the puzzle set 200. If necessary, a database program for accessing and modifying the database. And the like may be further included.

The content storage unit 309 stores a plurality of video files or audio files associated with the puzzle set 200 or the puzzle block 210, and stores a puzzle image representing an image of the puzzle set 200. In addition, the content storage unit 309 may further include a content mapping table indicating a correspondence relationship between the stored video file, audio file or puzzle image and the puzzle set 200 or the puzzle blocks 210 in the puzzle set 200. It may include.

The content mapping table allows identifying the content (video or audio file) corresponding to the puzzle set 200 and / or identifying the content corresponding to the puzzle block 210. Therefore, the control program uses the mapping relationship to reproduce the content of the puzzle block 210 currently identified from the image or the content of the current puzzle set 200 using the reproduction program.

The content mapping table may be, for example, an identifier of the puzzle set 200 that can uniquely identify the puzzle set 200 in the content providing device 100 or a specific puzzle block 210 in the specific puzzle set 200. An identifier of the puzzle block 210 capable of identifying the same, and an identifier of the content (for example, a stored location and a file name, etc.) together with the identifier of the puzzle set 200 or the puzzle block 210. It can be composed of multiple items, including as items (or entries) of. Of course, if the identifier of the puzzle block 210 is unique only in the puzzle set 200, the item may further include the identifier of the puzzle set 200.

The identifier of the puzzle set 200 or the identifier of the puzzle block 210 may be extracted from an image captured by the image sensing unit 303, from which puzzle block 210 or any puzzle set 200 is extracted. To see if it is currently being assembled.

In addition, the content mapping table may further include a predetermined position (area) that is an accurate position to be positioned within the puzzle block receiving unit 301 with respect to each puzzle block 210 of the item, and the predetermined position may include a specific puzzle block. The comparison with the identified position of 210 allows the puzzle block 210 to know whether it has been placed in the correct position or where it should be moved from its current position, and this predetermined position is determined using a position mark (e.g. The position at which the puzzle block 210 should be located may be set by expressing the number (coordinate) of the mark.

The structure of the content mapping table may take various forms, for example, hierarchically for each puzzle set 200 including a plurality of puzzle blocks 210 using a tree structure or a pointer. The content corresponding to the puzzle set 200 and the content corresponding to the puzzle block 210 may be identified accordingly. Alternatively, the content mapping table may take the form of a record used in a database.

In addition, the content storage unit 309 may further include scenario information (file) indicating an assembling order between the plurality of puzzle sets 200 when there are a plurality of puzzle sets 200. For example, the assembly order of the puzzle set 200 can be known and a user can be assembled to be assembled according to a scenario.

The output unit 311 outputs content corresponding to the puzzle set 200 or the puzzle block 210 under the control of the controller 319 or completes the assembly of the puzzle set 200 to the user under the control of the controller 319. For example, an image (or further including a puzzle image) of the boundary line of the puzzle set 200 may be output, or a voice signal may be output to induce assembly completion, and according to the variation of the puzzle block. Or, upon completion, provide the user with audio and / or video type feedback.

The output unit 311 includes a first image display 311-1, a second image display 311-3, and an audio output unit 311-5, and includes a first image display 311-1. ) Includes a first display panel 120 to output a puzzle image of the puzzle set 200 or an image or a video of content corresponding to the puzzle set 200 or the puzzle block 210 and to the puzzle set 200. ) May be further output under the control of the controller 319.

The second image display 311-3 may include the second display panel 130 to output an image of a boundary line of the puzzle set 200 currently being assembled. In this case, only a boundary line for distinguishing and guiding the boundaries between the puzzle blocks 210 constituting the puzzle set 200 may be output to the second display panel 130, so that no image is output except the boundary line. To maintain transparency in most areas of the second display panel 130 (ie, excluding borders) so that the camera sensor 140 positioned below the second display panel 130 can capture an image. May be desirable.

The audio output unit 311-5 includes a speaker or an audio amplifier and outputs the audio sound so that a user can hear the audio sound under the control of the controller 319.

The content / program update unit 313 may include or use a universal serial bus (USB), a Wi-Fi (WiFi), and / or a Bluetooth interface to receive content or a program from an external device and store the received program in the program storage unit 307. And the content is stored in the content storage unit 309.

The control command receiving unit 317 includes or uses the input interface 155 to receive a control command from the user and the received control command is transmitted to the control unit 319.

The controller 319 controls each of the functional blocks based on the control command received from the control command receiver 317. The controller 319 may load and execute a program stored in the program storage unit 307 in an execution unit of the processor 158 to preferably control each functional block.

More specifically, referring to the functions performed by the controller 319, the controller 319 may allow a user to determine a language to be provided by the content providing device 100 by a user using a setting program, and the puzzle set 200. Can be selected at the time of assembly (for example, playback of content corresponding to completion of assembly, reproduction of content corresponding to each puzzle block 210 at assembly, and each puzzle at assembly of each puzzle block 210). Outputting various setting menus that can be selected by the user, such as displaying a predetermined position of the block 210, etc.), and previously listening to the content stored in the content storage unit 309 or repeatedly listening to the content. 311 (especially, the first image display unit 311-1) and various program environments can be set through the control command received through the control command receiving unit 317.

In addition, the controller 319 identifies one or more puzzle blocks 210 from one or more images captured by the image sensing unit 303 using a puzzle identification program or the like, and corresponds to the identified puzzle blocks 210. Determine assembly completion of set 200 and / or identify puzzle blocks 210 that have changed (newly placed or removed) over time in periodically received images.

In addition, the controller 319 may store the content corresponding to the puzzle block 210 changed according to the set program environment or the content corresponding to the puzzle set 200 when the puzzle set 200 is completed using the content mapping table. In operation 309, the content may be reproduced according to the format of the corresponding content using a content reproducing program, or an image corresponding to the puzzle set 200 may be output to the output unit 311. In this process, the controller 319 may further use a database program to access or determine content.

This series of processes can be configured using a control program that can be performed in the control unit 319, specifically, in the control program can be loaded in accordance with the control command received from the user, and also the puzzle set 200 In the case of assembling), the identifier and position of the puzzle block 210 or the position of the puzzle set 200 or the completion of the puzzle set 200 are received from the puzzle identification program, and the identifier or puzzle set of the received puzzle block 210 is received. Identification information (e.g., file name, directory, etc.) for the corresponding content to the content reproducing program to reproduce the corresponding content using the content mapping table according to the environment of the program in which this control program is set using the identifier of 200. To provide a content playback program to play the content.

Although these programs are referred to as separate program names, they are not limited thereto, and may be structured as one program or various program structures that are obvious to those skilled in the art, and some of these programs may perform this function. Functions may be distributed to such hardware logic.

The main functions performed by the controller 319 will be described in more detail.

The control interlocking unit 315 interlocks with an external device through the external communication interface 154 to allow the external device to perform some of the functions performed by the controller 319. Accordingly, the external device may receive the captured image from the image sensing unit 303 through the external communication interface 154 and identify or complete the puzzle block 210 or the puzzle set 200 that is changed from the received image. As a result, the corresponding content may be identified, and the corresponding content may be transmitted to the content providing device 100 through the external communication interface 154, or the external device may directly play the corresponding content.

Alternatively, the external device may receive a result performed by the controller 319 and correspondingly perform an application of the external device to provide a specialized service to the user. For example, the external device may perform a puzzle set that is performed by the user. Information such as the identifier of 200 or completion is transmitted to a central server connected to the Internet so that the central server can manage the usage history of the user who uses the content providing device 100 or provide various services to the user accordingly. do.

Hereinafter, the main functions performed by the controller 319 will be described in order to suit the flow order according to the assembly of the puzzle set 200.

First, the structure of the puzzle set 200 and the image code displayed on the puzzle set 200 will be described before looking at the main functions performed by the controller 319.

FIG. 5 is a diagram illustrating an embodiment of a puzzle set 200 including an image code to recognize puzzle blocks 210 of the puzzle set 200. As can be seen in FIG. 5, one puzzle set 200 includes a plurality of separate puzzle blocks 210 and is completed when all the puzzle blocks 210 are assembled in a predetermined position.

In order to identify each puzzle block 210 from the captured image through the image sensing unit 303 or to determine whether the puzzle set 200 is completed, each puzzle block 210 includes an image code. .

This image code includes a puzzle block identifier that can identify each puzzle block 210 with another puzzle block 210, and the image code also includes a corresponding puzzle set that includes the puzzle block 210 ( And a puzzle set identifier that is an identifier for 200).

In addition, the image code may further include information on the total number of puzzle blocks 210 included in the puzzle set 200. This total number information allows the user to easily know the total number of puzzle blocks 210 to be assembled of the puzzle set 200 from the image code from one puzzle block 210.

Such image code may be printed on the puzzle block 210, for example, by printing with a predetermined color ink or infrared ink that is not recognized by the user, and the image code of the puzzle block 210 may be displayed as a puzzle block ( It is displayed on one side of 210 and preferably on the back side which is not visible to the user at the time of assembly. Of course, it may be displayed on the front of the puzzle block 210, in which case the image sensing unit 303 is configured to capture such an image outside or on the case of the content providing device 100.

As can be seen in FIG. 5, each puzzle block 210 each includes an image code. This image code is displayed at a predetermined location for each puzzle block 210. This designated position does not need to be fixed and may be displayed at different positions for each puzzle block 210. Therefore, the positional information (in the form of coordinate information or in the form of rectangular area information) of each puzzle block 210 in the puzzle set 200 for each such image code can be stored in advance, and the puzzle of the content mapping table can be stored in advance. It may be stored as information about block 210.

The configuration form of the image code may be one of various formats, for example, may be a QR code or a barcode. Alternatively, the image code may be in the form of a predetermined format that may be recognized and decoded by the controller 319.

The completed puzzle set 200 may be captured by the image sensing unit 303, and the captured image may include image codes displayed on one surface of the plurality of puzzle blocks 210. In addition, a plurality of marks (position identification mark 111 or region separation mark 112) may be included.

Here, the mark is described as being displayed on the floodlight panel 110 or the second display panel 130, but is not necessarily limited thereto. For example, when the puzzle block 210 is constructed and the puzzle set 200 is assembled, It may be displayed along the outline of the puzzle set 200, which may need to be assembled first as an edge, and may further include an identifier of the puzzle set 200 in the outline. In this case, the inclusion of the puzzle set identifier may be omitted in the image code of each puzzle block 210.

Such a configuration may of course be configured in consideration of the difficulty of each puzzle set 200 or the size of the puzzle block, so that various puzzle sets 200 may be easily added to the content providing device 100 without any additional configuration. It is possible to provide a resolution for identifying the position so that the performance load of the controller 319 can be variably configured according to the difficulty (resolution) of the puzzle set 200.

This position identification mark 111 may be used to determine the position of the image code included in each puzzle block 210, that is, the puzzle block 210, for example, the position (region) of the identified image code. (For example, two-dimensional coordinates or two-dimensional coordinate regions), the number of the position identification marks 111 of two or more outer sides of which the position identification marks 111 are displayed from the specific position identification marks 111 (for example, By counting the first position identification mark 111 on the left side, the position (area) of the corresponding image code can be determined.

As a result, the position identification mark 111 divides the two-dimensional space region of the puzzle block accommodating portion 301 at regular intervals on the horizontal axis and the vertical axis so that the two-dimensional space region can be expressed as coordinates in two dimensions.

6 is a diagram illustrating an exemplary format of an image code included in each puzzle block 210.

6A illustrates a 15-bit display area for displaying an identifier of a puzzle set 200 in which the puzzle block 210 is included as a format of the first exemplary image code, and included in the puzzle set 200. A 5-bit display area for indicating the total number of puzzle blocks 210 and a 5-bit puzzle block identifier of this puzzle block 210 in the puzzle set 200, and used to identify an image code It includes for example five anchor marks arranged along the periphery.

This anchor mark can be used to identify the presence or absence of an image code, and in addition can be used to determine the position (area) in the puzzle block receiving portion 301 of the image code and also the image code. It is used as a reference point for decoding (identifying) each identifier within. That is, it can be determined that the image code exists by identifying all of these anchor marks having a constant distance (distance), and the center (middle) of the image code from the position from the corresponding position identification marks 111 of this anchor mark. The location or location area (in the form of a rectangle) can be determined.

Each mark (dot) displayed in the image code may take various forms, for example, a square form or a circular form.

6 (b) shows another exemplary image code format, which includes a 24-bit puzzle set identifier, a total number of 6-bit puzzle blocks 210 and a 6-bit puzzle block identifier. Doing.

As can be seen in (a) and (b) of FIG. 6, each of these marks or each bit must be identifiable through image recognition, which is done via the position identification mark 111. That is, the specific mark or bit is aligned (or aligned) on the image with the position identification mark 111 and each is mapped to the specific position. Therefore, the size of this mark or bit may vary depending on the resolution, which is the interval between the position identification marks 111.

FIG. 6C illustrates an image code of a specific puzzle block 210 displayed according to the format of FIG. 6A. As can be seen here, the 15-bit puzzle set identifier can be represented as a 15-bit binary number, and the puzzle block identifier is used to identify the puzzle block 210 within the puzzle set 200, and this identifier is an example. For example, it may be preset in the form of a serial number and stored in advance in the content storage unit 309 or the like.

As can be seen in Figure 6, it is possible to identify each puzzle block 210 and the puzzle set 200 by using the image code, the configuration of the various forms of the puzzle set 200 and this puzzle set 200 Various types of configurations of the puzzle block 210 in the apparatus can be configured, and each puzzle set 200 can be easily identified.

Based on the structure of the puzzle set 200 or the puzzle block 210, the main functions performed by the controller 319 will be described again. In the case of overlapping with the foregoing description, the description thereof will be omitted to some extent.

(1) Program Environment Setting

The controller 319 sets a program environment to be set in the content providing device 100 under the control of the user. For example, it is possible to select a language, and to set up a scenario (for example, learning an alphabet puzzle, learning a fairy tale, etc.) for assembling a plurality of puzzle sets 200 classified according to difficulty in a sequence, or Allows the user to select a particular puzzle set 200.

Of course, the user may place a specific puzzle block 210 in the puzzle block receiving unit 301 to assemble an arbitrary puzzle set 200 without setting a scenario or setting the puzzle set 200. The identifier of the puzzle set 200 may be identified using the image code of the puzzle block 210 which is placed at, and the image, video, or audio file corresponding to the puzzle set 200 may be output through the output unit 311. have.

The scenario may be configured to have a predetermined assembling order and may first display an image of the puzzle set 200 through the first image display 311-1 in the assembling order.

(2) Determination of the variation of the puzzle block 210

After the environment setting of the program or according to a preset program environment setting, the user prepares a puzzle set 200 including a plurality of puzzle blocks 210, and the user sets the one of the first image display unit 311-1 to one of them. By using an image displayed through or by looking at a picture made of a separate paper, for example, a particular puzzle block 210 is placed in the puzzle block receiving unit 301.

Accordingly, the controller 319 periodically captures an image including the image codes from the puzzle block receiver 301 from the image sensing unit 303 periodically (for example, once every two seconds, etc.), and from there, The variation of the puzzle block 210 is determined.

That is, the controller 319 may identify puzzle blocks 210 included in the image frame, that is, puzzle block identifiers of the puzzle block 210, from the series of image frames captured by the image sensing unit 303. In addition, the puzzle block 210 determines the location (area) of each puzzle block 210 and determines the identifier and location (area) information of the determined puzzle blocks 210 for each image frame. You can decide.

The determination of these puzzle blocks 210 or the determination of the identifier and the determination of the position (area) are performed by scanning from left to right and from top to bottom in the two-dimensional space on the image frame and identifying the anchor mark of the image code. This is done by determining the position using the position identification mark 111 from the mark and reading the code in the spatial area designated on the basis of the anchor mark.

The image frame may be a frame composed of one image received from one camera sensor 140 or one image composed (combined) from a plurality of images received from multiple camera sensors 140.

In the case of an image frame composed of a plurality of images, the plurality of images may be configured as one image frame by using an area identification mark. That is, each image includes a region identification mark, and for example, extracts (cuts) an image region of a rectangular region from each image, which has a boundary line of each region identification mark, and extracts an image of the extracted image region adjacently. In combination with the region, one image frame can be constructed.

For example, in the case of composing one image frame from four images, each camera sensor 140 captures the allocated area (upper left, lower left, upper right, lower right) and the captured image on the boundary surface. Overlap with other images, including area identification marks. The rectangular region allocated to each camera sensor 140 may be extracted based on the region identification mark, and the extracted image may be combined according to the assigned position to generate one image frame.

In addition, the controller 319 may periodically generate a series of information (for example, an identifier of a puzzle block 210 in a previous image frame and a puzzle block 210 in a current image frame) at a current time point. It is possible to determine the changed puzzle block 210 of.

The changed puzzle block 210 includes the identifier and location (area) information of the puzzle block 210, and accordingly, the controller 319 uses the identifier of the newly placed (or removed) puzzle block 210. To provide feedback such as audio or video.

Such feedback may be provided using an identifier of the puzzle block 210 and / or a puzzle set identifier included in the puzzle block 210, and content corresponding to the puzzle set 200 may be displayed using a content mapping table. Loaded from the storage unit 309, played back or executed and outputted to the output unit 311, or the content corresponding to the puzzle block 210 (for example, if the puzzle block 210 is related to an alphabet, an image representing the alphabet or Audio) from the content storage unit 309 to be played or executed.

If the newly placed puzzle block 210 is the first puzzle block 210 placed in the puzzle block receiving unit 301, the puzzle set identifier included in the image code is used to determine which puzzle set 200 is included and The corresponding content of the content storage unit 309 representing a video or guide phrase, a guide comment, or an audio or puzzle image of the puzzle set 200 corresponding to the puzzle set 200 may be loaded and output through the output unit 311. Can be.

(3) Provide feedback according to the position of the puzzle block 210

In addition, the controller 319 may provide the user with immediate feedback (eg, visual and / or audio feedback) according to the determined position with respect to the changed puzzle block 210 or the placed puzzle block 210. have. For example, a puzzle block identifier (or, in addition, a puzzle set identifier) may be used to compare a predetermined position in the content mapping table with a position at which the puzzle block 210 that has actually changed (or lies) is currently placed.

From this, the control unit 319 may directly provide the feedback of the audio or video through the output unit 311 for guiding the currently changed puzzle block 210 to the predetermined position.

For example, the controller 319 may be configured in the puzzle image of the puzzle set 200 displayed on the first image display 311-1 to highlight (highlight) a predetermined position at which the puzzle block 210 that is currently changed is to be placed. The area of the puzzle block 210 representing the area corresponding to the predetermined position may be changed to an accent color or the accent color to emphasize the boundary line of the puzzle block 210 of the predetermined position.

Alternatively, when the controller 319 further includes a second image display 311-3, the controller 319 corresponds to a predetermined position among the boundary lines of the puzzle set 200 displayed on the second image display 311-3. The feedback may be provided by emphasizing (eg, thickening) the boundary of the puzzle block 210.

In addition, the controller 319 may output voice announcements and the like to the audio output unit 311-5, and output voice feedback for guiding a direction to a predetermined location according to the selected language, for example. can do.

This feedback, when the assembly of the puzzle set 200 is placed in the wrong position to the user can be easily informed to the problem to the user to reduce some of the user's mistakes.

(4) Providing boundary marks of puzzle set 200

In addition, the controller 319 identifies the puzzle set 200 by recognition of the puzzle block 210 or according to a predetermined scenario, and the user identifies when the puzzle blocks 210 included in the puzzle set 200 are completed. The boundary line between the puzzle blocks 210 may be outputted together with the image or separately through the output unit 311.

For example, the controller 319 further displays the boundary of the puzzle set 200 together with the puzzle image of the puzzle set 200 on the first image display 311-1, or the second image display 311-3. When 3) is included in the content providing device 100, the second image display 311-3 may be configured to display only a boundary of the puzzle set 200.

(5) Determination of Completion of Puzzle Set 200

The controller 319 may also determine whether the puzzle set 200 is completed as the puzzle set 200 is assembled. Methods of determining the completion of the puzzle set 200 may be various, and an exemplary method of determining the completion using the image will be described with reference to FIGS. 7 to 13.

7 to 13 are diagrams illustrating an image form displayed on the puzzle set 200 after the puzzle set 200 to be used for various recognition methods used to determine whether the puzzle set 200 is completed. 7 shows that the closed curves are printed on the back surfaces of the puzzle blocks 210 constituting the puzzle set 200 with ink (infrared ink or visible light ink, etc.), and the controller 319 recognizes the connected closed curves. Completion of the assembly can be determined.

In this manner, the lines constituting the closed curve of each puzzle block 210 may be printed on the portion other than the area where the image code is printed.

Accordingly, the controller 319 identifies a part of the closed curve in one selected first puzzle block 210 and sequentially recognizes a part of the closed curve of another puzzle block 210 adjacent along an extension line of the closed curve part. Whether it is connected to the selected puzzle block 210 may be determined. The closed curves may be printed on the puzzle blocks 210 of the puzzle set 200 so that the closed curves are not formed in any case except the completion of the assembly.

8 is a method in which the control unit 319 can determine whether or not the completion by determining a plurality of closed curves between the adjacent puzzle block (210). As can be seen in FIG. 8, it can be seen that there is a small closed curve along the boundary of four adjacent puzzle blocks 210, so in this way a closed curve can exist with the image code, and the four adjacent Whether there is a closed curve for each of the puzzle blocks 210 and whether there is a specified number of closed curves may be determined whether the puzzle is completed.

9 shows that when the puzzle set 200 is completed, the entire surface of the puzzle block 210 is printed in a specific color (infrared ink or colored ink) so as to form an image of a certain shape. In this manner, the image code may be included, for example, the area in which the image code is printed may be printed together with the image code by the controller 319 considering that the area is printed in the specific color.

Thus, in this method, the entire image frame can be scanned to determine the shape of a particular color on the back of the puzzle set 200 and compared with the predetermined image shape to easily determine whether to complete.

FIG. 10 shows that a figure image is printed with a specific ink in an adjacent boundary area of the puzzle block 210 similar to FIG. 8. The controller 319 recognizes the figure image of the corresponding boundary area, and may determine that all figures are completed when they are fitted without defects or gaps. The shape of the figure can be various, such as a circle, a square.

Fig. 11 shows that the figure image is printed with ink (colored or infrared ink) only in the area of the specific size in the bonded portion of each puzzle block. The controller 319 recognizes the corresponding figure image, and may determine that all figures are completed when they are fitted without defects or gaps. The shape of the figure can be various, such as a circle, a square.

12 assumes that the puzzle is completed using the image code of each puzzle block. The controller 319 may determine whether the puzzle is completed by recognizing the image code of the puzzle block and checking whether there are all puzzle pieces constituting the puzzle set. For example, in embodiments in which the image code includes a puzzle set identifier, a puzzle block identifier, and a total number of puzzle blocks, the puzzle is completed when the puzzle set identifiers are all the same and a puzzle block corresponding to the total number of puzzle blocks is recognized. Or, if the puzzle set identifiers are all the same and the puzzle block identifiers are all from 1 to the number corresponding to the total number of puzzle blocks, it may be determined that the puzzle is completed.

FIG. 13 shows that a line image of a specific ink is printed along the boundary line of the puzzle block 210. When the puzzle block 210 is normally placed, the line images printed on the puzzle block 210 are overlaid and displayed. Accordingly, the control unit 319 determines whether or not the completion of the entire puzzle set 200 is completed or not whether the thickness of the line image printed along the boundary line of the puzzle block 210 is equal to or the same as the predetermined thickness (thickness due to overlapping). You can check whether there is no gap between the images to determine if it is complete.

As described above with reference to FIGS. 7 to 13, it is possible to determine whether to complete the assembly of the puzzle set 200 through image recognition in various ways. This method may be configured irrespective of the recognition of the image code, but may be preferably configured to determine whether the image code is completed in the same state.

By the recognition of the completion of the puzzle set 200, it is possible to easily determine whether or not the completion of the puzzle set 200 without restriction of the shape or configuration of the puzzle set 200, the size or shape of the puzzle block 210.

(6) playback of content for puzzle set 200

When the puzzle set 200 is completed and the control unit 319 determines, the content storage unit 309 loads the content corresponding to the puzzle set 200 and outputted according to the completion of the puzzle set 200. The content is reproduced and output through the output unit 311.

The reproduced content here may not necessarily be the same as the content corresponding to the puzzle set 200 in "(2) Determination of the fluctuation of the puzzle block 210", and may be different. For example, a video for realizing a fairy tale as a completion, a video or a guide for celebrating a completion may be output through the output unit 311.

In addition, when the controller 319 determines that it is completed and when assembling a series of puzzle sets 200 according to a scenario, a puzzle corresponding to the puzzle set 200 next to the currently completed puzzle set 200 is assembled. The image, video, or audio may be output through the output unit 311 to induce the assembly of the next puzzle set to the user.

If the control unit 319 determines that it is not completed, the subsequent process including the "(2) determination of the variation of the puzzle block 210" may be optionally repeated.

By reproducing the content according to the completion and the provision of the content afterwards, it is possible to increase the educational effect of the puzzle set to the infants or students and to provide a variety of fun.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings.

100: content providing device 110: floodlight
111: location identification mark 112: area separation mark
120: first display panel 130: second display panel
140: camera sensor 150: control module
151 nonvolatile memory 152 volatile memory
153: hard disk 154: external communication interface
155: input interface 156: output interface
157: camera sensor interface 158: processor
159: System Bus / Control Bus
200: Puzzle Set 210: Puzzle Block
301: puzzle block receiving unit 303: image sensing unit
305: infrared light emitting unit 307: program storage unit
309: content storage unit 311: output unit
311-1: First image display unit 311-3: Second image display unit
311-5: Audio output unit 313: Content / program update unit
315: control interlocking unit 317: control command receiving unit
319: control unit

Claims (20)

As a content providing device through automatic puzzle recognition,
A puzzle block receiver capable of positioning one or more puzzle blocks and transmitting light;
An image sensing unit capturing an image of at least one puzzle block located at the puzzle block receiving unit; And
And a controller configured to determine whether assembly of a puzzle set corresponding to one or more puzzle blocks is completed from the captured image.
Content providing device through automatic puzzle recognition. The method of claim 1,
The puzzle block accommodating part includes a plurality of marks displayed at regular intervals,
The control unit, characterized in that for determining the position of each puzzle block in the puzzle block receiving unit using a plurality of marks displayed on the captured image,
Content providing device through automatic puzzle recognition. The method of claim 1,
One surface of each puzzle block includes an image code for identifying the puzzle block,
The image code comprises an identifier of a corresponding puzzle set and an identifier of each puzzle block in the puzzle set,
Content providing device through automatic puzzle recognition. The method of claim 1,
The controller may determine whether the puzzle set is completed by recognizing one or more closed curves from the captured image.
Content providing device through automatic puzzle recognition. The method of claim 3,
The control unit may determine whether the assembly of the corresponding puzzle set is completed using the identifier of each puzzle block,
Content providing device through automatic puzzle recognition. The method of claim 3,
Further comprising a display unit capable of displaying an image,
The control unit may output an image corresponding to the identifier of the puzzle set to the display unit.
Content providing device through automatic puzzle recognition. The method of claim 1,
The controller, when it is determined that the assembly of the puzzle set is completed, characterized in that for loading the content corresponding to the puzzle set, so that the user can be provided with the content corresponding to the puzzle set,
Content providing device through automatic puzzle recognition. As a content providing device through automatic puzzle recognition,
A puzzle block receiver capable of positioning one or more puzzle blocks and transmitting light;
An image sensing unit including an infrared filter to capture an infrared image of one or more puzzle blocks on the puzzle block receiving unit; And
And a controller configured to determine feedback to be provided to a user based on the captured infrared image.
Content providing device through automatic puzzle recognition. 9. The method of claim 8,
Further comprising; an infrared light emitting unit for emitting infrared light,
The control unit may further determine whether assembly of a puzzle set corresponding to one or more puzzle blocks is completed from an infrared image captured by the emission of the infrared light.
Content providing device through automatic puzzle recognition. As a content providing device through automatic puzzle recognition,
A puzzle block receiver capable of positioning one or more puzzle blocks and transmitting light;
An image sensing unit capturing an image of at least one puzzle block located at the puzzle block receiving unit; And
And a controller that identifies content corresponding to one or more puzzle blocks from the captured image.
Content providing device through automatic puzzle recognition. The method of claim 10,
One surface of each puzzle block includes an image code including a puzzle block identifier for identifying the puzzle block,
The control unit, characterized in that to identify the content using the puzzle block identifier,
Content providing device through automatic puzzle recognition. The method of claim 10,
An output unit for outputting the contents;
The control unit may detect a change in one or more puzzle blocks located in the puzzle block receiving unit, and reproduce and output the content corresponding to the changed puzzle block to the output unit.
Content providing device through automatic puzzle recognition. The method of claim 11,
The image code further includes a puzzle set identifier for identifying a puzzle set including a plurality of puzzle blocks,
The control unit, characterized in that to identify the content by the combination of the puzzle set identifier and the puzzle block identifier,
Content providing device through automatic puzzle recognition. The method of claim 13,
And a content storage unit configured to store a content mapping table representing a plurality of contents and a corresponding relationship between the puzzle block or the puzzle set and the contents.
The control unit, characterized in that to identify the content using the content mapping table,
Content providing device through automatic puzzle recognition. The method of claim 12,
The control unit may determine a position where the variable puzzle block is placed using a plurality of marks included in the puzzle block accommodating unit, compare a predetermined position of the variable puzzle block with the laid position, and according to the comparison result, Characterized by outputting audio or video feedback to an output unit,
Content providing device through automatic puzzle recognition. As a content providing device through automatic puzzle recognition,
A display unit capable of displaying an image associated with the puzzle set and transmitting light;
An image sensing unit for capturing an image of the back side of at least one puzzle block transmitted through the display unit at a position below the display unit; And
And a control unit identifying one or more puzzle blocks from the captured image.
Content providing device through automatic puzzle recognition. The method of claim 16, wherein
It further comprises a puzzle block receiving unit disposed on the display unit for positioning one or more puzzle blocks,
The controller may control the display unit to display a puzzle boundary line of a puzzle set corresponding to the identified puzzle block.
Content providing device through automatic puzzle recognition. 17. The method of claim 16,
The controller may determine a predetermined position at which the identified puzzle block is to be located and change an image output to the display unit according to the determined predetermined position.
Content providing device through automatic puzzle recognition. 19. The method of claim 18,
The modified image indicates the predetermined position of the identified puzzle block,
Content providing device through automatic puzzle recognition. The method according to any one of claims 1, 8, 10 and 17,
The image sensing unit may include a plurality of camera sensors capable of capturing a partial area of the puzzle block receiving unit, respectively.
Content providing device through automatic puzzle recognition.

Images