JP6947763B2 - How to record information in space and its system - Google Patents

Description

The present invention relates to a method of recording information in space and a system thereof.

Tomu Kawada, the inventor of the present application who is the leader of the three AR brothers (the role of the eldest son), usually researches and develops AR (augmented reality) and is familiar with the technology. At the time of image judgment, AR analyzes the image reflected through the camera in dot units and discriminates the object from the contour and feature points, but as Kawada continues his research, the phenomenon is that the object is two-dimensional ... that is, as a surface. I realized that I was just catching it.

For example, when communicating about desks and works of art, it is now possible to convey only two-dimensional information, such as taking pictures and supplementing with sentences. There is no touch or smell of the desk, no outline or depth of the work of art here. In other words, the information is not rich. Kawada thought that if we could add depth to this two dimension, the information would be three-dimensional. Then, this invention starts from the question "How can we realize it?"

For example, even if the invention of "Anywhere Door" that appears in Doraemon is difficult because it requires physical transfer of substances, it is not possible to spatially transfer the three-dimensional substance in front of us as "information". Kawada thought so.

So what should I do?
Kawada comes up with the idea of combining multiple pieces of information and making the means of information transmission multidimensional. However, on the other hand, I also thought that there is a limit to making information three-dimensional by the means of transmission expressed in binary numbers of "010101 ..." on the current Internet. The Internet needs to be mediated by wires, and although the amount of transmission there is estimated to be 1000 times the current amount in 2020, there is no improvement measure other than thickening the fiber cable, and that is the growth of civilization. This is because it is predicted that the future will reach a plateau. Therefore, we considered adopting "light" as the basic transmission means and combining it with "sound", "ultrasonic waves", "color", and the like.

The reason for adopting light as a core technology is that it is compatible with the fact that the current "010101 ..." binary number Internet and other information transmission means can be reproduced by blinking or fluctuating light. In addition to that, there is no need for a line such as the Internet when transmitting information, and it is possible to communicate beyond the standards of OS and terminals. If the light can be exchanged beyond the standard, information such as signage overflowing in the city can be stored in a portable device such as a badge that stores the light, and the information and life log can be stored.

However, the difficulty of combining these is also that a plurality of information transmission means having different properties are linked according to the application. For example, light and sound / ultrasonic waves have different reference velocities, so it is necessary to give them a "common language" and "cooperation rules (patterns)". This is an extremely difficult effort, but Kawada had similar experience in the past when it came to giving different protocols a "common language," and that was alive. Kawada, who used to work for a sewing machine maker, was developing a patented technology that connects a sewing machine that operates in ternary numbers that "stabs, pulls out, and stops", a binary computer, and a human being who controls it. However, the further difficulty this time was that it was necessary to put light and ultrasonic waves into practical use while taking into consideration the interference of sunlight and ultrasonic waves in the living environment. There is also a limitation of smartphone model specifications. In order to clear these restrictions, in addition to inventing an intermediate technology that communicates different protocols, it was important to clear the problem that multiple communication means such as "sound", "ultrasonic wave", and "color" complement each other. It was filtered to work as a target.

Based on the above ideas, Kawada completed one basic invention.

The first aspect of the invention is
It ’s a way to store information in space.
(1) A process in which an information communication terminal device receives spatially mediated transmission information consisting of at least one or a combination of sound, color, light, and ultrasonic waves at its spatial position.
(2) A step of detecting terminal attribute information consisting of at least one or a combination of one or two or more of the time, inclination / direction, and acceleration at which the information communication terminal device receives the space-mediated transmission information.
(3) A process in which the information communication terminal device or the server to which the information communication terminal device is connected specifies the spatial position of the information communication terminal device by decoding the received space-mediated transmission information.
(4) A step in which the information communication terminal device or the server to which the information communication terminal device is connected stores the attribute information of the terminal in association with the spatial position of the specified information communication terminal device.
(5) A step of associating and storing the attribute information of the terminal with an intermittent spatial position by repeating the steps (1) to (4) at a predetermined timing by the information and communication terminal device, and a step of storing the attribute information of the terminal.
Is a method of having.

The second aspect of the present invention is
It is a method of using the information stored in the space by the above method.
The server to which the information communication terminal device is connected stores the attribute information of this information communication terminal device in association with the specified spatial position of the information communication terminal device.
The server determines whether or not to pass the attribute information of the information communication terminal device to the service providing system that provides the service to the information communication terminal device based on the spatial position of the information communication terminal device. And the process to do
A process in which the service providing system receives the attribute information of the information communication terminal device from the server and provides a predetermined service provided by the service providing system based on the spatial position and the attribute information.
Is a method of having.

If this invention is applied to smartphones, compatibility between various OSs such as iOS, Android, and Windows (registered trademark) has been extremely insufficient to have one function, but "Hikari" It can be unified by mediating "sound," "color," and "ultrasonic waves," and it is possible to omit the mass of point cards and the like in wallets, which many people find annoying.

Until now, even with one payment function, each store had to install a dedicated terminal and connect it to the Internet. If this technology permeates, it will be possible to realize a world where consumers can easily make payments with two smartphones.

In addition, ultrasonic waves are also large as one of the depths of information transmission created in this way. Ultrasonic waves can detect the texture and contour of an object. This is similar to how dolphins recognize obstacles and prey with ultrasound. As a result, there is a possibility that rich information transmission that can convey the texture of the desk, the form and hardness of the work of art, etc. will be born in the near future.

Hereinafter, the details of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a schematic configuration diagram showing a system according to an embodiment of the present invention. FIG. 2 is also a schematic diagram showing the operation. Similarly, a schematic configuration diagram showing a system for using spatial position tags.

As mentioned above, the invention completed by the inventor Kawada is
It ’s a way to store information in space.
(1) A process in which an information communication terminal device receives spatially mediated transmission information consisting of at least one or a combination of sound, color, light, and ultrasonic waves at its spatial position.
(2) A step of detecting terminal attribute information consisting of at least one or a combination of one or two or more of the time, inclination / direction, and acceleration at which the information communication terminal device receives the space-mediated transmission information.
(3) A process in which the information communication terminal device or the server to which the information communication terminal device is connected specifies the spatial position of the information communication terminal device by decoding the received space-mediated transmission information.
(4) A step in which the information communication terminal device or the server to which the information communication terminal device is connected stores the attribute information of the terminal in association with the spatial position of the specified information communication terminal device.
(5) A step of associating and storing the attribute information of the terminal with an intermittent spatial position by repeating the steps (1) to (4) at a predetermined timing by the information and communication terminal device, and a step of storing the attribute information of the terminal.
It is a method having.

It is also a method of using the information stored in the space.
(6) The server to which the information communication terminal device is connected stores the attribute information of the information communication terminal device in association with the specified space position of the information communication terminal device.
(7) Whether or not the server passes the attribute information of the information communication terminal device to the service providing system that provides the service to the information communication terminal device based on the spatial position of the information communication terminal device. And the process of deciding
(8) A process in which the service providing system receives the attribute information of the information communication terminal device from the server and provides a predetermined service provided by the service providing system based on the spatial position and the attribute information.
It is a method having.

First, "storing information in space" means virtually leaving footprints (spatial position tags) of information and communication terminal devices in our actual activity space. For example, as shown in FIG. 1, it is assumed that the user 1 holds the information communication terminal device 2 and is located in a certain environment space. In this case, the space-mediated transmission information composed of a combination of sound, light, color, and ultrasonic waves peculiar to the space received by the information communication terminal device 2 is decoded (analyzed), and the space of the information communication terminal device 2 at that time is What and where it is is specified. Then, this information and the attribute information of the information communication terminal device 2 itself are virtually left in the space as the space position tag P.

In this embodiment, the decoding is executed by the spatial location information processing server 3 on the cloud receiving the spatial mediation transmission information from the information communication terminal device 2 and inquiring it to the spatial mediation transmission information DB 4a. Will be done. For example, based on the combination of the peculiar background music and the peculiar lighting in the above space position, the space position P is decoded as "inside the convenience store A" or the like.

Further, in this embodiment, as shown in FIG. 1, the information and communication terminal device 2 oscillates ultrasonic waves U1 and U2 by itself, and detects the reflected ultrasonic waves to obtain a horizontal distance to an adjacent obstacle and a horizontal distance to an adjacent obstacle. It is configured to be able to measure vertical distances. This makes it possible to know, for example, at which position in the convenience store A the information communication terminal device 2 is located. This information is also used to identify the space position P as space-mediated transmission information. Thereby, as shown in FIG. 2, for example, it is possible to decode the specific position of the information communication terminal device 2 in the area A or the area B.

Then, when the user 1 moves as shown by the arrow in FIG. 2, the information received by the information communication terminal device 2 and the decoded information are tagged in the space as intermittent space positions P1 to P7. .. This example shows an example in which it can be seen from the received space-mediated transmission information that the information has moved from the area A to the area B.

As a result, the position of the information communication terminal device 2 in which space at a certain point in time is virtually left as a space position tag P in that space, so that various services can be provided by using the tag P. However, I will discuss it later.

Further, by integrating those tags P, it becomes possible to "define" the atmosphere of the space including the size of the space. That is, the size of the space can be defined by summing up the distances between the moving terminal device 2 and the obstacles in the space at each time point.

Hereinafter, the method of recording information in the space will be described in more detail in the order of the constituent requirements (1) to (5) above.

(1) Regarding "a process in which an information / communication terminal device receives space-mediated transmission information consisting of a combination of at least two or more of sound, color, light, and ultrasonic waves at its spatial position" Here, "information / communication terminal device" (Information and communication terminal device 2) is typically a mobile phone (smartphone), but may be a device that does not have a communication function by itself but can receive and store space-mediated transmission information. For example, a device such as a badge that is attached to the user's chest. By retrieving information from this device later, the spatially mediated transmission information received by this device becomes available.

Further, as the space-mediated transmission information, sound, color, light, ultrasonic waves (and combinations thereof) are mentioned, and this makes it possible to specify and specify the space in which the information communication terminal device 2 exists. It is a thing. For example, in the case of a station, it is the background sound of the surroundings, the lighting itself, its color, and the transmission information of ultrasonic waves beyond the audible range. The space can be specified and defined by these individual pieces of information and their combinations.

In addition, it is possible to receive information at high speed by combining not only one piece but also a plurality of (two or more) space-mediated transmission informations to multiplex. That is, as described above, there is a limit to the amount of communication (communication speed) per unit time in the current transmission means expressed by the binary number of "010101 ..." on the Internet, and in 2020, it is 1000 times the current amount. In order to deal with the amount of information that is expected to be, it is necessary to diversify the means of information transmission.

Further, by using the space-mediated transmission information, a physical line such as the Internet becomes unnecessary, and it is possible to exchange information beyond the standards of OSs and terminals. According to this method, information such as signage overflowing in the city can be received one after another.

Moreover, in the case of space-mediated transmission information, it is necessary to consider the sunlight and the interference of various noises and noises in the living environment. In the present invention, in order to cope with this problem, since a plurality of communication means such as "sound", "ultrasonic wave", and "color" work complementarily, it is easy to filter out those noises. Become.

Further, in this embodiment, the information communication terminal device 2 itself has a built-in ultrasonic wave transmitter, and detects ultrasonic waves reflected in the horizontal direction and the height direction according to the direction of the terminal device 2 to detect an obstacle. It is possible to measure the distance to. The ultrasonic waves received at this time are also included in the space-mediated transmission information. By providing such a function, it is possible to measure the accurate position of the information communication terminal device in the space, and in some cases, it is possible to measure the dimensions of the room.

(2) Regarding "a step of detecting terminal attribute information consisting of at least one or a combination of one or two or more of the time, inclination / direction, and acceleration at which the information communication terminal device receives the space-mediated transmission information" This step Is a step of recording the attribute information of the terminal itself when the information communication terminal device 2 receives the space-mediated transmission information. Specifically, it is at least one of the time, the inclination / direction, and the acceleration when the space-mediated transmission information is received. In addition to this, video information taken by this mobile terminal may be recorded. Further, information that can identify the terminal itself by a third party, for example, a telephone number or a personal ID may be recorded.

(3) Regarding "a process in which an information communication terminal device or a server to which this information communication terminal device is connected identifies the spatial position of this information communication terminal device by decoding the received space-mediated transmission information".
In this step, the space-mediated transmission information received in the step (1) above is decoded, and the space position P of the information communication terminal device 2 is specified.

For example, suppose the space is a particular convenience store. In that case, the music flowing in the convenience store, the colors of the floor and ceiling display shelves, the lighting, and other ultrasonic waves exceeding the audible range are received by this communication device. Further, the distance to the floor or the wall is measured by detecting the reflected wave of the ultrasonic wave transmitted from the information communication terminal device 2.

In this embodiment, the spatial position information processing server 3 stores sound, light, color, and ultrasonic identification information for identifying space-mediated transmission information specific to each space (spatial identification information database). ) 4 is prepared in advance, and the information communication terminal device 2 inquires the server 3 of the space-mediated transmission information to identify and specify the space. At this time, the reflection of the ultrasonic wave is used to specify the position in the space. For example, the position in the store is specified by the distance to the obstacle in the water Hiei direction measured by ultrasonic waves. In addition, the height of the terminal can also be detected.

The decoding of the space-mediated transmission information may be performed by the information communication terminal device 2 itself or by the server 3.

In the present invention, as described above, a communication protocol is defined so that noise floating in the space can be filtered out by combining a plurality of (two or more) space-mediated transmission information with each other. It is executed according to the protocol.

Further, when the spatial position cannot be decoded only by the space-mediated transmission information, other auxiliary information may be used to perform this. For example, the camera function of the information / communication terminal device 2 may be used to capture the surrounding scenery, which may be used to specify the spatial position.
(4) About "a process in which an information communication terminal device or a server to which this information communication terminal device is connected stores the attribute information of the terminal in association with the spatial position of the specified information communication terminal device" This information communication terminal The attribute information of the device 2 is at least one or more combinations of position information, orientation (tilt) information, and acceleration information that can be detected by the terminal itself, and preferably information that identifies the terminal (phone number, personal ID, etc.). ). By associating this with the space position P, it becomes possible to virtually leave the information of the terminal in the space. This information is accumulated in the spatial position tag database 4b of the server.
(5) Regarding "a step in which the information and communication terminal device repeats the steps (1) to (4) at a predetermined timing to associate and store the attribute information of the terminal with an intermittent spatial position". , As shown in FIG. 2, it is possible to intermittently leave a footprint of this information communication terminal device in the space.

Next, each function of (6) to (8) above will be described with respect to a method of using the information (spatial space position tag) recorded in the space.

FIG. 3 is a schematic configuration diagram showing a system configuration for this purpose.

FIG. 3 in the figure is the spatial position information processing server, to which the spatial mediation transmission information DB 4a and the spatial position tag DB 4b for storing the spatial position tag P are connected. The information communication terminal device 2 is connected to this server. Further, the reference numeral 6 indicates the above-mentioned space-mediated transmission information recording device (for example, a device such as a batch dedicated to information recording) that cannot be directly connected to the spatial position information processing server 3. The device 6 can be connected to the spatial location information processing server 3 via, for example, a PC 7.

Then, what is shown by 8 in the figure is a service provider system that provides a processing service using the spatial position tag P. For example, when electronic money for using transportation is installed in the terminal device 2, the service provider system 8 is a transportation billing system. In this case, the transportation billing system is set with permission 9 so that only the spatial information position tag P left around the station can be tracked.

The location information processing server 3 provides the attribute information of the information communication terminal device 2 associated with the location tag P by collating the permission 9 possessed by the service user system 8 with the spatial location tag P. Passed to the person system 8. Thereby, for example, it is possible to provide a billing service for the information communication terminal device 2 even if the ticket gate of the station is passed. Further, according to such a system, it can be assumed that the ticket gate itself will be unnecessary in the future.

Further, the service provider may be a retail commercial facility such as a convenience store. For example, in the case of a convenience store, it can be used for payment in the same way as the above transportation billing, and it is possible to obtain customer flow line information such as the position (height) of the store where the terminal was located. It can be used to devise the type and display position when replacing.

Further, the service provider system 8 can be used to provide various services, not limited to billing.

Hereinafter, for example, the provision of services to participants at a concert hall will be described as an example.

In this example, the space-mediated transmission information in the concert hall is the song and lighting that are played in the concert. Further, the acceleration of the terminal detected by the information communication terminal device 2 may be used for this.

First, when it is detected that the information and communication terminal device 2 has entered the concert venue, the service provider system 8 is described by the spatial location information processing server 3 based on the permission 9 "inside the venue". It becomes possible to retrieve the spatial information position tag and attribute information of the mobile information communication terminal 2, thereby permitting access to the service providing system 8 of the information communication terminal 2.

For example, the information communication terminal device 2 first downloads the dedicated application 10 from the service providing system 8. The application 10 receives information and a command 10 prepared based on the spatial position tag P of the information communication terminal device 2 from the service provider system 8 and executes the application 10. For example, the following processing is possible.

(A) The location of the mobile communication terminal in the concert hall is determined from the space-mediated transmission information received by the communication terminal device 2, and the screen of the mobile communication terminal device 2 is made to emit light in a color corresponding to the position.

(B) A song to be played at a concert hall is discriminated from the space-mediated transmission information received by the information communication terminal device 2, and the screen of the portable communication terminal device 2 is made to emit light in a color corresponding to the song. In addition, the timing of light emission and the like are changed according to the acceleration.

(C) A song to be played at a concert hall is discriminated from the space-mediated transmission information received by the communication terminal device 2, and the lyrics of the song and other related information are displayed on the screen of the communication terminal device 2.

Further, as another example, an application example will be described when the space itself moves, such as when the space is in an elevator or in a train.

When the space moves in this way, for example, information regarding the movement of the space may be transmitted to the application 10 downloaded to the terminal device 2. For example, when the space is an elevator, the outside scenery according to the height of the elevator may be sent to the application to be displayed. Further, in the case of a train, various information regarding the current position of the train may be sent to the application 10.

According to the invention described above, compatibility between various OSs such as iOS, Android, and Windows (registered trademark) was extremely insufficient to have one function, but "Hikari" It can be unified by mediating "sound," "color," and "ultrasonic waves," and it is possible to omit the mass of point cards and the like in wallets, which many people find annoying.

Until now, even with one payment function, each store had to install a dedicated terminal and connect it to the Internet. If this technology permeates, it will be possible to realize a world where consumers can easily make payments with two smartphones.

Needless to say, the present invention is not limited to the above-mentioned embodiment, and can be variously modified without changing the gist of the invention.

U1. U2 ... Ultrasonic P1 to P7 ... Spatial position tag 1 ... User 2 ... Information communication terminal device 3 ... Spatial position information processing server 4a ... Spatial mediation transmission information DB
4b ... Spatial position tag DB
6 ... Device 7 ... PC
8 ... Service user system 9 ... Permission

Claims (16)

It is a method of using the information recorded in the space.
A server connected to the information communication terminal device via a network records the attribute information of the information communication terminal device in association with the specified spatial position of the information communication terminal device.
The information stored in a specific spatial position based on the spatial position to which each service providing system has permission for a plurality of service providing systems in which the server provides a predetermined service to the information terminal device. The process of deciding whether to pass the attribute information of the terminal device and
The service providing system receives the attribute information of the information terminal device stored in the spatial position to which the user has permission from the server, and based on the spatial position and the attribute information, the information terminal device is subjected to. , The process of providing the predetermined service provided by this service providing system, and
Method to have. In the method according to claim 1,
The spatial position and attribute information of the information communication terminal device is
The information communication terminal device or server repeatedly detects the spatial position and attribute information of the information terminal device at a predetermined timing, and stores the attribute information of the information communication terminal device in association with the intermittent spatial position. A method characterized by being. In the method according to claim 1,
When the space itself in which the spatial position of the information communication terminal device exists moves, the predetermined service provided by this service providing system is provided based on the position after the movement, the spatial position, and the attribute information. A method characterized by being. In the method of claim 1,
The process of identifying the spatial position of the information communication terminal device by decoding the received space-mediated transmission information by the information communication terminal device or the server to which the information communication terminal device is connected.
A process in which the server to which the information communication terminal device is connected stores the attribute information of the terminal in association with the spatial position of the specified information communication terminal device.
A method characterized by having. The method according to claim 4.
The step of receiving the space-mediated transmission information is to receive the space-mediated transmission information composed of two or more combinations of sound, color, light, and ultrasonic waves peculiar to the space position.
A method characterized by that. The method according to claim 4.
The ultrasonic wave as the space-mediated transmission information also includes a reflected wave of the ultrasonic wave oscillated by the information communication terminal device itself in order to specify the position of the information communication terminal device within the space position. A method characterized by being. In the method according to claim 4,
Moreover,
The process of capturing an image of the space when the information communication terminal device receives the space-mediated transmission information, and
When the information communication terminal device or the server to which the information communication terminal device is connected decodes the received space-mediated transmission information, the spatial position of the information communication terminal device is specified by referring to the video as well. How to feature. The method according to claim 4.
The server has a reference database that stores sound, color, light, and ultrasound information associated with a particular spatial location.
The step of specifying the spatial position is a method characterized in that the server identifies the spatial position by inquiring the received spatial mediation transmission information to the reference database. A system that uses information recorded in space
A server connected to the information communication terminal device via a network records the attribute information of the information communication terminal device in association with the specified spatial position of the information communication terminal device.
The information stored in a specific spatial position based on the spatial position to which each service providing system has permission for a plurality of service providing systems in which the server provides a predetermined service to the information terminal device. A means of deciding whether or not to pass the attribute information of the terminal device,
The service providing system receives the attribute information of the information terminal device stored in the spatial position to which the user has permission from the server, and based on the spatial position and the attribute information, the information terminal device is subjected to. , The means for providing the predetermined service provided by this service providing system, and
System with. In the system according to claim 9,
The spatial position and attribute information of the information communication terminal device is
The information communication terminal device or server repeatedly detects the spatial position and attribute information of the information terminal device at a predetermined timing, and stores the attribute information of the information communication terminal device in association with the intermittent spatial position. A system characterized by being. In the system according to claim 9,
When the space itself in which the spatial position of the information communication terminal device exists moves, the predetermined service provided by this service providing system is provided based on the position after the movement, the spatial position, and the attribute information. A system characterized by being. In the system of claim 9,
A means for identifying the spatial position of the information communication terminal device by decoding the received space-mediated transmission information by the information communication terminal device or the server to which the information communication terminal device is connected.
A means by which the information communication terminal device or the server to which the information communication terminal device is connected stores the attribute information of the terminal in association with the spatial position of the specified information communication terminal device.
A system characterized by having more. The system according to claim 12.
The space-mediated transmission information is composed of two or more combinations of sound, color, light, and ultrasonic waves peculiar to the space position.
A system characterized by that. The system according to claim 12.
The ultrasonic wave as the space-mediated transmission information also includes a reflected wave of the ultrasonic wave oscillated by the information communication terminal device itself in order to specify the position of the information communication terminal device within the space position. A system characterized by being. In the system according to claim 12,
Moreover,
A means for capturing an image of space when an information communication terminal device receives the space-mediated transmission information, and
When the information communication terminal device or the server to which the information communication terminal device is connected decodes the received space-mediated transmission information, the spatial position of the information communication terminal device is specified by referring to the video as well. Characteristic system. The system according to claim 12.
The server has a reference database that stores sound, color, light, and ultrasound information associated with a particular spatial location.
The means for specifying the spatial position is a system characterized in that the server identifies the spatial position by inquiring the received spatial mediation transmission information to the reference database.

Images