WO2004048887A1

WO2004048887A1 - Real world object recognition method and device, and attached device

Info

Publication number: WO2004048887A1
Application number: PCT/JP2003/015019
Authority: WO
Inventors: Yuichi Kado; Shinichiro Muto; Fumiharu Morisawa; Yuichi Morikawa
Original assignee: Nippon Telegraph And Telephone Corporation
Priority date: 2002-11-25
Filing date: 2003-11-25
Publication date: 2004-06-10
Also published as: AU2003302450A1

Abstract

A real world object recognition method comprising a step of allowing attached devices (11a, 11b, 11c) which are attached to respective real world objects (Oa, Ob, Oc) and to each of which unique identification information is assigned to transmit the identification information and position information representing the positions of the attached devices (11a, 11b, 11c) and allowing a computer system (2) to receive the information and a step of allowing the computer system (2) to determine the positions of the real world objects (Oa, Ob, Oc) corresponding to the attached devices (11a, 11b, 11c) on the basis of the identification information and the position information and to recognize the devices.

Description

Real World X-Cut. Heart method and magnificence and purple element

Technical field

Light

The present invention provides real-world object information, which is information about real-world objects, in a three-computer system that constitutes a fine server world. A real world Obuji X Kutto for your knowledge. Technology related to heart method, armor and accessories

In recent years, the network has been connected to communication networks, and has been connected to each other. In addition, the network has ranged from household appliances such as TVs to sensors and factories and X-groups. There is a possibility that a wide variety of services may be developed and used in a wide range of fields that are connected to each other through a network. The pumps interconnected by a network are connected to each other by the pumps in the evening, and cooperate with each other in order to achieve services while communicating with each other. In the development of software that implements services such as those that use JavaVa (registered) PP and distributed Xobn X systems, which are used in distributed object networks, It is an essential object for realizing h-directed VV c c 〇 R Β A (Common 0 b) Xt-oriented systems such as bje C t R e Q uest B roker A R C hite Cture) are becoming mainstream.

In other words, the real world is modeled on a Γmono J-based model, and is used as an objet X-cut. 厂ノノ J J J 構By describing the properties such as functions as the characteristics of the Xbox X-cut, the functions realized in the system can be clarified by natural ideas.

Then, the real world's job X is sent to the server world as a job-of-the-world {virtual world on a computer system (single or multiple systems)}. How to combine 0 need for books § Convertible

In recent years, computers have been connected to each other by a communication network, and various services have been provided in a virtual world on a computer network. It is not limited to electronic mail and WWW browsing as typified by the information provided by the Internet, but also the Internet, telephone, fax, broadcasting-type information services, Video and standing

Various services have begun in the world on the net, such as the distribution of telecommunications, telecommunications business, broadcasting business, and even e-commerce.

However, the only things that can be directly operated with such a good service are those that have been previously incorporated into a virtual world called Neck as an evening. Things that the real world ΓMono J and ヒ Hi J say cause in everyday life ΓEnvironment J are almost always incorporated into the network. There is little or no means of reflecting these to the temporary world on the network.

In other words, Ubiquitous services utilizing the network, which is currently expected worldwide, are said to be informationization of ordinary space. The information of ordinary living space has been left as it is.

For example, searching for the location of assets and important items in the home Freshness of food in the refrigerator Shellfish expiration date Inventory management Health care and care for the elderly; ¾Auxiliary care and security at home Evening 3 The potential behavior of buyers within the shopping mall, such as purchasing behavior tracking and dynamic marketing, is extremely large. There is a place, but not yet 1 开]

In order to realize such a service, it is as if you are actually watching it.

Table

Always knows when, where, and what the shape of the link is and how it can be interpreted.The result of the knowledge is a change in the knowledge of the virtual world, which has a relationship between the real world and the mapping. It is essential to establish a mechanism to reflect

In other words, the change in the shape of an object in the real world, taking the form of an event, changes the shape of the object in the object that constitutes the knowledge of the virtual world. The mechanism to reflect in the program, that is, the X-cut of the real world is compiled. 2003/015019

4 There was a long-awaited need for a way to reflect (merge) the world in the evening in the evening.

Such a real world and a virtual world on a computer such as a computer-a representative of the first conventional technology of how to observe the world's objects is the Sentientc OmP of Cambridge University. Sent € nt C 0 m P uting, which has examples of uting, is defined as a means that the system can be enhanced by feeling the real world. The sensor group and m-measurement provide the location of the real world objet X-cut, Factory Hit J-Mono J, and its specific properties to the App U-Cashin software. So, for example, it is used to maintain the environmental morale between normal life is

First of all, detecting the position of the real world obn X cut and its identification ID is a starting occupation, so that it becomes a starting occupation.

A 100-meter square pill is used to specify the position of the object at a position of about 3 cm in a 100-square-meter pill that employs a wave-based location system. One stand per unit

Says wave sensor 7

20 An 8 cm long device attached to the object embedded in the ceiling is a

It has a built-in wave transmitter. 中央 Central pin to which identification IDs are assigned

The identification ID can be found on the radio channel from the P

The sensors that reset the sunset are the ones that receive the ID of the white waves by radio waves.The apulse that sends the pulse of the supersonic waves sends out the sensor on the ceiling. Shoes 5 receives it and calculates the position by the diagonal method based on the difference in propagation time.

It operates in synchronization with the evening cook, including the controller that controls the laser sensor V-talk, so that it is occupied when transmitting the identification ID by radio wave. There is a system that provides a basis for calculating the time difference between when the wave sensor detects the pulse of the wave and when the wave sensor detects the pulse. To identify the location

In the sensor system, the location of the location X and the location of the location H including the location J and the source of the U source in the building are integrated by a distributed X-directional module, and the U source is sensed naturally. The spatial correlation between the objects and the X-cuts is shown to the application V software. The location of each object and the status of each object are represented by the X-box X of CORBA (Comm 0 nobjeat R e Quest Broker A rchitect U re).

The Co RBA is a standard for network-based networking that is required to realize a distributed network-based X-box system. Then C

4 R B A's object corresponds to 40 0 all objects

The type of X-cut is similar.For example, the object of C0 RBA for real object h, such as the h-person's personal computer power, m-pi, mpi, etc. Correspondingly , 15019

6 With the current properties of the real world

, ゝ

For example, if the interface is the control interface for the world's Xbox, the printer will be connected to the corresponding application via the corresponding application box. • The software activates the actual printer.

All of the X X cuts in B A form a world model viewed from the application / software ォ; «

X X white body is in the shadow of transactions, alternative processing during system downtime, security management, distribution of vanes, or large-scale distributed systems. To take care of the items in the list, we provide a single entrance to the opening case for the application.

System is super erect

The sensor group and sensor control entrance are embedded in the ceiling and floor, and the system entrance or entrance 1 is required, so large office buildings, hospitals, etc. Works best for mobile people who generate information, access information, and in situations where they need to interact with disparate devices and with each other.

The second conventional technique is the management of mono.

"RF-ID (Radio Fre Quen C) is a technology that connects the real-world factory MONO J and the network. y I dentification) Tag is small, and has a built-in line communication IC, and the basic function is only to transmit the ID number etc. stored in the memory.Mainly for logistics management. The managed object When attached to a X-cut, the identification ID can be obtained without contact in a non-contact manner (NIKKEI Ε LECTR o N

ICS 2 0 2 2 • 25 p Ρ. 109-13: 7 ') However, what is happening in the real world is a virtual world on the net at the real time. In order to provide a variety of services, it is necessary to always have a function that always keeps πθ as to which object is when, where, and in what state. As a third conventional technique, there is a technique of wi picting a real-world object h that emits infrared light by using an infrared sensor or an infrared force camera. This is a sensor that can acquire both a shin and an ID simultaneously (Nobuyuki Matsushita et al., “IDC am: An image sensor that can sometimes protect a shin and an ID,” IEICE. Academic report, IT 2 0 1 ― 9 2, PP-1 0 5

― 1 3 7) Developed with the aim of linking the real space and the virtual space by using the ID force camera consisting of It is a system that can recognize IDA (NIKKEIEL Ε CTRONICS 2

0 0 2. 4 • 8 P • 3 5 “LΕD detects light by inputting force into the virtual space” First, the real X-cut of the real world

A light-emitting diode (LED), whose blinking is controlled by a so-called bean, is mounted on the (subject), and the ID is assigned. Bin repeats extinction based on its ID

_

The blinking pattern is detected and analyzed by a custom-built-in power meter (ID force mailer) developed uniquely for the new system. If you compare the ID to the infrared remote that displays the image of the subject in the image, the bin is an infrared umon transmitter, and the ID input camera is a remote control receiver. The ID camera, which is an array sensor (CM 〇 S sensor) arranged in an array, can only image the scene as a force camera (sin mode). <The coordinates on the image of the icon and the ID key sent by the beacon are output as a set (ID mode-ID). Repeat the sampling of kHz at 200 times, and the carrier frequency transmitted by the bin 3 is 4 The ID of 8 bits at 4 kHz is all 19 2 X 1 2 4 pixels In

Create 3D image at 15 f Ρ s

It is possible to link to the information (on the internet) of the server world via D, so that the user can use the ID to obtain information about the object The number of ID bits that can be obtained is 8 bits, which is 4 k

Performs X-star coding with a carrier of Hz and transmits / receives the ID-d in the unit of 22-bit packets.

As a fourth conventional technique%, there is a construction method (cyberrCode) of augmented reality and realism using a two-dimensional mat UV index (JunRekimotooYujii).

A y a t s u k a Written by the factory C y b e r C o d e • D e s i g n i n g A u g υ L m e n t e d R e a 1 i t y

E n V i r o n m e 11 \ t: s w i t h V i s u a 1

T ags J) on the surface of a real-world object. The next vault matrix 3 is attached, and the video is taken with a video camera. From the subject you see on the video 3?

You can access the related information on the network 7-x through the docs box and develop the virtual world's object X-X.

As a fifth prior art, a real X-cut is photographed with a special video camera, and the area where the object that can be cooked is shown and its link destination URL, Information about shooting time, etc. |

There is a plan (Shunji Sugawara et al., “Shooting a Critical Power Bulloject”, WISS 201, pp. 167-17-172). This is also a proposal for a method of '1 ^! ' Sharing obnects and temporary phases iii. Information on the world. Multiple Cs with

The method of identifying multiple real objects photographed with a CD force camera uses the wavelength difference of the embedded infrared accessory, so the emission center wavelength is 800 η m 8 2

5 nm 850 nm 8 7 5 nm 9 0 0 η m with infrared m element and the permissible wavelength range are different (infrared pass filter with center wavelength of 800 nm 850 nm 900 nm Filter to C

(They are dressed in the C D force camera.) The number of real X-cuts that can be distinguished from each other by preparing three C C D force cameras is a maximum of 5.

In addition, six conventional technologies consist of five L Ε D There is a method that attaches a tag called Ba11oonTag to a real object factory and shoots it with a video camera (Wataru Takaki, infrared tag read by a factory camera and its tag). Application of W

I S S 2 0 0 P P. 13 1-13 6). The video of the camera is analyzed, the tag information is read, and the position in the video is calculated.

Of the five LEDs, the four at the periphery repeatedly occupy and illuminate at the same timing, functioning as a clock signal, and the central LED is the clock. The signal blinks 1/4 phase behind the signal blinking. The image captured by the power camera that sends the evening signal is first extracted only from bright pixels. Next, the pixels extracted in this process are area-combined and the area of the area is calculated.Area with an area equal to or greater than a certain value is determined to be not a Ba11oonTag light source and removed. This removal is performed to remove bright parts of white walls, fluorescent light sources, etc. from the judgment target.

Next, a combination that can be presumed to be a quick signal is searched for in a plurality of areas selected as follows. Since the clock signal of B a 1 ο on Tag appears as a roughly diamond-shaped area in the image, it is limited to the angle e formed by the four vertices in all combinations of the four areas. The selection of the clock signal source by adding When the diamond of the signal source is selected, the area where the diamond was located in the most recent video frame is mapped. How the Ba1 1 oon Tag moves Analyze 15019

11 When the clock signal is turned on or off next time, investigate whether an LED can be found near the center of the diamond, and check the data bit. The frame processing speed of the computer that reads “1” or “0” is 10 Hz, and if the phase difference between clock and data is taken into account, the transmission will be 5 Any speed below HZ is possible. Then, the transmission speed of the evening is set to 4 Hz.

A seventh conventional technology is being developed at the University of California, Bakule, USA. "SmartDu

There is an ultra-small wireless sensor node called St ((i)

B r e t t W a r n e k e et al., “Sm a r t D u s t • C o m m u n i. C a t i n g w i t h a

C u b i c i M i 1 1 i .m e t e r C o m P u t e r J I E E E, C o m p u t e r, J a n • 20

0 1 (i [i) Josep M. Kahn et al., Factory E merging Cha 1 1 enges: Mobi 1 e Networking for Smart Dust ", 2 0 0 0 KICS) Line communication technology is an optical communication technology in which light arriving from a laser light source at a base station is incident on a wireless sensor node in a direction parallel to the optical axis that is incident on the ultra-small reflective mirror. From the laser installed at the base station that uses the method of returning or removing it as an optical signal from the laser installed at the base station, the laser is sent to the area where the wireless sensor nodes are scattered. · When irradiating the beam, the above irradiation light will cause the wireless sensor node to The normal sensor node, which can be modulated to send the evening, contains the command that is coming from it, the command that is coming from it, and the command that requests the sensing information. When a beam that is not received is received, the microminiature reflector is moved to change the reflected beam toward or away from the base station in parallel to the base station. The point that can be returned to the station is that the small reflector is a mirror on three mutually perpendicular surfaces formed inside the corner of the body.

Since the light beam incident on the three-sided reflecting mirror is reflected in parallel with the incident optical axis, it is basically possible to use each line sensor even if there is no special argument. The reflected beam reflected from the camera returns to the base station, and the reflected beam from the entire area where the sensor nodes and groups are distributed is imaged on the CCD sensor array. Therefore, if a lens system is designed, the modulated beam from each node can be received at a pixel at a specific position on the sensor array corresponding to the spatial position.

(= 1 In other words, space division multiplexing optical communication can be realized.

According to the number of pixels in the C M 〇S image sensor, the size of the Hd is 25 6 X 25 6 when the XU in a 17 m square is divided into two. When light is received at the cellular array, each pixel corresponds to a spatial area of 66 cm 2. If it is only the distance of the box of the evening, another node, Ka's t = I

The signal speed is CCD. Depends on the sensor frame

The first technology mentioned above is embedded in the horoscopes that are applied to the daily life of home shops and narrow offices.2.

Expenses that require construction work, which are difficult due to cost-effectiveness, and the size of the applicable sky, such as a two-dimensional planar shape

£ 1

By changing the method of positioning the ultrasonic sensors and the spacing between them, the diagonal technique

It is necessary to adjust the whole system in order to identify the position by the method, and it is not necessary for the general public to purchase this system and to arrange, maintain, and maintain it. Absolutely difficult

I

Also, the RFD tag of the second prior art

Dagger

Even if it is attached to a cut, there is no ability to specify the location of the X-cut to which a specific different D is attached. In order to specify the location, it is necessary to search close to the U-da, but since the communication distance is 2 m because of the wave rule, any other ID is assigned to the object. If it is not possible to build a system that uses a real-time system to determine when and where the network is located, NTT is indoors and has an is 1 of about 10 m. In the evening and when using multiple base stations, D

In the system that issued the technology to identify the RF ID

The specified m of the weakly used position in the 0 MHz band is about ± 2 m, but there is no accuracy in specifying the position of the object with the other part. Regarding s, it is only possible to identify where it is located.RF is too wide to be accurate, but it is difficult to know the location of the ID. RF in

R due to the effect of ID-R-It is difficult to receive the signal of ID o

Further, the third conventional technique employs a method in which a vein is repeatedly occupied based on its ID and is not synchronized with a receiving system. In addition, the beacon does not know when to shoot with the ID power camera, and must constantly flash. Since the power consumption of the LED is not small, the size of the bin can be reduced

It is not suitable for use in applications that attach to observables that are not environmentally friendly. If intermittent operation is performed due to electric power, there is a possibility that the ID will not be able to be recognized due to the ID force. In this case, an algorithm such as key synchronization (inserting a stop bit and a stop bit before and after the asynchronous method) is required. It is difficult to recognize the moving object because the processing is greatly increased and it takes too much time

In the fourth prior art, in order to operate a system in a real environment using a binar, it is necessary to use an existing object in order to be able to understand even from <to. Because a huge gutter is attached to the surface, the shape of the real X-cut can be recognized because it is necessary. <O> Also, from an oblique angle or near the M Be in both

2D mats Since there is a need to greatly improve the degree of image processing and the image processing capacity, about 100 obscure X-cuts are required. It is difficult to learn

Also, in the method using the wavelength difference of the light source of the fifth conventional technique, the number of clearly identifiable objects is limited to only about several. Since it is a method that only extracts bright occupancy from the output infrared image, if the sphere or its reflected light is behind the infrared light source, the infrared incidental element cannot be detected. It is not practical in practice

Furthermore, the occupation of the sixth prior art is occupied without synchronizing with the receiving system that has a low data transfer rate.

A system that identifies the ID by photographing the LED with a power camera, which can only transmit at extremely low shutter speeds, such as 4H, is required to send 10 characters. At 0 seconds, you have to be within the frame. Therefore, you only need to give the ID number of the X-Cut that is the subject of the power camera.

The 8-bit field takes 2 seconds, so the speed of the mouth center is very low, so it is difficult to understand the opposition of the moving object.More than 10 objects X 1 a1 1 0 on Τ ag is 5 L

Requires E D and is not suitable for downsizing

The present invention has been made in view of the above, and its main purpose is to provide a real world object with a three-chip system that forms a server world against the real world talent. DISCLOSURE OF THE INVENTION To provide a method for connecting the real world and the super-world that makes it possible to properly determine the world's genius and the world's talent.

The present invention, which relates to the ability to achieve the above-mentioned objectives, is based on the real-world object information related to the real-world object engineering, and is based on the computer system that composes the super-world. Real World Obuji X Kutto for understanding. For the sake of mind, を The identification information and the position of the element attached to the real world object X, which are issued from an accessory assigned with one identification information, are assigned. The step of receiving the position information to be represented by the opening / closing system and the identification information of the attached element and the real world object X corresponding to the element based on the position information. A step is provided to identify the position of the unit by the computer system.

The present invention according to the above-mentioned 2 for forming the above-mentioned giant is based on real world object X related information related to real world talents. -A real-world, open-minded way to learn more about the evening system.

-ヽ

Location information indicating the identification information and the position of the tag attached to the real world object. The system receives the steps and the identifier Step 3 Obtain the attached image of the attached real world X-Cut by the computer system and receive it. 取得 Obtain the identification information and position information of the attached element. By step Ό Identification information of the attached band associated with the step to be associated with the acquired image of the real world object X Location information and the real world object X a step for identifying the real world object corresponding to the incidental device based on the image of h by using a computer system.

The present invention, which relates to a third aspect for forming the above-mentioned hugeness, includes a real world object for constructing a real world object information about a real world object. The identification information generated by the attached element attached to the real world Xbox and assigned with the identification information, and the identification information generated by the attached element. Based on the means for receiving the position information indicating the position of the child and the received identification information of the attached element and the position information, the position of the real world object X-cut corresponding to the attached element has been specified. Have the means to know

The present invention according to a fourth aspect for achieving the above object,

Huh

A real world object X-Cut device for constructing a server world based on the real world object X information related to the real world object, which is attached to the real world talent X object. And

——- Identification information and -a emitted from the attached element to which the identification information of interest is assigned.

Position information indicating the position of the associated s-element For receiving an image of a real-world observatory with an attached element attached, and acquiring the identification information and position information of the received Iff element attached Means associated with the image of the real world object protected by the means 1 and identification information of the attached element associated with the position information and the image of the real world object X Means for identifying and identifying the position of the real world Xbox corresponding to the attachment based on the

According to a fifth aspect of the present invention for achieving the above-mentioned objective, a server-world corresponding to the real world having sound identification information attached to a real world X-box is provided. The identification information and the positional information indicating the position of the incidental element can be communicated to the computer system by line communication to the computer system. In accordance with the transmitting means for transmitting and the operation finger from the computer system, the state of the Bd real world object and the small number of the state near the real world object X A sensing means for transmitting sensing information about the real world object which has been sensed to the PC computer system, and a memory system for detecting the real world object. Executes a predetermined operation in response to the operation command from the刖 PC for related operation information

Operating means for transmitting data to the computer system.

As described above, according to the present invention, additional information issued from the accessory card and the position of the accessory are determined. The information can be received and understood by the computer system (real world X-axis π ^ recognition device).

At least the location of real world objects such as environments can be connected to the server world in the real world, and various services can be created that are closely related to everyday life. In particular, according to the present invention, the W attached to the object h in the real world receives the light emission instruction command and emits light when the identification information matches. Then, the position of the luminous occupation is specified as the position of the real world object, and the position of the real world object is combined with the object X object of the world specified by the identification information. Real world objects such as physical environment

Such events can be linked to the global network and the corresponding talents in the world can be connected to the network. When I live in IJ

Further, according to the present invention, spatial image processing is performed on a frame image signal obtained by subtracting a nearby frame image signal at a predetermined strong ratio from a frame image signal of optical timing. The noise reduction processing that includes the filter processing or the pattern matching processing or both processing is performed, and the image with the highest image density, for example, the maximum signal intensity for each spot The image is identified as a light emission image, and the position of the light emission image in the frame image is specified as the position of the incidental element, and it is connected to the world's object. Disturbance from the noise of s

^> And accurately identify the position of the optical image and thus the position of the Xbox X

Further, according to the present invention, the adjacent frame image signal or the frame image signal when the incidental element is not emitting light is subtracted from the note frame image signal, or The frame image signal after ら is subtracted from the frame image signal at a predetermined intensity ratio to remove the pixel signal in the frame which is less than a predetermined value. It is possible to accurately remove the shadow of these disturbance noises, and to accurately identify the position of the luminescent image and, consequently, the position of the object.

According to the present invention, the light emission is repeated by a predetermined period, or a gad having a random length, and the light is repeatedly emitted after a period of time, and the light emission of the incidental element is imaged by the imaging means. The position is specified as the position of the real world object X, and the position of the real world object is specified by another information. The events that cause the world's oppositions X will be sent to the U-room, which will be combined with the corresponding object X-cuts in the world.

It is possible to create a variety of services that are closely related to everyday life using the computer network.

Further, according to the present invention, when a light emitting instruction is received by attaching an incidental element which emits light repeatedly in a predetermined time and a predetermined cycle in response to a light emitting instruction command to a real world object, and Light emission is repeated for a predetermined time and at a predetermined cycle.

Real world object The position of the real world object X specified as the position of the object is added to the position of the object world in the saba world, so that the object X, the object return, etc. Various events are linked to real-world events, which are linked to the corresponding objects in the world, and various types of events that use the network are connected to everyday life. ―When you create a screw,

Further, according to the present invention, an accessory W that emits light in response to the light emission instruction τ is attached to an object X in the real world, and the light emission of the accessory when the light emission instruction is received is received by the first imaging means. The second imaging means having the same imaging field of view captures an image of a real world object attached to the accessory, and the position of the light emitting point captured by the first imaging means is determined by the second imaging means. The position identification information of the real world object X X specified as the position of the real world object X X is associated with the image of the real world object X X taken by the second imaging means. Since the image and position of the bird are converted into the observable X-cuts of the server world specified by the identification information, various events caused by the real-world obects X, such as people, objects, and the environment, can be considered. The world's corresponding objects in the world Down pin Interview evening system to have you in Sai server world was or to Ru door door is in the α to the S. Humans are observing the information that they are aware of. Real-world Observation X The image of the X-Cut is correlated and correlated. Various services that use the service When you do

According to the present invention, the field of view or both of the 145th and the 2nd it image means are also larger than the image content frame and outside the frame; The state of the object is identified, and the identification information of the real world X-box is used. The light-emitting position The moving object newly entered into the field of view of the imaging means in order to sense the flash point. I can make my mind go smoothly

Further, according to the present invention, the incidental element is a base of a real world object.

Detects the status of the system and / or the proximity of the status B or both, and sends the sensing information that has been sensed, and the computer system receives the sensing information and sends the sensing information. The singing information is the object in the server world or the object in the server world specified by the identification information together with the location of the real world object.

The real world object and the server world object h are connected in association with the information or information processing function related to the X cut, so that the white body and the vicinity of the real world X cut are wet and wet. Degree

According to the report, information such as vibration C C2 concentration, pollen abundance, acceleration, movement, tilt and pressure can be obtained and related to the Sapa world object.

Furthermore, according to the present invention, the incidental element senses the state of the real world X-cut or the state S 'or both, and the computer system receives the sensing information. Sensing information on real-world objects The location information and identification information are associated with the image of the real-world object X X imaged by the second imaging means. Sensing information Identified by identification information Related information related to information and information processing functions related to the X-World of X-World or X-World of X-World 1 so that the white of the real world object X

,>

Say vibration C ο 2 concentration Pollen abundance acceleration speed

This information and the images of the real world X-X X, which the human observes, can be associated with the super-world X-X X X.

According to the present invention, the accessory has an actuator for performing a predetermined operation, and the computer system transmits an operation instruction for the operation and the operation for the operation. The command reception confirmation signal or the actuator execution notification signal is received from the accessory, and the information on the operation function of the actuator is identified by the identification information together with the position of the real world open box. Since it will be linked to the identified genius of the world, for example, it is possible to use an object such as a bi-directional camera to create a real-world object. In addition to causing the action of the species in relation to, the information on the actuation function of the actuator Xu X is linked to the super X-cut of the world. Various services using evening networking that provide services closely related to everyday life You can create it.

Also, according to the present invention, the accessory has an actuating device for performing a predetermined operation, and the n-computer system transmits the actuating device to transmit the actuating operation, and whether the W element is attached. Rakuchu Receiving a reliable mouth signal or a work execution execution notification signal from the accessory, information on the operation of the work function, and the position and identification of the real world X-box Information of the real world object associated with the image of the real world object obtained by capturing the information by the second imaging means. Information on the operation function of the location information function. Since it is linked to the observable X-cut in the server world identified by the identification information, it is possible to use an actuator to cause the action of the species in relation to the observable X-cut in the real world In addition, information on the operation function of the Actuator X-X and the image of the real world X-ray X taken by the second imaging means are combined into the Ob-X X-ray of the server world. □ Various types of computer networks Create a service that is closely related to everyday life

Further, according to the present invention, the luminous point is selected with priority given to the region estimated from the position of the mental sensation in the past luminescence. From the image captured by the second imaging means, the outline of the X-X cut including the past light-emitting occupation is captured and the light is emitted.

During the period when the user is not conscious, the movement of the contour of the X-ray X-ray is traced from the image taken by the second imaging means to compensate for the temporal occlusion of the tag, and the light emission intensity of the attached device Is weak <Even if the light emission is occasionally obscured, it is possible to continuously track the position of the world Xbox X

According to the present invention, a past light-emitting partial image is reflected on a template of a light-emitting pattern or a past light-emitting point position is detected. The use of the template used in step (b) suppresses misidentification ff ^ of the light source other than the accessory.

FIG. 1 shows an embodiment of the present invention.

Real-world talented blades related to shape

Diagram showing the schematic configuration of the oral knowledge system

FIG. 2 is a diagram for illustrating a method of connecting the real world and the server world according to an embodiment of the present invention.

Fig. 3 shows the output frame image of the moving image camera (the image table for each frame) that captures the emission image from the optical element of each accessory in the embodiment shown in Fig. 1. ) Is illustrated.

The figure is a schematic block diagram showing an example of processing of the computer system and the attachment shown in FIGS. 1 and 2.

Figure 5 shows the noise in the frame image of the moving image power camera.

A diagram for clarifying the process of removing the emitted light image by subtraction (difference) from the 刖 frame image

FIG. 6 is a schematic flow chart showing an example of processing of the computer system and the neat w * multiplier shown in FIGS. 1 and 5.

Fig. 7 is a diagram for explaining the process of removing the light emission image that appeared as noise from the frame image of the moving image camera by a different subtraction process from Fig. 5. is there FIG. 8 is a schematic diagram showing an example of the processing of the TC device and the attached elements shown in FIGS. 1 and 7.

Fig. 9 is a diagram to clarify the fixed space filter processing that removes noise signals from light sources such as sunlight and lighting that still remain in the difference processing. To

FIG. 10 is a schematic front view showing an example of processing of the amp system and the element shown in FIGS. 1 and 9.

Fig. 11 shows an example in which, instead of the spatial filter processing, the data processing is performed by using a parametric V-chitching process, and even in the difference processing, the light emission signals other than those of the light emitting elements of the incidental elements are left. FIG. 7 is a diagram for explaining a cone-shaped matching process for removing noise signals from light sources such as sunlight and lighting.

FIG. 12 is a schematic front view showing an example of processing of the computer system and the attached elements shown in FIGS. 1 and 11.

Figure 13 shows how the priority is compared between the frame image processed by the inter-filter process and the frame image after the P-V-V-ching process to determine the final priority order and to detect it. Attachment of child

FIG. 4 is a diagram for explaining a process of extracting X-ray X-cuts for identifying occupancy of light-emitting elements of an optical element.

FIG. 14 is a diagram showing a result obtained by performing the processing of FIGS. 2 to 13 described above in a general manner.

Fig. 15 shows the occupied light emission of the first priority determined, and FIG. 9 is an explanatory diagram showing that positional information of an attached element attached to a cut is paired with Ji and coordinates in the frame thereof are set as positional information of an attached purple element.

FIG. 16 shows the identification ID of the object extracted as shown in FIG. 15 = mm + 1... The time when the light emission instruction command was transmitted T m T m + 1 of the object Frame image coordinates (XmYm) 1: X: m · +-1 Ym + 1)

Is a diagram showing a process of generating a file associated with..., That is, a file for extracting an in-frame m-data extracted from a frame image of each object X.

Fig. 17 shows the information file on the Saiha, where the position data extraction file 35 in the frame image of each X-X image shown in Fig. 16 is pre-loaded. It is a figure that pi indicates that it is to be configured and treated as an obverse

Figure 18 shows the position of each object in the frame image that was converted in Figure 17-the extracted file and the name of the object X ID クォで X でででクク ID ID ID ク ID ID ク ID ID ID クククククククIt is a diagram showing that an information file is linked to form an information database.

Figure 19 shows the location of the object X in the frame image in the frame image. The extracted file was placed on the server space (from the information related to the units connected to the network). Space in the space) It shows that the X-box management is based on the ob-

It is a figure

FIG. 20 is a diagram for explaining the overall operation of another embodiment of the real world object X-Cut Hya system shown in FIG. 1 according to the present invention.

Fig. 21 shows the output frame image of the moving image camera (the frame-by-frame image) that captures the emission image from the light-emitting element of each auxiliary element in the embodiment shown in Fig. 20. The statue shown

See

FIG. 22 is a diagram for illustrating the overall operation of another embodiment of the real world object X-recognition system shown in FIG. 1 according to the present invention according to another embodiment of the present invention. Show up

FIG. 23 shows the overall work of another embodiment of the real world object recognition system shown in FIG. 1 according to the present invention.

It is a figure for

FIG. 24 is a diagram for explaining the overall operation of another embodiment of the real-world object recognition system shown in FIG. 1 according to the present invention.

FIG. 25 is a block diagram showing the overall construction of another embodiment of the real-world object mental system shown in FIG. 1 according to the present invention.

It is a figure for

FIG. 26 is a diagram for explaining the overall operation of another embodiment of the real-world X-ray recognition system shown in FIG. 1 according to the present invention. Figure 27 shows the position of the luminous occupancy of the incidental image taken with the 1 «1 power camera and the real world object captured using the 2 nd video camera.

It is a figure to clarify the association with the image of the X cut

FIG. 28 is a schematic flowchart showing an example of the processing of the computer system and the attachments shown in FIGS. 1 and 26.

Figure 29 shows the position of the light-emission occupancy of the incidental element imaged with the first moving image camera and the real-world object imaged with the second moving image camera.

Regarding the association with the X-cut image, the real world object imaged by the second moving image power camera corresponding to the position fr of the luminous occupancy of the appendix imaged by the first moving image camera This is a view in which the visual power is superimposed on the image of the project

FIG. 30 is a schematic diagram showing an example of the processing of the computer system and the attached elements shown in FIGS. 1 and 29.

FIG. 31 is a diagram for §-converting the overall operation of another embodiment of the real world object W knowledge system shown in FIG. 1 according to the present invention.

FIG. 32 is a diagram in which the visual field range of the first video power camera and the visual field range of the second video power camera are the same in the embodiment table of FIG. 31.

FIG. 33 is a diagram illustrating the real world X-X shown in FIG. 1 according to the present invention.

FIG. 11 is a diagram for explaining the overall operation of another embodiment of the Π'ί knowledge system. , ❖

FIG. 34 is a diagram for explaining the process of generating the X-Voice tube.

,

FIG. 35 is a diagram for clarifying the processing for configuring the job management base.

Fig. 36 is a diagram for converting the process for constructing the object management section-evening

FIG. 37 illustrates another embodiment of the real world gift object recognition system shown in FIG. 1 according to the present invention.

It is a figure for

Figure 38 shows the information of the accessory in the connection between the position of the light-emitting point of the accessory shown in Figure 27 and the image of the real-world object captured by the second moving image power camera. And further sensing

7 "-The figure with the evening added

Fig. 39 shows the relationship between the position of the light emitting point of the accessory shown in Fig. 29 and the image of the real world object captured by the second moving image camera, and the image of the real world object X-cut. This is a diagram in which visual power is superimposed on the top and additional sensing information is added as information for W Chako.

FIG. 40 is a diagram illustrating the overall construction of another contested form of the real-world smart X-knowledge system shown in FIG. 1 according to the present invention.

It is a diagram for

FIG. 41 is a diagram for explaining the overall operation of another embodiment of the real-world object contact system shown in FIG. 1 according to the present invention.

It is a diagram for

FIG. 42 is a diagram illustrating the real world talented X-X shown in FIG. 1 according to the present invention. FIG. 10 is a diagram for explaining the overall operation of another embodiment of the system

Fig. 43 shows the actuating one-time operation command sent to the attached device, and if necessary, the actuating one-time operation command reception confirmation signal or the actuating event notification from the attached device. FIG. 2 is a diagram configured to receive a signal.

Figure 44 shows the information of the additional element in the combination of the position of the luminous occupancy of the additional element and the image of the real world X-X imaged by the second moving image camera. It is a diagram to which information on the X X operation function has been added.

Fig. 45 shows the image of the real world open X-cut with the visible power superimposed on it and the information on the actuation function added as additional element information.

FIG. 46 is a diagram of a case where a visible light emitting element is used as an actuator in the embodiment shown in FIG. 41. FIG. 47 is a diagram of FIG. Fig. 2 In the case of visible light emitters in the evening □

Figure 48 shows an example of the processing of the computer system and accessories shown in Figures 1 and 29. It is a schematic chart showing the outline

FIG. 49 is a diagram for explaining the overall operation of another embodiment of the real world object recognition system shown in FIG. 1 according to the present invention.

Figure 50 is the real world object shown in Figure 1 according to the present invention. It is a diagram for explaining the overall operation of another embodiment of the system.

FIG. 51 is a diagram for explaining the overall operation of another embodiment of the real world object recognition system shown in FIG. 1 according to the present invention.

FIG. 52 is a diagram for explaining the overall operation of another embodiment of the real-world object oral knowledge system shown in FIG. 1 according to the present invention.

FIG. 53 is a schematic flow chart showing an example of the processing of the computer system and the armature shown in FIGS. 1 and 52.

FIG. 54 is a schematic flowchart showing an example of the processing of the computer system and the attachments shown in FIGS. 1 and 52.

FIG. 55 shows, in particular, the attachment of the object and the attachment of the child; the emission of light from the child. Reflecting the past light-emitting partial image of the incidental element on the template of the light-emitting panel for the sake of understanding, and using a template similar to the past light-emitting partial image It is a diagram showing the processing used

FIG. 56 is a diagram for explaining the overall operation of another embodiment of the real-world object X-cut portal system shown in FIG. 1 according to the present invention.

FIG. 57 is a diagram showing the process of using the template used for the position of the light emitting device and the position of the accessory in the past in the embodiment. FIG. 58 is a diagram showing the process of changing the imaging conditions of the imaging means for imaging the light emission of the accessory in another embodiment of the present invention.

FIG. 59 is a diagram for 兌 converting the entire operation of another embodiment of the real world X-X knowledge system shown in FIG. 1 according to the present invention.

FIG. 60 is a diagram for explaining the overall operation of another embodiment of the real-world object recognition system shown in FIG. 1 according to the present invention.

Figure 61 shows the use of a template in which the light intensity at the center of the accessory is near the maximum exposure value and the light intensity decreases conically from the center. FIG. 62 is a view for explaining the overall operation of another embodiment of the real world object recognition system shown in FIG. 1 according to the present invention.

FIG. 63 is a diagram for explaining the overall operation of another embodiment of the real world object X-cut recognition system shown in FIG. 1 according to the present invention.

FIG. 64 is a diagram for explaining the overall operation of another embodiment of the real world X-ray recognition system shown in FIG. 1 according to the present invention.

FIG. 65 is a diagram for explaining the overall operation of another embodiment of the real-world X-cut recognition system shown in FIG. 1 according to the present invention. Best mode for implementing

Hereinafter, a real world object according to the present invention will be described. With reference to the drawings, the best mode for carrying out the knowledge method and the device and the real-world software s accessory will be described.

FIG. 1 shows a schematic configuration of a real-world object recognition system 1 including a real-world object recognition device and a real-world object recognition accessory according to an embodiment of the present invention. Figure showing

As shown in Figure 1, a real-world object contact system

1 is a predetermined recognition target area in the real world (for example, inside a room, outside, or the like), and existing real world objects

The information (real world object X cut information) (hereinafter simply referred to as “office object h”) is sent to a server—a computer system (real world object recognition device) that constitutes the world. 2) The above-mentioned real-world object X-cut information is linked to α-symbols and tems (cyber-worlds) 2 by α. System

As shown in Fig. 2 below, the real world object O is a tree planted in a flowerpot and is an object that constitutes the environment. The object 0c, which is the object of the object b, is an example.

As shown in Figure 1, a real-world object

1 is a combination that recognizes the information of the real world object. 3. Equipped with an evening system 2 and an attached element 11 attached to the real world object and capable of emitting information related to the attached X-box.

Attached element 1 1

For example, an identification information storage means 14 such as a U is provided for storing identification information having identification information such as D.

What: Attachment 1 1. I C I n t e g r a t i o n

C i r c u i t) evening and R F 'I D (Ra d i o F r e q u en c y I D) evening etc.

In addition, the walking element 11 has its function as a self-attached fff brown as the above-mentioned real world object information in response to a light emission instruction command transmitted from the three-pixel system 2. The position information output unit 15 which outputs the position information of the child (the position information of the attached source object X) as, for example, light emission information and the operation command transmitted from the computer system 2. (Attachment of the working element pre-installed in accordance with the operation) 16) The actuating part 16 that operates the 16a and the sensor sent from the pump system 2 In response to the singing instruction, a sensing unit 17, which detects sensing information by a pre-installed sensing means sensor 17 a and transmits it to the computer system 2, is provided. □ Note that it is only necessary for the attachment 11 to have a small number of <15

As shown in FIG. 1, the computer system 2 uses the identification information for distinguishing the above element 11, that is, the object 0 to which the ffT element 11 is attached. Knowledge to generate Transmits a light emission instruction (e.g., an instruction with a content of `` Emit the auxiliary element corresponding to the generation identification '' information to emit light J) to the separate information generation means 20 and the generated identification information. Means 2 1 and 0

In addition, the computer system 2 is configured by a first imaging means 22 and a first imaging means 22 such as a moving image camera, for example, for taking an image of the above-mentioned recognition target area as an imaging visual field. A process for reducing noise included in the imaged video information is performed, and the image information (noise-processed) is captured by the noise processing unit 23 and the first imaging unit 22. The video information) and the i-by-i information generating means 20 発光 based on the generated identification information, a light-emitting point for associating the position of the light-emitting point included in the video information and the identification information; And means for associating position / identification information 25

Furthermore, the computer system 2 is a means for associating 2

Processing for generating and displaying identification force at a corresponding position on the display screen of a display screen of, for example, a display 26 from the identification information and position information obtained from 5, for example, a display. For example, the force information generation means 27 and the first image pickup means 22 for executing the same image pickup visual field (the above-mentioned cutting target area), for example, the second force such as a moving image force camera An image pickup means 30 is provided, and image information picked up by the second image pickup means 30 is sent to the image display means 26 and displayed by the image display means 26. If the separate power is generated, the power information is displayed by folding it onto the video information. 3 Computer system 2 has a user interface section 31 for an interface (IF) for the user who can use the computer system. ―The IF section

3 1 is used together with the image display means 26 and the input means 32 to display the graphing function.

The IF section 31 of sru is integrated with the computer system 2

Even if you are using PX

Communication terminals that can be communicated with the computer system 2 via a communication line such as a power line dedicated line, etc. (for example, a personal computer that can be used by a user). (Evening at the end of the evening or at the end of the belt)

That is, the user operates the input means 32 and clicks and designates a predetermined position of the video information displayed on the video display means 27. を A predetermined request is sent to the user IF section 31. Via the computer to the computer system 2

For example, the above-described identification power is displayed on the video information displayed on the video display means 27. ■ At the Achitan A mouth, the user operates the input means 32. Clicking and specifying the above identification power

In addition, in response to the input via the input means 32 in the IF section 31, the input system 2 transmits the input data to the element having identification information such as the factory 1 J. Factory 2 J Equipped with another information determination means 35 to determine what information is required / ' For example, if the user ^1- user clicks on the position of the input operation 3 2 (specifies) the position, changes the number of clicks, or clicks hierarchically, multiple requests can be made. Can be input to the identification information determination / request determination means 35.

Then, the 3rd-evening system 2 determines whether the sensing instruction for the child is determined by the additional information specified by the separate information determination Z request determination means 35. n, a sensing instruction transmitting means 40 for transmitting a sensing instruction including the identification information of the designated incidental element, and the designated element according to the transmitted sensing instruction information. And a sensing information receiving means 41 for receiving the sensing information transmitted from the sensing section 17 of 11.

In addition, the operating system for the actuator 16a mounted on the specified incidental element specified by the identification information determination / request determination means 35 is determined by the n ump-evening system 2. When it is sent, the operation command including the identification information of the designated incidental element is transmitted, and the operation instruction transmitting means 45 and the operation section 16 of the designated incidental element 11 are transmitted according to the transmitted operation instruction. Performed action Execution notification Operational command Received confirmation P heart signal receiving means (and communication means)

4 6 and are equipped

Then, the 3rd party system 2 is a

The identification information and the light-emission occupation obtained by 5, the position information, the sensing information received by the sensing information receiving means 41, and the corresponding H Additional information and reception means 46 Based on the signal of the action line notification / action received, the operation history information and the corresponding identification information

<Information association that links (associates) any two pieces of information in some way or another-Information moss means (association means) 47

The computer system 2 includes an interface X-section that has a line communication function for the auxiliary element 11, an interface X that can be communicated with the interface X section, and a CD.

(Compmpt Disk)-R 〇 Μ (Read Only memory,

The external memory of the DVD (Digital Versati 1 e Disk) 'can be set to r / computer so that the external memory can be set in a redundant manner. Video information and attached element information (position information, sensor information, etc.) To store a small part of the operating information and the operation history information), a large storage device such as an eight-cage disk, and a quake of the computer. Internal memo that has the function of

Computer with U, etc.-Evening main unit 2a (see Figure 2 below) and the first and second terminals connected to the video input / output terminals of the n Each of the above-mentioned function configuration means is specifically realized by the above-mentioned eight-key configuration.

On the other hand, as shown in FIG. 1, the position information output section 15 of the light emitting element 11 includes a light emission instruction purging instruction receiving means 15 a for receiving a light emission instruction instruction, and a light emission instruction instruction receiving means 15. The identification information comparing the identification information included in the received light emission instruction with the identification information stored in the identification information recording means 14. The light emission control means 15d and the identification information mark that cause the light emitting element 15c to emit light according to the comparison result between the information ratio means 15 and the light emitting element 15c and the separate information ratio means 15b. An identification information transmitting means 15 e for extracting one piece of the identification information # stored in the column 14 and transmitting the extracted identification information # to the computer system 2 is provided.

In addition, as shown in Fig. 1, the actuating section 16 of the auxiliary element 11 has an actuation command received by an actuation command receiving means 16b with an actuation command receiving means 16b which receives an actuation command. The identification information included in the identification information is compared with the identification information stored in the identification information storage unit 14, and the identification information comparison means 16c for operating the operator 16a in accordance with the comparison result. The operation command was confirmed to be received according to the comparison result of the ID information comparison means 16c. A transmission means 16d for transmitting a heart signal and / or an action execution notification indicating an execution result of the action element 16a to the reception means 46 of the π-amplitude system 2; There

In addition, as shown in FIG. 1, the sensing section 17 of the auxiliary element 11 includes a sensing instruction receiving means 17b for receiving a sensing instruction. The identification information included in the sensing instruction received by the sensing instruction receiving means 17 b is compared with the identification information identified by the identification information B self '| According to the result of the comparison, according to the sensing means 17a, the Hamchi operation was performed.

The sensing result (sensing result) of the identification information comparing means 17c and the sensing means 17a for executing (sensing operation) is set as sensing information (sensing information). 3 Computer Haming information transmitting means 17 to be sent to the sensing information receiving means 41 of system 2 17 d anda: provided

In addition, Appendix A3 * element 11 1 is a light emitting element 15 c, working element 1

6a and sensing means (sensor)

Each child is equipped with a computer circuit having a line-communication function, for example, one chip. Each of the functions described above is implemented by a computer circuit.

Hereinafter, the overall operation of the real-world ob-X system 1 shown in Fig. 1 will be described more specifically.

As shown in Fig. 2, the real world objek

In FIG. 1, a computer system 2 constituting a hyper-world for a plurality of real world objects 〇a 、 c is provided with a moving image function as a first imaging means 22. The camera is attached to the camera 103 and the video camera 103 of the camera.

A light emission instruction command device that transmits a light emission instruction command to O c, for example, as an IR light 105 (light emission instruction command transmission means 2

1), and the moving image camera 103 and the luminous command device 105 are in contact with the computer main body 2a, respectively.

In the present embodiment, the light emitting instruction command device 105, which is the light emitting instruction command sender 21, is attached to the video power camera 103, but is not limited thereto. It is okay to be separated from the video power camera 103 Each of the X-cuts 〇a 〇c has an additional element 1 1 (1 1a1 1b1 1c) to which an identification ID (m 1 mm + 1), which is different information, is assigned. Each of the attached W-systems 1 1a 1 1b 1 1c is associated with a light-emitting instruction "P-pachi-height from the P-device 5 as described below. It is attached so that the moving image camera 103 can capture the light emitted in response to the light emission instruction command.

An accessory 11 attached to each of the light X 1 is a communication means (light emission instruction reception means 15a) for receiving the light emission instruction command from the light emission instruction device 5 and a light emission instruction. The communication means having the light emitting element 15c that emits light in response to the command is, for example, an RF receiver, infrared light receiving, RF transmitting / receiving, infrared transmitting / receiving, and the like. The light emitting element 15C is an example. Light emitting diode (L Ε D) laser ― E

In this embodiment, which is composed of a device that uses reflected light and a device that emits light, this device uses infrared light reception as communication means. Infrared LED is used as the light emitting element.Identification ID (m-1 mm + 1) assigned to each attached element 1 1 a 1 1 b 1 1 c Is used as a number to identify each tag 11, but is actually used to identify each object h in the real world to which the tag 11 is attached. Can still be used Image force film 103 is a moving image force sensor that is sensitive to the emission wavelength output from the photon of incidental member 11.

The image of the accessory 11 existing inside the visual field area 109 of the moving image power camera taken in 103, which will be described later.

J has a function to output the image of the light emission image from the light emitting element of the incidental element 11 in units of output frames. Specifically, the moving image power 103 is a power source for a predetermined time. The image sensor in the camera senses light and outputs it as a 1-frame still image.The output operation as a 1-frame still image is repeatedly repeated at a high rate. In this embodiment, the still image of one frame is sequentially generated in time series to capture and output a video. The frame image for each frame period is shown in the figure. In the figure, the upper part of Fig. 2 shows the 3-computer system 2 of this embodiment, in which n-1 nn + 1 is divided. Thus, each frame generated by repeating periodically

Start time of (n 1 1 n n + 1) Time corresponding to occupation

····················································································································· Tm Upon receiving the light-emitting instruction to be transmitted to the antenna 11 of the antenna, the light-emitting device 11 determines the identification ID included in the light-emitting instruction "P". If the IDs match, the command is interpreted as an instruction to cause the own light-emitting element to emit light, and white light is emitted. The child is caused to emit light for a predetermined duration. In addition, do not emit light to an opening that is different from the identification ID to which the other ID is assigned.

That is, as shown in Fig. 3, [First, the frame (n-

1) at the start of the process, and at time Tm-1 which corresponds to 識別, identification I

When a light emission instruction command (ID = m-1) including D (m-1) is transmitted from the light emission instruction command device 105 of the amp system 1 (FIG. 4; step). S1), this flashing instruction command

In response to (ID = m—1), the adjunct 11a of the identification ID (m-1) responds based on the comparison processing of the identification information comparing means 15b, and the adjunct element 11a As shown in the figure, the light-emitting element 15c of the light-emitting element 15c has a light-emitting duration (IDm--1) set in association with ID = m-1 based on the light-emitting instruction command.

Flash for only one flash duration (Step S2)

When the next frame (n) starts, at the start time, at a time Tm corresponding to ヽ, a light emission instruction command including an identification ID (m) is issued (ID = m). Transmitted from the device 105 (step S 3), in response to the light emission instruction command (ID = m), the auxiliary element 11 b of the identification ID (m) is transmitted to the identification information comparing means 1. The light emitting element 15c of the incidental element 11b is set in association with ID = m based on the light emission instruction command as shown in the figure. Flash only for the flash duration (ID = m flash duration)

(Step S4).

When the next frame (n + 1) starts, 1 开 The time corresponding to the time occupation Tm + 1 1 1;

The light emission instruction tap T3 including ID 1) and ID = m + 1) are transmitted from the light emission instruction instruction β105 to the light emission instruction command (ID = m + 1) in (Step S5). Then, the incidental element 11c of the identification ID (m + 1) responds based on the comparison processing of the identification information comparing means 15b, and the light emitting element of the

As shown in the figure, 15 c is <ID based on the light emission instruction command.

= m + 1 and the emission duration (I

D = m + 1 Flash duration only (flash duration) (Step S

6).

In the present embodiment, the light emitted by the light emitting element of each of the fff elements 11 slightly overlaps from the start of the light emission start frame to the start of the next frame. At the beginning of each frame, the emission of frame 刖 overlaps the emission of the next frame.

In addition, the light emitted by the light emitting element of each of the above-mentioned incidental elements does not emit light for a preset light emission duration.Even if all light emitting elements emit light with the same light emission duration. O Each device may emit light at any time o

By repeating the above operation, the light emitting element of each of the attached elements 11 1 emits light sequentially in response to the light emitting instruction command sequentially transmitted from the light emitting instruction W-1 105. Light emission from the light-emitting element of element 11

It is received at 03 (step S7). That is, video power Since the lens 103 is sensitive to the wavelength of the light from the photon of the appendix 11, it can capture its emission image, and the result is used as the output frame image. O Therefore, in the computer system 2, the output frame image output from the moving image camera 103 for each frame in the computer system 2 By adjusting the signal strength in each image of the above, the position of the light emitting element of the incidental element 11 having the identification ID specified by being included in the light emitting instruction command in the visual field (position)

-Identify the identity of the constellation)

(Step S8).

M. Physically, the computer system 2 is a video camera

1 0 3 Flash command device 1 0 5 and associating means 2

The light emitting instruction command device 105 recognizes the identification ID of the incidental element 11 specified by the light emitting instruction command by the cooperation operation of 5 and the identification ID and moving image information. The correspondence with the frame number of the output frame image of

識別 Identification corresponding to the frame number of the output frame image I

Appears the emission position of element 11 with D

Then, at the position of the attached w element 11 specified as described above, the associated ^ 1 element 11 is attached to the object X

Knowing the position of 〇, the position of the X-ray o-Xo o is located on the system that composes the server world. Sincerely, that is, to connect to the world of saba as X-o

In the above embodiment, it is attached to each obec Attach child 1 1 1 1

When the light emission instruction command is received from 105 and the identification ID matches, the light emitted from the camera is captured by the video camera 103, and the position of the light emission is occupied. The position of the real world object X specified as the position of the object is linked to the object X object of the three-computer system 2 (server world) specified by the identification ID. Therefore, events that cause the real world's Xbox, such as the human environment, to be triggered, are sent to the U.R. It is possible to create a variety of services that are closely related to hanging life using computer evening networks.

In this embodiment, the method of object X-cut to □ is such that, for example, one side of a corner of a home or a store office is, for example, a space of about 10 m or less. In humans, it can be seen at a speed that can be seen and perceived by humans, including the observable X-cuts. What you are doing

The eyes, tol, are motorized displays that correlate with real-world opponent images that humans are observing, such as the identification ID and location of the Xbox X-Cut. The time element is attached to the X-box which is related to the content of the video base derived from the video.

1 is small and low power consumption <cheap

Fig. 3 is shown in Fig. 2

Each ancillary element in the embodiment 1

Illustrates the frame image output from camera 103 (image frame for each frame-evening) Note that in Fig. 3, the output of the light emission instruction command from the light finger 7 ^ position 105 is shown in Fig. 3.

fff The emission time from the light-emitting element of element 11 is the same as in Fig. 1.

In Fig. 3, the light emission instruction "P

In response to a light emission instruction command (ID = m-1) output at time Tm1 at the beginning of (n-1)

The light emitted from the light emitting element of 1a is a moving image.

The video image taken at 0 3 and output as a frame image n-1-1 in the same figure is attached to the frame image n- 1 output from 03. The emission image from the luminous element of 1a is shown as a circle as indicated by the reference symbol I3a.The size of the emission image I3a in the frame image in the frame image. Represents the temporal integration value of the X-ray energy (intensity) of the luminescence received by the moving image camera 103. Specifically, the longer the luminescence is, the longer the time is. <The larger the diameter of the circle, the more <

In response to the light emission instruction τι (ID m) output from the light emission instruction n device 5 at time T m during the first J period at the start of frame (n), as described in | p]. The light emitted from the light-emitting element of the incidental element 11b is captured by the moving image camera 103 and is output as the light-emitting image Ib in the frame image n. In addition to the emission image Ib corresponding to the emission from the light emitting element of the element 11b, the element 11a emits light with a slight overlap at the beginning of the frame (n). Luminescence The light emitted from the light emitting element of the incidental element 11b is also indicated by a small circle, and the light emitted from the light emitting element of the incident element 11b is of the frame (n). The light emitted from the light-emitting element card of the incidental element 11a emits light only for a short time at the beginning of the frame (n), while the light is emitted over the entire period. Therefore, the luminescence image Ia is smaller than the luminescence image Ib and the luminescence image Ia is smaller than the luminescence image Ib. In the same way, the frame (n +

In response to the light emission instruction (ID = m + 1) output at time Tm + 1 in synchronization with the start of 1), the light output from the light emitting element of the incidental element 11C is a moving image. The frame image n + 1 is output as a light emission image I c on the frame image n + 1, and the frame image η + 1 has a light emitting element In addition to the luminescence image I c corresponding to the luminescence of the above, the luminescence from the luminous element of the attached element 11 b that slightly overlaps the luminescence at the beginning of the frame (n + 1) Corresponding outgoing

-The light image Ib is also shown as a small circle. Note that the emission image Ib is noise with respect to the ^ light image Ic.

Fig. 5 shows the emission image I3aI3b that appeared as noise in the frame image of the moving image camera 103 as shown in Fig. 3 as a single frame. FIG. 9 is a diagram for explaining a difference process for removing by subtraction (difference) with an image.

The frame image nn + 1 shown in Fig. 5 is explained in Fig. 3. As shown in the figure, the emission image I 3a1 3b appears as a noise, but in order to remove the emission image as a noise, the computer system 2 is used. In the example in Figure 5,

For example, a subtraction process from the previous frame image is performed. For example, a frame image n for identifying the position of the incidental element 1 1b (obtain X cut 〇b) with the identification ID m In order to remove the emission image I 3a appearing as noise in

The computer system 2 subtracts the previous frame image n-11 from the corresponding frame image n by the noise processing means 23 (see FIG. 6). The remaining pixel signal of a predetermined value or less is subtracted as a result of the subtraction of S 10), which is referred to as a signal (step S 11). The difference image 1 2 1 ab is obtained for the Xb of the identification ID m in which only the luminescence image I b from the luminous element I b exists. Therefore, the difference image 1 2 From 1 ab, it is possible to accurately identify the position of the incidental element 1 1 b (Obn X cut Ob) of ID m according to the ID m according to the noise.

Similarly, the incidental element 11c (identified by ID m + 1)

Frame image n + for identifying the position of X-cut ο c)

-

In order to remove the luminescence image Ib which appears as noise in FIG. 1, the computer system 2 uses the noise processing means 23 to remove the emission image Ib. One frame image n is subtracted from 1 (Step S 1), and the remaining pixel signals of a predetermined value or less are silenced (Step S 1). Step S 13), whereby the identification ID = m in which only the emission image I c from the light emitting element of the accessory with the identification ID = m + l exists

The difference image 1 2 1 b c for the +1 object X is obtained. Therefore, from the difference image 1 2 1 b c, the auxiliary element 1 1 c (object 〇) with identification ID =.

The position of C) can be accurately determined without being affected by noise.

In the above explanation, the frame image signal strength is set to 1 • 1 as the target of the difference processing, but it goes without saying that the difference processing with an arbitrary intensity ratio is also effective.

FIG. 7 shows the emission images I3a and I3b that appeared as noise in the frame image of the moving image camera 103 as shown in FIG. FIG. 9 is a diagram for illustrating a difference process that is removed by a subtraction process.

As the subtraction processing shown in FIG. 7, the convenience display system 2 doubles the signal intensity of the giant frame image for identifying the position of the incidental element 11 and doubles it. Subtracts the subsequent frame image from the doubled frame image.

Specifically, the computer system 2 uses the noise in the frame image n for identifying the position of 1 lb (object 〇b) of the incidental element having the identification ID m. In order to remove the emitted light image I3a that appears, the noise processing means 23 causes the frame image n to be doubled and the frame immediately before the frame image n to be doubled.

-N image n-1 minus the next frame image n + 1

(Fig. 8 step S20), that is, the frame image of the attention (n) X 2 {frame image (n-1) + (post-frame image (n + 1)] \ subtraction is performed, and the subtraction result is equal to or less than a predetermined value. The image signal is turned into a signal, that is, a signal (step S21), whereby only the emission image I3b from the light-emitting element of the incidental element having the identification ID = m exists, and the identification ID m The difference image 1 2 1 abc related to the object h

Therefore, it is possible to accurately specify the position of the accessory 11b (observer 〇b) with the identification ID = m from the difference image 12 21 abc without being affected by noise. Out

Similarly, a frame image n + for identifying the position of ancillary element 11 c (object 〇c) with identification ID = m + 1

In order to remove the emission image I b ′ appearing as noise in FIG. 1, the pump-evening system 2 is controlled by the noise processing means 23 to obtain the frame image n. + 1 signal strength is doubled, then one frame image n and the next frame image n

+ 2 is subtracted, that is, the frame image (n + 1) X

2 One (frame image (n) + (back frame image (n +

2)) Calculate the following 3 or 2 and make the remaining pixel signal below the predetermined value as a% reduction signal no signal, and

Only the luminescence image Ib of the element w of the element w with D = m + 1 exists. The difference image 1 2 1 bcd for the obscure X cut with the identification ID = m + 1 is obtained. (Step V S 2 2 S 2

3).

Identification ID = m from the difference image 1 2 1 bed The position of the + 1's accessory 1 1 c (Ob X X O c) is affected by noise. <It is not possible to specify the position accurately. In this example, the signal intensity ratio between the giant frame image and the adjacent frame image was set to 2 • 1 for the frame image that was used. I don't know

The subtraction processing shown in FIG. 5 and FIG. 7 described above is supposed to remove the shadow of light emission from the incidental element having the desired identification ID, but the subtraction processing is particularly effective. It is effective not only for removing the effects of various light emissions, but also for removing noise from such noise sources.For example, natural light such as sunlight. It is effective to remove noise and other fields that appear as noise, such as light and mon signals from electronic devices such as U-monitors, whose numbers have increased rapidly in recent years.

Fig. 9 shows the difference processing performed in Figs. 5 and 7, and in addition to the emission signal of the illuminant of the incidental element 11, the noise signal from the illuminant such as sunlight is left. Teshimatsu

The figure for §convertible fixed space file processing that removes noise signals like

That is, in the spatial file processing shown in FIG. 9, the computer system 2 uses the spatial filter for the difference-processed frame image n obtained in FIGS. 5 and 7. Shows an example of performing the lunar processing

In the spatial filter processing of the computer, the computer system 2 uses the noise processing means 23 to perform the frame processing after the partial processing. In the upper left corner of the f-elevation η, add the signal strength values of all the pixels in the rectangular filed U-ring range 1 26 that indicate the file size to the sum (Figure 10). By dividing the sum by the number of strokes, the filtered U

The average value in 26 is used as the signal strength of each pixel in the filtered range 1 26 (Step S31) .The filtered range 1 26 is While moving in the direction shown by the arrow 1 25, the processing of steps S 30 S 31 is executed for the entire area of the frame image n after the difference processing (step S 3 2) In the spatial filter processing of the field n, the signal strength of the image that is spread over the filter size is reduced. As a result of the spatial filter processing, the spatial filter processing is performed. The filtered frame image n1 24 is obtained after filtering, but the spatial image after frame processing n1 24 is originally ancillary with locally increased intensity. The light emission signal of the light emitting element of element 1 is strengthened, and the noise signal which is not widely distributed and not strong is weakened. Since the difference in intensity from the signal is widened, it is possible to assign priorities in accordance with the intensity. In the example shown in FIG. 9, the light emitting signal of the light emitting element of the incidental element 11 has the priority 1 The noise in the lower right corner is the second highest priority. The center noise is the third highest priority.So, the low-priority system 2 has the highest priority.

When the image is determined to be a light emission signal image from the light emitting element of No. 1, the first coordinate is added to the desired object O Emission occupation of the photon of the attached element 11 can be determined as the position of the attached element 11, that is, the position of the X-box X (step S 3 3)

Figure 11 shows an example of using the spatial matching process instead of the spatial filter process shown in Fig. 9 for skiing. Element 11 Other than the light emission signal of the light-emitting element, for example, noise matching from a light source such as sunlight lighting is removed.Pattern matching processing is performed. It is a diagram for explaining the unmatching process.

In other words, in the pattern matching process of Fig. 11

5 and the frame image n 1 2 after difference processing obtained in Fig. 7

7 shows an example of performing evening matching on

In the evening-matching process, the skipping system 2 is provided by the noise processing means 23 by the square processing region 1 shown in the upper left corner of the frame image n after the difference processing. 3 Perform pattern matching processing on the image patterns of all pixels in 1 to obtain a correlation with the definition pattern similar to the emission pattern of the light emitting element. (Fig. 12 Step S40) The definition pattern in the pattern matching area 13 1 of this pattern corresponds to the light emission pattern of the light emitting element of the incidental element 11 1. The strength of the cone is defined as a cone where the strength decreases from the center <to the periphery of < Then, the pedestal system 2 sequentially changes the packet matching area 13 1 over the entire area of the frame image n after the difference processing as indicated by an arrow 12 29. While moving, the pixel pattern within the packet-matched area 13 1 is defined as the pattern pattern, and pattern matching processing is performed. Obtain a matching result at the current position (Step S

4 1)

As a result of the V-matching, the frame image n 1 2 after the pass-matching process is protected and the frame image n 1 2 after the pass-matching process is protected. In figure 8, the shape of the emitted image is different even if the intensity of the light emission signal of the light emitting element of the incidental element 11 is large and the intensity is strong in other noise parts. Therefore, the setting value and litching value are small.

<As a result, the intensity difference between the emission signal of the desired light-emitting element and the noise signal is widened, and it is possible to assign a priority order according to the intensity as shown in Fig. 11. In the example, the light-emitting signal of the light-emitting element of the attached element 11 has the highest priority. The noise in the lower right corner has the second priority.The noise in the center is removed. Is determined to be a light emission signal from the light emitting element of the accessory 11 1, and the light emitting element 11 having the first priority position attached to the desired object is assigned ^! The position of the luminous occupancy of the child, that is, the position of the ffT child 11 is subtracted, and it is determined that the position is the position of Xeven X 0 (step S42, FIG. Frame after spatial filter processing Based on the drawing lacquer image n 1 2 4 and the image of the evening matching processing frame image n 1 2 8 in Fig. 11, the priorities are compared to determine the final priority. FIG. 3 is a diagram for explaining a process of extracting X-rays for identifying a light-emitting point of a light-emitting element of the element 11 to be detected.

That is, as shown in FIG. 13, the impulse system 2 is converted into a frame image n 12.4 by the noise processing means 23 and the spatial filter processing a in FIG. After comparing the frame image n 1 288 with the pattern matching process of 1 1, the comparison is made (FIG. 13: Ste, S 50). For example, both are extracted after both processes. When only the extracted signals are extracted, as shown in the figure below, the signal with the third priority in the spatial file after-frame processing image n124 is removed and the signal with the first priority is removed. Only the second and third place signals remain 着 Set a predetermined threshold based on the strength of both remaining signals and compare the threshold with the first and second place priority signals and above the threshold value Extract only the signal> (Step S5)

However, the threshold value is determined from the maximum value in the detected signal or is a value determined in advance. As a result, the signal above the threshold is the only signal at the upper left, and this signal is finally determined as the signal with the highest priority, and the signal from the sensor 11 that detects this signal is detected. As described above, the light emission points of the elements are different. As described above, the frame image n1 24 after the spatial file processing shown in FIG. 9 and the notching shown in FIG. 11 are obtained. Determine final priority from processed frame image n 1 2 8 and camera Various methods can be applied. For example, there is a method of using one of the fruits, or a method of combining the two. The choice of which method to use is a matter of judging the intended use.

In the comparison with the above-mentioned threshold value, when multiple signals exceed the threshold value, it is considered that the threshold value is changed and the comparison is performed again, and furthermore, some image processing is performed again. Is considered to be applied, but it should be judged based on the intended use.

FIG. 14 is a diagram showing a result obtained by integrating the processes of FIGS. 1 to 13 described above.

That is, as shown in FIGS. 2 and 14, the computer system 2 first issues a light emission instruction command including the identification ID specified by the light emission instruction command device 105 to each accessory 11. To the camera to make the light emitting element of the incidental element 11 with the matching identification ID emit light (see steps S1 and S6). The next light emission is captured by the video camera 103. (See step S7) and output it as the output image frame containing the light emitting point

Next, the noise system 2 removes the noise by performing a difference process between the output image frame and the adjacent image frame by the noise processing means 23 (Steel). S 1 0 S

Then, the image subjected to the difference processing is subjected to the spatial filter processing and the pattern matching processing to perform the difference processing. Further remove the noise from the system even after the processing (Steps s3 0 S3 3 and / 'or Step S4 0 S4

2).

Next, the computer system 2 compares the frame images after the spatial file processing and the frame matching processing by comparing the priorities of the frame images. The prioritization is determined among the signals within the rem, the determined signal of the prioritized priority is compared with a predetermined threshold, and finally the luminous occupation of the first priority is determined. (Step S57).

Figure 15 shows the correspondence between the luminous pattern of the first priority determined in Figure 13 and the position information of the accessory 11 attached to the abbot, and the coordinates in the frame image are shown. Ancillary element 1

FIG. 4 is an explanatory diagram showing that the position information is set to 1

That is, the computer system 2 is a correspondence means.

25 Emitting the light from ra 5

T m is the time when the light-emitting finger is ordered, and m is the output image from which the light emission is imaged. Frame image of the signal that was ranked first in frame n. Inside coordinates

As shown in 34a, it can be extracted as (X m, Y m) (Step S60). This is the position of the signal with the first priority. From the above description, the coordinates (XmYm) in the frame image of the first priority to indicate the emission from the accessory 11 of the identification ID m are set to the time Tm. In the same way, the light emitting instruction including another ID = m + 1 was struck. For the output image frame n + 1 for the time Tm + 1, the coordinates in the frame image are as shown in Fig. 9 at 34b.

(X m + 1, Y m + 1) (Step S

6 1).

FIG. 16 shows the different IDs of the objects extracted as shown in FIG. 15 = m, m + 1,..., The time Tm, Tm + 1,. , Coordinates of the object image in the frame image (Xm, Ym), (Xm + 1, Ym + 1)

Is a diagram showing a process of generating a file in which frame data are associated with each other, that is, a file 135 for extracting position data in a frame image of each object X.

That is, the convenience system 2 is provided with the association means.

According to 25, each time (τm, Tm + 1 ...

,) And the corresponding position in the frame image of each identification ID (m, m + 1,…) extracted from the corresponding output frame (n, n + 1,…) (Step S6 5., Step S6

6), and then corresponded to each identification ID (m, m + 1,

..) And the position coordinates in the frame image, a position data extraction file 135 in the frame image of each object is generated (step S67). .

That is, the position extraction in the frame image—the evening extraction file 135 is made up of each object ID (m ...

, M + 1,) corresponding to each time (T m, T m + 1,…) and screen coordinates

(XmYm), (Xm + 1, Ym + 1 •), ... are registered in correspondence with each other. Fig. 17 shows the location data extraction file 1335 in the frame image of each object shown in Fig. 16 in advance and the information file in the computer system 2 in advance. In this figure, it is shown that the object is configured and handled as object database 141. As an example of an information file in the compilation system 2 of this example, a file 1337 relating to the name of an X-box is illustrated.

The file 1337 relating to the name of the object is stored in advance as another file in the form of information about the object X (in this embodiment, the information attached to each object X File).

In the connection with the information in the computer system 2 in Fig. 17, the association means 25 uses the U-Receiver 3 based on the dfck object ID based on a narrative database concept. In the frame image of each object m Data extraction file 13 5 and the name of the object X

Prior to the connection of (Step V V S7'0), which is connected to the element 1337, the position of the attached element 11 attached at the time Tm with the identification ID = m is -Screen coordinates, which are coordinates in the image

(X m Y m), but it is not clear how long it would take to combine this with the file 37 about the object name, as in this example. Where the name A is the coordinates

(X m Y m), it is possible to construct a job X 14 table that can be obtained as information that can be easily understood by humans. The connection between the files may be a filer in a storage area of an external storage device such as a computer to an eight-disk in an evening system 2, or may be a filer. Repentance between a number of different pump systems via a network not shown Files in the TJ shell area |

Figure 18 shows the location extraction file 1335 and the evening file 1337 relating to the name of the object X in the frame image of each object described in Figure 17. The other X is the X-shaped X-X-Dot that is linked with the X X-ID, and is the other term g for the T-file 1337, which is the object named for the object 141. Information file 13 8

The information base 144 is configured by α by the associating means 25 of the computer system 2 (step S7).

(See 1)

In the information file 1338, information such as hobbies, purchase histories, color prices, URL-B, etc., is registered in correspondence with the card.

P (Int (ernettProtoco1 1) Shows that information can be obtained from subsites by accessing the X-subsites existing on the i-network 151

As shown in Fig. 18, when multiple files are opened with multiple keys through multiple keys, the added value of the information provided by gadegaki is increased. For example, in this example, it is assumed that the purchase history of the name A at the coordinates (XmYm) at time Tm is XX. As described above, UR • L '(Uniform Resource] Locator, which indicates the location of a file on an IP network, is used as additional information as described above. If added, it is also possible to extract information from the site of the specified URL and add it to the record information as additional information

In addition, the connection between the files was also established by the file technicians in the storage area of the external storage te storage such as the eight-disk disk of the three-computer system 2. Is the A of files in the storage area between different computer systems via a network (not shown).

■ It may be the same as that mentioned above

Fig. 19 shows the position extraction in the frame image of the 刖ブン才ブンブンブン刖ブン抽出 1 抽出 5 5 5 5 1 サ 5 ササササEvening system 2 or a space built from multiple computer systems connected to the network and the information accumulated in the 3rd evening system) Is a diagram showing that in connection with the management of Xbox X in the real world and the Xbox management of the real world and the SIVOR world-evening 145

For details, <indicates that computer system 2 is

The position extraction file 135 of the X-frame in the frame image is used as the identification ID, which is a common term between the X-cut list 13 and the X-box 13 in the server world. Correlation means 2

5 to combine the world with the world h Management table 1 4 5 is configured (step s

7 3 Cyber-The object list 1339 on the top has the identification ID position time, attribute, sensing information, etc. as items 100

To temporarily manage a thing in the real world as an object in the server world means to manage its properties. Is usually limited to fixed information that can be supplemented in advance.For example, if it is a book, it is a book, a publisher, and so on. In the real-time, as shown in the position extraction data file 135 in the frame image of the

-To recognize the location information of the world object and associate it with the identification ID to provide a mechanism for other files to be provided by the public. Previously, the fixed X server was able to add the real-world location information to the real time as a big item in the above X list 1339. ―The above information can be dynamically changed in accordance with the real world. That is, Saiha and Saibun X are managed according to the real world, and the real world is managed. Achieving a close connection to the world and joining the world with the world of Saba

FIG. 20 is a diagram for explaining the overall operation of another embodiment of the real world object oral knowledge system 1 shown in FIG. 1 according to the present invention.

In the embodiment shown in Figure 20, the computer system The lighting of the attached element 11 that emits light in response to the light emission command is performed by the motion of the lighting device. When the frame is synchronized with the frame period of the camera 103, the occupation of the light emitting element of the incidental element 11 within the frame time of the moving image camera 103 differs. Other components and functions are the same, and the same components are denoted by the same reference numerals and their description is omitted.

FIG. 21 is a diagram showing the respective attachments in the embodiment shown in FIG.

Video camera that captures the luminescence image from the luminous element 1 1

3 shows the output frame image (image for each frame τ evening).

In the present embodiment, as shown in FIG. 20, the light emission indicating device 105 of the illumination system 2 and the moving image

The occupancy of the incidental element 11, which emits light in response to the light emission instruction from the light emission instruction device 105 by cooperating with the light emission instruction device 103, is used as a moving image. In addition to this, the emission time of the luminous element of the accessory 11 is set within the frame time of the moving image camera 103.

As shown in Fig. 21, the frame images η and η + 1 output from the moving image power camera 103 are attached to the -W element 1 1b1 1c from the light-emitting element. Only the light emission image I 3 b I 3 c appears, and as shown in FIG. 3, the portion of the light emission image from the other incidental element 11 does not appear as noise. Therefore, correct the attitude at the position of the attachment 1 1 Because it ends at every frame, the speed of the animation is as fast as the frame cycle of 103. Sense of mind is possible □

FIG. 22 is a diagram for explaining the overall operation of another embodiment of the real-world obnext X-centre system 1 shown in FIG. 1 according to the present invention.

As shown in FIG. 22, in this embodiment, each of the additional elements 1 attached to the X-box 0 of the real world is particularly important.

When the light-emitting element 15C of 1 synchronizes with the frame of the moving image camera 103 under the control of the light-emission control means 15d, it repeats at a predetermined frequency In addition, each accessory 11 is pre-allocated to its own device by transmitting the light for a period of J times and emitting light repeatedly and of a predetermined period, for example, by a transmission means 16 d or the like. The obtained identification ID is transmitted to the computer system 2. The identification ID is included in the light emission and transmitted to the computer system 2. It is also possible to take any means by sending it to the computer system 2 via another communication path.

At this time, as shown in FIG. 4, the computer system 2 captures the light emission of the incidental element 11 with the moving image camera 103 and transmits the light in response to the light emission of the auxiliary element 11. In the same way as described above, the position of the light-emitting area captured by receiving another ID is specified as the position of the real world object X, and the position of the specified real world object h is specified. Create a world In the computer system 2, the mouth, i.e., the object corresponding to the different information, or the object having the above position, can be set to the world of the cyber world.

Figure 23 is the real world X X K1 shown in Figure 1. 7 is a diagram for explaining the overall operation of the mind system 1 in another embodiment. In particular, the light emitters 15c of each accessory 11 correspond to the control of the light emission control means 15d. When the video is synchronized with the frame of the camera 103, it emits light after a gad time of random length, which is periodic.

In the embodiment shown in FIG. 23, the accessory 11 is spontaneous when it is synchronized with the frame of the moving image camera 103 by the transmission means 16, for example. A guide of a short length, and in synchronization with the light emission repeated after time, an identification ID previously assigned to white as in FIG. 22 is compiled. The ID that is sent to the evening system is not included in the light emission, and may be sent to the evening system or sent via another communication channel. It is possible to take any means by sending it to the system

The ancillary element 11 is a non-periodically random gad for synchronizing with the frame of the moving image camera 103, emits light repeatedly after time, and emits light. Synchronize and identify

Since the ID is transmitted to the computer system, the computer system 2 captures the light emission of the fir element with the moving image camera 103 and captures the light. Transmitted in synchronization with light Received another ID and received the image

,

As described above, the position of the real world talent

, *

The position of the specified real world talent X Xh is specified in the computer system 2 constituting the server world, that is, the object corresponding to the identification information and having an upper position. FIG. 24 shows that the whole operation of the real-world object recognition system 1 according to still another embodiment of the present invention is expressed as p. It is a diagram for the purpose of explanation, and in particular, the accessory attached to the Xbox X 0

In response to a light-emitting instruction command from the light-emitting instruction device 105, the light-emitting device repeatedly emits light for a predetermined period of time at a predetermined period.

In the present embodiment, as shown in FIG. 24, for example, the light emitting element 15c of the attachment 11a is operated at the time Tm-1 according to the control of the light emission control means 15d. In response to the light emission instruction command output from the light emission instruction device 105 of the computer system 2, the light emission is repeated at a predetermined cycle T and spontaneously emits light for a predetermined time. When the element 1 1b 1 1c also responds to the light emission instruction output at time TmTm + 1 in the same manner as 1J, the element repeatedly repeats at a predetermined cycle T. The light emission instruction command is repeated for a predetermined period of time Τ in accordance with a light emission instruction command so that the light is emitted for a predetermined time, thereby reducing the number of times the light emission instruction command is output. Light emission instruction device 1 0

5 and the frequency of communication between the light receiving means of In addition, the ft work is reduced and the energy consumption is reduced.

In other words, in the present embodiment, the accessory 11 attached to the object X in the real world and assigned an identification ID in advance is a computer system constituting the hyper-world. When the light-emitting instruction command containing the identification ID is received once from the system 2, the identification information included in the light-emitting instruction command is the identification information assigned to itself. Flashes repeatedly at a predetermined period for a predetermined time in response to a flash command

Then, in the amp-evening system 2, the light emission of the incidental element 11 was imaged with the moving image camera 103, and the position of the light-emission occupancy was compared with the position of the real world X-box. Then, the position of the specified real world X-cut corresponding to the identification ID is assigned to the server world as an object corresponding to the identification ID and having the above-mentioned position.

FIG. 25 is a diagram for explaining the overall operation of another embodiment of the real world object recognition system 1 shown in FIG. 1 according to the present invention. In particular, FIG. In the configuration, the light emission of the tag 11 emitting light in response to the light emission instruction is synchronized with the frame period Τ f of the moving image camera 103 and the light emitting device of the tag 11 is also emitted. The light emission duration is set within the frame time of the moving image camera 103. In this embodiment, the other components, operations, and effects are the same as those of the embodiment shown in FIG. The same components are denoted by the same reference numerals and their description is omitted. Fig. 26 is a diagram for illustrating the overall operation of another embodiment of the real world object X 'B' knowledge system 1 shown in Fig. 1 according to the present invention.

In the embodiment shown in the figure, the real world observing system 1 is the first moving image which is the first imaging means 22 in the embodiment shown in FIG. In addition to the force camera 103 a, the second moving means 30, which has the first moving image force 103 a and the same image field of view (field of view 109), is the second imaging means 30. The second video power camera equipped with a video power camera 103b

103 b is an image of the real world object X attached to the appendix 11 and an image of the real world object taken by _ and an image of the first object. Moving image The position of the object X obtained from the image captured by the camera 103a is located on the computer system 2 in the server world. The other components and effects are the same. One component is the same. The same components are designated by the same reference numerals, and the corresponding components are omitted.

The second video power camera 103b is a so-called general digital camera and can capture a visible image, but it is not necessary to use a video power camera. Still image power is good

First video power camera 1 0 3 a and second video power camera 1

0 With 3b-Evening in System 2

The light emission of the ftr element 1 1 is imaged by the first moving image camera 103 a and the light is emitted by the second image camera 103 b--fW element 1 1 The image of the attached real-world object 〇 is shown in Figure 26 in the lower right corner, and the image of the object 15 1 (T m) { }, 1 5 1 (T m + 1)

{At light time T m + 1}

In the present embodiment P, which is configured as follows, the identifier 11 attached to the object X in the real world X is identified by the identifier I.

It is the same as the embodiment table p in FIG. 2 in that it is configured to emit light in response to the light emission instruction command from the light emission instruction command device 105 when D is assigned. When the incidental element 11 receives a light emitting instruction including an identification ID for identifying the incidental element 11 from the light emitting instruction instruction 105 of the computer system 2, the incidental element 11 issues an instruction to emit light. Emit when the identification information included in the instruction is the identification information assigned to you.

In the illumination system 2, the emission of the incidental element 11 is imaged by the first moving image camera 103a, and the AT element is emitted by the second moving image camera 103b. 11 The image of the real-world object 帯 attached to 1 撮像 is taken, and the position of the luminous occupancy imaged by the first moving image camera 103 a is displayed in the real-world object X-X The position and identification ID of the specified real world object 0 specified as the position of 0

The image and position of the real world object ο associated with the image of the real world talented object 像 imaged in 103 b are displayed in the world of the world (computer system 2). I'm going to say it above

Figure 27 shows the first video power camera as explained in Figure 26.

-tth

The relationship between the position of the light-emitting point of the appendix 11 captured in 103 a and the image of the real world object X-ray captured in the second moving image camera 103 b is As shown in FIG. 27, the computer system 2 has the first moving force camera 1 at the light emission time Tm by the associating means 25 as shown in FIG. 27. 0 3a The identification coordinates of the real world object 0b obtained from the image picked up by 0a, the ID = m, and the position coordinates of the luminous occupancy of the accessory lib indicated by the code 1 3 4 (T m). X m Y m) in synchronization with the imaging timing of the first video power camera 103 a at the same time T m with the second video power camera 103 b. The image 15 1 a of the real world object 〇 b is changed to □ (FIG. 28, step S 80, and then the light emission time T m +

The identification of the real world X X 〇b obtained from the image captured by the first moving image power camera 103 a in Step I D = m +

The sign of 1 is 13 4 (T m + 1). The position coordinates (coordinate data) of the luminous occupancy of the incidental element 1 1 c (X m + 1 Y m +

1) is synchronized with the imaging timing of the first video power camera 103a, and is captured at the same time Tm + 1 with the second video power camera 103b. Each of the real worlds displayed in the video content (image) by an operation like step 15 (step S81 1) of the image 15 The image and position of object X cut 0 can be extracted on 3 computer system 2

FIG. 29 shows the occupancy of the light emitted from the appendix 11 taken by the first moving image camera 103 a described in FIG. 27, the position of ヽ, and the second moving image.

, ❖

In association with the image of the real world X-cut O taken by the force camera 103b, the light emission of the accessory 11 imaged by the first moving force camera 103a FIG. 5 is a diagram in which the visual force is superimposed on the image of the real world X-cut X taken by the second moving image force 103 b corresponding to the position 1 of ヽ.

That is, the computer system 2 is associated with the association means.

25 By the force information generation means 27, the second moving image J of the first moving image camera 103a at the light emission time Tm is taken for one second in the imaging evening. The first video camera in the image 15 1 (T m) of the real-world object Ob 'taken at one time T m with the camera 103 b Obtained from the image picked up by the camera 103a: Ancillary element: L; 1.b <T) Departure: Position of occupied by

(X m, Υ m)

Overlay Mb with a visible shape of the mouth that can be made (Fig.30, step S90) o

Next, the computer system 2 outputs the light emission time Tm +

1, at the same time Tm with the second video power camera 103 b in preparation for the imaging evening of the first video power camera 103 a,

Image of the real world Oven X ku 0b taken 1 5 1 (T m

+1), the position of the luminous occupancy of the tag 11b obtained from the image captured by the first moving image power camera 103a. (X m + 1 Y m + 1) is superimposed with a visible power (power output) M b of a predetermined shape to be seen by the user (Step S 91, na, obn X Same for h 0 c

,

As shown in FIG. 29, the visible power MC is displayed according to the position of T m and T m + 1 of the small O c (attached element 11 c). Second video power camera 1

Image of a real world talented object 0 b 〇 C imaged at 0 3 b at emission time T m 0 b 〇 C and emission time T m

Image 1 of real world talent X X h 〇 b 〇 C taken at + 1

The visible power MbMC corresponding to the object 〇bOc is displayed in a folded state over 5 1 (Tm + 1)

The user who looks at the eleven statues by displaying the visible ticks as in the case of the real world that is used in this system,

For example, an image which is displayed in a magnified manner as in an example in which the field X-cut can be easily confirmed is displayed on the image display means 26 of the computer system 2. Displayed on the play screen and the position of the force is specified by the user in the input means 32 (for example, by mouse). A to V, depending on the program attached.

It is possible to execute a desired operation such as obtaining property information of the object to which the accessory 11 present at the position of the power is attached at T m.

Like this shaping table with the input hand 3 2 Response Ji and down pin Interview evening to your Keru that by the Mausu operation visible Ma ^first force-click-click to Mr. vinegar, Te-time 2: desired (which is pre-Me 'flop opening g) this to execute an operation As a result, the usability of the HyunTuff X can be greatly improved.Instead of the click of the mouse, for example, it can be used as a display. By using the touch panel display, you can use the stencil or your finger to touch the displayed force on the screen.

(Corresponding object properties' information acquisition operation, etc.)

FIG. 31 is a diagram illustrating the overall operation of another embodiment of the real world object recognition system 1 shown in FIG. 1 according to the present invention.

In the present embodiment, in particular, one of the visual field regions 109 of the first video power camera 103 a and the second video power camera 103 b of the embodiment shown in FIG. 26 is used. Or finally both a. ■ ~~ Larger than the image content frame to be provided to the user and wait for the side of the real world object X-cut that exists outside the image content frame. Identification information of the real world object that was captured and grasped by capturing the first video power camera 103a and the second video power camera 103b or both. It is intended to be used for a fortune-telling

In other words, as shown in Fig. 31, the image display means 26 in the evening system 2 is a user who is finally a user.

The image content V frame provided to the user is 16 1 As shown, the size <<Ah Ci

Outside of 1, the visual field range of the second video camera 103 b is 1

6 As shown in 2

Further, image display means 2 in the computer evening system 2

The field of view of the first video camera 103a is set outside the field of view 162 of the second video power camera 103b as shown by 163. In addition, the second moving image force 103 b and the field of view 162 of the first moving force camera 103 b are the actual moving X-cut of the peripheral region. The outside of the screen frame near the outside is outside the screen frame, and the first and second moving image power lenses 103 a and 10 0

It is out of the field of view of 3b. In Fig. 31, each real object (o a O g) is marked with a white circle and each real object is

Shows the appendix 11 (corresponding to the force) attached to aog.

That is, in this embodiment, the real world object existing outside the image content frame is used.

O d 0 g of the first moving image force 103 a and / or the second moving force corresponding to the visual field of the 103 b moving image 〇 d 0 g The state (side standby state) is defined as an image based on the image of the first moving image power camera 103a <the position and / or the second moving image power camera 103b. When the computer system 2 "puts the mouth center ¾πθ6¾,

Therefore, for example, a real world object that exists outside the image content frame (for example, a real object O dof) Is in the field of view of the power camera 103 b and / or the field of view of the first video camera 103 a, even if α It is possible to smoothly recognize the corresponding real world object X by using the position and video information that was previously grasped as a promotion standby letter.

FIG. 32 shows the field of view of the first video power camera 103 a and the field of view of the second video power camera 103 b in the embodiment of FIG. As shown in FIG. 31, other configurations and operations are the same as those in FIG. 31.

FIG. 33 is a diagram for illustrating the overall operation of another embodiment of the real-world object-centered system 1 shown in FIG. 1 according to the present invention.

In all of the embodiments described above,

1 has only a few <and only the position information output unit 15 after the position information output unit 15 operating unit 16 and sensing unit 17.

In addition, in the present embodiment, the accessory 11 is one of the position information output sections 15, the operation section 16, and the sensing section 17, which is less than the position information output section 15. And sensing part

Has 1 7

That is, in the embodiment table shown in Fig. 33, the identification element is assigned as shown in Fig. 1, and the attached element 11 attached to the real-world obu factory o is shown in Fig. 2. In the configuration, a real-world object with an additional element 11 is also provided.

Or a platform near World Object O Or the sensing information transmission means 40 and the sensing information transmitting means of the empire overnight system 2 on the sensing information about the real world 'world ob X X', which the person has learned. Equipped with a sensing unit 17 that transmits to the light emission instruction command / signal receiving unit 210 that constitutes the sensing information receiving unit 41

The light emission instruction / signal receiving section 210 receives sensing information on the real world X-box 0 from the sensor of the additional element 11, and outputs the signal. -Evening system 2 needs sensing information on real world object 0. The location of real world object 0 specified in the implementation form in Fig. 2 is also required. The object identified by the identification information

It is intended to be associated with information related to X-cut o, obect o, or information processing functions.

In addition, in FIG. 33, the optical instruction command / signal receiving unit 2

10 is an accessory 1 that specifies an accessory 11 and includes a sensing instruction command, such as an RF signal, that includes another ID.

It is configured to transmit to 1. In addition, since the other configuration is almost the same as the configuration shown in FIG. 2, the description is omitted or simplified.

The incidental element 11 receives the sensing instruction 8 from the light emission instruction / signal receiving unit 210 by the sensing instruction or communication means 17b, and compares the identification information comparison means 17c. Thus, when it is determined that the identification ID included in the received sensing instruction command is the identification ID assigned to the user, the real-world object that has been written is detected. X Sensing information related to 0 Transmit from the information transmission means 17 d to the optical command / signal receiving section 210 as an RF signal, for example.

The flash instruction command / signal receiving unit 210 receives the sensing information of the flash.

Further, as another configuration, the attached ητ thread 11 divides the sensing information about the real world object Xkh sensed by the sensing information transmitting means 17d into itself. Assigned identification

Along with the ID, it is sent to the light emission instruction command / signal receiving section 210 in a spontaneous manner, and the light emission instruction command / signal receiving section 210 receives and receives the sensing information and the identification ID of the LED. Of the sensing information transmission source is identified by the identified ID.

It is located in a warehouse, for example.

Attach an AT sensor with an acceleration sensor as 17a.When the product is moved, the movement is sensed by the acceleration sensor and the sensing information is obtained. It is applied to a U-case 3 which sends a light emission instruction command / signal to the receiving unit 210 and generates some kind of alarm, for example, or the sensor 1

7a, the sensor is mounted on the attachment 11 and the temperature sensor sends it to the light emission instruction command / signal reception unit 210 at predetermined time intervals by the temperature sensor.

It is a week for U-Case a that informs you of the temperature

In the case of the acceleration sensor described above, for example, the transmission of sensing information (U-ga) is a case where the output of the sensor exceeds a threshold value that can be detected, for example. Then, for example, At which time the sensing information is sent from the incidental element 11 to the light emitting instruction / signal receiving section 21 1

The light emitting finger transmitted to the device 0! The command / signal receiving unit 210 receives the identification ID transmitted from the element 11 together with the sensing information of the It is possible to determine whether the information is based on the sensing information of the real world talented

In addition, a real world X-ray X-ray with the auxiliary element 11 sensed by the sensor 17a

The shape of the object and the statue in the vicinity of the real world oven X are, for example, ovenek white ί <dish, vibration, acceleration, tilt, pressure place, etc. Environmental temperature and humidity surrounding

Co ₂ concentration,, pollen (a lot of rice: salmon, etc.).

As shown in Fig. 34, the computer system 2 uses the associative means 47 to extract the sensing information obtained in the excavation 33 from each of the information shown in Fig. 18. The file in the frame image of the object X X 1 3 5 and the file associated with the object name-the file 1 3 7 X Closing evening Base 1 4 1 □ □, and the order of each objet X-cut and the sensing τ evening associated with m • Sensing Generates a file extraction file 18 1 (step S 100) and assigns the position of each object X h to the sensing file 18 1 Identification for

The attribute information file 183 of each Xbox X-Cut registered in advance on the computer system 2 with the ID as the Oxtsu term is connected. □ It is a diagram showing that the X-based X management

Location in Fig. 34 • Sensing completed evening extraction file 18 1 is the location extraction image in the frame image of each X-cut box shown in Fig. 16. Identify to cells 135

The sensing information output from the sensor of the incidental element 11 with D as a general term is added, and each object is recorded on the computer system 2 in advance. The attribute information file 183 is the sensing information obtained by the sensor for the evening file 1337 relating to the object name shown in Fig. 17. The attribute information of the sensing information that was previously recorded as attribute information 1 is also registered as the attribute information of the sensing information registered in advance as shown in the figure. Heart rate position Content is present

In the example of the open management table 1885 shown in Fig. 34, for example, in the real world open X cut corresponding to the identification ID m, the body

1 dish Heartbeats etc. are registered as sensing information.

The degree of inn, humidity, etc. that can be obtained as sensation information is compared to the registered sensing information registered in advance in the file. The correspondence of the sensing information taken in the embodiment of FIG. 3 3 to the correspondence of the sensing information is managed in the job management table 18 5 to manage and provide the sensing information.

FIG. 35 shows the real world object X shown in FIG. 1 according to the present invention. FIG. 2 is a diagram for explaining the overall operation of another embodiment of the system 1

As shown in FIG. 35, the three-stage system 2 is connected to the associative storage means 47, and is located at the position shown in FIG. 34. File 18 1 is recorded in the sensing information located on the IP network 15 1, which is located on the network. Attribute information file of each object registered in advance on the network 1

The identification ID for 8.4 is combined as a general term (link) to form the Obuji Plant Management Dinner-evening 1185

(Step S110).

FIG. 36 shows the overall operation of another embodiment of the real world object recognition system 1 shown in FIG. 1 according to the present invention.

It is a diagram for

As shown in FIG. 36, the computer system 2

19 The position of each X-cut in the frame image shown in Fig. 9 is extracted by adding the sensing information obtained in Fig. 35 to the extracted file 13 5 Single extraction file 1 8

Construct 2 and position • Sensing end

In this example, the object management database 1445 is constructed by associating 182 with the object X file list 13 on the computer system 2. Step S120).

One of the properties of OBON X, which is managed in the SYPA world (on the computer system 2), as described in OBJECT X CLUSTER FILE 13 on SYPA Sensing Information is also provided.

FIG. 37 shows each of the components in the embodiment shown in FIG. 26.

11 is provided with a sensing section 17 as shown in FIG. 33, and in the 3-pump-evening system 2, transmission / reception is performed in place of the light emission instruction command device 5. A transmission / reception unit 190 (a light emission instruction transmission means 21, a sensing instruction transmission means 40, and a sensing information reception means).

(Corresponding to 41)) is a diagram configured to transmit a sensing instruction command to the attached element 11 and receive sensing information from the attached element 11. , And other configurations and operations are the same as those in FIG. 26 and FIG. 33, and description thereof will be omitted.

Fig. 38 shows the image of the real world object 0 taken with the second moving image camera 103b, and the position of the light emission of the tag 11 shown in Fig. 27, FIG. 13 is a diagram in which sensing is further added as information of the auxiliary element 11 in the connection of FIG.

That is, the computer system 2 is based on the image captured by the first moving image camera 103a at the light emission time Tm according to the associating means 47. Identification of the obtained real-world object: occupied light emission of the auxiliary element 1 1b indicated by the code 13 4 (T m) of ID = m, position of X (X m Y m) and the above The sensing time D m (indicated by reference numeral 191 a) sensed at the flash time T m is changed to the imaging time of the first moving image camera 103 a. Real world talented buzzer X at the time Tm with the second video power camera 103b Ob image 1 5 1 (T m) (Fig. 39 Step S 1 3 0

Next, the luminous system Tm +

In FIG. 1, the identification ID of the real-world pupil X ku h obtained from the image picked up by the first moving image camera 103 a is denoted by the code 1 3 4 (T m + 1), the position coordinates (X m + 1 Y m + 1) of the light emitting point of the subscript 1 C, and the sensor sensed at the light emitting time T m + 1 Sing-Evening

D m + 1 (indicated by reference numeral 19 1 b) is

In synchronization with the imaging evening of 103 a, the second moving image

Same at 10 3 b-Connect the image 15 1 (T m + 1) of real world object 0 b taken at time Τ m + 1 (Step S 13 1 , Yona: Depending on the work, video content

Each real world object X displayed in (image)

When the image position β and the sensing parameter of 〇 are removed on the computer system 2,

As a result, the system is connected to the desired evening (for example, reception is possible) based on the image position of the real world object ο and the sensing area. Or in response to instructions from the user) on the image of the real world Oven X Quad, for example, the position of the luminous occupation (Object 0b) Tt

Yes-Appends the sensing 7 "obtained by the ftr element 11b to the specified display form and superimposes it. For example, as an object W attached to hin Ob For example, the incidental element 11b can detect the bypass data (human) 0b of the data (biological information: blood pressure, pulse, body temperature, etc.). If there is a sensor 17a, it is also possible to display the detected date and time as a numerical value (by night value) on the corresponding object box 〇b.

As a result, for example, every time the position changes according to the movement of the X-ray of the human X b, the display position of the Bayer value is linked according to the movement. It is possible to visually observe the change in the pile value at each Ob position.

Further, for example, a case in which an accessory 11 attached to each of a plurality of objects has, for example, a temperature sensor 17a for detecting the temperature of the surrounding area. Numerical values of multiple temperatures detected by each of the multiple incidental elements 1 1

(Pile value) and a plurality of associated elements 11 as dots are superimposed and displayed on each of them, and each dot is displayed as a line graph with a line segment. FIG. 40 shows the position of the light-emission occupancy of the auxiliary element 11 shown in FIG. 29 and the real-world object 〇b imaged by the second moving image camera 103 b. In the association with the image, the visual abilities Mb are superimposed and displayed on the image {15 1 (T m) L 5 1 (T m + 1)} of the real world object 0b. In addition, the information of ancillary element 1 1 is added to '-Sensingde-overnight Dm Dm + 1

(See Fig. 38 and Fig. 39). Other The configuration and operation of the device are the same, and the description thereof is omitted. As a result, the user sees the completion of the sensing of the auxiliary element 11 b attached to the above-mentioned X-ob. When the user wishes to perform the task, for example, in the input means 32, the user designates (clicks) the corresponding visible power Mb with a mouse. By the program P which is set to π in the memo U of the system 2, the n computer system 2 is configured to have the attached element 1 1 corresponding to the cooked visible power M b. When the sensing data detected by b is displayed on or near the display position of the visible force Mb, for example, it is displayed. FIG. 41 shows another embodiment of the real world observable X-cut knowledge system 1 shown in FIG. 1 according to the present invention.

It is a diagram for explaining the whole movement of the shape

Ancillary element 11 in this embodiment table is a position information output unit.

15, working part 16 and sensing part 17

<Both have a position '| harm information output unit 15 and an operation unit 16.

The operator 16a in the operation unit 16 is, for example, an actuator, and the actor is in the real world, for example, in response to a mechanical input. In addition to the one that performs the mechanical action of (e.g., a vibrator LED), instructs the specified operation to be mounted Included

In other words, the light emission instruction / signal reception The unit 210 transmits an operation including, for example, an additional information specifying the tag 11 by an RF signal, for example.

Each of the appenders 11 receives the operation command by the operation command receiving unit 16b, and the identification information comparison unit 16c includes the operation command in the received operation command. When it is determined that the different ID is the identification ID assigned to the white part, the action is performed on α), and the predetermined work is performed by the child actuator 16a. p.

In addition, the auxiliary element 11 is provided with its transmitting means 16d, and may be actuated, if necessary, to receive an operation command reception confirmation oral signal and / or an actuating signal. X X including the overnight execution result (operation result) Sends an overnight execution notification signal to the light emission instruction command / signal receiving unit 210

The light emission instruction command / signal receiving section 210 receives the actuating operation command reception confirmation signal or the actuating overnight execution notification signal from the accessory 11 and outputs the signal. Based on the reception result, the information about the operation function of the work X X is transferred to the identification information of the corresponding object X, the information related to the job X, or the information processing function. I'm getting involved

FIG. 42 is a diagram for explaining the overall operation of another embodiment of the real-world object recognition system 1 shown in FIG. 1 according to the present invention.

FIG. 42 shows each auxiliary element in the embodiment shown in FIG.

A work 16 is provided in 11 as shown in Fig. 41, and In addition, the light emitting finger 7 command / signal receiving section 190 (corresponding to the light emitting instruction command transmitting means 21, the operation command transmitting means 45, and the receiving means 46) in the illumination system 2 is activated. A command is transmitted to the accessory element 11, and the action execution notification and / or the operation command reception confirmation signal is transmitted from the accessory element 11 again. Other configurations and operations are the same as those in FIGS. 26 and 41, and a description thereof will be omitted.

Fig. 43 shows the occupancy of the light in Fig. 27,

Real world image taken with the camera and the second video power camera 103b

In X with the image of the X-ray, the information is added to the information of the auxiliary element 11 in D. The X-E is a diagram with information on the operating function added.

That is, the computer system 2 obtains the image obtained by the first moving image power camera 103 a at the light emission time Tm by the associating means 47. The coordinates of the light emitting point of the incidental element 1 1b indicated by the code 13 4 (T m) with the identification ID of the real world object ID = m (X m Y m) and at the above light emission time T m Worked X X 1

The information Am (indicated by reference numeral 201a) representing the actuator 6a of the 6a is transmitted to the imaging wing of the first moving image camera 103a for one mouth J period. Image at time Tm at time pm

, ❖

Image 1 5 1 (T m) of the real world Oven X

D (Fig. 44 4 step S1400) o

Next, the computer system 2 sets the light emission time T m + 1 in 1 ft] Image Power Camera ID 103 ID of the real world object X obtained from the image created by it f 3 a Illumination of 1c c

(X m + 1 Y m + 1) and information on the operation function of the work X a 16 a that was operated at the above light emission time T m + 1 Am + 1 (sign 20 1b) at the time Tm + 1 with the second video power camera 103b in preparation for the image timing of the first video power camera 103a. The image 15 (Tm + 1) of the image 0b is connected (Step S1 4 1), and displayed in the video content (image) by the proper operation of The information about the image position of each real world X-ray image b and the operation function of the work X-Yu can be obtained on the computer system 2.

As a result, the operator system 2 can set the desired evening based on the information on the image position of the connected real world X and the operation function of the X X

(For example, in response to a reception or in response to an instruction from the user) on the image of the real-world object above, for example, the position coordinates of a light-emitting element X position (position of b)) The corresponding incidental element 1 1b Example of actuation of the element

(Numerical value, etc.) can be displayed in tatami

Fig. 44 shows the positions of the light-emitting points of the tag 11 shown in Fig. 29. In the association between the image of the real world object 〇b and the image of the real world object 〇b taken with the imager 103 b of the second device, the image of the real world object Xb 0b {15 1 (Τm) 5 1 (T m + 1)} with visible power M b superimposed on it, and further information on the actuation function of the actuator X X as information on the auxiliary element 11. A m + 1 (see Fig. 43 and Fig. 44) is added to the figure. Other configurations and operations are the same, and the description is omitted.

For example, when the user wants to visually recognize the information on the operation function of the attached element 11b attached to the above-mentioned object Ob, the input means 32 may be used as an example. When the corresponding visual force Mb is specified (clicked) by the mouse, the note of the system π is displayed. The switching system 2 displays information indicating, for example, the operation result of the actuation of the incidental element 11b corresponding to the clicked visual force Mb, for example, visible. It can be displayed on or near the display position of the force M b, and the user can visually recognize the displayed operation result information.

FIG. 45 is a diagram in the case where the visible light emitter 16a is used as a work in the embodiment shown in FIG. 41, and other configurations and operations are shown in FIG. Note that the auxiliary element 11 is the same as the light-emitting element 15c which emits light in response to the light-emitting instruction from the light-emitting instruction command / signal receiving unit 210, as described above. Applicable with W element It has a visible light emitting element as an actuator in addition to the child.

That is, in FIG. 45, the light emitting instruction tap is applied to the visible light emitting element provided as an actuator in the auxiliary element 11 1. When the device transmits the visible light emission command, the incidental command receiving means 16b of the attached device 11 transmits the visible light emission command to the device.

Receive 3 受信

Means for comparing information by m 1

6 If the other ID included in the visible light emission instruction received by c is determined to be the identification ID assigned to itself, it is visible according to the visible light emission instruction command to α. Activate the light emitting element 16a and send a response signal to the visible light emission instruction command to the emission instruction command / signal receiving unit 210.

The light emission instruction / signal receiving section 210 receives a response signal from the auxiliary element 11 to the visible light emission instruction, and receives the response signal.

It is known that the visible light photon 16a of 1 1 was made

FIG. 46 is shown in FIG. 26 in the case where the visible light emitting element 16 a is used as an accessory in the appendix 11 as shown in FIG. In the case where the second video power camera 103b is installed □ The other configuration and operation are the same as those in FIGS. 45 and 26.

FIG. 47 is a real world object shown in FIG. 1 according to the present invention. FIG. 3 is a diagram for explaining the overall operation of another embodiment of the knowledge system 1, particularly for clarifying the position a of an X-X cut within the visual field of a moving image camera. Come out In the embodiment shown in Fig. 47, the attachment 11b is attached.

,

Fig. 4 shows the processing when the real world object Xb 0b appears in the field of view of the video power camera 103.

7 (a) ('As shown here, at time T t 1, the plants, the dolly, and the power pans surrounded by the occupied lines are the auxiliary elements 11 a, 1 1c, 11d

ヽ

In a situation where three obi X cuts 0a, 0c, and Od are known as B, as shown in Fig. 47 (b), the time

At T = t 2 ¾

With tag 1 Tag 1b: w Opened X cut 0b, which is a gfc shot, is a moving image

Appear in the field of view of 103

As a result, the computer system 2 is a

According to FIG. 25, during the predetermined time constant ΔT, the identification ID of the object ob and the luminous occupancy of the incidental element: 11 b (FIG.

As shown in (b), it is clear that you have come to mind (Fig. 48 Step S

150 0), and its identification I: The system X 2 is that the new X X h 〇 b of D has newly entered. Know (Step

S 15 1).

,

In addition, if necessary, the frequency of the light emission instruction command to the oven Xk h is made variable, and after the appearance is determined, the light emission instruction command to the attenuated X light b, which has been reduced, is given. To the same frequency and m] level as other obcts that already know the frequency of

FIG. 49 illustrates the overall operation of another embodiment of the real world smart X-connect system 1 shown in FIG. 1 according to the present invention. This is a diagram specifically explaining the process of leaving an animation out of the field of view of a video camera.

In the embodiment shown in FIG. 49, a process in the case where an object 実 in the real world with the attached element 11 exits out of the visual field of the moving image camera 103 is shown. Sun: Fig. 49

As shown in (a), at time T = t1, plants, humans, power vans, and display devices surrounded by occupied lines each have ancillary elements. Ancillary elements 11a, 11b, 11c,

1 The four orthogonals 0 a, 〇 b, 〇 c,

〇 d A / ^{4 In a} situation where people are aware of the mind, as shown in Figure 49 (b), at time T = t2, the object O b

Let's say that you leave the field of view of the video power camera 103 as shown by 191

When the observable object Ob leaves the video camera 103 out of the visual field area, the π-computer system 2 sets the time constant ΔT for a predetermined time constant. Then, the identification of the object ob

The ID and the attached element 11b are attached. W The light emission from Taitoko, and the inquisitive mind (Fig. 50; step S16C »)

The object 0b of the ID exits from the visual field region 109, and the object is c »t detected (step S1661).

After confusing that he / she has been sent off, the frequency of the command to emit light to Obn X-Cult〇b is reduced, the frequency of communication for 4ιιι is reduced, and the obedient is also sent off. Attached element of project 〇b 1 1b Consumption due to unnecessary light emission from the attached element of b

Ε1 Can reduce power Fig. 51 is a diagram for illustrating the overall operation of another embodiment of the real world of X-Central core knowledge system 1 according to the present invention. FIG. 7 is a diagram for explaining a process of performing body surveying between platforms.

In the embodiment shown in FIG. 51, a plurality of moving image lenses (or the XYZ axes in FIG. 40) are used to detect the light emission from the auxiliary element 11 attached to the object ho. Apply the three video power cameras that correspond to each other and apply the light emission intensity obtained from each video power camera. The spatial position information of the obtained real space X-X is obtained. In this embodiment, the lens system of three video power cameras 103 X 103 Y 103 Z An example is shown in which the optical axes are arranged so as to be orthogonal to the XY axis, but from the position extracted from the two-dimensional frame image signal from the moving image camera. Any arrangement can be used as long as the arrangement and the coordinates of the illuminator of the attachment 11 attached to the object X cut O in the angle measurement can be calculated and the coordinates can be calculated. Multiple The moving force ra of the full-les-beam shall be the even of you are 1-neck] period

In the embodiment of FIG. 51 刖 In step S8 of FIG. 4, the computer system 2 uses three optical axes orthogonal to the XYZ axes for three moving image cameras 103 X 1 0 3 y 1 0 3 Extracted from Z and 1 port] The emission site (XmYm (ZmYm (Xmzm)) in each frame image Coordinates in space (X m Y m Z m) Note that the location in the third-order real space and the huge frame time Tm synchronized with the identification ID of the Xbox X are pre-loaded. 2 Information X-X on the upper side Fig. 52 shows the overall operation of another embodiment of the real-world X-X knowledge system 1 shown in Fig. 1 according to the present invention. This is a diagram for the sake of clarification, and is a diagram particularly for explaining the LaV King processing of an object X which is concealed by another object. Is the time T as shown in Fig. 52 (a).

= t1 is a plant hygiene vanity spray surrounded by a occupied line. 帯 Auxiliary element with ancillary elements 1 1 a 1 1 b 1 1 c 1 1 In the situation where X-cut 0 a O b O c 0 d is recognized, the X-cut X moves at time T t 2 as shown in Fig. 52 (b). It is assumed that the light emission of the accessory 11b is concealed by another object Od

Assuming that the light emission of the incidental element 11b is concealed by another object od as described above, the moving image lens 103a becomes light emitting of the incidental element 11b of the object 0b. In knowledge

<Naru

In the case where the light emission of the auxiliary element 1 1b of the obn X-cut 0b, which was known at time T = t2, cannot be detected (Fig. 5). 3 Step S 1 7

0 → Υ ES) 3: System time is past time The object O b (D n section containing the past light-emitting points is captured from the shadow image of the second moving image camera 103 b at τ t 1 (step S 1 7 1) Since the talent ο b is a person, the hull of the person is extracted by image processing.

Then, the computer system 2 emits light from the incidental element 11b based on the right of the captured object 0b. As long as you are not aware of it, follow the movement of the contour of object 0b from the image taken by the second moving image camera 103b as shown in Fig. 52 (c). Thus, the temporal obscuration of the light emission of the incidental element 11b with the incident object Ob is compensated for, and the position of the observable element 0b (the incidental element 11b) is predicted.

(Step S 1 7 2)

As processing other than the acquisition and tracking processing of step S 17 1 S 17 2, the computer system 2 uses the immediate adjacent frame image to be concealed (for example, t = The moving direction and movement of the object b based on the correlation between the pixel values, for example, based on the second moving image force at t0 t1 (the captured image of the camera 103b). The motion vector is calculated based on the distance (Fig. 5

4 Step V S 180), and from the calculated motion vector, a position where the next light emission will be detected is estimated (Step V S

1 8 1) Search for the light-emitting point by giving priority to that area (step

S 18 2).

In the example of the present embodiment, the processing in step S 17 1 S 17 2 or the processing in step S 180 S 18 2 Since the position of the hidden shadow X 0 h 0 b has been estimated and captured, as shown in FIG. Then, the object b comes out of the concealed state, and the incidental element 11b emits light again. It is possible to quickly detect the object X 0 h (attached element 1 1 b) in the shape P

FIG. 55 is a diagram for illustrating the overall operation of another embodiment of the real-world object recognition system 1 shown in FIG. 1 according to the present invention, and in particular, it is accompanied by an object. A template similar to the past light-emitting partial image by reflecting the past light-emitting partial image of the light-emitting pattern on the template of the light-emitting pattern to make a sense of the light emission from the attached element. FIG. 9 is a diagram showing a process using a sample.

In this embodiment, the computer system 2 is described in FIG. 6 and FIG. 8 in order to surely recognize the light emission of the vesicular object that is recognized. A template 231a similar to the past light-emitting partial image of the attached element 11 is added to the frame image n227 obtained by executing the subtraction processing. In the meantime, the whole frame of the frame image n227 after the difference processing is subjected to the touching processing as shown by an arrow 222 (step S190).

Next, the computer system 2 calculates an intellectual distance (interest) for the template for each locus calculated by the matching process, and calculates the perceived distance of the mouth center distance. Get distribution 2 2 8

(Step V S191). As a result, the resulting blade

Mouth distance distribution Based on the distance difference (difference in degree of difference) of -3o to 2 2 8, the signal with the highest S and the mouth tc distance (smallest degree of difference) is the first signal, the next signal Priority recognition order, such as 2nd place

Therefore, the combi-evening system 2 desires the first-priority locus by judging the higher-priority object as the light-emitting signal image of the light-emitting elements of the incidental element 11. When the position of the light emitting point of the light emitting element of the attached element 11 attached to the object o of the attached element 11, that is, the position of the attached element 11 is subtracted, the position of the object is determined. (Step S192).

FIG. 56 is a diagram showing a process in which a past light emission partial image is used as a template in the embodiment shown in FIG. 55.

In the present embodiment, in order to surely recognize the light emission of the object to be recognized, the system 2 performs the past processing on the frame image η 2 27 after the difference processing. While the light emitting partial image of the incidental element 11 is used as a template 2 3 1 b, the entire area of the frame image n 2 27 after the difference processing is indicated by an arrow 2 29 for the entire area of the frame image n 2 27. Option: Perform the sorting process.

(Step S200).

Next, the computer display 2 calculates the π′ΐ recognition icB distance (difference degree) with respect to the template for each coordinate calculated in the V-matching process, and calculates the difference between the two. The distribution of the recognition distance 2 228 a is obtained (step S 201). Based on the distance difference (difference in degree of difference) in the distance distribution 228a obtained as a result of the following:

Mouth 'distance

(Small filling

) The priority of the signal is 1st, and the next signal is the 2nd, etc.

Therefore, the computer system 2 determines that the one with the highest priority is a light emission signal image from the light emitting element of the incidental element 11, and determines the coordinates of the first priority according to the desired coordinates. It can be determined that the occupied position of the luminous element of the attached W element 11 attached to Bunek 0, that is, the position of the attached element 11 is subtracted from the position of Obek 0 (S Step S202).

Fig. 57 is a diagram showing the processing using the template used for the light emission occupation position of the incidental element in the past in the embodiment shown in Fig. 55.

In the present embodiment, the computer system 2 executes the difference processing described in FIG. 6 and FIG. For the obtained frame image n227, the frame after differential processing was used, using the template 2311c used for locating the light emission occupancy of the incidental element in the past. Arrow to the entire area of the image n 2 2 7

Perform matching processing as indicated by 2 29 (Step S

2 1 0).

Next, the computer system calculates the perceived distance (the degree of perception) for the template for each coordinate calculated by the matching process, and then distributes the perceived distance. Get 2 8b (Step S211) o

Based on the distance difference (difference in similarity) in the obtained kanji distance distribution 228, a signal with a short intellectual distance (smallness of reason) is obtained. Priority is 1st, next signal is 2nd, etc. Ό Priority can be determined

Accordingly, the computer system 2 determines the position with the highest priority by judging the one with the highest priority as the light emission signal image from the light emitting element of the incidental element 11. Light emission of the attached element 11 attached to the Oven X-Cut! If the position of the incidental element 11 is subtracted from the position of the incidental element 11, it is determined that the position of the object 0 is determined (step S 2 12).

FIG. 58 is a diagram for explaining the overall operation of another embodiment of the real-world object X-recognition system 1 shown in FIG. 1 according to the present invention. In particular, FIG. FIG. 7 is a diagram showing a process during a change of a photographing condition of the photographing means.

In the present embodiment, while the shooting conditions of the moving image camera 103 are being changed, the system 2 outputs the frame image signal output during the changing of the shooting conditions. Or, it is discarded and the process of detecting the light emitting position of the accessory 11 is interrupted (Step S220).

That is, as shown in FIG. 58, the frame image (n-

1) with a moving image camera 103

At time (n), the animation force shown by arrow 25 1

The shooting condition of (3) is changed (being changed). As shown in box 2, the frame image (n) is displayed in fm.

C Itn, it will be viewed or discarded, and the position detection process will be interrupted.

Similarly, in order to capture the image of the object 0 of the real world attached to the attached element 11 1, the shadow condition of the second moving image camera 103 b for capturing the image itself Even during the change, the frame image signal output by the first moving image camera 103a is discarded, and the process of detecting the light emission position of the attached fluorescent lamp is interrupted. FIG. 1 according to the present invention is a diagram for illustrating the overall operation of another embodiment of the real world object X-Cut system shown in FIG. 1, particularly illustrating a process at the time of a collision. It is a diagram for

In this embodiment, if a plurality of light sources are detected, the light emitting position information extracted in step (1) is discarded.

That is, as shown in 59, the amp-even system 2 uses the differential processing obtained by the differential processing described in FIG. 6 or FIG. -The image signal η2 2 4 is subjected to the space filter processing and the power matching processing described in Fig. 10 and Fig. 12 respectively. Then, the resulting frame image after the spatial file processing η 2 2

4 and overnight Frame image after matching processing η 2

Regarding 28, the priority comparison processing shown in the previous figure 13

(Refer to steps S230 and S50), even if the result of the execution of

If it exists as shown by 2 32 (Step S 2 3 1) Discard the extraction position coordinates at the time of the second frame image (step S2 32)

FIG. 60 is a diagram for explaining the overall operation of another embodiment of the real-world object recognition system 1 shown in FIG. 1 according to the present invention. Fig. 3 is a diagram for explaining the process related to

In this embodiment, the pedestrian illuminates the light emitting tan of the incidental element 11 multiple times, and recognizes it as the position of the incidental real world object h.

In FIG. 60, the auxiliary element 11 is spontaneously generated by the white element 11 or the moving image power is controlled by the light emission control stage 15d according to the command of the light emitting finger 7JN command block 105. Light-emitting element 1 while synchronizing with frame 103 of light-emitting element 1 while changing to one light-emitting pattern P (light-emitting, light-emitting, non-light-emitting, non-light-emitting) in 5 frames. The light emission pattern 'P that causes 5 C to emit light is, for example, the identification ID of the auxiliary element 11.

(Identification of attached real object X X ID)

M physically, the recognition ID is, for example, 5 bits (111)

If the corresponding bit is 1, the attached element 11 emits light when the corresponding bit is 1, as shown in Figure 60. Is output as non-emission, and the visual power camera 103 of the computer system 2 recognizes this emission turn for the corresponding 5 frames. , Computer system 2 When it was confirmed that this light emission was an object with identification ID = m (111010), the light emission position coordinates extracted from each frame image signal were recognized. It is recognized as the position of the object m (step S240). here,

5 bit example, but if necessary, any combination of number of bits and light emitting panel corresponding to another ID may be used.

Fig. 61 shows that a template whose central light intensity is near the maximum exposure value and whose light intensity decreases conically from the center is used as a template. Illustrated

In the present embodiment, in g, the computer system 2 was used to perform the difference processing described in FIGS. The light intensity at the center of the incidental element is set near the maximum exposure value for the frame image n 2 27 after the differential processing a obtained by executing the above, and the light intensity decreases conically from the center. Using the template 2 3 1 X, the arrow 2 2 is applied to the entire area of the frame image n 2 27 after the difference processing.

As shown in Fig. 9, the matching process is performed (step S25π), and then the computer system 2 performs the matching process for each locus calculated by the matching process. Calculate the distance between mind and mind (the degree of relevance) for the sample, and obtain the distribution of the sense distance 2 288 X (Step V S 2 51).

Based on the distance distribution (difference in degree of difference) in the distance distribution 228 X obtained by the 7PP, the shortest recognition distance is obtained. (Small degree of reason) The signal is ranked first and the next signal is ranked second and so on.

Therefore, if the high-priority system 2 determines that the high-priority object is a light-emitting signal image from the light-emitting element of the incidental element 11, it prefers the first-priority locus. If the position of the luminous occupancy of the light emitting element of the attachment 11 attached to the object 0, that is, the position of the attachment 11 is subtracted, it is determined that the position is the position of the object. Step S 2 5 2

m62 is a diagram for explaining the overall operation of another embodiment of the real world object X-coordinate system 1 shown in Fig. 1 according to the present invention. In particular, the wavelengths of emitted light are different. FIG. 7 is a diagram showing a process in a case where a plurality of accessories each having a plurality of light emitting elements are attached to an object Xh.

In this embodiment, each X-cut of the real world 〇 a 〇 b

0 C incidental incidental? A plurality of (two in this embodiment) light emitting elements 11 1 a 1 1 1 b having different emission wavelengths are provided for each of the elements 11 a 1 1 b 1 1 c. Two filters with emission wavelengths of λ1 and λ2 are assigned to each Xbox 0 in the real world, which is equipped with a different filter for the video power camera 330. Having accessory 1 1a

1 1 b is attached and the flash is fired.

As shown in the filter characteristic diagram of 330, a filter whose attenuation is larger in the wavelength of λ1 than in the wavelength of λ2 is installed in the imager 33. . As a result, as shown in the figure, the output frame image captured by the moving power camera 330 emits light of the emission wavelength of the incident wavelength of the incidental element having the light emitting element of the wavelength of λ1 as shown in the figure. The luminous intensity of an accessory with a child

The light emission pattern from the auxiliary element attached to the real world object is a special light emission pattern, so it is easy to distinguish it from other noise light sources. In the example of reducing the probability of misunderstanding, the example of the emission wavelength of 2 is shown in the example, but it is not limited to this, but a set of three or more wavelengths 1 = It is possible to combine a filter and a filter with arbitrary wavelength characteristics.

FIG. 63 shows a view of the real-world object recognition system 1 shown in FIG. 1 according to the present invention.

FIG. 10 is a diagram for converting the overall operation of another embodiment m, particularly for illustrating a process in which the light intensity of the light emitted from the tag is variable.

Book stand

In the embodiment, the emission intensity of the incidental element 11 attached to the open X is modulated by a combination of strong and weak □, and the variable pattern is illuminated and attached. The position of the object

That is, in FIG. 63, the auxiliary element 11 is an element.

In accordance with the instruction of the instruction or instruction device 105, the synchronizing with the frame of the moving image camera 103 according to the command of the device 105, for example, at 5 frames. Light intensity / small intensity of the X-axis of 1 Λ Light-emitting element 15 c is illuminated at P 1, and intensity modulation at ⁰ P P 1 is an ancillary * It is possible to correspond to the other ID of H11 (the other ID of the attached real X-cut)

For example, if another ID is represented by 5 shad (h), the incidental element 11 indicates the light emission variation when the bit corresponding to Ό shown in the figure is 1. If the corresponding bit is 0, it is sufficient to output with the light emission intensity weakened.

At the time, the visual power of the computer system 2

3 is the light emission change during the corresponding 5 frames.

Recognize P1 o

In addition, the illumination system 2 has an emission ID of m = (ί (110), (strong strong weak, strong weak)) based on the cutting edge recognition result. The light emitting position extracted from each frame image signal when you are sure that the light emitting position is the identification ID m. <> The position of the object is recognized.

(Step S260). : In this embodiment, S ± J has been described with an example of 5 bits, but the present invention is not limited to this, and the light emission intensity is modulated by an arbitrary number of bits corresponding to the identification ID. Good

FIG. 64 is a diagram for explaining the overall operation of another embodiment table P of the real-world object recognition system 1 shown in FIG. 1 according to the present invention. In particular, FIG. FIG. 9 is a diagram showing processing of a field α in which a plurality of incidental elements are provided.

In this embodiment, the number of the light emitting elements of the auxiliary ^ 1 element 11 attached to the object 実 in the real world is provided. The light intensity can be varied by using the four light-emitting elements 1 1 2 a 1 1 2 b 1 1

4 light emitting elements 1 1 2 a 1 1 2 b with auxiliary element 1 1 having 2 c 1 1 2 d attached to Xbox X

1 1 2c 1 1 2 By changing the number of flashes from 0 to 4 Ό Effectively changing the flash intensity when shooting with the video camera 103 What is

It is preferable that the light emitting elements 1 1 1 a 1 1 1 d are arranged sufficiently close to each other.

For example, light emitting element 1 1 2a 1 1 2b 1 1 2c 1

12 Change the luminous intensity of 2 to illuminate the variable e-circle panel. □ Realize functions such as recognizing as the position of the real world's Xbox X, which will be attached with certainty. It is also possible to reduce the misperception rate of OB X by changing the luminous intensity depending on disturbance such as thick light and lighting.

FIG. 65 is a diagram for explaining the overall operation of another embodiment of the real world gift object recognition system 1 shown in FIG. 1 according to another embodiment table t of the present invention. FIG. 4 is a diagram for explaining a process of setting a region having a light emission area ratio of a predetermined value or more in a minimum rectangle including a region having a light reception intensity of a predetermined value or more as a light emission target.

In this embodiment, the computer system 2 is used to accurately recognize the emission of the real world object X, which is known, and to avoid the knowledge of other disturbance light sources. And in Figure 8 For example, in the frame image n after the difference processing, the light emission area ratio in the smallest rectangle that includes the area where the light receiving intensity is equal to or more than the predetermined value is obtained. A region where the light emission area ratio is equal to or more than the predetermined value is searched (step S270), and a region where the luminous area ratio is equal to or more than the predetermined value is mainly detected.

The target is m n (step S 271).

For example, in the present embodiment, it is shown that the light-emitting surface mosquito rate in the smallest rectangle containing the light-emitting pattern of the attached object element of the world object is 70% or more. For example, the highest priority is given to the luminous patterns of 70% or more of the emission patterns, and the emission patterns of 70% or less are set to the disturbance light source, and the priority is given to Shinobu p8¾. Removed, etc. 0

As a result, it is possible to significantly reduce the possibility that the luminous occupancy from the disturbance light source is set to <−, — nm as the luminous occupancy of the ancillary element.In each of the above-described embodiments, Although the light emitting element was used as a function to emit the position information of the auxiliary element 11, the light emitting element was used instead of the light emitting element f or-or the GPS combined with the light emitting element.

(Such as Global Positioning L η 'Sysl, etc.)-A command to send the position m report from the spontaneous or computer system 2 by detecting the position information of the child. O It is possible to have a function to transmit according to

In addition, if only the functions are realized regardless of the performance, the position detection method described in the prior art can be applied.o For example, to acquire the position information of the accessory In addition, a position identification system based on triangulation based on super waves is used. It is also possible

As an example, in order to identify the location of an object at a location of about 3 cm in a 100 m2 building,

1 standing

• One sensor is embedded in a 720-meter ceiling for a 2 m-long good, and the 8 cm-long beam attached to the Oven X-Cut is an m-wave transceiver. And super standing

It has a built-in wave transmission and an identification ID is allocated.

Then, the identification ID is sent from the central entrance through the radio channel.

According to the wave sensane Vh ヮ h 各力力 U U 丁 U U るるる一方たたた

The pulse of the said wave is transmitted, and the sensor of the ceiling receives it and calculates the position by the diagonal method from the difference of the propagation delay time.

The whole system includes the central controller and the controller that controls the wave sensor network.

It operates at the time of pj, and is distinguished by radio wave.

According to the system that provides the basis for calculating the time difference to the occupation when the wave sensor detects a pulse of the wave, the system recognizes and positions 75 X-boxes per second by the system. In the sensor system, the location of all objects in the building, including the object J, and the location of the U source are integrated in a distributed X-cut oriented model. Abstraction can be achieved by presenting the spatial correlation between the X-books that are commercially felt by the humans to the application to the application software Xa. The space system is a U-ring system □

The position and status of each object X cut is CORBA (c

0 m m o n o b j e a t e Q U e st B r o k e r A Γ c i t e c t r e)

, ヽ,

The C0 RBA expressed in the form of a network is a standard of the object-oriented networking infrastructure required for realizing a distributed X-system, for example, in the real world. Each object

,

For the cut, the co-work of CORBA corresponds.

40 There are more than 40 types of objects b. For example, the hyperbasic force of the office is the same as that of the CORBA object for real objects such as a map. The current blog of the real world Oven X

, *

The control interface of the real world X-h with a tie-a face-like example, a U-Pin-Yu-is passed through the corresponding Prin- ject object. The software (J Case 3) was activated by the software.

,

Permanent C 0 R 全 All sets of A's X X form a world module that can be seen from the application 3 • software

,

Alternative processing when transacting in a transaction system Session 3 Management events Dispersion or the shadow of large-scale distributed systems Taking care of the items in <, we provide a single program to the U U

Above: To use a wave-based position locating system that was described physically, ^^

Said wave sensor group and sensor control 3 Embedding the D-la in the ceiling or floor, etc. and the system sru

Since it is necessary to perform B-measurement, highly mobile people, such as large office buildings and hospitals, can generate information, access information, access different types of machines, and interact with each other. Works best in situations where you need to interact

In addition, the real world smart X-ray X-ray, which emits infrared light to acquire the positional information of the incidental element, is used as a technique to recognize the sense of mind using an infrared sensor or infrared force camera. ID can be obtained at the same time It is possible to use an ID camera that can be used as a large image sensor.

For example, a light-emitting diode (LED) that controls blinking by a so-called bin as an accessory is attached to the real world opzik h (subject), and the ID is assigned to it.

<The bin repeats occupation based on its ID, and it detects and analyzes the occupation pattern using a video camera (ID camera). O Recognizing the ID The ID is compared to the infrared U-mon, which is displayed over the subject image. Bins are infrared U-monitors, and the ID input camera is a remote receiver. This is an array sensor (CM 〇 S dim sensor) with the machines arranged in an array 0

The ID camera is an ordinary camera.

(Singa mode) Outputs a set of coordinates on the image of the <bin> and the ID data transmitted by the icon (ID mode). In the ID mode, the ID force camera is

1 2 kHz sampling is repeated 200 times. Decode the 8-bit ID of the carrier frequency 4 kHz transmitted by the pixel for all 19 2 X 12 4 pixels 15 f

Create an ID image with P s □ It is possible to link to the information of the world of the world (on the inbox) via the ID of □. The number of bits of an ID that can be obtained when obtaining information about an object is 8 bits, and this is subjected to multi-X encoding using a 4 kHz carrier. , 22-bit packet I

Sending and receiving D T evening

Then, as an accessory, a two-dimensional matrix V is pasted on the surface of the real world Xbox X-ray, and the image is photographed with a video force camera. M U

From the subject that you are watching in the video, you can learn from the subject that you are watching in the video. You can access related information on hooks and develop virtual world objects.

In addition, as a means for identifying the attached element attached to the real object X, a W element with an infrared ray is embedded in the actual object X, and the infrared accessory is put in the infrared region. By photographing with multiple CCD power cameras with a hammer, it is also possible to use the wavelength difference of the embedded infrared accessory to distinguish the accessory from the B8 class.

For example, if the emission center wavelength is 800 nm, 825 nm, 8

50 nm, 875 ηm, 900 nm infrared-equipped element

13 The dangling wave region (the center wavelength is 800 nm, 85 (The infrared pass filter of 0 nm 900 nm is attached to the CCD force filter.) .

Furthermore, as an accessory identification technology, for example, a method of mounting an evening consisting of five LEDs on an actual object X and shooting with a camera can be used.

In this method, the obtained video of the hidden camera is analyzed, tag information is read, and the position in the video is calculated. Of the five LEDs in the evening, the four at the periphery repeatedly turn on and off at the same timing, play the role of a clock signal, and the center LED Lock signal flashes 1 Z 4 Phase delayed and occupied. Send evening signal

First, only the bright pixels are extracted from the image captured by the visual power camera. Next, the area extracted from the above-explained pixel is calculated to calculate the area of the area. Is judged to be not a sunset light source and is removed

Removal of bright parts of white walls, fluorescent light sources, etc. from the judgment target

Next, a search is made for a combination of the ク V signal and the estimated ク V signal in a plurality of regions selected in the following manner. The ク D signal in the evening is a roughly diamond-shaped signal in the image. Since it is captured as a region, it is possible to select a quick signal source by limiting the angle formed by the four peaks in all combinations of the four regions. When the rhombus is disjointed, the area where the rhombus is located in the most recent video frame is matched. Next, when the clock signal is turned on or off, it is determined whether or not an LED is found near the center of the diamond. Investigate-Obtain Γ1 J or Γ0 J as a tab Π When the frame processing speed is 10 Hz, the phase difference between the media and the data is determined. Considering this, the transmission speed can be any speed less than 5 Hz, so the tag transmission speed is 4 Hz.

In addition, a small wire sensor using optical communication technology can be used as an accessory.

The line communication technology being studied in systems using tw-wire sensor nodes is optical communication technology.For example, the light transmitted from the base station laser-light source can be used. A small reflective laser formed on the sensor is used to return the optical signal as an optical signal by returning or removing it in a direction parallel to the optical axis incident on it ο

That is, base station

When irradiating the laser beam to the area where the line sensor nodes are scattered from the laser where the ax is placed, the above-mentioned irradiation light is applied to the rntt: line sensor node. Change to send a command that includes the command to be started from the remote controller, the command to request sensing information, and so on.

A normal sensor node that can be made around B will return the reflected light in parallel to the base station by moving an ultra-small reflector when receiving an unmodulated beam. Change the reflected beam by removing or removing it. When he returns, he gets out.

The miniature reflectors are used to reflect each other's three surfaces formed inside the three corners of the body.

m

In other words, since the light beam incident on the three-sided reflecting mirror is reflected in parallel with the incident optical axis, a special element is essentially created for each beam sensor node. The reflected beam returned to the base station is returned to the base station, and the reflected beams from the entire area where the sensor nodes and groups are distributed are formed on the CCD sensor array. If the lens system is x-measured so that it can be imaged, it is possible that the modulated beam from each node will be received at a pixel at a specific position on the sensor array corresponding to its spatial position. it can

In other words, the spatial resolution that can be achieved by realizing space division multiplexing optical communication depends on the number of pixel arrays in the CMOs sensor. The pixels received at the 25 6 x 25 6 pixel array each have a pixel box corresponding to the area between 6 • 6 Cm 2. If it is separated by the distance of another place, it will be a signal from another sensor node (from three senses

The transmission speed depends on the frame period of the CCD sensor.

The present invention is not limited to the above-described embodiments and examples. <The present invention is not limited to the above-described embodiments and examples. It can be implemented in the form.

Commercial availability

The present invention relates to a real world object for identifying real world object information, which is information about real world objects, by means of a compilation system constituting a server world.

Regarding methods of oral tactile perception, devices and incidental devices, a server for real-world objects and a computer-system that composes the world supports real-world objects X , Which is defined as follows.

Claims

1-Real-world object information related to real-world opics (Oa 〇 boc) is perceived by the combo-evening system (2) that constitutes the server world. Real World Obuk §

In the manner of oral

刖 §d Ancillary elements (11a, 11b1c) assigned to the real world object X ((a0b0c) and assigned a significant 1m report The three-computer system (2) receives the identification information issued by the third computer and the position information indicating the position of the accessory (11a11b11c) from the step-by-step system (2). And

Based on the identification information and the positional information of the attached element (11a1 1b11c) received, the attached element (1 1a

1 1 b, 1 1 c) corresponding to the real world X h (〇 a

〇 b O c) The position of (b)

Real world obuji X X

The 2-刖 attachment (1 1 a 1 1 b 1 1 c) includes a light emitting element that emits light in response to the light emission instruction command 8 and outputs information on the light emitting point as the above-mentioned positional information. The computer system (2) includes identification information for identifying the attached element (1 1 a 1 1 b 1 1 c). In addition, a step for transmitting a light finger command is further provided, and based on the transmission step of the recording system (2), the light emission command is issued by the light emitting instruction (11a, lib, 1

1C), and when the identification information included in the light emission instruction command matches the identification information assigned to the tag, the light emitting element from the wire W is assigned to α. In the spot where light was emitted via

The receiving stage and the receiving system are the same as those described in the above three-pin system.

According to (2), the light emission of the accessory is captured as a frame unit image using the image capturing means (103), and the light is occupied by the light. Look at the steps to obtain position information.

The writing step is based on the obtained information

,,,

The step of identifying the report as the position of the real world object (oa0boc).

The real world object X claim m method described in claim 1

3 • 口

占 Image taken by the image pickup means (103) 占 When the W thread with the mark is illuminated, the frame image in the vicinity on the time axis from the 100 frame image signal of 注A step of subtracting the signal by a predetermined intensity ratio

The spatial frame and the η-turn 7 processing are applied to the note frame image signal that has been subjected to the subtraction processing. A step of performing a noise reduction process including one of <and

In the frame image signal that has been subjected to the noise reduction processing, the image 1, the image with the highest density is attached to the St element (11a

1 1 b 1 1 c)

Attach the position in the frame image of the recognized luminescent image

A step V that is specified and β-centered as the position of (11 a 1 1 b 1 1 c)

The method for recognizing a world-class object according to claim 2, wherein the method further comprises: o

(4) The above-mentioned reduction in the number of the frames included in the note @ frame image signal, the adjacent frame image signal and the frame image signal when the attached element is not emitting light Note that either one of the processing of subtracting one of the two and the processing of subtracting the frame image signal from the large frame image signal at a predetermined intensity ratio is performed. And

Note that the result of the subtraction processing becomes a negative number The above-mentioned note frame range The pixel signal in the image signal and the pixel signal below the predetermined threshold value Note The pixel signal in the huge frame image signal Steps to remove one of the <

,,, And.

X

b Spatial filter processing of the noise reduction processing step 、 Is a process for averaging the intensity values of the image signals of the respective images within the field range of the predetermined file size in the frame image signal of interest. Note: Includes a step that is performed for the entire area of the frame image signal and that gives a priority order according to the averaged signal strength of the frame image signal. The pattern matching process is performed in a manner similar to the definition pattern similar to the light emission / \ ° set of the attached element in the target matching area of the predetermined size. Note the processing for the entire frame of the image signal.

And prioritize according to the strength of the result.

And the noise reduction processing step includes at least one of the spatial filtering processing and a small number of the pattern matching processing. Select the position of the light-emitting element, based on the priority given by the processing of, and select the position of the selected light-emitting element. , 11c) The method of claim 3 characterized in that the location information and the step containing the speech are included.

6 • In response to the light emission instruction command “Π” from the tag (11a.11b11C), light emission is performed in anticipation of the frame period of the imaging means (103). The steps to write the word of mouth are 刖 id tag (1 1 a 1 1 b

The emission duration of 11 C) is set within one frame of the mP3 31 image means (103) and within one frame of the imaging means (103). Each of the image pickup means (103) is set as one of the time periods during which the shutter of the self image pickup means (103) is open. A frame image signal in frame units including a step for successively specifying a light emitting position of the ancillary element (11a1 1b1 1c); The real world object according to any one of claims 2 to 5. Way of thinking

7 帯 The optical element of the ancillary element (1 1 a 1 1 b 1 1 c) has a function to emit light repeatedly at a predetermined cycle and a repeated time after a guard time of random length. Equipped with one of the functions to emit light.

情報 Information about the light emitting point where the light was emitted is output as the position information. M The mark (11a 1 1b 1 1c) is assigned m in advance. The identification information is transmitted to the recording system (2) in synchronization with the recording light emission.

刖 The receiving step is 己ココ---

The information indicating the position of the light-emitting occupancy is obtained by imaging the light emission of the incidental element (11a, 11b1 1c) by the imaging means (103) by (2). And a step for receiving the BC-specific information, which is transmitted in synchronization with the light emission.

The knowledge step includes a real-world object (o 3. The method for recognizing a real-world object according to claim 2, further comprising a step for recognizing the position as a, O b 〇 c).

8 • Step to transmit a light emission instruction including identification information to specify the 刖 attached band (1 1 a 1 1 b 1 1 c) to the PU π computer system (2) In addition to

Based on the transmission step of the computer system (2), the light emission instruction is issued with the attached indicator (1 1 a 1 1 b 1

1C), when the identification information included in the light-emitting instruction command and included in the light-emitting instruction command matches the identification information assigned to the self-attached element, the light-emitting element of the accessory is recorded at P. When light is repeatedly emitted for a predetermined period of time and in a predetermined cycle in response to the flash command

The receiver and receiver for the m record are m records.

According to (2), the light emission of the accessory (11a11b11c) is imaged by the imaging means (103) to obtain position information indicating the position of the light-emitting area. The RJII <app contains the acquired location information of the light emitting point of the real world object (oa 〇 b, 〇 c) specified by the identification information. The world object X of claim 2, characterized in that it includes a step of orally sensation as the position β. Heart

Method o

The auxiliary element ヽ

(Note to the light command)

, '.

When the light emission is performed in synchronization with the frame cycle,

,

The above-mentioned JJ's recognition step is performed for the attached element (11a11b

The light emission duration of 1 c) is determined by one of the imaging means (103).

,,

A frame image signal of each frame unit of the imaging means is also defined as the frame.

1b, 11c). The method according to claim 8, wherein the method includes a step for continuously specifying the light emission position of (c).

, ヽ,

10 • Real-world genuine business information related to real-world objects (Oa, Ob, Oc) is transferred to a computer system (2) that constitutes the cyber world. . Real World Obuji X X

In the manner of oral sense,

, '-ヽ

付 The attached element (1 1 1) attached to the real world object (0 ao boc) and assigned with the identification information

, -A11b11C), indicating the identification information and the position of the associated element (11a11b11c).

,-Steps to receive position information by the computer system (2)

刖 Notes (11a11b, 11c) are attached.

,

A step of acquiring the image of the real world object X cut by the recording system (2);

,

Acquires the separate information and the position β information of the received fir-elements (11a11b, 11c) with the record by the record acquisition step. Steps to associate with the object of the world objet ((a 〇 b 0 c)

Based on the identification information and location information of the associated i-attached element (11a, lib, 11c) and the image of the real world object X cut (0aOb, 0c). The incidental child

The position of the real world object h (〇 a, O b 〇 c) corresponding to (1 1 a 1 1 b 1 1 c) is specified by the computer system (2) Steps and

A method for recognizing real-world objects, characterized by having

The W-system (11a1 1b11c) with the notation emits light in response to the light-emitting instruction command, and emits information on the light-emitting point as recording position information.発光ンン発光発光発光発光発光発光発光発光発光発光発光発光発光発光発光発光発光発光発光Prepare more steps

Based on the transmission step of the recording overnight system (2), the light emission instruction command is sent to the attached element (1 1 a 1 1 b 1

1C), when the identification information included in the light emission instruction command and included in the light emission instruction command matches the identification information assigned to the white accessory element, the accessory emits light via the light emitting element. Emitted to ft field α

刖 The reception step is the record-evening system.

According to (2), the light emission of the incidental element is One it image means with a given it image field of view

Includes a step to acquire position information indicating the position of the luminous occupancy by imaging using (103a).

The image acquisition system is a computer system.

According to (2), the first imaging means (103 a) and the second imaging means (103 b) having an imaging field of view of abbreviated | pj are used to write W1 real world objects (103). oa 〇 b O c)

10 Real World Object Method

1 2 • m Note associated with the mark (1 1 a 1

1b1 1C) Identification information Location information and images of real world objects (0a0boc)

The image in the 3 frame is provided with a step shown as 3 content.

At least one of the first and second imaging means (103a, 103b) in the elephant field of view is the elephant image.

3 Larger than the tenth V frame <

Description image n Identification information of other real world objects (0 a 〇 b 〇 c) that exist outside the frame of the light emission. Then

1 and a step of grasping based on the information obtained by the lesser of the second imaging means (103a103b) and the lesser one of the imaging means.

Other real-world objects (O a O b, ο c) Identification information of the luminous occupancy position information and the occupancy at the time of luminescence

The real-world object method according to claim 11, wherein the method further comprises:

13. The ancillary element (11a, lib, 11c) is a state of the real world object to which the ancillary element (11alib, lie) is attached and the real world object. Jet

(oa O b 〇 c) A sensing system that senses a small number of objects in the vicinity of the object and stores sensing information about the detected real world object. It has sensing means (17) for transmitting to

A step is provided for receiving the sensing information sensed by the sensing means (17).

The wit step receives the attached note (1 1 a

11b1 1C) The step of associating the sensing information with the identification information and the location information of (C) and assembling the linked information as the real world workbook information is included. M The real-world object h recognition method according to any one of claims 1 to 9, which is characterized by:

1 4 • Send a sensing instruction command including identification information that identifies the attached element (11a1 1b1 1c) by the computer system (2). To provide additional steps -

刖 Computing-evening Sensing instruction command of the system (2) Based on the transmission step, a <sensing instruction command is received by the auxiliary element and the sensing instruction is received. When the identification information included in the singing instruction command is assigned to the self-attachment / equivalent to the pSi specific information, the identification information is sensed from the attachment through the sensing means (17). When the sensing information is transmitted, the sensing information receiving step is carried out by the computer evening system (2) by means of the recording element (1). la, lib

11. The method for recognizing a real-world object according to claim 13, which includes a step for receiving the sensing information of 1c).

1 5 • The sensing information is written in the attachment (1 1 a

1 1 b 1 1 c)).

3 It is sent to the computer system (2). The sensing information reception switch includes the identification information from the computer system (2). N step 1 characterized by including a step for receiving sensing information.

3 real worlds

1 6 • The notation element (11a, 11b11C) is attached to the real-world object X ((a, 〇b) to which the accessory element (11a11b, 11c) is attached. , 〇 c)

The state Bp and a small number of the states in the vicinity of the real world object (0 a 〇 b, Ο C) are known. It has sensing means (17) for transmitting sensing information about the block (0 a ο b Ϊ 〇 C) to the recording computer system (2). ,

A step for receiving the sensing information sensed by the sensing means (17);

The image associating step includes the identification information, the position information, and the sensing information of the received recording accessory (11a1 1b11C) in the recording acquisition step. Includes the steps to associate with the image of the real world talent X-cut ((a0b, OC)

識 The marking steps are the associated 刖

(11a1 1b1 1C) based on the identification information, location information, sensing information, and the image of the real world object (Oa, ob0c) B-item X, which is characterized by including a step to be aware of

1 Real-world X-box of any one of 2

17 7 By the computer system (2), a sensing instruction including the information on the cruise to identify the child (11a1 1b1 1c) is issued by the computer system (2). Be prepared to send more steps

Based on the sensing instruction transmission step of the above-mentioned system- evening system (2), the <sensing instruction command is 刖 Bel attached element (1 1 a 1 1 b 1 1 c ), And If the other information included in the single finger instruction matches the identification information assigned to the self

When the sensing information sensed from the attached element via the sensing means (17) is transmitted, □

The step of receiving the sensing information is as follows: The recording system (2) uses the recording element (11a1 1b

11. The method of claim 16, wherein the method includes a step for receiving the sensing information of 11 c).

1 8 • The sensing information is written in the attached element (1 1 a

Together with the identification information assigned to 1 1b 1 1c)

3 Sent to the evening system (2)

The sensing information receiving step includes a step for receiving sensing information including IB nl-specific information by the computing system (2). Feature Claim 1

6 Description of the real world method of mind

1 9 付 The attached element (1 1 a 1 1 b 1 1 C) has an operator (16 a) for performing a predetermined operation, and is connected to the computer system (2). And a step for transmitting an action element operation command including identification information for specifying the B'J-attached element (11 alib 11 c).

(1) A bulletin regarding a predetermined operation executed in response to the operation order of the operator is transmitted by the operator (16a). In this case, a step for receiving the operation information that is included in the operation is further provided,

'-刖口芯 ¾ は ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾-

11b, 11c), the relevant information is associated with the operation information, and the associated information is regarded as the real-world object information. The method of claim 1, wherein the method includes a tip. 10. The method of claim 1, further comprising:

20 Note 3 Operator operation of the computer system (2) <Operator operation command is applied to the attached element (1 1 a 1 1 b 1 1 c) based on the transmission step. When the identification information included in the operation element operation instruction is received by the communication device and the identification information assigned to the self-attached element matches the identification information (= 3, the auxiliary element operation instruction is issued). When the information on the predetermined operation executed in response to the information is transmitted, the operation-related information receiving step is executed by the m-operation computer.

.,

According to the system (2) Ό 付付 (1 1 a j 1 1 b,

11. A real-world X-cut according to claim 19, which includes a step for receiving the operation-related information of 1 c).

Method.

21. The operation-related information is transmitted to the computer system (2) together with the identification information assigned to the auxiliary element (11 alib, 11 c). And 刖 The operation-related information receiving step is characterized in that the operation-related information receiving step includes a step for receiving the operation-related information including the identification information by the recording system (2). Section 19: Real World Object Method

2 2 刖 The attached elements (1 1 a, 1 1 b 1 1 c) have action elements (16 a) for performing predetermined operations, and

'-3 3 3 ス作用作用作用作用作用ススススススススススススススススススススススススWith tape

The information on the predetermined operation executed in response to the operation element operation instruction "P" is transmitted from the operation element (16a). At this time, the operation-related information on the operation is transmitted. In addition to the receiving step

In the image association step, the identification information, the position information, and the operation-related information of the incidental element (11a11bj11c) received are stored in the record acquisition step. Includes steps associated with images of acquired real world objects (Oa, Ob bc)

The u-motion amplifier is associated with the associated element.

(11 a, 11 b 1 1 c) identification information ML location information operation related information and BC real world object X (〇 a O b,

The method according to any one of claims 10 to 12, characterized in that the method includes a step of fuzzily recognizing real world object X cut information based on the image of (c). Real world object recognition method. ,

2 3 Operator of operator (2)

The operation element operation instruction is received by the ancillary element (11a11b, 11c) based on the transmission step and the identification included in the operation element operation instruction. At a location where the information matches the identification information assigned to the attached element, information on a predetermined operation executed in response to the third action element activation command is transmitted from the attached element. If you

The operation-related information receiving step is performed by the recording system (2) using the HIJ-attached element (11a1 1b

11. A real world object of β request m22 characterized by a step including a step for receiving the operation related information of 11c). Heart way. 24. The recording operation related information is written in the

11b, 11c) and the identification information assigned to

The step of receiving the operation-related information transmitted to the computer system (2) includes the operation-related information including the identification information by the computer system (2). Claim 22 characterized in that it includes a step for receiving information

ヽ,

Real World Oven X Ku Pji Mouth- ^ Method

, ❖,

25. Record the status of whether or not the real world X-cut to be the target of the 'recording' is nP in the field of view of the recording means (103). System (2) Judgment is performed within the predetermined time period. If the time is within the predetermined time period, it is determined that the real world X-cut (0a0bOc) has climbed into the imaging field of view. Otherwise, it is determined that the real world object (〇 a 〇 b 〇 C) has left the inside of the imaging field of view. The real-world Xbox B method described in any one of the above

2 6 • The image pickup means (] L 0: 3: X 10 3 y 1 0 3 z) is provided in plural.

A step in which a plurality of frame image signals are picked up by the plurality of image pickup means (10 3 X 10 3 y 10 3..

Based on the luminous point 1 obtained from each imaging means (103 X103 y103z), the angle between the recorded real space object (0a 〇 b0c) is determined by angle measurement. Steps to get location information and

A step of further comprising a step of recognizing the acquired spatial position information as the position information of the real world obn X cut ((a0b〇c). The method of World X X in any one of 2 to 25

2 7 • 口口

Past emission of the attached element (11a11b111c) attached to the real world object X-cut (〇a, ObOc) The step of recognizing the light occupation by giving priority to the area estimated from the position

The contour of the X-h h including the past light emission occupation is captured from the image image by the second imaging means (103 b), and the light emission of the auxiliary element (11a1 1b1 1c) is performed. During the period when the user is unaware of the fact, the movement of the outline of the object is tracked from the image captured by the second imaging means (103b), whereby the additional element ( 1 1 a 1 1 b, 1 1 c)

Claim 1 1 1 2 which further comprises

1 6 2 2 and 23, any one of the methods described above

2 8 • 刖

A light emitting point for detecting the light emitting point from the light emitting element of the incidental element (11a11b111c) attached to the real world object (Oa〇bOc). Either reflect the past light-emitting partial image of the evening template and the marking element (1 1 a 1 1 b 1 1 c) or use the real-world object (0 a ο b O c) A template used as a template for a light emitting panel to recognize the light emission from the light emitting element of the incidental element attached to the light emitting element of the past. Match the letter with the letter (1

1 a 1 b 1 1 c) wherein the light emitting device includes a step for specially examining the light emission from the light emitting element of claims 2 to 9. And a method for recognizing a real world object according to any one of items 11 to 26.

2 9-Claim 2 is characterized in that a step for interrupting the recording detection process is provided while the photographing condition of the recording means (10 3) is--5.世界ォ世界世界世界世界世界世界世界世界

30 • The step of acquiring the position of the light-emitting position information is characterized by discarding the light-emitting position information extracted at that time when the position of the light-emitting point of the number is recognized. The method of the real world X-X o method 3 1-記載 described in any one of the requests 2 to 9 and 11 to 29

The light emitting pattern consisting of multiple flashes and non-flashes of the indicator is collated. The flasher is a luminous tan, and the corresponding accessory (11a1 1b1 1c) is attached. The feature of m is to determine the position of the real world object h (〇 a 〇 b 〇 c), and to associate the position information of the mouth and mind with the identification information and the information on the occupancy of light emission. Items 2 to

9 and the method of any one of 11 to 30 of the real world X-h method according to any one of the above items 32. The recognition step is performed by the real world object. (〇 a O b 〇 C)

1b 1 1c) as a template of the light emitting panel for recognizing the light emission from the light emitting element of (c).

The light intensity at the center of 1 a 1 1 b 1 1 c) is set to be close to the light intensity of the path, and a template whose light intensity decreases conically from the center is used. 2-9 Nine-by-one method 11-11

m

3 3 刖 The tag (1 1 aj 1 1 b 1 1 c) has a plurality of light emitting elements with different wavelengths.

Claim 2 wherein the imaging means (103 (: 330)) is provided with filters having different attenuation values for a plurality of wavelengths of a plurality of light emitting elements. To 9 and 1

3. The real world object method according to any one of 1 to 32.

34. The method according to claim 1, wherein the light-emitting element emits light while changing its light intensity in response to the light-emitting instruction.

The method for real world observing according to any one of 2 to 9 and 11 to 32

35. There are a plurality of light emitting elements, and the plurality of light emitting elements emit light while changing the light intensity of the plurality of light emitting elements as a whole according to the number of the light emitting elements. Claim 3 4 world object recognition methods

Real

36 The noted knowledge step V is an area in which the received light intensity of the attention frame image signal obtained by the noted imaging means (103) is higher than a predetermined value. Claims 2 to 9, which are characterized in that the area in which the luminous area ratio in the minimum rectangle that contains the luminous area is greater than or equal to a predetermined value is set as the main luminous object. 1 Any one of 1 to 35

,

The listed world talent bun X k

3 7 • In the real world (o a 〇 b 〇 c)

,

Related real world X

, ❖

A real-world X-cut oral device for

,

It is attached to the real world object (0a 〇 b 〇 C), and is assigned to a single identification information from the nubs (11a11b, 11c). Means for receiving the emitted identification information and the position information indicating the position of the attached w element (11a11b11C), and the received attached band (11a11b1) 1C) and the corresponding element based on the location information.

, *

A means for identifying the position of the real world X-cut (〇aLaOb0c)

A real-world object X-Kut oriental sensation device that features a shito with a. 3 8 • The indicator (11a, 11b, 11c) emits light in response to the light-emitting instruction command, and information on the light-emitting area and the light is recorded as the position information. A light emitting element for outputting the light, and further including means (21) for transmitting a light emitting instruction, including identification information for specifying the tag.

The light emission instruction based on the transmission means (21) is received by the attached element (11 a, 11 b, 11 c), and the light emission instruction is included in the light emission instruction “P”. A where the information matches the identification information assigned to the white accessory A. When light emission is emitted from the attached device via the light emitter,

The receiving means is a 刖 attached element (11a? 11b, 1

The light emission of 1C) is captured as a frame unit image using imaging means (: 22 (10'3;)). Equipped with a hand to obtain information,

,

The record ρ recognition means uses the acquired record information,

, ■ * »

刖 As the position of the real world oven X cut (〇 a, ο b 〇 c). With the means to know

Si featuring

Claim 37: Real World Object X

3 9

A predetermined frame image signal on the time axis is obtained from the note S frame image signal at the time of light emission of the tag imaged by the imaging means (22 (103)). Means (23) for subtraction by intensity ratio, and For the frame image signal that has been subjected to the arithmetic processing of the above, the noise reduction processing that includes the lesser of the inter-field processing and the patterning V-processing is performed. Means of application (2

3) and

Frame image signal and noise reduction processing

,,

Image with the highest pixel density

. Means of knowledge (23) and

The position in the frame image of the luminescence image recognized by ρ

(1 1 a 1 1 b 1 1 c)

The real world object according to claim 38, further comprising _ and.

B core

40 • The memory reduction means (23) is adjacent to the image signal and the frame image signal; “frame image a”

(1 1 a 1 1 b 1 1 c) The process of subtracting a small <from the frame image signal when no light is emitted and the note before and after the frame image signal. One of the processes for subtracting the image signal at a predetermined intensity ratio from the

Note that the result of the subtraction processing becomes negative. Note: The image signal in the huge frame image signal and the small number of the image signal in the huge frame image signal Means to remove both

The real world described in claim 39, which features and Business center

41. The spatial filter processing of the noise reduction processing means (23) is performed in accordance with the predetermined filter size in the note frame image signal. Note: The process of averaging the pixel signal intensity values of each image within the image range is performed over the entire area of the frame image signal, and priority is given to this averaged signal intensity. Including the process of assigning a ranking,

The V-tuning process is a correlation process with a definition similar to the emission pattern of the 刖 BC-attached element in the pattern-matching region of a predetermined size.注 Note: This process is performed for the entire area of the big frame image signal, and includes the process of assigning priorities according to the signal strength of the result.

The noise reduction processing means (23) is provided by one of the processing of the U-space recording file processing and the recording matching processing. Based on priority 刖

ヽ A means for selecting the position of the luminous pattern, and identifying the position of the selected luminous pattern with the positional information of the attachment (11a1 1b1 1c).冃冃項実 3 実世界世界世界世界

4 2. 撮像 In response to the light emission instruction command from the Si3 auxiliary element (11 a 1 1 b 1 1 c), the imaging means (22 (1 0

3) When the light is being synchronized in synchronization with the frame period of)), The recognition means sets the light emission duration of the incidental element within one frame of the imaging means (22 (103)) and within one frame of the imaging means, and Means (22 (10 3)) is set as one of the time periods during which the shutter is open, and the imaging means (22 (10 3)) is set.

3)) means for continuously identifying the light position of the PC tag (11a11b, 11c) based on the frame image signal of each frame unit of the above). The real-world object mouth ', the package according to any one of claims 38 to 41

4 3 帯 The luminous element of the ancillary element (1 1 a 1 1 b 1 1 c) has a function of emitting light repeatedly at a predetermined cycle and a random length of 1 hour. It has one of the functions of returning light emission, and outputs information on the light emitting point that has emitted light by any of the above functions as the positional information, and outputs the information. The element (11a, lib, 11c) transmits the pre-assigned identification information in synchronization with the light emission,

The receiving means captures the light emission of the incidental element (11a, lib, 11c) by the imaging means (22 (103)), and indicates a position indicating the position of the light-emitting point. Means for acquiring information, and receiving the identification information transmitted in synchronization with the light emission,

The recognizing means converts the acquired position information of the light emitting point into Claim 38. The real world object according to claim 38, further comprising means for recognizing the position of the real world object (〇 aob ο c) specified by the separate '1' blue report. X cut equipment β

4 4-手段 There is further provided a means for transmitting a light emission instruction command including identification information for specifying the ancillary element (1 1 a 1 1 b 1 1 c).

Based on the transmitting means (21), the light emission instruction is received by the attached element (11a1 1b1 1c), and the identification information included in the light emission instruction is used as an accessory element. The light emitting element of the incidental element repeatedly emits light for a predetermined time and at a predetermined period in response to the light emitting instruction command when the identification information assigned to the light emitting element is matched. At this time, the receiving means captures the light emission of the attached element by the imaging means (2

2 (10 3)) to obtain position information indicating the position of the light-emitting area and the position of the light by capturing the image.

The mouth recognition means transmits the acquired position information of the light emission occupation and ヽ.

,

識別 Real world object (o a

O b 〇 c) with a means to identify the position of (_ and

,

The World of X-Cut Identifier as defined in claim 38.

45. The frame of the image pickup means in response to the light emitting instruction command or the incidental device (11a, lib, 11c). When the light emission is being performed in synchronization with the period, the recognizing means of the “m” indicates that the additional element (11a, 11b, 1)

The light emission duration of 1 c) is

3)), and is set within one frame of the auxiliary element (11a) by the frame image signal of each frame unit of the imaging means (22 (103)). , lib, 11c), characterized in that it comprises means for continuously identifying the light emission position of the real-world object recognition device ia according to claim 44.

4 6 Real world object information about real world object h (0aO boc) is stored in a real world object k1 unit for constructing a server world.付 Attached elements (11a11b, 11c) attached to the real world X-cut (Oa〇b〇C) and assigned unique identification information Means for receiving the identification information issued by the user and position information indicating the positions of the attached elements (11a, 11b, 11C);

A means (30) for acquiring an image of a real world object to which a note (11a, 11b11C) is attached.

(1 0 3 b)) and,

The identification information and the position information of the received recording accessory (11a11b11C) are acquired by the recording acquisition means (30 (103b)). Means (47) for associating with the image of the real world

Associated associated element (1 1 a 1 1 b 1 1 C), based on the identification information, the position information, and the image of the real world object, the real world object (〇a) corresponding to the attached element (11 alib, 11 c). 〇 b O c)

A real-world object recognition device that features:

4 7 • Light emitting element (11a, lib, 11c) emits light in response to a light emission instruction command, and outputs information on the light emitting point as the recording position information. And means (21) for transmitting a light emission instruction command including other information for specifying the incidental element (1 la, lib, 11 c).

The light emitting instruction based on the transmitting means (21) is received by the tag (11a11b, 11c), and the identification information included in the light emitting instruction is added to the accessory. When light emission is emitted from the incidental element via the light emitting element when the assigned information matches the different information.

The receiving means may include the auxiliary element (1 1 a 1 1 b 1

1c) the luminescence of the real-world object (oaOb

情報 Position information indicating the position of the light-emission occupancy is obtained by imaging using the first imaging means (22 (103 a)) having a predetermined imaging visual field area including c). The image acquisition means (30 (103b)) has two image pickup areas having substantially the same imaging field of view as the first image pickup means. The real world object described in IS 46, characterized in that the real world object is provided with a means for capturing an image of the real world object using the means (30 (103b)). G Recognition

4 8-The incidental element (11 a 1

1b 1 1c) The identification information, location information and the image of the real world object Xa (Oa, Ob, Oc) are used as the image content in the predetermined image content frame. Equipped with means for displaying

First and second imaging means (22 (1 ■ C) 3 a)

30 (10 3 b)) of the imaging field of view is slightly larger than the above-mentioned image content frame and may be outside the above-mentioned image content frame. The real world of

The state including the identification information of the X cut (oaob, 0c), the occupancy position information and the time of emission is defined as the side standby state.

1 and 2nd imaging means (22 (103 a) 30 (1

0 3 b) means for grasping based on the information obtained by at least one of the imaging means;

Means for identifying the identification information of the other real world object (〇 a ob 0 C), the light emitting point position information, and the light occupancy by the light source.

The real-world object '! ^ NB ^ ¾t li 49 according to claim 47, further comprising: the auxiliary element (11 alib, 11 c) The state of the real world X X (O a, 0 b, 0 c) to which the tag (1 1 a 1 1 b 1 1 c) is attached and the real world X X h (0 a 0 b) , 〇 C) that transmits sensing information about the real world object X (0a0b 〇 c) Have means (17)

刖 Means for receiving the sensing information detected by the recording sensing means (17) (4-

1)

m means of identification is the received iu attached element (1 1 a 1

1b 11 1) The information obtained by associating the sensing information with the identification information and the position information of C) is defined as the real world X-cut information. The real-world object recognition device according to any one of claims 37 to 45, characterized by comprising means (47) for recognizing the real world.

50 0 刖 A means (40) for transmitting a sensing instruction command including identification information for specifying the tag (11a, lib, 11c) is further provided.

セ The sensing instruction command based on the sensing instruction command transmission means (40) is used to send the sensing element (11 a, 11 b 1

1c) when the identification information received in the sensing instruction command and included in the sensing instruction command matches the identification information assigned to the self-attached element, When the sensing information sensed via the sensing means (17) is transmitted, the sensing information receiving means (41) transmits the sensing information. The sentence of the attached notation (11a, 11b, 11c)

Claim 49. The real world object ii according to claim 49, characterized by comprising means for receiving the m report.

5 1 The sensing information is written in the attached element (1 1 a

1 1 b 1 1 c) is transmitted together with the separate information. Ό The sensing information receiving means (41) is a sensing device including the identification information. 50. A real-world X-box according to claim 50, further comprising means for receiving information. Attire

5 2 • IU marked element (1 1 a 1 1 b 1 1 c) is a real world object X (〇 a 〇 b 〇 c) with the corresponding element (11 a 1 1 b, 11 c) And the real world object X, which senses and detects at least one of the abilities in the vicinity of the real world object (〇a, 〇bOc). Sensing means for transmitting sensing information

(1 7)

A means (41) for receiving the recording sensing information detected by the recording sensing means (17);

The image image associating means (47) is a means for acquiring the identification information of the received incidental element (素子 aObOc), the positional information and the sensing information, and 0 (1 0 3 b) 手段 Equipped with a means for relating the image of the real world object X (〇 a 0 b O c) The recording means is the identification information of the associated incidental element (11a1 1b11c), the location information, the sensing information, and the real-world talent (0a, 0a). (b) a means for recognizing real-world X-act information based on the image of (c), wherein the real-world gifted business object according to any one of claims 46 to 48 is provided. X cut RS¾lA.

5 3 A means (40) for transmitting a sensing instruction command including identification information for specifying the attached band (11a11b11c) is further provided.

Based on the sensing instruction notifying means (40), a <sensing instruction command is applied to the marked element (1 1 a J 1 1 b 1

1c) When the identification information transmitted in the sensing instruction command and included in the sensing instruction instruction matches the identification information assigned to the white band, the data is written from the band. The sensing information receiving means (41) has been transmitted when the sensing information sensed via the sensing means (17) has been transmitted. Claim 52. The method of claim 52, further comprising a means for receiving sensing information of the attached element (1 1a 1 1b 1 1c). Equipment

5 4-Sensing information is in the attached band (1 1 a

1 1 b 1 1 c) is transmitted together with the identification information assigned thereto, and the sensing information receiving means (41)

手段 A means is provided for receiving sensing information including other information. A real world object according to claim 52, characterized in that:

5 5 付 Annotation. 帯 ((1 1 a 1 1 b 1 1 c) has an operator (16 a) that performs a predetermined operation. Means for transmitting an operator actuation command including identification information for identifying 1 1 C) and

関連 Operation-related information on the operation when the information on the predetermined operation executed in response to the BJ-operation element operation instruction is transmitted by the operation element (16a) And means for receiving the

口 The recording means is the received attachment (1 1 a 1

1b 1 1c) is associated with the operation-related information to the identification information and the position information, and means (47) for identifying and associating the associated information as real world job information is provided. The real-world X-cut device according to any one of claims 37 to 45.

5 6 Operation element operation Command transmission means (45)

<The operation element operation instruction is indicated by the 刖 mark (1 1 a 1 1 b

11c) when the identification information received in the operation element operation command and included in the operation element operation command matches the identification information assigned to the incidental element, the operation element activation operation from the element is performed at α. If information is sent about a given action performed in response to the instruction, The world object according to claim 55, wherein the operation-related information receiving means (46) is characterized in that the operation-related information receiving means (46) is provided with a means for receiving the transmitted information attached thereto and the operation-related information of the child. X-cut recognition device.

-ヽ-

5 7 The nu notation information is written in the tag (11 a,

1 1 b, identification information assigned to Ί 1 c) and transmitted to ヽ

,

In addition, the operation-related information receiver (46) has a means for receiving operation-related information including the identification information.

, ❖

A real-world object recognition apparatus according to claim 55, further comprising:

58. The ancillary element (11a, lib, 11c) has an action element (16a) for performing a predetermined operation, and the ancillary element (11a, lib, 11c) has a function element for performing a predetermined operation. Means (45) for transmitting an action element activation command including identification information for identifying 1 1 c);

Means for receiving operation-related information on the operation when information on a predetermined operation executed according to the operation element operation command is transmitted from the operation element (16a). 4 6) and

The image associating means (47) obtains the identification information, the position information, and the operation-related information of the attached element (11a, lib, 11c) received by the obtaining means (30 (10) 3b) The real world objects (Oa, O means for associating the associated element (11a1lb, 11c) with the identification information, position information, operation-related information, and information of the associated element (11a1lb, 11c). 47. A system according to claim 46, further comprising means for recognizing real world object information based on an image of the world object (〇a, 0b0C). Real world object k ¾fe ¾ as described in any one of

1

,

5 9 υ 作用作用作用作用作用作用作用作用作用作用作用作用作用作用作用

11 C) The identification information received and included in the operation element operation instruction matches the identification information assigned to the white accessory. □ In response to the operation element operation command from the accessory. When information about a given action performed in the past has been sent □

,

The operation-related information receiving means (46) is transmitted.

,

Claim 5, characterized in that it is provided with means for receiving operation-related information of the auxiliary elements (11a11b, 11c).

8 Real world talent X X cut. Heart device

60. The operation-related information includes the auxiliary element (11a,

The operation-related information receiving means (46) transmitted to the user and the separate information allocated to 11b1 1c) is a means for receiving the operation-related information including the HU identification information. Claim 58. A real-world object according to claim 58. Recognition device.

6 1 A computer system (2) which has identification information attached to the X-Cut (〇a〇b〇c) of the real world and composes the SA world corresponding to the real world ) And an accessory (11a11b111c) capable of line communication with

識別 Identification information and the attached nr thread (11a, 11b1

A communication means (15) for transmitting the location information representing the 1 L position of 1 C) to the 'J's own computer system (2);

,,

Note: The state of the real world Xb b (〇a0b, 0c) and the real world Xb X ( O a O boc) is sensed, and the sensing information about the sensed real world object X is recorded. Sensing means for transmitting to the system (2)

(1 7) and

所定 Executes a predetermined operation in response to an operation command from the computer system (2), and stores operation-related information related to the operation in a computer-based system. A. Ft work means (16) sent to

Ancillary element characterized by having