WO2024100769A1

WO2024100769A1 - Positioning system and positioning method

Info

Publication number: WO2024100769A1
Application number: PCT/JP2022/041577
Authority: WO
Inventors: 良雄宮崎
Original assignee: 株式会社ソニー・インタラクティブエンタテインメント
Priority date: 2022-11-08
Filing date: 2022-11-08
Publication date: 2024-05-16

Abstract

The present invention enables an operation device to acquire the position of a user who holds the operation device. A positioning system (1) comprises: a wearing fixture (30) that is worn by a user and that can communicate with the an operation device (20) held by the user; and a communication apparatus (40) that can wirelessly communicate with the mounting fixture (30) and that is disposed apart from the user. The wearing fixture (30) or the communication apparatus (40) calculates the position of the wearing fixture (30) on the basis of communication between the two. The wearing fixture (30) transmits information about the calculated position of the wearing fixture (30) to the operation device (20).

Description

Positioning system and positioning method

This disclosure relates to a positioning system and a positioning method.

Patent Document 1 listed below describes an operating device used to operate applications such as games. The operating device is capable of wired or wireless communication with an information processing device that executes the application, and transmits signals corresponding to operations performed by a user on the operating device to the information processing device. Patent Document 1 listed below also describes that the operating device is provided with a light-emitting unit that receives light from a light source such as an LED and emits light, and the position of the operating device (the position of the user holding the operating device) is detected by detecting the light from the light-emitting unit through a camera connected to the information processing device.

JP 2022-107542 A

For example, if an operating device can obtain the position of a user who owns the operating device, it can transmit that position to an information processing device. The information processing device can change the position of an image or an object in an image displayed on a display based on the user's position received from the operating device.

The objective of this disclosure is to enable an operating device to obtain the location of the user holding the operating device.

The positioning system according to the present disclosure includes a wearable device that is worn by a user and capable of communicating with an operation device held by the user, and a communication device that is capable of wireless communication with the wearable device and is positioned away from the user. The wearable device or the communication device calculates the position of the wearable device based on communication between the wearable device and the communication device. The wearable device transmits information relating to the position of the wearable device calculated by the wearable device or the communication device to the operation device. This allows the operation device to obtain the position of the user holding the operation device.

The attachment according to the present disclosure is worn by a user and is capable of communicating with an operating device held by the user and a communication device disposed at a distance from the user, and calculates the position of the attachment based on communication between the attachment and the communication device, and transmits information relating to the calculated position of the attachment to the operating device. This allows the operating device to obtain the position of the user holding the operating device.

In addition, the positioning method according to the present disclosure is a positioning system including a wearable device worn by a user and capable of communicating with an operation device held by the user, and a communication device capable of wirelessly communicating with the wearable device and positioned away from the user, in which the wearable device or the communication device calculates the position of the wearable device based on communication between the wearable device and the communication device. The wearable device transmits information relating to the position of the wearable device calculated by the wearable device or the communication device to the operation device. This allows the operation device to obtain the position of the user holding the operation device using the wearable device and the communication device.

FIG. 1 is a diagram illustrating a positioning system according to an embodiment of the present disclosure. FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device and an operation device. FIG. 2 is a diagram illustrating an example of a hardware configuration of the wearing tool and the communication device. FIG. 2 is a functional block diagram showing an example of functions of the wearing tool, the communication device, and the information processing device. FIG. 11 is a functional block diagram showing another example of the functions of the wearing tool, the communication device, and the information processing device. 11 is a diagram showing an example of a method for calculating the distance between the wearing tool and the communication device. FIG. 13 is a diagram showing an example of a method for calculating an angle between the wearing tool and the communication device. FIG. 13 is a diagram showing another example of a method for calculating an angle between the wearing tool and the communication device. FIG. FIG. 13 is a diagram showing another example of a method for calculating the position of the wearing equipment. FIG. 13 is a diagram showing another example of a method for calculating the position of the wearing equipment. FIG. 11 is a diagram showing an example of a flow of a positioning process of a wearing tool performed in a positioning system. FIG. 11 is a diagram showing another example of the flow of the positioning process of the wearing equipment performed in the positioning system.

1. System Configuration
Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Fig. 1 is a diagram showing a positioning system 1 as an example of an embodiment of the present disclosure. As shown in Fig. 1, the positioning system 1 includes an operation device 20 capable of wired or wireless communication with an information processing device 10 that executes an application such as a game. The positioning system 1 may include the information processing device 10 and a display device 5 such as a liquid crystal display or an organic EL (Electro Luminescence) display that is electrically connected to the information processing device 10.

The operation device 20 is held by a user and used to operate applications executed on the information processing device 10. In the example shown in FIG. 1, the operation device 20 is held by the user's left hand 2L and right hand 2R. In the example shown in FIG. 1, the operation device 20 is a game controller, and includes a plurality of operation buttons 24a, a cross key 24b, and an operation stick 24c. The operation device 20 may also include a microphone, a speaker, a touch sensor that senses contact with a finger or the like, an inertial measurement unit (IMU) that detects acceleration, angular velocity, and the attitude (tilt) of the operation device 20, and the like.

The positioning system 1 includes a wearable device 30 worn by the user and a communication device 40 arranged at a distance from the user, as shown in FIG. 1. The wearable device 30 is capable of communicating with the operation device 20 held by the user, and the communication device 40 is capable of wireless communication with the wearable device 30. The communication device 40 is supported by a support 48 such as a tripod. Note that communication between the wearable device 30 and the operation device 20 may be wireless or wired. In the example shown in FIG. 1, the wearable device 30 is a band (bracelet) worn on the user's wrist (the wrist of the right hand 2R in the example shown in FIG. 1). The wearable device 30 is not limited to this, and may be anything that can be worn by the user, such as a ring worn on a finger or a necklace worn around the neck.

As described below, in the positioning system 1 according to this embodiment, the operation device 20 is configured to acquire the position of the user holding the operation device 20 using the wearing device 30 and the communication device 40. The operation device 20 can transmit the acquired user position to, for example, the information processing device 10 that is executing an application. Based on the user position received from the operation device 20, the information processing device 10 can change the position of an image displayed on the display device 5 or an object in the image.

2. Hardware Configuration
Fig. 2A is a diagram showing an example of the hardware configuration of the information processing device 10 and the operation device 20. Fig. 2B is a diagram showing an example of the hardware configuration of the wearing tool 30 and the communication device 40. The information processing device 10 is, for example, a computer such as a game device, a video playback device, a personal computer, or a server device. As shown in Fig. 2A, the information processing device 10 includes, for example, a control unit 11, a storage unit 12, a communication unit 13, and a display control unit 14.

In the information processing device 10, the control unit 11 is a program control processor (control device) such as a CPU (Central Processing Unit) that operates according to programs such as firmware stored in the memory unit 12. The memory unit 12 is a memory element such as a ROM (Read Only Memory) or a RAM (Random Access Memory), or an auxiliary memory device such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive). The communication unit 13 is a communication device such as a network board. The display control unit 14 transmits a video signal to the display device 5, thereby causing the display device 5 to display various images. The information processing device 10 may also include an optical disc drive that reads optical discs, a video output terminal such as an HDMI (High Definition Multimedia Interface) (registered trademark), a data input/output terminal such as a USB (Universal Serial Bus), and audio input/output terminals such as a microphone, a speaker, and an earphone jack.

The operation device 20 is, for example, a game controller or a video playback controller. As shown in FIG. 2A, the operation device 20 includes a control unit 21 which is a processor, a storage unit 22 which is a storage device, and a communication unit 23 which is a communication device, similar to the information processing device 10. The control unit 21 of the operation device 20 operates, for example, according to a program (such as firmware) stored in the storage unit 22. The communication unit 23 of the operation device 20 can communicate with the communication unit 13 of the information processing device and the communication unit 33 of the attachment 30, which will be described later, in a wired or wireless manner. The operation device 20 also includes an operation unit 24. The operation unit 24 outputs the contents of the operation to the control unit 21 in response to the user's operation of the operation member. The operation unit 24 may include, for example, a plurality of operation buttons 24a, a cross key 24b, an operation stick 24c, and the like, as shown in FIG. 1. The operation unit 24 may include an interface such as a keyboard or a trackball, or a sensor such as a touch sensor or an IMU.

The attachment 30 is worn by a user holding the operation device 20. As shown in FIG. 2B, the attachment 30 includes a control unit 31 which is a processor, a storage unit 32 which is a storage device, and a communication unit 33 which is a communication device, similar to the information processing device 10 and the operation device 20. The control unit 31 of the attachment 30 operates, for example, according to a program (such as firmware) stored in the storage unit 32. The communication unit 33 of the attachment 30 is capable of wired or wireless communication with the communication unit 23 of the operation device 20. In addition, the communication unit 33 of the attachment 30 includes an antenna, which will be described later, and is therefore capable of wireless communication with a communication unit 43, which will be described later, of the communication device 40.

The communication device 40 is placed at a predetermined position away from the user. In the example shown in FIG. 1, the communication device 40 is fixed at a predetermined position in a room in which the information processing device 10 is placed. As shown in FIG. 2B, the communication device 40, like the attachment 30, includes a control unit 41 which is a processor, a storage unit 42 which is a storage device, and a communication unit 43 which is a communication device. The control unit 41 of the communication device 40 operates, for example, according to a program (such as firmware) stored in the storage unit 42. The communication unit 43 of the attachment 40 includes an antenna, which will be described later, and is therefore capable of wireless communication with the communication unit 33 of the attachment 30.

3. Functional Blocks
Fig. 3A is a functional block diagram showing an example of functions implemented in the positioning system 1. In the example shown in Fig. 3A, the operation device 20 includes, as functions, an operation information acquisition unit 201, a position information reception unit 202, an operation data generation unit 203, and an operation data transmission unit 204. These functions may be realized mainly by the control unit 21 of the operation device 20.

The operation information acquisition unit 201 of the operation device 20 acquires information on user operations on the operation unit 24, such as the multiple operation buttons 21. The operation data generation unit 203 of the operation device 20 generates operation data indicating the content of the user's operation based on the information on the user's operation acquired by the operation information acquisition unit 201. The operation data transmission unit 204 of the operation device 20 transmits the operation data generated by the operation data generation unit 203 to the information processing device 10. The function of the position information reception unit 202 of the operation device 20 will be described later.

In the example shown in FIG. 3A, the attachment 30 includes, as functions, a signal transmission/reception unit 301, a calculation unit 302, and a position information transmission unit 303. These functions may be realized primarily by the control unit 31 of the attachment 30. In the example shown in FIG. 3A, the communication device 40 includes, as a function, a signal return unit 401. This function may be realized primarily by the control unit 41 of the communication device 40.

In the example shown in FIG. 3A, the signal transmitting/receiving unit 301 of the attachment 30 transmits a first signal (request) to the communication device 40 using the antenna of the communication unit 33. When the signal reply unit 401 of the communication device 40 receives the first signal transmitted by the signal transmitting/receiving unit 301 of the attachment 30 using the antenna of the communication unit 43, it transmits (replies) a second signal (response) to the attachment 30. The signal transmitting/receiving unit 301 of the attachment 30 receives the second signal transmitted by the signal reply unit 401 of the communication device 40 using the antenna of the communication unit 33.

In the example shown in FIG. 3A, the calculation unit 302 of the wearing device 30 calculates the position of the wearing device 30 based on communication between the wearing device 30 (signal transmission/reception unit 301) and the communication device 40 (signal response unit 401). The position information transmission unit 303 of the wearing device 30 transmits information about the position of the wearing device 30 calculated by the calculation unit 302 to the operation device 20. The position information reception unit 202 of the operation device 20 receives information about the position of the wearing device 30. In the example shown in FIG. 3A, the position information reception unit 202 receives information about the position transmitted by the position information transmission unit 303 of the wearing device 30. Here, "information about the position of the wearing device 30" may be information indicating the position of the wearing device 30 itself, or may be information about a position corrected with respect to the position of the wearing device 30. For example, the position information transmission unit 303 transmits information about the position of the wearing device 30, so that the operation device 20 can obtain the position of the wearing device 30. In other words, the operation device 20 can obtain the position of the user who holds the operation device 20 and wears the wearing device 30.

In the example shown in FIG. 1, the operation device 20 is operated while being held by the user in the right hand 2R and left hand 2L. The attachment 30 is worn on the user's hand (right hand 2R or left hand 2L) or wrist. In this case, the position of the operation device 20 and the position of the attachment 30 can be said to be approximately the same position. The position information transmission unit 303 of the attachment 30 may transmit the position of the attachment 30 as the position of the operation device 20.

The position information transmission unit 303 of the wearing device 30 may transmit a position corrected from the position of the wearing device 30 to the operation device 20. For example, the calculation unit 302 of the wearing device 30 may calculate the position of the user's chest, head, etc. based on the position of the wearing device 30.

The calculation unit 302 of the wearing device 30 may calculate the position of the operation device 20 based on the position of the wearing device 30 and the relative position of the operation device 20 with respect to the wearing device 30. The control unit 21 of the operation device 20 may calculate the position of the operation device 20 based on the position of the wearing device 30 received from the wearing device 30 and the relative position of the operation device 20 with respect to the wearing device 30. Here, the "relative position of the operation device 20 with respect to the wearing device 30" can be calculated, for example, from the size of the user's hand and the direction from the position of the wearing device 30 to the position of the display device 5 (the direction in which the user is facing). In addition, if the operating device 20 includes a sensor such as an IMU, it is possible to further calculate the relative position of the operation device 20 with respect to the wearing device 30 based on the attitude of the operating device 20. In this way, the operating device 20 can obtain the position of the operating device 20.

In the present disclosure, the user holds the operation device 20. Therefore, in the present disclosure, the "user's position" may include not only the positions of the user's hands, wrists, chest, and head, but also the position of the operation device 20. Furthermore, the operation device 20 acquiring the user's position may include not only the operation device 20 acquiring the position of the attachment 30, but also the operation device 20 acquiring the position of the operation device 20.

FIG. 3B is a functional block diagram showing another example of functions implemented in the positioning system 1. In the example shown in FIG. 3B, the wearing device 30 includes, as its functions, a signal reply unit 304 and a position information transfer unit 305. These functions may also be realized mainly by the control unit 31 of the wearing device 30, similar to the functions of the wearing device 30 shown in FIG. 3A. In the example shown in FIG. 3B, the communication device 40 includes, as its functions, a signal transmission/reception unit 402, a calculation unit 403, and a position information transmission unit 404. These functions may also be realized mainly by the control unit 41 of the communication device 40, similar to the functions of the communication device 40 shown in FIG. 3A.

In the example shown in FIG. 3B, the signal transmission/reception unit 402 of the communication device 40 transmits a first signal (request) to the attachment 30 using the antenna of the communication unit 43. When the signal reply unit 304 of the attachment 30 receives the first signal using the antenna of the communication unit 33, it transmits (replies) a second signal (response). The signal transmission/reception unit 402 of the communication device 40 receives the second signal using the antenna of the communication unit 43.

In the example shown in FIG. 3B, the calculation unit 403 of the communication device 40 calculates the position of the wearing device 30 based on communication between the communication device 40 (signal transmission/reception unit 402) and the wearing device 30 (signal response unit 304), similar to the calculation unit 302 shown in FIG. 3A. The position information transmission unit 404 of the communication device 40 transmits information regarding the position of the wearing device 30 calculated by the calculation unit 403 to the wearing device 30. The position information transfer unit 305 of the wearing device 30 receives information regarding the position of the wearing device 30 and transmits (transfers) this information to the operation device 20. Then, the position information receiving unit 202 receives the information regarding the position transferred by the position information transfer unit 305 of the wearing device 30. For example, the position information transmission unit 404 and the position information transfer unit 305 transmit information regarding the position of the wearing device 30, so that the operation device 20 can obtain the position of the wearing device 30. The operation device 20 can obtain the position of the user who is holding the operation device 20 and wearing the wearing device 30. In addition, the position information transmission unit 404 and the position information transfer unit 305 may transmit the position of the operation device 20 corrected from the position of the wearing device 30 to the operation device 20. This allows the operation device 20 to obtain the position of the operation device 20.

3A and 3B, the operation data generating unit 203 of the operation device 20 generates operation data including information about the position of the attachment 30 based on the information about the user's operation acquired by the operation information acquiring unit 201 and the information about the position of the attachment 30 received by the position information receiving unit 202 (information about the position of the attachment 30, or information about the position corrected based on the position of the attachment 30). In this case, the information about the position of the attachment 30 calculated by the attachment 30 or the communication device 40 is information transmitted to the information processing device 10 together with operation data indicating the operation content on the operation device 20. The operation data transmitting unit 204 of the operation device 20 transmits the operation data generated by the operation data generating unit 203 to the information processing device 10. As a result, the information processing device 10 can acquire information such as the position of the attachment 30 (i.e., the position of the user wearing the attachment 30) and the position of the operation device 20 corrected from the position of the attachment 30, along with the user's operation on the operation device 20. The information processing device 10 can change the position of an image or an object in an image displayed on the display device 5 based on, for example, acquired information such as the user's position.

The operation data generating unit 203 of the operation device 20 generates operation data by, for example, including information on the position of the attachment 30 received by the position information receiving unit 202 (information on the position of the attachment 30, or information on the position corrected based on the position of the attachment 30) in a data area predetermined in the operation data. In this case, the information on the position of the attachment 30 calculated by the attachment 30 or the communication device 40 is information that is transmitted to the information processing device 10 in a state that it is included in a data area predetermined in the operation data. For example, free space is provided in the operation data generated by the conventional operation device. The operation data generating unit 203 may generate operation data by storing information on the position of the attachment 30 in this free space. In this way, it becomes possible to transmit information on the position of the attachment 30 without changing the standard of the conventional operation data. For example, operation data including information on the position of the attachment 30 can be generated simply by updating a program such as firmware stored in the conventional operation device.

[4. Position Calculation Method (1)]
The following describes the processing of the calculation unit 302 of the wearing device 30 or the calculation unit 403 of the communication device 40 (hereinafter, also simply referred to as the calculation units 302 and 403) that calculates the position of the wearing device 30. The

calculation units

302 and 403 calculate, for example, the distance and angle between the wearing device 30 and the communication device 40 (the angle between the direction in which one of the wearing device 30 and the communication device 40 is facing and the direction from the one device to the other device), and calculate the position of the wearing device 30 based on the calculated distance and angle. FIG. 4 is a diagram showing an example of a method for calculating the distance between the wearing device 30 and the communication device 40. FIG. 5A is a diagram showing an example of a method for calculating the distance and angle. FIG. 5B is a diagram showing another example of a method for calculating the distance and angle.

The

calculation units

302, 403 calculate the distance between the attachment 30 and the communication device 40 based on the time it takes for a signal to travel back and forth between the attachment 30 and the communication device 40. In the example shown in FIG. 4, T indicates the passage of time. Ta indicates, for example, the time from when the signal transmission/reception unit 301 of the attachment 30 transmits a first signal (request) until the signal reply unit 401 of the communication device 40 receives this signal. Tb indicates, for example, the time from when the signal reply unit 401 of the communication device 40 receives the first signal until it transmits (replies) a second signal (response). Tc indicates, for example, the time from when the signal reply unit 401 of the communication device 40 transmits a second signal until the signal transmission/reception unit 301 of the attachment 30 receives this signal. Td indicates, for example, the time from when the signal transmission/reception unit 301 of the attachment 30 transmits the first signal until it receives the second signal, that is, a series of periods from Ta to Tc. Note that the above explanation is for the example of the functional block shown in FIG. 3A, but by replacing the signal transmission/reception unit 301 of the attachment 30 with the signal transmission/reception unit 402 of the communication device 40, and by replacing the signal response unit 401 of the communication device 40 with the signal response unit 304 of the attachment 30, it becomes an explanation of the example of the functional block shown in FIG. 3B.

In the example shown in FIG. 4, the distance D between the attachment 30 and the communication device 40 can be calculated using a formula such as D = speed of light * (Ta + Tc) / 2, or D = speed of light * (Td - Tb) / 2. Note that "*" indicates the multiplication symbol.

The signal reply unit 401 or the signal reply unit 304 (hereinafter also simply referred to as the signal reply unit 401, 304) may, for example, add the period Tb (a numerical value such as the number of seconds) to the second signal (response) and transmit it. The

signal reply unit

401, 304 may also, for example, add the time at which the first signal was received and the time at which the second signal was transmitted to the second signal and transmit it. In this way, the

calculation unit

302, 403 can determine the periods Ta and Tc, or the periods Td and Tb, based on the information such as the period and time added to the second signal, the time at which the first signal was transmitted, and the time at which the second signal was received, and calculate the distance D between the attachment 30 and the communication device 40. Note that if the period Tb is known, the

signal reply unit

401, 304 may transmit the second signal without adding the period and time information.

In the example shown in FIG. 5A, the communication unit 33 of the attachment 30 includes an antenna 51. Furthermore, the communication unit 43 of the communication device 40 includes a first antenna 52a and a second antenna 52b that are capable of wireless communication with the antenna 51. Conversely, the antenna 51 may be included in the communication unit 43 of the communication device 40, and the first antenna 52a and the second antenna 52b may be included in the communication unit 33 of the attachment 30. The first antenna 52a and the second antenna 52b face in the same direction (the direction shown by the dotted arrow in FIG. 5A). The first antenna 52a and the second antenna 52b are arranged at a predetermined distance d in a direction that perpendicularly intersects with the direction in which these antennas face.

As shown in FIG. 5A, for example, when the communication device 40 is not facing the attachment 30, more specifically, when the position of the antenna 51 of the attachment 30 is misaligned with the direction in which the first antenna 52a and second antenna 52b of the communication device 40 are facing, a difference occurs between the distance D1 between the antenna 51 and the first antenna 52a and the distance D2 between the antenna 51 and the second antenna 52b.

Here, the

calculation units

302, 403 may determine the distance D between the attachment 30 and the communication device 40 based on a first period T1 until the signal travels back and forth between the first antenna 52a and the antenna 51, and a second period T2 until the signal travels back and forth between the second antenna 52b and the antenna 51. The

calculation units

302, 403 may, for example, calculate the distance D1 between the first antenna 52a and the antenna 51 based on the first period T1, calculate the distance D2 between the second antenna 52b and the antenna 51 based on the second period T2, and calculate the average value of the distances D1 and D2 as the distance D between the attachment 30 and the communication device 40.

The

calculation units

302 and 403 may also calculate the angle (azimuth angle) θ between the direction in which the communication device 40 (or the attachment 30) is facing and the direction from the communication device 40 to the attachment 30 based on the first period T1 until the signal travels back and forth between the first antenna 52a and the antenna 51 and the second period T2 until the signal travels back and forth between the second antenna 52b and the antenna 51. The angle θ can be calculated, for example, by the formula θ=arccos((ψλ)/2πd). Here, "ψ" indicates the phase difference between the signals received by the first antenna 52a and the second antenna 52b, "λ" indicates the wavelength of the signal, "π" indicates the ratio of the circumference of a circle to its diameter, and "d" indicates the distance between the first antenna 52a and the second antenna 52b (see FIG. 5A). In the example shown in FIG. 5A, the

calculation units

302 and 403 calculate the position of the attachment 30 based on the distance D and angle θ calculated as above.

As shown in FIG. 5B, the communication unit 43 of the communication device 40 (or the communication unit 33 of the attachment 30) may include an array antenna 53. The array antenna 53 includes a first set of antennas spaced apart in the vertical direction (Z-axis direction in FIG. 5B) and a second set of antennas spaced apart in the horizontal direction (X-axis direction in FIG. 5B). The

calculation units

302 and 403 obtain the period for a signal to travel back and forth between each of the multiple antennas included in the array antenna 53 and the antenna 54 included in the communication unit 33 of the attachment 30 (or the communication unit 43 of the communication device 40), and may calculate the distance D between the attachment 30 and the communication device 40, and the azimuth angle θ1 and the elevation angle θ2 between the direction in which the communication device 40 (or the attachment 30) is facing and the direction from the communication device 40 to the attachment 30, based on these multiple periods. In this way, by using the array antenna 53 to measure the period for a signal to travel back and forth at each antenna, it becomes possible to calculate the elevation angle θ2 in addition to the azimuth angle θ1. In the example shown in FIG. 5B, the

calculation units

302 and 403 can calculate the position of the attachment 30 based on the distance D, azimuth angle θ1, and elevation angle θ2 calculated as described above.

[4. Position Calculation Method (2)]
Fig. 6A is a diagram showing another example of a method for calculating the position of the wearing equipment 30. In the example shown in Fig. 6A, the positioning system 1 includes multiple communication devices 40 (three communication devices 40a to 40c) that are located at different positions. The communication devices 40a to 40c include the communication unit 43 described above and are capable of wireless communication with the wearing equipment 30.

In the example shown in FIG. 6A, the calculation unit 302 or the calculation unit 403 included in the communication devices 40a to 40c calculates the distance between the wearing device 30 and the communication device 40 based on the time it takes for a signal to travel back and forth between the wearing device 30 for each of the communication devices 40a to 40c and the communication device 40. The

calculation units

302, 403 calculate the distance Da from the wearing device 30 worn by the user 2 to the communication device 40a, the distance Db from the wearing device 30 to the communication device 40b, and the distance Dc from the wearing device 30 to the communication device 40b. As shown in FIG. 6A, the position where the arc Ra with the radius of the distance Da from the communication device 40a, the arc Rb with the radius of the distance Db from the communication device 40b, and the arc Rc with the radius of the distance Dc from the communication device 40c overlap is the position of the wearing device 30. Therefore, in the example shown in FIG. 6A, the

calculation units

302 and 403 calculate the position of the attachment 30 based on the calculated distances Da to Dc.

FIG. 6B is a diagram showing another example of a method for calculating the position of the wearing device 30. In the example shown in FIG. 6B, the positioning system 1 includes multiple communication devices 40 (four communication devices 40e to 40h), similar to the example shown in FIG. 6A. The communication devices 40e to 40h include a communication unit 43 and are capable of wireless communication with the wearing device 30. The communication devices 40e to 40h are disposed in different positions from each other. Furthermore, in the height direction (Z-axis direction in FIG. 6B), one communication device 40h is disposed in a different position from the other communication devices 40e to 40g.

In the example shown in FIG. 6B, the calculation unit 302 or the calculation unit 403 included in the communication devices 40e to 40h calculates the distance between the wearing device 30 and the communication device 40 based on the time it takes for a signal to travel back and forth between the wearing device 30 for each of the communication devices 40e to 40h and the communication device 40. The

calculation units

302 and 403 calculate the distance De from the wearing device 30 to the communication device 40e, the distance Df from the wearing device 30 to the communication device 40f, the distance Dg from the wearing device 30 to the communication device 40g, and the distance Dh from the wearing device 30 to the communication device 40h. Here, the position where the surface of a sphere with a radius of the distance De from the communication device 40e, the surface of a sphere with a radius of the distance Df from the communication device 40f, the surface of a sphere with a radius of the distance Dg from the communication device 40g, and the surface of a sphere with a radius of the distance Dh from the communication device 40h overlap is the position of the wearing device 30. In the example shown in FIG. 6B, the

calculation units

302 and 403 can calculate the position of the attachment 30 based on the calculated distances De to Dh.

5. Flowchart
Fig. 7A is a diagram showing an example of the flow of the positioning process of the wearing equipment 30 performed by the positioning system 1. The positioning process shown in Fig. 7A is executed by each function of the functional block diagram shown in Fig. 3A. The positioning process shown in Fig. 7A and Fig. 7B described later may be executed repeatedly, for example, during a period in which the information processing device 10 is executing an application such as a game.

First, as shown in Fig. 7A, the signal transmission/reception unit 301 of the attachment 30 transmits a first signal (request) to the communication device 40 (step S101). If the positioning system 1 includes multiple communication devices 40 (e.g., communication devices 40a to 40c shown in Fig. 6A), in step S101, the signal transmission/reception unit 301 transmits the first signal to these multiple communication devices 40.

Then, the signal reply unit 401 of the communication device 40, which received the first signal (request) sent in step S101, replies with a second signal (response) to the attachment 30 (step S102). Next, the calculation unit 302 of the attachment 30 calculates the position of the attachment 30 based on the response periods of the first signal and the second signal sent and received in steps S101 and S102 (step S103).

In step S103, the calculation unit 302 of the attachment 30 calculates the distance and angle between the attachment 30 and the communication device 40 (the angle between the direction in which one of the attachment 30 and the communication device 40 is facing and the direction from that device to the other device) based on the time it takes for the signal to travel back and forth between the attachment 30 and the communication device 40 (the multiple times it takes for the signal to travel back and forth via the multiple antennas included in the attachment 30 or the communication device 40), as shown in, for example, Figures 4, 5A, and 5B, and calculates the position of the attachment 30 based on the calculated distance and angle.

In addition, in step S103, if the positioning system 1 includes multiple communication devices 40, the calculation unit 302 of the attachment may calculate the distance between the attachment 30 and each of the multiple communication devices 40 based on the time it takes for a signal to travel back and forth between the attachment 30 and each of the multiple communication devices 40, as shown in, for example, Figures 4, 6A, and 6B. Then, the position of the attachment 30 may be calculated based on the calculated distances.

Next, the position information transmission unit 303 of the wearing device 30 transmits information about the position of the wearing device 30 calculated in step S103 to the operation device 20 (step S104). The position information reception unit 202 of the operation device 20 receives the information about the position of the wearing device 30 transmitted in step S104. In step S103, the position information transmission unit 303 may transmit the information about the position of the wearing device 30 to the operation device 20. This allows the operation device 20 to obtain the position of the wearing device 30. The operation device 20 can obtain the position of the user who is holding the operation device 20 and wearing the wearing device 30. Also, in step S103, the position information transmission unit 303 may transmit information about the position of the wearing device 30 and the position corrected based on the relative position of the operation device 20 with respect to the wearing device 30 (for example, information corrected to the position of the operation device 20) to the operation device 20. This allows the operation device 20 to obtain the position of the operation device 20.

Then, the operation data generating unit 203 of the operation device 20 generates operation data including information regarding the position of the attachment 30 (step S105). Finally, the operation data transmitting unit 204 of the operation device 20 transmits the operation data generated in step S105 to the information processing device (step S106), and the process ends.

In step S105, the operation data generating unit 203 of the operation device 20 generates operation data including information regarding the position of the wearing device 30 based on the information on the user's operation acquired by the operation information acquiring unit 201 and the information regarding the position of the wearing device 30 received by the position information receiving unit 202. The operation data generating unit 203 may generate operation data including information on the position of the wearing device 30, for example. By receiving the operation data transmitted in step S106, the information processing device 10 can acquire the position of the wearing device 30 (i.e., the position of the user wearing the wearing device 30) together with the user's operation on the operation device 20.

In addition, in step S105, the operation data generation unit 203 may calculate the position of the operation device 20 based on the position of the wearing device 30 and the relative position of the operation device 20 with respect to the wearing device 30, and generate operation data including information on the calculated position of the operation device 20. Even if information corrected to the position of the operation device 20 is transmitted by the position information transmission unit 303 in step S104, the operation data generation unit 203 may generate operation data including information on the position of the operation device 20. The information processing device 10 can obtain the position of the operation device 20 by receiving the operation data transmitted in step S106.

In step S105, the operation data generating unit 203 of the operation device 20 generates operation data, for example, by including the position information received by the position information receiving unit 202, or position information corrected from that position, in a data area predetermined in the operation data. The operation data generating unit 203 may generate operation data by storing information about the position of the attachment 30 in an empty area defined in the conventional operation data, for example. In this way, it becomes possible to transmit information about the position of the attachment 30 to the information processing device 10 without changing the format of the conventional operation data.

FIG. 7B is a diagram showing another example of the flow of the positioning process of the wearing device 30 performed by the positioning system 1. The positioning process shown in FIG. 7B is executed by each function in the functional block diagram shown in FIG. 3B.

First, as shown in FIG. 7B, the signal transceiver 402 of the communication device 40 transmits a first signal (request) to the wearing device 30 (step S201). If the positioning system 1 includes multiple communication devices 40 (e.g., communication devices 40a to 40c shown in FIG. 6A), in step S201, each of the multiple communication devices 40 transmits a first signal to the wearing device 30.

Then, the signal reply unit 304 of the attachment 30, which received the first signal (request) sent in step S201, replies with a second signal (response) to the communication device 40 (step S202). Next, the calculation unit 403 of the communication device 40 calculates the position of the attachment 30 based on the response periods of the first and second signals sent and received in steps S201 and S202 (step S203).

In step S203, the calculation unit 403 of the communication device 40 may calculate the position of the wearing device 30 by calculating the distance and angle between the wearing device 30 and the communication device 40, similar to step S103 in FIG. 7A. Also, in step S203, if the positioning system 1 includes multiple communication devices 40, the calculation unit 403 of each communication device 40 may calculate the distance between the communication device 40 and the wearing device 30 based on the time it takes for a signal to travel back and forth between the communication device 40 and the wearing device 30. Then, one communication device 40 may acquire (receive) the distances calculated by each communication device 40 via the communication unit 43, and the calculation unit 403 of the communication device 40 may calculate the position of the wearing device 30 based on the acquired distances.

Then, the position information transmission unit 404 of the communication device 40 transmits information about the position of the wearing device 30 calculated in step S203 to the wearing device 30 (step S204). Next, the position information transfer unit 305 of the wearing device 30 receives the information about the position of the wearing device 30 transmitted in step S204, and transmits (transfers) it to the operation device 20 (step S205). In steps S203 and S204, the position information transmission unit 404 and the position information transfer unit 305 may transmit information about the position of the wearing device 30. Also, in steps S203 and S204, the position information transmission unit 404 and the position information transfer unit 305 may transmit position information corrected based on the position of the wearing device 30 (for example, information about the position of the operation device 20).

The position information receiving unit 202 of the operation device 20 receives the information on the position of the wearing device 30 transmitted in step S205. For example, when the position information receiving unit 202 receives the information on the position of the wearing device 30, the operation device 20 can obtain the position of the wearing device 30 (i.e., the position of the user wearing the wearing device 30). In addition, when the position information receiving unit 202 receives information on the position of the operation device 20 corrected from the position of the wearing device 30, the operation device 20 can obtain the position of the operation device 20.

Then, the operation data generating unit 203 of the operation device 20 generates operation data including information regarding the position of the attachment 30 (step S206). Finally, the operation data transmitting unit 204 of the operation device 20 transmits the operation data generated in step S206 to the information processing device (step S207), and ends the process. By receiving the operation data transmitted in step S207, the information processing device 10 can obtain the position of the attachment 30 (i.e., the position of the user wearing the attachment 30).

6. Summary
(1) As described above, the positioning system 1 described in the present disclosure includes the wearing device 30 worn by a user and capable of communicating with the operation device 20 held by the user, and the communication device 40 capable of wirelessly communicating with the wearing device 30 and disposed away from the user. The wearing device 30 or the communication device 40 calculates the position of the wearing device 30 based on communication between the wearing device 30 and the communication device 40. The wearing device 30 transmits information related to the position of the wearing device 30 calculated by the wearing device 30 or the communication device 40 to the operation device 20. This allows the operation device 20 to obtain the position of the user holding the operation device 20.

(9) Furthermore, the wearing device 30 described in this disclosure is worn by a user and is capable of communicating with the operation device 20 held by the user and the communication device 40 positioned away from the user. The wearing device 30 calculates the position of the wearing device 30 based on communication between the wearing device 30 and the communication device 40, and transmits information related to the calculated position of the wearing device 30 to the operation device 20. This allows the operation device 20 to obtain the position of the user holding the operation device 20.

(10) In addition, the positioning method described in this disclosure includes a positioning system 1 including a wearing device 30 worn by a user and capable of communicating with an operating device 20 held by the user, and a communication device 40 capable of wirelessly communicating with the wearing device 30 and positioned away from the user, in which the wearing device 30 or the communication device 40 calculates the position of the wearing device 30 based on communication between the wearing device 30 and the communication device 40. The wearing device 30 then transmits information regarding the position of the wearing device 30 calculated by the wearing device 30 or the communication device 40 to the operating device 20. This allows the operating device 20 to obtain the position of the user holding the operating device 20 using the wearing device 30 and the communication device 40.

(2) In the positioning system 1 of (1) above, the operation device 20 may be operated while being held by the user in his/her hand. The wearing equipment 30 may be worn on the user's hand or wrist. The operation device 20 may obtain the position of the operation device 20 based on information regarding the position of the wearing equipment 30. This allows the operation device 20 to obtain the position of the operation device 20.

(3) In the positioning system 1 of (1) above, one of the attachment 30 and the communication device 40 may include a first antenna 52a and a second antenna 52b capable of wirelessly communicating with the other device. The attachment 30 or the communication device 40 may calculate the distance D between the attachment 30 and the communication device 40 and the angle θ between the direction in which the one device is facing and the direction from the one device to the other device based on a first period T1 until a signal travels back and forth between the first antenna 52a and the other device and a second period T2 until a signal travels back and forth between the second antenna 52b and the other device. The attachment 30 or the communication device 40 may calculate the position of the attachment 30 based on the calculated distance D and angle θ.

(4)
The positioning system 1 of (1) above may include a plurality of communication devices 40 arranged at different positions. Each of the plurality of communication devices 40 may be capable of wirelessly communicating with the wearing device 30. The wearing device 30 or at least one of the plurality of communication devices 40 may calculate a distance between the wearing device 30 and the communication device 40 based on a period of time it takes for a signal to travel back and forth between the wearing device 30 and the communication device 40 for each of the plurality of communication devices 40. The wearing device 30 or at least one of the plurality of communication devices 40 may calculate a position of the wearing device 30 based on the calculated distances.

(5) In any one of the positioning systems 1 described above in (1) to (4), the attachment 30 may calculate the position of the attachment 30 based on communication between the attachment 30 and the communication device 40, and transmit information related to the calculated position of the attachment 30 to the operation device 20.

(6) In any one of the positioning systems 1 described above in (1) to (4), the communication device 40 may calculate the position of the wearing device 30 based on communication between the wearing device 30 and the communication device 40, and transmit information related to the calculated position of the wearing device 30 to the wearing device 30. The wearing device 30 may transmit information related to the position of the wearing device 30 received from the communication device 40 to the operation device 20.

(7) In any one of the positioning systems 1 described above in (1) to (6), information regarding the position of the attachment 30 calculated by the attachment 30 or the communication device 40 may be information transmitted to the information processing device 10 together with operation data indicating the operation content on the operation device 20. In this way, the information processing device 10 can obtain the position of the user holding the operation device 20.

(8) In the positioning system 1 described above in (7), the information regarding the position of the attachment 30 calculated by the attachment 30 or the communication device 40 may be information that is included within a data area that is predetermined in the operation data and is transmitted to the information processing device 10.

This disclosure is not limited to the above embodiments. For example, variations on the above embodiments may also be included within the technical scope of this disclosure.

For example, in the embodiment, an example has been described in which one of the wearing device 30 and the communication device 40 has a calculation unit (calculation unit 302 or calculation unit 403), but both the wearing device 30 and the communication device 40 may have a calculation unit. For example, the calculation unit 302 of the wearing device 30 may calculate the distance and angle between the wearing device 30 and the communication device 40, and the calculation unit 403 of the communication device 40 may calculate the position of the wearing device 30 based on the distance and angle calculated in the wearing device 30.

Furthermore, when the positioning system 1 includes a plurality of communication devices 40, the calculation unit 403 of each communication device 40 may calculate the distance from the communication device 40 to the wearing device 30, or the calculation unit 302 of the wearing device 30 or the calculation unit 403 of one of the communication devices 40 may calculate the distance from each communication device 40 to the wearing device 30. In this case, the calculation unit 302 of the wearing device 30 or the calculation unit 403 of one of the communication devices 40 may calculate the position of the wearing device 30 based on the calculated distances.

Claims

A wearing tool that is worn by a user and is capable of communicating with an operation device held by the user;
a communication device capable of wirelessly communicating with the wearing tool and disposed away from the user;
The wearing device or the communication device calculates a position of the wearing device based on communication between the wearing device and the communication device,
The wearing device transmits information regarding a position of the wearing device calculated by the wearing device or the communication device to the operation device.
the operation device is an operation device operated by the user while being held in his/her hand,
The wearing device is worn on the user's hand or wrist,
The operating device obtains a position of the operating device based on information about a position of the garment.
2. The positioning system according to claim 1,
One of the wearing tool and the communication device includes a first antenna and a second antenna capable of wirelessly communicating with the other device,
the attachment or the communication device calculates a distance between the attachment and the communication device and an angle between a direction in which the one device is facing and a direction from the one device toward the other device based on a first period of time until a signal travels back and forth between the first antenna and the other device and a second period of time until a signal travels back and forth between the second antenna and the other device;
The wearing device or the communication device calculates a position of the wearing device based on the calculated distance and angle.
2. The positioning system according to claim 1,
A plurality of the communication devices are disposed at different positions from each other,
The plurality of communication devices are all capable of wirelessly communicating with the wearing tool,
At least one of the wearing device or the plurality of communication devices calculates a distance between the wearing device and the communication device based on a time period for a signal to travel between the wearing device and the communication device for each of the plurality of communication devices;
At least one of the wearing device or the plurality of communication devices calculates a position of the wearing device based on the calculated plurality of distances.
2. The positioning system according to claim 1,
The wearing tool is
Calculating a position of the wearing device based on communication between the wearing device and the communication device;
A positioning system that transmits information regarding the calculated position of the garment to the operation device.
2. The positioning system according to claim 1,
The communication device includes:
Calculating a position of the wearing device based on communication between the wearing device and the communication device;
Transmitting information regarding the calculated position of the garment to the garment;
The wearing device transmits information regarding the position of the wearing device received from the communication device to the operation device.
2. The positioning system according to claim 1,
The information relating to the position of the wearing equipment calculated by the wearing equipment or the communication device is information that is transmitted to an information processing device together with operation data indicating the operation content on the operation device.
Positioning system.
8. The positioning system according to claim 7,
The information regarding the position of the wearing device calculated by the wearing device or the communication device is information that is included within a predetermined data area in the operation data and is transmitted to the information processing device.
A wearing tool that is worn by a user and enables communication between an operation device held by the user and a communication device disposed away from the user,
Calculating a position of the wearing device based on communication between the wearing device and the communication device;
The garment transmits information about the calculated position of the garment to the operation device.
A positioning system including a wearing tool that is worn by a user and capable of communicating with an operation device held by the user, and a communication device that is capable of wirelessly communicating with the wearing tool and is disposed apart from the user,
The wearing device or the communication device calculates a position of the wearing device based on communication between the wearing device and the communication device,
The wearing device transmits information about a position of the wearing device calculated by the wearing device or the communication device to the operation device.