JP3244734U - Writing instrument or operating device with posture detection means - Google Patents

Abstract

[Problem] Detect the posture of operating devices such as writing implements and electronic pens, the state of objects, and the posture of the operator, ensure the proper posture of the device, continue proper operating methods, and reduce the burden on the operator. Provides writing implements and operating devices that achieve this. A writing instrument having a posture detecting means that contacts or approaches an object having a flat part at one end of a long axis, the writing instrument having a multidirectional detection proximity sensor provided near one end of the writing instrument; It has an attitude detection unit that detects the attitude of the writing instrument from the output of the multidirectional detection proximity sensor, detects and predicts the attitude of the writing instrument, and when the attitude of the writing instrument deviates from the optimum range, the operation of the writing instrument is braked. [Selection diagram] Figure 1

Description

The present invention relates to a writing instrument or an operating device having a means for detecting the posture of a specific object when writing on a specific object or operating an electronic publication using the operating device.

In general, in the act of writing on a specific object such as a notebook or memo, or the act of operating an electronic publication such as a tablet or small computer using an operating device such as an electronic pen (hereinafter collectively referred to as "operating act"), the long axis A manual writing instrument or operating device (hereinafter collectively referred to as the "device") having the following functions is used. At this time, the posture of the device is formed while changing the inclination angle of the long axis with respect to the vertical direction in accordance with the operation action.
However, when performing an information transmission operation using an electronic pen, for example, if the angle of inclination becomes large, there is a possibility that information cannot be sufficiently transmitted, and the posture of the device has a large effect on the appropriateness of the operation. Further, the attitude of the device is determined by the state in which the scribe or operator (hereinafter referred to as "operator") holds the device, and the inclination of the writing surface of a specific object or the operation screen of an electronic publication. Furthermore, if these operations continue for a long time, they will place a heavy burden on the operator, and he may not be able to recognize deviations from the proper posture of the device.
Several proposals have been made to address these issues (for example, see Patent Document 1).
Specifically, as shown in FIG. 5A, for example, the electronic pen 100 has a distal end made of a translucent material, a light emitting section 103 inside, and a pen tip 101 connected to the touch panel 124. (display surface 122); a grip sensor 106 that detects that the user is gripping the electronic pen 100; and a posture sensor 108 that detects the posture of the electronic pen 100 with respect to the touch panel 124. The electronic information board system 110 includes a signal processing circuit 105 that processes detection signals output from each of the sensors, a light emitting unit 103, a battery 107 that supplies power to each sensor and the signal processing circuit 105, and a pen signal that the electronic information board system 110 is equipped with. The determination unit 606 includes a communication control unit 102 that transmits and receives signals to and from a reception unit (not shown), and as shown in FIG. 124 is not detected, the pen grip detection unit 603 detects that the electronic pen 100 is being gripped, and the angle (posture) of the electronic pen 100 detected by the pen posture detection unit 602 is detected. ) is within a predetermined range, the display control unit 608 has proposed a touch panel system 110 in which the handwriting of the electronic pen 100 is displayed on the display surface 122. Here, the attitude sensor 108 is composed of, for example, a gyro sensor that is well known as a sensor that detects angular velocity. The posture sensor 108 detects the posture of the electronic pen 100 when the user grips the electronic pen 100 and performs a writing operation. In the present embodiment, the attitude sensor 108 outputs an electric signal (attitude signal) according to an angle θ corresponding to the inclination that the electronic pen 100 makes with the surface of the touch panel 124. Note that the configuration of the posture sensor 108 is not limited to a gyro sensor, and may be configured using an acceleration sensor, for example.

Japanese Patent Application Publication No. 2018-156305

However, in these conventional operating devices and operating systems, it was necessary to overcome the following problems.
(b) Fluctuations in the posture of the device may not only result in changes in the state in which the device is held, but also abnormalities in the posture of the device due to changes in the operator's own posture. In such cases, the detection of an abnormality in the posture of the equipment was limited to repeated detection, and it was difficult to take measures that would lead to normal operation, making it difficult to continue and no response could be taken. Particularly in cases where image formation is possible without touching the touch panel as in the previous law, operating the device over a long period of time places a heavy burden on the operator, causing the device to remain in an abnormal position or forcing the operator to do so. As a result, the operator was forced to maintain a negative attitude, and there was a possibility that the user would not be able to continue with the original proper operating behavior.
(b) In addition, conventional sensors are limited to detecting inclination angles with respect to fixed surfaces such as horizontal or vertical surfaces. The impact on the device's attitude detection could not be ignored, and no countermeasures could be taken.
(a) Conventional posture detection only detects the posture of the device after an operation, and cannot detect or predict changes in the posture of the device immediately after, or abnormalities in the posture of the device accompanying the changes. It was not possible to prevent this from happening.
(d) In addition, although a momentary abnormality in the posture of a device may not affect the operating behavior, in the conventional method of detecting the posture of the device, even such a case was uniformly recognized as an abnormal operating behavior and was braked.

Therefore, the purpose of the present invention to meet these demands is to detect not only the posture of the device, but also the condition of objects near the device (including slopes and unevenness) related to the posture of the device, and the posture of the operator. The purpose of this invention is to provide a writing instrument or operating device that can be used. Furthermore, by detecting and predicting the current and future posture of the device, it is possible to ensure a proper posture of the device, continue a proper operating method, and reduce the burden on the operator. Furthermore, by braking the operation of the device, it is possible to more effectively ensure the proper posture of the device, continue the proper operating method, and reduce the burden on the operator.

As a result of extensive research, the inventor of the present invention has found that the above object can be achieved with a writing instrument or operating device having the posture detection means shown below, and has completed the present invention.

The present invention is a writing instrument or operating device that is in contact with or close to an object having a flat part at one end of its long axis, and has means for detecting a posture with respect to the object at a predetermined angle with the long axis,
a multidirectional detection proximity sensor provided near the one end;
a posture detection unit that uses artificial intelligence (AI) to calculate the inclination angle of the long axis with respect to the vertical direction from the output of the multidirectional detection proximity sensor, and detects the posture of the writing instrument or operating device;
It is characterized by having the following.

The present invention also provides a writing instrument or operating device having the above-mentioned posture detection means,
Based on the separation state between the writing instrument or operating device and the target object and the angle data of the long axis with respect to the target object, which are calculated from the output of the multidirectional detection proximity sensor, the artificial intelligence calculates current and future predictions. The present invention is characterized in that the posture of the writing instrument or operating device with respect to the object can be detected and predicted.

The present invention also provides a writing instrument or operating device having the above-mentioned posture detection means,
It has a braking unit that brakes the writing function or the operating function, and the attitude detection unit stores a preset optimal range for the detected attitude information of the writing instrument or operating device, and when the writing instrument or the operating device deviates from the range. , the operation of the writing instrument or the operating device is braked by the braking unit.

FIG. 2 is an explanatory diagram illustrating the configuration of a writing instrument or operating device according to the present invention. FIG. 2 is an explanatory diagram illustrating the posture of a writing instrument according to the present invention. FIG. 2 is an explanatory diagram illustrating the posture of a writing instrument with respect to an object having an inclination. FIG. 2 is an explanatory diagram illustrating a braking behavior of a writing instrument corresponding to a scribe's posture. FIG. 2 is an explanatory diagram illustrating the configuration of a conventional touch panel system.

Embodiments of the present invention will be described with reference to the drawings.
As illustrated in FIGS. 1(A) and 1(B), a writing instrument 10 or an operating device 20 (hereinafter referred to as "device 10, 20") according to the present invention has a long axis The ends 13 and 23 are in contact with each other or close to each other and face each other. The devices 10 and 20 have multidirectional detection proximity sensors (hereinafter referred to as sensors) 11 and 21 and posture detection units 12 and 22.
Here, the "operation device" refers to an electronic device having a communication function, such as an electronic pen. Further, the present invention is an embodiment related to devices 10 and 20 that are operated by an operator (not shown), and since the operation state (posture) of the operator has a large influence on the posture of the devices 10 and 20, , the sensors 11 and 21 also detect proximity information (separation distance and imaging) of the operator.

[Object related to the present invention]
The object 30 according to the present invention refers to a medium for writing, such as paper on a desk or a screen, or a medium for transmitting and displaying information, such as an "electronic terminal", and has a flat surface 31. Character information and image information are written, input, and communicated through the operation actions of . Specific "electronic terminals" include not only fixed electronic media such as electronic panels and desktop PCs, but also mobile devices such as tablet terminals, smartphones, and notebook PCs.

[Multidirectional detection proximity sensor]
The sensors 11 and 21 in the present invention are not particularly limited as long as they have the function of obtaining posture information in multiple directions of the devices 10 and 20. For example, the posture of the devices 10 and 20 itself can be detected using a gyroscope or an acceleration sensor as described above, and at the same time, the posture relative to the object 30 or the operator can be detected using a combination with an optical sensor or a magnetic sensor. It is possible to detect the proximity state in multiple directions. Images are taken in multiple directions around the device, including the object 30 and the operator, and the images are sent to the posture detection units 12 and 22 as image data.
In addition, by using multidirectional imaging cameras as the sensors 11 and 21 and directing a part of the multidirectional cameras toward the target object 30, the operator, and the surroundings of the devices 10 and 20, the devices 10 and 20, the target object 30, and the operator can be It is possible to obtain imaging data from multiple directions around the device. By transmitting this image data to the posture detection sections 12 and 22, the postures of the devices 10 and 20, the object 30, and the operator can be detected, and their suitability can be determined.

[Attitude detection section]
Attitude detection units 12 and 22 use artificial intelligence (AI) to detect "attitudes of devices 10 and 20,""attitude of object 30," and "attitude of operator," which will be described later, based on the outputs of sensors 11 and 21. At the same time, the appropriateness of the posture is determined.
By digitizing each posture and creating a database based on the numerical data and/or image data output from sensors 11 and 21, it becomes possible to set an appropriate range that will serve as a judgment standard by AI, and It is possible to judge whether the posture is appropriate or not.
Furthermore, by detecting and predicting not only the current but also the future posture of the devices 10 and 20 from the current and past data in the database, the proper posture of the devices 10 and 20 can be ensured and proper operation methods can be continued. This also makes it possible to reduce the burden on the operator.
Furthermore, as will be described later, by braking the operations of the devices 10 and 20, it is possible to more effectively ensure proper postures of the devices 10 and 20, continue proper operating methods, and reduce the burden on the operator. becomes possible.

[Device posture detection]
Here, the "apparatus posture" referred to in the present invention will be explained with reference to explanatory FIGS. 2(A) to 2(C) illustrating the posture of the writing instrument 10. From the upright state illustrated in FIG. 2(A), FIG. 2(B) shows a state in which the long axis X is tilted by an inclination of θ with respect to the vertical axis Y, and FIG. Shown in (C). In the former case, sufficient contact or proximity with the object 30 can be ensured, but in the latter case, the point of contact or proximity is so small that the original writing function cannot be ensured. The inclination degrees θ and θ' are transmitted to the attitude detection unit 12 as a detection signal and/or detection information detected by a sensor 11, which will be described later. In the attitude detection unit 12, the attitude of the device 10 is detected by performing calculation and information processing using the built-in AI based on the signal and/or information.
At this time, by calculating and processing information using AI, it becomes possible to detect and predict the current and future posture of the device, ensuring the proper posture of the device, continuing the proper operation method, and helping the operator. It is possible to reduce the burden. In other words, for example, it tracks and learns the correlation between information from the past sensor 11 and the (immediate) subsequent tilt angle associated with that information, and also estimates and learns the correlation with the most recent tilt angle from the current sensor 11 information. By repeating the verification, it is possible to predict the future posture of the device with a high degree of accuracy.

[Setting the optimal posture range of the device]
At this time, it is preferable to set not only an optimal range but also multiple appropriate ranges.
By calculating and processing information using AI, it becomes possible to detect and predict the optimal range or appropriate range for current and future device postures, ensuring appropriate device postures, and continuing and maintaining appropriate operating methods. The burden on the operator can be reduced. In other words, for example, it tracks and learns the correlation between information from the past sensor 11 and the (immediate) subsequent inclination angle associated with that information, and the optimum range or appropriate range at that time. By repeatedly estimating and comparing the relationship with the inclination angle and the optimal range or appropriate range at that time, it is possible to predict the future posture of the equipment and the optimal range or appropriate range at that time with a fairly high degree of accuracy.

[Device attitude detection when the object's attitude changes]
Next, detection of the posture of the device 10 when the posture of the object 30 changes will be described based on explanatory FIGS. 3A to 3C illustrating the posture of a writing instrument with respect to the tilted object 30.
Based on the separation state between the device 10 and the target object 30 calculated from the output of the sensor 11 and the angle data of the long axis X with respect to the target object 30, AI detects the current and future posture of the device 10 with respect to the target object 30. and can be predicted.
Specifically, when an optical sensor is used as the sensor 11, for example, by measuring the reflected light in at least three directions of the light irradiated to the object 30, the distance between the device 10 and the object including the state where the device 10 is separated from the one end 13 is measured. A three-dimensional separation state from the object 30 can be detected, and the attitude of the object 30 with respect to the device 10 as a reference point can be obtained as numerical data. Furthermore, the posture and surface state of the object 30 with the device 10 as the base point can be obtained as image data from the image data of the object 30 obtained using a camera. Therefore, based on the database created from these numerical values and image data, the current and future posture of the device 10 with respect to the target object 30 can be detected and predicted by AI.

[Device posture detection when the operator's posture changes]
By using a multi-directional camera capable of capturing images in multiple directions as a sensor and capturing images using a camera that points a portion of the multi-directional images toward the operator, it is possible to determine the suitability of the posture of the device.
By making various use of the sensor functions that constitute the device and using some of them to detect the operator's posture, it is possible to maintain the proper posture of the operator. In other words, since the operator's posture also has a large effect on the device's posture, by capturing the operator's image information as the device's posture detection information and classifying that information using AI, the operator's posture is determined by the device's posture. Posture status can be detected. It is possible to make an operator who is unable to recognize an abnormality in his or her own posture because he or she is concentrating on the operation recognize the appropriateness of his or her posture.
Specifically, as shown in Figure 4 (a-1), close-up image information of the operator in the proper operator posture (upright state) and information on the posture of the equipment at that time, and Figure 4 (b-1). By creating a database of a large amount of image data, including close-up image information of the operator and equipment posture information at the time of inappropriate operator posture (slouching), we can correlate the posture status of the equipment with the posture status of the operator. The relationship can be determined, and by optimizing the relationship, the appropriate range of each posture of the device and the operator can be calculated, and the suitability of the newly detected postures of the device and the operator can be recognized.

[Braking of equipment operation]
As described above, the posture detection information of the device according to the present invention can determine whether the operating state of the device itself is appropriate, whether the proximity state with the object is appropriate, and whether the posture of the operator is appropriate. Furthermore, by actively utilizing each piece of information, it is possible to ensure continuous proper operation of the equipment and proper posture of the operator.
In other words, this device is equipped with a braking section that brakes the writing function or operation function, and the posture detection section stores a preset optimal range for the detected posture information of the device, and if the device deviates from that range. By braking the operation of the device using the braking unit, it is possible to ensure continuous proper operation of the device and an appropriate posture of the operator. Here, the "braking unit" includes either an "independent braking" built into a device, or an "externally linked braking" braking by communication with an object. Examples of the former include braking the centering mechanism and core cutoff mechanism of a writing instrument, and turning on and off the transmitting and receiving functions of an electronic pen. The latter includes stopping the operation of the device and/or the object due to communication between the device and the object.

Specifically, FIG. 4 shows an example of the braking behavior of the writing instrument corresponding to the scribe's posture.
As illustrated in FIGS. 4(a-1) to (b-2), by using a multidirectional detection camera as the sensor 11, the attitude of the device 10 is detected from information from images around the device 10, and The postures of the object 30 and the operator can also be detected. Here, in the proper operator posture (upright state) shown in FIG. 4(a-1), the proper posture of the device 10 shown in FIG. 4(a-2) is ensured, and the device is Appropriate conditions are ensured. For example, the lead 14 of the writing instrument protrudes by a predetermined amount, and the state of writing on the object 30 is ensured. On the other hand, in the inappropriate posture of the operator (leaning forward) shown in FIG. 4(b-1), the posture of the device 10 is inappropriate as shown in FIG. 4(b-2) (the tilt angle θ deviates from the appropriate range). Therefore, it is determined that the device is in an inappropriate state with respect to the object 30, and the operation of the device is stopped, for example, due to storage of the lead 14 in a writing instrument or shielding by the blocking part 15.

As described above, with the present invention, a writing instrument or a It becomes possible to provide operating equipment. Furthermore, by detecting and predicting the current and future posture of the device, it becomes possible to ensure the proper posture of the device, continue the proper operation method, and reduce the burden on the operator. Furthermore, by braking the operation of the device, it becomes possible to more effectively ensure the proper posture of the device, continue the proper operating method, and reduce the burden on the operator.

10 Writing instrument 11, 21 Multidirectional detection proximity sensor 12, 22 Posture detection unit 13, 23 One end 20 Operation device 30 Target object 31 Planar part

The present invention is a writing instrument or operating device that is in contact with or close to an object having a flat part at one end of its long axis, and has means for detecting a posture with respect to the object at a predetermined angle with the long axis,
a multidirectional detection proximity sensor provided near the one end;
A posture of detecting the posture of the writing instrument or operating device by calculating the inclination angle of the long axis with respect to the vertical direction using artificial intelligence (AI) from the output of the multidirectional detection proximity sensor, which is provided on the writing instrument or operating device. a detection section;
It is characterized by having the following.

The present invention also provides a writing instrument or operating device having the above-mentioned posture detection means,
The writing instrument or the operating device has a braking unit that brakes the writing function or the operating function,
In the posture detection section, a preset optimal range for posture information of the writing instrument or operating device is stored, and when the posture information of the writing instrument or operating device is out of the range, the operation of the writing instrument or operating device is braked by the braking section. Features.

Claims (3)

A writing instrument or operating device that contacts or approaches a target object having a flat part at one end of its long axis, and that touches the target object at a predetermined angle with the long axis,
a multidirectional detection proximity sensor provided near the one end;
a posture detection unit that uses artificial intelligence (AI) to calculate the inclination angle of the long axis with respect to the vertical direction from the output of the multidirectional detection proximity sensor, and detects the posture of the writing instrument or operating device;
A writing instrument or operating device having a posture detecting means. Based on the separation state between the writing instrument or operating device and the target object and the angle data of the long axis with respect to the target object, which are calculated from the output of the multidirectional detection proximity sensor, the artificial intelligence calculates current and future predictions. 2. A writing instrument or operating device having an attitude detection means according to claim 1, wherein an attitude of the writing instrument or operating device with respect to the object can be detected and predicted. A writing instrument having a braking part that brakes a writing function or an operation function,
In the posture detection section, a preset optimum range is stored for the predicted/detected posture information of the writing instrument or operating device, and if the posture is out of the range, the braking section stops the operation of the writing instrument or operating device. 2. A writing instrument or operating device having a posture detecting means according to claim 1, wherein the writing instrument or operating device is braked.