WO2021192841A1

WO2021192841A1 - Program and electronic device

Info

Publication number: WO2021192841A1
Application number: PCT/JP2021/007856
Authority: WO
Inventors: 諒一佐藤
Original assignee: ブラザー工業株式会社
Priority date: 2020-03-24
Filing date: 2021-03-02
Publication date: 2021-09-30
Also published as: JP2021152727A

Abstract

The present invention provides technology which reduces restrictions on measurements of a two-point distance by an electronic device. An electronic device 1 comprises a millimeter wave radar 50 and acquires an output signal based on reflected waves received by the millimeter wave radar 50. On the basis of the acquired output signal, a prescribed gesture made by two fingers is detected. Thereafter, the two-point distance between a point that is represented by the tip of one of the fingers making the detected prescribed gesture and a point that is represented the tip of the other finger is measured, and the length indicated by the prescribed gesture is determined on the basis of the measured two-point distance.

Description

Programs and electronic devices

The technical fields disclosed herein relate to programs and electronic devices that measure distances between two points.

In electronic devices, there is known a technology that measures the distance between two points and performs processing based on the measurement results. For example, Patent Document 1 is a display input device that displays a preview image on a touch panel, measures the distance between two points between the touch positions of two fingers touched by the touch panel, and touches the two fingers. If the touch position of one finger moves to another position within a predetermined period, the distance between the two fingers is measured at the position after the movement, and the distance between the two points is measured first. A configuration is disclosed in which a display magnification is determined based on a distance measured and a distance measured after movement, and a preview image is displayed at the determined display magnification.

Japanese Unexamined Patent Publication No. 2014-63428

In the measurement of the distance between two points based on the touch position touched on the touch panel as in Patent Document 1, the measurement range is limited because the measurement cannot exceed the size of the touch panel. Further, it is necessary to touch the touch panel, and there is a restriction that the distance between two points cannot be measured when the touch panel cannot detect the touch position such as wearing gloves.

This specification discloses a technique in which measurement is not easily restricted when measuring a distance between two points in an electronic device.

The program was made for the purpose of solving the above-mentioned problems, and is a program that can be executed by a computer of an electronic device equipped with an electromagnetic wave sensor, and the electromagnetic wave sensor receives electromagnetic waves having a wavelength of millimeters or smaller than millimeters. A predetermined sensor indicated by two fingers on the computer based on an acquisition process of acquiring a waveform signal based on an electromagnetic wave received by the electromagnetic wave sensor and the waveform signal acquired in the acquisition process. A detection process for detecting a gesture is executed, and the predetermined gesture indicates an instruction level by the distance between one tip of the two fingers and the other tip of the two fingers, and further. The first measurement process of measuring the distance between two points of the point indicating the tip of the one finger and the point indicating the tip of the other finger shown in the predetermined gesture detected by the detection process on the computer. And the determination process of determining the instruction level instructed by the predetermined gesture based on the distance between the two points measured in the first measurement process.

According to the above configuration, as an instruction level, for example, a user measures the length of an object with two fingers and indicates the length by the distance between the tip of one finger and the tip of the other finger. By performing the above within the detection range of the electromagnetic wave sensor, the computer of the electronic device measures the length indicated by the predetermined gesture, that is, the distance between two points between the tips of two fingers, and the length of the object. Can be obtained. Therefore, since the measurement is not based on the position of the touch on the electronic device, the measurement point can be detected without contact, and the size of the touch panel is not restricted, so that the measurement can be performed in a wide range.

It is also new and useful in electronic devices that store the above programs.

According to the technique disclosed in the present specification, when the distance between two points is measured in an electronic device, the technique in which the measurement is not restricted is realized.
Is realized.

It is a block diagram which shows the electrical structure of the electronic device which incorporated the program of this invention. It is an external view which shows the display state at the time of making a label in an electronic device. It is a sequence diagram which shows the outline of the operation of an electronic device. (A) It is a flowchart which shows the procedure of the process in the calibration mode among the gesture analysis processing by a gesture analysis application, and (B) is the external view of the electronic device which shows the display state in the calibration mode. (A) A flowchart showing a procedure of processing in the measurement mode mode among gesture analysis processes by the gesture analysis application, and (B) a flowchart showing a part of the procedure of the process in the measurement mode mode according to the modified example. (A) External view of an electronic device showing a state in which a sheet object is selected by a user, (B) A label attachment object having a label attachment area to which a label paper created by using the electronic device is attached. It is an external view, (C) an external view of an electronic device in a state where a gesture is performed by a user, and (D) an external view of an electronic device in a state where the length of a sheet object is changed and displayed. It is a flowchart which shows the procedure of the processing in the measurement mode among the gesture analysis processing by the gesture analysis application which concerns on 2nd Embodiment.

(First Embodiment)
Hereinafter, embodiments in which the program incorporated in the electronic device is embodied will be described in detail with reference to the accompanying drawings. This embodiment discloses an application program (hereinafter referred to as "application") incorporated in a portable electronic device such as a tablet or a smartphone that can display an image.

As shown in FIG. 1, the electronic device 1 of this embodiment includes a controller 10 including a CPU 11 and a memory 12, and can be connected to the printer 2. Further, the electronic device 1 includes a display 20, an input interface (hereinafter referred to as "input I / F") 30, a communication interface (hereinafter referred to as "communication I / F") 40, and a millimeter-wave radar 50. , Which are electrically connected to the controller 10. The electronic device 1 is, for example, a device capable of executing various applications for printing on the printer 2. The controller 10 in FIG. 1 is a general term for hardware and software used for controlling the electronic device 1, and does not necessarily represent a single hardware actually existing in the electronic device 1. ..

The CPU 11 executes various processes according to the program read from the memory 12 and based on the user's operation. The CPU 11 is an example of a computer. The memory 12 includes a ROM and a RAM, and further includes a non-volatile memory such as an HDD and a flash memory, and stores various programs and data.

The display 20 includes a display surface for displaying various functions of the electronic device 1. The input I / F 30 is a key for executing each function of the electronic device 1, and is composed of a transmissive touch panel integrally provided on the surface of the display 20. The electronic device 1 accepts an icon selection operation when the user touches the icon displayed on the display 20 from the input I / F 30.

The communication I / F40 includes hardware for communicating with an external device such as a printer 2. The communication method of the communication I / F40 may be wireless or wired, or may be Wi-Fi (registered trademark), Bluetooth (registered trademark), USB, LAN or the like. The electronic device 1 of this embodiment may have a function of connecting to the Internet via the communication I / F40.

The millimeter wave radar 50 is configured to be able to transmit millimeter waves of around 60 GHz toward a measuring object, for example, a finger of a hand, and to receive reflected waves from the measured object. Then, the millimeter wave radar 50 can output a wave-shaped output signal based on the received reflected wave.

The millimeter-wave radar 50 preferably has a wideband radar frequency for detecting the fine movement of the measured object. In this embodiment, the laser frequency band of 57 GHz to 64 GHz band is used, but the radar frequency band is not limited to the frequency of 57 GHz to 64 GHz band, and a wider band radar frequency may be used. No. As the radar frequency, for example, a radar frequency having a wavelength in millimeters or a unit smaller than millimeters may be used. The millimeter wave radar is an example of an electromagnetic wave sensor.

As shown in FIG. 1, the memory 12 of the electronic device 1 of this embodiment includes an operating system (hereinafter referred to as “OS”) 41, a label creation application 42, and an image database (hereinafter referred to as “image DB”). ) 43 and the gesture analysis application 44 are incorporated. OS41 is a multitasking OS capable of processing a plurality of tasks in parallel by managing and switching a plurality of tasks. For example, iOS (registered trademark), Android (registered trademark), Windows (registered trademark), macOS (registered trademark), macOS (registered trademark), Windows (registered trademark), macOS (registered trademark), and Windows (registered trademark). It is either a registered trademark) or Windows (registered trademark).

The printer 2 of this embodiment is, for example, a so-called label printer provided with a thermal transfer type printing head, accommodating a label paper wound in a roll shape, and printing while unwinding the label paper. The printer 2 prints an image on the contained label paper and conveys the label paper based on the print job received from the electronic device 1, for example, and carries out the printed portion to the outside of the machine. The label paper is an example of a printing medium.

The label creation application 42 of this embodiment is an application for creating various labels using the printer 2. For example, a user can use an icon (not shown) for starting the label creation application displayed on the display 20. Can be activated by touching. The label creation application 42 receives instructions for creating and editing an image to be printed by the printer 2, and displays the received image on the display 20.

Further, the label creation application 42 receives an instruction to execute printing of the image displayed on the display 20, generates a print job based on the displayed image, and sends it to the printer 2. The label creation application 42 of this embodiment may be a program that can be executed independently based on a user's execution instruction, or a program that is called and executed from the program during the execution of another program.

The image DB 43 is a storage area for storing image data of various images for the label creation application 42. The label creation application 42 causes the display 20 to display an image of image data stored in the image DB 43 based on a user's instruction. The image data stored in the image DB 43 may be stored at all times, or may be acquired from a server or the like as needed.

In this embodiment, the image DB 43 stores, for example, a plurality of templates that can be selected by the label creation application 42, and image data of a plurality of usage example images that correspond to each template and show each usage example. NS. The template used in the label creation application 42 is image data of a template for label creation, and includes samples such as a text string, a code image, a frame image, and an illustration. For example, the user can refer to a plurality of use case images, select a template similar to a label to be created from a plurality of templates, edit the selected template, and print the selected template. The user can easily create a desired label paper by, for example, changing the character string of the template to a desired character and printing the template.

The gesture analysis application 44 is a kind of application software. As an example, the output signal output from the millimeter wave radar 50 is analyzed to detect two fingers, and the tip of one of the detected fingers and the other are detected. Perform gesture analysis to calculate the distance between two points between the tips of the fingers. The gesture analysis application 44 is similarly activated when the label creation application 42 is activated by the user.

Further, the gesture analysis application 44 analyzes the output signal output from the millimeter wave radar 50 to determine the distance between the electronic device 1 and the finger of the hand extended within the detection range of the millimeter wave radar 50. It can be calculated. As an example, the gesture analysis application 44 includes a measurement mode for calculating the distance between two points and a calibration mode executed before the measurement mode.

In the electronic device 1 of this embodiment, when the calibration mode by the gesture analysis application 44 ends, the screen 20 required for the input / editing process by the label creation application 42 is displayed on the display 20. That is, as shown in FIG. 2, various input buttons such as a save button 23, a print button 24, and a cancel button 25 are displayed on the display 20. Further, the display 20 displays a label image display area 26 for displaying an image such as text input by the user. The image displayed in the label image display area 26 is also an image of various labels created by using the printer 2.

The virtual keyboard 21 displayed on the display 20 has a plurality of text keys 211 corresponding to each text such as characters, and a plurality of function keys 212 corresponding to each command such as return and backspace used when inputting text. Is displayed. The keyboard is not limited to the virtual keyboard 21, and may be configured by, for example, a combination of a hardware keyboard or mouse that accepts input operations by the user.

Then, when the user touches the text key 211 portion of the virtual keyboard 21 displayed on the display 20, text information such as characters corresponding to the text key 211 is input to the electronic device 1 via the input I / F 30, and the memory 12 Is remembered in. At the same time, based on the input text information, the text is displayed as the input text 27 on the sheet object 28 displayed in the label image display area 26. The label image display area 26 corresponds to the label paper of the printer 2.

In the electronic device 1 of this embodiment, the virtual keyboard 21 is not displayed on the display 20 when the calibration mode by the gesture analysis application 44 ends. Then, when the user touches the sheet object 28 portion to select the sheet object 28, the virtual keyboard 21 is displayed on the display 20, but in FIG. 2, for convenience of explanation, the virtual keyboard 21 is displayed on the display 20. Indicates the state displayed in.

When the user touches the print button 24 portion displayed on the display 20, the electronic device 1 generates a print job based on the text information corresponding to the input text 27 displayed on the sheet object 28 and sends the print job to the printer 2. do.

Further, the electronic device 1 displays the distance between two points between the tips of two fingers calculated by the gesture analysis application 44 in the label image display area 26 by the label creation application 42 in the longitudinal direction of the sheet object 28. It can be expanded as a length, that is, the length of label paper.

In addition, when the user touches the save button 23 displayed on the display 20, the electronic device 1 stores the input text 27 displayed on the sheet object 28 in the image DB 43 as input text information.

Subsequently, the outline of the operation of the electronic device 1 will be described below with reference to the sequence diagram shown in FIG.

First, when the user touches the icon for starting the label creation application (procedure 1, hereinafter referred to as T1), the label creation application 42 and the gesture analysis application 44 acquire the activation instruction information (T2, T3), respectively.

Then, the gesture analysis application 44 first executes the calibration mode. That is, the gesture analysis application 44 displays the calibration image required for executing the calibration mode on the display 20 (T4).

Next, when the user makes a gesture within the detection range of the millimeter wave radar 50 (T5), the gesture analysis application 44 acquires an output signal output from the millimeter wave radar 50 (T6), and the acquired output signal is obtained. Gestures are analyzed based on (T7). After that, the gesture analysis application 44 calculates the distance between the two points between the tip of the thumb of the left hand and the tip of the index finger (T8), and stores it in the memory 12 as a reference value (T9). Then, the gesture analysis application 44 ends the calibration mode.

Then, the label creation application 43 acquires the calibration mode end information (T10) and displays the screen required for the label paper input / editing process on the display 20 (T11).

When the user touches the display 20 to select the sheet object 28 displayed on the display 20 (T12), the label creation application 43 changes the display form of the sheet object 28 displayed on the display 20 (T13). ..

At this time, the gesture analysis application 44 executes the measurement mode when the user selects the sheet object 28 (T12).

Here, when the user makes a gesture within the detection range of the millimeter wave radar 50 (T14), the gesture analysis application 44 acquires an output signal output from the millimeter wave radar 50 (T15), and the acquired output signal is obtained. The gesture is analyzed based on the above, and two fingers are detected (T16). After that, the gesture analysis application 44 calculates the distance between the two points between the tip of the thumb of the left hand and the tip of the index finger, and displays the calculated distance between the two points on the display 20 (T17).

Here, when the user selects OK (T18: YES), the calculated distance between the two points is stored in the memory 12 as the length of the label paper to be printed (T19), and the measurement mode is terminated.

On the other hand, when the user does not select OK (T18: NO), T14 to T18 are processed again, and the recalculated distance between the tip of the thumb of the left hand and the tip of the index finger is displayed on the display 20. And wait for the user to select.

On the other hand, when the gesture analysis application 44 ends the measurement mode, the label creation application 43 acquires the measurement mode end information (T20), and based on the label paper length information stored in the memory 12, the label image display area. The lengths of the 26 and the sheet object 28 are changed and displayed on the display 20 (T21).

When the user touches the print button 24 portion displayed on the display 20 (T22), the label creation application 42 stores the text information corresponding to the input text 27 displayed on the sheet object 28 and the memory 12 in the memory 12. A print job is generated based on the length of the label paper (T23) and transmitted to the printer 2 (T24).

Subsequently, among the gesture analysis processes by the gesture analysis application 44 of this embodiment, the procedure of the process in the calibration mode will be described with reference to the flowchart of FIG. 4 (A). The flowchart shown in FIG. 4A corresponds to the procedure of T4 to T9 in the sequence diagram shown in FIG. Further, the flowchart shown in FIG. 4A is executed by the CPU 11 of the electronic device 1. Further, each processing step in the following flowchart basically indicates the processing of the CPU 11 according to the instructions described in each program. The processing by the CPU 11 also includes hardware control using the API of the OS 41 of the electronic device 1. In this specification, the operation of the program will be described by omitting the description of the operation of the OS 41.

That is, the CPU 11 first executes the calibration mode. That is, the CPU 11 displays a calibration image (see FIG. 4B) required for executing the calibration on the display 20 (step 10, hereinafter referred to as S10). The calibration image includes marks A60 and marks B61 arranged at reference intervals.

Next, the CPU 11 acquires an output signal output from the millimeter-wave radar 50 (S11), analyzes the gesture based on the acquired output signal, and inserts the gesture into the detection range on the millimeter-wave radar 50 based on the gesture. The index finger and thumb hand are extracted (S12). Here, the "gesture" refers to the three-dimensional movement of the two fingers of the hand extended within the detection range of the millimeter-wave radar 50. In this embodiment, the CPU 11 extracts the three-dimensional movements of the two fingers in S12. Then, the CPU 11 then determines whether or not the two fingers can be detected (S13).

Here, for example, the user determines the distance between the thumb 63A of the left hand 63 and the index finger 63B so as to match the distance between the mark A60 and the mark B61 according to the calibration image displayed on the display 20 (FIG. 4 (FIG. 4). B) See). Next, the user extends the thumb 63A and the index finger 63B of the left hand 63 within the detection range of the millimeter wave radar 50 while maintaining the state (interval). At this time, the positions of the thumb 63A and the index finger 63B of the left hand 63 may be in a direction that is easy for the user to instruct as long as the distance between them is maintained. Further, the position of the left hand 63 with respect to the electronic device 1 may be a position that is easy for the user to instruct as long as it is within the detection range of the millimeter wave radar 50.

Then, the CPU 11 can extract the thumb 63A and the index finger 63B of the left hand 63 extended on the millimeter-wave radar 50 in S12, and determines that the two fingers could be detected in the next S13 (). S13: YES), the process proceeds to the next S14.

Next, in S14, the CPU 11 calculates the distance between the tip of the thumb 63A of the extracted left hand 63 and the tip of the index finger 63B.

Next, the CPU 11 stores the calculated distance in the memory 12 as a reference value indicating the reference distance between the mark A60 and the mark B61 (S15), and then the CPU 11 calibrates the display 20. A calibration end message is popped up for a certain period of time instead of the motion image (S16) to notify the user of the end of the calibration mode. Then, the process of the present calibration mode is ended, and the process proceeds to the process of the measurement mode described later. The process of S15 is an example of the preservation process.

On the other hand, if the user does not extend his / her hand within the detection range of the millimeter-wave radar 50, the CPU 11 determines that the two fingers could not be detected in S13 (S13: NO), and proceeds to the next S17. ..

Next, the CPU 11 detects whether or not the cancel button 25 is touched in S17. Here, when the user touches the cancel button 25, it is determined that the cancel button 25 has been touched (S17: YES), the display of the calibration image is stopped (S18), and then the processing of the calibration mode is terminated. , The process shifts to the measurement mode processing described later.

On the other hand, if the user has not touched the cancel button 25, the CPU 11 determines that the cancel button 25 has not been touched (S17: NO), returns to S11, and continues to output the output signal output from the millimeter wave radar 50. get.

As described above, in this embodiment, prior to the measurement of the actual length, the distance between the mark A60 and the mark B61 arranged in advance at the reference length is measured as the calibration mode. Then, in the determination of the actual length in the measurement mode, the length is determined based on the result measured in the calibration mode and the measured value measured in the subsequent measurement mode, and the user's hand is determined. It is possible to eliminate the measurement error caused by the shape of the above, and to measure the length more accurately.

In this embodiment, the mark A60 and the mark B61 are displayed on the calibration image to notify the user about the reference interval used in the calibration mode, but the specific dimensions are used as the reference interval. The user may be notified, or the dimension desired by the user may be used as the reference interval. In this case, the user prepares by widening the distance between the thumb 63A of the left hand 63 and the index finger 63B by using a ruler or the like.

Further, in the present embodiment, the end of the calibration mode is notified to the user by using a pop-up image, but the user may be notified by an announcement, a notification sound, vibration, or a combination thereof. good.

Subsequently, among the gesture analysis processes by the gesture analysis application 44 of this embodiment, the procedure of the process in the measurement mode will be described with reference to the flowchart of FIG. 5 (A). The flowchart shown in FIG. 5A corresponds to the procedures T14 to T19 in the sequence diagram shown in FIG. 3, and when the user selects the sheet object 28, it is executed by the CPU 11 of the electronic device 1. Further, each processing step in the following flowchart basically indicates the processing of the CPU 11 according to the instructions described in each program. The processing by the CPU 11 also includes hardware control using the API of the OS 41 of the electronic device 1. In this specification, the operation of the program will be described by omitting the description of the operation of the OS 41.

Here, as shown in FIG. 6A, the electronic device 1 displays the sheet object 28 by changing the display form from the broken line in FIG. 2 to a solid line according to the procedure of T13 shown in FIG. As a result, the electronic device 1 notifies the user that the sheet object 28 is in the selected state. The method of changing the display form of the sheet object 28 when the sheet object 28 is selected by the user is to change the display form by changing the frame color or line thickness of the sheet object 28, or to change the display form of the entire sheet object 28. Blink display may be used to change the display form.

That is, when the user intends to use the electronic device 1 to create a label paper that matches the length L of the label sticking area 71 of the label sticking object 70 (see FIG. 6B), First, the user touches the sheet object 28 portion to be edited to select the sheet object 28 to be edited.

Next, the user determines the distance between the tip of the thumb 63A of the left hand 63 and the tip of the index finger 63B so as to match the length L of the label sticking area 71 (see FIG. 6B). Next, the user extends the thumb 63A and the index finger 63B of the left hand 63 within the detection range of the millimeter-wave radar 50 while maintaining the state (interval) (see FIG. 6C). At this time, the positions of the thumb 63A and the index finger 63B of the left hand 63 were separated in the same direction as in the calibration mode, and the position of the left hand 63 with respect to the electronic device 1 was also performed in the calibration mode. By being in the same position as, the detection accuracy of the length L is improved.

In this state, the CPU 11 acquires the output signal output from the millimeter wave radar 50 (S20). The output signal is an example of a waveform signal, and the process of S20 is an example of an acquisition process.

Next, the CPU 11 analyzes the gesture based on the acquired output signal, and detects the index finger and thumb hand extended on the millimeter wave radar 50 based on the gesture (S21). The process of S21 is an example of the detection process.

Here, "gesture" refers to the three-dimensional movement of the fingers of the hand extended within the detection range of the millimeter-wave radar 50. In this embodiment, the CPU 11 analyzes the three-dimensional movement of the fingers based on the output signal output from the millimeter-wave radar 50 in S21 to extract two fingers. Then, the CPU 11 next determines whether or not the two fingers can be extracted (S22). Then, when the CPU 11 determines that the two fingers can be extracted (S22: YES), the CPU 11 proceeds to the next S23. On the other hand, if it is determined that the two fingers could not be extracted (S22: NO), the process returns to S20.

Next, the CPU 11 determines in S23 whether or not the state is maintained for a certain period of time. The fixed time here is preferably 1 second to 2 seconds, but is not limited to that, and may be shorter or longer than that.

Here, when the user keeps the thumb 63A and the index finger 63B extended on the millimeter wave radar 50 in the same state for a certain period of time, the CPU 11 determines in S23 that the state is maintained for a certain period of time. (S23: YES) Next, the CPU 11 calculates the distance between the two points between the tip of the extracted thumb 63A and the tip of the index finger 63B using the reference value measured in the calibration mode (S24). The process of S24 is an example of the first measurement process.

As described above, in this embodiment, the distance between the two points between the tip of the thumb 63A and the tip of the index finger 63B, which is measured in the calibration mode and extracted using the reference value stored in the memory 12, is calculated. Therefore, a more accurate distance can be calculated. In this embodiment, the distance between the two points between the tip of the extracted thumb 63A and the tip of the index finger 63B is calculated using the reference value measured in the calibration mode, but there is no problem in accuracy. The level may be calculated without using the reference value measured in the calibration mode.

Further, in the present embodiment, when the thumb 63A and the index finger 63B are continuously detected in the same state, the distance desired by the user, that is, the distance between the two points of the thumb 63A and the index finger 63B is measured by measuring at that timing. The possibility of accurate measurement increases. In the same state, it is not necessary for the fingers to be at the same position in the strict sense, and there may be some misalignment. Further, if a sound effect such as a shutter sound is sounded at the timing of measurement, the user can recognize that the measurement is completed, and the convenience is further improved.

Next, the CPU 11 pops up an image 64 (see FIG. 6C) describing the calculated distance between the two points on the display 20 (S25), and then the CPU 11 is "OK" by the user. It is determined whether or not it has been selected (S26). The process of S26 is an example of the determination process.

As described above, in this embodiment, since the image 64 in which the calculated distance between the two points is described is displayed in a pop-up, the user can easily recognize the length of the label paper, and the convenience is further improved.

Here, when the user touches the "OK" portion of the image 64, the CPU 11 determines that "OK" is selected in S26 (S26: YES), and then the CPU 11 determines between the calculated two points. The distance is stored in the memory 12 as the length of the label paper selected by the user (S27), and the measurement mode is temporarily terminated. After that, the CPU 11 returns to S20 and detects a new gesture.

Then, as shown in FIG. 3, when the length of the label paper is stored in the memory 12, the label creation application 42 acquires the measurement mode end information (T20), so that the electronic device 1 stores the label paper in the memory 12. Based on the length of the label paper, if the stored length of the label paper fits in the display 20, the label image display area 26 and the sheet object 28 are displayed on the display 20 by the same length. (See FIG. 6 (D)) (T21).

As described above, in the present embodiment, since the label image display area 26 and the sheet object 28 are displayed with the same length on the display 20, the user can easily recognize the length of the label paper, and the convenience is further improved. do. In addition, the user can easily input / edit the label paper by using the label creation application 42, which improves convenience.

In this embodiment, the label image display area 26 and the sheet object 28 are displayed at the same length, but they may be enlarged or reduced at a predetermined magnification for display.

On the other hand, when the CPU 11 determines in S22 that two fingers could not be detected (S22: NO), and in S23, when it determines that the state is not maintained for a certain period of time (S23: NO). , And, when it is determined that "OK" is not selected in S26 (S26: NO), the process returns to S20 and the gesture is detected again.

In this embodiment, when the calibration mode by the gesture analysis application 44 ends, the measurement mode mode by the gesture analysis application 44 is automatically started next, but FIG. 5 (B) shows. As shown in, for example, a process of determining whether or not the user touches any of the displays 20 or whether or not the sheet object 28 is touched in order to select the sheet object 28 before the step of S20. A step (S28) may be provided so that the measurement mode mode by the gesture analysis application 44 is started based on the user's instruction. The process of S28 is an example of the reception process.

Further, the user's instruction in this case is not limited to the touch to the display 20, and may be, for example, an instruction by voice or an instruction by a hard switch.

Further, in this embodiment, when the calibration mode by the gesture analysis application 44 ends, the measurement mode mode by the gesture analysis application 44 is started next, but the calibration mode is omitted and the gesture analysis is performed. The application 44 may be configured only in the measurement mode mode. For example, when the length of the label paper is stored in the memory 12, the calibration mode may be omitted.

As described in detail above, in the present embodiment, the user measures the length L of the label sticking area 71 of the label sticking object 70 with the tip of the thumb 63A and the tip of the index finger 63B, and then with the tip of the thumb 63A. When a predetermined gesture indicating the length by the distance between two points with the tip of the index finger 63B is performed within the detection range of the millimeter wave radar 50, the electronic device 1 has the length indicated by the predetermined gesture, that is, two. The length L of the label sticking area 71 can be obtained by measuring the distance between two points between the tips of the fingers.

Therefore, in this embodiment, since the measurement is not based on the position of the touch on the electronic device 1, the size of the input I / F 30 (display 20) is not restricted, and the measurement point can be detected without contact. Therefore, it is possible to measure in a wider range than the size of the input I / F 30 (display 20). Further, in this embodiment, the length L of the label sticking area 71 can be directly measured with two fingers and reflected as the length L of the sheet object 28, so that a tool such as a ruler is specially used. Instead, it is possible to easily create a label paper that reflects the length L of the label sticking area 71.

(Second Embodiment)
Hereinafter, the second embodiment, which embodies the gesture analysis application incorporated in the electronic device, will be described in detail with reference to the attached drawings. In the description, those having the same action and effect as those of the first embodiment will be described with the same reference numerals.

That is, the above-mentioned form is configured to measure the distance between two points between the tips of two fingers and reflect it as the length L of the sheet object 28. However, in this embodiment, the distance between two points between the tips of two fingers and the distance between the electronic device 1 and the left hand 63 are measured, respectively, and the distance is measured according to the distance between the electronic device 1 and the left hand 63. The difference is that the distance between the two points is configured to be reflected as the length of the sheet object 28 in the longitudinal direction or the size of the input text 27.

FIG. 7 is a flowchart showing the procedure of the processing in the measurement mode among the gesture analysis processes by the gesture analysis application 44 according to the second embodiment, and will be described in detail below with reference to this flowchart.

That is, when the CPU 11 determines in S22 that two fingers can be detected (S22: YES), in the next S30, the CPU 11 pops up an image indicating that the fingers are being detected on the display 20, and then displays the image on the display 20. In addition, the CPU 11 determines in S31 whether or not the state is maintained for a certain period of time. The fixed time here is preferably 2 seconds to 3 seconds, but is not limited to that, and may be shorter or longer than that.

Here, when the user maintains the thumb 63A and the index finger 63B of the left hand 63 extended on the millimeter wave radar 50 in the same state for a certain period of time, the CPU 11 maintains the state for a certain period of time in S31. Then, the CPU 11 calculates the distance between the electronic device 1 and the tips of the extracted thumb 63A and index finger 63B (S32). The process of S32 is an example of the second measurement process.

As described above, in this embodiment, when the thumb 63A and the index finger 63B are continuously detected in the same state, the distance desired by the user, that is, the distance between the two points of the thumb 63A and the index finger 63B, is measured by measuring at that timing. Is more likely to be measured accurately. In the same state, it is not necessary for the fingers to be at the same position in the strict sense, and there may be some misalignment. Further, if a sound effect such as a shutter sound is sounded at the timing of measurement, the user can recognize that the measurement is completed, and the convenience is further improved.

Next, the CPU 11 determines whether or not the distance between the calculated electronic device 1 and the extracted thumb 63A and index finger 63B is equal to or less than a predetermined value (S33).

Here, if the distance between the thumb 63A and the index finger 63B extended by the user on the millimeter wave radar 50 and the electronic device 1 is not less than or equal to the predetermined value, the CPU 11 is not less than or equal to the predetermined value in S33. The determination (S33: NO) is made, and then the CPU 11 determines in S34 whether or not the selected input text 27 exists. Here, the predetermined value is, for example, 100 mm, but is not limited thereto.

Here, if the user touches and selects the input text 27 displayed on the sheet object 28, the CPU 11 determines in S34 that the selected input text 27 exists (S34: YES), and next In S35, the CPU 11 measures the distance between the two points of the extracted tip of the thumb 63A and the tip of the index finger 63B in the calibration mode, and calculates it using the reference value stored in the memory 12 (S35). ). At this time, it may be notified that the character size of the input text 27 is being calculated.

At this time, in this embodiment, the distance between the two points between the tip of the thumb 63A and the tip of the index finger 63B, which is measured in the calibration mode and extracted using the reference value stored in the memory 12, is calculated. Therefore, the distance between two points can be calculated more accurately.

Next, the CPU 11 stores the calculated distance between the two points in the memory 12 as the character size of the input text 27 selected by the user (S36), then returns to S20 and detects the gesture again. The character size of the input text 27 is an example of a designated level.

Then, in the electronic device 1, the label creation application 42 acquires the measurement mode end information shown in FIG. 3 (T20), so that the label creation application 42 is a sheet object based on the character size information stored in the memory 12. The character size of the input text 27 displayed on the 28 is changed and displayed.

On the other hand, when the CPU 11 determines in S31 that the state is not maintained for a certain period of time (S31: NO), and in S34, it determines that the selected input text 27 does not exist (S34: In NO), the process returns to S20 and the gesture is detected again.

On the other hand, when the distance between the thumb 63A and the index finger 63B extended by the user on the millimeter wave radar 50 and the electronic device 1 is equal to or less than the predetermined value, the CPU 11 determines in S33 that the distance is equal to or less than the predetermined value (S33: YES). ), Next, in S37, the CPU 11 determines whether or not the selected sheet object 28 exists.

Here, if the user touches and selects the sheet object 28, the CPU 11 determines in S37 that the selected sheet object 28 exists (S37: YES), and then the CPU 11 determines in S35. , The distance between the two points between the tip of the extracted thumb 63A and the tip of the index finger 63B is measured in the calibration mode and calculated using the reference value stored in the memory 12 (S38). At this time, it may be notified that the length of the label paper is being calculated.

At this time, in this embodiment, the distance between the two points between the tip of the thumb 63A and the tip of the index finger 63B, which is measured in the calibration mode and extracted using the reference value stored in the memory 12, is calculated. Therefore, for example, the distance between two points can be calculated more accurately without being affected by the variation in the shape of the user's finger.

Next, the CPU 11 stores the calculated distance between the two points in the memory 12 as the length of the label paper selected by the user (S39), then returns to S20 and detects the gesture again.

Then, in the electronic device 1, the label creation application 42 acquires the measurement mode end information shown in FIG. 3 (T20), so that the label creation application 42 is based on the length information of the label paper stored in the memory 12. , The length of the label image display area and the sheet object 28 is changed to the length L and displayed (see FIG. 6D).

On the other hand, when the CPU 11 determines in S22 that two fingers could not be detected (S22: NO), in the next S40, an image indicating that the fingers are being detected is displayed on the display 20. Abort.

Next, the CPU 11 deselects the input texture 27 and the sheet object 28 selected by the user (S41), returns to S20, and detects the gesture again.

As described in detail above, in the present embodiment, the distance between the two points calculated according to the distance between the electronic device 1 and the thumb 63A and the index finger 63B extended by the user on the millimeter wave radar 50 is calculated by the sheet object 28. Since it can be reflected as the length and the character size of the input text 27, the convenience is improved.

In this embodiment, the calculated distance between two points is reflected as the character size of the input text 27 according to the distance between the electronic device 1 and the thumb 63A and the index finger 63B. The color of the input text 27 may be changed or the font type of the input text 27 may be changed based on the distance between the two points.

Further, in the present embodiment, when the distance between the electronic device 1 and the thumb 63A and the index finger 63B extended by the user on the millimeter wave radar 50 is equal to or less than a predetermined value, the calculated distance between the two points is used on the label paper. It is configured to be reflected in the length and as the character size of the input text 27 when it is equal to or more than the predetermined value. For example, when the distance between the thumb 63A and the index finger 63B is equal to or less than the predetermined value, the input is input. The character size of the text 27 may be configured to be reflected in the length of the label paper when it is equal to or larger than a predetermined value.

It should be noted that the present embodiment is merely an example and does not limit the present invention in any way. Therefore, as a matter of course, the present invention can be improved and modified in various ways without departing from the gist thereof.

That is, in the present embodiment, the calculated distance between the two points is reflected in the length of the label paper, but the width of the label paper, that is, the width of the label image display area 26 and the sheet object. It may be configured so as to be reflected in the length and width of 28.

Further, in the present embodiment, the thumb 63A and the index finger 63B of the left hand 63 are extended within the detection range of the millimeter wave radar 50. For example, the index finger 63B of the left hand 63 and the index finger of the right hand are extended. It does not matter if it is configured. In other words, gestures are not limited to one hand.

Further, the thumb 63A or index finger 63B of the left hand 63 and the other fingers of the left hand 63 may be configured to be extended within the detection range of the millimeter wave radar 50. Also, for example, the feet may be used instead of the hands.

Further, in the present embodiment, the label creation application 42 and the gesture analysis application 44 are configured as independent applications, but the label creation application 42 is configured to have the functions of the gesture analysis application 44, that is, both. You can configure your app with a single app.

Further, in the present embodiment, the gesture analysis application 44 is automatically started when the label creation application 42 is started, but both applications may be started independently. No. In this case, the icon for starting the label creation application 42 and the icon for starting the gesture analysis application 44 may be displayed on the display 20, respectively.

Further, the gesture analysis application 44 may be started when an input / edit target, for example, a sheet object 28 or an input text 27 is selected by the user.

Further, in any flowchart disclosed in the embodiment, the plurality of processes in any plurality of steps can be arbitrarily changed in the execution order or executed in parallel as long as the processing contents do not conflict with each other.

Further, the process disclosed in the embodiment may be executed by a single CPU, a plurality of CPUs, hardware such as an ASIC, or a combination thereof. In addition, the process disclosed in the embodiment can be realized in various aspects such as a recording medium or a method in which a program for executing the process is recorded.

1 Electronic device 2 Printer 10 Controller 12 Memory 20 Display 21 Virtual keyboard 26 Label image display area 27 Input text 28 Sheet object 30 Input I / F
41 OS
42 Label Creation App 44 Gesture Analysis App 50 Millimeter Wave Radar

Claims

A program that can be executed by a computer of an electronic device including an electromagnetic wave sensor, the electromagnetic wave sensor is a sensor that receives electromagnetic waves having a wavelength of millimeters or smaller than millimeters.
On the computer
An acquisition process for acquiring a waveform signal based on an electromagnetic wave received by the electromagnetic wave sensor, and a detection process for detecting a predetermined gesture indicated by two fingers based on the waveform signal acquired in the acquisition process. To be executed, the predetermined gesture indicates the length by the distance between one tip of the two fingers and the other tip of the two fingers.
Furthermore, to the computer
The first measurement process for measuring the distance between the two points of the point indicating the tip of the one finger and the point indicating the tip of the other finger shown in the predetermined gesture detected in the detection process, and the first measurement process. 1 The determination process of determining the length instructed by the predetermined gesture based on the distance between the two points measured in the measurement process is executed.
A program characterized by that.
In the program according to claim 1,
In the first measurement process,
When the predetermined gesture is continuously detected at the same position for a certain period of time or longer by the detection process, the distance between the two points is measured.
A program characterized by that.
In the program according to claim 1,
On the computer
A reception process for receiving measurement instructions is executed via the input interface of the electronic device.
When the measurement instruction is received in the reception process, the first measurement process is executed.
A program characterized by that.
In the program according to any one of claims 1 to 3.
On the computer
A print process for generating a print job for printing an image on a long print medium is executed, and the attributes of the print job include the length in the longitudinal direction of the print medium.
In the determination process,
A program comprising determining the length of the print medium in the longitudinal direction as the indicated length.
In the program according to claim 4,
On the computer
When a preview display process for displaying a preview of the print medium on the display of the electronic device is executed and the length of the print medium in the longitudinal direction is determined by the determination process, the preview display process determines the length of the print medium in the longitudinal direction. The preview of the print medium displayed in the display process is also changed based on the length of the print medium determined in the determination process in the longitudinal direction.
A program characterized by that.
In the program according to any one of claims 1 to 5.
In the determination process,
The distance between the two points measured in the first measurement process is determined to be the indicated length at the same magnification.
A program characterized by that.
In the program according to any one of claims 1 to 6.
After executing the first measurement process on the computer and before executing the determination process.
A confirmation process is executed in which whether or not the distance between the two points measured in the first measurement process is determined as the indicated length is received via the input interface of the electronic device.
When it is accepted in the confirmation process that the distance between the two points measured in the first measurement process is determined as the indicated length, the determination process is executed.
When the confirmation process accepts that the distance between the two points measured in the first measurement process is not determined as the indicated length, the determination process is not executed.
A program characterized by that.
In the program according to any one of claims 1 to 7.
On the computer
Based on the waveform signal acquired in the acquisition process, a second measurement process for measuring the distance between the predetermined gesture and the electronic device is executed.
In the determination process,
When it is possible to determine the indicated length of two types of objects, the first object and the second object, and the distance measured by the second measurement process is shorter than the threshold value. Based on the distance between the two points measured in the first measurement process, the indicated length of the first object is determined, and the distance measured in the second measurement process is the distance. If it is not shorter than the threshold value, the indicated length of the second object is determined based on the distance between the two points measured in the first measurement process.
A program characterized by that.
In the program according to any one of claims 1 to 8.
On the computer
When the measurement process is executed in the first state in which the reference length is specified, the determination process is not executed, and the distance between the two points measured by the measurement process is associated with the reference length. Execute the save process to save and save
When the measurement process is executed in the second state in which the reference length is not specified, the determination process is executed, and in the determination process, the distance between the two points measured in the first measurement process and the distance between the two points are determined. The indicated length is determined based on the reference length preserved in the preservation process and the distance between the two points associated with the reference length.
A program characterized by that.
In the program according to claim 9.
On the computer
In the case of the first state, a reference display process for displaying an image showing the reference length on the display of the electronic device is executed.
A program characterized by that.
Electromagnetic wave sensor and
With a computer
With
The electromagnetic wave sensor is
A sensor that receives electromagnetic waves with wavelengths in millimeters or smaller than millimeters.
The computer
An acquisition process for acquiring a waveform signal based on an electromagnetic wave received by the electromagnetic wave sensor, and a detection process for detecting a predetermined gesture indicated by two fingers based on the waveform signal acquired in the acquisition process. When executed, the predetermined gesture indicates the length by the distance between one tip of the two fingers and the other tip of the two fingers.
Furthermore, the computer
The first measurement process for measuring the distance between the two points of the point indicating the tip of the one finger and the point indicating the tip of the other finger shown in the predetermined gesture detected in the detection process, and the first measurement process. 1 The determination process of determining the length instructed by the predetermined gesture based on the distance between the two points measured in the measurement process is executed.
An electronic device characterized by that.
A program that can be executed by a computer of an electronic device including an electromagnetic wave sensor, the electromagnetic wave sensor is a sensor that receives electromagnetic waves having a wavelength of millimeters or smaller than millimeters.
On the computer
An acquisition process for acquiring a waveform signal based on an electromagnetic wave received by the electromagnetic wave sensor, and a detection process for detecting a predetermined gesture indicated by two fingers based on the waveform signal acquired in the acquisition process. The predetermined gesture to be executed indicates the instruction level by the distance between one tip of the two fingers and the other tip of the two fingers, and further causes the computer to perform the instruction level.
The first measurement process for measuring the distance between the two points of the point indicating the tip of the one finger and the point indicating the tip of the other finger shown in the predetermined gesture detected in the detection process, and the first measurement process. 1 The determination process of determining the instruction level instructed by the predetermined gesture based on the distance between the two points measured in the measurement process is executed.
A program characterized by that.
Electromagnetic wave sensor and
With a computer
With
The electromagnetic wave sensor is
A sensor that receives electromagnetic waves with wavelengths in millimeters or smaller than millimeters.
The computer
An acquisition process for acquiring a waveform signal based on an electromagnetic wave received by the electromagnetic wave sensor, and a detection process for detecting a predetermined gesture indicated by two fingers based on the waveform signal acquired in the acquisition process. When executed, the predetermined gesture indicates the indicated level by the distance between one tip of the two fingers and the other tip of the two fingers.
Furthermore, the computer
The first measurement process for measuring the distance between the two points of the point indicating the tip of the one finger and the point indicating the tip of the other finger shown in the predetermined gesture detected in the detection process, and the first measurement process. 1 The determination process of determining the instruction level instructed by the predetermined gesture based on the distance between the two points measured in the measurement process is executed.
An electronic device characterized by that.