WO2016139707A1 - Control device - Google Patents

Control device Download PDF

Info

Publication number
WO2016139707A1
WO2016139707A1 PCT/JP2015/006264 JP2015006264W WO2016139707A1 WO 2016139707 A1 WO2016139707 A1 WO 2016139707A1 JP 2015006264 W JP2015006264 W JP 2015006264W WO 2016139707 A1 WO2016139707 A1 WO 2016139707A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
video
gui
display
displayable range
Prior art date
Application number
PCT/JP2015/006264
Other languages
French (fr)
Japanese (ja)
Inventor
智 棚橋
俊之 青山
加道 博行
小杉 直貴
貴司 北田
Original Assignee
パナソニックIpマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックIpマネジメント株式会社 filed Critical パナソニックIpマネジメント株式会社
Publication of WO2016139707A1 publication Critical patent/WO2016139707A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present disclosure relates to a control device that detects a user operation performed on an image.
  • a display device having an input device having a screen input function for inputting information by touching the display screen with a user's finger or the like is a mobile electronic device such as a PDA (Personal Digital Assistant) or a portable terminal, and various home appliances. Used in stationary customer information terminals such as products and unmanned reception machines.
  • a touch detection method in an input device using such a touch operation a capacitive coupling method that detects a change in capacitance is known.
  • a touch panel device as in Patent Document 1 is known.
  • the present disclosure provides a video that prompts the user to exercise appropriately using a control device that detects a user operation performed on the video, such as a touch panel device.
  • the control device of the present disclosure includes a video providing unit that provides a video, an operation detection unit that detects a user operation performed on the video, and a position detection unit that detects a position where the user exists.
  • a video providing unit that provides a video
  • an operation detection unit that detects a user operation performed on the video
  • a position detection unit that detects a position where the user exists.
  • Displayable range of GUI graphical user interface
  • a control unit that controls the video providing unit so as to provide a video showing the GUI at any position within the determined displayable range.
  • a control device that detects a user operation performed on the image, such as a touch panel device.
  • FIG. 1 is an image diagram illustrating the configuration of the display control system according to the first embodiment.
  • FIG. 2A is an image diagram for explaining a GUI displayable range according to the user's physique information and the like according to the first embodiment.
  • FIG. 2B is an image diagram for explaining a GUI displayable range according to the user's physique information and the like according to the first embodiment.
  • FIG. 2C is an image diagram for explaining a GUI displayable range according to the user's physique information and the like according to the first embodiment.
  • FIG. 3 is a flowchart of operations for determining a GUI displayable range and changing the GUI display shape / speed in the display control system according to the first embodiment.
  • FIG. 3 is a flowchart of operations for determining a GUI displayable range and changing the GUI display shape / speed in the display control system according to the first embodiment.
  • FIG. 4 is a flowchart illustrating an operation of displaying a question sentence for performing user diagnosis in the display control system according to the first embodiment.
  • FIG. 5 is a flowchart illustrating operations of determining a GUI displayable range and changing the GUI display shape / speed in the display control system according to the second embodiment.
  • FIG. 6 is an image diagram illustrating a configuration of a display control system according to another embodiment.
  • FIG. 7 is an image diagram for explaining the operation of the display control system according to the modification of the other embodiment.
  • video includes still images and moving images.
  • FIG. 1 is an image diagram for explaining a configuration of a display control system 100 according to the first embodiment.
  • the display control system 100 includes a personal computer 110 (hereinafter referred to as a PC 110), a display panel 120, a capacitance sensor 130, a camera 140, a pressure sensor 150, and a cloud server 170.
  • the PC 110 includes a card reader 111 into which an IC card 180 can be inserted as a peripheral device.
  • the user 50 wears the biological sensor 160 on his / her arm or the like, and uses the exercise provided by the display control system 100. Each configuration will be described in detail below.
  • the PC 110 is connected to the display panel 120, the capacitance sensor 130, the camera 140, the pressure sensor 150, the biological sensor 160, the cloud server 170, and the card reader 111 so that they can communicate with each other by wire or wirelessly.
  • the PC 110 can acquire various types of information from each of the capacitance sensor 130, the camera 140, the pressure sensor 150, the biological sensor 160, the cloud server 170, and the card reader 111.
  • the PC 110 determines a displayable range 200 (hereinafter referred to as a GUI displayable range 200) of a graphical user interface (hereinafter referred to as GUI) on the display panel 120 based on the acquired various types of information. Further, the PC 110 can display or hide the mark 210 at any position within the determined GUI displayable range 200. Further, the PC 110 can change the speed at which the mark 210 is displayed or hidden, and can change the shape and color of the mark 210. Further, the PC 110 can display an image including text such as a question sentence and the mark 210 on the display panel 120.
  • the display panel 120 can display an image according to control by the PC 110.
  • the display panel 120 preferably has a width that is equal to or greater than the width of a person with an average physique with both hands extended. In addition, it is more preferable that the display panel 120 has a height that is equal to or higher than a height in which both hands extend above the head in a state where an average physique is upright.
  • the display panel 120 can be realized by an arbitrary display method such as a liquid crystal display method and an organic EL (Electro Luminescence) display method.
  • the capacitance sensor 130 is disposed on the front surface of the display panel 120 on the user 50 side, and detects a touch operation (user action) by the user 50. More specifically, the capacitance sensor 130 detects the position coordinates of the touch operation performed by the user 50 by detecting a change in capacitance at a location where the user 50 has touched. The capacitance sensor 130 transmits the detected position coordinates of the touch operation to the PC 110. The detected position coordinates of the touch operation are used in the PC 110 for correct / incorrect determination of the position where the touch operation should be performed. In the present embodiment, the capacitance sensor 130 is used as a touch panel.
  • the camera 140 is arranged around the display panel 120 (for example, at the top) and photographs the user 50.
  • the camera 140 is, for example, an imaging device equipped with an image sensor capable of RGB (Red Green Blue) color imaging.
  • the camera 140 transmits image data generated by photographing the user 50 to the PC 110.
  • the image data generated by the camera 140 is used for detecting the standing position of the user 50 in the PC 110.
  • the image data generated by the camera 140 may be used in the PC 110 for analysis of the biometric information (such as height) of the user 50, authentication of the face of the user 50, and the like.
  • the pressure sensor 150 is installed on the floor in front of the display panel 120.
  • a user 50 stands on the pressure sensor 150. It is preferable that the pressure sensor 150 has the same width as the horizontal width of the display panel 120.
  • the user 50 performs a touch operation on the mark 210 displayed on the display panel 120 while riding on the pressure sensor 150.
  • the pressure sensor 150 detects the position coordinates of the pressure based on the weight of the user 50 riding on the pressure sensor 150.
  • the pressure sensor 150 transmits the detected pressure position coordinates to the PC 110.
  • the detected position coordinates of the pressure are used in the PC 110 for detecting the standing position of the user 50 and the like.
  • the biosensor 160 is a wearable terminal worn on the user's 50 own arm or head.
  • the biometric sensor 160 is one of sensors that obtain biometric information, and detects the state of the living body such as the pulse rate, respiration rate, sweating, body temperature, and electroencephalogram of the wearing user 50.
  • the biosensor 160 transmits the state of the living body such as the detected pulse rate, respiration rate, sweating, body temperature, and electroencephalogram to the PC 110.
  • the detected biological state is used in the PC 110 to change the position and speed at which the mark 210 is displayed within the GUI displayable range 200.
  • the cloud server 170 includes a database in which various user physique information and medical information are managed by ID (Identification) management.
  • the physique information includes the user's 50 height, hand length, hand size, weight, and the like.
  • the medical information includes the presence or absence of injury or illness of the user, the type of injury or illness, the site of the injury or illness, and the test result of the dementia diagnosis.
  • the cloud server 170 searches the database based on the ID information transmitted from the PC 110 and returns the corresponding information to the PC 110.
  • the IC card 180 is inserted into the card reader 111 that is a peripheral device of the PC 110.
  • the IC card 180 includes ID information such as a personal identification number, age, sex, address, name, and date of birth of the user 50 who intends to use the display control system 100.
  • the ID information included in the IC card 180 is transmitted to the PC 110 via the card reader 111.
  • the ID information included in the IC card 180 is used for obtaining medical information from the cloud server 170 as described above. Instead of acquiring physique information and medical information from the cloud server 170, the IC card 180 may be recorded in advance to record physique information and medical information.
  • the capacitance sensor 130 and the PC 110 are compatible with the PC 110.
  • the user 50 may be able to directly input these pieces of information through the operation.
  • the display control system 100 provides a video that prompts the user 50 to exercise appropriately.
  • the display control system 100 determines the GUI displayable range 200 according to the physique information of the user 50 and the like.
  • FIG. 2A is an image diagram for explaining a GUI displayable range 200A according to the physique information and the like of the user 50A according to the first embodiment.
  • FIG. 2B is an image diagram illustrating a GUI displayable range 200B according to the physique information and the like of the user 50B.
  • FIG. 2C is an image diagram illustrating a GUI displayable range 200C according to the physique information and the like of the user 50C.
  • 2A, 2B, and 2C respectively show GUI displayable ranges 200A, 200B, and 200C when the physiques and the like of users 50A, 50B, and 50C are different from each other.
  • User 50A illustrates an adult with an average physique.
  • User B exemplifies an infant whose physique is smaller than an average physique adult.
  • User C exemplifies an adult who is an average physique adult but injured in his left arm.
  • the display control system 100 determines the GUI displayable range according to the user's physique and the like. As shown in FIG. 2A, the display control system 100 determines a GUI displayable range 200A in accordance with the physique of an adult user 50A, and displays a mark 210 within the determined GUI displayable range 200A. Similarly, as shown in FIG. 2B, the display control system 100 determines the GUI displayable range 200B in accordance with the physique of the user 50B who is an infant, and displays the mark 210 in the determined GUI displayable range 200B. . As shown in FIG.
  • the display control system 100 corrects the range on the left arm side to match the physique of the user 50C who is an adult who has an injury on the left arm, and determines the GUI displayable range 200C. .
  • the display control system 100 displays the mark 210 within the determined GUI displayable range 200C.
  • FIG. 3 is a flowchart illustrating operations of determining the GUI displayable range and changing the shape / speed of GUI display of the display control system 100 according to the first embodiment.
  • the PC 110 When the power of each device constituting the display control system 100 is turned on, the PC 110 starts a program and starts display control operation.
  • the PC 110 detects the standing position of the user 50 based on the image data generated by the camera 140 or the position coordinates detected by the pressure sensor 150 (step S100). That is, the PC 110 detects at which position the user 50 stands in the horizontal width direction of the front surface of the display panel 120.
  • the PC 110 reads the ID information of the user 50 from the IC card 180 inserted in the card reader 111 (step S101).
  • the PC 110 acquires physique information and medical information corresponding to the user 50 from the cloud server 170 based on the ID information read from the IC card 180 (steps S102 and S103).
  • the PC 110 sets the GUI displayable range 200 based on the standing position of the user 50 detected in step S100 and the physique information (height, hand length, hand size, etc.) of the user 50 acquired in step S102. decide. Specifically, the PC 110 sets the standing position of the user 50 as a reference position for determining the GUI displayable range 200. For example, the PC 110 causes the center line of the GUI displayable range 200 to be in front of the standing position of the user 50. The PC 110 determines the vertical length of the GUI displayable range 200 based on the height of the user 50, the length of the hand, and the size of the hand within a range that is not unreasonable for humans to exercise. On the other hand, the PC 110 determines the horizontal length of the GUI displayable range 200 based on the length and the size of the hand of the user 50 within a range where it is easy for the user 50 to exercise.
  • the PC 110 acquires the ID information (age, sex, etc.) acquired in step S102 and the medical information acquired in step S103 (whether the user is injured or ill, type of injury or illness, injury or illness site, dementia diagnosis)
  • the GUI displayable range 200 once determined in step S104 is corrected based on the test result (step S105). For example, if the user is older than a predetermined age (relatively elderly) or younger than a predetermined age (relatively young), the GUI displayable range 200 is corrected to be small. In addition, if the woman is a female, the GUI displayable range 200 is corrected to be small. Alternatively, if the user 50 is injured on the left arm, the GUI displayable range 200 is corrected so that the left arm side becomes smaller.
  • the PC 110 displays the display shape, display speed, and display of the mark 210 to be displayed in the GUI displayable range 200 based on the ID information (age, sex, etc.) acquired in step S101 and the medical information acquired in step S103.
  • a size and a display number are set (step S106). For example, prepare reference values for each of the display shape, display speed, display size, and number of displays, depending on the age, age, sex, or injuries, from the reference values. Shift the value of.
  • the mark 210 is randomly displayed within the GUI displayable range 200 that has been corrected in step S105 under the conditions set in step S106 (step S107).
  • the user 50 starts a touch operation on the mark 210 displayed in the GUI displayable range 200.
  • the mark 210 disappears after a certain period of time after being displayed.
  • the user 50 needs to complete the touch operation during the period in which the mark 210 is displayed, and is moderately exercised to the brain and body.
  • the PC 110 monitors whether there is a change in the biological information detected by the biological sensor 160 (step S108). If there is no change exceeding the predetermined value in the biological information being monitored (No in step S108), the PC 110 does not change the GUI displayable range 200 determined in step S105 and the conditions set in step S106. The random display of the mark 210 in the GUI displayable range 200 is continued. On the other hand, if there is a change exceeding the predetermined value in the biological information being monitored (Yes in step S108), the PC 110 corrects the GUI displayable range 200 determined in step S105 according to the degree of the change, and the step The condition set in S106 is changed (step S109).
  • PC110 continues the random display of the mark 210 on the conditions after change with respect to the GUI display possible range 200 after correction
  • the display control system 100 may simultaneously display the marks 210 at a plurality of positions within the GUI displayable range 200. Accordingly, it is possible to provide an image that prompts the user 50 for appropriate exercise.
  • the PC 110 monitors the standing position of the user 50 detected by the camera 140 or the pressure sensor 150 (step S110). If there is no change exceeding the predetermined value at the monitored standing position (No in step S110), the PC 110 returns to the operation in step S108 without correcting the GUI displayable range 200. On the other hand, if the monitored standing position has a change exceeding a predetermined value (Yes in step S110), the PC 110 corrects the GUI displayable range 200 according to the standing position. For example, when the standing position of the user 50 moves a distance of 30 cm to the left as viewed from the user 50, the PC 110 moves the reference position of the GUI displayable range 200 to a distance of 30 cm to the left as viewed from the user 50. To correct. Thereby, even if the user 50 moves, provision of the image
  • FIG. 4 is a flowchart showing an operation of displaying a question sentence for diagnosing the user 50 in the display control system 100 according to the first embodiment.
  • an operation method for displaying the mark 210 within the GUI displayable range 200 an operation for displaying a question sentence will be described.
  • the problem message is displayed on the display panel 120 (step S200).
  • the red round mark 210 is “correct”
  • the black square mark 210 is “incorrect (dummy)”.
  • a question sentence for instructing to touch the red round mark 210 is displayed on the display panel 120.
  • the PC 110 starts displaying the correct answer and the dummy mark 210 within the GUI displayable range 200.
  • the PC 110 monitors whether or not the user 50 has correctly touched the correct mark 210 (step S202). When the user 50 has correctly touched the correct mark 210 (Yes in step S202), the PC 110 displays the correct answer on the display panel 120 (step S203). On the other hand, when the user 50 cannot correctly touch the correct mark 210 (such as when the dummy mark 210 is touched), the PC 110 displays an incorrect answer on the display panel 120 (step S204). .
  • the PC 110 stores the results of the user 50 in an external recording medium.
  • the PC 110 ends the program related to the series of display operations. And PC110 is based on the precision (operation precision) which the user 50 was able to touch-operate the mark 210 correctly, and the time (operation reaction time) required until the user 50 could touch-operate after the mark 210 was started to display, Diagnose the amount of exercise of the user 50, superiority or inferiority of motor function, and degree of dementia progression. Then, the PC 110 displays the diagnosis result on the display panel 120.
  • the PC 110 obtains the acquired personal identification information, physique information, medical information, the GUI displayable range 200 determined based on these information, the display speed of the mark 210, the display size, the display shape, the conditions concerning the number of displays, diagnosis
  • the result is stored in an external recording medium.
  • the control device corresponding to the display control system 100 includes the video providing unit corresponding to the display panel 120 that provides the video and the static that detects the operation of the user 50 performed on the video.
  • An operation detection unit corresponding to the capacitance sensor 130 and a position detection unit corresponding to the camera 140 that detects a position where the user 50 exists are provided.
  • a GUI that is dynamically provided to the video providing unit based on the physique information of the user 50 recorded in the memory corresponding to the cloud server 170 or the IC card 180 and the position detected by the position detecting unit.
  • a video providing unit that determines a displayable range of a GUI (Graphical User Interface) corresponding to the displayable range 200, and (ii) provides a video indicating the GUI at any position within the determined displayable range.
  • a control unit corresponding to the PC 110 that controls the computer.
  • control unit may control the video providing unit so as to change the position where the video showing the GUI is provided within the determined displayable range as time elapses. Thereby, the image
  • control unit may control the video providing unit so as to provide a video showing a GUI at a plurality of positions within the determined displayable range at the same time.
  • movement can be provided.
  • control unit displays a video provided under the first condition among videos indicating a GUI, and a video provided under a second condition different from the first condition is at least one of color and shape.
  • the video providing unit may be controlled so as to be different. Thereby, the image
  • the control device corresponding to the display control system 100 includes a video providing unit corresponding to the display panel 120 that provides a video for the user 50 to operate, and an operation of the user 50 performed on the video. And an operation detection unit corresponding to the capacitance sensor 130 for detecting. Further, a biological information detection unit corresponding to the biological sensor 160 that detects the biological information of the user 50, and a control unit corresponding to the PC 110 that changes the video according to the change of the biological information, which are different from the operation of the user 50. Prepare.
  • control unit may change at least one of the display position, speed, and number of the video display according to the change of the biological information.
  • movement can be provided.
  • the biological information may be a pulse rate or a heart rate.
  • movement can be provided.
  • the operation detection unit may be a touch panel.
  • movement can be provided.
  • Embodiment 2 The second embodiment will be described below with reference to the accompanying drawings.
  • the display control system 100 concerning Embodiment 2 since a structure is the same as that of Embodiment 1 shown using FIG. 1, detailed description is abbreviate
  • the display control system 100 according to the second embodiment is different from the first embodiment in the method for determining the GUI displayable range 200.
  • FIG. 5 is a flowchart illustrating the operation of determining the GUI displayable range and changing the GUI display shape / speed in the display control system 100 according to the second embodiment.
  • the PC 110 displays on the display panel 120 a message prompting the user 50 to perform actual measurement (step S300). For example, a display for instructing actual measurement of the upper side of the GUI displayable range 200, a display for instructing actual measurement of the right side, a display for instructing actual measurement of the left side, and a display for instructing actual measurement of the bottom side are sequentially performed.
  • the user 50 performs a touch operation on the capacitance sensor 130 for each instruction displayed on the display panel 120. For example, when a display for instructing actual measurement of the left side of the GUI displayable range 200 is made, the user 50 extends the left hand as far as possible from the current standing position and performs a touch operation on the capacitance sensor 130. I do.
  • the user 50 when the display for instructing the actual measurement of the right side of the GUI displayable range 200 is made, the user 50 extends the right hand as far as possible from the current standing position and performs a touch operation on the capacitance sensor 130. I do.
  • the PC 110 measures the position coordinates on which the touch operation has been performed by the user 50 in association with each instruction (step S301). This actual measurement is performed for a portion necessary for determining the GUI displayable range 200.
  • the PC 110 determines the GUI displayable range 200 based on the actual measurement information obtained by actual measurement in Step S301 (Step S302).
  • the PC 110 sets the display shape, display speed, display size, and display number of the mark 210 as reference values (step S303).
  • the mark 210 is randomly displayed under the conditions set in step S303 (step S304).
  • the user 50 starts a touch operation on the mark 210 displayed in the GUI displayable range 200.
  • the mark 210 disappears after a certain period of time after being displayed.
  • the user 50 needs to complete the touch operation during the period in which the mark 210 is displayed, and is encouraged to exercise moderately to the user's 50 brain and body.
  • the PC 110 monitors the biological information detected by the biological sensor 160 (step S305). If there is a change in the biometric information (Yes in step S305), the PC 110 changes the condition set in step S303 according to the degree of the change based on the biometric information, and the mark 210 on the GUI displayable range 200 is random. The display is continued (step S306).
  • the operations in steps S305 to S308 are the same as those in steps S108 to S111 shown using FIG.
  • the display control system 100 can determine the GUI displayable range 200 by actual measurement based on the touch operation of the user 50.
  • Embodiments 1 and 2 have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to these, and can be applied to embodiments in which changes, replacements, additions, omissions, and the like are made. Moreover, it is also possible to combine each component demonstrated in the said Embodiment 1 and 2 into a new embodiment.
  • the display control system 100 determines the GUI displayable range 200 and displays the mark 210 in the determined GUI displayable range 200. This is intended to make the range in which the mark 210 that prompts the user 50 to exercise is displayed within the GUI displayable range 200. Therefore, whether or not an icon that is fixedly displayed (such as an icon for selecting an operation mode of the display control system 100) is displayed outside the GUI displayable range 200 is within the scope of the technical idea of the present disclosure. .
  • FIG. 6 is an image diagram illustrating a configuration of a display control system 100 according to another embodiment. As shown in FIG. 6, for each of a plurality of users 50 ⁇ / b> A, 50 ⁇ / b> B, 50 ⁇ / b> C, one display panel 120, capacitance sensor 130, camera 140, and pressure sensor 150 may be provided. Even in that case, as shown in FIG.
  • the display control system 100 determines the GUI displayable ranges 200A, 200B, and 200C in accordance with the physiques of the plurality of users 50A, 50B, and 50C, respectively.
  • the mark 210 is displayed in the determined GUI displayable ranges 200A, 200B, and 200C.
  • FIG. 7 is an image diagram for explaining the operation of the display control system 100 according to a modification of the other embodiment.
  • the user 50 ⁇ / b> D has a higher priority than the user 50 ⁇ / b> E.
  • the display control system 100 corrects the GUI displayable range 200E of the user 50E with low priority so as to limit (reduce) the range so as not to overlap with the GUI displayable range 200D of the user 50D with high priority. Then, the display panel 120 may give a warning instructing the user 50E to leave the user 50D to a position where it can be visually recognized, such as “approaching. Please move to the right”. Note that this warning may be a warning by sound from a speaker instead of a video by the display panel 120.
  • the display panel 120 is illustrated as an example of the video providing unit of the present disclosure, but the present disclosure is not limited to this.
  • the video providing unit may be a screen projected by a projector instead of the display panel 120. In this case, even if the touch operation by the user to the image projected on the screen is detected using a TOF (Time Of Flight) sensor or the like instead of the capacitance sensor 130 illustrated as an example of the operation detection unit, Good.
  • the screen may be a commercially available screen material, a wall surface, or a desk surface.
  • the camera 140 is illustrated as an example of the position detection unit of the present disclosure, but the present disclosure is not limited thereto.
  • the position detection unit the pressure sensor 150, the capacitance sensor 130, or an infrared sensor provided around the display panel 120 may be used.
  • the present disclosure is not limited thereto.
  • An RFID (Radio Frequency IDentifier) readable medium may be used.
  • a portable terminal that supports RFID reading may be used as a medium at this time.
  • the present disclosure can be applied to a use of detecting a user operation performed on a video in a control device that provides the video. For example, in medical welfare such as support for the elderly, or an amusement such as a game, it is possible to provide an image that prompts the user for appropriate exercise.

Abstract

A control device is provided with: a picture providing unit (120) that provides a picture; an operation detection unit (130) that detects an operation performed on the picture by a user (50); and a position detection unit (140) that detects the position at which the user (50) is present. The control device is also provided with a control unit (110) that (i), on the basis of physique information about the user (50) that is recorded in a memory (170) and the position detected by the position detection unit (140), determines a displayable range (200) for a graphical user interface (GUI) that the picture providing unit (120) is caused to dynamically provide, and that (ii) controls the picture providing unit (120) so as to provide a picture indicating the GUI at a position within the determined displayable range (200).

Description

制御装置Control device
 本開示は、映像に対して行われるユーザの操作を検出する制御装置に関する。 The present disclosure relates to a control device that detects a user operation performed on an image.
 表示画面に使用者の指などでタッチ操作して情報を入力する画面入力機能をもつ入力装置を備えた表示装置が、PDA(Personal Digital Assistant)及び携帯端末などのモバイル用電子機器、各種の家電製品、無人受付機等の据置型顧客案内端末に用いられている。このようなタッチ操作による入力装置におけるタッチ検出方式として、容量変化を検出する静電容量結合方式が知られている。例えば、特許文献1のようなタッチパネル装置が知られている。 A display device having an input device having a screen input function for inputting information by touching the display screen with a user's finger or the like is a mobile electronic device such as a PDA (Personal Digital Assistant) or a portable terminal, and various home appliances. Used in stationary customer information terminals such as products and unmanned reception machines. As a touch detection method in an input device using such a touch operation, a capacitive coupling method that detects a change in capacitance is known. For example, a touch panel device as in Patent Document 1 is known.
 一方、近年、高齢化社会の進展にともなって、医療福祉への貢献の要請が高まっている。例えば、適切な運動を提供する取り組みの要請がある。 On the other hand, in recent years, with the progress of an aging society, the demand for contribution to medical welfare is increasing. For example, there is a request for efforts to provide appropriate exercise.
特開2012―160172号公報JP 2012-160172 A
 本開示は、タッチパネル装置など、映像に対して行われるユーザの操作を検出する制御装置を用いて、ユーザに対して適切な運動を促す映像を提供する。 The present disclosure provides a video that prompts the user to exercise appropriately using a control device that detects a user operation performed on the video, such as a touch panel device.
 本開示の制御装置は、映像を提供する映像提供部と、映像に対して行われるユーザの操作を検出する操作検出部と、ユーザが存在する位置を検出する位置検出部と、を備える。また、(i)メモリに記録されたユーザの体格情報と、位置検出部により検出された位置とに基づいて、映像提供部に動的に提供させるGUI(グラフィカル・ユーザ・インターフェース)の表示可能範囲を決定し、(ii)決定された表示可能範囲内のいずれかの位置にGUIを示す映像を提供するよう映像提供部を制御する制御部、を備える。 The control device of the present disclosure includes a video providing unit that provides a video, an operation detection unit that detects a user operation performed on the video, and a position detection unit that detects a position where the user exists. (I) Displayable range of GUI (graphical user interface) that is dynamically provided to the video providing unit based on the user's physique information recorded in the memory and the position detected by the position detecting unit And (ii) a control unit that controls the video providing unit so as to provide a video showing the GUI at any position within the determined displayable range.
 本開示によれば、タッチパネル装置など、映像に対して行われるユーザの操作を検出する制御装置を用いて、ユーザに対して適切な運動を促す映像を提供できる。 According to the present disclosure, it is possible to provide an image that prompts the user to exercise appropriately using a control device that detects a user operation performed on the image, such as a touch panel device.
図1は、実施の形態1にかかる表示制御システムの構成を説明するイメージ図である。FIG. 1 is an image diagram illustrating the configuration of the display control system according to the first embodiment. 図2Aは、実施の形態1にかかる、ユーザの体格情報等に応じたGUI表示可能範囲を説明するイメージ図である。FIG. 2A is an image diagram for explaining a GUI displayable range according to the user's physique information and the like according to the first embodiment. 図2Bは、実施の形態1にかかる、ユーザの体格情報等に応じたGUI表示可能範囲を説明するイメージ図である。FIG. 2B is an image diagram for explaining a GUI displayable range according to the user's physique information and the like according to the first embodiment. 図2Cは、実施の形態1にかかる、ユーザの体格情報等に応じたGUI表示可能範囲を説明するイメージ図である。FIG. 2C is an image diagram for explaining a GUI displayable range according to the user's physique information and the like according to the first embodiment. 図3は、実施の形態1にかかる表示制御システムのGUI表示可能範囲の決定、及び、GUI表示の形状/速度変更の動作を示すフローチャートである。FIG. 3 is a flowchart of operations for determining a GUI displayable range and changing the GUI display shape / speed in the display control system according to the first embodiment. 図4は、実施の形態1にかかる表示制御システムにおいて、ユーザの診断を行うための問題文表示の動作を示すフローチャートである。FIG. 4 is a flowchart illustrating an operation of displaying a question sentence for performing user diagnosis in the display control system according to the first embodiment. 図5は、実施の形態2にかかる表示制御システムのGUI表示可能範囲の決定、及び、GUI表示の形状/速度変更の動作を示すフローチャートである。FIG. 5 is a flowchart illustrating operations of determining a GUI displayable range and changing the GUI display shape / speed in the display control system according to the second embodiment. 図6は、他の実施の形態にかかる表示制御システムの構成を説明するイメージ図である。FIG. 6 is an image diagram illustrating a configuration of a display control system according to another embodiment. 図7は、他の実施の形態の変形例にかかる表示制御システムの動作を説明するイメージ図である。FIG. 7 is an image diagram for explaining the operation of the display control system according to the modification of the other embodiment.
 以下、適宜図面を参照しながら、実施の形態を詳細に説明する。但し、必要以上に詳細な説明は省略する場合がある。例えば、既によく知られた事項の詳細な説明や実質的に同一の構成に対する重複説明を省略する場合がある。これは、以下の説明が不必要に冗長になるのを避け、当業者の理解を容易にするためである。 Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions of substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.
 なお、添付図面及び以下の説明は、当業者が本開示を十分に理解するために、提供されるのであって、これらによって請求の範囲に記載の主題を限定することを意図するものではない。 The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the claimed subject matter.
 以下の説明において、映像とは、静止画と動画を含む。 In the following description, video includes still images and moving images.
 (実施の形態1)
 以下、添付の図面を用いて、実施の形態1を説明する。
(Embodiment 1)
The first embodiment will be described below with reference to the accompanying drawings.
 図1は、実施の形態1にかかる表示制御システム100の構成を説明するイメージ図である。表示制御システム100は、パーソナルコンピュータ110(以下、PC110と称する)、表示パネル120、静電容量センサ130、カメラ140、圧力センサ150、及びクラウドサーバ170を備えている。PC110は、ICカード180を挿入可能なカードリーダー111を周辺機器として備えている。ユーザ50は、生体センサ160を自身の腕などに装着して、表示制御システム100による運動の提供を利用する。各構成を以下に詳細に説明する。 FIG. 1 is an image diagram for explaining a configuration of a display control system 100 according to the first embodiment. The display control system 100 includes a personal computer 110 (hereinafter referred to as a PC 110), a display panel 120, a capacitance sensor 130, a camera 140, a pressure sensor 150, and a cloud server 170. The PC 110 includes a card reader 111 into which an IC card 180 can be inserted as a peripheral device. The user 50 wears the biological sensor 160 on his / her arm or the like, and uses the exercise provided by the display control system 100. Each configuration will be described in detail below.
 PC110は、表示パネル120、静電容量センサ130、カメラ140、圧力センサ150、生体センサ160、クラウドサーバ170、及びカードリーダー111と、有線或いは無線により通信可能に接続されている。PC110は、静電容量センサ130、カメラ140、圧力センサ150、生体センサ160、クラウドサーバ170、及びカードリーダー111のそれぞれから各種の情報を取得することができる。PC110は、取得した各種の情報に基づいて、表示パネル120に、グラフィカル・ユーザ・インターフェース(以下、GUIと称する)の表示可能範囲200(以下、GUI表示可能範囲200と称する)を決定する。また、PC110は、決定したGUI表示可能範囲200内のいずれかの位置に、マーク210を表示したり、非表示にしたりすることができる。また、PC110は、マーク210を表示したり、非表示にしたりする速度を変更したり、マーク210の形状及び色を変更することができる。更に、PC110は、表示パネル120に問題文などのテキスト及びマーク210を含めた映像を表示することができる。 The PC 110 is connected to the display panel 120, the capacitance sensor 130, the camera 140, the pressure sensor 150, the biological sensor 160, the cloud server 170, and the card reader 111 so that they can communicate with each other by wire or wirelessly. The PC 110 can acquire various types of information from each of the capacitance sensor 130, the camera 140, the pressure sensor 150, the biological sensor 160, the cloud server 170, and the card reader 111. The PC 110 determines a displayable range 200 (hereinafter referred to as a GUI displayable range 200) of a graphical user interface (hereinafter referred to as GUI) on the display panel 120 based on the acquired various types of information. Further, the PC 110 can display or hide the mark 210 at any position within the determined GUI displayable range 200. Further, the PC 110 can change the speed at which the mark 210 is displayed or hidden, and can change the shape and color of the mark 210. Further, the PC 110 can display an image including text such as a question sentence and the mark 210 on the display panel 120.
 表示パネル120は、PC110による制御に従って、映像を表示することができる。表示パネル120は、平均的な体格の人間が両手を拡げた幅以上の幅を備えていることが好ましい。また、表示パネル120は、平均的な体格の人間が直立した状態で両手を頭上に伸ばした高さ以上の高さがあると、より好ましい。表示パネル120は、液晶表示方式、及び、有機EL(Electro Luminescence)表示方式など、任意の表示方式により実現可能である。 The display panel 120 can display an image according to control by the PC 110. The display panel 120 preferably has a width that is equal to or greater than the width of a person with an average physique with both hands extended. In addition, it is more preferable that the display panel 120 has a height that is equal to or higher than a height in which both hands extend above the head in a state where an average physique is upright. The display panel 120 can be realized by an arbitrary display method such as a liquid crystal display method and an organic EL (Electro Luminescence) display method.
 静電容量センサ130は、表示パネル120のユーザ50側の前面に配置され、ユーザ50によるタッチ操作(ユーザの動作)を検出する。より具体的には、静電容量センサ130は、ユーザ50が接触した箇所の静電容量の変化を検出することにより、ユーザ50によるタッチ操作の位置座標を検出する。静電容量センサ130は、検出したタッチ操作の位置座標をPC110に送信する。検出したタッチ操作の位置座標は、PC110において、タッチ操作をすべき位置の正誤判定などに利用される。本実施の形態において、静電容量センサ130はタッチパネルとして用いられる。 The capacitance sensor 130 is disposed on the front surface of the display panel 120 on the user 50 side, and detects a touch operation (user action) by the user 50. More specifically, the capacitance sensor 130 detects the position coordinates of the touch operation performed by the user 50 by detecting a change in capacitance at a location where the user 50 has touched. The capacitance sensor 130 transmits the detected position coordinates of the touch operation to the PC 110. The detected position coordinates of the touch operation are used in the PC 110 for correct / incorrect determination of the position where the touch operation should be performed. In the present embodiment, the capacitance sensor 130 is used as a touch panel.
 カメラ140は、表示パネル120の周辺(例えば上部)に配置され、ユーザ50を撮影する。カメラ140は、例えば、RGB(Red Green Blue)のカラー撮影が可能なイメージセンサを搭載した撮像装置である。カメラ140は、ユーザ50を撮影して生成した画像データをPC110に送信する。カメラ140が生成した画像データは、PC110において、ユーザ50の立ち位置の検出に利用される。或いは、カメラ140が生成した画像データは、PC110において、ユーザ50の生体情報(身長など)の解析、ユーザ50の顔の認証などに利用されてもよい。 The camera 140 is arranged around the display panel 120 (for example, at the top) and photographs the user 50. The camera 140 is, for example, an imaging device equipped with an image sensor capable of RGB (Red Green Blue) color imaging. The camera 140 transmits image data generated by photographing the user 50 to the PC 110. The image data generated by the camera 140 is used for detecting the standing position of the user 50 in the PC 110. Alternatively, the image data generated by the camera 140 may be used in the PC 110 for analysis of the biometric information (such as height) of the user 50, authentication of the face of the user 50, and the like.
 圧力センサ150は、表示パネル120の前の床に設置される。圧力センサ150の上にユーザ50が立っている。圧力センサ150は、表示パネル120の横幅と同程度の幅があることが好ましい。ユーザ50は、圧力センサ150の上に乗った状態にて、表示パネル120に表示されるマーク210に対するタッチ操作を行う。圧力センサ150は、上に乗ったユーザ50の体重に基づく圧力の位置座標を検出する。圧力センサ150は、検出した圧力の位置座標をPC110に送信する。検出した圧力の位置座標は、PC110において、ユーザ50の立ち位置の検出などに利用される。 The pressure sensor 150 is installed on the floor in front of the display panel 120. A user 50 stands on the pressure sensor 150. It is preferable that the pressure sensor 150 has the same width as the horizontal width of the display panel 120. The user 50 performs a touch operation on the mark 210 displayed on the display panel 120 while riding on the pressure sensor 150. The pressure sensor 150 detects the position coordinates of the pressure based on the weight of the user 50 riding on the pressure sensor 150. The pressure sensor 150 transmits the detected pressure position coordinates to the PC 110. The detected position coordinates of the pressure are used in the PC 110 for detecting the standing position of the user 50 and the like.
 生体センサ160は、ユーザ50自身の腕又は頭などに装着されるウェアラブル端末である。生体センサ160は、生体情報を取得するセンサの一つであり、装着したユーザ50の脈拍数、呼吸数、発汗、体温、及び脳波など、生体の状態を検出する。生体センサ160は、検出した脈拍数、呼吸数、発汗、体温、及び脳波など、生体の状態をPC110に送信する。検出した生体の状態は、PC110において、GUI表示可能範囲200内にマーク210を表示する位置及び速度の変更などに利用される。 The biosensor 160 is a wearable terminal worn on the user's 50 own arm or head. The biometric sensor 160 is one of sensors that obtain biometric information, and detects the state of the living body such as the pulse rate, respiration rate, sweating, body temperature, and electroencephalogram of the wearing user 50. The biosensor 160 transmits the state of the living body such as the detected pulse rate, respiration rate, sweating, body temperature, and electroencephalogram to the PC 110. The detected biological state is used in the PC 110 to change the position and speed at which the mark 210 is displayed within the GUI displayable range 200.
 クラウドサーバ170は、様々なユーザの体格情報及び医療情報をID(Identification)管理して記録したデータベースを備える。体格情報には、ユーザ50の身長、手の長さ、手の大きさ、及び体重などが含まれる。医療情報には、ユーザの怪我又は病気の有無、怪我又は病気の種類、怪我又は病気の部位、及び認知症診断のテスト結果などが含まれる。クラウドサーバ170は、PC110から送信されてきたID情報に基づいてデータベースを検索し、該当する情報をPC110に返信する。 The cloud server 170 includes a database in which various user physique information and medical information are managed by ID (Identification) management. The physique information includes the user's 50 height, hand length, hand size, weight, and the like. The medical information includes the presence or absence of injury or illness of the user, the type of injury or illness, the site of the injury or illness, and the test result of the dementia diagnosis. The cloud server 170 searches the database based on the ID information transmitted from the PC 110 and returns the corresponding information to the PC 110.
 ICカード180は、PC110の周辺機器であるカードリーダー111に挿入される。ICカード180は、表示制御システム100を利用しようとするユーザ50の、個人識別番号、年齢、性別、住所、氏名、及び生年月日などのID情報を含む。ICカード180に含まれるID情報は、カードリーダー111を介してPC110に送信される。ICカード180に含まれるID情報は、先述したように、クラウドサーバ170からの医療情報の取得に利用される。なお、クラウドサーバ170から体格情報及び医療情報を取得せずに、ICカード180に予め体格情報及び医療情報を記録させることで代替してもよい。また、クラウドサーバ170、ICカード180に、ユーザ50のID情報、体格情報、医療情報が予め登録されていない場合であっても、PC110が対応するために、静電容量センサ130、及び、PC110への操作を通して、ユーザ50がこれらの情報を直接入力できるようにしてもよい。 The IC card 180 is inserted into the card reader 111 that is a peripheral device of the PC 110. The IC card 180 includes ID information such as a personal identification number, age, sex, address, name, and date of birth of the user 50 who intends to use the display control system 100. The ID information included in the IC card 180 is transmitted to the PC 110 via the card reader 111. The ID information included in the IC card 180 is used for obtaining medical information from the cloud server 170 as described above. Instead of acquiring physique information and medical information from the cloud server 170, the IC card 180 may be recorded in advance to record physique information and medical information. Further, even if the ID information, the physique information, and the medical information of the user 50 are not registered in advance in the cloud server 170 and the IC card 180, the capacitance sensor 130 and the PC 110 are compatible with the PC 110. The user 50 may be able to directly input these pieces of information through the operation.
 上記の構成により、表示制御システム100は、ユーザ50に対して適切な運動を促す映像を提供する。適切な運動を促す映像を提供するにあたって、表示制御システム100は、ユーザ50の体格情報等に応じて、GUI表示可能範囲200を決定する。 With the above configuration, the display control system 100 provides a video that prompts the user 50 to exercise appropriately. In providing an image for promoting appropriate exercise, the display control system 100 determines the GUI displayable range 200 according to the physique information of the user 50 and the like.
 図2Aは、実施の形態1にかかる、ユーザ50Aの体格情報等に応じたGUI表示可能範囲200Aを説明するイメージ図である。図2Bは、同ユーザ50Bの体格情報等に応じたGUI表示可能範囲200Bを説明するイメージ図である。図2Cは、同ユーザ50Cの体格情報等に応じたGUI表示可能範囲200Cを説明するイメージ図である。図2A、図2B、図2Cは、ユーザ50A、50B、50Cの体格等がそれぞれ異なっている場合のGUI表示可能範囲200A、200B、200Cをそれぞれ示している。ユーザ50Aは、平均的な体格の成人を例示している。ユーザBは、平均的な体格の成人よりも体格の小さい幼児を例示している。ユーザCは、平均的な体格の成人ではあるが、左腕に怪我を負っている成人を例示している。 FIG. 2A is an image diagram for explaining a GUI displayable range 200A according to the physique information and the like of the user 50A according to the first embodiment. FIG. 2B is an image diagram illustrating a GUI displayable range 200B according to the physique information and the like of the user 50B. FIG. 2C is an image diagram illustrating a GUI displayable range 200C according to the physique information and the like of the user 50C. 2A, 2B, and 2C respectively show GUI displayable ranges 200A, 200B, and 200C when the physiques and the like of users 50A, 50B, and 50C are different from each other. User 50A illustrates an adult with an average physique. User B exemplifies an infant whose physique is smaller than an average physique adult. User C exemplifies an adult who is an average physique adult but injured in his left arm.
 図2A、図2B、図2Cを用いて後述するように、表示制御システム100は、ユーザの体格等に合わせて、GUI表示可能範囲を決定する。図2Aに示すように、表示制御システム100は、成人であるユーザ50Aの体格に合わせて、GUI表示可能範囲200Aを決定し、決定したGUI表示可能範囲200A内にマーク210を表示させる。同様に、図2Bに示すように、表示制御システム100は、幼児であるユーザ50Bの体格に合わせて、GUI表示可能範囲200Bを決定し、決定したGUI表示可能範囲200B内にマーク210を表示させる。図2Cに示すように、表示制御システム100は、左腕に怪我を負っている成人であるユーザ50Cの体格に合わせつつ、左腕側の範囲を小さくする補正を行い、GUI表示可能範囲200Cを決定する。表示制御システム100は、決定したGUI表示可能範囲200C内でマーク210を表示させる。 As will be described later with reference to FIGS. 2A, 2B, and 2C, the display control system 100 determines the GUI displayable range according to the user's physique and the like. As shown in FIG. 2A, the display control system 100 determines a GUI displayable range 200A in accordance with the physique of an adult user 50A, and displays a mark 210 within the determined GUI displayable range 200A. Similarly, as shown in FIG. 2B, the display control system 100 determines the GUI displayable range 200B in accordance with the physique of the user 50B who is an infant, and displays the mark 210 in the determined GUI displayable range 200B. . As shown in FIG. 2C, the display control system 100 corrects the range on the left arm side to match the physique of the user 50C who is an adult who has an injury on the left arm, and determines the GUI displayable range 200C. . The display control system 100 displays the mark 210 within the determined GUI displayable range 200C.
 上記のように構成された表示制御システム100の動作について、詳細に説明する。図3は、実施の形態1にかかる表示制御システム100のGUI表示可能範囲の決定、及び、GUI表示の形状/速度変更の動作を示すフローチャートである。 The operation of the display control system 100 configured as described above will be described in detail. FIG. 3 is a flowchart illustrating operations of determining the GUI displayable range and changing the shape / speed of GUI display of the display control system 100 according to the first embodiment.
 表示制御システム100を構成する各装置の電源をON状態とすると、PC110は、プログラムを起動し、表示制御の動作を開始する。 When the power of each device constituting the display control system 100 is turned on, the PC 110 starts a program and starts display control operation.
 まず、PC110は、カメラ140が生成した画像データ、或いは、圧力センサ150が検出した位置座標に基づいて、ユーザ50の立ち位置を検出する(ステップS100)。すなわち、PC110は、表示パネル120の前面の横幅方向において、いずれの位置にユーザ50が立っているのかを検出する。 First, the PC 110 detects the standing position of the user 50 based on the image data generated by the camera 140 or the position coordinates detected by the pressure sensor 150 (step S100). That is, the PC 110 detects at which position the user 50 stands in the horizontal width direction of the front surface of the display panel 120.
 PC110は、カードリーダー111に挿入されたICカード180から、ユーザ50のID情報を読み込む(ステップS101)。PC110は、ICカード180から読み込んだID情報に基づいて、クラウドサーバ170からユーザ50に該当する体格情報、医療情報を取得する(ステップS102、S103)。 The PC 110 reads the ID information of the user 50 from the IC card 180 inserted in the card reader 111 (step S101). The PC 110 acquires physique information and medical information corresponding to the user 50 from the cloud server 170 based on the ID information read from the IC card 180 (steps S102 and S103).
 PC110は、ステップS100で検出したユーザ50の立ち位置、及び、ステップS102で取得したユーザ50の体格情報(身長、手の長さ、手の大きさなど)に基づいて、GUI表示可能範囲200を決定する。具体的には、PC110は、ユーザ50の立ち位置を、GUI表示可能範囲200を決定するにあたっての基準の位置とする。例えば、PC110は、ユーザ50の立ち位置の正面にGUI表示可能範囲200の中心線が来るようにする。PC110は、GUI表示可能範囲200の縦方向の長さを、ユーザ50の身長、手の長さ、手の大きさに基づいて、人間が一般に運動するのにあたって無理のない範囲で決定する。一方、PC110は、GUI表示可能範囲200の横方向の長さを、ユーザ50の手の長さ、手の大きさに基づいて、ユーザ50にとって運動するのに無理のない範囲で決定する。 The PC 110 sets the GUI displayable range 200 based on the standing position of the user 50 detected in step S100 and the physique information (height, hand length, hand size, etc.) of the user 50 acquired in step S102. decide. Specifically, the PC 110 sets the standing position of the user 50 as a reference position for determining the GUI displayable range 200. For example, the PC 110 causes the center line of the GUI displayable range 200 to be in front of the standing position of the user 50. The PC 110 determines the vertical length of the GUI displayable range 200 based on the height of the user 50, the length of the hand, and the size of the hand within a range that is not unreasonable for humans to exercise. On the other hand, the PC 110 determines the horizontal length of the GUI displayable range 200 based on the length and the size of the hand of the user 50 within a range where it is easy for the user 50 to exercise.
 PC110は、ステップS102で取得したID情報(年齢、性別など)と、ステップS103で取得した医療情報(ユーザの怪我又は病気の有無、怪我又は病気の種類、怪我又は病気の部位、認知症診断のテスト結果など)とに基づいて、ステップS104で一旦決定したGUI表示可能範囲200を補正する(ステップS105)。例えば、所定の年齢以上(比較的高齢者)であったり、所定の年齢未満(比較的幼年者)であったりすれば、GUI表示可能範囲200を小さくするように補正する。また、女性であれば、GUI表示可能範囲200を小さくするように補正する。或いは、左腕に怪我を負ったユーザ50であれば、左腕側が小さくなるように、GUI表示可能範囲200を補正する。 The PC 110 acquires the ID information (age, sex, etc.) acquired in step S102 and the medical information acquired in step S103 (whether the user is injured or ill, type of injury or illness, injury or illness site, dementia diagnosis) The GUI displayable range 200 once determined in step S104 is corrected based on the test result (step S105). For example, if the user is older than a predetermined age (relatively elderly) or younger than a predetermined age (relatively young), the GUI displayable range 200 is corrected to be small. In addition, if the woman is a female, the GUI displayable range 200 is corrected to be small. Alternatively, if the user 50 is injured on the left arm, the GUI displayable range 200 is corrected so that the left arm side becomes smaller.
 PC110は、ステップS101で取得したID情報(年齢、性別など)と、ステップS103で取得した医療情報とに基づいて、GUI表示可能範囲200内で表示させるマーク210の、表示形状、表示速度、表示サイズ、表示数を設定する(ステップS106)。例えば、表示形状、表示速度、表示サイズ、表示数のそれぞれについて基準値を用意しておき、年齢の高い低いに応じて、性別に応じて、或いは、怪我の有無に応じて、基準値からそれぞれの値をシフトさせる。 The PC 110 displays the display shape, display speed, and display of the mark 210 to be displayed in the GUI displayable range 200 based on the ID information (age, sex, etc.) acquired in step S101 and the medical information acquired in step S103. A size and a display number are set (step S106). For example, prepare reference values for each of the display shape, display speed, display size, and number of displays, depending on the age, age, sex, or injuries, from the reference values. Shift the value of.
 以上のようにして、ステップS105で補正完了したGUI表示可能範囲200内において、ステップS106で設定した条件で、マーク210をランダムに表示開始する(ステップS107)。ユーザ50は、GUI表示可能範囲200内に表示されたマーク210に対するタッチ操作を開始する。マーク210は、表示された後、一定時間が経過すると非表示になる。ユーザ50は、マーク210が表示されている期間にタッチ操作を完了させる必要があり、脳と身体への適度な運動が促される。 As described above, the mark 210 is randomly displayed within the GUI displayable range 200 that has been corrected in step S105 under the conditions set in step S106 (step S107). The user 50 starts a touch operation on the mark 210 displayed in the GUI displayable range 200. The mark 210 disappears after a certain period of time after being displayed. The user 50 needs to complete the touch operation during the period in which the mark 210 is displayed, and is moderately exercised to the brain and body.
 GUI表示可能範囲200内にマーク210が表示されている間、PC110は、生体センサ160が検出している生体情報に変化があるかをモニタしている(ステップS108)。モニタ中の生体情報に、所定値を超える変化がなければ(ステップS108におけるNo)、PC110は、ステップS105で決定したGUI表示可能範囲200、及び、ステップS106で設定した条件を変更することなく、GUI表示可能範囲200へのマーク210のランダム表示を継続する。一方、モニタ中の生体情報に、所定値を超える変化があれば(ステップS108におけるYes)、PC110は、その変化の度合に応じて、ステップS105で決定したGUI表示可能範囲200を補正し、ステップS106で設定した条件を変更する(ステップS109)。そして、PC110は、補正後のGUI表示可能範囲200に対して、変更後の条件にてマーク210のランダム表示を継続する。例えば、脈拍数、呼吸数、発汗のいずれかを示す値が、所定値を超える変化がある場合には、GUI表示可能範囲200を小さくするように補正する。また、マーク210の表示速度を遅くしたり、表示数を少なくしたり、表示形状を大きくしたりして、ユーザ50への負担を軽減させる。これにより、ユーザ50に対する適度な運動を促す映像の提供を継続することができる。 While the mark 210 is displayed in the GUI displayable range 200, the PC 110 monitors whether there is a change in the biological information detected by the biological sensor 160 (step S108). If there is no change exceeding the predetermined value in the biological information being monitored (No in step S108), the PC 110 does not change the GUI displayable range 200 determined in step S105 and the conditions set in step S106. The random display of the mark 210 in the GUI displayable range 200 is continued. On the other hand, if there is a change exceeding the predetermined value in the biological information being monitored (Yes in step S108), the PC 110 corrects the GUI displayable range 200 determined in step S105 according to the degree of the change, and the step The condition set in S106 is changed (step S109). And PC110 continues the random display of the mark 210 on the conditions after change with respect to the GUI display possible range 200 after correction | amendment. For example, when the value indicating any one of the pulse rate, the respiratory rate, and the sweating exceeds a predetermined value, the GUI displayable range 200 is corrected to be small. In addition, the burden on the user 50 is reduced by reducing the display speed of the mark 210, reducing the number of displays, and increasing the display shape. Thereby, provision of the image | video which prompts the moderate exercise | movement with respect to the user 50 can be continued.
 また、表示制御システム100は、GUI表示可能範囲200の内の複数の位置に同時にマーク210を表示しても良い。これにより、さらにユーザ50に対して適切な運動を促す映像を提供できる。 Further, the display control system 100 may simultaneously display the marks 210 at a plurality of positions within the GUI displayable range 200. Accordingly, it is possible to provide an image that prompts the user 50 for appropriate exercise.
 GUI表示可能範囲200内にマーク210が表示されている間、PC110は、カメラ140或いは圧力センサ150が検出しているユーザ50の立ち位置をモニタしている(ステップS110)。モニタしている立ち位置に、所定値を超える変化がなければ(ステップS110におけるNo)、PC110は、GUI表示可能範囲200を補正することなく、ステップS108の動作に戻る。一方、モニタしている立ち位置に、所定値を超える変化があれば(ステップS110におけるYes)、PC110は、立ち位置に応じて、GUI表示可能範囲200を補正する。例えば、ユーザ50の立ち位置が、ユーザ50から見て左に30cmの距離を移動した場合、PC110は、GUI表示可能範囲200の基準の位置を、ユーザ50から見て左に30cmの距離を移動させる補正を行う。これにより、ユーザ50が移動したとしても、運動を促す映像の提供を継続することができる。 While the mark 210 is displayed in the GUI displayable range 200, the PC 110 monitors the standing position of the user 50 detected by the camera 140 or the pressure sensor 150 (step S110). If there is no change exceeding the predetermined value at the monitored standing position (No in step S110), the PC 110 returns to the operation in step S108 without correcting the GUI displayable range 200. On the other hand, if the monitored standing position has a change exceeding a predetermined value (Yes in step S110), the PC 110 corrects the GUI displayable range 200 according to the standing position. For example, when the standing position of the user 50 moves a distance of 30 cm to the left as viewed from the user 50, the PC 110 moves the reference position of the GUI displayable range 200 to a distance of 30 cm to the left as viewed from the user 50. To correct. Thereby, even if the user 50 moves, provision of the image | video which accelerates | stimulates an exercise | movement can be continued.
 図4は、実施の形態1にかかる表示制御システム100において、ユーザ50の診断を行うための問題文表示の動作を示すフローチャートである。ここでは、GUI表示可能範囲200内にマーク210を表示させる動作方法の一例として、問題文表示の動作を説明する。 FIG. 4 is a flowchart showing an operation of displaying a question sentence for diagnosing the user 50 in the display control system 100 according to the first embodiment. Here, as an example of an operation method for displaying the mark 210 within the GUI displayable range 200, an operation for displaying a question sentence will be described.
 PC110は、図3に示すステップS107において表示を開始すると、表示パネル120に問題文を表示する(ステップS200)。例えば、赤い丸型のマーク210を「正解」とし、黒い四角型のマーク210を「不正解(ダミー)」とする。このとき、表示パネル120に、赤い丸型のマーク210をタッチ操作することを指示する問題文を表示する。そして、PC110は、GUI表示可能範囲200内において、正解とダミーのマーク210の表示を開始する。 When the PC 110 starts display in step S107 shown in FIG. 3, the problem message is displayed on the display panel 120 (step S200). For example, the red round mark 210 is “correct”, and the black square mark 210 is “incorrect (dummy)”. At this time, a question sentence for instructing to touch the red round mark 210 is displayed on the display panel 120. Then, the PC 110 starts displaying the correct answer and the dummy mark 210 within the GUI displayable range 200.
 PC110は、ユーザ50が、正解のマーク210を正しくタッチ操作できたか否かをモニタしている(ステップS202)。ユーザ50が、正解のマーク210を正しくタッチ操作できた場合(ステップS202におけるYes)、PC110は、表示パネル120に、正解の旨を表示する(ステップS203)。一方、ユーザ50が、正解のマーク210を正しくタッチ操作できなかった場合(ダミーのマーク210をタッチ操作した場合など)、PC110は、表示パネル120に、不正解の旨を表示する(ステップS204)。 The PC 110 monitors whether or not the user 50 has correctly touched the correct mark 210 (step S202). When the user 50 has correctly touched the correct mark 210 (Yes in step S202), the PC 110 displays the correct answer on the display panel 120 (step S203). On the other hand, when the user 50 cannot correctly touch the correct mark 210 (such as when the dummy mark 210 is touched), the PC 110 displays an incorrect answer on the display panel 120 (step S204). .
 一連の問題が終了したときに、ユーザ50の問題に対する正解数の成績が表示される。PC110は、ユーザ50の成績を外部記録媒体に保存する。 When the series of questions is completed, the number of correct answers for the user's 50 questions is displayed. The PC 110 stores the results of the user 50 in an external recording medium.
 ユーザ50から動作停止の旨の操作がなされた場合、或いは、問題が終了した場合、PC110は、上記一連の表示動作にかかるプログラムを終了させる。そして、PC110は、ユーザ50がマーク210を正しくタッチ操作できた精度(操作精度)、マーク210が表示開始されてからユーザ50がタッチ操作できるまでに要した時間(操作反応時間)に基づいて、ユーザ50の運動量、運動機能の優劣、認知症進行度合いの診断を行う。そして、PC110は、診断結果を、表示パネル120に表示する。 When the user 50 performs an operation to stop the operation or when the problem ends, the PC 110 ends the program related to the series of display operations. And PC110 is based on the precision (operation precision) which the user 50 was able to touch-operate the mark 210 correctly, and the time (operation reaction time) required until the user 50 could touch-operate after the mark 210 was started to display, Diagnose the amount of exercise of the user 50, superiority or inferiority of motor function, and degree of dementia progression. Then, the PC 110 displays the diagnosis result on the display panel 120.
 PC110は、取得した個人識別情報、体格情報、医療情報、及び、これらの情報に基づいて決定したGUI表示可能範囲200、マーク210の表示速度、表示サイズ、表示形状、表示数にかかる条件、診断結果を、外部記録媒体に保存する。 The PC 110 obtains the acquired personal identification information, physique information, medical information, the GUI displayable range 200 determined based on these information, the display speed of the mark 210, the display size, the display shape, the conditions concerning the number of displays, diagnosis The result is stored in an external recording medium.
 以上のように、本実施の形態の表示制御システム100に相当する制御装置は、映像を提供する表示パネル120に相当する映像提供部と、映像に対して行われるユーザ50の操作を検出する静電容量センサ130に相当する操作検出部と、ユーザ50が存在する位置を検出するカメラ140に相当する位置検出部と、を備える。また、(i)クラウドサーバ170又はICカード180に相当するメモリに記録されたユーザ50の体格情報と、位置検出部により検出された位置とに基づいて、映像提供部に動的に提供させるGUI表示可能範囲200に相当するGUI(グラフィカル・ユーザ・インターフェース)の表示可能範囲を決定し、(ii)決定された表示可能範囲内のいずれかの位置にGUIを示す映像を提供するよう映像提供部を制御するPC110に相当する制御部、を備える。 As described above, the control device corresponding to the display control system 100 according to the present embodiment includes the video providing unit corresponding to the display panel 120 that provides the video and the static that detects the operation of the user 50 performed on the video. An operation detection unit corresponding to the capacitance sensor 130 and a position detection unit corresponding to the camera 140 that detects a position where the user 50 exists are provided. Also, (i) a GUI that is dynamically provided to the video providing unit based on the physique information of the user 50 recorded in the memory corresponding to the cloud server 170 or the IC card 180 and the position detected by the position detecting unit. A video providing unit that determines a displayable range of a GUI (Graphical User Interface) corresponding to the displayable range 200, and (ii) provides a video indicating the GUI at any position within the determined displayable range. A control unit corresponding to the PC 110 that controls the computer.
 これにより、タッチパネル装置など、映像に対して行われるユーザ50の操作を検出する制御装置を用いて、ユーザ50に対して適切な運動を促す映像を提供できる。 Thereby, it is possible to provide a video that prompts the user 50 to exercise appropriately using a control device that detects an operation of the user 50 performed on the video, such as a touch panel device.
 また、制御部は、決定された表示可能範囲内においてGUIを示す映像を提供する位置を、時間経過に応じて変化させるよう映像提供部を制御してもよい。これにより、ユーザ50に対して適切な運動を促す映像を提供できる。 Further, the control unit may control the video providing unit so as to change the position where the video showing the GUI is provided within the determined displayable range as time elapses. Thereby, the image | video which prompts the user 50 for an appropriate exercise | movement can be provided.
 また、制御部は、決定された表示可能範囲内の複数の位置に対して同時にGUIを示す映像を提供するよう映像提供部を制御してもよい。これにより、ユーザ50に対して適切な運動を促す映像を提供できる。 Further, the control unit may control the video providing unit so as to provide a video showing a GUI at a plurality of positions within the determined displayable range at the same time. Thereby, the image | video which prompts the user 50 for an appropriate exercise | movement can be provided.
 また、制御部は、GUIを示す映像のうち、第1の条件で提供される映像を、第1の条件とは異なる第2の条件で提供される映像とは色及び形状の少なくともどちらかを異ならせるよう映像提供部を制御してもよい。これにより、ユーザ50に対して適切な運動を促す映像を提供できる。 In addition, the control unit displays a video provided under the first condition among videos indicating a GUI, and a video provided under a second condition different from the first condition is at least one of color and shape. The video providing unit may be controlled so as to be different. Thereby, the image | video which prompts the user 50 for an appropriate exercise | movement can be provided.
 また、本実施の形態の表示制御システム100に相当する制御装置は、ユーザ50に操作させるための映像を提供する表示パネル120に相当する映像提供部と、映像に対して行われるユーザ50の操作を検出する静電容量センサ130に相当する操作検出部と、を備える。また、ユーザ50の操作とは異なる、ユーザ50の生体情報を検出する生体センサ160に相当する生体情報検出部と、映像を生体情報の変化に応じて変化させるPC110に相当する制御部と、を備える。 The control device corresponding to the display control system 100 according to the present embodiment includes a video providing unit corresponding to the display panel 120 that provides a video for the user 50 to operate, and an operation of the user 50 performed on the video. And an operation detection unit corresponding to the capacitance sensor 130 for detecting. Further, a biological information detection unit corresponding to the biological sensor 160 that detects the biological information of the user 50, and a control unit corresponding to the PC 110 that changes the video according to the change of the biological information, which are different from the operation of the user 50. Prepare.
 これにより、タッチパネル装置など、映像に対して行われるユーザ50の操作を検出する制御装置を用いて、ユーザ50に対して適切な運動を促す映像を提供できる。 Thereby, it is possible to provide a video that prompts the user 50 to exercise appropriately using a control device that detects an operation of the user 50 performed on the video, such as a touch panel device.
 また、制御部は、生体情報の変化に応じて、映像の表示の位置、速度、及び数の内少なくとも1つを変化させてもよい。これにより、ユーザ50に対して適切な運動を促す映像を提供できる。 Further, the control unit may change at least one of the display position, speed, and number of the video display according to the change of the biological information. Thereby, the image | video which prompts the user 50 for an appropriate exercise | movement can be provided.
 また、生体情報は、脈拍数または心拍数であってもよい。これにより、ユーザ50に対して適切な運動を促す映像を提供できる。 Moreover, the biological information may be a pulse rate or a heart rate. Thereby, the image | video which prompts the user 50 for an appropriate exercise | movement can be provided.
 また、操作検出部は、タッチパネルであってもよい。これにより、ユーザ50に対して適切な運動を促す映像を提供できる。 Further, the operation detection unit may be a touch panel. Thereby, the image | video which prompts the user 50 for an appropriate exercise | movement can be provided.
 (実施の形態2)
 以下、添付の図面を用いて、実施の形態2を説明する。実施の形態2にかかる表示制御システム100について、構成は図1を用いて示した実施の形態1と同様であるため、詳細な説明を省略する。実施の形態2にかかる表示制御システム100は、実施の形態1と比べて、GUI表示可能範囲200の決定方法が異なる。
(Embodiment 2)
The second embodiment will be described below with reference to the accompanying drawings. About the display control system 100 concerning Embodiment 2, since a structure is the same as that of Embodiment 1 shown using FIG. 1, detailed description is abbreviate | omitted. The display control system 100 according to the second embodiment is different from the first embodiment in the method for determining the GUI displayable range 200.
 図5は、実施の形態2にかかる表示制御システム100のGUI表示可能範囲の決定、及び、GUI表示の形状/速度変更の動作を示すフローチャートである。 FIG. 5 is a flowchart illustrating the operation of determining the GUI displayable range and changing the GUI display shape / speed in the display control system 100 according to the second embodiment.
 まず、PC110は、表示パネル120に、ユーザ50に実測を促す表示を行う(ステップS300)。例えば、GUI表示可能範囲200の上辺の実測を指示する表示、右辺の実測を指示する表示、左辺の実測を指示する表示、底辺の実測を指示する表示を順次行う。ユーザ50は、表示パネル120に表示される各指示の度に、静電容量センサ130に対してタッチ操作を行う。例えば、GUI表示可能範囲200の左辺の実測を指示する表示がなされた場合、ユーザ50は、現在の立ち位置から左手を可能な限り左方向に伸ばして、静電容量センサ130に対してタッチ操作を行う。同様にGUI表示可能範囲200の右辺の実測を指示する表示がなされた場合、ユーザ50は、現在の立ち位置から右手を可能な限り右方向に伸ばして、静電容量センサ130に対してタッチ操作を行う。PC110は、ユーザ50によるタッチ操作がなされた位置座標を、各指示に対応付けて実測する(ステップS301)。この実測を、GUI表示可能範囲200を決定するのに必要な箇所について行う。 First, the PC 110 displays on the display panel 120 a message prompting the user 50 to perform actual measurement (step S300). For example, a display for instructing actual measurement of the upper side of the GUI displayable range 200, a display for instructing actual measurement of the right side, a display for instructing actual measurement of the left side, and a display for instructing actual measurement of the bottom side are sequentially performed. The user 50 performs a touch operation on the capacitance sensor 130 for each instruction displayed on the display panel 120. For example, when a display for instructing actual measurement of the left side of the GUI displayable range 200 is made, the user 50 extends the left hand as far as possible from the current standing position and performs a touch operation on the capacitance sensor 130. I do. Similarly, when the display for instructing the actual measurement of the right side of the GUI displayable range 200 is made, the user 50 extends the right hand as far as possible from the current standing position and performs a touch operation on the capacitance sensor 130. I do. The PC 110 measures the position coordinates on which the touch operation has been performed by the user 50 in association with each instruction (step S301). This actual measurement is performed for a portion necessary for determining the GUI displayable range 200.
 PC110は、ステップS301で実測して得られた実測情報に基づき、GUI表示可能範囲200を決定する(ステップS302)。PC110は、マーク210の表示形状、表示速度、表示サイズ、表示数を基準値に設定する(ステップS303)。以上のようにして、ステップS302で決定したGUI表示可能範囲200内において、ステップS303で設定した条件で、マーク210をランダムに表示開始する(ステップS304)。ユーザ50は、GUI表示可能範囲200内に表示されたマーク210に対するタッチ操作を開始する。マーク210は、表示された後、一定時間が経過すると非表示になる。ユーザ50は、マーク210が表示されている期間にタッチ操作を完了させる必要があり、ユーザ50の脳と身体への適度な運動が促される。 The PC 110 determines the GUI displayable range 200 based on the actual measurement information obtained by actual measurement in Step S301 (Step S302). The PC 110 sets the display shape, display speed, display size, and display number of the mark 210 as reference values (step S303). As described above, within the GUI displayable range 200 determined in step S302, the mark 210 is randomly displayed under the conditions set in step S303 (step S304). The user 50 starts a touch operation on the mark 210 displayed in the GUI displayable range 200. The mark 210 disappears after a certain period of time after being displayed. The user 50 needs to complete the touch operation during the period in which the mark 210 is displayed, and is encouraged to exercise moderately to the user's 50 brain and body.
 GUI表示可能範囲200内にマーク210が表示されている間、PC110は、生体センサ160が検出している生体情報をモニタしている(ステップS305)。生体情報に変化があれば(ステップS305におけるYes)、PC110は、生体情報に基づき、その変化の度合に応じてステップS303で設定した条件を変更し、GUI表示可能範囲200へのマーク210のランダム表示を継続する(ステップS306)。ステップS305~S308の動作は、図3を用いて示した、ステップS108~S111と同様である。 While the mark 210 is displayed in the GUI displayable range 200, the PC 110 monitors the biological information detected by the biological sensor 160 (step S305). If there is a change in the biometric information (Yes in step S305), the PC 110 changes the condition set in step S303 according to the degree of the change based on the biometric information, and the mark 210 on the GUI displayable range 200 is random. The display is continued (step S306). The operations in steps S305 to S308 are the same as those in steps S108 to S111 shown using FIG.
 以上のように、表示制御システム100は、ユーザ50のタッチ操作に基づく実測によって、GUI表示可能範囲200を決定することができる。 As described above, the display control system 100 can determine the GUI displayable range 200 by actual measurement based on the touch operation of the user 50.
 (他の実施の形態)
 以上のように、本出願において開示する技術の例示として、実施の形態1及び2を説明した。しかしながら、本開示における技術は、これらに限定されず、変更、置き換え、付加、省略などを行った実施の形態にも適用できる。また、上記実施の形態1及び2で説明した各構成要素を組み合わせて、新たな実施の形態とすることも可能である。
(Other embodiments)
As described above, Embodiments 1 and 2 have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to these, and can be applied to embodiments in which changes, replacements, additions, omissions, and the like are made. Moreover, it is also possible to combine each component demonstrated in the said Embodiment 1 and 2 into a new embodiment.
 上記の実施の形態1及び2では、表示制御システム100は、GUI表示可能範囲200を決定し、決定したGUI表示可能範囲200内にマーク210を表示する。これは、ユーザ50に対して運動を促すマーク210を表示する範囲を、GUI表示可能範囲200内とする主旨である。従って、GUI表示可能範囲200の外側に、固定的に表示されるアイコン(表示制御システム100の動作モードの選択アイコンなど)が表示されていようと、なかろうと、本開示の技術思想の範疇である。 In the first and second embodiments, the display control system 100 determines the GUI displayable range 200 and displays the mark 210 in the determined GUI displayable range 200. This is intended to make the range in which the mark 210 that prompts the user 50 to exercise is displayed within the GUI displayable range 200. Therefore, whether or not an icon that is fixedly displayed (such as an icon for selecting an operation mode of the display control system 100) is displayed outside the GUI displayable range 200 is within the scope of the technical idea of the present disclosure. .
 上記の実施の形態1及び2では、一人のユーザ50に対して、表示パネル120、静電容量センサ130、カメラ140、圧力センサ150のそれぞれを一台ずつ備えた表示制御システム100を例示したが、本開示はこれに限定されない。図6は、他の実施の形態にかかる表示制御システム100の構成を説明するイメージ図である。図6に示すように、複数のユーザ50A、50B、50Cに対して、表示パネル120、静電容量センサ130、カメラ140、圧力センサ150の各々を一台ずつとしてもよい。その場合であっても、図6に示すように、表示制御システム100は、複数のユーザ50A、50B、50Cのそれぞれの体格等に合わせて、GUI表示可能範囲200A、200B、200Cをそれぞれ決定し、決定したGUI表示可能範囲200A、200B、200C内にマーク210を表示する。 In the first and second embodiments described above, the display control system 100 including one display panel 120, the capacitance sensor 130, the camera 140, and the pressure sensor 150 is illustrated for one user 50. However, the present disclosure is not limited to this. FIG. 6 is an image diagram illustrating a configuration of a display control system 100 according to another embodiment. As shown in FIG. 6, for each of a plurality of users 50 </ b> A, 50 </ b> B, 50 </ b> C, one display panel 120, capacitance sensor 130, camera 140, and pressure sensor 150 may be provided. Even in that case, as shown in FIG. 6, the display control system 100 determines the GUI displayable ranges 200A, 200B, and 200C in accordance with the physiques of the plurality of users 50A, 50B, and 50C, respectively. The mark 210 is displayed in the determined GUI displayable ranges 200A, 200B, and 200C.
 また、図6に示すように、複数のユーザが表示制御システム100を利用する場合、それぞれのユーザに応じて、GUI表示可能範囲が優先される順位(優先順位)を設定しておいてもよい。図7は、他の実施の形態の変形例にかかる表示制御システム100の動作を説明するイメージ図である。図7に示す変形例では、ユーザ50Dが、ユーザ50Eに対して、優先順位が高く設定されている。ユーザ50D或いはユーザ50Eが移動することにより、双方のGUI表示可能範囲200D、200Eが重複するほど接近した場合を考える。表示制御システム100は、優先順位の低いユーザ50EのGUI表示可能範囲200Eを、優先順位の高いユーザ50DのGUI表示可能範囲200Dと重複しないように、範囲を限定させる(小さくする)よう補正する。そして、表示パネル120は、ユーザ50Eに、「接近しています。右に移動してください。」などの、ユーザ50Dから視認可能な位置に離れることを指示する警告をしてもよい。なお、この警告は、表示パネル120による映像によるものではなく、スピーカからの音声による警告であってもよい。 Also, as shown in FIG. 6, when a plurality of users use the display control system 100, a priority order (priority order) in which the GUI displayable range is given priority may be set according to each user. . FIG. 7 is an image diagram for explaining the operation of the display control system 100 according to a modification of the other embodiment. In the modification shown in FIG. 7, the user 50 </ b> D has a higher priority than the user 50 </ b> E. Consider a case in which the GUI display possible ranges 200D and 200E approach each other as the user 50D or the user 50E moves. The display control system 100 corrects the GUI displayable range 200E of the user 50E with low priority so as to limit (reduce) the range so as not to overlap with the GUI displayable range 200D of the user 50D with high priority. Then, the display panel 120 may give a warning instructing the user 50E to leave the user 50D to a position where it can be visually recognized, such as “approaching. Please move to the right”. Note that this warning may be a warning by sound from a speaker instead of a video by the display panel 120.
 上記の実施の形態1及び2では、本開示の映像提供部の一例として、表示パネル120を例示したが、本開示はこれに限定されない。映像提供部として、表示パネル120ではなく、プロジェクタにより映像投影されるスクリーンであってもよい。この場合は、操作検出部の一例として例示した静電容量センサ130に代えて、TOF(Time Of Flight)センサなどを用いて、スクリーンに投影された映像へのユーザによるタッチ操作を検出してもよい。なお、スクリーンは、市販のスクリーン材であってもよいし、壁面、又は、机面であってもよい。 In Embodiments 1 and 2, the display panel 120 is illustrated as an example of the video providing unit of the present disclosure, but the present disclosure is not limited to this. The video providing unit may be a screen projected by a projector instead of the display panel 120. In this case, even if the touch operation by the user to the image projected on the screen is detected using a TOF (Time Of Flight) sensor or the like instead of the capacitance sensor 130 illustrated as an example of the operation detection unit, Good. The screen may be a commercially available screen material, a wall surface, or a desk surface.
 上記の実施の形態1及び2では、本開示の位置検出部の一例として、カメラ140を例示したが、本開示はこれに限定されない。位置検出部として、圧力センサ150、静電容量センサ130、もしくは、表示パネル120の周辺に設けられた赤外線センサを用いてもよい。 In Embodiments 1 and 2 described above, the camera 140 is illustrated as an example of the position detection unit of the present disclosure, but the present disclosure is not limited thereto. As the position detection unit, the pressure sensor 150, the capacitance sensor 130, or an infrared sensor provided around the display panel 120 may be used.
 上記の実施の形態1及び2では、カードリーダー111により、ICカード180内に記録されたデータを読み取る例を示したが、本開示はこれに限定されない。RFID(Radio Frequency IDentifer)読み取り可能な媒体としてもよい。また、このときの媒体として、RFID読み取りに対応した携帯端末を用いてもよい。 In the first and second embodiments described above, the example in which the data recorded in the IC card 180 is read by the card reader 111 has been described, but the present disclosure is not limited thereto. An RFID (Radio Frequency IDentifier) readable medium may be used. In addition, as a medium at this time, a portable terminal that supports RFID reading may be used.
 本開示は、映像を提供する制御装置において、映像に対して行われるユーザの操作を検出する用途に適用可能である。例えば、高齢者支援などの医療福祉、又は、ゲームなどのアミューズメントなどにおいて、ユーザに対して適切な運動を促す映像を提供することができる。 The present disclosure can be applied to a use of detecting a user operation performed on a video in a control device that provides the video. For example, in medical welfare such as support for the elderly, or an amusement such as a game, it is possible to provide an image that prompts the user for appropriate exercise.
 50  ユーザ
 50A  ユーザ
 50B  ユーザ
 50C  ユーザ
 50D  ユーザ
 50E  ユーザ
 100  表示制御システム
 110  パーソナルコンピュータ(PC)
 120  表示パネル
 130  静電容量センサ
 140  カメラ
 150  圧力センサ
 160  生体センサ
 170  クラウドサーバ
 180  ICカード
 200  GUI表示可能範囲
 200A  GUI表示可能範囲
 200B  GUI表示可能範囲
 200C  GUI表示可能範囲
 200D  GUI表示可能範囲
 200E  GUI表示可能範囲
 210  マーク
50 user 50A user 50B user 50C user 50D user 50E user 100 display control system 110 personal computer (PC)
DESCRIPTION OF SYMBOLS 120 Display panel 130 Capacitance sensor 140 Camera 150 Pressure sensor 160 Biosensor 170 Cloud server 180 IC card 200 GUI displayable range 200A GUI displayable range 200B GUI displayable range 200C GUI displayable range 200D GUI displayable range 200E GUI display Possible range 210 mark

Claims (8)

  1. 映像を提供する映像提供部と、
    前記映像に対して行われるユーザの操作を検出する操作検出部と、
    前記ユーザが存在する位置を検出する位置検出部と、
    (i)メモリに記録された前記ユーザの体格情報と、前記位置検出部により検出された位置とに基づいて、前記映像提供部に動的に提供させるGUI(グラフィカル・ユーザ・インターフェース)の表示可能範囲を決定し、(ii)前記決定された表示可能範囲内のいずれかの位置に前記GUIを示す映像を提供するよう前記映像提供部を制御する制御部と、を備えた制御装置。
    A video provider that provides video;
    An operation detection unit for detecting a user operation performed on the video;
    A position detection unit for detecting a position where the user exists;
    (I) Display of a GUI (graphical user interface) that is dynamically provided to the video providing unit based on the physique information of the user recorded in the memory and the position detected by the position detecting unit A control unit that determines a range, and (ii) controls the video providing unit to provide a video showing the GUI at any position within the determined displayable range.
  2. 前記制御部は、前記決定された表示可能範囲内において前記GUIを示す映像を提供する位置を、時間経過に応じて変化させるよう前記映像提供部を制御する、請求項1に記載の制御装置。 The control device according to claim 1, wherein the control unit controls the video providing unit so as to change a position where the video indicating the GUI is provided within the determined displayable range according to the passage of time.
  3. 前記制御部は、前記決定された表示可能範囲内の複数の位置に対して同時に前記GUIを示す映像を提供するよう前記映像提供部を制御する、請求項1に記載の制御装置。 The control device according to claim 1, wherein the control unit controls the video providing unit to simultaneously provide a video indicating the GUI for a plurality of positions within the determined displayable range.
  4. 前記制御部は、前記GUIを示す映像のうち、第1の条件で提供される映像を、前記第1の条件とは異なる第2の条件で提供される映像とは色及び形状の少なくともどちらかを異ならせるよう前記映像提供部を制御する、請求項1に記載の制御装置。 The control unit may be configured to display an image provided under a first condition among images indicating the GUI, and an image provided under a second condition different from the first condition is at least one of color and shape. The control device according to claim 1, wherein the video providing unit is controlled so as to differ.
  5. ユーザに操作させるための映像を提供する映像提供部と、
    前記映像に対して行われるユーザの操作を検出する操作検出部と、
    前記ユーザの操作とは異なる、前記ユーザの生体情報を検出する生体情報検出部と、
    前記映像を前記生体情報の変化に応じて変化させる制御部と
    を備えた制御装置。
    A video providing unit that provides a video for the user to operate;
    An operation detection unit for detecting a user operation performed on the video;
    A biometric information detection unit that detects biometric information of the user different from the user's operation;
    And a control unit configured to change the video according to the change of the biological information.
  6. 前記制御部は、前記生体情報の変化に応じて、前記映像の表示の位置、速度、及び数の内少なくとも1つを変化させる請求項5に記載の制御装置。 The control device according to claim 5, wherein the control unit changes at least one of a position, a speed, and a number of display of the video according to a change in the biological information.
  7. 前記生体情報は、脈拍数または心拍数である請求項5に記載の制御装置。 The control device according to claim 5, wherein the biological information is a pulse rate or a heart rate.
  8. 前記操作検出部は、タッチパネルである請求項5に記載の制御装置。 The control device according to claim 5, wherein the operation detection unit is a touch panel.
PCT/JP2015/006264 2015-03-05 2015-12-16 Control device WO2016139707A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015-043075 2015-03-05
JP2015043075 2015-03-05

Publications (1)

Publication Number Publication Date
WO2016139707A1 true WO2016139707A1 (en) 2016-09-09

Family

ID=56848085

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/006264 WO2016139707A1 (en) 2015-03-05 2015-12-16 Control device

Country Status (1)

Country Link
WO (1) WO2016139707A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009146364A (en) * 2007-12-18 2009-07-02 Sharp Corp Information posting device
JP2012103800A (en) * 2010-11-08 2012-05-31 Sharp Corp Display device
JP2012130565A (en) * 2010-12-22 2012-07-12 Sony Computer Entertainment Inc Signal processor, touch panel unit, information processor, and signal processing method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009146364A (en) * 2007-12-18 2009-07-02 Sharp Corp Information posting device
JP2012103800A (en) * 2010-11-08 2012-05-31 Sharp Corp Display device
JP2012130565A (en) * 2010-12-22 2012-07-12 Sony Computer Entertainment Inc Signal processor, touch panel unit, information processor, and signal processing method

Similar Documents

Publication Publication Date Title
KR102336601B1 (en) Method for detecting activity information of user and electronic device thereof
AU2013205245B2 (en) User terminal device and system for performing user customized health management, and methods thereof
KR102348489B1 (en) Electronic device and method for analyzing body components recognizable body measuring region automatically
US10359842B2 (en) Information processing system and information processing method
KR20170050878A (en) Electronic device and method for generating user profile
EP2276013A1 (en) Children s educational mat
CN107249441A (en) Electronic installation and method for measuring biological information
KR20170105569A (en) Medical Device Control
CN105745662A (en) Persistent user identification
KR101985438B1 (en) Smart Apparatus for Measuring And Improving Physical Ability
JP5715282B1 (en) Exercise support system, exerciser side device, and cloud server
WO2016040673A2 (en) Animation-based autism spectrum disorder assessment
JP2016174893A (en) Control device
US20200069222A1 (en) Image detection method and image detection device for determining position of user
JP2015225460A (en) Meal management method, meal management system, and meal management terminal
US9621847B2 (en) Terminal, system, display method, and recording medium storing a display program
JP2023527717A (en) Systems and methods for monitoring user activity
US20160274663A1 (en) Control apparatus
WO2016139707A1 (en) Control device
JP2019058285A (en) Activity support method, program, and activity support system
US11257246B2 (en) Image detection method and image detection device for selecting representative image of user
US11087157B2 (en) Image detection method and image detection device utilizing dual analysis
KR102369103B1 (en) Method and Apparatus for User Information Processing
KR20180040410A (en) Body composition apparatus and mobile terminal wireless communcating with the same
KR101409345B1 (en) Method for supplying medical information

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15883877

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: JP

122 Ep: pct application non-entry in european phase

Ref document number: 15883877

Country of ref document: EP

Kind code of ref document: A1