TWI828115B - Interactive electronic device and controlling method thereof - Google Patents

Abstract

An interactive electronic device and a controlling method thereof are provided. The interactive electronic device includes a main body, a mirror body, a display device, a first camera, a second camera, and a processor. The display device displays information of a display area through the mirror body. The first camera and the second camera are disposed on the main body at different heights. The first camera and the second camera detect a pose of a user. The processor modifies a location of the display area, a size of the display area, and an arrangement of the information displayed on the display device, based on the detected pose. The pose is divided into a first pose and a second pose. A head of the user with the first pose is higher than a default height. The head of the user with the second pose is lower than the default height.

Description

Interactive electronic device and control method thereof

The present invention relates to an electronic device and a control method thereof, and in particular to an interactive electronic device capable of dynamically adjusting a display screen and a control method thereof.

With the advancement of science and technology, sports equipment is not limited to devices used by itself. Current sports equipment also includes electronic devices that provide audio-visual or online interactive functions. For example, fitness mirrors (or sports mirrors) can not only reflect the images of athletes, but also display instructional videos for exercise. However, when the athlete's range of motion is too large, the athlete cannot watch his or her own exercise images or/and/or the displayed instructional videos through the fitness mirror, making the athlete unable to determine the correctness of the movements.

The present invention provides an interactive electronic device that can dynamically adjust the display screen in response to the movements of the athlete.

The interactive electronic device of the present invention includes a body, a mirror body, a display device, a first camera, a second camera and a processor. The mirror body is arranged on one side of the main body. The mirror body presents a virtual image corresponding to the user. The display device is arranged behind the mirror body. The display device is used to present information in the display area through the mirror. The first camera and the second camera are arranged at different heights on the body. The processor is coupled to the display device, the first camera and the second camera. The first camera and the second camera detect the user's posture, and the processor adjusts the position of the display area, the size of the display area, and the arrangement of information in the display device according to the detected posture. The posture is divided into a first posture and a second posture. In the first posture, the user's head is higher than the preset height. In the second posture, the user's head is lower than the preset height.

An embodiment of the present invention further provides a control method for an interactive electronic device. The control method includes the following steps: detecting the posture of the user located in front of the interactive electronic device through a first camera and a second camera, wherein the first camera and the second camera are arranged at different heights on the interactive electronic device; and, The position of the display area, the size of the display area, and the arrangement of information in the display device are adjusted according to the detected posture. The posture is divided into a first posture and a second posture. In the first posture, the user's head is higher than the preset height. In the second posture, the user's head is lower than the preset height.

Based on the above, the interactive electronic device and its control method according to the embodiment of the present invention can detect the user's posture through multiple cameras (such as the first camera and the second camera) arranged at different heights, and can detect the user's posture according to the posture. The display screen of the display device is correspondingly adjusted according to the difference (for example, the first posture or the second posture).

Some embodiments of the present invention will be described in detail with reference to the accompanying drawings. The component symbols cited in the following description will be regarded as the same or similar components when the same component symbols appear in different drawings. These embodiments are only part of the present invention and do not disclose all possible implementations of the present invention. Rather, these embodiments are only examples within the scope of the patent application of the invention.

FIG. 1A is a block diagram of an interactive electronic device according to an embodiment of the invention. FIG. 1B is a schematic diagram of an interactive electronic device according to an embodiment of the present invention. The interactive electronic device 100 of this embodiment can be applied to fitness exercises and provided to users and/or coaches for use. The interactive electronic device 100 is, for example, a fitness mirror.

Referring to FIG. 1A and FIG. 1B , in this embodiment, the interactive electronic device 100 includes a body 110 , a mirror 120 , a display device 130 , a first camera 140 , a second camera 150 and a processor 160 . In this embodiment, the body 110 may be a housing housing various components of the interactive electronic device 100 . The appearance shape of the body 110 in the embodiment of FIG. 1B is only an example and is not limited thereto.

In this embodiment, the mirror body 120 is disposed on one side of the main body 110 . The mirror body 120 presents a virtual image corresponding to the user. In some embodiments, the mirror body 120 is, for example, a plane mirror, a concave mirror, a convex mirror, or other similar mirrors or a combination of these mirrors, which can reflect the user and present a corresponding virtual image.

In this embodiment, the display device 130 is disposed on one side of the body 110 , and the display device 130 is disposed behind the mirror body 120 . The display device 130 displays information in the display area through the lens 120 . In some embodiments, the display device 130 is, for example, a liquid crystal display (LCD), a light-emitting diode (LED), an organic light-emitting diode (OLED), etc. A display device that displays a function.

In this embodiment, the first camera 140 and the second camera 150 are disposed at different heights on the body 110 . Specifically, in the embodiment shown in FIG. 1B , the first camera 140 is disposed in the body 110 below the mirror body 120 , so the first camera 140 can be called a lower lens or a lower lens module. The second camera 150 is disposed in the body 110 above the mirror body 120, so the second camera 150 can be called an upper lens or an upper lens module. In this embodiment, the first camera 140 and the second camera 150 can detect the user's posture simultaneously or non-simultaneously. In some embodiments, the first camera 140 and the second camera 150 have the same structure and functional configuration. The installation positions of the first camera 140 and the second camera 150 in the embodiment of FIG. 1B are only examples and are not limited thereto.

In this embodiment, the processor 160 is provided in the body 110 . The processor 160 is coupled to the display device 130, the first camera 140 and the second camera 150. In some embodiments, the processor 160 is, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose microprocessor (Microprocessor), digital signal processor (Digital Signal Processor) , DSP), programmable controller, Application Specific Integrated Circuits (ASIC), Programmable Logic Device (PLD) or other similar devices or combinations of these devices, which can be loaded and execute computer programs.

In this embodiment, the first camera 140 and/or the second camera 150 are used to capture the user. The processor 160 analyzes the image to confirm the user's posture. The processor 160 adjusts the display device 130 according to the detected posture. The position of the display area, the size of the display area, and the arrangement of the information in the display area. That is to say, the processor 160 can adjust the display screen of the display device 130 according to the user's current posture.

It should be noted that the user's posture can be divided into a first posture and a second posture. In this embodiment, the first posture may be called a high posture, and the second posture may be called a low posture. Specifically, relative to the ground (or the bottom of the body 110), the user's head in the first posture is higher than a preset height (for example, 100 cm), and in the second posture, the user's head is lower than the preset height. Set height. The description of the first posture and the second posture in this embodiment is only an example and is not limited thereto. In this embodiment, the preset height is, for example, the user's viewing height.

It is worth mentioning here that the interactive electronic device 100 can detect the user's posture through multiple cameras (such as the first camera 140 and the second camera 150 ) arranged at different heights, and can detect the user's posture according to different postures. (for example, a high posture or a low posture) to adjust the display screen of the display device 130 accordingly. In this way, even when the user's movement range is very large, the user can watch his/her own movement scenes or/and instructional videos through the display device 130 with the adjusted display screen, thereby having a good interactive experience.

Please refer to FIG. 1A and FIG. 1B again. In this embodiment, the interactive electronic device 100 also includes a non-visible light sensor 170, a transmission module 180 and a cloud server 190.

In this embodiment, the non-visible light sensor 170 is coupled to the processor 160 . Relative to the first camera 140 and the second camera 150 , the invisible light sensor 170 is disposed at different heights on the body 110 . Specifically, in the embodiment shown in FIG. 1B , relative to the ground (or the bottom of the body 110 ), the non-visible light sensor 170 is disposed in the body 110 equal to a preset height, and the first camera 140 is disposed at a lower height. in the body 110 at a preset height, and the second camera 150 is disposed in the body 110 at a height higher than the preset height. In this embodiment, the non-visible light sensor 170 can detect the user's posture simultaneously or non-simultaneously with the first camera 140 and/or the second camera 150 . In some embodiments, the non-visible light sensor 170 may be, for example, an infrared camera (IR Camera).

In this embodiment, the non-visible light sensor 170 and the first camera 140 and/or the second camera 150 are used to photograph the user for analysis and confirmation by the processor 160 in detecting the user's posture. The detected posture is used to determine what the user's posture is, such as the first posture (ie, high posture) or the second posture (ie, low posture).

It should be noted that the height of the non-visible light sensor 170 is between the locations where the first camera 140 and the second camera 150 are installed. Therefore, at a specific height (for example, a preset height), the non-visible light sensor 170 It can emit infrared rays and receive corresponding infrared ray detection signals, so that the processor 160 determines whether the user's posture is higher than a preset height based on the infrared ray detection signals, thereby assisting in determining what the user's posture is.

In this embodiment, the transmission module 180 is coupled to the processor 160 and the cloud server 190 . The processor 160 can transmit the calculated data (including detected gestures, etc.) to the cloud server 190 through the transmission module 180 . The processor 160 can receive information (such as teaching videos and other display data) from the cloud server 190 through the transmission module 180, and provide the information to the display device 130 for playback.

In some embodiments, the transmission module 180 may support global system for mobile communication (GSM), personal handy-phone system (PHS), code division multiple access (code division multiple access) , CDMA) system, wideband code division multiple access (WCDMA) system, long term evolution (LTE) system, global interoperability for microwave access (WiMAX) system, wireless security True (wireless fidelity, Wi-Fi) system or Bluetooth signal transmission components.

2A to 2C are schematic diagrams of the operation of the interactive electronic device according to the embodiment of the present invention. The interactive electronic device 100 shown in FIGS. 2A to 2C can be deduced by referring to the relevant description of the interactive electronic device 100 shown in FIG. 1 .

Referring to FIG. 2A , in this embodiment, assuming that the user 105 is located in front of the interactive electronic device 100 and is in a standing state, the interactive electronic device 100 senses light through the first camera 140 , the second camera 150 and/or non-visible light. The device 170 is used to detect the gesture of the user 105.

Specifically, in this embodiment, the interactive electronic device 100 obtains the user image through at least one of the first camera 140 , the second camera 150 and the non-visible light sensor 170 . The processor 160 receives and analyzes the user image to determine the corresponding position of the user 105's body shape, face or eyes, thereby determining that the user 105 is in the first posture (for example, standing posture 107-1).

It should be noted that in this embodiment, the non-visible light sensor 170 has a preset height H1, so the infrared rays emitted by the non-visible light sensor 170 are shielded by the user 105. In this way, the processor 160 can determine that the user 105 is in the first posture based on the detection signal. In addition, the processor 160 can further determine that the first posture is the standing posture 107-1 based on the image detected by the first camera 140.

In this embodiment, the processor 160 drives the display device 130 according to the gesture determination result. Specifically, in this embodiment, the display device 130 plays the training image corresponding to the first posture (for example, the standing posture 107-1) as the information of the display area 135-1, and presents the training image on the display device 130 in the display area 135-1. Therefore, the user 105 can view the corresponding training image in the display area 135-1 in the standing posture 107-1. The training images in this embodiment can be not only freeze-frame photos, but also audio-visual materials such as videos.

Referring to FIG. 2B , in this embodiment, assuming that the user 105 is located in front of the interactive electronic device 100 and is in a squatting state, the operation of the interactive electronic device 100 shown in FIG. 2B can refer to the operation of the interactive electronic device 100 shown in FIG. 2A Related explanations are provided by analogy.

The operation of the interactive electronic device 100 in FIG. 2B is different from the embodiment in FIG. 2A in that the processor 160 receives and analyzes the user image to determine the corresponding position of the user 105's body shape, face or eyes, thereby determining the user's identity. 105 is in a second posture (for example, a squatting posture 107-2, or a lower movement posture such as lying down).

It should be noted that in this embodiment, since the height of the user 105 is lower than the preset height H1, the infrared rays emitted by the non-visible light sensor 170 are not shielded by the user 105. In this way, the processor 160 can determine that the user 105 is in the second posture based on the detection signal. In addition, the processor 160 can further determine that the second posture is the squatting posture 107-2 based on the image detected by the second camera 150.

Another difference between this embodiment and the embodiment of FIG. 2A is that the display device 130 plays the training image corresponding to the second posture (for example, the squatting posture 107-2) as the information of the display area 135-2, and the training image is The image is presented in the display area 135-2 in the display device 130, not in the display area 135-1. Therefore, the user 105 can view the corresponding training images in the display area 135-2 in the squatting posture 107-2, so the user 105 will not be unable to view the training images due to different postures.

Referring to FIG. 2C , in this embodiment, assuming that the user 105 is located in front of the interactive electronic device 100 and is in a lying state, the operation of the interactive electronic device 100 shown in FIG. 2B may refer to the interactive electronic device shown in FIG. 2A or 2B . The relevant description of the device 100 can be deduced by analogy.

The operation of the interactive electronic device 100 in Figure 2C is different from the embodiment in Figure 2B in that the processor 160 can further determine that the second posture is the lying posture 107-3 based on the image detected by the second camera 150. In addition, the display device 130 plays the training image corresponding to the second posture (for example, the lying posture 107-3) as the information of the display area 135-3, and presents the training image in the display area 135-3 of the display device 130. 3, rather than in display area 135-1. Therefore, the user 105 can view the corresponding training image in the display area 135-3 in the lying position 107-3.

FIG. 3 is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. The interactive electronic device 100 shown in FIG. 3 can be deduced by referring to the relevant descriptions of the interactive electronic device 100 shown in FIGS. 1 to 2C .

Referring to FIG. 3 , in this embodiment, the bottom of the interactive electronic device 100 is against the ground, and the length of the interactive electronic device 100 is, for example, 180 centimeters. The preset height H1 of the interactive electronic device 100 is, for example, 100 centimeters. The non-visible light sensor 170 is set at the preset height H1 so that the processor 160 can initially determine the user 105 based on the emitted infrared rays. Is in the first position or the second position. The processor 160 can also analyze the corresponding position of the body shape, face or eyes of the user 105 based on the images captured by the first camera 140 and/or the second camera 150 to further determine whether the user 105 is in a standing posture 107 -1. Squatting position 107-2 or lying down position 107-3.

In this embodiment, when the user 105 is in the first posture (for example, standing posture 107-1), the user 105 has a height H2 (for example, greater than 100 centimeters) higher than the preset height H1 relative to the ground. Since the infrared rays emitted by the non-visible light sensor 170 are shielded by the user 105, the processor 160 determines that the user 105 is in the first posture.

Continuing with the above description, the first camera 140 is driven to detect the user 105 so that the processor 160 determines whether the eye height of the user 105 is higher than the preset height H1 based on the detected image. When the eye height of the user 105 is higher than the preset height H1, the processor 160 determines that the user 105 is in the standing posture 107-1. On the other hand, when the eye height of the user 105 is not higher than the preset height H1, the processor 160 determines that the user 105 is in the second posture.

In this embodiment, when the user 105 is in the second posture (for example, the squatting posture 107-2), the user 105 has a height H3 (for example, less than 100 centimeters) lower than the preset height H1 relative to the ground. Since the infrared rays emitted by the non-visible light sensor 170 will not be blocked by the user 105, the processor 160 determines that the user 105 is in the second posture.

Continuing with the above description, the second camera 150 is driven to detect the user 105 so that the processor 160 determines whether the eye height of the user 105 is higher than the preset height H1 based on the detected image. When the eye height of the user 105 is lower than the preset height H1, the processor 160 determines that the user 105 is in the squatting posture 107-2. On the other hand, when the eye height of the user 105 is not lower than the preset height H1, the processor 160 determines that the user 105 is in the first posture.

FIG. 4 is a flow chart of a control method of an interactive electronic device according to an embodiment of the present invention. Referring to FIG. 2A and FIG. 4 , the interactive electronic device 100 can perform the following steps S410 to S480 so that the interactive electronic device 100 can implement an interactive display function based on the captured real-time image (or video).

In step S410, the interactive electronic device 100 presents the main page (eg, user interface) in the display area 135-1. When the user 105 operates the main page through the display area 135-1, the user 105 can select the course exercise therein. In step S420, the interactive electronic device 100 presents the selected course movement in the display area 135-1.

In step S430, the interactive electronic device 100 detects the height of the user 105 through the invisible light sensor 170. In step S440, the interactive electronic device 100 determines whether the infrared ray emitted by the non-visible light sensor 170 is shielded through the processor 160 to determine whether the height of the user 105 is higher than the preset height H1. When the infrared ray emitted by the non-visible light sensor 170 is shielded, it means that the height of the user 105 may be higher than the preset height H1, and step S450 is continued. On the contrary, when the infrared ray emitted by the non-visible light sensor 170 is not shielded, it means that the height of the user 105 is lower than the preset height H1, and step S460 is continued.

In step S450, the processor 160 drives the first camera 140 to turn on the first camera 140. The first camera 140 detects the user 105, so that the processor 160 adjusts the display area 135-1 according to the detected result until the course movement ends. On the other hand, in step S460, the processor 160 drives the second camera 150 to turn on the second camera 150. As shown in the embodiment of FIG. 2B , the second camera 150 detects the user 105 so that the processor 160 adjusts the display area 135 - 2 according to the detected result until the course movement ends.

In step S470, the processor 160 determines whether the course exercise ends based on at least one of the played course exercise file and the results detected by the first camera 140 and/or the second camera 150. When the course exercise ends, step S480 is executed to end the interactive display function. On the contrary, when the course exercise has not ended, return to step S440.

FIG. 5 is a flow chart of a control method of an interactive electronic device according to an embodiment of the present invention. Referring to FIG. 2A and FIG. 5 , the interactive electronic device 100 can perform the following steps S510 to S570 so that the interactive electronic device 100 can implement an interactive display function according to the played image (or video).

In step S510, the interactive electronic device 100 presents the main page (eg, user interface) in the display area 135-1. When the user 105 operates the main page through the display area 135-1, the user 105 can select the course exercise therein. In step S520, the interactive electronic device 100 presents the selected course exercise in the display area 135-1.

In step S530, the interactive electronic device 100 uses the processor 160 to analyze the image of the coach according to the currently played course movement file to determine the corresponding position of the coach's body shape, face or eyes, thereby determining the position of the coach in the course movement. The instructor's posture is either in the first position or in the second position. When the coach's posture is in the first posture (for example, the standing posture 107-1), it means that the user 105 should also be in the corresponding first posture, and step S540 is continued. On the contrary, when the coach's posture is in the second posture (for example, the squatting posture 107-2 shown in Figure 2B or the lying posture 107-3 shown in Figure 2C), it means that the user 105 should also be in the second posture, and Continue to step S550.

In step S540, the processor 160 drives the first camera 140 to turn on the first camera 140. The first camera 140 detects the user 105, so that the processor 160 adjusts the display area 135-1 according to the detected result until the course movement ends. On the other hand, in step S550, the processor 160 drives the second camera 150 to turn on the second camera 150. As shown in the embodiment of FIG. 2B , the second camera 150 detects the user 105 so that the processor 160 adjusts the display area 135 - 2 according to the detected result until the course movement ends.

In step S560, the processor 160 determines whether the course exercise ends based on at least one of the played course exercise file and the results detected by the first camera 140 and/or the second camera 150. When the course exercise ends, step S570 is executed to end the interactive display function. On the contrary, when the course exercise has not ended, return to step S530.

6A to 6B are operational schematic diagrams of the interactive electronic device according to the embodiment of the present invention. The interactive electronic device 100 shown in FIGS. 6A and 6B can be deduced by analogy with reference to the relevant description of the interactive electronic device 100 shown in FIGS. 2A and 2B .

Referring to FIG. 6A and FIG. 6B , in this embodiment, when the user 105 changes from the first posture (for example, standing posture 107-1) to the second posture (for example, squatting posture 107-2), the processor 160 moves The display device 130 is positioned to correspondingly adjust the display area 135-1 to the display area 135-2. That is to say, after the interactive electronic device 100 determines the posture of the user 105, the interactive electronic device 100 moves the display area 135-1 or 135-2 to an appropriate position according to the current posture 107-1 or 107-2. .

FIG. 7A is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. The interactive electronic device 100 shown in FIG. 7A can be deduced by referring to the relevant description of the interactive electronic device 100 shown in FIG. 2A . FIG. 7B is a structural diagram of the interactive electronic device according to the embodiment of FIG. 7A of the present invention. In order to facilitate the explanation of the content of this case, the embodiment of FIG. 7B omits some components and illustrates it with a side cross-sectional view of the interactive electronic device 100.

Referring to FIGS. 7A and 7B , in this embodiment, when the user 105 is in the first posture (for example, standing posture 107 - 1 ), the first camera 140 is driven to detect the user 105 . In this embodiment, the first camera 140 is suitable for motion in the first posture (for example, the standing posture 107-1). It should be noted that the detection range of the first camera 140 can cover the entire height of the user 105 when standing.

In this embodiment, the first camera 140 is disposed on the first lens mount 141 and is fixed in the first lens mount 141 . The first camera 140 is parallel to the horizontal line L1 and perpendicular to the mirror body 120 . Specifically, the angle between the first camera 140 and the horizontal line L1 is 0 degrees. That is to say, the image capturing angle of the first camera 140 is a horizontal image capturing angle. In this embodiment, the field of view (Field of View, FOV) of the first camera 140 may be, for example, 130 degrees.

FIG. 8A is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. The interactive electronic device 100 shown in FIG. 8A can be deduced by referring to the relevant description of the interactive electronic device 100 shown in FIG. 2C . FIG. 8B is a structural diagram of the interactive electronic device according to the embodiment of FIG. 8A of the present invention. In order to facilitate the description of the present application, the embodiment of FIG. 8B omits some components and illustrates it with a side cross-sectional view of the interactive electronic device 100.

Referring to FIGS. 8A and 8B , in this embodiment, when the user 105 is in the second posture (for example, the lying posture 107 - 3 ), the second camera 150 is driven to detect the user 105 . In this embodiment, the second camera 150 is suitable for motion in the second posture (for example, the lying posture 107-3 or the squatting posture 107-2 shown in FIG. 2B). It should be noted that the detection range of the second camera 150 can cover the entire body height of the user 105 when squatting or lying on the ground.

In this embodiment, the second camera 150 is disposed on the second lens mounting base 151 and is fixed in the second lens mounting base 151 . The second camera 150 is not parallel to the horizontal line L1 and the mirror body 120 . An included angle TH is formed between the second camera 150 and the horizontal line L1, that is, between the reference line L2 and the horizontal line L1, where the included angle TH may be an acute angle or an obtuse angle. That is to say, the image capturing angle of the second camera 150 is to capture images diagonally downward. In this embodiment, the field of view (FOV) of the second camera 150 may be, for example, 90 degrees.

FIG. 9 is an exploded view of an interactive electronic device according to an embodiment of the present invention. The interactive electronic device 100 shown in FIG. 9 can be deduced by referring to the relevant description of the interactive electronic device 100 shown in FIG. 1 . In order to facilitate the explanation of the content of this case, some components are omitted in the embodiment of FIG. 9 .

Referring to FIG. 9 , in this embodiment, the mirror body 120 of the interactive electronic device 100 includes a coated glass 121 , a front frame metal part 122 and a supporting metal part 123 . The front frame metal piece 122 is connected to the frame of the coated glass 121 . The front frame metal part 122 and the coated glass 121 are fixedly installed in the supporting metal part 123 . In this embodiment, the lens masks 152 of the first camera 140 , the second camera 150 and the second camera 150 are respectively embedded in the supporting metal parts 123 .

In this embodiment, the interactive electronic device 100 also includes an electric motor 111, a motor shaft 112, a tension belt 113, a component configuration box 114, a display limit slide 115, a horn fastener 116, a horn hole groove 117 and a back. Cover 118. The body 110 is formed between the back cover 118 and the supporting metal member 123 to provide the aforementioned components 121 to 123, 130, 140, 150 to 152, and 111 to 117.

In this embodiment, the electric motor 111 , the motor shaft 112 and the tension belt 113 are arranged on the upper half of the body 110 . The electric motor 111 , the motor shaft 112 and the tension belt 113 can be called moving mechanisms and are controlled by the processor 160 . In this embodiment, the processor 160 controls the moving mechanism to adjust the position of the display device 130 relative to the body 100 according to the detected posture, thereby adjusting the position of the display area and the image presentation angle. It should be noted that the interactive electronic device 100 can adjust the display screen of the display device 130 through mechanical operation.

Specifically, as shown in the enlarged view of FIG. 3 , one end of the motor shaft 112 is connected to the electric motor 111 . The tension belt 113 is looped around the motor shaft 112 and connected to the display device 130 . The electric motor 111 can drive the motor shaft 112 to rotate in the direction of arrow C1, so that the tension belt 113 drives the display device 130 to move in the direction of arrow C2.

In this embodiment, the display limiting slide rails 115 are provided on both sides of the body 110 . Two long sides of the display device 130 may be disposed in the display limiting slide rail 115 . The display device 130 can move up and down in the display limiting slide rail 115 (ie, the direction of arrow C2).

In this embodiment, the component configuration box 114 , the horn fastener 116 and the horn hole slot 117 are provided in the lower half of the body 110 . The horn fastener 116 and the horn hole groove 117 are engaged with each other and fixedly arranged on the edge of the component configuration box 114 . In this embodiment, the component configuration box 114 , the speaker fastener 116 and the speaker hole slot 117 are also connected to the display device 130 to serve as a speaker to output voice data corresponding to the image (or video) played by the display device 130 .

In this embodiment, the display device 130 is disposed behind the coated glass 121 . The display device 130 is disposed between the supporting metal member 123 and the back cover 118, and has space to move up and down.

10A to 10C are structural diagrams of the interactive electronic device according to the embodiment of FIG. 9 of the present invention. The interactive electronic device 100 shown in FIGS. 10A to 10C can be deduced by referring to the relevant description of the interactive electronic device 100 shown in FIG. 9 . In order to facilitate the description of the present invention, some components are omitted in the embodiment of FIG. 10A to FIG. 10C .

Referring to FIGS. 9 to 10C , the interactive electronic device 100 is shown in FIG. 10A from the front and at an angle of 45 degrees. The interactive electronic device 100 is shown from the front in FIG. 10B . The interactive electronic device 100 is shown from the side in FIG. 10C .

In this embodiment, the speakers 211-1 and 211-2, a printed circuit board (PCB) 212, and a subwoofer (Subwoofer) 213 may be included in the component configuration box 114. The speakers 211-1, 211-2 and the subwoofer 213 are coupled to the printed circuit board 212. The printed circuit board 212 is coupled to the display device 130 . In this embodiment, the speakers 211-1 and 211-2 may be 15W speakers and serve as left-channel speakers and right-channel speakers respectively.

It should be noted that point P1 shown in FIG. 10B is the center point of the display device 130. When the electric motor 111 drives the display device 130 through the tension belt 113, the point P1 can move downward for a certain distance. In this embodiment, the maximum moving distance of point P1 is limited by the size of the display device 130 and the size of the body 110 . For example, if the display device 130 is 32 inches, the maximum moving distance of the point P1 may be 310 mm.

In this embodiment, the interactive electronic device 100 further includes a control circuit board 220, an extension cord circuit 230, and an adapter 240. The control circuit board 220 , the extension circuit 230 and the adapter 240 are embedded in the side of the body 110 . The extension circuit 230 and the adapter 240 are coupled to the control circuit board 220 . The control circuit board 220 is also coupled to at least one of the printed circuit board 212, the electric motor 111, the first camera 140, the second camera 150, and the display device 130.

In this embodiment, the control circuit board 220 may be an Arduino power circuit. In this embodiment, the adapter 240 may include a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (Universal Serial Bus, USB) 3 and a Type-C (USB-C) interface. Three-in-one adapter.

11A to 11C are schematic diagrams of the operation of the interactive electronic device according to the embodiment of the present invention. The interactive electronic device 100 shown in FIGS. 11A to 11C can be deduced by analogy with reference to the relevant description of the interactive electronic device 100 shown in FIGS. 2A to 2C .

Referring to FIG. 11A , in this embodiment, when the user 105 is in the first posture (for example, standing posture 107 - 1 ), the processor 160 can adjust the display area 135 - 1 to occupy the visible area 131 in the display device 130 . That is to say, the training image played in the display area 135-1 overlaps with the visible area 131 for viewing by the user 105.

Referring to FIG. 11B , the operation of the interactive electronic device 100 in FIG. 11B is different from the embodiment in FIG. 11A in that when the user 105 is in the second posture (for example, squatting posture 107 - 2 ), the processor 160 can adjust the display area. 135-2. Specifically, the processor 160 may divide the non-display area 132 in the visible area 131 . In this embodiment, the area of the visible area 131 and the area of the display area 135-2 have an equal proportional relationship. That is to say, the viewable area 131 can be scaled with a fixed aspect ratio (ie, equal proportions) to form the viewable area 131 and the non-display area 132 in the display device 130 . In this embodiment, the processor 160 may present information in the display area 135 - 2 (ie, the visible area 131 ) other than the non-display area 132 for the user 105 to view.

Referring to FIG. 11C , the operation of the interactive electronic device 100 in FIG. 11C is different from the embodiment in FIG. 11A in that when the user 105 is in the second posture (for example, the lying posture 107 - 3 ), the processor 160 can adjust the display Area 135-3. The interactive electronic device 100 shown in FIG. 11C can be deduced by referring to the relevant description of the interactive electronic device 100 shown in FIG. 11B .

It should be noted that when the posture of the user 105 changes from the standing posture 107-1 to the squatting posture 107-2 or the lying posture 107-3, the processor 160 can correspondingly change the display area according to the determined current posture. The training image played in 135-1 is zoomed into the visible area 131 in the display area 135-2, or zoomed into the visible area 131 in the display area 135-3. On the other hand, when the posture of the user 105 changes from the squatting posture 107-2 or the lying posture 107-3 to the standing posture 107-1, the processor 160 can adjust the size of the visual area 131 accordingly, and can refer to the aforementioned The relevant description of the implementation manner is analogized.

12A to 12C are schematic diagrams of display areas according to embodiments of the present invention. Referring to FIG. 12A, in this embodiment, the display area 135-1 may be applied to the display area 135-1 of the FIG. 11A embodiment. In this embodiment, the display area 135-1 includes a user parameter information area 311, a coach teaching video area 312, and a camera shooting screen area 313. The number, size and configuration of the user parameter information area 311, the coaching video area 312 and the camera shooting screen area 313 in this embodiment are only examples and are not limited thereto.

In this embodiment, the user parameter information area 311 can present basic information about the user, such as current cardiorespiratory endurance information and personal information. The coach teaching video area 312 can present videos of course movements recorded by the coach or live broadcast. The camera capture frame area 313 may present a real-time video of the user 105 captured by at least one of the first camera 140 , the second camera 150 and the non-visible light sensor 170 .

Referring to FIG. 12B, in this embodiment, the display area 135-2 may be applied to the display area 135-2 of the FIG. 11B embodiment. The difference between the embodiment of Figure 12B and the embodiment of Figure 12A is that the user parameter information area 311, the coach teaching video area 312 and the camera shooting screen area 313 in the display area 135-1 are reduced in equal proportions and presented in the visible area. 131 in. In the display area 135-2, other areas of the visible area 131 are excluded to form a non-display area 132.

Referring to Figures 12A and 12B, when the display area 135-1 is converted to the display area 135-2, it means that the user 105 changes from the standing posture 107-1 (refer to Figure 11A) to the squatting posture 107-2 (refer to Figure 11B). In this embodiment, the processor 160 can proportionally scale the user parameter information area 311, the coach teaching video area 312, and the camera shooting screen area 313 in the display area 135-1 to adjust the position and display of the display area 135-1. The size of the area 135-1 is adjusted to the visible area 131 in the display area 135-2.

It should be noted that compared to the display area 135-1, the user parameter information area 311, the coach teaching video area 312, and the camera shooting screen area 313 in the display area 135-2 have been reduced in equal proportions, and in the same manner. configuration is moved down. Therefore, the user 105 in the squatting position 107-2 can view the information presented in the user parameter information area 311, the coach teaching video area 312, and the camera shooting screen area 313 in the visible area 131. That is to say, the interactive electronic device 100 can adjust the display screen of the display device 130 through software operation.

Referring to FIG. 12C, in this embodiment, the display area 135-3 may be applied to the display area 135-3 of the FIG. 11C embodiment. The difference between the embodiment of Fig. 12C and the embodiment of Fig. 12A is that the user parameter information area 311, the coach teaching video area 312 and the camera shooting screen area 313 in the display area 135-1 are not only reduced in proportion but also presented in In the visible area 131, the arrangement thereof is also changed. In this embodiment, the size of the user parameter information area 311 is reduced. The size of the coaching video area 312 is reduced and moved below the user parameter information area 311 . The size of the camera shooting frame area 313 is reduced and moved to the right of the user parameter information area 311 and the coach teaching video area 312 .

On the other hand, another difference between the embodiment of FIG. 12C and the embodiment of FIG. 12A is that other areas of the visible area 131 are excluded from the display area 135 - 3 to form a non-display area 132 . In addition, the arrangement position and size of the non-display area 132 in the embodiment of FIG. 12C are different from the non-display area 132 in the embodiment of FIG. 12B.

Referring to Figures 12A and 12C, when the display area 135-1 is converted to the display area 135-3, it means that the user 105 changes from the standing posture 107-1 (refer to Figure 11A) to the lying posture 107-3 (refer to Figure 11C). In this embodiment, the processor 160 can adjust the configuration position and size of the user parameter information area 311, the coach teaching video area 312 and the camera shooting frame area 313 to adjust the arrangement of the information, and adjust the display area 135-1 to display Viewable area 131 in area 135-3.

It should be noted that compared with the display area 135-1, the user parameter information area 311, the coach teaching video area 312, and the camera shooting screen area 313 in the display area 135-3 are reduced and rearranged, and in different ways. configuration is moved down. Therefore, the user 105 in the lying position 107-3 can view the information presented in the user parameter information area 311, the coach teaching video area 312, and the camera shooting screen area 313 in the visible area 131.

FIG. 13A is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. The interactive electronic device 100 shown in FIG. 13A can be deduced by referring to the relevant description of the interactive electronic device 100 shown in FIG. 1 . Figure 13B is a schematic diagram of the display area of the embodiment of Figure 13A of the present invention.

Referring to FIGS. 13A to 13B , in this embodiment, the first camera 140 and the second camera 150 can be driven to detect the posture of the user 105 simultaneously. It should be noted that the first camera 140 and the second camera 150 synchronously capture images of the user 105 at different angles. Therefore, the processor 160 can capture the images captured by the first camera 140 and the second camera 150 . Image processing is performed to form a three-dimensional image as shown in Figure 13B. Therefore, the user 105 can view his own three-dimensional image through the display device 130 .

FIG. 14 is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. The interactive electronic device 100 shown in FIG. 14 can be deduced by referring to the relevant description of the interactive electronic device 100 shown in FIG. 1 .

Referring to FIG. 14 , in this embodiment, the first camera 140 and the second camera 150 can be driven in turn to detect the posture of the user 105 at different times. It should be noted that the first camera 140 or the second camera 150 can capture images of multiple users 105-1, 105-2, so that the processor 160 performs corresponding operations. Therefore, the interactive electronic device 100 can be provided for multiple people to use at the same time.

FIG. 15 is a flowchart of a control method for an interactive electronic device according to an embodiment of the present invention. Referring to FIG. 11A, 11B and FIG. 15, the interactive electronic device 100 can perform the following steps S1510~S1580, so that the interactive electronic device 100 realizes the interactive display function.

In step S1510, the interactive electronic device 100 detects the posture of the user 105 located in front of the interactive electronic device 100 through the first camera 140 and the second camera 150. In step S1520, the processor 160 adjusts the position of the display area 135-1 or 135-2 in the display device 130, the size of the display area 135-1 or 135-2, and the display area 135-1 or 135-2 according to the detected posture. 2 arrangement of information. When the user 105 is in the first posture (for example, the standing posture 107-1 shown in FIG. 11A), step S1530 is executed. When the user 105 is in the second posture (for example, the squatting posture 107-2 shown in FIG. 11B), step S1540 is executed.

In step S1530, the processor 160 drives the display device 130 and the first camera 140 so that the display device 130 plays the first posture training image corresponding to the first posture, and captures the current image of the user 105 through the first camera 140 and The current image is presented in the display area 135-1 of the display device 130.

Continuing step S1530, in step S1550, the processor 160 determines whether the posture changes from the first posture to the second posture based on at least one of the current image of the user 105 and the first posture training image. When the first posture changes to the second posture, step S1570 is continued. On the contrary, when the first posture does not change to the second posture, it means that the posture is maintained at the first posture, and the process returns to step S1530.

In step S1570, when the detected posture changes from the first posture (for example, the standing posture 107-1 shown in Figure 11A) to the second posture (for example, the squatting posture 107-2 shown in Figure 11B) and the display device 130 is When playing the first posture training image, the processor 160 drives the display device 130 so that the display device 130 displays the first warning message to inform the user 105 and pauses the playback of the first posture training image, or plays the corresponding second posture training image from the beginning. Second pose training images for poses. In this embodiment, the first warning information may be countdown seconds information, or voice reminder information to remind that the next action belongs to the second gesture.

Following step S1540, in step S1560, the processor 160 determines whether the posture changes from the second posture to the first posture based on at least one of the current image of the user 105 and the second posture training image. When the second posture changes to the first posture, step S1580 is continued. On the contrary, when the first posture does not transform into the second posture, it means that the posture is maintained at the first posture, and the process returns to step S1540.

In step S1580, when the detected posture changes from the second posture (for example, the squatting posture 107-2 shown in Figure 11B) to the first posture (for example, the standing posture 107-1 shown in Figure 11A) and the display device 130 is When playing the second posture training image, the processor 160 drives the display device 130 so that the display device 130 displays the second warning message to inform the user 105 and pauses the playback of the second posture training image, or plays the corresponding first posture training image from the beginning. The first pose training images for poses. In this embodiment, the second warning information may be countdown seconds information, or voice reminder information to remind that the next action belongs to the first gesture.

In this embodiment, the first posture training image and/or the second posture training image may be recorded images recorded by a coach in advance.

Specifically, in this embodiment, the interactive electronic device 100 records the recorded images of the user 105 (for example, a coach) through the first camera 140 and the second camera 150, and analyzes the user 105 based on the recorded images through the processor 160. The posture is the first posture (for example, standing posture 107-1) or the second posture (for example, squatting posture 107-2). The processor 160 marks multiple image blocks in the recorded image (for example, images of the recorded image at a certain moment or period) as the first posture or the second posture. That is to say, the processor 160 inserts tag data labeled as the first gesture or the second gesture into the recorded image. In this way, when the user 105 who is a student is operating the interactive electronic device 100, in steps S1550 and S1560, the processor 160 can perform training according to the recorded image (ie, the first posture training image and/or the second posture The corresponding label data in the training image) is used to determine whether the posture has changed.

In this embodiment, the processor 160 marks and presents the posture change attention information in the recorded image at a predetermined countdown time before the posture of the user 105 changes. In this way, when the user 105 who is a student operates the interactive electronic device 100, he or she can be informed in advance that the posture will undergo large movements. In this embodiment, after completing the recording of the image, the processor 160 transmits the recorded image to the cloud (for example, the server 190 shown in Figure 1).

In summary, the interactive electronic device according to the embodiment of the present invention can detect the posture of the user through multiple cameras with different heights, and can adaptively adjust the content displayed on the interactive electronic device according to the different postures. Displays the configuration of the area. In this way, the user can view the information displayed by the interactive electronic device regardless of whether he is standing in a high posture or squatting or lying in a low posture. In some embodiments, the interactive electronic device can scale and move the visible area in the display area in response to the user's posture, and can also rearrange the arrangement of different screen areas in the display area to display information more flexibly.

Although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Anyone with ordinary knowledge in the technical field may make some modifications and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the appended patent application scope.

100:Interactive electronic devices 105, 105-1, 105-2: User 107-1:Standing posture 107-2: Squatting position 107-3: Lying down position 110:Ontology 111: Electric motor 112:Motor shaft 113: Tension belt 114:Component configuration box 115: Monitor limit slide rail 116: Horn fastener 117: Horn hole groove parts 118:Back cover 120: Mirror body 121:Coated glass 122: Front frame metal parts 123:Supporting metal parts 130:Display device 131:Visible area 132:Do not display area 135-1~135-3: Display area 140:First camera 141:First lens mount 150: Second camera 151: Second lens mount 152: Lens mask 160:processor 170:Non-visible light sensor 180:Transmission module 190:Cloud server 211-1~211-2: Speaker 212:Printed circuit board 213: Subwoofer 220:Control circuit board 230:Extension cord circuit 240:Adapter 311: User parameter information area 312: Coach teaching video area 313:Camera shooting area C1~C2: arrow H1: Default height H2~H3: height L1: horizontal line L2: Reference line P1: point S1510~S1580: steps S410~S480: steps S510~S570: steps TH: included angle

FIG. 1A is a block diagram of an interactive electronic device according to an embodiment of the invention. FIG. 1B is a schematic diagram of an interactive electronic device according to an embodiment of the present invention. 2A to 2C are schematic diagrams of the operation of the interactive electronic device according to the embodiment of the present invention. FIG. 3 is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. FIG. 4 is a flow chart of a control method of an interactive electronic device according to an embodiment of the present invention. FIG. 5 is a flow chart of a control method of an interactive electronic device according to an embodiment of the present invention. 6A to 6B are operational schematic diagrams of the interactive electronic device according to the embodiment of the present invention. FIG. 7A is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. FIG. 7B is a structural diagram of the interactive electronic device according to the embodiment of FIG. 7A of the present invention. FIG. 8A is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. FIG. 8B is a structural diagram of the interactive electronic device according to the embodiment of FIG. 8A of the present invention. FIG. 9 is an exploded view of an interactive electronic device according to an embodiment of the present invention. 10A to 10C are structural diagrams of the interactive electronic device according to the embodiment of FIG. 9 of the present invention. 11A to 11C are schematic diagrams of the operation of the interactive electronic device according to the embodiment of the present invention. 12A to 12C are schematic diagrams of display areas according to embodiments of the present invention. FIG. 13A is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. Figure 13B is a schematic diagram of the display area of the embodiment of Figure 13A of the present invention. FIG. 14 is a schematic diagram of the operation of the interactive electronic device according to the embodiment of the present invention. FIG. 15 is a flowchart of a control method for an interactive electronic device according to an embodiment of the present invention.

100:Interactive electronic devices

120: Mirror body

130:Display device

140:First camera

150: Second camera

160:processor

170:Non-visible light sensor

180:Transmission module

190:Cloud server

Claims (12)

An interactive electronic device includes: a body; a mirror body, which is disposed on one side of the body; the mirror body presents a virtual image corresponding to a user; and a display device, which is disposed behind the mirror body for Presenting information in a display area through the mirror; a first camera and a second camera, wherein the first camera and the second camera are arranged at different heights on the body; and a processor coupled to the display device, the first camera and the second camera, wherein the first camera and the second camera obtain a user image to detect a gesture of the user, the processor based on the user image and a preset height The posture is determined, and the processor adjusts the position of the display area, the size of the display area, and the arrangement of the information in the display device according to the detected posture, wherein the posture is divided into a first posture and a second posture. , the user's head in the first posture is higher than the preset height, and the user's head in the second posture is lower than the preset height. The interactive electronic device as claimed in claim 1, wherein when the user takes the first posture, the processor adjusts the display area to occupy a visible area in the display device, wherein when the user takes the first posture In the second posture, the processor is in the visible area Divide a non-display area and present the information in the display area outside the non-display area. The interactive electronic device as claimed in claim 1, wherein the image capturing angle of the first camera is a horizontal image capturing angle, and the image capturing angle of the second camera is an oblique downward capturing image. The interactive electronic device as claimed in claim 3, wherein the field of view (FOV) of the first camera is 130 degrees, and the field of view (FOV) of the second camera is 90 degrees. The interactive electronic device as claimed in claim 1, further comprising: a moving mechanism controlled by the processor, wherein the processor controls the moving mechanism to adjust the display device relative to the detected gesture. The position of the main body, thereby adjusting the position of the display area and the image presentation angle. The interactive electronic device as claimed in claim 1, further comprising: a non-visible light sensor coupled to the processor, wherein the processor responds to the first camera, the second camera and the non-visible light sensor The detected posture is used to determine whether the user's posture (set at the H1 position) is the first posture or the second posture. The interactive electronic device as claimed in claim 1, wherein the display area includes a user parameter information area, a coaching video area, and a camera shooting area, wherein the processor scales the display area in equal proportions The user parameter information area, the coach's teaching video area, and the camera shooting screen area are used to adjust the display The position of the display area and the size of the display area, wherein the processor adjusts the configuration positions of the user parameter information area, the coach teaching video area, and the camera shooting frame area to adjust the arrangement of the information. A control method for an interactive electronic device, including: obtaining a user image through a first camera and a second camera to detect a gesture of a user located in front of the interactive electronic device, wherein the first camera and The second camera is disposed at different heights on the interactive electronic device; determines the posture based on the user image and a preset height; and adjusts the position of a display area in a display device based on the detected posture, the The size of the display area and the arrangement of information, wherein the posture is divided into a first posture and a second posture. In the first posture, the user's head is higher than the preset height, and in the second posture, the user The head is lower than the preset height. The control method as described in claim 8, wherein the step of adjusting the position of the display area, the size of the display area and the arrangement of the information in the display device according to the detected posture includes: when the user is the first When the user takes a second posture, adjust the display area to occupy a visible area in the display device; and when the user takes the second posture, divide a non-display area in the visible area and present the information in the Do not display areas outside the display area. The control method as claimed in claim 9, wherein the step of detecting the gesture of the user located in front of the interactive electronic device based on the first camera and the second camera includes: analyzing the user image to determine the usage The corresponding position of a body shape, a face or an eye of the user, thereby determining whether the user is in the first posture or the second posture; and playing a training corresponding to the first posture or the second posture The image is used as the information and is presented in the display area of the display device. According to the control method described in claim 10, the step of adjusting the position of the display area, the size of the display area and the arrangement of the information in the display device according to the detected posture includes: when the detected posture is In the first posture, a first posture training image corresponding to the first posture is played, and the current image of the user is captured through the first camera and the current image is presented on the display device; when the detected When the posture is the second posture, a second posture training image corresponding to the second posture is played, and the current image of the user is captured through the second camera and the current image is presented on the display device; When the detected posture changes from the first posture to the second posture and the display device is playing the first posture training image, a first warning message is displayed to inform the user and the playback of the first posture training is paused. The image or a second posture training image corresponding to the second posture is played from the beginning; and when the detected posture changes from the second posture to the first posture and the display When the device is playing the second posture training image, it displays a second warning message to inform the user, and pauses the playback of the second posture training image or plays the first posture training image corresponding to the first posture from the beginning. . The control method as described in claim 8 further includes: recording a recorded image of the user through the first camera and the second camera, and analyzing the posture of the user based on the recorded image through the processor. The first posture or the second posture; multiple image blocks in the recorded image are marked as the first posture or the second posture, and at a predetermined countdown time before the user's posture changes. Mark and present a posture change attention information in the recorded image; and transmit the marked recorded image to a cloud server.

Images