CN116578189A - Control assembly, VR equipment, control method and control device thereof - Google Patents

Abstract

The application discloses a control assembly and VR equipment, which belong to the technical field of man-machine interaction, wherein the control assembly (100) is used for being in communication connection with display equipment, and the control assembly (100) comprises a main body part (110), a control part (120) and a tactile feedback part (130); the control part (120) and the touch feedback part (130) are both arranged on the main body part (110), the touch feedback part (130) comprises a magnetic fluid unit (131) and a magnetic field generator (132), the magnetic field generator (132) is electrically connected with the control part (120), the control part (120) can control the magnetic field generator (132) to generate a magnetic field according to display scene information fed back by the display device, and the magnetic field generated by the magnetic field generator (132) is used for changing the state of a magnetic fluid (1313) of the magnetic fluid unit (131). The application also discloses a control method and a control device of the VR equipment and a readable storage medium.

Description

Control assembly, VR equipment, control method and control device thereof

Technical Field

The application belongs to the technical field of man-machine interaction, and particularly relates to a control assembly, VR equipment, a control method of the VR equipment, a control device and a readable storage medium.

Background

VR (Virtual Reality) devices have gained increasing acceptance in recent years, and people can experience the most realistic sensation in the Virtual Reality world, which simulates the Reality of the environment and the difficulty in recognizing the Reality world, and gives people the feeling of being personally on the scene.

In the related art, VR devices mainly include a display device and a handle, through which a user can set and control scene contents displayed by the display device.

However, the handle in the related art can only set and control the scene content displayed by the display device, and does not have a relatively real force feedback function, so that the handle in the related art weakens the touch sense experience, and further makes it difficult for a user to have proprioception close to a real scene, so that the control performance of the VR device is relatively poor.

Disclosure of Invention

The embodiment of the application aims to provide a control component, VR equipment, a control method, a control device and a readable storage medium thereof, which can solve the problem of poor control performance of the VR equipment.

In order to solve the technical problems, the application is realized as follows:

in a first aspect, an embodiment of the present application provides a manipulation assembly, where the manipulation assembly is configured to be communicatively connected to a display device, and the manipulation assembly includes a main body portion, a control portion, and a haptic feedback portion;

the control part and the touch feedback part are both arranged on the main body part, the touch feedback part comprises a magnetic fluid unit and a magnetic field generator, the magnetic field generator is electrically connected with the control part, the control part can control the magnetic field generator to generate a magnetic field according to display scene information fed back by the display equipment, and the magnetic field generated by the magnetic field generator is used for changing the state of magnetic fluid of the magnetic fluid unit.

In a second aspect, an embodiment of the present application provides a VR device, including a display device and the foregoing control assembly, where the control assembly is communicatively connected to the display device.

In a third aspect, an embodiment of the present application provides a control method of a VR device, which is applied to the VR device, where the control method includes:

acquiring display scene information fed back by display equipment;

and controlling the magnetic field generator to generate a magnetic field according to the display scene information so as to change the state of the magnetic fluid.

In a fourth aspect, an embodiment of the present application provides a control device of a VR device, which is applied to the VR device, where the control device includes:

the acquisition module is used for acquiring the display scene information fed back by the display equipment;

and the control module is used for controlling the magnetic field generator to generate a magnetic field according to the display scene information so as to change the state of the magnetic fluid.

In a fifth aspect, embodiments of the present application provide a VR device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the control method as described above.

In a sixth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor implement the steps of the control method as described above.

In a seventh aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the third aspect.

In the embodiment of the application, the display scene information fed back by the display equipment is fed back to the control part, the control part can enable the magnetic field generator to generate a corresponding magnetic field according to the display scene information, the magnetic field at the specific position and the magnetic field with specific strength can cause the state of the magnetic fluid at the specific position to change specifically, and the magnetic fluid can act on the hand of a user when the state of the magnetic fluid changes, so that the physical touch experience of the user in a real scene is simulated, and the realism of the user operation is enhanced. Therefore, the control component disclosed by the application can simulate corresponding physical touch sense for different virtual scenes through the touch feedback part so as to enhance the sense of reality of user operation, thereby improving the control performance of VR equipment.

Drawings

Fig. 1 to 3 are schematic structural views of a first steering assembly according to an embodiment of the present application;

FIG. 4 is a partial schematic view of a steering assembly disclosed in an embodiment of the present application;

FIG. 5 is a schematic structural view of a second steering assembly according to an embodiment of the present application;

FIG. 6 is an exploded view of a third steering assembly disclosed in an embodiment of the present application;

FIG. 7 is a schematic structural view of a third steering assembly according to an embodiment of the present application;

FIG. 8 is an exploded view of a magnetic fluid unit of a steering assembly in accordance with an embodiment of the present application;

FIG. 9 is a schematic diagram of a magnetic fluid unit of a steering assembly according to an embodiment of the present application;

FIG. 10 is a cross-sectional view taken along the direction A-A of FIG. 9;

FIG. 11 is a schematic structural view of a magnetic fluid unit of a steering assembly according to an embodiment of the present application;

FIG. 12 is a cross-sectional view taken along the B-B direction of FIG. 11;

FIG. 13 is a schematic structural view of a haptic feedback portion of a steering assembly in accordance with an embodiment of the present application;

fig. 14 is a flowchart of a control method of a VR device according to an embodiment of the present application;

fig. 15 is a block diagram of a VR device embodying an embodiment of the present application;

fig. 16 is a schematic hardware structure of a VR device for implementing an embodiment of the present application.

Reference numerals illustrate:

100-control assembly, 110-main part, 111-handle body, 112-glove body, 120-control part, 130-tactile feedback part, 131-magnetic fluid unit, 1311-carrier part, 1311 A-Accommodation groove, 1312-elastic coating film, 1313-magnetic fluid, 1314-adhesive layer, 1315-protective layer, 132-magnetic field generator, 140-bending detection element, 150-control handle, 160-clamping piece, 161-clamping concave part, 162-supporting cushion, 170-accommodation box, 171-installation seat, 172-box body and 173-upper cover.

Detailed Description

The technical solutions of the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The control component and the VR device provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings by means of specific embodiments and application scenarios thereof.

Referring to fig. 1 to 13, an embodiment of the present application discloses a control assembly 100, wherein the control assembly 100 is communicatively connected with a display device. The user can set and control scene content displayed by the display device through the manipulation component 100. The display device can be a VR display device, and specifically can be VR display devices such as VR glasses and VR helmets. The disclosed steering assembly 100 may include a body portion 110, a control portion 120, and a haptic feedback portion 130.

The main body 110 is a main body component of the steering assembly 100, and the main body 110 can provide an installation space for other component parts of the steering assembly 100. The control portion 120 and the haptic feedback portion 130 are both provided to the main body portion 110.

The haptic feedback part 130 includes a magnetic fluid unit 131 and a magnetic field generator 132, the magnetic field generator 132 being capable of generating a magnetic field capable of changing a state of the magnetic fluid 1313 in the magnetic fluid unit 131, for example, the magnetic field being capable of driving the magnetic fluid to move, so that the magnetic field generated by the magnetic field generator 132 is capable of changing a moving state of the magnetic fluid unit; for another example, the magnetic field generator can also generate an alternating stope to heat the magnetic fluid unit, so the magnetic field generated by the magnetic field generator 132 can change the temperature state of the magnetic fluid unit.

The magnetic fluid 1313 is also called magnetic liquid or magnetic liquid, is a novel functional material, has magnetism and fluidity of liquid, has no magnetic attraction under static state, shows magnetism only under an external magnetic field, and is stable cementing liquid.

The magnetic field generator 132 is electrically connected to the control part 120, and the control part 120 can display scene information according to feedback of the display device to control the magnetic field generator 132 to generate a magnetic field, wherein the magnetic field generated by the magnetic field generator 132 is used for changing the state of the magnetic fluid 1313 of the magnetic fluid unit 131 so as to simulate touch sense. The controller may be a combination of a circuit board, a chip, and other functional devices. The magnetic field generator 132 may be a component formed of an electromagnet structure, and of course, the magnetic field generator 132 may also be a component formed of a permanent magnet component. The specific structure and principle of the magnetic field generator 132 are well known and will not be described in detail herein.

In a specific operation process, when the user performs corresponding actions in the virtual scene, feedback information generated by the actions is fed back to the control component 100. When the receiving device (e.g., antenna) of the manipulation assembly 100 receives feedback information of the display device, the controller performs an analysis process on the feedback information and controls the magnetic field generator 132 to generate a specific magnetic field according to the data of the feedback information. As shown in fig. 4 and 13, under the action of a specific magnetic field, the magnetic fluid 1313 moves in a specific direction and at the same time with a specific intensity, and the acting force of the magnetic fluid 1313 appropriately presses the hand of the user, so as to simulate the physical tactile experience of the user in a real scene.

For example, when the user plays the virtual shooting game, the weight of the virtual gun body can be used as display scene information, the display scene information is fed back to the control assembly 100, the control part 120 analyzes and processes the weight information of the virtual gun body, the magnetic field generator 132 is controlled to generate a specific magnetic field according to the data of the weight of the virtual gun body, the magnetic fluid 1313 moves along the specific direction, and the acting force of the magnetic fluid 1313 appropriately presses the hands of the user, so that the weight of the user holding the gun in the real scene is simulated. For another example, when the user shoots with the gun in a real scene, the user can feel not only the weight of the gun body, but also the recoil of the bullet on the gun body during shooting. In order to further simulate the touch feeling of a user shooting in a real scene, information such as the weight of a virtual gun body and the recoil force of a bullet on the gun body can be fed back as display scene information.

For another example, the temperature information of the scene displayed by the display device may be fed back to the control unit as the display scene information, and the control unit 120 may regulate the temperature state of the magnetic fluid 1313 according to the temperature information.

In the embodiment disclosed by the application, the display scene information fed back by the display device is fed back to the control part 120, the control part can enable the magnetic field generator 132 to generate a corresponding magnetic field according to the display scene information, the magnetic field with a specific position and a specific strength can cause the state of the magnetic fluid 1313 at the specific position to change specifically, and the state of the magnetic fluid 1313 can act on the hand of a user when changing, so that the physical touch experience of the user in a real scene is simulated, and the realism of the user operation is enhanced. Therefore, the control component disclosed by the application can simulate corresponding physical touch sense for different virtual scenes through the touch feedback part so as to enhance the sense of reality of user operation, thereby improving the control performance of VR equipment.

The display scene information may be touch information such as volume, surface texture, weight, etc. of the object, and may be other information of the content displayed by the display device, which is not limited herein.

The disclosed manipulation assembly 100 implements haptic simulation by changing the state of the magnetic fluid 1313 through a magnetic field. Therefore, the handling assembly 100 of the present application does not need to provide a complex mechanical structure, so that the handling assembly 100 has smaller volume and weight and lower cost. Meanwhile, the control assembly 100 in the application performs the haptic simulation through the state change of the magnetic fluid 1313, and the state change of the magnetic fluid 1313 is related to the direction of the magnetic field and the strength of the magnetic field, so that more physical haptic simulation can be realized through different magnetic field designs, and therefore, the control assembly 100 in the application can simulate more real scenes, and the matching performance with the display equipment is higher.

In addition, the haptic feedback portions 130 of the control assembly 100 disclosed in the application are all located on the main body portion 110, so that the haptic feedback portions are not limited by space, and therefore, the control space is larger and the user experience is better.

Alternatively, the manipulation assembly 100 may be an operation handle, and thus the main body 110 may be a handle body 111, and the handle body 111 may have a manipulation region and a grip region disposed around the manipulation region along a circumference of the manipulation region. The user holds the operation handle through the holding area. The control area is internally provided with a control button. When the user holds the operating handle, the thumb of the user is positioned in the control area, so that the control keys are controlled, and other fingers of the user can be held in the holding area. Since the hand region of the user is mostly in the grip region, the magnetic fluid unit 131 and the magnetic field generator 132 may be both disposed in the grip region. The magnetic fluid unit 131 is disposed in the holding area, so that most of the area of the user's hand can act on the magnetic fluid unit 131, and the user can obtain better touch feeling.

In another alternative, the steering assembly 100 may be an operating glove and the main body 110 may be a glove body 112. The magnetic fluid unit 131 and the magnetic field generator 132 may be both disposed on the surface of the glove body 112. The glove body 112 may be fitted over the user's hand. Specifically, the glove body 112 may include a first surface and a second surface disposed opposite to each other, the first surface may be a surface facing the palm of the user's hand, the second surface may be a surface facing the back of the user's hand, and the magnetic fluid unit 131 and the magnetic field generator 132 may be disposed on the first surface and the second surface.

Alternatively, in another aspect, the magnetic fluid unit 131 may be disposed on the first surface, and the magnetic field generator 132 may be disposed on the second surface. At this time, the magnetic fluid unit 131 acts on the palm area with better touch feeling, and at the same time, the magnetic fluid unit 131 and the magnetic field generator 132 are distributed on two opposite sides of the glove body 112, so that interference is not easy to occur.

In the above embodiment, the main body 110 may be provided with a filling groove, in which the magnetic fluid 1313 is filled, and the notch of the filling groove is covered with the elastic coating 1312, and the elastic coating 1312 can seal the filling groove, so as to avoid leakage of the magnetic fluid 1313. As shown in fig. 9, when the magnetic fluid 1313 is not subjected to a magnetic field, the magnetic fluid 1313 has no or little force on the elastic coating 1312, and thus the elastic coating 1312 does not undergo convex deformation toward the user's hand. As shown in fig. 11, when the magnetic fluid 1313 is subjected to a magnetic field, the magnetic fluid 1313 applies a force to the elastic coating 1312, so that the elastic coating 1312 is convexly deformed toward the user's hand to generate a pressing force on the user's hand. As shown in fig. 13, the direction of movement of the magnetic fluid 1313 is different depending on the direction and strength of the magnetic field, and thus the amount and direction of deformation of the elastic coating 1312 are different.

Alternatively, in another alternative embodiment, the magnetic fluid 1313 may be enclosed in an elastic bag, and the magnetic fluid unit 131 is an elastic bag structure enclosed with the magnetic fluid unit 131.

Alternatively, the elastic coating 1312 and the elastic bag may be made of plastic, PET (Polyethylene terephthalate ), or the like.

In another alternative embodiment, the magnetic fluid unit 131 may include a carrier part 1311, an elastic coating 1312, and a magnetic fluid 1313, and the carrier part 1311 may be connected with the body part 110. The carrier portion 1311 may be provided with a receiving groove 1311a, and the elastic coating film 1312 covers the notch of the receiving groove 1311a to form a filling cavity. The magnetic fluid 1313 fills the filling cavity.

In a specific assembly process, the magnetic fluid 1313 is filled in the accommodating groove 1311a, and then a coating film is attached to the notch of the accommodating groove 1311a to seal the accommodating groove 1311a. Finally, the assembled magnetic fluid unit 131 is integrally assembled to the main body 110.

In this embodiment, the carrier portion 1311 of the magnetic fluid unit 131 can carry the magnetic fluid 1313, so that the magnetic fluid 1313 is prevented from generating a large force on the elastic coating 1312 under the condition of not being affected by a magnetic field. In addition, the magnetic fluid unit 131 disclosed in this embodiment is assembled separately, so that the manufacturing process and material requirements for the main body 110 are low, and thus the manufacturing cost of the control assembly 100 can be reduced.

In another alternative embodiment, the number of the magnetic fluid units 131 is plural, and the plurality of magnetic fluid units 131 are spaced apart. In this scheme, the greater the number of the magnetic fluid units 131, the greater the area that can cover the user's hand, thereby making the simulated touch feel more realistic. In addition, the more the number of the magnetic fluid units 131 is, the more scenes can be simulated, so that the use scene of the control assembly 100 is further improved.

Further, the carrier portion 1311 of each magnetic fluid unit 131 is provided with a plurality of receiving grooves 1311a, and the plurality of receiving grooves 1311a are arranged in an array. In this solution, each magnetic fluid unit 131 is provided with a plurality of filling cavities, so the magnetic fluid units 131 in each filling cavity can be independently controlled, so that the touch feeling of the hand area corresponding to each magnetic fluid unit 131 is finer, and the reality of the simulated touch feeling is further improved.

In the above embodiment, the magnetic fluid unit 131 may further include an adhesive layer 1314, and the carrier part 1311 may be adhered to the body part 110 through the adhesive layer 1314. Alternatively, the adhesive layer 1314 may be an adhesive structure such as double sided tape, glue, etc., although the adhesive layer 1314 may be other structures, and is not limited herein.

Of course, the magnetic fluid unit 131 is not limited to the bonding method and may be connected to the main body 110 by a clamping method, a screw connection method, or the like, and is not limited herein.

In the above embodiment, when the main body 110 is the handle body 111, the side of the magnetic fluid unit 131 with the elastic coating 1312 needs to face the direction outside the main body 110, that is, when the user holds the handle body 111, the side of the magnetic fluid unit 131 with the elastic coating 1312 needs to face the hand of the user, so the surface of the side of the magnetic fluid unit 131 facing away from the elastic coating 1312 can be attached to the surface of the handle body 111.

When the main body 110 is the glove body 112, the magnetic fluid unit 131 may be disposed inside the glove body 112, that is, the magnetic fluid unit 131 may be disposed on an inner surface of a space of the glove body 112 for accommodating a user's hand, and at this time, a surface of a side of the magnetic fluid unit 131 facing away from the elastic coating 1312 may be attached to an inner surface of the space of the glove body 112 for accommodating a user's hand.

Alternatively, the magnetic fluid unit 131 may be disposed outside the glove body 112, and at this time, a surface of a side of the magnetic fluid unit 131 facing away from the elastic coating 1312 may be attached to an outer surface of the glove body 112. At this time, the adhesive layer 1314 is located on one side of the elastic coating 1312.

However, in order to avoid the adhesive layer 1314 from covering the elastic coating 1312, in an alternative embodiment, the adhesive layer 1314 may be provided with a through hole, and the elastic coating 1312 may be disposed opposite the through hole. In this embodiment, the adhesive layer 1314 is provided with a through hole, so that the elastic film 1312 can be exposed, so as to avoid affecting the reality of the simulated touch of the control assembly 100.

Further, in order to avoid damage to the carrier part 1311, in an alternative embodiment, the magnetic fluid unit 131 may further include a protective layer 1315, and the adhesive layer 1314 and the protective layer 1315 may be respectively located at opposite sides of the carrier part 1311. In this embodiment, the protective layer 1315 is equivalent to increasing the thickness of the carrier portion 1311, so that the carrier portion 1311 can be prevented from being worn out, thereby improving the safety and reliability of the magnetic fluid unit 131.

In another alternative embodiment, the main body 110 may be the glove body 112, and the steering assembly 100 may further include a bending detection element 140, where the bending detection element 140 may be disposed on the glove body 112. The bending detection element 140 may be electrically connected to the control part 120. The curvature detecting element 140 may be configured to detect hand curvature information, and may be configured to allow the display device to simulate and display a hand curvature state according to the hand curvature information.

Specifically, the curvature detecting element 140 recognizes the curvature state of the user's hand by the finger curvature position and degree, and the hand curvature information is transferred to the display device through the control part 120, so that the state of the user's hand can be simulated in real time in the virtual space displayed by the display device.

In the scheme, when a user touches or grabs an object in the virtual space, the bending state of the hand of the user and the hand state in the virtual space can be synchronously operated, and the motion in the real state can be more similar, so that the reality of touch feeling can be further improved, and the user experience is further improved.

Alternatively, the bending detection element 140 may be a bending sensor, and of course, may be a combination of a bending sensor and other circuits.

In another alternative embodiment, the manipulation assembly 100 may further include a manipulation handle 150 through which a user can set and control scene content displayed by the display device. At this time, the body part 110, the control part 120, and the haptic feedback part 130 constitute a manipulation glove for realizing haptic feedback, and the manipulation handle 150 is used for setting and controlling scene contents displayed by the display device. In this scheme, the scene content is controlled and the haptic feedback is separately set, so that the structure of the control assembly 100 is simplified, and the complexity of the control assembly 100 is avoided.

It should be noted that the control handle 150 in this embodiment is a conventional control handle, which is different from the control handle provided with the magnetic fluid unit 131 disclosed in the above embodiment. The joystick 150 mentioned here is only used for setting and controlling the scene content displayed by the display device, and cannot be used for tactile feedback.

In another alternative embodiment, the joystick 150 has a joystick key that maps with hand bending information. Different hand curvatures represent different keys of the control key. For example, when the hand is held in a fist, a confirmation button may be represented. For another example, different fingers are correspondingly matched with the manipulation keys, and when the corresponding fingers are bent, the corresponding keys are triggered. In this scheme, the hand curvature is correspondingly matched with the control button, so that the control assembly 100 is separated from the constraint of the control handle 150, and the operation of the control assembly 100 is more flexible.

Further, the control handle 150 may have a position locating component for locating the spatial position of the control handle 150, so that the user can accurately determine the position of the control handle 150, and the operation of the control handle 150 can be visualized, so that the control difficulty of the control handle 150 is small.

In an alternative embodiment, the steering handle 150 may be disposed on the glove body 112, and the spatial position of the glove body 112 may be located by a position locating assembly of the steering handle 150. At this time, the spatial position of the control handle 150 may be positioned, so that the spatial position of the glove body 112 may be positioned, and the operation of the control assembly 100 may be visualized, so that the control difficulty of the control assembly 100 may be smaller. In addition, the glove body 112 can be positioned by the position positioning component of the control handle 150, so that the position positioning component is not required to be arranged on the glove body 112, and the structure of the control component 100 is simplified.

The positioning component may be an antenna component, a camera or the like, but the positioning component may also be other structures, which is not limited herein.

In another alternative embodiment, the steering assembly 100 may further include a clamping member 160, the clamping member 160 may be detachably connected to the glove body 112, and the clamping member 160 is used to clamp the steering handle 150. In this embodiment, the clamping member 160 is a replaceable unit, so that the clamping member 160 can be replaced according to different operation handles 150, so as to achieve versatility of the operation assembly 100.

Alternatively, in another alternative embodiment, the clamping member 160 includes a first jaw body and a second jaw body that are relatively movable, the first and second jaw bodies forming a clamping space for clamping the manipulation handle 150. In this scheme, the first claw body and the second claw body can move relatively to make the volume in centre gripping space changeable, and then can control handle 150 according to the nimble centre gripping of shape of control handle 150, thereby realize controlling the commonality of subassembly 100.

Alternatively, the first claw body and the second claw body may be connected through a sliding rail, and of course, may also be connected through an elastic member. Of course, the first claw body and the second claw body may also be movably connected through other components, which is limited herein.

In another aspect, a supporting cushion 162 may be disposed in the clamping space of the clamping member 160, and the supporting cushion 162 may prevent the clamping member 160 from rigidly contacting the steering handle 150, thereby preventing the steering handle 150 from being damaged. And at the same time, the anti-slip function can be achieved on the control handle 150, so that the control handle 150 is prevented from accidentally sliding off the clamping piece 160.

In another alternative embodiment, the control assembly 100 may further include a housing box 170, the housing box 170 may be provided with a housing cavity, the control portion 120 may be located in the housing cavity, and the housing box 170 may be fixedly connected with the glove body 112. The clamping member 160 may be disposed at a side of the receiving box 170 facing away from the glove, and the clamping member 160 may be detachably connected with the receiving box 170. In this case, the accommodating case 170 can protect the control part 120, thereby improving the safety and reliability of the manipulation assembly 100. In addition, the clamping piece 160 is disposed on one side of the accommodating box 170 away from the glove, so that the clamping piece 160 and the control handle 150 can be prevented from interfering with the glove body 112, and the operation of the control glove is not easily affected.

In another alternative embodiment, the accommodating box 170 may include a mounting seat 171, a box body 172 and an upper cover 173, the mounting seat 171 may be adhered to the glove body 112, the box body 172 may be fixed to a side of the mounting seat 171 facing away from the glove body 112, and the box body 172 and the upper cover 173 may enclose an accommodating cavity. In this solution, the structure of the accommodating box 170 and the assembly structure of the accommodating box 170 and the glove body 112 are simple, so that the structure of the control assembly 100 is simple, and the manufacturing cost of the control assembly 100 can be reduced.

The mounting seat 171, the case 172, and the upper cover 173 may be connected by a connector such as a bolt or a rivet.

Further, the clamping member 160 may be provided with a clamping recess 161, and the clamping member 160 may be in clamping fit with the upper cover 173 through the clamping recess 161. In this solution, the clamping member 160 can be directly clamped on the upper cover 173, so that the connection and the disassembly of the clamping member 160 and the upper cover 173 are simpler, and the replacement of the clamping member 160 is more convenient.

Of course, the clip 160 and the upper cover 173 are not limited to the structure of the clip, and may be connected by a screw, a magnetic attraction, or the like.

In another alternative embodiment, a functional element for heating or cooling the magnetic fluid 1313 may be further disposed on the magnetic fluid unit 131, so as to simulate the cold and hot environments of the virtual environment, thereby further improving the user experience. For example, heating wires or fans may be provided to heat or cool the body of the magnetic fluid 1313.

Based on the manipulation assembly 100 disclosed in the embodiments of the present application, the embodiments of the present application also disclose a VR device, where the disclosed VR device includes the manipulation assembly 100 described in any of the embodiments above. The VR device of the present disclosure further includes a display device to which the manipulation assembly 100 is communicatively coupled. The control part 120 of the control assembly 100 can control the magnetic field generator 132 to generate a magnetic field according to the display scene information fed back by the display device, so as to change the state of the magnetic fluid 1313 of the magnetic fluid unit 131, thereby realizing the haptic simulation.

Based on the VR device disclosed in the embodiment of the present application, the embodiment of the present application discloses a control method of the VR device, where the disclosed control method is applied to the VR device as described above, as shown in fig. 14, and the disclosed control method includes:

s101, obtaining display scene information fed back by a display device.

The user sees scene information displayed by the display device in the virtual space, and these display scene information are fed back to the manipulation assembly 100 as feedback information. The display scene information may be touch information such as volume, surface texture, weight, temperature, etc. of the object.

S102, controlling the magnetic field generator 132 to generate a magnetic field according to the display scene information so as to change the state of the magnetic fluid 1313.

When the receiving device (e.g., antenna) of the manipulation assembly 100 receives the display scene information fed back by the display device, the control part 120 performs an analysis process on the feedback information and controls the magnetic field generator 132 to generate a specific magnetic field according to the data of the feedback information. Under the action of a specific magnetic field, the state of the magnetic fluid 1313 changes, so that the physical touch experience of a user in a real scene is simulated.

Based on the control method disclosed in the embodiment of the present application, the embodiment of the present application discloses a control device for VR equipment, where the disclosed control device includes:

the acquisition module is used for acquiring the display scene information fed back by the display equipment;

the control module is used for controlling the magnetic field generator 132 to generate a magnetic field according to the display scene information so as to change the state of the magnetic fluid 1313.

In this aspect, when the receiving device (e.g., antenna) of the manipulation assembly 100 receives feedback information of the display device, the controller performs an analysis process on the feedback information and controls the magnetic field generator 132 to generate a specific magnetic field according to the data of the feedback information. Under the action of a specific magnetic field, the state of the magnetic fluid 1313 changes, so that the physical touch experience of a user in a real scene is simulated.

Optionally, as shown in fig. 15, the embodiment of the present application further provides a VR device 500, which includes a processor 520, a memory 510, and a program or an instruction stored in the memory 510 and capable of running on the processor 520, where the program or the instruction implements each process of the above-mentioned control method embodiment of the VR device when executed by the processor 520, and the process can achieve the same technical effects, and for avoiding repetition, a detailed description is omitted herein.

Fig. 16 is a schematic hardware structure of a VR device for implementing an embodiment of the present application.

The VR device 400 includes, but is not limited to: radio frequency unit 410, network module 420, audio output unit 430, input unit 440, sensor 450, display unit 460, user input unit 470, interface unit 480, memory 490, and processor 401. The processor 401 described herein includes the control portion 120 of the steering assembly 100 disclosed in an embodiment of the present application.

Those skilled in the art will appreciate that VR device 400 may also include a power source (e.g., a battery) for powering the various components, which may be logically connected to processor 401 via a power management system to perform functions such as managing charge, discharge, and power consumption via the power management system. The VR device structure shown in fig. 8 is not limiting of the VR device, and the VR device may include more or less components than illustrated, or may combine certain components, or may be arranged in different components, which are not described in detail herein.

The user input unit 470 is used for inputting manipulation information, such as display scene information fed back by the display device, pressing information of the manipulation keys, detection information of the position locating component and the curvature detection element 140, by a user.

The processor 401 is configured to obtain display scene information by processing, and control the magnetic field generator 132 to generate a magnetic field according to the display scene information, where the magnetic field generated by the magnetic field generator 132 is used to change the state of the magnetic fluid 1313 of the magnetic fluid unit 131, so as to implement haptic simulation.

In the embodiment disclosed in the present application, the control assembly 100 can simulate corresponding physical touch for different virtual scenes through the haptic feedback portion 130, so as to enhance the sense of reality of user operation, thereby improving the control performance of VR device.

It should be appreciated that in embodiments of the present application, the input unit 440 may include a graphics processor (Graphics Processing Unit, GPU) 441 and a microphone 442, with the graphics processor 441 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 460 may include a display device, which may include a display panel 461, and the display panel 461 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 470 includes a touch panel 471 and other input devices 472. The touch panel 471 is also referred to as a touch screen. The touch panel 471 may include two parts of a touch detection device and a touch controller. Other input devices 472 may include the disclosed steering assembly 100, of course, other input devices 472 may also include, but are not limited to, physical keyboards, function keys (e.g., volume control keys, switch keys, etc.), trackballs, mice, joysticks, and so forth, which are not described in detail herein. Memory 490 may be used to store software programs and various data including, but not limited to, application programs 491 and an operating system 492. The processor 401 may integrate an application processor, which mainly processes an operating system, a user interface, an application program, etc., with a modem processor, which mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

The embodiment of the application also provides a readable storage medium, on which a program or an instruction is stored, which when executed by a processor, implements each process of the above-mentioned control method embodiment of VR device, and can achieve the same technical effects, so that repetition is avoided and no further description is given here.

Wherein, the processor is the processor in the VR device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

The embodiment of the application further provides a chip, the chip comprises a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running programs or instructions, the processes of the control method embodiment of the VR device can be realized, the same technical effects can be achieved, and the repetition is avoided, and the description is omitted here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.

Claims (14)

1. A steering assembly (100) for communication connection with a display device, characterized in that the steering assembly (100) comprises a main body portion (110), a control portion (120) and a haptic feedback portion (130);

the control part (120) and the touch feedback part (130) are both arranged on the main body part (110), the touch feedback part (130) comprises a magnetic fluid unit (131) and a magnetic field generator (132), the magnetic field generator (132) is electrically connected with the control part (120), the control part (120) can control the magnetic field generator (132) to generate a magnetic field according to display scene information fed back by the display device, and the magnetic field generated by the magnetic field generator (132) is used for changing the state of a magnetic fluid (1313) of the magnetic fluid unit (131).

2. The steering assembly according to claim 1, wherein the magnetic fluid unit (131) comprises a carrier portion (1311), an elastic coating (1312) and the magnetic fluid (1313), the carrier portion (1311) being connected with the main body portion (110); the carrier part (1311) is provided with a containing groove (1311 a), the elastic coating film (1312) covers the notch of the containing groove (1311 a) to form a filling cavity, and the magnetic fluid (1313) is filled in the filling cavity.

3. The control assembly according to claim 2, wherein the number of the magnetic fluid units (131) is plural, and the plurality of the magnetic fluid units (131) are arranged at intervals; the carrier part (1311) of each magnetic fluid unit (131) is provided with a plurality of accommodating grooves (1311 a), and the accommodating grooves (1311 a) are arranged in an array.

4. A handling assembly according to claim 3, wherein the magnetic fluid unit (131) further comprises an adhesive layer (1314) and a protective layer (1315), the adhesive layer (1314) and the protective layer (1315) being located on opposite sides of the carrier portion (1311), respectively; the adhesive layer (1314) is provided with a through hole, the elastic coating film (1312) is arranged opposite to the through hole, and the carrier part (1311) is adhered to the main body part (110) through the adhesive layer (1314).

5. The steering assembly according to claim 1, wherein the main body portion (110) is a glove body (112); the magnetic fluid unit (131) and the magnetic field generator (132) are both arranged on the surface of the glove body (112).

6. The steering assembly according to claim 5, wherein the steering assembly (100) further comprises a curvature detection element (140), the curvature detection element (140) is disposed on the glove body (112), the curvature detection element (140) is electrically connected to the control portion (120), the curvature detection element (140) is configured to detect hand curvature information, and the display device is configured to display a hand curvature state in a simulation manner according to the hand curvature information.

7. The steering assembly according to claim 6, wherein the steering assembly (100) further comprises a steering handle (150), the steering handle (150) being arranged on the glove body (112), the steering handle (150) having a position locating assembly by which the spatial position of the glove body (112) can be located, and the steering keys of the steering handle (150) being mapped with the hand bending information.

8. The steering assembly according to claim 7, wherein the steering assembly (100) further comprises a clamping member (160), the clamping member (160) being detachably connected to the glove body (112), the clamping member (160) being adapted to clamp the steering handle (150).

9. The control assembly according to claim 8, wherein the control assembly (100) further comprises a housing box (170), the housing box (170) is provided with a housing cavity, the control part (120) is located in the housing cavity, the housing box (170) is fixedly connected with the glove body (112), the clamping member (160) is disposed on a side of the housing box (170) away from the glove body (112), and the clamping member (160) is detachably connected with the housing box (170).

10. The handling assembly according to claim 9, wherein the accommodating box (170) comprises a mounting seat (171), a box body (172) and an upper cover (173), the mounting seat (171) is adhered to the glove body (112), the box body (172) is fixed on one side of the mounting seat (171) away from the glove body (112), and the accommodating cavity is defined by the box body (172) and the upper cover (173);

clamping concave parts (161) are formed in the clamping pieces (160), and the clamping pieces (160) can be matched with the upper cover (173) in a clamping mode through the clamping concave parts (161).

11. The control assembly according to claim 1, wherein the main body portion (110) is a handle body (111), the handle body (111) has a holding area, and the magnetic fluid unit (131) and the magnetic field generator (132) are both disposed in the holding area.

12. VR device characterized in that it comprises a display device and a steering assembly (100) according to any one of claims 1 to 11, said steering assembly (100) being communicatively connected to said display device.

13. A control method of a VR device, applied to the VR device of claim 12, the control method comprising:

acquiring display scene information fed back by display equipment;

and controlling the magnetic field generator (132) to generate a magnetic field according to the display scene information so as to change the state of the magnetic fluid (1313).

14. A control apparatus of a VR device as set forth in claim 12, the control apparatus comprising:

the acquisition module is used for acquiring the display scene information fed back by the display equipment;

and the control module is used for controlling the magnetic field generator (132) to generate a magnetic field according to the display scene information so as to change the state of the magnetic fluid (1313).