CN112911271B - Image display method, human body communication device, system and storage medium - Google Patents
Image display method, human body communication device, system and storage medium Download PDFInfo
- Publication number
- CN112911271B CN112911271B CN201911223034.6A CN201911223034A CN112911271B CN 112911271 B CN112911271 B CN 112911271B CN 201911223034 A CN201911223034 A CN 201911223034A CN 112911271 B CN112911271 B CN 112911271B
- Authority
- CN
- China
- Prior art keywords
- human body
- communication device
- head
- mounted display
- body communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B13/00—Transmission systems characterised by the medium used for transmission, not provided for in groups H04B3/00 - H04B11/00
- H04B13/005—Transmission systems in which the medium consists of the human body
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses an image display method, a human body communication device, a system and a storage medium, wherein the method is applied to a human body communication system; the method comprises the following steps: under the condition that the target human body is in contact with the target object, the first human body communication device determines that a first human body transmission channel is formed between the first human body communication device and the second human body communication device; the first human body communication device receives first image information sent by the second human body communication device through the first human body transmission channel, and sends the first image information to the VR head-mounted display equipment through the second human body transmission channel; the VR head-mounted display equipment is used for displaying an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between the position where the VR head-mounted display equipment is contacted with the target human body and the position where the first human body communication device is contacted with the target human body. The embodiment of the application can improve the reality of VR display.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to an image display method, a human body communication device, a human body communication system, and a storage medium.
Background
Virtual Reality (VR) technology combines virtual reality and display with each other, creating and experiencing a virtual world, immersing a user in the environment, simulating the environment and displaying the world with difficulty in distinguishing reality and falseness.
Currently, a user may enter a virtual simulated environment by wearing a head-mounted display. In a virtual simulation environment, if an object is touched, a user cannot perceive what the object is in the real world unless the user takes off the head-mounted display, which is troublesome.
Disclosure of Invention
The embodiment of the application provides an image display method, a human body communication device, a system and a storage medium, which can display images based on human body communication transmission through VR head-mounted display equipment and improve the reality sense of VR display.
In a first aspect, an embodiment of the present application provides an image display method, which is applied to a human body communication system, where the human body communication system includes a virtual reality VR head-mounted display device, a first human body communication device and a second human body communication device, the first human body communication device is disposed on a target human body, the target human body wears the VR head-mounted display device, and the second human body communication device is disposed on a target object; the method comprises the following steps:
the first human body communication device determining that a first human body transmission channel is formed between the first human body communication device and the second human body communication device in a case where the target human body is in contact with the target object;
the first human body communication device receives first image information sent by the second human body communication device through the first human body transmission channel, and sends the first image information to the VR head-mounted display equipment through the second human body transmission channel; the VR head-mounted display device is used for displaying an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between a position where the VR head-mounted display device is in contact with the target human body and a position where the first human body communication device is in contact with the target human body.
In a second aspect, embodiments of the present application provide a human body communication system, which includes a virtual reality VR head mounted display device, a first human body communication device and a second human body communication device, wherein the first human body communication device is disposed on a target human body, the target human body wears the VR head mounted display device, and the second human body communication device is disposed on a target object;
the first human body communication device is used for determining that a first human body transmission channel is formed between the first human body communication device and the second human body communication device under the condition that the target human body is in contact with the target object;
the first human body communication device is further used for receiving first image information sent by the second human body communication device through the first human body transmission channel and sending the first image information to the VR head-mounted display equipment through the second human body transmission channel;
the VR head-mounted display equipment is used for displaying an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between a position where the VR head-mounted display equipment is in contact with the target human body and a position where the first human body communication device is in contact with the target human body.
In a third aspect, an embodiment of the present application provides a human body communication device, including:
a determination unit configured to determine that a first human body transmission channel is formed between the first human body communication device and the second human body communication device in a case where the target human body is in contact with the target object;
a receiving unit for receiving first image information transmitted by the second human body communication device through the first human body transmission channel;
a transmitting unit, configured to transmit the first image information to the VR head-mounted display device through a second human body transmission channel; the VR head-mounted display device is used for displaying an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between a position where the VR head-mounted display device is in contact with the target human body and a position where the first human body communication device is in contact with the target human body.
In a fourth aspect, embodiments of the present application provide a human body communication device, including a processor, a memory for storing one or more programs configured to be executed by the processor, the programs including instructions for performing some or all of the steps performed by the first human body communication device in the first aspect of the embodiments of the present application.
In a fifth aspect, this application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program causes a computer to execute some or all of the steps performed by the first human body communication device as described in the first aspect of this application.
In a sixth aspect, embodiments of the present application provide a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, where the computer program is operable to cause a computer to perform some or all of the steps performed by the first human communication device as described in the first aspect of embodiments of the present application. The computer program product may be a software installation package.
It can be seen that the image display method described in the embodiments of the present application is applied to a human body communication system, the human body communication system includes a virtual reality VR head mounted display device, a first human body communication device and a second human body communication device, the first human body communication device is disposed on a target human body, the target human body wears the VR head mounted display device, and the second human body communication device is disposed on a target object; the first human body communication device determining that a first human body transmission channel is formed between the first human body communication device and the second human body communication device in a case where the target human body is in contact with the target object; the first human body communication device receives first image information sent by the second human body communication device through the first human body transmission channel, and sends the first image information to the VR head-mounted display equipment through the second human body transmission channel; the VR head-mounted display equipment is used for displaying an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between the position where the VR head-mounted display equipment is contacted with the target human body and the position where the first human body communication device is contacted with the target human body. The human body communication device provided by the embodiment of the application can receive the image information sent by the target object under the condition that the target human body is in contact with the target object, can display the image based on human body communication transmission through the VR head-mounted display equipment, and improves the reality sense of VR display.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a human body communication system disclosed in an embodiment of the present application;
FIG. 2 is a schematic diagram of a first human body communication device according to an embodiment of the present disclosure;
fig. 3A is a schematic structural diagram of a capacitive coupling coupler disclosed in an embodiment of the present application;
fig. 3B is a schematic structural diagram of a current-coupled coupler according to an embodiment of the present disclosure;
fig. 3C is a schematic structural diagram of a line-coupled coupler according to an embodiment of the present application;
FIG. 4 is a flowchart illustrating an image display method according to an embodiment of the present disclosure;
FIG. 5 is a schematic flow chart diagram of another image display method disclosed in the embodiments of the present application;
FIG. 6 is a schematic flow chart diagram of another image display method disclosed in the embodiments of the present application;
fig. 7 is a schematic structural diagram of a human body communication device disclosed in an embodiment of the present application;
fig. 8 is a schematic structural diagram of another human body communication device disclosed in the embodiments of the present application.
Detailed Description
In order to make the technical solutions of the present invention better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first," "second," and the like in the description and claims of the present invention and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The human body communication device and the human body emitting device related to the embodiment of the application are called as human body communication devices, and the human body communication devices can be devices implanted into human bodies. For example, the human body communication device may include various pacemakers having a wireless communication function, bionic organs (e.g., artificial limbs, bionic eyes, artificial hearts, etc.), an implant chip or sensor, and so on. For convenience of description, the above-mentioned apparatuses may be collectively referred to as a human body communication device, a human body may be provided with a plurality of human body communication devices, the human body communication devices may implement devices for communicating with various sensors (e.g., a temperature sensor, a blood fat detection sensor, a blood sugar detection sensor, a blood pressure detection sensor, a blood temperature detection sensor, etc.) of the human body and various other human body communication devices of the human body, and a user may implant the human body communication device into the human body.
The following describes embodiments of the present application in detail.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a human body communication system disclosed in an embodiment of the present application, and as shown in fig. 1, the human body communication system 100 may include a virtual reality VR head-mounted display device 11, a first human body communication device 12 and a second human body communication device 13, the first human body communication device 12 is disposed on a target human body 20, the target human body 20 wears the VR head-mounted display device 11, and the second human body communication device 13 is disposed on a target object 30.
And the VR head-mounted display device 11 is used for receiving and displaying image information sent by the external device through the Internet. When the VR head-mounted display device 11 detects that the head of the user moves or the eyes of the user move, the displayed VR picture can be adjusted;
a first human body communication device 12 for determining that a first human body transmission path is formed between the first human body communication device 12 and the second human body communication device 13 in a case where the target human body 20 is in contact with the target object 30;
the first human body communication device 12 is further configured to receive the first image information sent by the second human body communication device 13 through the first human body transmission channel, and send the first image information to the VR head-mounted display apparatus 11 through the second human body transmission channel;
and the VR head-mounted display device 11 is used for displaying the image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between the position where the VR head-mounted display device 11 is contacted with the target human body 20 and the position where the first human body communication device 12 is contacted with the target human body 20.
The human body transmission channel is a transmission channel which adopts human body tissues (such as human body muscles, human body bones, human body blood and the like) as transmission media. The human body transmission channel may be used to transmit an electric field or an electromagnetic wave. The first human body transmission path is a transmission path formed by human body tissues of the target human body between the first human body communication device 12 and the second human body communication device 13.
The first image information may include image information of the target object (e.g., three-dimensional image information of the target object) and parameter information of the target object. For example, material information of the target object, size information of the target object (for example, length, width and height data of the target object), surface temperature information of the target object, and the like. The VR head-mounted display device 11 displaying the image corresponding to the first image information may include: the VR head-mounted display device 11 displays three-dimensional image information of the target object and parameter information of the target object. After the user wears the VR head-mounted display device 11, under the condition that the target human body 20 is in contact with the target object 30, images of the target object based on human body communication transmission can be displayed through the VR head-mounted display device, the reality of VR display is improved, and VR experience is improved. Because the image of the target object is transmitted through human body communication, the power consumption of the VR head-mounted display device can be reduced.
The target object may be an object having a human body communication function, such as a table, a stool, a chair, etc., having a human body communication transmission function.
Optionally, as shown in fig. 2, the first human body communication device 12 includes a human body communication chip 121, a coupler 122, and N electrodes, where the N electrodes are implanted at N different positions of the human body in a distributed manner, and N is an integer greater than or equal to 2.
The human body communication chip 121 may process the signal received by the coupler, or may process the signal to be transmitted and then transmit the processed signal to be transmitted through the coupler.
The first human body communication apparatus 12 receives a signal transmitted from another device through the coupler 122, and may transmit a signal to another device through the coupler.
Human Body Communication (HBC), also called intra-body communication (IBC), is understood to be a short-distance wireless communication mode, which uses the human body as a medium for information transmission, and uses the human body as a cable, the human body communication device may use a coupler to implement bidirectional data transmission, the coupler may include a transmitter (transmitter) and a receiver (receiver), and the coupler may connect a plurality of electrodes (electrodes), in this embodiment, the plurality of fingers are 2 or more than 2. The receiver can be used as an input device of a human body communication device, the human body communication device can be used as an output device of the human body device, the transmitter and the receiver are respectively connected with at least one electrode, wherein the connection mode can be wireless connection or wired connection, the coupler can input weak electric signals into the human body through the electrodes so as to realize information transmission, the electrodes can carry a sensor, or the electrodes can not carry a sensor, and the sensor can be used for detecting various physiological characteristics (such as blood vessel diameter, blood oxygen content, blood fat content and the like) of the human body and working parameters (such as current, voltage and the like) of the human body communication device. In a specific implementation, the human body communication device can be implanted in a human body.
Experiments prove that researches on the electric conduction capability of biological tissues show that along with the increase of signal frequency, the dielectric constant of most living tissues or organs is greatly reduced, and meanwhile, the electric conductivity is obviously improved, which means that human body communication is carried out at higher frequency so as to reduce the attenuation of signals in the communication process. However, when the frequency is increased, the wavelength of the signal is correspondingly shortened, and when the wavelength is close to the height of a person, the person can emit electromagnetic waves to the surroundings as a radio frequency antenna, so that the dissipation of the communication signal is caused, even the signal coupled through the air gradually exceeds the signal coupled through the person, and the signal with the too high frequency is not suitable for the person to communicate. Therefore, in most studies on human body communication, the signal frequency can be selected in the range of 10kHz to 100 MHz.
Couplers can be classified into capacitive coupling type couplers, current coupling type couplers and line coupling type couplers according to their operation principles.
Specifically, please refer to fig. 3A, fig. 3B and fig. 3C, in which fig. 3A is a schematic structural diagram of a capacitive coupling coupler disclosed in the present embodiment, fig. 3B is a schematic structural diagram of a current coupling coupler disclosed in the present embodiment, and fig. 3C is a schematic structural diagram of a line coupling coupler disclosed in the present embodiment. As shown in fig. 3A, the capacitive coupling coupler can generate an electric field in a human body by using oscillation of a transmitter, and a receiver detects a change of the electric field, thereby implementing human body communication. As shown in fig. 3B, the current-coupled coupler can realize intra-body communication by electromagnetic waves generated by 2 electrodes connected to the transmitter and 2 electrodes connected to the receiver. As shown in fig. 3C, the line-coupled coupler can use the receiver as an input and the transmitter as an output, and use the human body as a medium to generate current, thereby achieving the purpose of communication.
Optionally, the VR head-mounted display device may include a camera; VR head mounted display device passes through camera device and detects whether human and target object of target contact.
Optionally, the VR head-mounted display device may further include a processing device and a display device, where the camera device includes at least two cameras;
the VR head-mounted display equipment shoots at least two target object pictures through at least two cameras;
the VR head-mounted display equipment performs synthesis processing on at least two target object pictures through a processing device to generate second image information;
the VR head-mounted display device displays an image corresponding to the second image information through the display device.
The target object pictures are pictures of the target object at least two angles shot by at least two cameras, and the image corresponding to the second image information can be an image with three-dimensional stereoscopic impression.
Referring to fig. 4, fig. 4 is a flowchart illustrating an image display method according to an embodiment of the present disclosure, which can be applied to the human body communication system shown in fig. 1. As shown in fig. 4, the image display method includes the following steps.
In a case where the target human body is in contact with the target object, the first human body communication device determines that a first human body transmission channel is formed between the first human body communication device and the second human body communication device 401.
402, the first human body communication device receives the first image information sent by the second human body communication device through the first human body transmission channel, and sends the first image information to the VR head-mounted display device through the second human body transmission channel.
In this application embodiment, VR head mounted display device can be worn to the user that the target human body corresponds, watches the VR picture through VR head mounted display device. Wherein the image information corresponding to the VR picture can be transmitted by the external device. The VR head-mounted display device can be in communication connection with external equipment, and receives and displays image information sent by the external equipment. When the VR head mounted display device detects head movement or eye movement of a user, the VR picture displayed by the VR head mounted display device can be adjusted.
The first image information may include image information of the target object (e.g., three-dimensional image information of the target object) and parameter information of the target object, among others. For example, material information of the target object, size information of the target object (for example, length, width and height data of the target object), surface temperature information of the target object, and the like.
In the case where the target human body is in contact with the target object, the first human body communication device in the target human body may transmit a weak current signal, the first human body communication device may determine a current loop between the first human body communication device and the second human body communication device according to the weak current signal, and determine a human body tissue through which the current loop flows as a first human body transmission channel. The first human body communication device in the target human body receives the first image information transmitted by the second human body communication device through the first human body transmission channel.
Optionally, the surface of the target object may be provided with a sensing device for sensing whether a touch operation or a press operation is performed. When the target object senses a touch operation or a press operation, the second human body communication device in the target object can send a weak current signal outwards, the target object can determine a current loop between the first human body communication device and the second human body communication device according to the weak current signal, and the human body tissue flowing through the current loop is determined to be a first human body transmission channel. The second human-body communication device in the target object may transmit the first image information to the first human-body communication device through the first human-body transmission channel.
And 403, displaying the image corresponding to the first image information by the VR head-mounted display equipment, wherein the second human body transmission channel is a transmission channel formed by human body tissues between the position where the VR head-mounted display equipment is contacted with the target human body and the position where the first human body communication device is contacted with the target human body.
In the embodiment of the application, after the user wears the VR head-mounted display device, under the condition that the target human body is in contact with the target object, the image of the target object based on human body communication transmission can be displayed through the VR head-mounted display device, the sense of reality of VR display is improved, and VR experience is improved. Because the image of the target object is transmitted through human body communication, the power consumption of the VR head-mounted display device can be reduced.
Optionally, the first human body communication device includes a human body communication chip, a coupler, and N electrodes, where the N electrodes are implanted at N different positions of a human body in a distributed manner, and N is an integer greater than or equal to 2; in step 401, the first human body communication device determining that a first human body transmission channel is formed between the first human body communication device and the second human body communication device includes:
the first human body communication device determines a first contact part when a target human body is in contact with a target object through a human body communication chip; the first human communication device determines that the coupler, the N electrodes, and human tissue between the N electrodes and the first contact portion form a first human transmission channel.
In the embodiment of the application, when the target human body is in contact with the target object, a current loop may be formed between the ground terminal of the target object, the second human body communication device, the first contact portion when the target human body is in contact with the target object, the first human body communication device, and the ground terminal of the target human body. The body tissue through which the current loop passes may include a first body transmission channel. The first human body transport channel can be seen in fig. 1. The specific structure of the first human body communication device can be seen in fig. 2, and is not described in detail here.
Optionally, in step 402, before the first human body communication device sends the first image information to the VR head-mounted display device through the second human body transmission channel, the method may further include the following steps:
(11) the first human body communication device determines a second contact part when the target human body is in contact with the VR head-mounted display device;
(12) the first human communication device determines that the coupler, the N electrodes, and human tissue between the N electrodes and the second contact portion form a second human transmission channel.
In an embodiment of the application, the VR head mounted display device may include a ground terminal. After a user corresponding to a target human body wears the VR head-mounted display device, a current loop can be formed among the grounding end of the VR head-mounted display device, the grounding end of the target human body, the grounding end of the second contact part when the target human body contacts the VR head-mounted display device, the first human body communication device and the target human body, and human body tissues through which the current loop passes can comprise a second human body transmission channel. The second human body transmission channel can be seen in fig. 1. The specific structure of the first human body communication device can be seen in fig. 2, and is not described in detail here.
Referring to fig. 5, fig. 5 is a flowchart illustrating another image display method according to an embodiment of the present disclosure, which can be applied to the human body communication system shown in fig. 1. As shown in fig. 5, the image display method includes the following steps.
501, the VR head-mounted display device displays a VR picture through a display device.
The first human body communication device determines that a first human body transmission channel is formed between the first human body communication device and the second human body communication device in a case where the target human body is in contact with the target object 502.
503, the first human body communication device receives the first image information sent by the second human body communication device through the first human body transmission channel, and sends the first image information to the VR head-mounted display apparatus through the second human body transmission channel.
Step 502 and step 503 in the embodiment of the present application may refer to step 401 to step 402 shown in fig. 4, which are not described herein again.
And 504, the VR head-mounted display device displays a VR picture containing an image corresponding to the first image information through the display device, and the second human body transmission channel is a transmission channel formed by human body tissues between a position where the VR head-mounted display device is in contact with a target human body and a position where the first human body communication device is in contact with the target human body.
In an embodiment of the application, the VR screen may be received by the VR head-mounted display device from an external device via the internet. The external device is a device that can provide a VR screen to the VR head mounted display device.
The embodiment shown in fig. 5 may be applied to a scenario of remote video learning. For example, the learning efficiency of a user (e.g., a student) at home is low and is far lower than that of a school, a virtual learning environment is created for the user through the VR technology, so that the user can experience the learning environment at the school at home, for example, a bedroom of the user is simulated into a classroom, and the user can experience the learning environment in the classroom of the school at home. However, in the virtual simulation environment, if a user touches an object (e.g., a desk), the user cannot perceive what the object is in the real world unless the user takes off the head-mounted display, which is troublesome. Through human body communication, a child can directly contact the object, thereby sensing the original appearance of the object in the real world. This object can integrate human communication (transmission) device, and when user's hand touched this object, transmitted VR head mounted display device's receiving terminal through human communication, what alright know the object of contact this moment was the desk, can restore this desk true original appearance through VR head mounted display device simultaneously. For example, a desk in a classroom that a child sees in a virtual world is actually a stool in the real world, and at this time, the child only needs to touch the desk that is seen to know that the desk is actually a stool.
In this application embodiment, after the user wears VR head mounted display equipment, the user can show the VR picture through VR head mounted display equipment's display device, and under the condition that the target human body contacts with the target object, can show the VR picture that contains the image based on human communication transmission through VR head mounted display equipment, improves the sense of reality that the VR shows, improves VR experience. Because the image of the target object is transmitted through human body communication, the power consumption of the VR head-mounted display device can be reduced.
Referring to fig. 6, fig. 6 is a flowchart illustrating another image display method according to an embodiment of the present disclosure, which can be applied to the human body communication system shown in fig. 1. VR head mounted display device includes camera device. As shown in fig. 6, the image display method includes the following steps.
601, the VR head-mounted display device displays a VR picture through a display device.
602, the VR head-mounted display device detects whether the target human body contacts the target object through the camera device.
In this application embodiment, VR head mounted display equipment can shoot the picture of target human body and target object through camera device, and VR head mounted display equipment is according to this target human body and target object's picture analysis target human body and target object whether contact. Specifically, the VR head-mounted display device may analyze whether the target human body is in contact with the target object through an image processing algorithm.
603, the first human body communication device determines that a first human body transmission channel is formed between the first human body communication device and the second human body communication device in a case where the target human body is in contact with the target object.
604, the first human body communication device receives the first image information sent by the second human body communication device through the first human body transmission channel, and sends the first image information to the VR head-mounted display device through the second human body transmission channel.
605, the VR head-mounted display device displays, through the display device, a VR picture including an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between a position where the VR head-mounted display device is in contact with the target human body and a position where the first human body communication device is in contact with the target human body.
Step 603 and step 604 in the embodiment of the present application may refer to step 401 to step 402 shown in fig. 4, step 601 may refer to step 501 shown in fig. 5, and step 604 to step 605 may refer to step 503 to step 504 shown in fig. 5, which are not described again here.
Optionally, after step 602 is executed, the following steps may also be executed:
and under the condition that the target human body is disconnected from the target object, the VR head-mounted display equipment displays a VR picture which does not contain the image corresponding to the first image information through the display device.
In this embodiment, the image corresponding to the first image information may be an image of the target object. When the target human body is in contact with the target object, the VR head-mounted display device displays an image of the target object, and when the target human body is not in contact with the target object, the VR head-mounted display device does not display the image of the target object. Whether the image of the target object is displayed or not can be determined by whether the user touches the target object or not, and the VR interaction effect is improved.
Optionally, the VR head-mounted display device further includes a processing device and a display device, and the camera device includes at least two cameras; after the VR head-mounted display device displays the VR screen not including the image corresponding to the first image information through the display device, the following steps may be further performed:
(21) the VR head-mounted display equipment shoots at least two target object pictures through at least two cameras;
(22) the VR head-mounted display equipment performs synthesis processing on at least two target object pictures through a processing device to generate second image information;
(23) the VR head-mounted display equipment determines the similarity of the first image information and the second image information according to the first image information and the second image information;
(24) and when the similarity of the first image information and the second image information is greater than a preset similarity threshold, the VR head-mounted display equipment displays a VR picture containing an image corresponding to the second image information through the display device.
In this embodiment, the image corresponding to the first image information may be an image of the target object. The first image information is information that is acquired in advance by the target object (for example, image information of the target object provided by a designer of the target object), and accurately describes an image of the target object.
Under the condition that the target human body is not in contact with the target object, the VR head-mounted display device does not display an image corresponding to the first image information, and a camera device of the VR head-mounted display device can capture images within a visual field range of the VR head-mounted display device, for example, the VR head-mounted display device can capture at least two images of the target object through at least two cameras, and the VR head-mounted display device performs synthesis processing on the at least two images of the target object through the processing device to generate second image information; if the similarity between the first image information and the second image information is larger than a preset similarity threshold, the VR head-mounted display device can display a VR picture containing an image corresponding to the second image information or display a VR picture containing an image corresponding to the first image information through the display device.
In some scenes, after a user wears the VR head-mounted display device, the user touches a target object with a hand to obtain an image of the target object, and then the user may be difficult to touch the target object due to inconvenience in movement and the like, and the user may move the VR head-mounted display device (for example, the user may move the VR head-mounted display device by rotating the head), so that the camera of the VR head-mounted display device may automatically (for example, periodically) shoot pictures within the visual field of the VR head-mounted display device, and when the target object is captured, the image of the target object may be displayed again. To the image that corresponds at the image information that VR head mounted display device displayed through human communication transmission before, the user can show at the VR picture again through the mode that removes VR head mounted display device, improves user and VR head mounted display device's interactive effect, and then improves VR display effect.
The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the mobile terminal includes hardware structures and/or software modules for performing the respective functions in order to implement the above-described functions. Those of skill in the art will readily appreciate that the present invention can be implemented in hardware or a combination of hardware and computer software, with the exemplary elements and algorithm steps described in connection with the embodiments disclosed herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiment of the present application, the mobile terminal may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
Referring to fig. 7, fig. 7 is a schematic structural diagram of a human body communication device disclosed in the embodiment of the present application. As shown in fig. 7, the human body communication apparatus 700 includes a determining unit 701, a receiving unit 702, and a transmitting unit 703, wherein:
a determination unit 701 configured to determine that a first human body transmission channel is formed between the first human body communication device and the second human body communication device in a case where the target human body is in contact with the target object;
a receiving unit 702, configured to receive first image information sent by the second human body communication device through the first human body transmission channel;
a sending unit 703, configured to send the first image information to the VR head-mounted display device through a second human body transmission channel; the VR head-mounted display device is used for displaying an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between a position where the VR head-mounted display device is in contact with the target human body and a position where the first human body communication device is in contact with the target human body.
Optionally, the first human body communication device includes a human body communication chip, a coupler, and N electrodes, where the N electrodes are implanted at N different positions of a human body in a distributed manner, and N is an integer greater than or equal to 2; the determining unit 701 determines that a first human body transmission channel is formed between the first human body communication device and the second human body communication device, specifically: determining a first contact part when the target human body is in contact with the target object through the human body communication chip; determining that the coupler, the N electrodes, the human tissue between the N electrodes and the first contact site form the first human transmission channel.
Optionally, the determining unit 701 is further configured to determine a second contact portion when the target human body is in contact with the VR head-mounted display device before the sending unit 703 sends the first image information to the VR head-mounted display device through the second human body transmission channel; determining that the coupler, the N electrodes, and the human tissue between the N electrodes and the second contact site form the second human transmission channel.
The determining unit 701 shown in fig. 7 may specifically be a processor, the receiving unit 702 may specifically be a receiver, and the sending unit 703 may specifically be a transmitter.
By implementing the human body communication device shown in fig. 7, after a user wears the VR head-mounted display device, under the condition that a target human body is in contact with a target object, images of the target object based on human body communication transmission can be displayed through the VR head-mounted display device, so that the reality of VR display is improved, and VR experience is improved. Because the image of the target object is transmitted through human body communication, the power consumption of the VR head-mounted display device can be reduced.
Referring to fig. 8, fig. 8 is a schematic structural diagram of another human body communication device disclosed in the embodiment of the present application. As shown in fig. 8, the human body communication device 800 includes a processor 801 and a memory 802, wherein the human body communication device 800 may further include a bus 803, the processor 801 and the memory 802 may be connected to each other by the bus 803, and the bus 803 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus 803 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 8, but this is not intended to represent only one bus or type of bus. The memory 802 is used to store one or more programs containing instructions; the processor 801 is adapted to invoke instructions stored in the memory 802 to perform some or all of the method steps performed by the first human communication device of fig. 4-6 described above.
By implementing the human body communication device shown in fig. 8, after the user wears the VR head-mounted display device, under the condition that the target human body is in contact with the target object, the image of the target object based on human body communication transmission can be displayed through the VR head-mounted display device, so that the reality of VR display is improved, and the VR experience is improved. Because the image of the target object is transmitted through human body communication, the power consumption of the VR head-mounted display device can be reduced.
Embodiments of the present application also provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program causes a computer to execute a part or all of the steps of any one of the image display methods as described in the above method embodiments.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any one of the image display methods as described in the above method embodiments.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing embodiments of the present invention have been described in detail, and the principles and embodiments of the present invention are explained herein by using specific examples, which are only used to help understand the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (11)
1. An image display method is applied to a human body communication system, the human body communication system comprises a Virtual Reality (VR) head-mounted display device, a first human body communication device and a second human body communication device, the first human body communication device is arranged on a target human body, the target human body wears the VR head-mounted display device, and the second human body communication device is arranged on a target object; the method comprises the following steps:
the first human body communication device determining that a first human body transmission channel is formed between the first human body communication device and the second human body communication device in a case where the target human body is in contact with the target object;
the first human body communication device receives first image information sent by the second human body communication device through the first human body transmission channel, and sends the first image information to the VR head-mounted display equipment through the second human body transmission channel; the VR head-mounted display device is used for displaying an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between a position where the VR head-mounted display device is in contact with the target human body and a position where the first human body communication device is in contact with the target human body.
2. The method of claim 1, wherein the first human communication device comprises a human communication chip, a coupler, and N electrodes implanted distributed at N different locations of a human body, N being an integer greater than or equal to 2; the first human body communication device determining that a first human body transmission channel is formed between the first human body communication device and the second human body communication device, including:
the first human body communication device determines a first contact part when the target human body is in contact with the target object through the human body communication chip;
the first human communication device determines that the coupler, the N electrodes, human tissue between the N electrodes and the first contact site form the first human transmission channel.
3. The method of claim 2, wherein prior to the first human communication device sending the first image information to the VR head mounted display device via the second human transmission channel, the method further comprises:
the first human body communication device determining a second contact portion when the target human body is in contact with the VR head mounted display device;
the first human communication device determines that the coupler, the N electrodes, the human tissue between the N electrodes and the second contact site form the second human transmission channel.
4. A method according to any of claims 1-3, wherein before the first human communication device determines that a first human transmission channel is formed between the first human communication device and the second human communication device, the method further comprises:
the VR head-mounted display equipment displays a VR picture through the display device;
the VR head mounted display device displays an image corresponding to the first image information, including:
and the VR head-mounted display equipment displays a VR picture containing an image corresponding to the first image information through the display device.
5. The method of claim 4, wherein the VR head mounted display device includes a camera; before the first human body communication device determines that a first human body transmission channel is formed between the first human body communication device and the second human body communication device, the method further comprises:
the VR head-mounted display equipment detects whether the target human body is in contact with the target object through the camera device;
the first human body communication device performs the step of determining that a first human body transmission channel is formed between the first human body communication device and the second human body communication device in a case where the target human body is in contact with the target object.
6. The method of claim 5, wherein after the VR head mounted display device detects whether the target human body is in contact with the target object via the camera, the method further comprises:
and under the condition that the target human body is disconnected from the target object, the VR head-mounted display equipment displays a VR picture which does not contain the image corresponding to the first image information through the display device.
7. The method of claim 5, wherein the VR head mounted display device further comprises a processing device and a display device, the camera device comprising at least two cameras; after the VR head-mounted display device displays, through the display apparatus, a VR frame that does not include an image corresponding to the first image information, the method further includes:
the VR head-mounted display equipment shoots at least two target object pictures through the at least two cameras;
the VR head-mounted display equipment synthesizes the at least two target object pictures through the processing device to generate second image information;
the VR head-mounted display device determines similarity of the first image information and the second image information according to the first image information and the second image information;
and when the similarity between the first image information and the second image information is greater than a preset similarity threshold, the VR head-mounted display device displays a VR picture containing an image corresponding to the second image information or displays a VR picture containing an image corresponding to the first image information through the display device.
8. A human body communication system, comprising a Virtual Reality (VR) head-mounted display device, a first human body communication device disposed on a target human body wearing the VR head-mounted display device, and a second human body communication device disposed on a target object;
the first human body communication device is used for determining that a first human body transmission channel is formed between the first human body communication device and the second human body communication device under the condition that the target human body is in contact with the target object;
the first human body communication device is further used for receiving first image information sent by the second human body communication device through the first human body transmission channel and sending the first image information to the VR head-mounted display equipment through the second human body transmission channel;
the VR head-mounted display equipment is used for displaying an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between a position where the VR head-mounted display equipment is in contact with the target human body and a position where the first human body communication device is in contact with the target human body.
9. A human body communication apparatus, wherein the human body communication apparatus is used for a human body communication system including a virtual reality VR head mounted display device, a first human body communication apparatus provided on a target human body wearing the VR head mounted display device, and a second human body communication apparatus provided on a target object; the human body communication device includes:
a determination unit configured to determine that a first human body transmission channel is formed between the first human body communication device and the second human body communication device in a case where the target human body is in contact with the target object;
a receiving unit for receiving first image information transmitted by the second human body communication device through the first human body transmission channel;
a transmitting unit, configured to transmit the first image information to the VR head-mounted display device through a second human body transmission channel; the VR head-mounted display device is used for displaying an image corresponding to the first image information, and the second human body transmission channel is a transmission channel formed by human body tissues between a position where the VR head-mounted display device is in contact with the target human body and a position where the first human body communication device is in contact with the target human body.
10. A human body communication device comprising a processor and a memory for storing one or more programs configured for execution by the processor, the programs comprising instructions for performing the method performed by the first human body communication device as claimed in any one of claims 1 to 7.
11. A computer-readable storage medium for storing a computer program for electronic data exchange, wherein the computer program is adapted to make a computer perform the method as claimed in any of claims 1-7 performed by a first human communication device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911223034.6A CN112911271B (en) | 2019-12-03 | 2019-12-03 | Image display method, human body communication device, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911223034.6A CN112911271B (en) | 2019-12-03 | 2019-12-03 | Image display method, human body communication device, system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112911271A CN112911271A (en) | 2021-06-04 |
| CN112911271B true CN112911271B (en) | 2022-04-12 |
Family
ID=76104109
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911223034.6A Active CN112911271B (en) | 2019-12-03 | 2019-12-03 | Image display method, human body communication device, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112911271B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1102215A2 (en) * | 1999-11-17 | 2001-05-23 | Sony Corporation | Data transmission apparatus and data reception apparatus |
| CN102571215A (en) * | 2011-12-20 | 2012-07-11 | 中国科学院深圳先进技术研究院 | Health service network based on intra-body communication system |
| CN103997376A (en) * | 2014-06-10 | 2014-08-20 | 深圳先进技术研究院 | Data communication system and method for human body communication |
| CN104796168A (en) * | 2014-01-22 | 2015-07-22 | 凌通科技股份有限公司 | Biological contact type interactive entertainment system, wearing interactive system and data transmission circuit |
| CN105099893A (en) * | 2015-08-26 | 2015-11-25 | 深圳市冠旭电子有限公司 | Personal information exchange method and personal information exchange system |
| CN105357628A (en) * | 2015-11-18 | 2016-02-24 | 北京橙鑫数据科技有限公司 | Electronic card exchange method and system, and apparatuses |
| CN106507288A (en) * | 2016-11-29 | 2017-03-15 | 惠州Tcl移动通信有限公司 | A kind of information transferring method and intelligent terminal based on human body communication |
| CN106788780A (en) * | 2016-12-31 | 2017-05-31 | 歌尔科技有限公司 | The method and Intelligent worn device of a kind of electronic name card exchanging |
| CN110505023A (en) * | 2019-07-26 | 2019-11-26 | 华为技术有限公司 | A kind of exchange method of information, wearable device and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150257735A1 (en) * | 2013-10-24 | 2015-09-17 | Evena Medical, Inc. | Systems and methods for displaying medical images |
| US20190265473A1 (en) * | 2018-02-23 | 2019-08-29 | Oculus Vr, Llc | Apparatus, systems, and methods for enabling low-power communications via wearers' bodies |
-
2019
- 2019-12-03 CN CN201911223034.6A patent/CN112911271B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1102215A2 (en) * | 1999-11-17 | 2001-05-23 | Sony Corporation | Data transmission apparatus and data reception apparatus |
| CN102571215A (en) * | 2011-12-20 | 2012-07-11 | 中国科学院深圳先进技术研究院 | Health service network based on intra-body communication system |
| CN104796168A (en) * | 2014-01-22 | 2015-07-22 | 凌通科技股份有限公司 | Biological contact type interactive entertainment system, wearing interactive system and data transmission circuit |
| CN103997376A (en) * | 2014-06-10 | 2014-08-20 | 深圳先进技术研究院 | Data communication system and method for human body communication |
| CN105099893A (en) * | 2015-08-26 | 2015-11-25 | 深圳市冠旭电子有限公司 | Personal information exchange method and personal information exchange system |
| CN105357628A (en) * | 2015-11-18 | 2016-02-24 | 北京橙鑫数据科技有限公司 | Electronic card exchange method and system, and apparatuses |
| CN106507288A (en) * | 2016-11-29 | 2017-03-15 | 惠州Tcl移动通信有限公司 | A kind of information transferring method and intelligent terminal based on human body communication |
| CN106788780A (en) * | 2016-12-31 | 2017-05-31 | 歌尔科技有限公司 | The method and Intelligent worn device of a kind of electronic name card exchanging |
| CN110505023A (en) * | 2019-07-26 | 2019-11-26 | 华为技术有限公司 | A kind of exchange method of information, wearable device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112911271A (en) | 2021-06-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110349081B (en) | Image generation method and device, storage medium and electronic equipment | |
| CN106139587B (en) | Method and system for avoiding real environment obstacles based on VR game | |
| KR101945082B1 (en) | Method for transmitting media contents, apparatus for transmitting media contents, method for receiving media contents, apparatus for receiving media contents | |
| CN108509033B (en) | Information processing method and related product | |
| CN109451349A (en) | A kind of video broadcasting method, device and mobile terminal | |
| WO2018120657A1 (en) | Method and device for sharing virtual reality data | |
| JP7355006B2 (en) | Information processing device, information processing method, and recording medium | |
| US10537815B2 (en) | System and method for social dancing | |
| CN108924438A (en) | Filming control method and Related product | |
| CN107065197B (en) | Human eye tracking remote rendering real-time display method and system for VR glasses | |
| CN110780742B (en) | Eyeball tracking processing method and related device | |
| CN109218648A (en) | A kind of display control method and terminal device | |
| CN108876878B (en) | Head portrait generation method and device | |
| CN108491076B (en) | Display control method and related product | |
| US20180095532A1 (en) | Virtual Reality Head-Mounted Device | |
| CN110490897A (en) | Imitate the method and electronic equipment that video generates | |
| CN110536479A (en) | Object transmission method and electronic equipment | |
| CN109426343A (en) | Cooperation training method and system based on virtual reality | |
| WO2017061890A1 (en) | Wireless full body motion control sensor | |
| CN112911271B (en) | Image display method, human body communication device, system and storage medium | |
| CN110956571A (en) | SLAM-based virtual-real fusion method and electronic equipment | |
| CN112354185A (en) | Cloud game control system and cloud game control method | |
| CN105893452B (en) | Method and device for presenting multimedia information | |
| CN114220160A (en) | Anti-cheating remote examination equipment based on VR technology and use method thereof | |
| CN110706337B (en) | Virtual character image setting-based implementation method, intelligent sound box and intelligent terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |