CN114650443A - Playing method and device of head-mounted display equipment and head-mounted display equipment - Google Patents
Playing method and device of head-mounted display equipment and head-mounted display equipment Download PDFInfo
- Publication number
- CN114650443A CN114650443A CN202011506648.8A CN202011506648A CN114650443A CN 114650443 A CN114650443 A CN 114650443A CN 202011506648 A CN202011506648 A CN 202011506648A CN 114650443 A CN114650443 A CN 114650443A
- Authority
- CN
- China
- Prior art keywords
- user
- target object
- head
- playing
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 239000000463 material Substances 0.000 claims abstract description 27
- 238000005259 measurement Methods 0.000 claims abstract description 20
- 238000004590 computer program Methods 0.000 claims description 8
- 238000012216 screening Methods 0.000 claims description 4
- 238000012790 confirmation Methods 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims description 3
- 230000003993 interaction Effects 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000001960 triggered effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000011022 operating instruction Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to the field of wearable display equipment, in particular to a playing method and device of the wearable display equipment, head-mounted display equipment, computer equipment and a computer-readable storage medium, wherein the method comprises the following steps: acquiring real-time images of various objects in front of the vision of a user, and if the real-time images are matched with a first prestored image, determining that the object is a first target object; acquiring the actual measurement distance between a user and the first target object, and generating a playing instruction of introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold; and playing the introduction material corresponding to the first object on the head-mounted display equipment according to the playing instruction. The method and the device can provide a more free interaction mode for the user to use the head-mounted display equipment so as to improve the use experience of the user.
Description
Technical Field
The present application relates to the field of head-mounted display devices, and in particular, to a method and an apparatus for playing a head-mounted display device, a computer device, and a computer-readable storage medium.
Background
In the existing head-mounted display device, the related introduction materials can be played according to the content which can be seen by the user currently, such as landscape or articles. In the current playing mode, a user usually needs to click a corresponding control case through a handle to trigger the playing of the corresponding introduction material. In the above method for playing the introduction material of the head-mounted display device, when the user wears the head-mounted display device to view the played content, the user must use the hand to control the playing of the corresponding introduction material, and both hands cannot be liberated, so that the user cannot be provided with the most free interactive mode.
Disclosure of Invention
In order to overcome the technical problems, the following technical scheme is proposed in particular aiming at the problem that the existing head-mounted display equipment can not provide a free interaction mode for users:
in a first aspect, the present application provides a playing method for a head-mounted display device, which includes the following steps:
acquiring real-time images of various objects in front of the vision of a user, and if the real-time images are matched with a first prestored image, determining that the object is a first target object;
acquiring the actual measurement distance between a user and the first target object, and generating a playing instruction of introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold;
and playing the introduction data corresponding to the first target object on the head-mounted display equipment according to the playing instruction.
In a preferred embodiment provided by the first aspect, the step of acquiring a real-time image of an object in front of the user's vision includes:
shooting a visual front area of a user to acquire a real-time image of each object;
before the step of determining that the object is the first target object if the real-time image matches the first pre-stored image, the method further comprises:
and when the continuous presenting time length of the real-time image of any object reaches a first time threshold value, matching the real-time image of the object with a first pre-stored image.
In a preferred embodiment provided by the first aspect, before the step of generating the playing instruction of the introduction material corresponding to the first object, the method further includes:
when the continuous presenting duration of the real-time image of any object does not reach a second time threshold, deleting the real-time image of the object;
wherein the first time threshold is greater than the second time threshold.
In a preferred embodiment provided by the first aspect, the step of obtaining a measured distance between the user and the first target object includes:
acquiring user positioning information, and receiving object positioning information of a close-distance object within a preset distance from the user positioning information;
matching the second pre-stored image of the close-distance object with the first pre-stored image of the first target object, and screening out object positioning information of the first target object within a preset distance;
and calculating the actual measurement distance between the user and the first target object according to the object positioning information of the first target object and the user positioning information.
In a preferred embodiment provided by the first aspect, after the step of playing the introduction material corresponding to the first object on the display device according to the playing instruction, the method further includes:
acquiring a moving track of a user;
according to a distribution route map of a current display area and object positioning information of an unplayed object and the first target object, determining the unplayed object which is on the distribution route map and is closest to the first target object as a second target object, and generating forecast information of the second target object;
and playing the forecast information of the second target object on the head-mounted display equipment according to the forecast information.
In a preferred embodiment provided by the first aspect, the step of acquiring a movement track of the user includes:
acquiring object positioning information of an object passed by a user in the display area, and drawing according to the sequence of the user passing to obtain the moving track;
the positioning information of the entrance of the display area where the first target object is located is an origin coordinate, and the object positioning information corresponding to all objects in the display area is coordinate information set relative to the origin coordinate.
In a preferred embodiment provided by the first aspect, before the step of acquiring the movement track of the user, the method further includes:
when detecting that the current user positioning information is an origin coordinate, generating a tracking instruction;
and acquiring the positioning information of the user and the coordinate information of the object passed by the user according to the tracking instruction.
In a second aspect, the present application provides a playback apparatus for a head-mounted display device, including:
the first target object confirmation module is used for acquiring real-time images of various objects in front of the vision of the user, and if the real-time images are matched with a first pre-stored image, the objects are confirmed to be first target objects;
the playing instruction generating module is used for acquiring the actual measurement distance between a user and the first target object, and generating a playing instruction of the introduction material corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold;
and the playing module is used for playing the introduction material corresponding to the first object on the head-mounted display equipment according to the playing instruction.
In a preferred embodiment provided by the second aspect, the playing device of the head-mounted display apparatus further includes:
the mobile track acquisition module is used for acquiring a mobile track of a user;
the forecast information generating module is used for determining an unplayed object which is on the distribution route map and is closest to the first target object as a second target object according to the distribution route map of the current display area and the object positioning information of the unplayed object and the first target object, and generating forecast information of the second target object;
and the forecast module is used for playing forecast information of the second target object on the head-mounted display equipment according to the forecast information.
In a third aspect, the present application also provides a head mounted display device, comprising: the device comprises a front-mounted camera device, a positioning device, a display and a processor;
the front camera device is used for shooting real-time images of all objects in front of the vision of the user;
the positioning device is used for acquiring user positioning information of a user and receiving object positioning information in the display area;
the display is used for displaying real-time images of all objects in front of the vision of the user and playing introduction materials corresponding to the first target object;
the processor is configured to execute the playback method of the head-mounted display device according to any one of claims 1 to 7.
In a fourth aspect, an electronic device is provided, which includes:
one or more processors;
a memory;
one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to: the playing method of the head-mounted display device according to the first aspect of the embodiments of the present disclosure is implemented.
In a fifth aspect, a computer-readable storage medium is provided, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the playing method of the head-mounted display device according to the first aspect of the embodiments of the present disclosure.
Compared with the prior art, the application has the following beneficial effects:
according to the playing scheme of the head-mounted display equipment, the images of all objects in the real-time images are matched with the first prestored images through the currently acquired real-time images to confirm the obtained first target object; and when the detected measured distance between the user and the first target object is smaller than a set distance threshold, generating a playing instruction corresponding to the introduction data, and playing the introduction data corresponding to the first target object on the head-mounted display equipment according to the playing instruction. According to the scheme provided by the application, the user can obtain the first target object through the head-mounted display equipment, and can also automatically obtain the corresponding introduction material, so that a more free interaction mode for using the head-mounted display equipment is provided for the user, and the use experience of the user is improved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic flowchart illustrating a playing method of a head-mounted display device according to an embodiment of the present disclosure;
fig. 2 is a flowchart illustrating a playing method of a head-mounted display device according to another embodiment of the disclosure;
fig. 3 is a schematic diagram of a playing method of a head-mounted display device according to an embodiment of the disclosure;
fig. 4 is a schematic structural diagram of a playing device of a head-mounted display device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a playing apparatus of a head-mounted display device according to another embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device executing a playing method of a head-mounted display device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, or operations, but do not preclude the presence or addition of one or more other features, integers, steps, operations, or groups thereof.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
The playing method of the head-mounted display device provided by the application can be applied to the head-mounted display device. For a playing method capable of executing the head mounted display device provided by the present application, the present application provides a corresponding head mounted display device, which specifically includes: the device comprises a front-facing camera device, a positioning device, a display and a processor, wherein the front-facing camera device is used for shooting real-time images of all objects in front of the vision of a user; the positioning device is used for acquiring user positioning information of a user and receiving object positioning information in the display area; the display is used for displaying real-time images of all objects in front of the vision of the user and playing introduction materials corresponding to the first target object; the processor is used for executing the playing method of the head-mounted display device provided by the application.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a playing method of a head-mounted display device according to an embodiment of the present disclosure.
In order to more clearly explain the execution process of the playback method of the head-mounted display device, in the following detailed description of the playback method of the head-mounted display device, the head-mounted display device provided as above is taken as an execution subject for illustration. However, this illustration does not mean that the provided playing method of the head-mounted display device can only be applied to the provided head-mounted display device, and can also be applied to other devices composed of modules having the above functions; or by other modules of the head-mounted display device with the above functions.
As shown in fig. 1, an embodiment of the present application provides a playing method for a head-mounted display device, where the method includes the following steps:
s110: and acquiring real-time images of all objects in front of the vision of the user, and if the real-time images are matched with a first pre-stored image, determining that the objects are first target objects.
The playing method provided by the application is executed when the user wears the head-mounted display equipment.
The playback method provided in the present application is executed on the premise that the target object is confirmed. In an embodiment, a real-time image in front of the user's vision, that is, in front of the head-mounted display device, can be captured by a front camera of the head-mounted display device having a capturing function. And inputting the real-time image, acquiring each object in the real-time image, and matching the image of each object with the first pre-stored image. The first pre-stored image comprises pre-stored images corresponding to all introduction contents to be played.
And screening out an object corresponding to the playing content from the real-time image according to the matching result, and determining the object as a first target object played by the playing method.
In this embodiment, the object provided by the present application may be an exhibit in an exhibition place, and the exhibition place may be a museum, an exhibition, or the like; or may be the sights in the scenic spot or the identification of the sights. The first target object is an object that is present in the real-time image and that can be matched to a first pre-stored image.
S120: and acquiring the actual measurement distance between the user and the first target object, and generating a playing instruction of the introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold.
In this embodiment, the measured distance may be obtained by acquiring user positioning information of the user and object positioning information of the first target object through a positioning device of the head-mounted display device, and calculating the measured distance between the user and the first target object according to the positioning information of the user and the first target object.
The set distance threshold refers to a maximum distance sufficient to identify the first target object therein from the real-time image. And when the actual measurement distance is smaller than the set distance threshold, namely when the real-time image acquired by the user is far away from the first target object enough to identify the first target object, triggering to generate a playing instruction of the introduction data corresponding to the first target object according to the comparison result that the actual measurement distance is smaller than the set distance threshold.
In this embodiment, the introduction data corresponding to the first target object is stored corresponding to the first pre-stored image.
S130: and playing the introduction material corresponding to the first object on the head-mounted display equipment according to the playing instruction.
According to the playing command obtained in step S120, the introduction material is played on the head-mounted display device according to the attribute of the introduction material.
The attribute of the introduction material may refer to a format of the playing content. If wmv and avi are in a video format, or if tif and gif are in a picture format, the playing content can be played through a display of the head-mounted display device, and the playing content is added to the display, so that the playing video acquired by the playing picture can be superimposed on the real-time image acquired by the user through the head-mounted display device. If the format of the played content is an audio format such as wav and mp3, the corresponding audio content can be played through an audio playing device, and the audio playing device may be disposed on the head-mounted display device or may be an audio playing device that performs information interaction with the head-mounted display device. The audio playing device extracts the information of the first target object according to the received playing instruction, acquires the audio file of the corresponding introduction material, and plays the audio file through the audio playing device.
According to the playing method of the head-mounted display equipment, the images of all objects in the real-time images are matched with the first prestored images through the currently acquired real-time images, and the obtained first target object is confirmed; and when the detected measured distance between the user and the first target object is smaller than a set distance threshold, generating a playing instruction corresponding to the introduction data, and playing the introduction data corresponding to the first target object on the head-mounted display equipment according to the playing instruction. According to the scheme provided by the application, the user can obtain the first target object through the head-mounted display equipment, and can also automatically obtain the corresponding introduction material, so that a more free interaction mode for using the head-mounted display equipment is provided for the user, and the use experience of the user is improved.
On the premise of the above embodiment of the present application, the acquiring of the real-time images of the objects in front of the user' S vision in step S110 includes:
shooting a visual front area of a user to acquire a real-time image of each object;
based on this, before the step of determining that the object is the first target object if the real-time image matches the first pre-stored image in step S110, the method further includes:
and when the continuous presenting time length of the real-time image of any object reaches a first time threshold value, matching the real-time image of the object with a first pre-stored image.
In this embodiment, a front area of the vision of the user can be obtained by shooting through a front camera of the head-mounted display device, and a real-time image is obtained, where the real-time image may include a plurality of objects, and the objects may include corresponding objects that can be matched with the first pre-stored image and cannot be successfully matched. The real-time image can be decomposed into real-time images of the objects by using the difference of the depths of field of the objects in the real-time image.
In the same time period, real-time images of a plurality of continuous frames are acquired. And obtaining the presenting time length of each object in the real-time images according to the continuous frames of real-time images. And if the presenting time length of the object appearing in the real-time image reaches a first time threshold value, the user is acquiescent to watch the corresponding object. The real-time image of the object is matched with a first pre-stored image.
The object currently watched by the user is confirmed by the time length of each object in the acquired real-time image, and the object is further matched with the first prestored image, so that the data processing amount increased by matching all the objects in the real-time image can be avoided.
Correspondingly, before the step of generating the playing instruction of the introduction material corresponding to the first object in step S120, the method further includes:
when the continuous presenting duration of the real-time image of any object does not reach a second time threshold, deleting the real-time image of the object;
wherein the first time threshold is greater than the second time threshold.
Before generating the playing instruction corresponding to the first target object, determining the presenting time length of each object in the real-time image to compare with a second time threshold value by using the mode of obtaining the presenting time length of the object in the real-time image. The second time threshold is smaller than the first time threshold, and the second time threshold is used for measuring whether the time length of the corresponding object appearing in the real-time image is too short or not so as to judge that the corresponding object is not the object to be watched by the user. And if the continuous presenting time of the real-time image of the object does not reach the second time threshold, triggering the real-time image corresponding to the object to be deleted so as to save the data storage space.
For the step of obtaining the measured distance between the user and the first target object in step S120, the method includes:
acquiring user positioning information, and receiving object positioning information of a close-distance object within a preset distance from the user positioning information;
matching the second pre-stored image of the close-distance object with the first pre-stored image of the first target object, and screening out object positioning information of the first target object within a preset distance;
and calculating the actual measurement distance between the user and the first target object according to the object positioning information of the first target object and the user positioning information.
In this embodiment, the positioning device of the head-mounted display apparatus may be utilized to determine user positioning information of a user and receive object positioning information of each object. The preset distance can be set according to the identification parameters of the display device of the head-mounted display equipment and/or the data such as the general viewing range of the user, so as to confirm the identification range of the first object, thereby ensuring that the first object can be clearly identified and can be clearly seen by the user.
Specifically, according to the user positioning information, object positioning information of each object within a range of a preset distance from the user positioning information is obtained, and object positioning information of objects within the preset distance from the user positioning information is obtained through calculation of the two positioning information. In this embodiment, since the object identified by the positioning information does not necessarily appear in the real-time image, the object within the preset distance from the user positioning information is set as a close-distance object for easy discrimination.
For a short-distance object capable of acquiring the object positioning information thereof, a corresponding pre-stored image is also set corresponding to the object positioning information, and in this embodiment, the pre-stored image of the short-distance object is set as a second pre-stored image.
And matching the first target object determined by the real-time image with the second target object determined by the positioning information, specifically matching the corresponding first pre-stored image with the corresponding second pre-stored image. If the two are identical, the object is both present in the real-time image and can be clearly recognized and clearly seen by the user. And confirming the matched first target object as the unique first target object, and calculating the measured distance between the user and the unique first target object.
If more than one first target object is determined, the first target object with the minimum measured distance is determined as the only first target object.
Referring to fig. 2, fig. 2 is a flowchart illustrating a playing method of a head-mounted display device according to another embodiment of the present disclosure.
After step S130, the method further includes:
s140, acquiring a movement track of a user;
s150, according to the distribution route of the current display area and the object positioning information of the unplayed object and the first target object within a set distance value, determining the object which is on the distribution route and is closest to the first target object as a second target object, and generating forecast information of the second target object;
and S160, playing the forecast information of the second target object on the head-mounted display equipment according to the forecast information.
The display area is an area where all objects capable of being matched with the first pre-stored image are located, and in the following description of the embodiment of the movement trajectory, the objects capable of being matched with the first pre-stored image become displayed objects. If the exhibition area is a museum, the exhibited objects are all exhibits in the museum.
When a user passes through an object, a movement track of the user is formed according to user positioning information of the user, and in this embodiment, the movement track is named as a movement track.
And obtaining a distribution route map of the display area where the user is located according to the user positioning information of the user. And in the display area, the displayed objects are distributed on the corresponding distribution route in the distribution route map.
According to the object positioning information of the first object determined by the user and the object positioning information of the objects which are not played in the display area, the objects which are not played and are closest to the first object are determined as second objects by contrasting the distribution route map. The determined second target object is actually a result of predicting an object which is viewed next by the user according to the distribution route map of the display area.
And generating corresponding forecast information according to the determined second target object. The forecast information may include: the relative position information of the second target object and the current first target object, the first pre-stored image and the related information of the second target object, the displayed object corresponding to the next watching and the like are conveniently recommended to the user.
If the unplayed object is an object with different categories, preferentially recommending an object with the same category attribute as the first object as the second object according to the category attribute of the unplayed object and the first object, or preferentially recommending an object with a higher association degree with the first object as the second object according to the association degree of the theme. And finally determining the recommended second target object by combining the measured distance between the first target object and the second target object.
Referring to fig. 3, fig. 3 is a schematic diagram of a playing method of a head-mounted display device according to an embodiment of the present disclosure.
As shown in FIG. 3, the first target object is labeled T1. The first target object is set as a class A object, and the obtained unplayed objects comprise the class A object and a class B object. In fig. 3, the unplayed class a object and unplayed class B object are labeled as a and B, respectively. And temporarily setting the unplayed A-class object as the second target object according to the class attribute, obtaining the actual measurement distance between the second target object and the distribution route map according to the object positioning information of the second target object and the first target object, and judging whether the second target object is suitable for being used as the second target object. If the measured distance between the first target object and the unplayed class B object is much smaller than the measured distance between the first target object and the unplayed class a object and the measured distance between the first target object and the unplayed class B object meets the condition that the first target object is closest to the first target object, the unplayed class B object can be determined as a second target object.
The step of step S140 may further include:
acquiring object positioning information of an object passed by a user in the display area, and drawing according to the sequence of the user passing to obtain the moving track;
the entrance of the display area where the first target object is located is an origin coordinate, and the object positioning information corresponding to all objects in the display area is coordinate information set relative to the origin coordinate.
The user moves in the display area and watches the displayed objects, which all pass through different displayed objects. And object positioning information corresponding to different displayed objects. According to the route traveled by the user, the objects marked as T1, T2 and T3 in fig. 3 are the routes formed by the displayed objects that have been traveled and viewed by the user, and the routes include the object positioning information of the passed displayed objects and the passing sequence of each displayed object, so that the moving track is depicted, such as the track represented by the black and thick line in fig. 3.
In this embodiment, the positioning information of the entrance of the display area where the first target object, that is, the object for display, is located may be set as the origin coordinate, such as the O point (0, 0) in fig. 3. With respect to the positioning information of the entrance, object positioning information corresponding to all objects in the display area where the object is located is set, and the object positioning information of the displayed object 10 meters away from the entrance is set to (10, 0), as shown by the displayed object corresponding to the mark T1 in fig. 3.
Further, before step S140, the method further includes:
when detecting that the current user positioning information is an origin coordinate, generating a tracking instruction;
and acquiring the positioning information of the user and the coordinate information of the object passed by the user according to the tracking instruction.
In the two steps, according to the setting of the positioning information of the display area, if the current user positioning information is detected to be the origin coordinate, the user is identified and obtained to start entering the display area. Then, generation of the tracking command is triggered by generation of the origin coordinates. According to the tracking instruction, a positioning function of the head-mounted display device is triggered, in the embodiment, the starting of the positioning device is triggered according to the tracking instruction, and the real-time user positioning information of the user and the coordinate information of the object passed by the user are acquired.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a playing device of a head-mounted display device according to an embodiment of the present disclosure.
As shown in fig. 4, in another embodiment, the present application provides a playback apparatus 400 of a head-mounted display device, including:
a first target object confirmation module 410, configured to obtain real-time images of each object in front of the user's vision, and if the real-time images match with a first pre-stored image, confirm that the object is a first target object;
a playing instruction generating module 420, configured to obtain an actual measurement distance between a user and the first target object, and generate a playing instruction of introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold;
the playing module 430 is configured to play the introductory material corresponding to the first object on the head-mounted display device according to the playing instruction.
Referring to fig. 5, fig. 5 is a schematic structural diagram of a playing device of a head-mounted display apparatus according to another embodiment of the present application.
The playing apparatus 400 of the head-mounted display device provided above further includes:
a moving track obtaining module 440, a forecast information generating module 450 and a forecast module 460.
The moving track acquiring module 440 is configured to acquire a moving track of a user;
a forecast information generating module 450, configured to determine, according to a distribution route map of a current display area and object location information of an unplayed object and the first target object, an unplayed object that is on the distribution route map and is closest to the first target object as a second target object, and generate forecast information of the second target object;
and the forecast module 460 is configured to play the forecast information of the second target object on the head-mounted display device according to the forecast information.
Based on the same principle as the method shown in the embodiment of the present application, an embodiment of the present application further provides an electronic device, which may include but is not limited to: a processor and a memory; a memory for storing computer operating instructions; and the processor is used for executing the method shown in the embodiment by calling the computer operation instruction. Compared with the prior art, the electronic device in the embodiment of the application enables a user to obtain the first object through the head-mounted display device, and also can automatically obtain the corresponding introduction material, so that a more free interaction mode for using the head-mounted display device is provided for the user, and the use experience of the user is improved.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an electronic device for executing a playing method of a head-mounted display device according to an embodiment of the present disclosure.
In an alternative embodiment, an electronic device is provided, as shown in fig. 6, the electronic device 600 shown in fig. 6 comprising: a processor 601 and a memory 603. Wherein the processor 601 is coupled to the memory 603, such as via a bus 602. Optionally, the electronic device 600 may also include a transceiver 604. It should be noted that the transceiver 604 is not limited to one in practical applications, and the structure of the electronic device 600 is not limited to the embodiment of the present application.
Among them, electronic devices include but are not limited to: mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
The present application provides a computer-readable storage medium, on which a computer program is stored, which, when running on a computer, enables the computer to execute the corresponding content in the foregoing method embodiments. Compared with the prior art, the computer-readable storage medium in the embodiment of the application enables a user to obtain the first object through the head-mounted display device, and also can automatically obtain the corresponding introduction material, so that a more free interaction mode for using the head-mounted display device is provided for the user, and the use experience of the user is improved.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above embodiments.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the spirit of the disclosure. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.
Claims (12)
1. A playing method of a head-mounted display device is characterized by comprising the following steps:
acquiring real-time images of various objects in front of the vision of a user, and if the real-time images are matched with a first prestored image, determining that the object is a first target object;
acquiring the actual measurement distance between a user and the first target object, and generating a playing instruction of introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold;
and playing the introduction material corresponding to the first object on the head-mounted display equipment according to the playing instruction.
2. The method of claim 1, wherein the step of obtaining a real-time image of an object in front of the user's vision comprises:
shooting a visual front area of a user to acquire a real-time image of each object;
before the step of determining that the object is the first target object if the real-time image matches the first pre-stored image, the method further comprises:
and when the continuous presenting time length of the real-time image of any object reaches a first time threshold value, matching the real-time image of the object with a first pre-stored image.
3. The method according to claim 2, wherein the step of generating the playing instruction of the introduction material corresponding to the first object further comprises:
when the continuous presenting duration of the real-time image of any object does not reach a second time threshold, deleting the real-time image of the object;
wherein the first time threshold is greater than the second time threshold.
4. The method of claim 1,
the step of obtaining the measured distance between the user and the first target object includes:
acquiring user positioning information, and receiving object positioning information of a close-distance object within a preset distance from the user positioning information;
matching the second pre-stored image of the close-distance object with the first pre-stored image of the first target object, and screening out object positioning information of the first target object within a preset distance;
and calculating the actual measurement distance between the user and the first target object according to the object positioning information of the first target object and the user positioning information.
5. The method of claim 1,
after the step of playing the introduction material corresponding to the first object on the display device according to the playing instruction, the method further includes:
acquiring a moving track of a user;
according to a distribution route map of a current display area and object positioning information of an unplayed object and the first target object, confirming an unplayed object which is on the distribution route map and is closest to the first target object as a second target object, and generating forecast information of the second target object;
and playing the forecast information of the second target object on the head-mounted display equipment according to the forecast information.
6. The method of claim 5,
the step of obtaining the movement track of the user comprises the following steps:
acquiring object positioning information of an object passed by a user in the display area, and drawing according to the sequence of the user passing to obtain the moving track;
the positioning information of the entrance of the display area where the first target object is located is an origin coordinate, and the object positioning information corresponding to all objects in the display area is coordinate information set relative to the origin coordinate.
7. The method of claim 6,
before the step of obtaining the movement track of the user, the method further comprises:
when detecting that the current user positioning information is an origin coordinate, generating a tracking instruction;
and acquiring the positioning information of the user and the coordinate information of the object passed by the user according to the tracking instruction.
8. A playback apparatus for a head-mounted display device, comprising:
the first target object confirmation module is used for acquiring real-time images of various objects in front of the vision of the user, and if the real-time images are matched with a first pre-stored image, the objects are confirmed to be first target objects;
the playing instruction generating module is used for acquiring the actual measurement distance between a user and the first target object, and generating a playing instruction of the introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold;
and the playing module is used for playing the introduction material corresponding to the first object on the head-mounted display equipment according to the playing instruction.
9. The apparatus of claim 8, further comprising:
the mobile track acquisition module is used for acquiring a mobile track of a user;
the forecast information generating module is used for determining an unplayed object which is on the distribution route map and is closest to the first target object as a second target object according to the distribution route map of the current display area and the object positioning information of the unplayed object and the first target object, and generating forecast information of the second target object;
and the forecast module is used for playing forecast information of the second target object on the head-mounted display equipment according to the forecast information.
10. A head-mounted display device, comprising: the device comprises a front-mounted camera device, a positioning device, a display and a processor;
the front camera device is used for shooting real-time images of all objects in front of the vision of the user;
the positioning device is used for acquiring user positioning information of a user and receiving object positioning information in the display area;
the display is used for displaying real-time images of all objects in front of the vision of the user and playing introduction materials corresponding to the first target object;
the processor is configured to execute the playback method of the head-mounted display device according to any one of claims 1 to 7.
11. An electronic device, comprising:
one or more processors;
a memory;
one or more computer programs, wherein the one or more computer programs are stored in the memory and configured to be executed by the one or more processors, the one or more computer programs configured to perform the playback method for a head-mounted display device according to any one of claims 1 to 7.
12. A computer-readable storage medium, having a computer program stored thereon, which, when executed by a processor, implements the playback method of the head-mounted display device according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011506648.8A CN114650443B (en) | 2020-12-18 | 2020-12-18 | Playing method and device of head-mounted display device and head-mounted display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011506648.8A CN114650443B (en) | 2020-12-18 | 2020-12-18 | Playing method and device of head-mounted display device and head-mounted display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114650443A true CN114650443A (en) | 2022-06-21 |
| CN114650443B CN114650443B (en) | 2024-04-19 |
Family
ID=81990035
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011506648.8A Active CN114650443B (en) | 2020-12-18 | 2020-12-18 | Playing method and device of head-mounted display device and head-mounted display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114650443B (en) |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309034A (en) * | 2012-03-07 | 2013-09-18 | 精工爱普生株式会社 | Head-mounted display device and control method for the head-mounted display device |
| CN105681918A (en) * | 2015-09-16 | 2016-06-15 | 乐视致新电子科技（天津）有限公司 | Method and system for presenting article relevant information in video stream |
| US20160316196A1 (en) * | 2015-04-27 | 2016-10-27 | Kevin J. MacKenzie | Stereoscopic display of objects |
| US20170103572A1 (en) * | 2015-10-07 | 2017-04-13 | Institute For Information Industry | Head mounted device and guiding method |
| US20170111588A1 (en) * | 2015-10-14 | 2017-04-20 | Qualcomm Incorporated | Constant field of view for image capture |
| WO2017113194A1 (en) * | 2015-12-30 | 2017-07-06 | 深圳市柔宇科技有限公司 | Head-mounted display apparatus, head-mounted display system, and input method |
| US20170287007A1 (en) * | 2016-04-03 | 2017-10-05 | Integem Inc. | Real-time and context based advertisement with augmented reality enhancement |
| CN107767460A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | The methods of exhibiting and device of augmented reality |
| CN107885823A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | Player method, device, storage medium and the electronic equipment of audio-frequency information |
| WO2019196133A1 (en) * | 2018-04-09 | 2019-10-17 | 杭州瑞杰珑科技有限公司 | Head-mounted visual aid device |
| CN110430459A (en) * | 2019-07-22 | 2019-11-08 | 上海掌门科技有限公司 | Video name card display method and apparatus |
| WO2020001151A1 (en) * | 2018-06-26 | 2020-01-02 | 朱光 | Split-type head-mounted display system and interaction method |
| CN110811537A (en) * | 2019-11-12 | 2020-02-21 | 赵成玉 | Functional glasses system |
| CN111510701A (en) * | 2020-04-22 | 2020-08-07 | Oppo广东移动通信有限公司 | Virtual content display method and device, electronic equipment and computer readable medium |
| CN111580652A (en) * | 2020-05-06 | 2020-08-25 | Oppo广东移动通信有限公司 | Control method and device for video playing, augmented reality equipment and storage medium |
-
2020
- 2020-12-18 CN CN202011506648.8A patent/CN114650443B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309034A (en) * | 2012-03-07 | 2013-09-18 | 精工爱普生株式会社 | Head-mounted display device and control method for the head-mounted display device |
| US20160316196A1 (en) * | 2015-04-27 | 2016-10-27 | Kevin J. MacKenzie | Stereoscopic display of objects |
| CN105681918A (en) * | 2015-09-16 | 2016-06-15 | 乐视致新电子科技（天津）有限公司 | Method and system for presenting article relevant information in video stream |
| US20170103572A1 (en) * | 2015-10-07 | 2017-04-13 | Institute For Information Industry | Head mounted device and guiding method |
| US20170111588A1 (en) * | 2015-10-14 | 2017-04-20 | Qualcomm Incorporated | Constant field of view for image capture |
| WO2017113194A1 (en) * | 2015-12-30 | 2017-07-06 | 深圳市柔宇科技有限公司 | Head-mounted display apparatus, head-mounted display system, and input method |
| US20170287007A1 (en) * | 2016-04-03 | 2017-10-05 | Integem Inc. | Real-time and context based advertisement with augmented reality enhancement |
| CN107767460A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | The methods of exhibiting and device of augmented reality |
| CN107885823A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | Player method, device, storage medium and the electronic equipment of audio-frequency information |
| WO2019196133A1 (en) * | 2018-04-09 | 2019-10-17 | 杭州瑞杰珑科技有限公司 | Head-mounted visual aid device |
| WO2020001151A1 (en) * | 2018-06-26 | 2020-01-02 | 朱光 | Split-type head-mounted display system and interaction method |
| CN110430459A (en) * | 2019-07-22 | 2019-11-08 | 上海掌门科技有限公司 | Video name card display method and apparatus |
| CN110811537A (en) * | 2019-11-12 | 2020-02-21 | 赵成玉 | Functional glasses system |
| CN111510701A (en) * | 2020-04-22 | 2020-08-07 | Oppo广东移动通信有限公司 | Virtual content display method and device, electronic equipment and computer readable medium |
| CN111580652A (en) * | 2020-05-06 | 2020-08-25 | Oppo广东移动通信有限公司 | Control method and device for video playing, augmented reality equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114650443B (en) | 2024-04-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106331732B (en) | Generate, show the method and device of panorama content | |
| CN104620522B (en) | User interest is determined by detected body marker | |
| CN107872731B (en) | Panoramic video playing method and device | |
| US10488195B2 (en) | Curated photogrammetry | |
| CN109040297B (en) | User portrait generation method and device | |
| US9100667B2 (en) | Life streaming | |
| CN109313812A (en) | Sharing experience with context enhancing | |
| CN110163066B (en) | Multimedia data recommendation method, device and storage medium | |
| CN108198098B (en) | Self-service tourism method and mobile terminal | |
| US8611725B2 (en) | Playback display device, image capturing device, playback display method, and storage medium | |
| CN110215706B (en) | Method, device, terminal and storage medium for determining position of virtual object | |
| CN111432245B (en) | Multimedia information playing control method, device, equipment and storage medium | |
| CN111291200B (en) | Multimedia resource display method and device, computer equipment and storage medium | |
| KR102466526B1 (en) | Electronic device for tagging event on sports play video and operating method thereof | |
| CN112860059A (en) | Image identification method and device based on eyeball tracking and storage medium | |
| CN109947988B (en) | Information processing method and device, terminal equipment and server | |
| CN114650443B (en) | Playing method and device of head-mounted display device and head-mounted display device | |
| KR20150047694A (en) | Electronic device and method for providing advertisement data in electronic device | |
| CN114299809B (en) | Direction information display method, display device, electronic apparatus, and readable storage medium | |
| JP2011239158A (en) | User reaction estimation apparatus, user reaction estimation method and user reaction estimation program | |
| CN115905374A (en) | Application function display method and device, terminal and storage medium | |
| US20040027365A1 (en) | Controlling playback of a temporal stream with a user interface device | |
| CN111292773A (en) | Audio and video synthesis method and device, electronic equipment and medium | |
| TW202005407A (en) | System for displaying hint in augmented reality to play continuing film and method thereof | |
| JP2014110560A (en) | Information processing unit, server device, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |