WO2019033615A1

WO2019033615A1 - Method for displaying character string in virtual reality scene, and head-mounted display device

Info

Publication number: WO2019033615A1
Application number: PCT/CN2017/113974
Authority: WO
Inventors: 陈晨
Original assignee: 歌尔科技有限公司
Priority date: 2017-08-16
Filing date: 2017-11-30
Publication date: 2019-02-21
Also published as: CN107479842A

Abstract

Provided in the present invention are a method for displaying a character string in a virtual reality scene, and a head-mounted display device. The method comprises the following steps: when the length of a character string to be displayed is greater than the length of a text tag, selecting a starting character from the character string to be displayed one by one from left to right; in the character string to be displayed, selecting a character string starting from the starting character to be a target character string; and displaying the target character string in the text tag. The technical solution of the present invention implements the scrolling display of a character string in a text tag of a fixed length.

Description

Character string display method and head-mounted display device in virtual reality scene

cross reference

The present application is hereby incorporated by reference in its entirety in its entirety in its entirety in its entirety in the the the the the the the the the the the the the

Technical field

The present invention relates to the field of virtual reality technologies, and in particular, to a character string display method and a head mounted display device in a virtual display scene.

Background technique

Unity is a fully integrated professional game engine that is powerful and easy to use. With the development of VR (virtual reality) technology, more and more VR resources use Unity as a development platform.

In a VR scenario, the file path name, folder name, application name, and picture name associated with the VR resource often have too long a string content. In a VR scene, when a character string is displayed, if the character size is adjusted according to the human eye standard, a fixed-length text label can only display a limited number of characters, so that the character content beyond the length of the text label cannot be completely displayed; The length of the character is adjusted, and it is inevitable to reduce the size of the characters to display all the characters, resulting in a small character that cannot be seen clearly.

Therefore, how to display a string conforming to the human visual standard within a fixed-length text label has become an urgent problem to be solved.

Summary of the invention

The invention provides a character string display method and a head-mounted display device in a virtual display scene, which realizes a scroll display effect of a character string in a fixed length text label.

The present invention provides a method for displaying a character string in a virtual display scene, including:

When the length of the string to be displayed is greater than the length of the text label, one by one from left to right Selecting a starting character from the string to be displayed;

Select a string starting from the start character as the target string;

The target character string is displayed within the text label.

Further optionally, after displaying the target character string in the text label, the method further includes: when the rightmost character of the character string to be displayed is displayed in the text label, re-following from left to right The starting characters are sequentially selected one by one from the string to be displayed.

Further optionally, the method further includes: determining a length of the character string to be displayed according to the number of characters, a font, and a font size of the character string to be displayed.

Further optionally, displaying the target character string in the text label comprises: displaying the target character string to the left in the text label.

Further optionally, displaying the target character string in the text label includes: displaying, after detecting that the focus of the virtual camera in the VR scene falls within an area where the text label is located, displaying in the text label The target string.

The present invention also provides a head mounted display device including a memory and a processor;

The memory is configured to: store one or more computer instructions;

The processor is configured to execute the one or more computer instructions for: when the length of the character string to be displayed is greater than the length of the text label, select one by one from the left to right order a start character; a character string starting from the start character is selected as a target character string; and the target character string is displayed in the text tag.

Further optionally, the processor is further configured to: when the rightmost character of the to-be-displayed character string is displayed in the text label, re-send the character string to be displayed one by one from left to right Select the starting character.

Further optionally, the processor is further configured to: determine a length of the character string to be displayed according to the number of characters, a font, and a font size of the character string to be displayed.

Further optionally, the processor is configured to: display the target character string to the left in the text label.

Further optionally, the processor is further configured to: detect a virtual camera in the VR scene The focus falls on the area where the text label is located, and the target character string is displayed in the text label.

The character string display method and the head-mounted display device in the virtual reality scene provided by the present invention, when the length of the character string to be displayed is greater than the length of the text label, is selected from the string to be displayed one by one from left to right. The first character. Based on the start character, a character string starting from the start character is obtained as a target character string from the character string to be displayed and the target character string is displayed on the text label. With such a technical solution, the defect that the character string conforming to the human eye visual standard cannot be displayed in the fixed length text label in the prior art is solved, and the scroll display effect of the character string in the fixed length text label is realized.

DRAWINGS

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

1 is a flowchart of a method for displaying a character string in a virtual reality scene according to an embodiment of the present invention;

2a is a flowchart of a method for displaying a character string in another virtual reality scenario according to an embodiment of the present invention;

2b is a schematic diagram showing target strings displayed one by one in a text label according to an embodiment of the present invention;

3 is a schematic structural diagram of a head mounted display device according to an embodiment of the present invention;

FIG. 4 is a schematic diagram showing the internal configuration of the head mounted display device 400 in some embodiments provided by the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. The described embodiments are a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

1 is a flowchart of a method for displaying a character string in a virtual reality scene according to an embodiment of the present invention. Referring to FIG. 1, the method includes:

Step 101: When the length of the character string to be displayed is greater than the length of the text label, the starting characters are selected one by one from the left to right sequence.

Step 102: In the character string to be displayed, select a character string starting from the start character as a target character string.

Step 103: Display the target character string in the text label.

For step 101, the character string to be displayed includes letters, numbers, special symbols, and the like, and may be a file path name, a folder name, an application name, and a picture name that need to be displayed. The length of the string to be displayed indicates the amount of display space occupied by the string to be displayed.

A text label, which can be a display area for displaying a string. The length of the text label indicating the fixed size of the text label within which a certain number of characters having a particular style and font size can be accommodated and displayed.

The start character is the character in the string to be displayed. When the character string displayed in the text label is selected from the string to be displayed, the start character determines from which character to start.

Since the user usually reads in the order from left to right when reading characters, it can be considered that in a character string, the character on the left performs the information transfer mission with priority over the character on the right. Therefore, when the start character is selected from the characters to be displayed, it can be selected one by one in order from left to right. For example, when the start character is first selected from a character string to be displayed, the first character from the left of the character string to be displayed may be selected; when the start character is selected the second time, the character string to be displayed may be considered as the left word. The first character has been read by the user and does not need to be displayed. In this case, the second character from the left of the character string to be displayed can be selected as the starting character. And so on, no longer repeat them.

For step 102, the target string is a string for displaying directly on the text label, and the target string may be a string to be displayed or a part of the string to be displayed.

After the start character is determined, the character to be displayed on the left side of the start character in the character string to be displayed is discarded, and the character string starting from the start character in the character string to be displayed may be used as the target character string. For example, when the first character in the string to be displayed is the start character, the target character string is the character string to be displayed. When the second character in the string to be displayed is the start character, the target string is a string consisting of characters other than the leftmost character in the string to be displayed. Similarly, when the nth character in the string to be displayed is the start character, the target string is a string consisting of characters other than the n-1 character to the left of the nth character in the string to be displayed.

For step 103, after determining the target string, the target string is displayed within the text label. Optionally, the display order of the target string is associated with the corresponding starting character in the order in which the strings to be displayed are arranged. It can be considered that when the target character string is displayed in the text label, the target character string corresponding to the start character is displayed one by one according to the order of the start characters from left to right, and the two target character strings are displayed with a certain time interval. . Optionally, during the display process, the target string is always displayed to the left within the text label. Further, as the start character changes from left to right, the entire character string displayed in the text label is displayed to scroll left.

The character string display method provided in this embodiment, when the length of the character string to be displayed is greater than the length of the text label, selects the start character from the string to be displayed one by one in order from left to right. Based on the start character, a character string starting from the start character is obtained as a target character string from the character string to be displayed and the target character string is displayed on the text label. With such a technical solution, the defect that the character string conforming to the human eye visual standard cannot be displayed in the fixed length text label in the prior art is solved, and the scroll display effect of the character string in the fixed length text label is realized.

2a is a flowchart of a method for displaying a character string in another virtual reality scenario according to an embodiment of the present invention. Referring to FIG. 2a, the method includes:

Step 201: Determine a length of a character string to be displayed.

Step 202: Determine whether the length of the character string to be displayed is greater than the length of the text label. If yes, go to step 203; if no, display the character string to be displayed in the text label.

Step 203: In the string to be displayed, determine the word corresponding to the character in the order of increasing from left to right. Symbol number.

Step 204: Initialize the character number i=1.

Step 205: Select an ith character in the string to be displayed as the start character.

Step 206: In the character string to be displayed, select a character string starting from the start character as the target character string.

Step 207: The target character string is always displayed to the left in the text label.

Step 208: Determine whether the rightmost character of the character string to be displayed is displayed in the text label. If yes, go to step 204; if no, go to step 209.

Step 209, i=i+1, and step 205 is performed.

For step 201, optionally, the length of the character string to be displayed may be determined according to the number of characters, the font, and the font size of the character string to be displayed. Among them, the font may include the spacing between the characters in the string, the glyph of the character or whether the character has a bold attribute or the like. According to the font and the font size, the length of a single character can be determined, and the length of the character string to be displayed can be determined by combining the number of characters.

For step 202, after determining the length of the character string to be displayed, the length of the character to be displayed may be combined with the length of the text label to determine whether the length of the character to be displayed is greater than the length of the text label. If the length of the character to be displayed is less than or equal to the length of the text label, the text label can be considered as a complete display of the character string to be displayed. In this case, the character string to be displayed can be directly sent to the text label for display.

If the length of the character to be displayed is greater than the length of the text label, the text label may not be able to completely display the character string to be displayed. In this case, step 203 and subsequent steps may be performed to scroll the characters in the string to be displayed in the text label. Display to completely display the string to be displayed.

For step 203, the character number corresponding to the character is determined in descending order from left to right, and the leftmost character in the character string to be displayed is numbered 1, and the leftmost character is numbered 2, 3, ... in order. Where N is the total number of characters in the string to be displayed.

For step 206, after determining the start string, the start character and the character to the right of the start character can be used as the target string. For example, for a character string to be displayed containing 10 characters, the character number of the start character is 2, and the target character string is a character string consisting of characters numbered 2ˉ10 in the string to be displayed. If the character number of the start character is 5, the target character string is 5 to 10 in the string to be displayed. The character consists of a string.

For step 207, after determining the target string, the target string is always displayed to the left in the text label. It should be understood that as the starting characters change from left to right one by one, the target string also changes. If the target string is always displayed to the left, as the target string changes, the text label will render the string to be displayed continuously scrolling to the left.

FIG. 2b is a schematic diagram showing the target character strings displayed one by one in the text label according to the embodiment of the present invention; as shown in FIG. 2b, the character string to be displayed is: GaSfgw3E6wwGERE3WE6F. When the start character is selected one by one according to the order of characters from left to right, the first start character is G, and the corresponding first target character string is: GaSfgw3E6wwGERE3WE6F. The display effect of the first target string can be as shown in Fig. 2b. When the length of the text label is limited, the first target string cannot be completely displayed. The second starting character is a, and the corresponding second target string is: aSfgw3E6wwGERE3WE6F. Similarly, the start character is selected one by one according to the order of characters from left to right, and the third start character S, the fourth start character f, the fifth start character g, and the sixth start can be obtained. The character w and its corresponding target string are not described here.

For the step 208, in the embodiment, the start characters are selected one by one from left to right, and each time the operation of selecting the start character can be regarded as removing a character that has been displayed on the left side, thereby displaying a waiting in the text label. Displays undisplayed characters in the string. Therefore, this step can determine whether the character string to be displayed is completely displayed on the text label by determining whether the rightmost character of the character string to be displayed is displayed on the text label. If it is fully displayed, you do not need to remove the displayed characters.

If the rightmost character of the string to be displayed is already displayed on the text label, the string to be displayed is considered to be completely displayed. At this time, the display of the string can be paused, the current display state can be maintained, or the left-to-right position can be restarted. The starting characters are selected one by one in order.

Preferably, in order to form a continuous scrolling effect and improve the user's reading experience, in this embodiment, after the character string to be displayed has been completely displayed, step 204 may be performed to restart starting from left to right. The first character.

For step 209, if the rightmost character of the character string to be displayed has not been displayed in the text label, the selection of the start character string may be continued to remove the displayed character. Character to be displayed in the string The numbering order is incremented from left to right, so the character number of the next starting character is obtained by adding 1 to the character number of the current starting character. After the character number of the next start character is obtained, step 205 can be performed to select the start character from the string to be displayed and perform the subsequent steps.

In the above or below embodiments of the present invention, optionally, during the process of displaying the VR scene, it is possible to continuously detect whether the focus of the virtual camera (VR Camera) in the VR scene falls within the area where the text label is located. If it is detected that the focus of the virtual camera falls in the area where the text label is located, the user's line of sight falls on the text label, and the display process of the target character string can be started in the text label.

Optionally, if the focus of the VR camera is detected in the area where the text label is located, the implementation of the underlying technology may have the following feasible implementation manners: first, add a bounding box to the text label, and start with the location of the VRCamera. , create a ray along the direction of observation. The observation direction may be acquired according to a gyroscope, an inertial sensor, and/or a triaxial acceleration sensor on the VR wearing device, and further, the ray may change as the viewing direction of the user changes. Secondly, it is detected in real time whether the ray collides with the bounding box corresponding to the text label. If a collision is detected, the focus of the VR Camera can be considered to be in the area where the text label is located. Through this implementation manner, when the user views the text label, the scroll display text label is started, and the adaptive display of the character string is realized, thereby further improving the user's viewing experience.

FIG. 3 is a schematic structural diagram of a head mounted display device according to an embodiment of the present invention. Referring to FIG. 3, the device includes a memory 31 and a processor 32.

The memory 31 is configured to: store one or more computer instructions.

The processor 32 is configured to execute the one or more computer instructions for: when the length of the character string to be displayed is greater than the length of the text label, the character string to be displayed one by one in order from left to right Selecting a start character; selecting a character string starting from the start character as a target character string; displaying the target character string in the text label.

Further, the processor 32 is further configured to: when the rightmost character of the to-be-displayed character string is displayed in the text label, re-display the character to be displayed one by one from left to right. Select the starting character in the string.

Further optionally, the processor 32 is further configured to: determine the length of the character string to be displayed according to the number, the font and the font size of the character string to be displayed.

Further optionally, the processor 32 is configured to: display the target character string to the left in the text label.

Further optionally, the processor 32 is further configured to display the target character string in the text label when detecting that a focus of the virtual camera in the VR scene falls within an area where the text label is located.

Further optionally, the head mounted display device comprises: a virtual reality head mounted display device or an augmented reality head mounted display device.

The head-mounted display device of the present invention selects a start character from the to-be-displayed character string one by one in order from left to right when the length of the character string to be displayed is greater than the length of the text label. Based on the start character, a character string starting from the start character is obtained as a target character string from the character string to be displayed and the target character string is displayed on the text label. With such a technical solution, the defect that the character string conforming to the human eye visual standard cannot be displayed in the fixed length text label in the prior art is solved, and the scroll display effect of the character string in the fixed length text label is realized.

The electronic device provided by some embodiments of the present invention may be an external head mounted display device or an integrated head mounted display device, wherein the external head mounted display device needs to be used in conjunction with an external processing system (eg, a computer processing system).

FIG. 4 shows a schematic diagram of the internal configuration of the head mounted display device 400 in some embodiments.

The display unit 401 may include a display panel disposed on a side surface of the head mounted display device 400 facing the user's face, and may be a one-piece panel or left and right panels respectively corresponding to the left and right eyes of the user. The display panel may be an electroluminescence (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a laser-scanned display in which the retina may be directly displayed or similar.

The virtual image optical unit 402 photographs the image displayed by the display unit 401 in an enlarged manner and allows the user to observe the displayed image in the enlarged virtual image. As the display image outputted to the display unit 401, it may be an image of a virtual scene supplied from a content reproduction device (a Blu-ray disc or a DVD player) or a streaming server, or an image of a real scene photographed using an external camera 410. In some embodiments, virtual image optical unit 402 can include a lens unit, such as a spherical lens, an aspheric lens, a Fresnel lens, and the like.

The input operation unit 403 includes at least one operation member for performing an input operation, such as a button, a button, a switch, or other similarly functioned component, receives a user instruction through the operation member, and outputs an instruction to the control unit 407.

The status information acquisition unit 404 is configured to acquire status information of the user wearing the head mounted display device 400. The status information acquisition unit 404 may include various types of sensors for detecting status information by itself, and may acquire status information from an external device such as a smartphone, a wristwatch, and other multi-function terminals worn by the user through the communication unit 405. The status information acquisition unit 404 can acquire location information and/or posture information of the user's head. The status information acquisition unit 404 may include one or more of a gyro sensor, an acceleration sensor, a global positioning system (GPS) sensor, a geomagnetic sensor, a Doppler effect sensor, an infrared sensor, and a radio frequency field intensity sensor. Further, the state information acquisition unit 404 acquires state information of the user wearing the head-mounted display device 400, for example, acquires, for example, an operation state of the user (whether the user wears the head-mounted display device 400), an action state of the user (such as standing, walking, running) And the state of movement such as the state of the hand or fingertip, the open or closed state of the eye, the direction of the line of sight, the size of the pupil, the mental state (whether the user is immersed in observing the displayed image, and the like), or even the physiological state.

The communication unit 405 performs communication processing, modulation and demodulation processing with an external device, and encoding and decoding processing of the communication signal. In addition, the control unit 407 can transmit transmission data from the communication unit 405 to an external device. Communication can be in wired or wireless form, such as Mobile High Definition Link (MHL) or Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), Wireless Fidelity (Wi-Fi), Bluetooth communication or Bluetooth low energy communication, and mesh networks of the IEEE 802.11s standard. Additionally, communication unit 405 can be a cellular wireless transceiver that operates in accordance with Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and the like.

In some embodiments, the head mounted display device 400 can also include a storage unit, which is a mass storage device configured to have a solid state drive (SSD) or the like. In some embodiments, storage unit 406 can store applications or various types of data. For example, content viewed by the user using the head mounted display device 400 may be stored in the storage unit 406.

In some embodiments, the head mounted display device 400 can also include a control unit, and the control unit 407 can include a computer processing unit (CPU) or other device having similar functionality. In some embodiments, control unit 407 can be used to execute an application stored by storage unit 406, or control unit 407 can also be used to perform the methods, functions, and operations disclosed in some embodiments of the present application.

The image processing unit 408 is for performing signal processing such as image quality correction related to the image signal output from the control unit 407, and converting its resolution into a resolution according to the screen of the display unit 401. Then, the display driving unit 409 sequentially selects each row of pixels of the display unit 401, and sequentially scans each row of pixels of the display unit 401 line by line, thereby providing pixel signals based on the signal-processed image signals.

In some embodiments, the head mounted display device 400 can also include an external camera. The external camera 410 may be disposed on the front surface of the body of the head mounted display device 400, and the external camera 410 may be one or more. The external camera 410 can acquire three-dimensional information and can also be used as a distance sensor. Additionally, a position sensitive detector (PSD) or other type of distance sensor that detects reflected signals from the object can be used with the external camera 410. The external camera 410 and the distance sensor can be used to detect the body position, posture, and shape of the user wearing the head mounted display device 400. In addition, under certain conditions, the user can directly view or preview the real scene through the external camera 410.

In some embodiments, the head mounted display device 400 may further include a sound processing unit 411 that may perform sound quality correction or sound amplification of the sound signal output from the control unit 407, signal processing of the input sound signal, and the like. Then, the sound input/output unit 412 is after the sound processing Output sound to the outside and input sound from the microphone.

It should be noted that the structure or component illustrated by the dashed line in FIG. 4 may be independent of the head mounted display device 400, for example, may be disposed in an external processing system (eg, a computer system) for use with the head mounted display device 400; or The structure or components shown by the dashed box may be disposed inside or on the surface of the head mounted display device 400.

The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on such understanding, the above-described technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as ROM/RAM, magnetic Discs, optical discs, etc., include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.

It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not limited thereto; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments are modified, or the equivalents of the technical features are replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

A character string display method in a virtual reality scene, comprising:

When the length of the character string to be displayed is greater than the length of the text label, the starting characters are selected from the to-be-displayed character string one by one in order from left to right;

Select a string starting from the start character as the target string;

The target character string is displayed within the text label.
The method according to claim 1, wherein after displaying the target character string in the text label, the method further comprises:

When the rightmost character of the character string to be displayed is displayed in the text label, the start character is selected from the to-be-displayed character string one by one in order from left to right.
The method of claim 1 further comprising:

Determining the length of the character string to be displayed according to the number of characters, the font, and the font size of the character string to be displayed.
The method of claim 1 wherein displaying the target string within the text label comprises:

The target character string is always displayed to the left within the text label.
The method according to any one of claims 1 to 4, wherein displaying the target character string in the text label comprises:

When it is detected that the focus of the virtual camera in the VR scene falls within the area where the text label is located, the target character string is displayed in the text label.
A head mounted display device, comprising: a memory and a processor;

The memory is configured to: store one or more computer instructions;

The processor is configured to execute the one or more computer instructions for:

When the length of the character string to be displayed is greater than the length of the text label, the starting characters are selected from the to-be-displayed character string one by one in order from left to right;

Select a string starting from the start character as the target string;

The target character string is displayed within the text label.
The head-mounted display device according to claim 6, wherein the processor is further configured to:

When the rightmost character of the character string to be displayed is displayed in the text label, the start character is selected from the to-be-displayed character string one by one in order from left to right.
The head mounted display device of claim 6, wherein the processor is configured to:

The target character string is always displayed to the left within the text label.
A head mounted display device according to any one of claims 6-8, wherein

The processor is further configured to display the target character string in the text label when detecting that a focus of the virtual camera in the VR scene falls within an area where the text label is located.
The head mounted display device according to any one of claims 6-8, wherein the head mounted display device comprises: a virtual reality head mounted display device or an augmented reality head mounted display device.