TWI650702B - Displaying and operating system for resume with using augmented reality and method thereof - Google Patents

Abstract

A history display and operating system and method for applying augmented reality, wherein the history of the handheld device capture portion is an original image, and the corresponding resume field is determined according to the combined image, and the resumed field is determined according to the determined history field. Corresponding augment history information, the augmentation history information is overlaid on the combined image to generate a display image and displayed. When the augmentation history information is touch-operated, the handheld device performs a corresponding presentation state according to the type of the augmented history information. Thereby, the technical effect of providing resume display and operation in the form of augmented reality can be achieved.

Description

Application of augmented reality history display and operating system and method thereof

[0001] A display and operating system and method thereof, and more particularly to a display and operating system and method thereof for providing a history through an augmented reality form.

[0002] In the past, job seekers generally used resumes to apply for jobs. Through the fields provided by the resumes, employers can initially understand the basic information, abilities, personality, etc. of job seekers. Resumes are indispensable for both job seekers. Appliances, however, in order to further understand the job seekers, there is a growing number of resumes required by the job seekers, and more and more paper is consumed by the resumes. [0003] In view of the rapid development of science and technology, the fastest-growing technology is inevitably related to the technology of handheld devices. The applications developed with handheld devices are also mushrooming and expanding. Augmented Reality, AR) is a technology for providing handheld devices. The augmented reality refers to the image position and angle acquired by the image capture device of the handheld device, and the image analysis technology is added to the handheld device. The technique in which the displayed virtual world can be combined and interacted with the real world scene, the present invention is expected to provide a more succinct display and operation in the form of augmented reality in the past. As described above, it has been found that in the prior art, there has been a problem that the history has excessively consumed paper, and therefore it is necessary to propose an improved technical means to solve the problem.

[0005] In view of the prior art, there is a problem that the history is too paper-consuming, and the present invention discloses a history display and operating system and method thereof for applying augmented reality, wherein: [0006] The application disclosed in the present invention augmented reality The history display and the operating system include: a resume and a handheld device, and the handheld device further includes: a processor and a storage device. [0007] The resume has a plurality of resume fields, and some of the resume fields provide text alone or provide images separately, and the resume fields that provide text alone or provide images separately provide a combined image of images and characters. [0008] The handheld device provides display and operation of the history in an augmented reality form, the processor is for executing each instruction; and the storage device is for storing a plurality of instructions that are loaded and executed by the processor: [0009] The history of the captured part is the original image, and the original image includes one of the combined images; the corresponding resume field is determined according to the combined image; the corresponding augmentation history information is queried according to the judged history field; The resume information covers the combined image to generate a display image; the display image is displayed; and when the augmentation history information is touch-operated, the corresponding presentation state is executed according to the type of the augmentation history information. [0010] The present invention discloses a history display and operation method for augmented reality, which includes the following steps: [0011] First, a history having a plurality of resume fields is provided, and some of the resume fields provide text alone or Providing images separately, not providing text alone or providing a separate image of the image provides a combined image of the image and text; then providing a handheld device that provides display and operation of the resume in augmented reality; The resume of the handheld device captures the original image, and the original image includes one of the combined images; then, the handheld device determines the corresponding resume field according to the combined image; and then, the handheld device is based on the judged resume The field queries the corresponding amplification history information; then, the handheld device overlays the combined history information to generate a display image; then, the handheld device displays the display image; finally, when the amplification history information is touched At the time, the handheld device performs a corresponding presentation state according to the type of the augmentation history information. [0012] The system and method disclosed by the present invention are as above, and the difference from the prior art is that the history of the captured portion of the handheld device is the original image, and the corresponding history field is determined according to the combined image, and is determined according to the determined image. The resume field queries the corresponding amplification history information, and the augmentation history information covers the combined image to generate and display the display image. When the amplification history information is touched, the handheld device is based on the type of the amplification history information. Perform the corresponding rendering state. [0013] Through the above technical means, the present invention can achieve the technical effect of providing resume display and operation in the form of augmented reality.

[0015] The embodiments of the present invention will be described in detail below with reference to the drawings and embodiments, so that the application of the technical means to solve the technical problems and achieve the technical effects can be fully understood and implemented. [0016] Hereinafter, an operation system and method according to an embodiment of the present invention will be described with reference to an embodiment. Please refer to both FIG. 1 and FIG. 2, and FIG. 1 is a view of the present invention. A system block diagram showing the history display of the augmented reality and the operating system; and FIG. 2 is a flow chart showing the method of displaying and operating the history of the augmented reality in the present invention. [0017] The history display and operating system of the application augmented reality disclosed in the present invention includes a history 10 and a handheld device 20, and the handheld device 20 further includes a processor 21 and a storage device 22. [0018] Please refer to FIG. 3, and FIG. 3 is a schematic diagram showing the history of the display and operation of the augmented reality in the present invention. The history 10 has a plurality of resume fields and a part of the resume column. The bit 11 provides the text alone or provides the image separately, and the history field 12 that does not provide the text alone or provides the image separately provides the combined image 31 of the image and the text (step 101). [0019] Specifically, the resume field 11 is a description of the basic information, photos, field names, etc. of the job seeker, and the resume field 12 is the content of the corresponding field for the job seeker, for example, the work image. The license image, the autobiographic image, etc., are merely illustrative here, and are not intended to limit the scope of application of the present invention. [0020] The handheld device 20 provides display and operation of the history 10 in the form of Augmented Reality (AR) (step 102), and the aforementioned augmented reality refers to an image capturing device that passes through the handheld device 20. The captured image position and angle actuarial and image analysis technology enable the virtual world displayed by the handheld device 20 to combine and interact with the real world scene. The processor 21 of the handheld device 20 is used for Executing each instruction; and the storage device 22 of the handheld device 20 is for storing a plurality of instructions, which are loaded and executed by the processor: [0021] Please refer to "4th figure", and "4th picture" is shown as The original image of the history display and operation of the augmented reality is applied to the image of the history 10 by the image device of the handheld device 20, and the original image 30 includes the combined image 31. One (step 103). [0022] After the image of the history 10 is captured by the image device of the handheld device 20 as the original image 30, the handheld device 20 can determine the corresponding history field 12 according to the combined image 31 (step 104). Specifically, the handheld device 20 performs image processing on the combined image 31 (for example, image rotation, fisheye correction, sharpening, etc., etc., which is merely illustrative herein, and is not limited thereto. Category) and optical character recognition, whereby the combined image 31 is divided into an image of "●" and a text of "work", and the image is "●" and each of the previously stored images is separately mapped. For the comparison of the image, the comparison between the image and the comparison image is generally performed on the image edge of the two images that need to be compared and the image of the comparison image, and then the edge of the image is compared with the image of the comparison image. The intercepted image is compared with each corresponding pixel in the comparison image, and when the intercepted image is close to the corresponding pixel color in the comparison image, the pixel is judged to be similar Pixels in the image with the intercepted When the pixel ratio of the approximated pixel in the comparison image and the total image of the captured image is greater than or equal to the preset pixel ratio, it can be determined that the image and the comparison image are the same image, only For example, the application range of the present invention is not limited thereto, that is, the image is “●”, and the aligned image is “●”, and then the aligned image is matched according to the comparison. "●" inquires that the corresponding comparison text is "work", the text is "work" and the comparison text is "work" for text comparison, in the image is "●" and the text is "work" When the match is satisfied, it is judged that the corresponding resume field 12 is "work", and if the image is "●" and the character is "work", one of the matches does not match the history field 12. [0023] Please refer to FIG. 5, and FIG. 5 is a schematic diagram showing the augmentation history information of the history display and operation of the augmented reality application according to the present invention. The handheld device 20 is based on the combined image 31. After determining the corresponding history field 12, the handheld device 20 queries the corresponding augmentation history information 32 based on the determined history field 12 (step 105), and the amplification history information 32 includes the license image and the analysis table. And the image of the work, etc., that is, the type of the augmentation history information 32 includes an image, a table, an image, and the like, which are merely exemplified herein, and are not limited to the application scope of the present invention, and the history information 32 is expanded. The indication is as shown in "Figure 5". [0024] After the handheld device 20 queries the corresponding augmentation history information 32 based on the determined history field 12, the handheld device 20 can overlay the amplification history information 32 at the position of the combined image 31. And the combined image 31 of the character to generate the display image 33 (step 106). After the handheld device 20 generates the display image 33, the handheld device 20 can display the display image 33 (step 107), and display the image 33. As shown in the "figure 5", the amplification history information 32 can be displayed at the position of the combined image 31 by the augmented reality format. [0025] Please refer to FIG. 6 and FIG. 6 is a schematic diagram showing the change of the augmentation history information after the touch operation of the augmented reality display and operation of the present invention. When the augmentation history information 32 is displayed in the touch operation, the touch operation is, for example, a touch point selection operation, an up, down, left and right sliding operation, etc., which are merely illustrative, and are not limited thereto. For the application category, the handheld device 20 performs a corresponding presentation state according to the type of the augmentation history information 32 (step 108). Specifically, it is assumed that the augmentation history information 32 is an image type or a table type, and when the right sliding operation is triggered, the augmentation history information 32 of the content displayed in the "figure 5" will be displayed. The amplification history information 32 that is switched to the content shown in "Fig. 6" is only indicated by an image in the drawings, and the present invention is not limited thereto, and the amplification history information is assumed. 32 is the image type. When the touch point selection operation is triggered, the status of the expansion history information 32 image playback will be displayed. [0027] Please refer to "FIG. 7", and "FIG. 7" is a schematic diagram showing the history of the display and operation of the augmented reality application of the present invention. The resume is not provided separately or the image is provided separately. Bit 12 further includes providing a verification image 34 that surrounds the interior of the resume field 12 that is not provided separately or that provides the image separately. It is worth noting that the verification image in "Picture 7" The image 34 is represented by unequal-spaced black squares, and the verification image 34 can also be represented by equally spaced black squares. The verification image 34 can also be unequal or equally spaced colored geometric shapes. (for example, triangles, parallelograms, etc., which are merely illustrative and are not intended to limit the scope of application of the present invention), the verification image 34 may also be unequal or equally spaced. Non-geometric shapes (eg, stars, double circles, crosses, etc., which are merely illustrative and are not intended to limit the scope of application of the invention) are merely illustrative and not This bureau Application scope of the invention. [0028] Please refer to FIG. 8 and FIG. 8 is a schematic diagram showing the original image display and operation of the augmented reality application of the present invention. The image device of the handheld device 20 is used to record the history 10 When the image is captured as the original image 30, the original image 30 includes a complete history field 12 that is not separately provided or separately provided, that is, the original image 30 includes the combined image 31 and the verification image 34. [0029] After the image of the history 10 is captured by the image device of the handheld device 20 as the original image 30, the handheld device 20 can verify the verification image 34 of the history field 12, specifically, The handheld device 20 will first perform normalized image processing on the original image 30 (for example, image rotation, fisheye correction, sharpening, etc., which are merely illustrative here, and are not intended to limit the scope of application of the present invention) The normalized non-single-provided text or the separately provided resume field 12, that is, the combined image 31 and the verification image 34 are normalized image processing, and further normalized The optical character recognition of the combined image 31 is determined, and the corresponding history field 12 is determined according to the combined image 31. The corresponding history field 12 is determined according to the combined image 31. Please refer to the above description, and no further operation is performed here. Narration. [0030] The image processing for normalizing the original image 30 by the handheld device 20 is to extract the normalized non-single-provided text or the resume field 12 of the separately provided image and judged according to the combined image 31. After the corresponding resume field 12, the handheld device 20 can query the corresponding comparison image according to the judged history field 12, and pass the verification image 34 and the retrieved and judged history field. 12 corresponding image matching, image comparison image 34 and comparison image image comparison technology, please refer to the above image and comparison image image comparison technology, no longer here Repeat them. [0031] When the pixel ratio of the verification image 34 to the comparison image is greater than or equal to the preset pixel ratio, the handheld device 20 may determine that the verification image 34 passes the verification, when the verification image 34 and the comparison image are When the pixel ratio is less than the preset pixel ratio, the handheld device 20 can determine that the verification image 34 fails the verification. [0032] When the verification image 34 of the history field 12 is verified, the corresponding history field 12 can be determined based on the combined image 31, and the corresponding history field is determined by the handheld device 20 based on the combined image 31. After 12, the handheld device 20 queries the corresponding augment history information 32 based on the determined history field 12, and after the handheld device 20 queries the corresponding augment history information 32 based on the determined history field 12 The handheld device 20 can cover the combined image 31 of the image and the text by the augmentation history information 32 at the position of the combined image 31 to generate the display image 33, and the augmentation history information 32 displayed in the handheld device 20 is During the touch operation, the handheld device 20 performs the corresponding presentation state according to the type of the augmentation history information 32. For details, refer to the foregoing description, and no further details are provided herein. [0033] In summary, it can be seen that the difference between the present invention and the prior art is that the history of the captured portion of the handheld device is the original image, and the corresponding history field is determined according to the combined image, and according to the judged history column. The bit queries the corresponding augmentation history information, and the augmented history information covers the combined image to generate and display the display image. When the augmentation history information is touched, the handheld device performs the correspondence according to the type of the augmented history information. The state of presentation. [0034] By using such a technical means, the problem that the history of the prior art is excessively consumed by the paper can be solved, thereby achieving the technical effect of providing the history display and operation in the form of augmented reality. [0035] Although the embodiments of the present invention are as described above, the above description is not intended to directly limit the scope of the invention. Any changes in the form and details of the embodiments may be made without departing from the spirit and scope of the invention. The scope of the invention is to be determined by the scope of the appended claims.

[0036]

10‧‧‧ resume

11‧‧‧ resume field

12‧‧‧ resume field

20‧‧‧Handheld devices

21‧‧‧ Processor

22‧‧‧Storage device

30‧‧‧ original image

31‧‧‧Combined image

32‧‧‧Augmented resume information

33‧‧‧Display image

34‧‧‧Verification image

Step 101‧‧‧ Provide a history with multiple resume fields. Some resume fields provide text alone or provide images separately. The resume fields that provide text alone or provide images separately provide images and text. Combined image

Step 102‧‧‧ Provide hand-held devices that provide display and operation of resumes in augmented reality

Step 103‧‧‧ The hand-held device captures part of the history as the original image, and the original image contains one of the combined images.

Step 104‧‧‧Handheld device judges the corresponding resume field based on the combined image

Step 105‧‧‧The handheld device queries the corresponding augmentation history information according to the judged history field

Step 106‧‧‧The handheld device overlays the combined history information to generate a display image

Steps 107‧‧‧Handheld device display display image

Step 108‧‧‧ When the amplification history information is touch-operated, the handheld device performs the corresponding presentation state according to the type of the amplification history information.

[0014] FIG. 1 is a block diagram of a system for displaying a history display and an operating system of an augmented reality according to the present invention. FIG. 2 is a flow chart showing a method for displaying and operating a history of augmented reality according to the present invention. FIG. 3 is a schematic diagram showing the history of the display and operation of the augmented reality application of the present invention. FIG. 4 is a schematic diagram showing the original image of the history display and operation of the augmented reality application of the present invention. FIG. 5 is a schematic diagram showing the augmentation history information of the history display and operation of the augmented reality application of the present invention. FIG. 6 is a schematic diagram showing the change of the augmentation history information after the touch operation of the history display and operation of the augmented reality in the present invention. FIG. 7 is a schematic diagram showing the history of the display and operation of the history of applying the augmented reality according to the present invention. FIG. 8 is a schematic diagram showing the original image of the history display and operation of the augmented reality application of the present invention.

Claims (10)

A history display and operating system for applying augmented reality, comprising: a history, the resume has a plurality of resume fields, and some of the resume fields provide text alone or provide images separately, not separately providing text or A resume field providing an image separately provides an image and a combined image of a text; and a handheld device that provides display and operation of the resume in an augmented reality form, the handheld device further The method includes: a processor for executing each instruction; and a storage device, configured to store a plurality of instructions, the instruction being loaded and executed by the processor: the history of the captured portion is an original image, The original image includes one of the combined images; determining the corresponding history field according to the combined image; and querying the corresponding augment history information according to the determined history field; Amplifying the history information to cover the combined image to generate a display image; displaying the display image; and when the amplification history information is touched, according to the amplification history The type of information performs the corresponding rendering state. A history display and an operating system for applying augmented reality as described in claim 1, wherein the resume field that provides the text alone or provides the image separately includes providing a verification image, the verification image Surrounded by the interior of the resume field. A history display and an operating system for applying augmented reality as described in claim 2, wherein the processor further comprises loading and executing: extracting the history of the portion as the original image, The original image includes a complete resume field that is not provided separately or provides an image separately; the verification image of the history field is verified; when the verification image of the history field is verified, according to the And determining, by the combined image, the corresponding history field; and querying the corresponding augmentation history information according to the determined history field; and overlaying the augmentation history information to the combined image to generate the Displaying the image; displaying the display image; and when the augmentation history information is touch-operated, performing a corresponding presentation state according to the type of the augmentation history information. The vitae display and the operating system for applying the augmented reality according to claim 3, wherein the verifying the verification image of the history field further comprises: normalizing the image processing of the original image, The normalized non-single-provided text or the resume field of the image is separately provided; the combined image in the resume field that is not separately provided or separately provided is the verification map Determining the corresponding history field according to the combined image; and querying a corresponding comparison image according to the determined history field; and the verification image and the comparison image Performing image comparison; when the pixel ratio of the verification image and the comparison image is greater than or equal to a preset pixel ratio, then the verification image passes verification; and when the verification image is compared with the ratio When the pixel ratio of the image is less than the preset pixel ratio, the verification image fails to pass the verification. The history display and the operating system of the application augmented reality according to claim 1, wherein the type of the augmentation history information is an image and a table, and the augmentation history is switched according to the touch operation. The display content of the information is displayed in different display states; when the type of the augmentation history information is an image, the presentation state of the video playback is performed on the augmentation history information according to the touch operation. A history display and operation method for applying augmented reality, comprising the steps of: providing a resume with multiple resume fields, and some resume fields provide text alone or separately, not separately providing text or A resume field providing an image separately provides an image and a combined image of a text; providing a handheld device for providing display and operation of the resume in an augmented reality form; The resume image is an original image, and the original image includes one of the combined images; the handheld device determines the corresponding history field according to the combined image; the handheld device is determined according to the The resume field queries a corresponding augmentation history information; the handheld device overlays the augmentation history information to generate a display image; and the handheld device displays the display image; And when the augmentation history information is touch-operated, the handheld device performs a corresponding presentation state according to the type of the augmentation history information. A history display and operation method for applying augmented reality as described in claim 6 wherein the resume field that does not provide text alone or provides an image separately includes providing a verification image, the verification image Surrounded by the interior of the resume field. The history display and operation method for applying augmented reality according to claim 7, wherein the history display and operation method of applying the augmented reality further comprises the following steps: the handheld device extracts the part The history image is the original image, and the original image includes a complete history field that is not separately provided or separately provided; the handheld device verifies the verification image of the history field; When the verification image of the history field passes the verification, the handheld device determines the corresponding history field according to the combined image; the handheld device queries according to the determined history field. Corresponding to the augmentation history information; the handheld device overlays the augmentation history information to generate the display image; the handheld device displays the display image; and when the expansion When the enhanced history information is touch-operated, the handheld device performs a corresponding presentation state according to the type of the augmentation history information. A history display and operation method for applying augmented reality as described in claim 8 wherein the application of the augmented reality history display and operation method further comprises the following steps: the handheld device is opposite to the original The image is subjected to normalized image processing to extract a normalized non-single-provided text or a resume field providing an image separately; the handheld device eliminates the history of not providing the text alone or separately providing the image The combined image in the field is the verification image; the handheld device determines the corresponding history field according to the combined image; the handheld device is based on the determined history field Querying a corresponding alignment image; the handheld device performs image comparison on the verification image and the comparison image; and the handheld device is when the verification image is compared with the ratio When the pixel ratio of the image is greater than or equal to the preset pixel ratio, the verification image passes verification; and the handheld device is when the pixel ratio of the verification image and the comparison image is smaller than the preset image When the ratio, then the image verification failed verification. The history display and operation method for applying augmented reality according to claim 6, wherein when the type of the augmentation history information is an image and a table, the augmentation history is switched according to the touch operation. The display content of the information is displayed in different display states; when the type of the augmentation history information is an image, the presentation state of the video playback is performed on the augmentation history information according to the touch operation.