WO2018126642A1 - 显示设备和显示方法 - Google Patents

显示设备和显示方法 Download PDF

Info

Publication number
WO2018126642A1
WO2018126642A1 PCT/CN2017/093719 CN2017093719W WO2018126642A1 WO 2018126642 A1 WO2018126642 A1 WO 2018126642A1 CN 2017093719 W CN2017093719 W CN 2017093719W WO 2018126642 A1 WO2018126642 A1 WO 2018126642A1
Authority
WO
WIPO (PCT)
Prior art keywords
human body
image
display
area
target
Prior art date
Application number
PCT/CN2017/093719
Other languages
English (en)
French (fr)
Inventor
王子锋
曹磊
任妍
林涉
胡楠楠
金海岚
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US15/752,470 priority Critical patent/US10572722B2/en
Priority to EP17838116.6A priority patent/EP3567468B1/en
Publication of WO2018126642A1 publication Critical patent/WO2018126642A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1415—Digital output to display device ; Cooperation and interconnection of the display device with other functional units with means for detecting differences between the image stored in the host and the images displayed on the displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • A—HUMAN NECESSITIES
    • A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47G—HOUSEHOLD OR TABLE EQUIPMENT
    • A47G1/00—Mirrors; Picture frames or the like, e.g. provided with heating, lighting or ventilating means
    • A47G1/02—Mirrors used as equipment
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/12—Advertising or display means not otherwise provided for using special optical effects
    • G09F19/16—Advertising or display means not otherwise provided for using special optical effects involving the use of mirrors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition

Definitions

  • Embodiments of the present disclosure relate to a display device and a display method.
  • the traditional display device can be used to display image information such as photos and videos. People can search for memories of their past lives by viewing videos and photos that have been saved at the corresponding time, but the image information displayed in this way is relatively fixed. Linked to the real world and users cannot interact with the images displayed on the display device.
  • An embodiment of the present disclosure provides a display device including: a first image capturing device configured to acquire a target image of the target region when the human body is in the target region; and an image processing device configured to be according to the target
  • the human body image in the image identifies the physical feature of the human body;
  • the image generating device is configured to generate a virtual human body image corresponding to the target age corresponding to the human body according to the physical feature;
  • the display device configured to display the virtual The human body image, wherein the area displayed by the virtual human body image is a virtual human body display area.
  • the image processing apparatus may be further configured to identify, according to the target image, an area occupied by the human body image in the target image, where the area occupied by the human body image corresponds to a human body corresponding area on the display device, wherein the virtual human body display area is located in the human body corresponding area.
  • the virtual human body display area changes in real time according to changes in the corresponding area of the human body.
  • the display device provided by the embodiment of the present disclosure further includes a storage device, wherein the first image capturing device is further configured to acquire a background image of the target region when no human body is in the target region;
  • the storage device is configured to store the background image.
  • the display device is further configured to display a partial image of the corresponding background display area in the background image, the background display area being the A display area outside the virtual human body display area.
  • the display device is a mirror display device, and the display device is further configured to display a partial image corresponding to the fill display region in the background image in a fill display area,
  • the filling display area is a display area outside the virtual human body display area in the human body corresponding area.
  • the first image capturing device is a visible light image collecting device.
  • the display device provided by the embodiment of the present disclosure may further include a second image capturing device, wherein the second image capturing device is configured to acquire a target image of the target area, and the second image capturing device is infrared Image acquisition device or visible light image acquisition device.
  • the display device provided by the embodiment of the present disclosure may further include a database device configured to store a plurality of sample data.
  • the display device provided by the embodiment of the present disclosure may further include a feature analyzing device configured to identify an estimated age of the human body according to the physical feature, wherein the target age is different from the estimated age, the image
  • the generating means is configured to: find, in the database device, sample data closest to the physical feature; and generate a virtual human body image corresponding to the target age of the human body based on sample data closest to the physical feature .
  • the display device further includes a feature analyzing device, and further includes a feature analyzing device configured to identify an estimated age of the human body according to the physical feature, the target age and The estimated age is different, the image generating device is configured to: determine identity information of the human body according to the physical feature; and search for at least one of the sample data that meets the identity information in the database device; Generating comprehensive sample data for at least one of the sample data conforming to the identity information; and generating a virtual body image corresponding to the target age of the human body based on the integrated sample data.
  • the physical appearance feature includes an action of a human body, and an action of the virtual human body in the virtual human body image corresponds to an action of the human body.
  • Another embodiment of the present disclosure provides a display method suitable for any of the above display devices, the method comprising: collecting a target image of a target area when the human body is in the target area; and identifying a physical feature of the human body according to the target image Generating a virtual human body image corresponding to the target age corresponding to the human body according to the physical features; displaying the virtual human body image in the virtual human body display area.
  • the display device provided by the embodiment of the present disclosure can display a virtual human body image corresponding to the physical features of the user's human body, can be associated with the real environment, and can interact with the virtual human body image to improve the user experience.
  • FIG. 1 is a schematic diagram of a display device according to an embodiment of the present disclosure
  • FIG. 2 is a second schematic diagram of a display device according to an embodiment of the present disclosure.
  • FIG. 3 is a schematic diagram of a composition of a display device according to an embodiment of the present disclosure.
  • FIG. 4 is a third schematic diagram of a display device according to an embodiment of the present disclosure.
  • FIG. 5 is a second schematic diagram of a display device according to an embodiment of the present disclosure.
  • FIG. 6 is a fourth schematic diagram of a display device according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic view of a human body covering area in an embodiment of the present disclosure.
  • FIG. 8 is a flowchart of a display method according to an embodiment of the present disclosure.
  • FIG. 9 is a second flowchart of a display method according to an embodiment of the present disclosure.
  • FIG. 10 is a third flowchart of a display method according to an embodiment of the present disclosure.
  • FIG. 11 is a flowchart of a step of implementing step S30 in a display method according to an embodiment of the present disclosure
  • FIG. 12 is a second flowchart of the steps of step S30 in a display method according to an embodiment of the present disclosure.
  • the display device provided by the embodiment of the present disclosure can display a virtual human body image corresponding to the physical features of the user's human body, can be associated with the real environment, and can interact with the virtual human body image to improve the user experience.
  • An embodiment of the present disclosure provides a display device 100 including a processor 101, a memory 102, a first image capture device 110, and a display panel 120, as shown in FIGS. 1 and 2.
  • the display panel 120 is one example of a display device.
  • the display device 100 further includes an image processing device 130 and an image generating device 140. Referring to FIGS.
  • the first image capture device 110 is configured to acquire a target image of the target region TA when the human body Hu is in the target region TA before the display panel 120;
  • the image processing device 130 is configured to be in accordance with the target image
  • the human body image identifies the physical features of the human body Hu;
  • the image generating device 140 is configured to generate a virtual human body image corresponding to the target age corresponding to the human body according to the physical features;
  • the display panel 120 is configured to display the virtual human body image, the virtual human body image display area The area A1 is displayed for the virtual human body.
  • components of the embodiments of the present disclosure may be interconnected by a bus system in a wired connection, a wireless connection, or other form of connection (not shown). It should be noted that the components and structures of the display device illustrated in FIGS. 1 through 3 are merely exemplary and not limiting, and the display device may have other components and structures as needed.
  • the image capture device is, for example, a camera including an image sensor, which may be a CMOS or CCD image sensor, so that image data within a predetermined area can be acquired, which image data is available for subsequent processing.
  • the image processing apparatus and the image generating apparatus may be implemented, for example, by software, hardware, firmware, or any combination thereof; for example, corresponding computer program code may be stored in the storage apparatus, and image processing and image generation may be implemented when executed by the processor. Operation, the generated image can be converted into a video signal and sent to the display panel display.
  • the storage device can be implemented by the memory 102.
  • the processor 101 can be a central processing unit (CPU) or have data processing capabilities. And/or other forms of processing units that command execution capabilities, such as signal processors (DSPs), field programmable gate arrays (FPGAs), etc., and can be used to control other components in the display device to perform the desired functions.
  • CPU central processing unit
  • DSPs signal processors
  • FPGAs field programmable gate arrays
  • memory 102 can include one or more computer program products, which can include various forms of computer readable storage media, such as volatile memory and/or nonvolatile memory.
  • the volatile memory may include, for example, a random access memory (RAM) and/or a cache or the like.
  • the nonvolatile memory may include, for example, a read only memory (ROM), a hard disk, a flash memory, or the like.
  • One or more computer program instructions can be stored on the computer readable storage medium, and the processor 101 can execute the program instructions to implement the functions of the various functional devices (implemented by the processor) in the embodiments of the present disclosure and/or Or other desired features.
  • the memory stores computer program instructions, and when the computer program instructions are executed by the processor, the following steps are performed: identifying a physical feature of the human body according to the collected target image, and generating a corresponding body shape according to the recognized physical feature A virtual human body image that meets the target age.
  • the target age may be entered by the user or automatically generated by the display device 100.
  • the display device 100 may further include an input device (not shown) through which the user can input the target age and other control information.
  • the input device may include one or more of a keyboard, a mouse, a microphone, or a touch screen.
  • the image processing device 130 is further configured to identify an area occupied by the human body image in the target image according to the target image, and the area occupied by the human body image corresponds to the human body corresponding area A2 on the display panel, As shown in FIGS. 1 and 2, the virtual human body display area A1 is located in the human body corresponding area A2.
  • the human body corresponding area A2 may be a rectangular area corresponding to the boundary around the human body Hu.
  • the human body corresponding area A2 may be an area corresponding to the outline of the human body Hu.
  • the shape of the human body corresponding area A2 includes, but is not limited to, the case described in the embodiment of the present disclosure.
  • the virtual human body display area A1 may change in real time according to changes in the corresponding area of the human body. For example, when the human body Hu moves left and right relative to the display panel, the human body corresponding area A2 changes in real time as the position of the human body changes, and the virtual human body display area A1 changes in real time as the position of the human body corresponding area A2 changes, and accordingly moves left and right accordingly. .
  • the human body corresponding area A2 follows the person The position of the body changes in real time, zoomed in or out, and the virtual human body display area A1 changes in real time with the position of the corresponding area A2 of the human body, and is also enlarged or reduced accordingly.
  • the display device 100 provided by the embodiment of the present disclosure further includes a storage device 150 .
  • the first image capture device 110 is further configured to acquire a background image A3 of the target area TA when no human body is in the target area TA; the storage device 150 is configured to store the background image A3.
  • a background image A3 is exemplarily illustrated by using a vase as an example.
  • the background image A3 includes, but is not limited to, an image corresponding only to the position where the vase is located in FIG. 6 , and may be changed according to the environment in which it is used. For example, it can be trees, buildings, and the like.
  • the background image A3 may include an image of the entire target area TA when no human body is in the target area TA.
  • the display panel 120 is further configured to display a partial image corresponding to the background display area in the background image in the background display area, and the background display area may be a virtual human body.
  • a display area other than the area A1 is displayed. That is, as shown in FIG. 6, the display panel 120 can display the virtual human body image in the virtual human body display area A1 while simultaneously displaying the background image A3 in the background display area other than the virtual human body display area A1. That is, the background display area other than the virtual human body display area A1 displays the portion of the background image A3 corresponding to the area.
  • the background image A3 and the target image with the human body can be compared, and the same portion is the portion of the display background image A3 other than the virtual human body display area A1. This allows the user to experience the virtual human body image in the same environment as himself, enhance the authenticity of the display, and improve the user experience.
  • the image displayed by the display device 100 in FIG. 6 is only one example in the embodiment of the present disclosure, and the virtual human body image in the virtual human body display area A1 may be an image of a human youth period, or may be other age groups of the human body.
  • the age of the virtual human body image in the virtual human body display area A1 can be determined according to the target age.
  • the display panel 120 may be the mirror display panel 120.
  • the mirror display panel can be realized by using an APF (Advanced Polarizer Film), and the polarizing film APF can be attached to the polarizer and then attached to the display panel to realize mirror display.
  • the mirror display panel 120 appears as a mirror surface in an area where no display data is applied, and can present an image of an object appearing in front of it as a mirror, and can be displayed in an area to which display data is applied. Show the image you want to display.
  • the display panel 120 when the display panel 120 is a mirror display panel, it is not necessary to display a background image outside the human body corresponding area A2, that is, a mirror display outside the human body corresponding area A2, which can make the background image more realistic and can reflect the background in real time. Image changes to enhance the user experience.
  • the display panel 120 in order to prevent the user from seeing his own image in the filling area in the display panel 120 (ie, the filling display area is the display area outside the human body corresponding area A2 and the virtual human body display area A1), the display panel 120 needs to be configured to be The filled display area displays a partial image of the background image corresponding to the filled display area.
  • the region corresponding to the different portions of the two images is the human body corresponding region A2.
  • a portion in which the virtual human body display area A1 is removed is cut out in the human body corresponding area A2 to obtain a filled display area. That is to say, when the display panel 120 is a mirror display panel, the displayed image is composed of three parts, the first part is a virtual human body image in the virtual human body display area A1, and the second part is a virtual human body display area A1, the human body corresponding The background image displayed by the filled area in the area A2, and the third part is a mirror image other than the corresponding area A2 of the human body.
  • the first image capturing device 110 is a visible light image capturing device.
  • the target image is a visible light image
  • the image processing device 130 can recognize the physical features of the human body through the visible light target image.
  • physical features of the human body include facial features, contours, hair color, skin color, and clothing. It should be noted that the physical features of the human body include but are not limited to the above features, and may also include other features that can reflect the human body.
  • the facial features of the human body can be scaled to form facial features of the virtual human body image.
  • the display device 100 provided by the embodiment of the present disclosure may further include a second image capturing device 160 .
  • the second image capture device 160 is configured to acquire a target image of the target area TA, and the second image capture device 160 may be an infrared image capture device or a visible light image capture device.
  • the second image capturing device 160 is an infrared image capturing device
  • the infrared image capturing device is sensitive to the temperature of the human body, the recognition rate of the human body can be improved.
  • the target image or the background image collected by the first image capturing device 110 may be image-fused with the target image or the background image collected by the second image capturing device 160.
  • the occlusion area analysis of the human body Hu is as shown in FIG. 7.
  • the occlusion area of the image acquired by the first image acquisition device 110 is the area between the human body Hu and d, c, and the occlusion area of the image captured by the second image acquisition device 160. It is the area between the human body Hu and a, b.
  • the change of the background image located in the occlusion area will not be acquired in real time, so that the display on the display panel 120 cannot be updated in real time, affecting the user experience, and at the same time, setting the first image capture device 110 and The second image capturing device 160 can greatly reduce the area of the occlusion region, and the occlusion region at this time is the region surrounded by e, f, g and the human body Hu in FIG.
  • the positions where the first image capturing device 110 and the second image capturing device 160 are disposed are not limited to the left and right sides of the display panel 120 as shown in FIGS. 4 and 6, and may be disposed at other positions, for example, It is provided on the upper and lower sides of the display panel 120.
  • the number of image capturing devices may not be limited to two, and multiple image capturing devices may be disposed at the same time, for example, three, four, or five, etc., and multiple image capturing devices may be disposed around the display panel 120 to try to Reduce the area of the occlusion area and improve the recognition rate of the human body.
  • the target area TA in the embodiment of the present disclosure corresponds to the field of view of each image capturing device. That is to say, each image acquisition device can acquire an image of the target area TA.
  • the display device 100 provided by the embodiment of the present disclosure may further include a database device 170 configured to store a plurality of sample data.
  • the sample data may include image data of photos, videos, and the like of a plurality of different age groups of the human body, and may also include information such as education level, occupation, and birth place of the human body.
  • the database device 170 may be disposed in the display device 100, or may be disposed in a server of a local area network or a wide area network, or may be disposed in a cloud server connected to the display device through a wired or wireless network.
  • the database device 170 can also find and retrieve sample data of the human body from the Internet.
  • the display device 100 provided by the embodiment of the present disclosure may further include a feature analyzing device 180 configured to identify an estimated age of the human body according to the physical features, the target age being different from the estimated age. That is to say, the age of the virtual human body image is different from the estimated age of the human body, so that the user can see himself at different ages in reality in the virtual human body image displayed by the display device 100, thereby improving the user's experience and improving the user experience.
  • a feature analyzing device 180 configured to identify an estimated age of the human body according to the physical features, the target age being different from the estimated age. That is to say, the age of the virtual human body image is different from the estimated age of the human body, so that the user can see himself at different ages in reality in the virtual human body image displayed by the display device 100, thereby improving the user's experience and improving the user experience.
  • the body's estimation can be identified based on the body's facial wrinkles, hair color and other physical features. age.
  • the image generating device is configured to generate a virtual human body image corresponding to the target age of the human body according to the physical features, including: searching the database device 170 for sample data closest to the physical feature; and The close sample data generates a virtual human body image corresponding to the target age of the human body.
  • the image generating device is configured to generate a virtual human body image corresponding to the target age of the human body according to the physical features, including: determining identity information of the human body according to the physical features; and searching for identity in the database device 170 At least one sample data of the information; generating comprehensive sample data according to at least one sample data conforming to the identity information; and generating a virtual body image corresponding to the target age of the human body based on the integrated sample data.
  • the identity information of the human body can be judged according to the clothing, jewelry, skin color, and facial expression of the human body, and the identity information of the human body includes information such as education level, occupation, place of birth, and ethnicity.
  • the physical features include the actions of the human body, and the actions of the virtual human body in the virtual human body image correspond to the actions of the human body. That is to say, when the movement of the human body changes, for example, when the human body waves, the virtual human body also performs a wave motion, improving the authenticity and interest of the display, and improving the user experience.
  • the database device and the feature analyzing device can be implemented, for example, by software, hardware, firmware, or any combination thereof; for example, corresponding computer program code and data required to run the computer program code or generated data can be stored in the storage.
  • corresponding database functions and feature analysis functions can be implemented when executed by the same or different processors.
  • an embodiment of the present disclosure further provides a display method, including the following steps:
  • Step S10 collecting a target image of the target area when the human body is in the target area;
  • Step S20 Identify a physical feature of the human body according to the target image
  • Step S30 generating a virtual human body image corresponding to the target age corresponding to the human body according to the physical features
  • Step S40 displaying a virtual human body image in the virtual human body display area.
  • the display method provided by the embodiment of the present disclosure further includes the following steps:
  • Step S15 Identify the position of the human body according to the target image, and the position of the human body corresponds to the corresponding region of the human body
  • the virtual human body display area is located in the corresponding area of the human body.
  • the virtual human body display area changes in real time according to changes in the corresponding area of the human body.
  • the display method provided by the embodiment of the present disclosure further includes the following steps:
  • Step S05 When no human body is in the target area, the background image of the target area is collected and stored.
  • the display method provided in the embodiment of the present disclosure further includes the following steps:
  • Step S50 Display a partial image corresponding to the background display area in the background image in the background display area, and the background display area is a display area outside the virtual human body display area.
  • step S50' when the display panel is a mirror display panel, the display method provided by the embodiment of the present disclosure is replaced with step S50'.
  • Step S50' displaying a partial image corresponding to the filled display area in the background image in the filled display area, and the filled display area is a display area outside the virtual human body display area in the human body corresponding area.
  • the display method provided by the embodiment of the present disclosure further includes the following steps:
  • Step S01 Store a plurality of sample data.
  • the display method provided by the embodiment of the present disclosure further includes the following steps:
  • Step S25 Identify the estimated age of the human body according to the physical features, and the target age is different from the estimated age.
  • generating a virtual human body image corresponding to the target age of the human body according to the physical features includes:
  • Step S31 searching for the sample data closest to the physical feature in the database device
  • Step S32 Generate a virtual human body image corresponding to the target age of the human body according to the sample data closest to the physical feature.
  • generating a virtual human body image corresponding to the target age of the human body according to the physical features includes:
  • Step S31' judging the identity information of the human body according to the physical features
  • Step S32' searching at the database device for at least one sample data that conforms to the identity information
  • Step S33' generating comprehensive sample data according to at least one sample data conforming to the identity information; as well as
  • Step S34' generating a virtual human body image corresponding to the target age corresponding to the human body based on the integrated sample data.
  • the physical features include actions of the human body, and the actions of the virtual human body in the virtual human body image correspond to actions of the human body.
  • the database device is configured to store a plurality of sample data to implement step S01.
  • the first image capture device is configured to acquire and store a background image of the target region when no human body is in the target region to implement step S05.
  • the first image capture device is further configured to acquire a target image of the target region to implement step S10 when the human body is in the target region.
  • a computer program instruction is stored on the memory, and the above steps S15, S20, S25, and S30 may be performed when the computer program instruction is executed by the processor: recognizing a position of the human body according to the target image, the human body The position corresponds to the corresponding area of the human body; the physical characteristics of the human body are identified according to the target image; the estimated age of the human body is identified according to the physical features, the target age is different from the estimated age; and the virtual human body image corresponding to the target age corresponding to the human body is generated according to the physical features.
  • the display panel is configured to display a virtual human body image in the virtual human body display area to implement step S40.
  • the display panel is further configured to display a partial image corresponding to the background display area in the background image in the background display area, the background display area is a display area outside the virtual human body display area, to implement step S50; or, the display panel is further configured to be
  • the filled display area displays a partial image corresponding to the filled display area in the background image, and the filled display area is a display area outside the virtual human body display area in the human body corresponding area to implement step S50'.
  • step S30 computer program instructions are stored on the memory, and steps S31, S32 or steps S31', S32', S33', S34' are executed when the computer program instructions are executed by the processor.
  • the display device provided by the embodiment of the present disclosure can display a virtual human body image corresponding to the physical features of the user's human body, can be associated with the real environment, and can interact with the virtual human body image to improve the user experience.
  • the display device provided by the embodiment of the present disclosure can be applied to a large shopping mall, a church, a pavilion, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种显示设备(100)和显示方法，该显示设备(100)包括，第一图像采集装置(110)，被配置为当人体(Hu)处于目标区域中(TA)时，采集所述目标区域(TA)的目标图像；图像处理装置(130)，被配置为根据目标图像中的人体图像识别人体(Hu)的体貌特征；图像生成装置(140)，被配置为根据体貌特征生成与人体(Hu)对应的符合目标年龄的虚拟人体图像；以及显示装置(120)，被配置为显示虚拟人体图像，其中，所述虚拟人体图像显示的区域为虚拟人体显示区域(A1)。

Description

显示设备和显示方法 技术领域
本公开的实施例涉及一种显示设备和显示方法。
背景技术
传统的显示设备可以用于显示照片、视频等图像信息，人们对于自己过往生活的联系，可以通过查看对应时间已保存的视频、照片等来沟起回忆，但这样显示的图像信息较为固定，无法与现实环境联系在一起，而且用户无法与显示设备中显示的图像进行互动。
发明内容
本公开的实施例提供一种显示设备，包括：第一图像采集装置，被配置为当人体处于目标区域中时，采集所述目标区域的目标图像；图像处理装置，被配置为根据所述目标图像中的人体图像识别所述人体的体貌特征；图像生成装置，被配置为根据所述体貌特征生成与所述人体对应的符合目标年龄的虚拟人体图像；显示装置，被配置为显示所述虚拟人体图像，其中，所述虚拟人体图像显示的区域为虚拟人体显示区域。
例如，在本公开实施例提供的显示设备中，所述图像处理装置还可以被配置为根据所述目标图像识别所述目标图像中所述人体图像占据的区域，所述人体图像占据的区域对应所述显示装置上的人体对应区域，所述虚拟人体显示区域位于所述人体对应区域中。
例如，在本公开实施例提供的显示设备中，所述虚拟人体显示区域根据所述人体对应区域的变化实时变化。
例如，本公开实施例提供的显示设备，还包括存储装置，其中，所述第一图像采集装置还被配置为当没有人体处于所述目标区域中时，采集所述目标区域的背景图像；所述存储装置被配置为存储所述背景图像。
例如，在本公开实施例提供的显示设备中，所述显示装置还被配置为显示所述背景图像中对应背景显示区域的部分图像，所述背景显示区域为所述 虚拟人体显示区域之外的显示区域。
例如，在本公开实施例提供的显示设备中，所述显示装置为镜面显示装置，所述显示装置还被配置为在填充显示区域显示所述背景图像中对应所述填充显示区域的部分图像，其中，所述填充显示区域为所述人体对应区域内、所述虚拟人体显示区域之外的显示区域。
例如，在本公开实施例提供的显示设备中，所述第一图像采集装置为可见光图像采集装置。
例如，本公开实施例提供的显示设备，还可以包括第二图像采集装置，其中，所述第二图像采集装置被配置为采集所述目标区域的目标图像，所述第二图像采集装置为红外图像采集装置或可见光图像采集装置。
例如，本公开实施例提供的显示设备，还可以包括数据库装置，被配置为存储多个样本数据。
例如，本公开实施例提供的显示设备，还可以包括特征分析装置，被配置为根据所述体貌特征识别所述人体的估计年龄，其中，所述目标年龄与所述估计年龄不同，所述图像生成装置被配置为：在所述数据库装置中查找与所述体貌特征最接近的样本数据；以及根据与所述体貌特征最接近的样本数据生成与所述人体的与目标年龄对应的虚拟人体图像。
例如，在本公开实施例提供的显示设备中，所述显示设备还包括特征分析装置，还包括特征分析装置，被配置为根据所述体貌特征识别所述人体的估计年龄，所述目标年龄与所述估计年龄不同，所述图像生成装置被配置为：根据所述体貌特征判断所述人体的身份信息；在所述数据库装置中查找符合所述身份信息的至少一个所述样本数据；根据所述符合所述身份信息的至少一个所述样本数据生成综合样本数据；以及根据所述综合样本数据生成与所述人体的与目标年龄对应的虚拟人体图像。
例如，在本公开实施例提供的显示设备中，所述体貌特征包括人体的动作，所述虚拟人体图像中虚拟人体的动作对应所述人体的动作。
本公开的另一个实施例提供了一种显示方法，适用于上述任一的显示设备，该方法包括：当人体处于目标区域中时，采集目标区域的目标图像；根据目标图像识别人体的体貌特征；根据体貌特征生成与人体对应的符合目标年龄的虚拟人体图像；在虚拟人体显示区域显示虚拟人体图像。
例如，本公开实施例提供的显示设备可以显示与用户人体的体貌特征对应的虚拟人体图像、可以与现实环境联系在一起，而且可以与虚拟人体图像进行互动，提高了用户体验。
附图说明
为了更清楚地说明本公开实施例的技术方案，下面将对实施例或相关技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅涉及本公开的一些实施例，并非对本公开的限制。
图1是本公开实施例提供的一种显示设备的示意图之一；
图2是本公开实施例提供的一种显示设备的示意图之二；
图3是本公开实施例提供的一种显示设备组成的示意图之一；
图4是本公开实施例提供的一种显示设备的示意图之三；
图5是本公开实施例提供的一种显示设备组成的示意图之二；
图6是本公开实施例提供的一种显示设备的示意图之四；
图7是本公开实施例中人体遮挡区域的示意图；
图8是本公开实施例提供的一种显示方法的流程图之一；
图9是本公开实施例提供的一种显示方法的流程图之二；
图10是本公开实施例提供的一种显示方法的流程图之三；
图11是本公开实施例提供的一种显示方法中步骤S30实施步骤的流程图之一；以及
图12是本公开实施例提供的一种显示方法中步骤S30实施步骤的流程图之二。
具体实施方式
下面将结合附图，对本公开实施例中的技术方案进行清楚、完整地描述参考在附图中示出并在以下描述中详述的非限制性示例实施例，更加全面地说明本公开的示例实施例和它们的多种特征及有利细节。应注意的是，图中示出的特征不是必须按照比例绘制。本公开省略了已知材料、组件和工艺技术的描述，从而不使本公开的示例实施例模糊。所给出的示例仅旨在有利于理解本公开示例实施例的实施，以及进一步使本领域技术人员能够实施示例 实施例。因而，这些示例不应被理解为对本公开的实施例的范围的限制。
除非另外特别定义，本公开使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性，而只是用来区分不同的组成部分。此外，在本公开各个实施例中，相同或类似的参考标号表示相同或类似的构件。
例如，本公开实施例提供的显示设备可以显示与用户人体的体貌特征对应的虚拟人体图像、可以与现实环境联系在一起，而且可以与虚拟人体图像进行互动，提高了用户体验。
本公开的实施例提供一种显示设备100，如图1和图2所示，显示设备包括处理器101、存储器102、第一图像采集装置110和显示面板120。显示面板120是显示装置的一个示例。如图3所示，显示设备100还包括图像处理装置130和图像生成装置140。参见图1至图3，第一图像采集装置110被配置为当人体Hu处于显示面板120前的目标区域TA中时，采集目标区域TA的目标图像；图像处理装置130被配置为根据目标图像中的人体图像识别人体Hu的体貌特征；图像生成装置140被配置为根据体貌特征生成与人体对应的符合目标年龄的虚拟人体图像；显示面板120被配置为显示虚拟人体图像，虚拟人体图像显示的区域为虚拟人体显示区域A1。
例如，本公开实施例中的各组件可以通过总线系统以有线连接、无线连接或其它形式的连接方式(未示出)互连。应当注意，图1至图3所示的显示设备的组件和结构只是示例性的，而非限制性的，根据需要，所述显示设备也可以具有其他组件和结构。
在本公开中，图像采集装置例如为包括图像传感器的摄像头，该图像传感器可以为CMOS或CCD图像传感器，从而可以采集预定区域内的图像数据，这些图像数据可供后续处理。图像处理装置和图像生成装置例如可以通过软件、硬件、固件或它们的任意组合实现；例如，相应的计算机程序代码可以存储在存储装置中，当由处理器执行时可以实现图像处理和图像生成的操作，所生成图像可以被转变为视频信号，并发送给显示面板显示。
例如，存储装置可以由存储器102实现。
例如，处理器101可以是中央处理单元(CPU)或者具有数据处理能力 和/或指令执行能力的其它形式的处理单元，例如信号处理器(DSP)、现场可编程门阵列(FPGA)等，并且可以用于控制显示设备中的其它组件以执行期望的功能。
例如，存储器102可以包括一个或多个计算机程序产品，所述计算机程序产品可以包括各种形式的计算机可读存储介质，例如易失性存储器和/或非易失性存储器。所述易失性存储器例如可以包括随机存取存储器(RAM)和/或高速缓冲存储器(cache)等。所述非易失性存储器例如可以包括只读存储器(ROM)、硬盘、闪存等。在所述计算机可读存储介质上可以存储一个或多个计算机程序指令，处理器101可以运行所述程序指令，以实现本公开实施例中(由处理器实现)的各个功能装置的功能以及/或者其它期望的功能。
例如，所述存储器上存储有计算机程序指令，在所述计算机程序指令被所述处理器运行时执行以下步骤：根据采集的目标图像识别人体的体貌特征，根据识别的体貌特征生成与人体对应的符合目标年龄的虚拟人体图像。
例如，目标年龄可以由用户输入或者由显示设备100自动生成。
例如，显示设备100还可以包括输入装置(图中未示出)，用户可通过输入装置输入目标年龄和其它控制信息。输入装置可以包括键盘、鼠标、麦克风或触摸屏等中的一个或多个。
例如，在本公开实施例提供的显示设备100中，图像处理装置130还被配置为根据目标图像识别目标图像中人体图像占据的区域，人体图像占据的区域对应显示面板上的人体对应区域A2，如图1和图2所示，虚拟人体显示区域A1位于人体对应区域A2中。
例如，如图1所示，人体对应区域A2可以是包围人体Hu四周边界对应的矩形区域。又例如，如图2所示，人体对应区域A2也可以是人体Hu外形轮廓对应的区域。例如，人体对应区域A2的形状包括但不局限于本公开实施例中所述的情形。
例如，在本公开实施例提供的显示设备100中，虚拟人体显示区域A1可以根据人体对应区域的变化实时变化。例如，当人体Hu相对于显示面板左右移动时，人体对应区域A2随着人体的位置实时变化，也左右移动，虚拟人体显示区域A1随着人体对应区域A2的位置实时变化，也相应地左右移动。而且，当人体Hu相对于显示面板前后移动时，人体对应区域A2随着人 体的位置实时变化，放大或缩小，虚拟人体显示区域A1随着人体对应区域A2的位置实时变化，也相应地放大或缩小。
例如，如图5和图6所示，本公开实施例提供的显示设备100还包括存储装置150。第一图像采集装置110还被配置为当没有人体处于目标区域TA中时，采集目标区域TA的背景图像A3；存储装置150被配置为存储背景图像A3。
需要说明的是，在图6中以花瓶为例示例性地说明背景图像A3，背景图像A3包括但不局限于只有图6中花瓶所在的位置对应的图像，可以根据是其使用环境而变化，例如可以为树木、建筑物等等。例如，背景图像A3可以包括当没有人体处于目标区域TA中时整个目标区域TA的图像。
例如，如图6所示，在本公开实施例提供的显示设备100中，显示面板120还被配置为在背景显示区域显示背景图像中对应背景显示区域的部分图像，背景显示区域可以为虚拟人体显示区域A1之外的显示区域。也就是说，如图6所示，显示面板120可以在虚拟人体显示区域A1显示虚拟人体图像，并同时在虚拟人体显示区域A1之外的背景显示区域显示背景图像A3。也就是说，在虚拟人体显示区域A1之外的背景显示区域显示背景图像A3中对应该区域的部分。例如，可以将背景图像A3和带有人体的目标图像对比，相同的部分即为虚拟人体显示区域A1之外的显示背景图像A3的部分。这样可以使用户体验到虚拟人体图像与自己处于同样的环境中，增强显示的真实性，提高用户体验。
需要说明的是，图6中显示设备100显示的图像仅为本公开实施例中的一个示例，虚拟人体显示区域A1中的虚拟人体图像可以是人体幼年时期的图像，也可以是人体其他年龄段(例如，老年)的图像，或者经过其它处理的虚拟人体图像。例如，虚拟人体显示区域A1中的虚拟人体图像的年龄可以根据目标年龄确定。
例如，在本公开实施例提供的显示设备100中，显示面板120可以为镜面显示面板120。例如，镜面显示面板可以利用偏振膜APF(Advanced Polarizer Film)实现，偏振膜APF可以和偏光片贴合在一起，然后贴在显示面板上，实现镜面显示。镜面显示面板120在没有被施加显示数据的区域表现为镜面，可以如镜子般呈现出现在其前方物体的像，而在被施加显示数据的区域可显 示需要显示的图像。
例如，当显示面板120为镜面显示面板时，不需要在人体对应区域A2之外显示背景图像，即在人体对应区域A2之外为镜面显示，这样可以使背景图像更加逼真，而且可以实时反映背景图像的变化，提升用户体验。但为了避免用户在显示面板120中的填充区域(即填充显示区域为人体对应区域A2内、虚拟人体显示区域A1之外的显示区域)看到自己的镜像，显示面板120还需要被配置为在填充显示区域显示背景图像中对应填充显示区域的部分图像。例如，通过对比背景图像A3和带有人体的目标图像，这两幅图像中不同的部分对应的区域即为人体对应区域A2。在人体对应区域A2中截取除去虚拟人体显示区域A1的部分即可得到填充显示区域。也就是说，当显示面板120为镜面显示面板时，显示的图像由三部分组成，第一部分是虚拟人体显示区域A1中的虚拟人体图像，第二部分是虚拟人体显示区域A1之外、人体对应区域A2内的填充区域显示的背景图像，第三部分是人体对应区域A2之外的镜面图像。
例如，在本公开实施例提供的显示设备100中，第一图像采集装置110为可见光图像采集装置。例如，目标图像为可见光图像，图像处理装置130可以通过该可见光目标图像识别人体的体貌特征。
例如，人体的体貌特征包括面部特征、外形轮廓、头发颜色、肤色和衣着。需要说明的是，人体的体貌特征包括但不局限于上述特征，也可以包括其它可以反映人体的特征。
例如，可以将人体的面部特征经过缩放后形成虚拟人体图像的面部特征。
例如，如图4和图6所示，本公开实施例提供的显示设备100还可以包括第二图像采集装置160。第二图像采集装置160被配置为采集目标区域TA的目标图像，第二图像采集装置160可以为红外图像采集装置或可见光图像采集装置。
例如，当第二图像采集装置160为红外图像采集装置时，由于红外图像采集装置对于人体的温度较为敏感，可以提高人体的识别率。
例如，当第二图像采集装置160为可见光图像采集装置时，可以将第一图像采集装置110采集的目标图像或背景图像与第二图像采集装置160采集的目标图像或背景图像进行图像融合处理，提高人体的识别率，同时减少人 体的遮挡区域。
例如，人体Hu的遮挡区域分析如图7所示，第一图像采集装置110采集的图像的遮挡区域为人体Hu和d、c之间的区域，第二图像采集装置160采集的图像的遮挡区域为人体Hu和a、b之间的区域。当显示面板120不是镜面显示面板时，位于遮挡区域中的背景图像的变化将无法实时被获取，从而无法实时更新显示在显示面板120上，影响用户体验，而同时设置第一图像采集装置110和第二图像采集装置160，可以大大减少遮挡区域的面积，此时的遮挡区域为图7中e、f、g与人体Hu包围的区域。
例如，第一图像采集装置110和第二图像采集装置160设置的位置并不局限于如图4和图6所示的显示面板120的左右两侧的情形，也可以设置在其他位置，例如，设置在显示面板120的上下侧。
例如，图像采集装置的数量可不局限于两个，可以同时设置多个图像采集装置，例如，3个、4个或5个等，多个图像采集装置可以设置在显示面板120的四周，以尽量减小遮挡区域的面积，提高人体的识别率。
例如，本公开实施例中的目标区域TA与各个图像采集装置的视场对应。也就是说，各个图像采集装置均可以采集到目标区域TA的图像。
例如，如图5所示，本公开实施例提供的显示设备100，还可以包括数据库装置170，被配置为存储多个样本数据。
例如，样本数据可以包括多个人体不同年龄段的照片、视频等图像数据，也可以包括人体的教育程度、职业、出生地等信息。
例如，数据库装置170可以设置在显示设备100中，也可以设置在局域网或广域网的服务器中，或者设置在云端服务器中，服务器通过有线或无线网络与显示设备连接。例如，数据库装置170也可以从互联网上查找和获取人体的样本数据。
例如，如图5所示，本公开实施例提供的显示设备100还可以包括特征分析装置180，被配置为根据体貌特征识别人体的估计年龄，目标年龄与估计年龄不同。也就是说，虚拟人体图像的年龄与人体的估计年龄不同，这样，用户可以在显示设备100显示的虚拟人体图像中看到与现实中不同年龄的自己，提高趣味性，提升用户体验。
例如，可以根据人体的脸部皱纹、头发颜色等体貌特征识别人体的估计 年龄。
此时，例如，图像生成装置被配置为根据体貌特征生成与人体的与目标年龄对应的虚拟人体图像，包括：在数据库装置170中查找与体貌特征最接近的样本数据；以及根据与体貌特征最接近的样本数据生成与人体的与目标年龄对应的虚拟人体图像。
又例如，在另一个示例中，图像生成装置被配置为根据体貌特征生成与人体的与目标年龄对应的虚拟人体图像，包括：根据体貌特征判断人体的身份信息；在数据库装置170中查找符合身份信息的至少一个样本数据；根据符合身份信息的至少一个样本数据生成综合样本数据；以及根据综合样本数据生成与人体的与目标年龄对应的虚拟人体图像。
例如，可以根据人体的衣着、首饰、肤色、面部表情判断人体的身份信息，人体的身份信息例如包括教育程度、职业、出生地、人种等信息。
例如，在本公开实施例提供的显示设备100中，体貌特征包括人体的动作，虚拟人体图像中虚拟人体的动作对应人体的动作。也就是说，当人体的动作发生变化时，例如人体挥手时，虚拟人体也会进行挥手的动作，提高显示的真实性和趣味性，提高用户体验。
在该实施例中，数据库装置以及特征分析装置例如可以通过软件、硬件、固件或它们的任意组合实现；例如，相应的计算机程序代码以及计算机程序代码运行所需的数据或产生数据可以存储在存储装置中，当由相同或不同的处理器执行时可以实现相应的数据库功能和特征分析功能。
例如，如图8所示，本公开的实施例还提供一种显示方法，包括如下步骤：
步骤S10：当人体处于目标区域中时，采集目标区域的目标图像；
步骤S20：根据目标图像识别人体的体貌特征；
步骤S30：根据体貌特征生成与人体对应的符合目标年龄的虚拟人体图像；
步骤S40：在虚拟人体显示区域显示虚拟人体图像。
例如，如图9和图10所示，本公开实施例提供的显示方法，还包括如下步骤：
步骤S15：根据目标图像识别人体的位置，人体的位置对应人体对应区 域，虚拟人体显示区域位于人体对应区域中。
例如，虚拟人体显示区域根据人体对应区域的变化实时变化。
例如，如图9和图10所示，本公开实施例提供的显示方法，还包括如下步骤：
步骤S05：当没有人体处于目标区域中时，采集并存储目标区域的背景图像。
例如，如图9本公开实施例提供的显示方法，还包括如下步骤：
步骤S50：在背景显示区域显示背景图像中对应背景显示区域的部分图像，背景显示区域为虚拟人体显示区域之外的显示区域。
例如，如图10所示，当显示面板为镜面显示面板时，本公开实施例提供的显示方法，步骤S50替换为步骤S50’。
步骤S50’：在填充显示区域显示背景图像中对应填充显示区域的部分图像，填充显示区域为人体对应区域内、虚拟人体显示区域之外的显示区域。
例如，如图9和图10所示，本公开实施例提供的显示方法，还包括如下步骤：
步骤S01：存储多个样本数据。
例如，如图9和图10所示，本公开实施例提供的显示方法，还包括如下步骤：
步骤S25：根据体貌特征识别人体的估计年龄，目标年龄与估计年龄不同。
例如，如图11所示，在本公开实施例提供的显示方法中，根据体貌特征生成与人体的与目标年龄对应的虚拟人体图像(步骤S30)包括：
步骤S31：在数据库装置中查找与体貌特征最接近的样本数据；以及
步骤S32：根据与体貌特征最接近的样本数据生成与人体的与目标年龄对应的虚拟人体图像。
例如，如图12所示，在本公开实施例提供的显示方法中，根据体貌特征生成与人体的与目标年龄对应的虚拟人体图像包括：
步骤S31’：根据体貌特征判断人体的身份信息；
步骤S32’：在数据库装置中查找符合身份信息的至少一个样本数据；
步骤S33’：根据符合身份信息的至少一个样本数据生成综合样本数据； 以及
步骤S34’：根据综合样本数据生成与人体对应的符合目标年龄的虚拟人体图像。
例如，在本公开实施例提供的显示方法中，体貌特征包括人体的动作，虚拟人体图像中虚拟人体的动作对应人体的动作。
例如，结合图9和图10描述显示设备的工作方式。数据库装置被配置为存储多个样本数据，以实现步骤S01。第一图像采集装置被配置为当没有人体处于目标区域中时，采集并存储目标区域的背景图像，以实现步骤S05。第一图像采集装置还被配置为当人体处于目标区域中时，采集目标区域的目标图像以实现步骤S10。
在本公开的实施例中，存储器上存储有计算机程序指令，在所述计算机程序指令被所述处理器运行时可以执行上述步骤S15、S20、S25和S30：根据目标图像识别人体的位置，人体的位置对应人体对应区域；根据目标图像识别人体的体貌特征；根据体貌特征识别人体的估计年龄，目标年龄与估计年龄不同；根据体貌特征生成与人体对应的符合目标年龄的虚拟人体图像。显示面板被配置为在虚拟人体显示区域显示虚拟人体图像，以实现步骤S40。
显示面板还被配置为在背景显示区域显示背景图像中对应背景显示区域的部分图像，背景显示区域为虚拟人体显示区域之外的显示区域，以实现步骤S50；或者，显示面板还被配置为在填充显示区域显示背景图像中对应填充显示区域的部分图像，填充显示区域为人体对应区域内、虚拟人体显示区域之外的显示区域，以实现步骤S50’。
例如，在步骤S30中，所述存储器上存储有计算机程序指令，在所述计算机程序指令被所述处理器运行时执行步骤S31、S32或步骤S31’、S32’、S33’、S34’。
例如，本公开实施例提供的显示设备可以显示与用户人体的体貌特征对应的虚拟人体图像、可以与现实环境联系在一起，而且可以与虚拟人体图像进行互动，提高了用户体验。
例如，本公开实施例提供的显示设备可以应用在大型商场，教堂，展馆等场所。
虽然上文中已经用一般性说明及具体实施方式，对本公开作了详尽的描 述，但在本公开实施例基础上，可以对之作一些修改或改进，这对本领域技术人员而言是显而易见的。因此，在不偏离本公开精神的基础上所做的这些修改或改进，均属于本公开要求保护的范围。
本申请要求于2017年1月4日递交的中国专利申请第201710003900.5号的优先权，在此全文引用上述中国专利申请公开的内容以作为本申请的一部分。

Claims (15)

  1. 一种显示设备，包括：
    第一图像采集装置，被配置为当人体处于目标区域中时，采集所述目标区域的目标图像；
    图像处理装置，被配置为根据所述目标图像中的人体图像识别所述人体的体貌特征；
    图像生成装置，被配置为根据所述体貌特征生成与所述人体对应的符合目标年龄的虚拟人体图像；以及
    显示装置，被配置为显示所述虚拟人体图像，其中，所述虚拟人体图像显示的区域为虚拟人体显示区域。
  2. 根据权利要求1所述的显示设备，其中，所述图像处理装置还被配置为根据所述目标图像识别所述目标图像中所述人体图像占据的区域，所述人体图像占据的区域对应所述显示装置上的人体对应区域，所述虚拟人体显示区域位于所述人体对应区域中。
  3. 根据权利要求2所述的显示设备，其中，所述虚拟人体显示区域根据所述人体对应区域的变化实时变化。
  4. 根据权利要求1所述的显示设备，还包括存储装置，其中，
    所述第一图像采集装置还被配置为当没有人体处于所述目标区域中时，采集所述目标区域的背景图像；
    所述存储装置被配置为存储所述背景图像。
  5. 根据权利要求4所述的显示设备，其中，所述显示装置还被配置为在背景显示区域显示所述背景图像中对应所述背景显示区域的部分图像，所述背景显示区域为所述虚拟人体显示区域之外的显示区域。
  6. 根据权利要求4所述的显示设备，其中，所述显示装置为镜面显示装置，所述显示装置还被配置为在填充显示区域显示所述背景图像中对应所述填充显示区域的部分图像，所述填充显示区域为所述人体对应区域内、所述虚拟人体显示区域之外的显示区域。
  7. 根据权利要求1-6任一项所述的显示设备，其中，所述第一图像采集装置为可见光图像采集装置。
  8. 根据权利要求1-6任一项所述的显示设备，还包括第二图像采集装置，其中，所述第二图像采集装置被配置为采集所述目标区域的目标图像，所述第二图像采集装置为红外图像采集装置或可见光图像采集装置。
  9. 根据权利要求1-6任一项所述的显示设备，还包括数据库装置，其被配置为存储多个样本数据。
  10. 根据权利要求9所述的显示设备，还包括特征分析装置，其被配置为根据所述体貌特征识别所述人体的估计年龄，其中，所述目标年龄与所述估计年龄不同，
    所述图像生成装置被配置为：
    在所述数据库装置中查找与所述体貌特征最接近的样本数据；以及
    根据与所述体貌特征最接近的样本数据生成与所述人体的目标年龄对应的虚拟人体图像。
  11. 根据权利要求9所述的显示设备，其中，
    所述显示设备还包括特征分析装置，所述特征分析装置被配置为根据所述体貌特征识别所述人体的估计年龄，所述目标年龄与所述估计年龄不同，
    所述图像生成装置被配置为：
    根据所述体貌特征判断所述人体的身份信息；
    在所述数据库装置中查找符合所述身份信息的至少一个所述样本数据；
    根据所述符合所述身份信息的至少一个所述样本数据生成综合样本数据；以及
    根据所述综合样本数据生成与所述人体的与目标年龄对应的虚拟人体图像。
  12. 根据权利要求1-6任一项所述的显示设备，其中，所述体貌特征包括人体的动作，所述虚拟人体图像中虚拟人体的动作对应所述人体的动作。
  13. 一种显示方法，适用于根据权利要求1的显示设备，包括：
    当所述人体处于目标区域中时，采集所述目标区域的目标图像；
    根据所述目标图像识别所述人体的体貌特征；
    根据所述体貌特征生成与所述人体对应的符合目标年龄的虚拟人体图像；
    在所述虚拟人体显示区域显示所述虚拟人体图像。
  14. 根据权利要求13的显示方法，还包括：
    根据所述目标图像识别所述人体的位置，其中，所述人体的位置对应所述显示装置的人体对应区域，所述虚拟人体显示区域位于人体对应区域中。
  15. 根据权利要求13的显示方法，还包括：
    当没有所述人体处于所述目标区域中时，采集并存储所述目标区域的背景图像；
    在所述显示装置的背景显示区域显示所述背景图像中对应所述背景显示区域的部分图像，其中，所述背景显示区域为所述虚拟人体显示区域之外的显示区域，或者，当所述显示装置为镜面显示面板时，在所述显示装置的填充显示区域显示所述背景图像中对应所述填充显示区域的部分图像，其中，所述填充显示区域为所述人体对应区域内、所述虚拟人体显示区域之外的显示区域。
PCT/CN2017/093719 2017-01-04 2017-07-20 显示设备和显示方法 WO2018126642A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/752,470 US10572722B2 (en) 2017-01-04 2017-07-20 Display apparatus and display method
EP17838116.6A EP3567468B1 (en) 2017-01-04 2017-07-20 Display apparatus and display method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710003900.5 2017-01-04
CN201710003900.5A CN108268227B (zh) 2017-01-04 2017-01-04 显示设备

Publications (1)

Publication Number Publication Date
WO2018126642A1 true WO2018126642A1 (zh) 2018-07-12

Family

ID=62771597

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/093719 WO2018126642A1 (zh) 2017-01-04 2017-07-20 显示设备和显示方法

Country Status (4)

Country Link
US (1) US10572722B2 (zh)
EP (1) EP3567468B1 (zh)
CN (1) CN108268227B (zh)
WO (1) WO2018126642A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111625101B (zh) * 2020-06-03 2024-05-17 上海商汤智能科技有限公司 一种展示控制方法及装置
CN114939216B (zh) * 2022-05-30 2023-11-10 深圳英鸿骏智能科技有限公司 一种辅助康复运动的设备与方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101782900A (zh) * 2009-01-15 2010-07-21 中兴电工机械股份有限公司 人生时光数字记录及呈现系统
CN101971128A (zh) * 2007-12-05 2011-02-09 阿尔梅瓦股份公司 屏幕与指针对象之间交互用的交互装置
US20110169932A1 (en) * 2010-01-06 2011-07-14 Clear View Technologies Inc. Wireless Facial Recognition
CN103413270A (zh) * 2013-08-15 2013-11-27 北京小米科技有限责任公司 一种图像的处理方法、装置和终端设备
CN105827930A (zh) * 2015-05-27 2016-08-03 广东维沃软件技术有限公司 一种辅助拍照的方法和装置

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8982109B2 (en) 2005-03-01 2015-03-17 Eyesmatch Ltd Devices, systems and methods of capturing and displaying appearances
US8726194B2 (en) * 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
US8146005B2 (en) * 2007-08-07 2012-03-27 International Business Machines Corporation Creating a customized avatar that reflects a user's distinguishable attributes
JP5423379B2 (ja) * 2009-08-31 2014-02-19 ソニー株式会社 画像処理装置および画像処理方法、並びにプログラム
US8994718B2 (en) * 2010-12-21 2015-03-31 Microsoft Technology Licensing, Llc Skeletal control of three-dimensional virtual world
JP5145444B2 (ja) * 2011-06-27 2013-02-20 株式会社コナミデジタルエンタテインメント 画像処理装置、画像処理装置の制御方法、及びプログラム
CN103514545B (zh) * 2012-06-28 2017-12-29 联想(北京)有限公司 图像处理方法以及电子设备
JP6441231B2 (ja) * 2012-12-18 2018-12-19 アイズマッチ エルティーディー．ＥｙｅｓＭａｔｃｈ Ｌｔｄ． 外観を撮像及び表示する装置、システム及び方法
US9779527B2 (en) 2013-08-15 2017-10-03 Xiaomi Inc. Method, terminal device and storage medium for processing image
US9710972B2 (en) * 2014-05-30 2017-07-18 Lucasfilm Entertainment Company Ltd. Immersion photography with dynamic matte screen
CN106203304B (zh) * 2016-06-30 2020-04-17 维沃移动通信有限公司 一种图像生成方法及其移动终端

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101971128A (zh) * 2007-12-05 2011-02-09 阿尔梅瓦股份公司 屏幕与指针对象之间交互用的交互装置
CN101782900A (zh) * 2009-01-15 2010-07-21 中兴电工机械股份有限公司 人生时光数字记录及呈现系统
US20110169932A1 (en) * 2010-01-06 2011-07-14 Clear View Technologies Inc. Wireless Facial Recognition
CN103413270A (zh) * 2013-08-15 2013-11-27 北京小米科技有限责任公司 一种图像的处理方法、装置和终端设备
CN105827930A (zh) * 2015-05-27 2016-08-03 广东维沃软件技术有限公司 一种辅助拍照的方法和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3567468A4 *

Also Published As

Publication number Publication date
EP3567468A1 (en) 2019-11-13
US20190012529A1 (en) 2019-01-10
EP3567468B1 (en) 2023-05-03
CN108268227A (zh) 2018-07-10
CN108268227B (zh) 2020-12-01
US10572722B2 (en) 2020-02-25
EP3567468A4 (en) 2020-09-02

Similar Documents

Publication Publication Date Title
US10832039B2 (en) Facial expression detection method, device and system, facial expression driving method, device and system, and storage medium
US9996983B2 (en) Manipulation of virtual object in augmented reality via intent
US9495008B2 (en) Detecting a primary user of a device
US9626801B2 (en) Visualization of physical characteristics in augmented reality
US20140354534A1 (en) Manipulation of virtual object in augmented reality via thought
US10733799B2 (en) Augmented reality sensor
CN106127552B (zh) 一种虚拟场景显示方法、装置及系统
US11763479B2 (en) Automatic measurements based on object classification
TW201337815A (zh) 電子試衣方法和電子試衣裝置
JP2016514865A (ja) 現実世界の分析可視化
JP2022019753A5 (zh)
JP6109288B2 (ja) 情報処理装置、情報処理方法及びプログラム
JP7379603B2 (ja) 推奨を配信する方法、デバイス、及びシステム
US10701220B2 (en) Image print proposal device, method, and program
US11562545B2 (en) Method and device for providing augmented reality, and computer program
WO2021185110A1 (zh) 眼球追踪校准方法及装置
WO2018126642A1 (zh) 显示设备和显示方法
CN116452745A (zh) 手部建模、手部模型处理方法、设备和介质
WO2019085519A1 (zh) 面部跟踪方法及装置
JP5766763B2 (ja) スクリーン内のカーソルをクリック可能なオブジェクトに移動させる方法及び該方法を実現するために用いるコンピュータシステムとコンピュータプログラム
WO2024114470A1 (zh) 商品虚拟试用效果展示方法及电子设备
KR101749104B1 (ko) 3d 모델을 이용하는 광고 시스템 및 광고 방법
US11127218B2 (en) Method and apparatus for creating augmented reality content
US20230309824A1 (en) Accommodation tracking based on retinal-imaging
US20240185530A1 (en) Information interaction method, computer-readable storage medium and communication terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17838116

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017838116

Country of ref document: EP

Effective date: 20190805