Pith. sign in

REVIEW

Text2Face: A Multi-Modal 3D Face Model

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2303.02688 v2 pith:RFHVBDYG submitted 2023-03-05 cs.CV

classification cs.CV
keywords modelmulti-modalfacemorphableshapetext2facetextualallows
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We present the first 3D morphable modelling approach, whereby 3D face shape can be directly and completely defined using a textual prompt. Building on work in multi-modal learning, we extend the FLAME head model to a common image-and-text latent space. This allows for direct 3D Morphable Model (3DMM) parameter generation and therefore shape manipulation from textual descriptions. Our method, Text2Face, has many applications; for example: generating police photofits where the input is already in natural language. It further enables multi-modal 3DMM image fitting to sketches and sculptures, as well as images.

Discussion (0). Sign in to comment.

Pith tools