REVIEW 5 cited by
$F$, $B$, Alpha Matting
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Cutting out an object and estimating its opacity mask, known as image matting, is a key task in many image editing applications. Deep learning approaches have made significant progress by adapting the encoder-decoder architecture of segmentation networks. However, most of the existing networks only predict the alpha matte and post-processing methods must then be used to recover the original foreground and background colours in the transparent regions. Recently, two methods have shown improved results by also estimating the foreground colours, but at a significant computational and memory cost. In this paper, we propose a low-cost modification to alpha matting networks to also predict the foreground and background colours. We study variations of the training regime and explore a wide range of existing and novel loss functions for the joint prediction. Our method achieves the state of the art performance on the Adobe Composition-1k dataset for alpha matte and composite colour quality. It is also the current best performing method on the alphamatting.com online evaluation.
Forward citations
Cited by 5 Pith papers
-
LayeringDiff: Layered Image Synthesis via Generation, then Disassembly with Generative Knowledge
LayeringDiff synthesizes layered images by generating a composite with a pretrained diffusion model and then decomposing it into foreground and background layers using small fine-tuned networks.
-
SDMatte: Grafting Diffusion Models for Interactive Matting
SDMatte adapts Stable Diffusion to interactive matting via visual-prompt cross-attention, opacity/coordinate embeddings, and masked self-attention, reporting SOTA results on multiple benchmarks.
-
Memory Efficient Matting with Adaptive Token Routing
Adaptive token routing with a lightweight refinement branch lets a ViT matting model run on full-resolution high-res images at about 12% of the memory of the ViTMatte baseline with only a small accuracy drop on Compos...
-
Morpho-Aware Global Attention for Image Matting
A vision transformer matting model with Tetris-like convolutional query embeddings achieves top results on Composition-1k and Distinctions-646.
-
BiVM: Accurate Binarized Neural Network for Efficient Video Matting
BiVM is a 1-bit binarized video matting network that beats prior binarized methods on accuracy and efficiency, with 11.82 MAD on VideoMatte240K versus 28.49 for ReActNet-binarized RVM.
Discussion (0). Continue with ORCID to comment.