SIGGRAPH Asia 2026

SIA: Selective Image Analogy

1Simon Fraser University 2University of Cyprus 3Shahid Beheshti University 4CYENS Centre of Excellence

* Both authors contributed equally to this research.

A single reference pair (A, A′) may contain multiple edits at once. In this example the changes include adding a logo, changing the expression, and replacing the background. Given a new query image B, SIA lets the user choose which edits to transfer. The same demonstration can produce different outputs, ranging from single-edit results to combinations of selected edits, while leaving the remaining edits out.
Abstract

A demonstration pair carries several edits. Take only the ones you want.

Image analogy copies a change shown by a before/after pair (AA′) onto a new image B. But one pair usually holds several edits at once, and existing methods transfer all of them — you cannot ask for only some.

We introduce Selective Image Analogy (SIA): the pair stays fixed, and you choose which of its edits to apply. SIA first learns to transfer the whole change, then gains control from a mask over the edit words. The mask acts twice — it weakens the unwanted words in the text embedding, and gates a small adapter to them while the image is generated. The unwanted edits are dropped and the chosen ones stay, even though every edit is still visible in A′, and no new pair is needed for each combination.

Results · interactive

Switch any edit off. Same pair, different output.

Every edit starts kept — click one to suppress it. The demonstration pair never changes, only the result. Every image here is a real SIA output.

Demonstration pair
Query image

Edits

kept suppressed

More examples

Drag across the result to see what stayed behind.

One suppression setting per example. Drag the slider to wipe between the untouched query image and the result.

Method

One mask, applied at two aligned points.

Before denoising the mask weakens the suppressed tokens in the text embedding; during denoising it gates the adapter to those same tokens. The demonstration pair and the prompt stay untouched.

Overview of our selective image analogy pipeline. Given a demonstration pair (A, A′) containing multiple edits and a query image B, the model transfers only the user-selected edits to produce B′. In this example, green textual tokens indicate retained edits that should be applied to B, while red textual tokens indicate suppressed edits that should not be transferred, even though they are present in A′. The visual analogy guides the overall edit transfer, while the colored textual tokens specify which edits are retained or suppressed using selective token suppression and the Concept Suppression Vector (CSV).
01

AnaLoRA — learn the whole analogy first

A lightweight LoRA adapter on FLUX.2-Klein, trained in concat mode on the four-image tuple (A, A′, B, B′). The latents of A, A′ and B are packed as visual conditioning and paired with a structured analogy prompt that names all demonstrated edits. After this stage the model reliably performs full transfer.

02

ExLoRA — gate the adapter to the masked tokens

A token-gated LoRA whose low-rank residual is applied only at the text positions marked by the suppression mask. Unmasked tokens pass through the ordinary text stream, so suppression stays local to the edit phrase the user switched off — no new demonstration pair, no per-subset prompt, no query-specific optimisation.

03

CSV — remove the residual signal in the prompt

The prompt embeddings still describe every edit, suppressed ones included. For each edit we estimate a direction in text-encoder space from 64 contrastive positive/negative prompt pairs, cache it, and subtract that component from the suppressed edit’s token embeddings before denoising. Retained edits and the analogy instructions are left untouched.

1,606training samples
239edit settings
239test cases
2–4simultaneous edits
rank 16both adapters
30denoising steps

Our Multi-Edit Analogy Dataset spans creature and non-creature subjects and covers object additions, appearance changes, expression changes, pose changes, background replacements and style transfer. Every sample is filtered with a vision–language model to verify that the desired edits are present and the excluded ones are absent.

Evaluation

Highest retained-edit accuracy, and the strongest suppression.

Preservation alone is not enough for selective analogy: a method that barely changes the query image scores well on preservation and badly on everything else. SIA leads on retained accuracy, recall and both CLIP directional scores.

Quantitative comparison with visual analogy baselines
Method Qwen3-VL-32B Gemma 3 CLIP
Ret. Acc. ↑Pres. ↑Recall ↑ Ret. Acc. ↑Pres. ↑Recall ↑ Dir. Image ↑Dir. Ret. ↑
RelationAdapter [Gong et al. 2025] 6.749.930.7828.099.480.9410.3860.144
VisualCloze [Li et al. 2025] 7.248.620.8568.149.280.9470.4640.152
Edit Transfer [Chen et al. 2025] 2.319.960.1765.759.580.6230.1020.023
LoRWeB [Manor et al. 2026] 6.599.830.7368.129.510.9260.4020.155
SIA (ours) 8.019.750.8928.659.570.9520.5430.171
Table 1. Quantitative comparison with visual analogy baselines. VLM scores use Qwen3-VL-32B-Instruct and Gemma 3. Ret. Acc. measures retained-edit quality, Pres. measures preservation of B, and Recall measures retained-edit recall. CLIP-Dir Image is the image–image directional metric, while CLIP-Dir Retained measures alignment with the retained edit direction.
Citation

Use SIA in your research?

@inproceedings{alimohammadi2026sia,
  title     = {SIA: Selective Image Analogy},
  author    = {Alimohammadi, Amirhossein and Izadpanah, Kian and
               Kariminia, Bardiya and Chrysanthou, Yiorgos and
               Mahdavi-Amiri, Ali},
  booktitle = {SIGGRAPH Asia 2026 Conference Papers},
  year      = {2026},
  publisher = {Association for Computing Machinery}
}

Questions and requests are welcome — please open an issue on the GitHub repository.