conference-paper

What Sketch Explainability Really Means for Downstream Tasks?

Research footprint

At a glance

Citations
7
References
147
Comments
0
Paper overview

Öz

In this paper, we explore the unique modality of sketch for explainability, emphasising the profound impact of human strokes compared to conventional pixel-oriented studies. Beyond explanations of network behavior, we discern the genuine implications of explainability across diverse downstream sketch-related tasks. We propose a lightweight and portable explainability solution - a seamless plugin that integrates effortlessly with any pre-trained model, elim-inating the need for re-training. Demonstrating its adaptability, we present four applications: highly studied re-trieval and generation, and completely novel assisted drawing and sketch adversarial attacks. The centrepiece to our solution is a stroke-level attribution map that takes different forms when linked with downstream tasks. By addressing the inherent non-differentiability of rasterisation, we enable explanations at both coarse stroke level (SLA) and partial stroke level (P-SLA), each with its advantages for specific downstream tasks.

Record transparency

Publication details

DOI
10.1109/cvpr52733.2024.01046
OpenAlex
W4402715766
Document type
conference-paper
Language
EN
Last metadata update
Community

Comments

Oturum Açın to join the discussion.

  1. No comments yet. Start the discussion.