A selection of my open-source work, grouped by area: from visual-attention modeling and self-supervised learning to generative & multimodal models, LLM/retrieval systems, and MLOps tooling. Full list on GitHub.
Visual Attention & Eye Tracking
Self-supervised scanpath prediction on paintings using a Barlow Twins objective, learning gaze dynamics without labeled fixations.
↳ Self-Supervised Scanpath Prediction Framework for Painting Images (CVPRW 2022)
Foveal Disc-IoU Scanpath Score: a perceptually grounded metric for comparing predicted and human scanpaths.
↳ Closing the Foveal Gap: Perceptually Grounded Scanpath Comparison with Disc IoU (ETRA 2026)
The Art Visual Attention dataset: eye-tracking data across diverse painting styles for saliency and scanpath research.
↳ AVAtt: Art Visual Attention Dataset for Diverse Painting Styles (ETRA 2024)
Semantic scanpath similarity, comparing what viewers saw, not just where they looked, using VLMs and NLP metrics.
↳ What They Saw, Not Just Where They Looked (ETRA 2026)
Generative model for stochastic scanpath prediction on paintings via unsupervised domain adaptation.
↳ SPGen: Stochastic Scanpath Generation for Paintings (2026)
Perceptual evaluation of masked-autoencoder emergent properties through an eye-tracking-based policy.
↳ Perceptual Evaluation of Masked AutoEncoder Emergent Properties (ETRA 2024)
LLMs, NLP & Retrieval
A retrieval-augmented life-coaching assistant built on curated Dr. K (HealthyGamer) transcripts.
Experiments and recipes for fine-tuning small language models.
Health-Related Fake News Mitigation: a production platform for detecting and countering medical misinformation with hybrid RAG.
Generative & Multimodal AI
An agentic image-editing system with MLLM orchestration and identity-preservation gating, driven by natural-language instructions.
A LoRA adapter for FLUX.1-schnell that generates flat-lay garment product photography from detailed text prompts, in a minimalist contemporary fashion aesthetic. Trigger word: JLSCOM.
MLOps & Tooling
A boilerplate generator for MLflow + PyTorch experiment tracking, so new projects start reproducible.
No projects match this filter.