›_
Back to Projects

Cosmetics Product Search & Flyer Generation

No preview available

completedSep 2024 - Oct 2024

Cosmetics Product Search & Flyer Generation

Yash Technologies

Developed CLIP-based image-to-image and text-to-image search with image captioning for cosmetic products. Extended to generate product flyers using Stable Diffusion for inpainting makeup on model photos and outpainting customised backgrounds. SAMViT used for precise segmentation.

Tech Stack

CLIPStable DiffusionSAMViTPythonComputer VisionImage Processing

Highlights

  • Image-to-image and text-to-image search
  • AI-powered flyer generation via Stable Diffusion
  • SAMViT-based makeup inpainting

Challenges

  • Fine-tuning CLIP embeddings for the cosmetics domain where colour and texture nuances are critical
  • Achieving photorealistic makeup inpainting without bleeding artifacts on diverse skin tones