AI Lecture Assistant

PythonCLIPWhisperChromaDBStreamlitOllama

A smart study tool helping students fast-track learning by finding exact moments in lecture videos. Searches both visual slides and spoken audio using AI.

View Source Code

Project Demo

Project Overview

AI Lecture Assistant is a study companion designed to help students navigate long lecture videos efficiently. Instead of watching hours of footage, students can ask questions like "Where does the professor explain backpropagation?" and jump instantly to that moment.

How It Helps Students

•Flexible Input: Upload your own lecture recordings or simply paste a YouTube URL.

•Save Time: Instantly locate key concepts without scrubbing through timelines.

•Multimodal Search: Finds relevant content whether it was written on a slide (Visual) or spoken by the lecturer (Audio).

•Privacy-First: Runs locally, ensuring personal study data remains private.

Agentic Orchestration

The system is managed by four autonomous agents:

•Video Agent: Processes lecture recordings and extracts slide content.

•RAG Agent: Indexes the lecture content for fast retrieval.

•UI Agent: Provides a simple chat interface for students.

•Ops Agent: Ensures the tool runs smoothly on personal devices.

Key Capabilities

•Semantic Search: Find specific moments in videos using natural language concepts.

•Visual Intelligence: Uses CLIP to "see" and index diagrams and text on slides.

•Speech Intelligence: Uses Whisper to transcribe and understand lectures.