Microsoft’s Magentic UI Web Agents. Run it 100% Free using Ollama!



AI Summary

This video provides a comprehensive tutorial on setting up and using Magentic UI, a free, privacy-focused AI agent that can control your computer locally using Ollama.

Key Features:

  • Runs 100% locally on your computer using Ollama
  • Automatically controls a virtual computer to perform tasks
  • Includes multiple agent types: web surfer, coder, and file surfer agents
  • Takes screenshots and processes visual information
  • All data remains private and secure

Setup Process:

  1. Download and install Ollama from ollama.com
  2. Install the Qwen 3 model: ollama run qwen2.5:3b
  3. Install Docker Desktop (prerequisite)
  4. Install Magentic UI: pip install magentic-ui ollama
  5. Run: magentic-ui --port 8081
  6. Configure in browser at localhost:8081 using Ollama provider with “qwen2.5:3b” model

Live Demonstration:
The video shows two practical examples:

  • Finding post office closing hours in DE1 UK
  • Searching for Italian restaurants in London Bridge with ratings and hours

Performance & Limitations:

  • Processing time: 5-10 minutes per complex query (on Mac Studio baseline specs)
  • Performance depends heavily on computer specifications and running applications
  • Works on both Mac and Windows with similar setup
  • Requires decent system resources during operation
  • Docker dependency adds setup complexity for beginners

Privacy Benefits:

  • Complete local processing - no external server communication
  • User maintains control with ability to take manual control at any time
  • Open source and transparent
  • Cost-effective alternative to paid AI services

User Experience:

  • Interactive approval system for AI actions
  • Real-time screenshot feedback
  • Plan generation and review before execution
  • Manual control option when needed