Skip to content

Start Ingestion

To populate your AI with data, you need to run the importers. This process extracts data, scrubs it for PII, and stores it in the vector database.

1. Configure Importers

Open apps/importers/config.yaml and enable the importers you want to use. You can also set a cron-style schedule for each.

2. Using the Admin Dashboard (GUI)

The easiest way to trigger ingestion is via the Admin Dashboard:

  1. Open the Dashboard: http://localhost:8501
  2. Navigate to the Importers tab.
  3. Select the desired importer (e.g., local_files).
  4. Click Execute.

3. Running via CLI

You can also run importers manually from the command line:

# Run a specific importer
uv run python -m importers.orchestrator --importer gmail

# Run with custom config
uv run python -m importers.orchestrator --config apps/importers/config.yaml

Available Importers

My Independent AI supports several data sources, including:

  • Local Files: Documents from your computer.
  • Gmail: Your emails (requires OAuth).
  • WhatsApp: Chat exports.
  • Dropbox: Cloud storage files.
  • And more...

See the full Importers Documentation for more details.