Unlost: Open source alternative to Rewind AI.

Semantically search or ask questions about things you've seen

Shout out to txtai and breakdown from Kevin which makes building this easier.

Demo

Features

• semantic searching your memory
• filtering with dates/application in natural language (e.g. user interview questions from last week @chrome)
• search through meeting transcripts
• copy text from screenshot by cropping
• Open website from screenshot
• supports meeting transcripts from Zoom and Google Meet.
• local/provider llm/agent integration (coming soon, help wanted)
• remote server + storage in the cloud (coming soon, help wanted)

Quick Start

• install here and run
• control + m to toggle search

Build locally

1. run poetry install in server

2. Recompile python server(only if it has changed)

   python -m PyInstaller unlost_server.py -D -y --windowed --hidden-import=torch --hidden-import=unlost_server --collect-data torch --collect-data en_core_web_sm --copy-metadata torch --copy-metadata tqdm --copy-metadata regex --copy-metadata requests --copy-metadata packaging --copy-metadata filelock --copy-metadata numpy --copy-metadata tokenizers --copy-metadata importlib_metadata --copy-metadata huggingface-hub --copy-metadata safetensors --copy-metadata pyyaml --exclude-module skl2onnx --add-data "query_classifier.pickle:."

3. Drag python bundle into XCode Resources and delete old one (only if it has changed)

4. XCode Product > Archive, distribute app, custom, copy app

If you want to make/test server changes locally, make sure to disable this line

unlost/unlost-app/unlost/AppDelegate.swift

Line 38 in b212c4a

let _ = PythonServer.shared

How it works

Unlost follows client-server which is unusual for desktop application. This makes it a lot easier to

1. add remote storage/server support which would take a lot of the work off your local machine. battery life yay.
2. add SOTA/experimental AI stuff in python
3. cross platform

The UI is written in SwiftUI which is responsible for rendering the UI and ocr/storing screenshots.

The server is written in python which is responsible for indexing screenshots/OCR results, providing endpoint for semantic searching. A lot of heaving lifting from txtai.

All the data is stored under ~/Documents/UnlostApp.nosync

Contributing

Please discuss significant code changes in discord to make sure it's ok with other users.

Make your changes in a fork and raise PR to merge in.