A new open-source project is betting that the fastest way to find a memory is to describe it — and that the search should never leave your laptop. SCM, short for Screen Memories, is a free macOS application that applies local AI models to every photo and every frame of video in a folder, letting users search their libraries in plain language. The project appeared on GitHub this week and quickly climbed to the front page of Hacker News, where it drew more than 85 points within hours.
The pitch is simple on the surface: point SCM at any folder, and it builds a searchable index of what is actually in your media — not just filenames, but the visual content of each image and each scene inside each video. What sets it apart in a crowded field of AI photo tools is that all of it runs on the Mac itself. There are no accounts, no cloud uploads and no telemetry. Once the models download their weights on first run, the app works offline. この件の詳細は、AIニュースをご覧ください。
Five Ways to Search a Lifetime of Media
SCM organizes search into five distinct modes, each powered by a different model running locally.
The Files mode performs whole-file semantic search across photos and videos, ranking results by meaning with boosts from filenames and phrases. Scenes goes deeper: the app segments videos into individual scenes and embeds each one separately, so a query lands you on the exact shot, with a jump straight to its timecode rather than a timestamp buried in a filename.
Two text-focused modes handle the words inside media. The OCR mode, built on the Tesseract engine, reads text that is visibly present in images and video frames and matches it literally, with English plus 35 additional language packs that can be toggled on. The Dialogue mode runs Whisper speech recognition over videos and indexes the exact spoken words, with tiered levels of match exactness for hunting a specific line.
Finally, an opt-in LLMs mode turns the extracted material — dialogue transcripts, OCR text and filenames — into a local chat context. Users can ask questions about their own library, and the app returns answers with citations pointing back to the source files, all generated by a model running on the same machine.
How It Works Under the Hood
Technically, SCM is an Electron application written in JavaScript, using the Bun toolkit as its package manager and runtime. The heavy lifting is done by transformer models executed directly in the app — the default vision model is a CLIP variant whose weights, roughly 435 megabytes, are downloaded once on first use.
The index maintains itself. Watched folders auto-import new media as it arrives, content hashing deduplicates files that have merely been renamed or moved, and switching to a different model re-embeds the library in the background without blocking searches. The developer notes that menu-bar and tray features are specific to macOS, where the app is packaged for distribution.
The privacy model is the selling point. The project's documentation is explicit: media never leaves the machine, inference runs locally through transformer runtimes, and after the initial weight download everything works offline. For users with sensitive archives — medical imagery, legal footage, personal video — that architectural choice is the feature.
Built for Personal Archives
The interface reflects the same philosophy of customization. Any query can be saved as a reusable tab, so a search that took a moment to phrase becomes a permanent view over the library. The app also ships with toggleable Screenshots and Email tabs, acknowledging that a modern Mac accumulates screenshots and attachments at a pace that quickly outgrows the operating system's own search.
The underlying technique is the now-standard machinery of semantic search: a vision model converts each image and video scene into a numerical embedding, and queries are embedded the same way so that matching happens by meaning rather than keyword overlap. What is notable here is not the technique but the packaging — the same pipeline that cloud photo services run on server farms is compressed into an Electron app that a non-developer can install and run unattended over folders of their choosing.
Part of a Larger Shift Toward Local AI
SCM は、消費者向けハードウェア上で有能な AI モデルを実行することが目新しいものから期待されるものへと変化する中で登場しました。 Apple はセマンティック検索を自社の写真アプリに着実に押し込んでいますが、その一方で、オープンソースの音声、視覚、およびテキストのモデルはラップトップで快適に動作するサイズまで縮小されています。不足しているのは、基礎となるモデルではなく、統合レイヤーです。つまり、エンジニア以外のユーザーが実際に自分のファイルで使用できるものにそれらを結び付けるソフトウェアです。
それが SCM が占めるニッチな分野であり、その受け入れられ方は、その痒みが本物であることを示唆しています。リポジトリはおよそ 1 日で 160 個のスターと 8 個のフォークを収集し、Hacker News のコメント投稿者はモデル サイズ、インデックス作成速度、Windows の可用性について質問を集中しました。現時点ではプロジェクトが macOS 専用であるため、最後の質問に対する答えは現時点では「ノー」です。
このプロジェクトは MIT ライセンスに基づいてリリースされており、商用利用と変更が許可されています。写真や画面録画の大規模で整理されていないアーカイブを所有し、それをどこにでもアップロードすることを原理的に嫌う人にとって、これは、完全なローカル メディア検索エンジンがもはや研究デモではなく、午後のインストールであるということを示す、最も説得力のあるデモンストレーションの 1 つです。
---
AIの最新情報をお届けAIの最新ニュース、分析、ブレイクスルーを一箇所で。
AIニュースをもっと読む →
