Track Anything

Within weeks of Meta's Segment Anything launch in April 2023, the SUSTech VIP Lab team behind Track Anything showed how to make it work on video: click an object in one frame, let SAM produce a mask, then hand that mask to the XMem tracker to follow it through the clip, with an optional E2FGVI pass to paint the object out. The Gradio app made interactive video masking and object removal reachable for people who had never trained a model, and it became a popular annotation shortcut. Code changes stopped in June 2023; the only later commit, in December 2025, added a README pointer to the authors' newer SAM-Body4D project. It can still be installed on an NVIDIA GPU, but its requirements are unpinned, so a fresh environment pulls current Gradio and PyTorch releases the 2023 code never saw, and nobody upstream is fixing the breakage. Its own code is MIT, while the E2FGVI inpainting model it relies on is CC BY-NC 4.0, so object removal is limited to non-commercial use. For new work, Meta's SAM 2 (Apache-2.0) handles click-to-track video segmentation in a single model, and SAM 3 adds text prompts.