Logitloom: Explore token trajectory trees on instruct and base models

Summary

logitloom logitloom is a tool for exploring token trajectory trees (aka looming) on instruct and base models. Getting started Go to https://vgel.me/logitloom to use the deployed version of the tool. Using a chat model You will need a chat API that supports both assistant prefill (for the prefill setting and for expanding non-chosen branches), along with logprobs. I recommend deepseek-v3 for this. (NOT r1, which doesn't support logprobs via the Deepseek API.) Base URL: https://api.deepseek.com/beta API Key: Get one from https://platform.deepseek.com/api_keys. API keys are only stored and used locally, there's no backend. Get one from https://platform.deepseek.com/api_keys. API keys are only stored and used locally, there's no backend. Model: deepseek-chat Type: chat (You can save this as a preset to easily switch back to later using Edit Presets.) You can now fill in a prompt, and optionally an assistant prefill, and click run to start expanding the tree. Using a base model The best base model host currently is Hyperbolic's 405-base. I recommend using it directly, instead of via OpenRouter, which can introduce some issues. You will need a completions API that supports logprobs. (Most do.) Base URL: https://api.hyperbolic.xyz/v1 API Key: Get one from https://app.hyperbolic.xyz/settings. API keys are only stored and used locally, there's no backend. Get one from https://app.hyperbolic.xyz/settings. API keys are only stored and used locally, there's no backend. Model: meta-llama/Meta-Llama-3.1-405B Type: base (You can save this as a preset to easily switch back to later using Edit Presets.) You can now fill in either a prompt or prefill, and click run to start expanding the tree. (Prompt and prefill are simply concatenated for base models, so use either one.) Features "Run" will begin building a new tree (overwriting your current one) using the given expansion settings. Depth: How deep to expand the tree, in tokens. Max children: How many child options to consider for e...