文档 / 术语表
术语表
本术语表提供了 Langfuse 文档中使用的关键术语和概念的定义。
可观测性（Observability）
| 术语 | 定义 |
|---|---|
| Agent | An observation type that represents an AI agent workflow, including multi-step reasoning processes, tool orchestration, and autonomous decision-making. Used to track agent behavior and interactions. （同义词：Observation Type） |
| Agent Graph | A visual representation of complex AI agent workflows in Langfuse. Agent graphs help you understand and debug multi-step reasoning processes and agent interactions by displaying the flow of observations within a trace. |
| AI Engineering Loop | A lifecycle for continuously improving AI-powered systems by connecting production visibility with development workflows. It moves from tracing and monitoring real behavior to building datasets, running experiments, and evaluating changes before the cycle starts again. |
| Chain | An observation type that represents a link between different application steps, such as passing context from a retriever to an LLM call. （同义词：Observation Type） |
| Custom Dashboards | Flexible, self-service analytics dashboards that allow you to visualize and monitor metrics from your LLM application. Dashboards support multiple chart types, filtering, and multi-level aggregations. |
| Embedding | An observation type that represents a call to an LLM to generate embeddings. Can include model information, token usage, and costs. （同义词：Observation Type） |
| Environment | A way to organize traces, observations, and scores from different deployment contexts (e.g., production, staging, development). Helps keep data separate while using the same project. |
| Evaluator | An observation type that represents functions assessing the relevance, correctness, or helpfulness of LLM outputs. Also refers to the function that scores experiment results. （同义词：Observation Type） |
| Event | A basic observation type used to track discrete events in a trace. Events are the building blocks of tracing. （同义词：Observation Type） |
| Filter Search Bar | A single-line query bar for filtering and searching the Observations and Traces tables by typing field:value expressions instead of assembling filters in the sidebar. Supports operators, wildcards, negation, and an Ask AI button that drafts filters from a plain-language description. |
| Generation | An observation type that logs outputs from AI models including prompts, completions, token usage, and costs. The most common observation type for LLM calls. （同义词：Observation Type） |
| Guardrail | An observation type that represents a component protecting against malicious content, jailbreaks, or other security risks. （同义词：Observation Type） |
| Instrumentation | The process of adding code to record application behavior. Langfuse provides context managers, observe wrappers, and manual observation methods for instrumenting your application. |
| Log View | Shows all observations concatenated. Great for quickly scanning through them. |
| Model Definition | A configuration that stores pricing information for an LLM model. Model definitions specify the cost per input and output token, enabling Langfuse to automatically calculate the price of generations based on token usage. |
| Observation | An individual step within a trace. Observations can be of different types (span, generation, event, tool, etc.) and can be nested to represent hierarchical workflows. |
| OpenTelemetry | An open standard for collecting telemetry data from applications. Langfuse is built on OpenTelemetry, enabling interoperability and reducing vendor lock-in. （同义词：OTel） |
| Retriever | An observation type that represents data retrieval steps, such as calls to vector stores or databases in RAG applications. （同义词：Observation Type） |
| Session | A way to group related traces that are part of the same user interaction. Commonly used for multi-turn conversations or chat threads. |
| Span | An observation type that represents the duration of a unit of work in a trace. The default observation type for most operations. （同义词：Observation Type） |
| Tags | Flexible labels that categorize and filter traces and observations. Useful for organizing by feature, API endpoint, workflow, or other criteria. |
| Token | The basic unit of text that LLMs process. Tokens can be words, parts of words, or characters depending on the model's tokenizer. Token counts determine API costs and context window limits. Langfuse tracks input and output tokens for cost monitoring and optimization. |
| Tool | An observation type that represents a tool call in your application, such as calling a weather API or executing a database query. （同义词：Observation Type） |
| Trace | A single request or operation in your LLM application. Traces contain the overall input, output, and metadata, along with nested observations that capture each step. |
| Tracing | The process of capturing structured logs of every request in your LLM application. Includes prompts, responses, token usage, latency, and any intermediate steps. |
| User Tracking | The ability to associate traces with users via a userId. Enables per-user analytics, cost tracking, and filtering. |
评估（Evaluation）
| 术语 | 定义 |
|---|---|
| AI Engineering Loop | A lifecycle for continuously improving AI-powered systems by connecting production visibility with development workflows. It moves from tracing and monitoring real behavior to building datasets, running experiments, and evaluating changes before the cycle starts again. |
| Annotation Queue | A manual evaluation method that allows domain experts to review and add scores and comments to traces, observations, or sessions. Useful for building ground truth, systematic labeling, and team collaboration. |
| Dataset | A collection of test cases (dataset items) used to test and benchmark LLM applications. Datasets contain inputs and optionally expected outputs for systematic testing. |
| Dataset Experiment | Also known as a Dataset Run. The execution of a dataset through your LLM application, producing outputs that can be evaluated. Links dataset items to their corresponding traces. （同义词：Dataset Run, Experiment Run） |
| Dataset Item | An individual test case within a dataset. Each item contains an input (the scenario to test) and optionally an expected output. |
| Evaluation Method | A function that scores traces, observations, sessions, or dataset runs. Methods include LLM-as-a-Judge for subjective assessments, Annotation Queues for human review, Scores via UI for spot checks, and Scores via API/SDK for programmatic evaluation. |
| LLM-as-a-Judge | An evaluation method that uses an LLM to score the output of your application based on custom criteria. Provides scalable, repeatable evaluations with chain-of-thought reasoning. |
| Offline Evaluation | Testing your application against a fixed dataset before deployment. Used to validate changes and catch regressions during development. |
| Online Evaluation | Scoring live production traces to catch issues in real traffic. Helps identify edge cases and monitor application quality in production. |
| Remote Experiment | A webhook-based trigger that allows running SDK experiments from the Langfuse UI. Configure a webhook URL and default config, then trigger experiments that fetch the dataset, run your application, and ingest scores back into Langfuse. |
| Score | The output of an annotation or automated evaluation. Scores can be numeric, categorical, boolean, or text and are assigned to traces, observations, sessions, or dataset runs. |
| Score Config | A configuration defining how a score is calculated and interpreted. Includes data type, value constraints, and categories for standardized scoring. |
| Task | A function definition that processes dataset items during an experiment. The task represents the application code you want to test. |
提示词（Prompts）
| 术语 | 定义 |
|---|---|
| Chat Prompt | A prompt type that consists of an array of messages with specific roles (system, user, assistant). Useful for managing complete conversation structures and chat history. （同义词：Message Prompt） |
| Playground | The LLM Playground where you can test, iterate, and compare different prompts and models directly in Langfuse without writing code. |
| Prompt Label | A label that can be assigned to a prompt version. Used to mark prompt versions as production or staging to fetch them via the SDK or API. |
| Prompt Management | A systematic approach to storing, versioning, and retrieving prompts for LLM applications. Decouples prompt updates from code deployment. |
| Prompt Variables | Placeholders in prompts that are dynamically filled at runtime. Allow creating reusable prompt templates with customizable content. |
| Protected Prompt Label | Restricts the ability to modify certain prompt labels (e.g. production) from being added to new prompt versions to admins and owners. This prevents accidental or unauthorized changes to production prompts. |
| Text Prompt | A prompt type that consists of a single string. Ideal for simple use cases or when you only need a system message. （同义词：String Prompt） |
SDK（SDK）
| 术语 | 定义 |
|---|---|
| Flush | The process of sending buffered trace data to the Langfuse server. Important for short-lived applications to ensure no data is lost when the process terminates. |
| Instrumentation | The process of adding code to record application behavior. Langfuse provides context managers, observe wrappers, and manual observation methods for instrumenting your application. |
| OpenTelemetry | An open standard for collecting telemetry data from applications. Langfuse is built on OpenTelemetry, enabling interoperability and reducing vendor lock-in. （同义词：OTel） |
| SDK | Software Development Kit. Langfuse provides native SDKs for Python and JavaScript/TypeScript that handle tracing, prompt management, and API access. （同义词：Software Development Kit） |
平台（Platform）
| 术语 | 定义 |
|---|---|
| API Key | Credentials used to authenticate with the Langfuse API and SDKs. API keys consist of a public key and secret key and are associated with a specific project. They are managed in project settings. |
| Billable Unit | The unit of measurement for Langfuse Cloud pricing. Units are the sum of traces, observations, and scores ingested per billing period. |
| Langfuse Assistant | An in-product AI assistant, available in beta on Langfuse Cloud, for exploring project data and Langfuse workflows in plain language. It queries traces, observations, sessions, and metrics through the Langfuse MCP server, searches documentation, and proposes navigation actions that you confirm. |
| LLM Connection | An API key configuration that allows Langfuse to call LLM models in the Playground or for LLM-as-a-Judge evaluations. Supports providers like OpenAI, Anthropic, and Google. |
| MCP Server | A Model Context Protocol server that enables AI-powered tools to interact with Langfuse data. Used for advanced integrations and AI-assisted workflows. |
| Organization | A top-level entity in Langfuse that contains projects. Organizations manage billing, team members, and SSO configuration. |
| Project | A container that groups all Langfuse data within an organization. Projects enable fine-grained role-based access control and separate data for different applications. |
| RBAC | Role-Based Access Control that manages permissions within Langfuse. Roles include Owner, Admin, Member, Viewer, and None, each with specific scopes. （同义词：Role-Based Access Control） |
API（API）
| 术语 | 定义 |
|---|---|
| API Key | Credentials used to authenticate with the Langfuse API and SDKs. API keys consist of a public key and secret key and are associated with a specific project. They are managed in project settings. |
| Metrics API | An API endpoint for retrieving customized analytics from Langfuse data. Allows specifying dimensions, metrics, filters, and time granularity to build custom reports and dashboards for LLM applications. |
| Public API | The REST API that provides access to all Langfuse data and features. Used for custom integrations, workflows, and programmatic access. |