kazoottt-blog-v2/src/content/note/ChainForge简单介绍.md

toAstro, astroType, published, toWexin, toJuejin, toZhihu, title, date, author, tags, finished, category, slug, description, NotionID-notionnext, link-notionnext, date_created, date_modified

toAstro	astroType	published	toWexin	toJuejin	toZhihu	title	date	author	tags	finished	category	slug	description	NotionID-notionnext	link-notionnext	date_created	date_modified
true	null	true	null	null	null	ChainForge简单介绍	2024-05-22T00:00:00.000Z	KazooTTT	工具 chainforge llm	true	AI	chainforge-intro	ChainForge is a visual programming environment designed for prompt engineering, allowing users to evaluate and test prompts for large language models (LLMs). It supports various use cases such as assessing prompt effectiveness, conducting adversarial testing, and evaluating model performance. The platform also facilitates the customization of LLMs through its documentation on adding custom providers. Users can find practical examples and tutorials on the ChainForge website and GitHub repository, including a case study on Twitter and a video demonstrating LLM prompt injection attacks and vulnerability testing. Additionally, ChainForge is working on enhancing its functionality by enabling internal and proxy network environments.	40ec4f8d-2030-4ce1-b8c7-c1c9f56ef55b	https://kazoottt.notion.site/ChainForge-40ec4f8d20304ce1b8c7c1c9f56ef55b	20250104	20250304

ChainForge 简单介绍

官网：

ChainForge: A visual programming environment for prompt engineering

github 地址：

GitHub - ianarawjo/ChainForge: An open-source visual programming environment for battle-testing prompts to LLMs.

简介

使用场景

评估提示词

攻击性测试

评估模型

评估某项指标

实践

这两个例子单独拿出来讲

TODO

1. 内部环境运行
2. 内网环境 proxy [Add Custom Providers - ChainForge Documentation](https://chainforge.ai/docs/custom_providers/ 提供了自定义 llm

参考

使用案例：

X

自动化 Prompts

[2402.10949] The Unreasonable Effectiveness of Eccentric Automatic Prompts

相关的视频

LLM Prompt Injection Attacks & Testing Vulnerabilities With ChainForge - YouTube

使用 ChainForge 进行 LLM 提示注入攻击和漏洞测试