What is Prompt Lab?

Prompt Lab is a utility that serves as an environment for you to experiment with custom prompts, as well as customizing aspects such as the LLM, temperature, Max. Tokens, Top K, and Top P values. You can also save your tests, modify them, and compare previous LLM outputs with new ones. You can find the Prompt Lab under the Utilities section of the left-hand side menu.

Core Capabilities

• Facilitates Rapid Experimentation: Quickly test ideas to identify the best prompt formulations for your AI applications.
• Model Comparison: Evaluate outputs from different AI models for the same prompt to determine optimal model performance.
• Knowledge Retention: Save and manage effective prompts for consistent results and future use.
• Boosts Productivity: Access a library of tested, pre-built prompts to save time and standardize best practices across teams.
• Supports Iterative Improvement: Refine prompts based on model performance to achieve optimal outcomes.

Layout

1. Prompting Section: Located on the upper left side of the screen. Here, you can design your prompts, models, and make desired parameter changes.
2. Saved Tests: Located on the right-hand side of the screen. Here, you can visualize your saved prompts and load them if you want to.
3. Response Section: Located on the lower left side of the screen. Here, you can track the LLM responses to the prompt by comparing both the most recent and the previous response displayed and labeled.

Using the Prompt Lab

1. Create a name for your new test.
2. Select the model you want to use.
3. Adjust the temperature of the LLM. Higher the temperature, the more “creative” and “unpredictable” the response the LLM will provide, and vice versa.
4. If you would like to adjust more parameters, select Advanced settings and alter the parameters as desired.
5. Under the “Prompt” text box, insert the prompt you want to test.
6. Once everything is ready, select Generate below the text box, and wait for the LLM Output, which will be displayed at the bottom of your screen.
7. If you want, you can save or update your test by selecting the Save test button. This will save the prompt, the parameters, as well as the LLM Output for further testing.