This example demonstrates how to use PyPilot to create a task that generates test data based on a given template. It showcases the use of custom types and efficient batch processing.

​
Code

The following code creates a function that takes a count then returns a list of generated user profiles that match a provide result_type template:

import pypilot as pypilot
from pydantic import BaseModel, Field


class UserProfile(BaseModel):
    name: str = Field(description='The full name of the user')
    age: int = Field(description='The age of the user, 20-60')
    occupation: str = Field(description='The occupation of the user')
    hobby: str 


def generate_profiles(count: int) -> list[UserProfile]:
    return pypilot.run(
        f"Generate {count} user profiles",
        result_type=list[UserProfile],
        context={"count": count}
    )

Now we can generate some test data:

test_data = generate_profiles(count=5)

from rich import print
print(test_data)

​
Key concepts

This implementation showcases several important PyPilot Features:

  1. Pydantic models: We use a Pydantic model (UserProfile) to define the structure of our generated data. This ensures that the generation task returns well-structured, consistent results.

    class UserProfile(BaseModel):
    name: str
    age: int
    occupation: str
    hobby: str

  2. Batch processing: We generate multiple user profiles in a single task, which is more efficient than generating them individually. This is achieved by specifying List[UserProfile] as the result_type.

    result_type=List[UserProfile]

  3. Context passing: We pass the desired count as context to the task, allowing the LLM to generate multiple data points based on the given parameters.

    context={"count": count}

By leveraging these PyPilot Features, we create an efficient and flexible test data generation tool. This example demonstrates how PyPilot can be used to build AI-powered data generation workflows that can produce multiple data points in a single operation, based on customizable templates. This approach is particularly useful for creating diverse and realistic test datasets for various applications.