Toppy M 7B
JetMoE
Login to get your token

And use it in the following codes.

import os
from leptonai.client import Client

api_token = os.environ.get('LEPTON_API_TOKEN')
client = Client("https://sambacoev03.lepton.run", token=api_token)

result = client.run(
    text="[INST] Create an itemized list of tasks to complete to create a startup [/INST]",
    max_new_tokens=256,
    temperature=0.9,
    top_k=50,
    top_p=0.9,
    repetition_penalty=1,
    do_sample=True
)
print(result)

The rate limit for the Model APIs is 10 requests per minute across all models under Basic Plan. For the pricing plan, you may check out pricing page, If you need a higher rate limit with SLA or dedicated deployment, please contact us.