--- layout: article title: Integrating Anyscale description: Learn how to integrate Anyscale into your Appwrite project. difficulty: intermediate readtime: 15 --- The Anyscale API is a powerful tool for generating text using the leading open-source models. This tutorial will guide you through setting up the Anyscale API and integrating it into your Appwrite project. You'll create a simple function that takes a text prompt and generates a completion using Mistral's Mixtral 8x7B model. Then, using Appwrite functions, you'll create a UI that allows users to input text and see the generated completion. # Prerequisites {% #prerequisites %} - An Appwrite Project - An [Anyscale API Key](https://app.endpoints.anyscale.com/credentials) {% section #step-1 step=1 title="Create new function" %} Head to the [Appwrite Console](https://cloud.appwrite.io/console), click on **Functions** in the left sidebar and click the **Create Function** button. {% only_dark %} ![Create function screen](/images/docs/functions/dark/template.avif) {% /only_dark %} {% only_light %} ![Create function screen](/images/docs/functions/template.avif) {% /only_light %} 1. In the Appwrite Console's sidebar, click **Functions**. 1. Click **Create function**. 1. Under **Connect Git repository**, select your provider. 1. After connecting to GitHub, under **Quick start**, select the **Node.js** starter template. 1. In the **Variables** step, add `ANYSCALE_API_KEY`. Generate your AnyScale key [here](https://app.endpoints.anyscale.com/credentials). 1. Follow the step-by-step wizard and create the function. {% /section %} {% section #step-2 step=2 title="Add OpenAI SDK" %} Once the function is created, navigate to the freshly created repository and clone it to your local machine. Install the `openai` package to simplify interacting with the AnyScale API, as it is an OpenAI-compatible API. ```bash npm install openai ``` {% /section %} {% section #step-3 step=3 title="Create utility function" %} For this example, the function can take both `GET` and `POST` requests. For the `GET` request, return a static HTML page that will have a form to submit text to the API. Meanwhile, the `POST` request will send the text to the AnyScale API and return the generated text. Write the code to return the static HTML page. To do this, create a new `src/utils.js` file with the following code: ```js import path from 'path'; import { fileURLToPath } from 'url'; import fs from 'fs'; const __filename = fileURLToPath(import.meta.url); const __dirname = path.dirname(__filename); const staticFolder = path.join(__dirname, '../static'); export function getStaticFile(fileName) { return fs.readFileSync(path.join(staticFolder, fileName)).toString(); } ``` {% /section %} {% section #step-4 step=4 title="Handle GET request" %} Write the `GET` request handler in the `src/main.js` file. This handler will return a static HTML page you'll create later. ```js import { getStaticFile } from './utils.js'; export default async ({ req, res, error }) => { if (req.method === 'GET') { return res.text(getStaticFile('index.html'), 200, { 'Content-Type': 'text/html; charset=utf-8', }); } }; ``` If the method is `GET`, it returns the static HTML page. {% /section %} {% section #step-5 step=5 title="Create web page" %} Create an HTML web page that the function will serve. Create a new file at `static/index.html` with some HTML boilerplate: ```html Anyscale Demo ``` The code above includes a script that will handle the form submission and a script tag that includes of the Alpine.js library. This library will be used to handle the submission of the form. After the `` tag add a `` containing the visible form: ```html

Prompt Anyscale Demo

Use this page to test your implementation with Anyscale using Mixtral 8x7B. Enter text and receive the model output as a response.

``` The form will allow users to submit text to the Appwrite function through a POST request. The Appwrite function will call the Anyscale API and return the response to the user. {% /section %} {% section #step-6 step=6 title="Handle POST request" %} Add methods necessary to integrate with the Anyscale API. Import `openai` and the Appwrite SDK at the top of the `main.js` file. ```js import OpenAI from 'openai'; ``` Add code to validate the body of the request and initialize the Appwrite SDK after the `GET` request handler from earlier: ```js if (!req.body.prompt && typeof req.body.prompt !== "string") { return res.json({ ok: false, error: "Missing required field `prompt`" }, 400); } const openai = new OpenAI( { apiKey: process.env.ANYSCALE_API_KEY, baseURL: "https://api.endpoints.anyscale.com/v1" } ); ``` Make a request to the Anyscale API and return the response: ```js try { const response = await openai.chat.completions.create({ model: "mistralai/Mixtral-8x7B-Instruct-v0.1", max_tokens: parseInt(process.env.ANYSCALE_MAX_TOKENS ?? "512"), messages: [{ role: "user", content: req.body.prompt }], stream: false }); const completion = response.choices[0].message?.content; return res.json({ ok: true, completion }, 200); } catch (err) { error(err); return res.json({ ok: false, error: "Failed to query model." }, 500); } ``` {% /section %} {% section #step-8 step=8 title="Test the function" %} Now that the function is deployed test it by visiting the function URL in your browser. This should show the UI created earlier. To test it, write a prompt and click the submit button. After a brief moment, you should see the text generated by the Anyscale API. ![Testing the function](/images/docs/ai/integrations/anyscale/demo.avif) {% /section %}

Prompt Anyscale Demo

Anyscale: