/

OpenAI

&

Replicate

Integrate OpenAI and Replicate

Connect OpenAI and Replicate nodes in your workflow. Integrate with any tool or database and ship powerful backend logic and APIs instantly - No code required!

Node stack

Supported OpenAI and Replicate Nodes

Add any other tools or your preferred database nodes. If an integration is not available generate your own using AI

Fetch OpenAI File

Generates a readable stream for a file stored in OpenAI Storage. Return this stream using a 'Return' node to receive it through an API endpoint (to download the file, write it to the file system, etc.)

Generate Embeddings

Generate embeddings for a given content using OpenAI text-embedding-ada-002 model

GPT-4 Vision

Use GPT-4 Vision to ask questions about images.

Image Generator

Converts text to Base64 image using OpenAI's DALL·E models.

JSON Generator

Generates text based on a given user and system prompt and always returns a JSON object using the OpenAI GPT (Turbo) APIs.

LLM Extract

Extract structured data from any text input.

LLM Extract URL

Extract structured data from any web page.

Multi-Image GPT-4 Vision

Analyses multiple images using the OpenAI GPT-4 Vision model.

Neighbor Search

Find the nearest neighbors for a given search query using OpenAI embeddings

OpenAI Assistant

Add different script nodes and let the AI Assistant automatically choose which to execute based on the input. Built to work with OpenAI Assistants API V2.

OpenAI Assistant (Stream Response)

Add different script nodes and let the AI Assistant automatically choose which to execute based on the input. The node returns a streamed text response (meant to be returned back to the client) and the thread ID (to track the conversation). Built to work with OpenAI Assistants API.

Stream Response

Send a chat message to OpenAI and return the response stream. --- If you plan on sending this stream back to the client as the response, you may want to consider adding a **Set Response Header** node following this node (and before the return node) with the key set to `content-type` and the value set to `text/plain`, to make it easier for the client to figure out how to handle the stream.

Text Generator

Generates text using OpenAI API for a given user and system prompt

Text to Speech

Converts text to speech using OpenAI API and returns audio in Base64.

Whisper Speech To Text

Convert audio/speech to text using OpenAI's Whisper API.

Answer Image Questions

Answers questions about images using the Replicate model

Background Remover

Remove the background from images using Replicate API

Face Restoration

Performs practical face restoration algorithm for old photos or AI-generated faces using Replicate

Face Swap

Swaps faces using replicate's yan-ops/face_swap model.

Image Super-Resolution and Restoration

Performs a AI Photorealistic Image Super-Resolution and Restoration using Replicate

Llama 2 Chat

Llama 2 for chat completion

Music Generator

Uses Replicate's music-gen model to generate music based on a user prompt.

Replicate Client

A generic Replicate Client to use any Replicate model.

Replicate Llama Text Generator

Uses Replicate Llama model to generate text based on a provided prompt and system prompt while applying various text generation settings.

Stability AI Image Generation

Text to image generation using Stability AI's sdxl model that creates beautiful 1024x1024 images

Stability AI Text Generation

Generate text using the Stability AI 7 billion parameter language model

Upscale Image

Performs Real-ESRGAN with optional face correction and adjustable upscale

Quick start

How to integrate OpenAI and Replicate

Step 1 — Add the nodes to your workflow

Create a new workflow in BuildShip, click “Add node”, and select the OpenAI and Replicate actions you want to use.

Step 2 — Configure each node

Go to each node to authenticate (or add your API key) and fill in the required parameters.

Step 3 — Connect the nodes

Each node in BuildShip can connect to others by using their output variables. When you reference a variable from one node in another, BuildShip automatically links them in the workflow.

Step 4 — Test your workflow

Define your starting data in the Inputs node and choose what to do with the result in the Flow Output node. Finally, run a test to see your workflow in action.

blog posts & tutorials

Recommended Reads

Below are recommneded blogs that will help in your journey