A React Native application that implements OpenAI integration for audio calls with visualization of the audio voices. Shows a glimpse of the AI-powered features that can be built using the Stream Video SDK.
Here's a screenshot of the end result:
- Connects to an audio call with an AI agent, so the user can discuss technical topics regarding the Stream Products
- Visualizes the audio of the agent and the user
- Uses OpenAI to power the AI agent
- You have followed the steps in the Node.js server and you have a localhost running
- Stream account with API key and secret
- OpenAI API key with access to the Realtime API
- Stream Video's iOS SDK (1.18.0 or above for the best experience)
-
first you need to start the backend server. More info on the backend server can be found here
- update the
src/join.tsfile on line:10const baseUrl = "your localhost url here";with an url to your local backend server - for easier access from your testing devices, you can use ngrok to get a public url for your local server
- update the
-
then, you will need to run the client Metro dev server
# Using npm
npm start
# OR using Yarn
yarn start# Using npm
npm run android
# OR using Yarn
yarn androidFor iOS, remember to install CocoaPods dependencies (this only needs to be run on first clone or after updating native deps).
bundle installbundle exec pod installTo start the native iOS app, run the following command:
# Using npm
npm run ios
# OR using Yarn
yarn iosThis project is licensed under the BSD 3-Clause License - see the LICENSE file for details.
