Skip to content

Commit de2a87e

Browse files
zererazoindrila-b
andauthored
upgrade to v0.3.0 (#320)
* upgrade to v0.3.0 * feat: add support for ollama fast model * upgrade to v0.3.0 * feat: add support for ollama fast model * styles: update the thinking color and change the heading font sizes * feat(docs): Added changes in documents WRT latest code --------- Co-authored-by: oindrilabanerjee <banerjee.oindrila.ob@gmail.com>
1 parent a637476 commit de2a87e

File tree

14 files changed

+242
-67
lines changed

14 files changed

+242
-67
lines changed

docs/apikeys/apikeys.mdx

+65-5
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ icon: 'key'
66

77
This guide providers more details about creating and setting AI api keys in your .env file for using Xyne's chat feature.
88

9-
To use **AI chat**, you need to configure access credentials. You can use one of the following providers: ***AWS, OpenAI, or Ollama***.
9+
To use **AI chat**, you need to configure access credentials. You can use one of the following providers: ***AWS, OpenAI, Ollama, Together AI or Fireworks AI***.
1010

1111
### AWS (Amazon Bedrock)
1212

@@ -15,6 +15,8 @@ To use **AI chat**, you need to configure access credentials. You can use one of
1515
- Add them as environment variables in your ```.env.default``` file:
1616
```javascript .env.default
1717
AWS_ACCESS_KEY=<YOUR_AWS_ACCESS_KEY>
18+
AWS_SECRET_KEY=<YOUR_AWS_SECRET_KEY>
19+
AWS_REGION=<YOUR_AWS_REGION>
1820
```
1921
<Note> The ```AWS_REGION``` key is optional in the ```.env.default``` file; if not provided, it defaults to ```us-west-2``` </Note>
2022

@@ -25,15 +27,73 @@ To use **AI chat**, you need to configure access credentials. You can use one of
2527
OPENAI_API_KEY=<YOUR_OPENAI_API_KEY>
2628
```
2729
### Ollama (Local LLM)
28-
- Install Ollama and the desired model from ollama.com.
30+
- Install Ollama and the desired model from [Ollama](https://ollama.com/).
2931
- Add the model name in your .env.default file:
3032
```javascript .env.default
3133
OLLAMA_MODEL=<YOUR_OLLAMA_MODEL_NAME>
3234
```
33-
<Tip> If you're using Ollama, ensure the specified model is downloaded locally. </Tip>
35+
<Tip> If you're using Ollama, ensure the specified model is downloaded locally. </Tip>
36+
37+
### Together AI
38+
- Create your API key in [Together AI](https://www.together.ai/)
39+
- Select the model from your choice.
40+
- Add the following to your .env.default file:
41+
```javascript .env.default
42+
TOGETHER_API_KEY=<YOUR_TOGETHER_API_KEY>
43+
TOGETHER_MODEL=<YOUR_TOGETHER_MODEL>
44+
TOGETHER_FAST_MODEL=<YOUR_TOGETHER_FAST_MODEL>
45+
```
46+
47+
### Fireworks AI
48+
- Create your API key in [Fireworks AI](https://fireworks.ai/)
49+
- Select the model from your choice.
50+
- Add the following to your .env.default file:
51+
```javascript .env.default
52+
FIREWORKS_API_KEY=<YOUR_FIREWORKS_API_KEY>
53+
FIREWORKS_MODEL=<YOUR_FIREWORKS_MODEL>
54+
FIREWORKS_FAST_MODEL=<YOUR_FIREWORKS_FAST_MODEL>
55+
```
56+
57+
## Setting up for Reasoning [Together | Fireworks | Ollama] :
58+
59+
For addition of only reasoning in your model, you need to add REASONING in your .env.default file:
60+
```javascript .env.default
61+
REASONING=true
62+
```
63+
64+
### For example :
65+
66+
#### Reasoning with Together AI :
67+
68+
```javascript .env.default
69+
TOGETHER_API_KEY=<YOUR_TOGETHER_API_KEY>
70+
TOGETHER_MODEL=deepseek-ai/DeepSeek-R1
71+
TOGETHER_FAST_MODEL=deepseek-ai/DeepSeek-V3
72+
REASONING=true
73+
FAST_MODEL_REASONING=false
74+
```
75+
#### Reasoning with Fireworks AI :
76+
77+
```javascript .env.default
78+
FIREWORKS_API_KEY=<YOUR_FIREWORKS_API_KEY>
79+
FIREWORKS_MODEL=accounts/fireworks/models/deepseek-r1
80+
FIREWORKS_FAST_MODEL=accounts/fireworks/models/deepseek-v3
81+
REASONING=true
82+
FAST_MODEL_REASONING=false
83+
```
84+
85+
#### Reasoning with Ollama :
86+
87+
```javascript .env.default
88+
OLLAMA_MODEL=<REASONING_MODEL>
89+
OLLAMA_FAST_MODEL=non reasoning model
90+
REASONING=true
91+
FAST_MODEL_REASONING=false
92+
```
93+
3494
### Key Selection Order :
3595
If multiple keys are set in the environment variable, our system follows this precedence:
3696
```javascript
37-
AWS → OpenAI → Ollama
97+
AWS → OpenAI → Ollama → Together AI → Fireworks AI
3898
```
39-
<Tip>Only anyone provider is required to get started. This means either AWS or OpenAI or Ollama can be used, all of them aren't required.</Tip>
99+
<Tip>Only anyone provider is required to get started. This means either AWS or OpenAI, Ollama, Together AI or Fireworks AI can be used, all of them aren't required.</Tip>

docs/authentication/service-accounts.mdx

+1-1
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ Once you've filled out the details, click on `CREATE AND CONTINUE`
4545
- Choose the ```json``` option for downloading the key file, and click on ```Create```.
4646
<img height="200" src="../images/serv-acc5.png" />
4747
- Remember the ```Client id``` associated with this json file.
48-
- Once the key file has been created, choose a reliable location for downloading the key file, this will be used for putting it in the [```.env``` of the application](https://docs.xynehq.com/deployment/cloud/aws/aws-deployment-with-docker#setting-the-environment-variables)
48+
- Once the key file has been created, choose a reliable location for downloading the key file, this will be used for putting it in the [```.env``` of the application](https://docs.xynehq.com/quickstart#setting-the-environment-variables)
4949

5050

5151
## Enabling APIs

docs/contribution/devmode.mdx

+23-4
Original file line numberDiff line numberDiff line change
@@ -40,21 +40,40 @@ In the ```.env.development``` file, you can paste the following :
4040
ENCRYPTION_KEY=<YOUR_ENCRYPTION_KEY>
4141
# If you wish to execute authorization using Service Account then use :
4242
SERVICE_ACCOUNT_ENCRYPTION_KEY=<YOUR_SERVICE_ACCOUNT_ENCRYPTION_KEY>
43-
# If you wish to execute authorization using Oauth then use :
43+
44+
4445
GOOGLE_CLIENT_ID=<YOUR_GOOGLE_CLIENT_ID>
4546
GOOGLE_CLIENT_SECRET=<YOUR_GOOGLE_CLIENT_SECRET>
4647
GOOGLE_REDIRECT_URI=http://localhost:3000/v1/auth/callback
48+
4749
HOST=http://localhost:3000
50+
4851
JWT_SECRET=<YOUR_JWT_SECRET>
52+
4953
DATABASE_HOST=xyne-db
5054
VESPA_HOST=vespa
55+
56+
57+
## If using AWS Bedrock
5158
AWS_ACCESS_KEY=<YOUR_AWS_ACCESS_KEY>
5259
AWS_SECRET_KEY=<YOUR_AWS_ACCESS_SECRET>
53-
## OR
60+
AWS_REGION=<YOUR_AWS_REGION>
61+
62+
## OR [ If using Open AI ]
5463
OPENAI_API_KEY=<YOUR_OPEN_API_KEY>
55-
## OR
64+
65+
## OR [ If using Ollama ]
5666
OLLAMA_MODEL=<YOUR_OLLAMA_MODEL_NAME>
57-
AWS_REGION=<YOUR_AWS_REGION>
67+
68+
## OR [ If using Together AI ]
69+
TOGETHER_API_KEY=<YOUR_TOGETHER_API_KEY>
70+
TOGETHER_MODEL=<YOUR_TOGETHER_MODEL>
71+
TOGETHER_FAST_MODEL=<YOUR_TOGETHER_FAST_MODEL>
72+
73+
## OR [ If using Fireworks AI ]
74+
FIREWORKS_API_KEY=<YOUR_FIREWORKS_API_KEY>
75+
FIREWORKS_MODEL=<YOUR_FIREWORKS_MODEL>
76+
FIREWORKS_FAST_MODEL=<YOUR_FIREWORKS_FAST_MODEL>
5877
```
5978

6079
### Set up Docker

docs/deployment/cloud/aws/aws-deployment-with-docker.mdx

+45-5
Original file line numberDiff line numberDiff line change
@@ -54,33 +54,73 @@ Setup your Google Credentials for the application.
5454
Inside the ```server``` folder of the ```xyne``` folder, you will find a ```.env.default``` file, this is the .env file that our docker uses.
5555
For the moment you will find some default generated environment variables that we've set up for the app to work.
5656

57-
<Warning> We strictly recommend generating your own ENCRYPTION_KEY, SERVICE_ACCOUNT_ENCRYPTION_KEY and JWT_SECRET values for security.</Warning>
57+
<Warning> We strictly recommend generating your own ***ENCRYPTION_KEY, SERVICE_ACCOUNT_ENCRYPTION_KEY and JWT_SECRET*** values for security.</Warning>
58+
59+
60+
<Tip>Due to our agentic RAG implementation, the maximum TPM limit exceeds for Open AI's gpt4o model.
61+
For the ***best experience***, we recommend using ***AWS Bedrock or Claude***, as it enhances performance and accuracy. </Tip>
5862

5963
In the ```.env.default``` file, you can modify the following and replace the missing values with your own :
6064

6165
```javascript .env.default file
6266
ENCRYPTION_KEY=<YOUR_ENCRYPTION_KEY>
6367
SERVICE_ACCOUNT_ENCRYPTION_KEY=<YOUR_SERVICE_ACCOUNT_ENCRYPTION_KEY>
64-
# If you wish to execute authorization using Oauth then use :
68+
69+
6570
GOOGLE_CLIENT_ID=<YOUR_GOOGLE_CLIENT_ID>
6671
GOOGLE_CLIENT_SECRET=<YOUR_GOOGLE_CLIENT_SECRET>
6772
GOOGLE_REDIRECT_URI=http://localhost:3001/v1/auth/callback
6873
GOOGLE_PROD_REDIRECT_URI=<YOUR_Public_IPv4_DNS_ADDRESS>/v1/auth/callback
74+
6975
JWT_SECRET=<YOUR_JWT_SECRET>
76+
77+
7078
DATABASE_HOST=xyne-db
7179
VESPA_HOST=vespa
80+
81+
82+
## If using AWS Bedrock
7283
AWS_ACCESS_KEY=<YOUR_AWS_ACCESS_KEY>
7384
AWS_SECRET_KEY=<YOUR_AWS_ACCESS_SECRET>
74-
## OR
85+
AWS_REGION=<YOUR_AWS_REGION>
86+
87+
## OR [ If using Open AI ]
7588
OPENAI_API_KEY=<YOUR_OPEN_API_KEY>
76-
## OR
89+
90+
## OR [ If using Ollama ]
7791
OLLAMA_MODEL=<YOUR_OLLAMA_MODEL_NAME>
92+
93+
## OR [ If using Together AI ]
94+
TOGETHER_API_KEY=<YOUR_TOGETHER_API_KEY>
95+
TOGETHER_MODEL=<YOUR_TOGETHER_MODEL>
96+
TOGETHER_FAST_MODEL=<YOUR_TOGETHER_FAST_MODEL>
97+
98+
## OR [ If using Fireworks AI ]
99+
FIREWORKS_API_KEY=<YOUR_FIREWORKS_API_KEY>
100+
FIREWORKS_MODEL=<YOUR_FIREWORKS_MODEL>
101+
FIREWORKS_FAST_MODEL=<YOUR_FIREWORKS_FAST_MODEL>
102+
103+
78104
HOST=<YOUR_Public_IPv4_DNS_ADDRESS>
79-
AWS_REGION=<YOUR_AWS_REGION>
80105
```
81106

82107
<Warning> Ensure that these IPv4 address is the same as the one you've added in your Google Cloud Project</Warning>
83108

109+
110+
<Tip>To use the chat feature of Xyne, you need any one AI provider (AWS, Ollama, OpenAI Together AI or Fireworks AI). Missing keys will disable chat functionality.</Tip>
111+
112+
You can checkout the AI Providers section for better clarity :
113+
114+
<Card
115+
title="Setup AI Providers for Xyne"
116+
icon="key"
117+
href="/apikeys/apikeys"
118+
>
119+
Setup your AI Provider.
120+
</Card>
121+
122+
<Warning> Chat will be unavailable without a Service Account or OAuth Account connection. </Warning>
123+
84124
## Deploy Xyne with Docker :
85125

86126
Run the following command to run the application :

docs/images/slashd.png

454 Bytes
Loading

docs/mint.json

+24-24
Original file line numberDiff line numberDiff line change
@@ -49,45 +49,45 @@
4949
"group": "Get Started",
5050
"pages": ["introduction", "quickstart"]
5151
},
52-
{
53-
"group": "AI Providers",
54-
"pages": ["apikeys/apikeys"]
55-
},
56-
{
57-
"group": "Deployment",
58-
"pages": [
59-
{
60-
"group": "Cloud Deployment",
61-
"icon": "cloud",
62-
"pages": [
63-
{
64-
"group": "AWS",
65-
"icon": "aws",
66-
"pages": ["deployment/cloud/aws/aws-deployment-with-docker"]
67-
}
68-
]
69-
}
70-
]
71-
},
7252
{
7353
"group": "Authentication",
7454
"pages": ["authentication/get-credentials", "authentication/oauth", "authentication/service-accounts"]
7555
},
76-
{
77-
"group": "For Developers",
78-
"pages": ["contribution/contribute", "contribution/devmode"]
79-
},
8056
{
8157
"group": "Ingesting Data",
8258
"pages": ["ingestion/ingestion","ingestion/oauth-ingest", "ingestion/service-ingest"]
8359
},
60+
{
61+
"group": "AI Providers",
62+
"pages": ["apikeys/apikeys"]
63+
},
64+
{
65+
"group": "Deployment",
66+
"pages": [
67+
{
68+
"group": "Cloud Deployment",
69+
"icon": "cloud",
70+
"pages": [
71+
{
72+
"group": "AWS",
73+
"icon": "aws",
74+
"pages": ["deployment/cloud/aws/aws-deployment-with-docker"]
75+
}
76+
]
77+
}
78+
]
79+
},
8480
{
8581
"group": "Re-Ingesting Data",
8682
"pages": ["re-ingest/reingest"]
8783
},
8884
{
8985
"group": "Changelog",
9086
"pages": ["changelog/overview"]
87+
},
88+
{
89+
"group": "For Developers",
90+
"pages": ["contribution/contribute", "contribution/devmode"]
9191
}
9292
],
9393
"redirects": [

docs/quickstart.mdx

+26-6
Original file line numberDiff line numberDiff line change
@@ -76,26 +76,46 @@ In the ```.env.default``` file, you can modify the following and replace the mis
7676
```javascript .env.default file
7777
ENCRYPTION_KEY=<YOUR_ENCRYPTION_KEY>
7878
SERVICE_ACCOUNT_ENCRYPTION_KEY=<YOUR_SERVICE_ACCOUNT_ENCRYPTION_KEY>
79-
# If you wish to execute authorization using Oauth then use :
79+
80+
8081
GOOGLE_CLIENT_ID=<YOUR_GOOGLE_CLIENT_ID>
8182
GOOGLE_CLIENT_SECRET=<YOUR_GOOGLE_CLIENT_SECRET>
8283
GOOGLE_REDIRECT_URI=http://localhost:3000/v1/auth/callback
8384
GOOGLE_PROD_REDIRECT_URI=http://localhost:3001/v1/auth/callback
85+
86+
8487
JWT_SECRET=<YOUR_JWT_SECRET>
88+
89+
8590
DATABASE_HOST=xyne-db
8691
VESPA_HOST=vespa
92+
93+
## If using AWS Bedrock
8794
AWS_ACCESS_KEY=<YOUR_AWS_ACCESS_KEY>
8895
AWS_SECRET_KEY=<YOUR_AWS_ACCESS_SECRET>
89-
## OR
96+
AWS_REGION=<YOUR_AWS_REGION>
97+
98+
## OR [ If using Open AI ]
9099
OPENAI_API_KEY=<YOUR_OPEN_API_KEY>
91-
## OR
100+
101+
## OR [ If using Ollama ]
92102
OLLAMA_MODEL=<YOUR_OLLAMA_MODEL_NAME>
103+
104+
## OR [ If using Together AI ]
105+
TOGETHER_API_KEY=<YOUR_TOGETHER_API_KEY>
106+
TOGETHER_MODEL=<YOUR_TOGETHER_MODEL>
107+
TOGETHER_FAST_MODEL=<YOUR_TOGETHER_FAST_MODEL>
108+
109+
## OR [ If using Fireworks AI ]
110+
FIREWORKS_API_KEY=<YOUR_FIREWORKS_API_KEY>
111+
FIREWORKS_MODEL=<YOUR_FIREWORKS_MODEL>
112+
FIREWORKS_FAST_MODEL=<YOUR_FIREWORKS_FAST_MODEL>
113+
114+
93115
HOST=http://localhost:3001
94-
## Set your desired AI provider
95-
AWS_REGION=<YOUR_AWS_REGION>
96116
```
97117

98-
<Tip>To use the chat feature of Xyne, you need any one AI provider (AWS, Ollama, or OpenAI). Missing keys will disable chat functionality.</Tip>
118+
<Tip>To use the chat feature of Xyne, you need any one AI provider (AWS, Ollama, OpenAI Together AI or Fireworks AI). Missing keys will disable chat functionality.</Tip>
99119

100120
You can checkout the AI Providers section for better clarity :
101121

0 commit comments

Comments
 (0)