AI/Microsoft-fara
1
0
Fork 0
mirror of https://github.com/microsoft/fara.git synced 2026-06-10 02:54:01 +08:00
Code Issues Packages Projects Releases Wiki Activity

Update README with Windows and memory usage notes (#30)

Browse Source
This commit is contained in:
Hussein Mozannar
2025-11-28 13:35:43 -05:00
committed by GitHub
parent ca1d3868f4 b555f0874b
commit 21469308d6
1 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@@ -40,7 +40,9 @@ Then you can iterative query it with:
fara-cli --task "whats the weather in new york now"
```
Hint: might need to do `--tensor-parallel-size 2` with vllm command if you run out of memory
Notes:
- If you're using Windows, we highly recommend using WSL2 (Windows Subsystem for Linux).
- You might need to do `--tensor-parallel-size 2` with vllm command if you run out of memory
### What Makes Fara-7B Unique