Welcome to the optillm wiki! You will find more details here, including running examples, code samples and other documentation.

• Build your own plugin
• Using the privacy plugin

• MCTS

• Patchwork

When installing on Jetson you may need to build some dependencies from sources as wheels for them may not be available on PYPI. Installing the following dependencies separately before running pip install -r requirements.txt is known to work on a NVIDIA Jetson Orin 64B development kit.

pip install 'z3-solver<4.12'
pip install spacy --no-binary blis