Instructions to use Veol-CZ/czech-semantic-embeddings-c with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Veol-CZ/czech-semantic-embeddings-c with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Veol-CZ/czech-semantic-embeddings-c:F16 # Run inference directly in the terminal: llama cli -hf Veol-CZ/czech-semantic-embeddings-c:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Veol-CZ/czech-semantic-embeddings-c:F16 # Run inference directly in the terminal: llama cli -hf Veol-CZ/czech-semantic-embeddings-c:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Veol-CZ/czech-semantic-embeddings-c:F16 # Run inference directly in the terminal: ./llama-cli -hf Veol-CZ/czech-semantic-embeddings-c:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Veol-CZ/czech-semantic-embeddings-c:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf Veol-CZ/czech-semantic-embeddings-c:F16
Use Docker
docker model run hf.co/Veol-CZ/czech-semantic-embeddings-c:F16
- LM Studio
- Jan
- Ollama
How to use Veol-CZ/czech-semantic-embeddings-c with Ollama:
ollama run hf.co/Veol-CZ/czech-semantic-embeddings-c:F16
- Unsloth Desktop
- Docker Model Runner
How to use Veol-CZ/czech-semantic-embeddings-c with Docker Model Runner:
docker model run hf.co/Veol-CZ/czech-semantic-embeddings-c:F16
- Lemonade
How to use Veol-CZ/czech-semantic-embeddings-c with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Veol-CZ/czech-semantic-embeddings-c:F16
Run and chat with the model
lemonade run user.czech-semantic-embeddings-c-F16
List all available models
lemonade list
- Atomic Chat
Upload 10 files
Browse files- .gitattributes +8 -0
- README.md +77 -3
- Seznam__dist-mpnet-paracrawl-cs-en.f16.gguf +3 -0
- Seznam__dist-mpnet-paracrawl-cs-en.q8_0.gguf +3 -0
- Seznam__retromae-small-cs.f16.gguf +3 -0
- Seznam__retromae-small-cs.q8_0.gguf +3 -0
- Seznam__simcse-dist-mpnet-paracrawl-cs-en.f16.gguf +3 -0
- Seznam__simcse-dist-mpnet-paracrawl-cs-en.q8_0.gguf +3 -0
- Seznam__simcse-retromae-small-cs.f16.gguf +3 -0
- Seznam__simcse-retromae-small-cs.q8_0.gguf +3 -0
- checksums.txt +8 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
Seznam__dist-mpnet-paracrawl-cs-en.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
Seznam__dist-mpnet-paracrawl-cs-en.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
Seznam__retromae-small-cs.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
Seznam__retromae-small-cs.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
Seznam__simcse-dist-mpnet-paracrawl-cs-en.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
Seznam__simcse-dist-mpnet-paracrawl-cs-en.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
Seznam__simcse-retromae-small-cs.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
Seznam__simcse-retromae-small-cs.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -1,3 +1,77 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: cc-by-4.0
|
| 3 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc-by-4.0
|
| 3 |
+
pipeline_tag: sentence-similarity
|
| 4 |
+
---
|
| 5 |
+
|
| 6 |
+
# Czech Semantic Embeddings (GGUF)
|
| 7 |
+
|
| 8 |
+
GGUF conversions of Czech semantic embedding models from Seznam, prepared for llama.cpp embedding inference.
|
| 9 |
+
|
| 10 |
+
## Included Models
|
| 11 |
+
|
| 12 |
+
- `Seznam__retromae-small-cs.f16.gguf`
|
| 13 |
+
- `Seznam__retromae-small-cs.q8_0.gguf`
|
| 14 |
+
- `Seznam__dist-mpnet-paracrawl-cs-en.f16.gguf`
|
| 15 |
+
- `Seznam__dist-mpnet-paracrawl-cs-en.q8_0.gguf`
|
| 16 |
+
- `Seznam__simcse-retromae-small-cs.f16.gguf`
|
| 17 |
+
- `Seznam__simcse-retromae-small-cs.q8_0.gguf`
|
| 18 |
+
- `Seznam__simcse-dist-mpnet-paracrawl-cs-en.f16.gguf`
|
| 19 |
+
- `Seznam__simcse-dist-mpnet-paracrawl-cs-en.q8_0.gguf`
|
| 20 |
+
|
| 21 |
+
## Upstream Sources
|
| 22 |
+
|
| 23 |
+
- https://github.com/seznam/czech-semantic-embedding-models
|
| 24 |
+
- https://huggingface.co/Seznam/retromae-small-cs
|
| 25 |
+
- https://huggingface.co/Seznam/dist-mpnet-paracrawl-cs-en
|
| 26 |
+
- https://huggingface.co/Seznam/simcse-retromae-small-cs
|
| 27 |
+
- https://huggingface.co/Seznam/simcse-dist-mpnet-paracrawl-cs-en
|
| 28 |
+
|
| 29 |
+
## Citation
|
| 30 |
+
|
| 31 |
+
If you use these models, please cite the original Seznam paper:
|
| 32 |
+
|
| 33 |
+
- Bednar et al., 2024, *Some Like It Small: Czech Semantic Embedding Models for Industry Applications*
|
| 34 |
+
- https://arxiv.org/abs/2311.13921
|
| 35 |
+
|
| 36 |
+
```bibtex
|
| 37 |
+
@inproceedings{bednavr2024some,
|
| 38 |
+
title={Some Like It Small: Czech Semantic Embedding Models for Industry Applications},
|
| 39 |
+
author={Bedn{\'a}{\v{r}}, Ji{\v{r}}{\'\i} and N{\'a}plava, Jakub and Baran{\v{c}}{\'\i}kov{\'a}, Petra and Lisick{\`y}, Ond{\v{r}}ej},
|
| 40 |
+
booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
|
| 41 |
+
volume={38},
|
| 42 |
+
number={21},
|
| 43 |
+
pages={22734--22742},
|
| 44 |
+
year={2024}
|
| 45 |
+
}
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
## Usage (llama.cpp)
|
| 49 |
+
|
| 50 |
+
Run embedding server:
|
| 51 |
+
|
| 52 |
+
```bash
|
| 53 |
+
llama-server -m Seznam__retromae-small-cs.q8_0.gguf --embedding --pooling cls
|
| 54 |
+
```
|
| 55 |
+
|
| 56 |
+
OpenAI-compatible embeddings endpoint:
|
| 57 |
+
|
| 58 |
+
```bash
|
| 59 |
+
curl http://127.0.0.1:8080/v1/embeddings \
|
| 60 |
+
-H "Content-Type: application/json" \
|
| 61 |
+
-d '{"input":["Ahoj svete","Semantic search test"]}'
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
+
## File Integrity
|
| 65 |
+
|
| 66 |
+
SHA256 checksums are in `checksums.txt`.
|
| 67 |
+
|
| 68 |
+
## License
|
| 69 |
+
|
| 70 |
+
This repo contains converted checkpoints from upstream models. Respect original model licenses and terms:
|
| 71 |
+
|
| 72 |
+
- `retromae-small-cs`: CC-BY-4.0
|
| 73 |
+
- `dist-mpnet-paracrawl-cs-en`: CC-BY-4.0
|
| 74 |
+
- `simcse-retromae-small-cs`: CC-BY-4.0
|
| 75 |
+
- `simcse-dist-mpnet-paracrawl-cs-en`: CC-BY-4.0
|
| 76 |
+
|
| 77 |
+
Attribution to Seznam and original model cards is required.
|
Seznam__dist-mpnet-paracrawl-cs-en.f16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:13f49d79ddbaa47bd0d8f246bbcf2f6f8d3f3f735c4d2d10444b21ae02356c42
|
| 3 |
+
size 50070496
|
Seznam__dist-mpnet-paracrawl-cs-en.q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1eb73d97eb89885ba798af24503d2118ade68e29b5afbf091d1dbec50b522331
|
| 3 |
+
size 27488896
|
Seznam__retromae-small-cs.f16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ae5a6bc5f2ef884f581aedeb0d22d282febea0d0a2e4cc31b0f096ba7a3b4a87
|
| 3 |
+
size 50070560
|
Seznam__retromae-small-cs.q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dbd1622d15524062b92923996fdff7506728144c68add699cc2ed947f4af619f
|
| 3 |
+
size 27488960
|
Seznam__simcse-dist-mpnet-paracrawl-cs-en.f16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:644f994e698b709c217584024959f7ec72e1e24e302dd1fb42090f5454cd5298
|
| 3 |
+
size 50070496
|
Seznam__simcse-dist-mpnet-paracrawl-cs-en.q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:79de6b9a6d76c97acf745cc002f306bbc00e620a9530466c6b89e6094dc70272
|
| 3 |
+
size 27488896
|
Seznam__simcse-retromae-small-cs.f16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:33e59a02e52e52f73e7c0288c9cbc4bd8bd628848034c7f1ab75d386025a6075
|
| 3 |
+
size 50070592
|
Seznam__simcse-retromae-small-cs.q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:787e869ece032624873b89a49e3c1a036ca05eeadc34d55e1a88cd2cb9c51985
|
| 3 |
+
size 27488992
|
checksums.txt
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
13f49d79ddbaa47bd0d8f246bbcf2f6f8d3f3f735c4d2d10444b21ae02356c42 Seznam__dist-mpnet-paracrawl-cs-en.f16.gguf
|
| 2 |
+
1eb73d97eb89885ba798af24503d2118ade68e29b5afbf091d1dbec50b522331 Seznam__dist-mpnet-paracrawl-cs-en.q8_0.gguf
|
| 3 |
+
ae5a6bc5f2ef884f581aedeb0d22d282febea0d0a2e4cc31b0f096ba7a3b4a87 Seznam__retromae-small-cs.f16.gguf
|
| 4 |
+
dbd1622d15524062b92923996fdff7506728144c68add699cc2ed947f4af619f Seznam__retromae-small-cs.q8_0.gguf
|
| 5 |
+
644f994e698b709c217584024959f7ec72e1e24e302dd1fb42090f5454cd5298 Seznam__simcse-dist-mpnet-paracrawl-cs-en.f16.gguf
|
| 6 |
+
79de6b9a6d76c97acf745cc002f306bbc00e620a9530466c6b89e6094dc70272 Seznam__simcse-dist-mpnet-paracrawl-cs-en.q8_0.gguf
|
| 7 |
+
33e59a02e52e52f73e7c0288c9cbc4bd8bd628848034c7f1ab75d386025a6075 Seznam__simcse-retromae-small-cs.f16.gguf
|
| 8 |
+
787e869ece032624873b89a49e3c1a036ca05eeadc34d55e1a88cd2cb9c51985 Seznam__simcse-retromae-small-cs.q8_0.gguf
|