Instructions to use numind/NuExtract with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use numind/NuExtract with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="numind/NuExtract", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("numind/NuExtract", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("numind/NuExtract", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use numind/NuExtract with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "numind/NuExtract"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "numind/NuExtract",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/numind/NuExtract

SGLang

How to use numind/NuExtract with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "numind/NuExtract" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "numind/NuExtract",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "numind/NuExtract" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "numind/NuExtract",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use numind/NuExtract with Docker Model Runner:
```
docker model run hf.co/numind/NuExtract
```

NuExtract

Commit History

Update README.md

cc8190e
verified

SorenDreano commited on 3 days ago

add metadata for new version (#12)

1b6c9d9
verified

liamcripwell

davanstrien HF Staff commited on Oct 17, 2024

Update README.md

669cf37
verified

liamcripwell commited on Oct 14, 2024

Add base_model metadata (#11)

b270761
verified

liamcripwell

davanstrien HF Staff commited on Aug 22, 2024

Update README.md

f9b15f3
verified

liamcripwell commited on Jun 26, 2024

Update README.md

590025b
verified

liamcripwell commited on Jun 26, 2024

Update README.md

452f304
verified

Alexandre-Numind commited on Jun 24, 2024

Update README.md

34d374e
verified

Alexandre-Numind commited on Jun 24, 2024

Upload result.png

5cfd71c
verified

Alexandre-Numind commited on Jun 24, 2024

Delete result.png

0d923bf
verified

Alexandre-Numind commited on Jun 24, 2024

Update README.md

53bb8c5
verified

Alexandre-Numind commited on Jun 24, 2024

Update README.md

0bf8048
verified

Alexandre-Numind commited on Jun 24, 2024

Update generation_config.json

09be9ca
verified

Alexandre-Numind commited on Jun 24, 2024

Update README.md

d25c898
verified

Alexandre-Numind commited on Jun 24, 2024

Upload 2 files

e3f5235
verified

Alexandre-Numind commited on Jun 24, 2024

Delete result_ft.png

a8be0fa
verified

Alexandre-Numind commited on Jun 24, 2024

Delete result.png

c06ad8b
verified

Alexandre-Numind commited on Jun 24, 2024

Upload 2 files

353addb
verified

Alexandre-Numind commited on Jun 24, 2024

Delete result.png

ed20a2e
verified

Alexandre-Numind commited on Jun 24, 2024

Delete result_ft.png

79e5612
verified

Alexandre-Numind commited on Jun 24, 2024

Upload result_ft.png

dd7c08a
verified

Alexandre-Numind commited on Jun 21, 2024

Delete result_ft.png

a358d0a
verified

Alexandre-Numind commited on Jun 21, 2024

Update README.md

409b58c
verified

Alexandre-Numind commited on Jun 21, 2024

Upload result_ft.png

eb15bfb
verified

Alexandre-Numind commited on Jun 21, 2024

Update README.md

6904da6
verified

Alexandre-Numind commited on Jun 21, 2024

Upload result.png

cdd8a2a
verified

Alexandre-Numind commited on Jun 21, 2024

Update README.md

4819954
verified

Alexandre-Numind commited on Jun 21, 2024

Update generation_config.json

aa73f7f
verified

Alexandre-Numind commited on Jun 20, 2024

Update tokenizer_config.json

7c67b1e
verified

Alexandre-Numind commited on Jun 20, 2024

Update README.md

acf7388
verified

Alexandre-Numind commited on Jun 20, 2024

Create README.md

fac7b94
verified

Alexandre-Numind commited on Jun 20, 2024

Upload 5 files

01c3b83
verified

Alexandre-Numind commited on May 31, 2024

Upload 7 files

a70f0fd
verified

Alexandre-Numind commited on May 31, 2024

initial commit

0c8062d
verified

Alexandre-Numind commited on May 31, 2024

Commit History

Update README.md cc8190e verified

add metadata for new version (#12) 1b6c9d9 verified

Update README.md 669cf37 verified

Add base_model metadata (#11) b270761 verified

Update README.md f9b15f3 verified

Update README.md 590025b verified

Update README.md 452f304 verified

Update README.md 34d374e verified

Upload result.png 5cfd71c verified

Delete result.png 0d923bf verified

Update README.md 53bb8c5 verified

Update README.md 0bf8048 verified

Update generation_config.json 09be9ca verified

Update README.md d25c898 verified

Upload 2 files e3f5235 verified

Delete result_ft.png a8be0fa verified

Delete result.png c06ad8b verified

Upload 2 files 353addb verified

Delete result.png ed20a2e verified

Delete result_ft.png 79e5612 verified

Upload result_ft.png dd7c08a verified

Delete result_ft.png a358d0a verified

Update README.md 409b58c verified

Upload result_ft.png eb15bfb verified

Update README.md 6904da6 verified

Upload result.png cdd8a2a verified

Update README.md 4819954 verified

Update generation_config.json aa73f7f verified

Update tokenizer_config.json 7c67b1e verified

Update README.md acf7388 verified

Create README.md fac7b94 verified

Upload 5 files 01c3b83 verified

Upload 7 files a70f0fd verified

initial commit 0c8062d verified

Update README.md

cc8190e
verified

add metadata for new version (#12)

1b6c9d9
verified

Update README.md

669cf37
verified

Add base_model metadata (#11)

b270761
verified

Update README.md

f9b15f3
verified

Update README.md

590025b
verified

Update README.md

452f304
verified

Update README.md

34d374e
verified

Upload result.png

5cfd71c
verified

Delete result.png

0d923bf
verified

Update README.md

53bb8c5
verified

Update README.md

0bf8048
verified

Update generation_config.json

09be9ca
verified

Update README.md

d25c898
verified

Upload 2 files

e3f5235
verified

Delete result_ft.png

a8be0fa
verified

Delete result.png

c06ad8b
verified

Upload 2 files

353addb
verified

Delete result.png

ed20a2e
verified

Delete result_ft.png

79e5612
verified

Upload result_ft.png

dd7c08a
verified

Delete result_ft.png

a358d0a
verified

Update README.md

409b58c
verified

Upload result_ft.png

eb15bfb
verified

Update README.md

6904da6
verified

Upload result.png

cdd8a2a
verified

Update README.md

4819954
verified

Update generation_config.json

aa73f7f
verified

Update tokenizer_config.json

7c67b1e
verified

Update README.md

acf7388
verified

Create README.md

fac7b94
verified

Upload 5 files

01c3b83
verified

Upload 7 files

a70f0fd
verified

initial commit

0c8062d
verified