Python request LM Studio Model failed but Curl successful

Question

I tried to request local model by using Python with below code,

import requests
import json

url = 'http://localhost:1234/v1/chat/completions'

headers = {
    'Content-Type': 'application/json'
}

data = {
    'model': 'deepseek-r1-distill-qwen-7b',
    'messages': [
        {'role': 'system', 'content': 'Always answer in rhymes. Today is Thursday'},
        {'role': 'user', 'content': 'What day is it today?'}
    ],
    'temperature': 0.7,
    'max_tokens': -1,
    'stream': False
}

response = requests.post(url, headers=headers, data=json.dumps(data))

if response.status_code == 200:
    print('Response:', response.json())
else:
    print('Error:', response.status_code, response.text)

and got 503 service unavailable error. But if I request it successfully via Curl,

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "deepseek-r1-distill-qwen-7b",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes. Today is Thursday" },
      { "role": "user", "content": "What day is it today?" }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": false
}'

why this happening and how could I fix it?

MJepbarov · Accepted Answer · 2025-02-21 06:26:59Z

0

The REQUESTS may be using a system proxy, curl and python.requests operate differently

session = requests.Session()
session.trust_env = False
response = session.post(...)

Also I'd recommend to try request it using tools like Postman or Insomnia, then check the request/response headers, probably LM server sets required headers, or try to set "Content-Length":

data_str = json.dumps(data)
headers["Content-Length"] = str(len(data_str))

You may also try to export the Python Requests code from Postman and check the difference.

answered Feb 21 at 6:26

MJepbarov

1271 gold badge2 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python request LM Studio Model failed but Curl successful

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related