Support or Ignore reasoning field in response
Post here questions and problems related to bundled or custom AI actions, connectors and in general configuring and working with the AI Positron Assistant add-ons.
-
yokota
- Posts: 14
- Joined: Wed Mar 13, 2024 4:22 am
Support or Ignore reasoning field in response
Hi, support.
I use AI Positron Enterprise with Local LLM.
I had updated the local LLM Ollama recently,
since then, AI Positron fails to catch response and says "Invalid sse format."
It seems to occur by "reasoning" and "reasoning_content" fields in responsed JSON.
Now, I set proxy-server to remove these fields and work with AI Positron.
I hope AI Positron natively supports or ignores these fields.
Regards,
I use AI Positron Enterprise with Local LLM.
I had updated the local LLM Ollama recently,
since then, AI Positron fails to catch response and says "Invalid sse format."
It seems to occur by "reasoning" and "reasoning_content" fields in responsed JSON.
Now, I set proxy-server to remove these fields and work with AI Positron.
I hope AI Positron natively supports or ignores these fields.
Regards,
Tatsuro YOKOTA
Antenna House, Inc.
http://www.antenna.co.jp/
http://www.antennahouse.com/
Antenna House, Inc.
http://www.antenna.co.jp/
http://www.antennahouse.com/
-
Cosmin Duna
- Site Admin
- Posts: 130
- Joined: Wed Dec 12, 2018 5:33 pm
Re: Support or Ignore reasoning field in response
Post by Cosmin Duna »
Hi,
Thank you for the detailed report.
You're right that the current OpenAI connector (based on chat/completions) does attempt to process reasoning fields, but its handling of them isn't ideal, which is what you're running into with the "Invalid SSE format" error after the Ollama update.
The good news: in the next version of AI Positron, which we're planning to release in the coming few weeks, we're adding support for the Responses API. Once that's available, you'll be able to connect to Ollama through the Responses API endpoint, which should handle reasoning fields (including `reasoning` and `reasoning_content`) properly .
We'll update this thread when the new version is out!
Best regards,
Cosmin
Thank you for the detailed report.
You're right that the current OpenAI connector (based on chat/completions) does attempt to process reasoning fields, but its handling of them isn't ideal, which is what you're running into with the "Invalid SSE format" error after the Ollama update.
The good news: in the next version of AI Positron, which we're planning to release in the coming few weeks, we're adding support for the Responses API. Once that's available, you'll be able to connect to Ollama through the Responses API endpoint, which should handle reasoning fields (including `reasoning` and `reasoning_content`) properly .
We'll update this thread when the new version is out!
Best regards,
Cosmin
Cosmin Duna
<oXygen/> XML Editor
http://www.oxygenxml.com
<oXygen/> XML Editor
http://www.oxygenxml.com
-
yokota
- Posts: 14
- Joined: Wed Mar 13, 2024 4:22 am
Re: Support or Ignore reasoning field in response
> The good news: in the next version of AI Positron, which we're planning to release in the coming few weeks, we're adding support for the Responses API.
That makes me happy. I'll wait for the release.
Thank you!
That makes me happy. I'll wait for the release.
Thank you!
Tatsuro YOKOTA
Antenna House, Inc.
http://www.antenna.co.jp/
http://www.antennahouse.com/
Antenna House, Inc.
http://www.antenna.co.jp/
http://www.antennahouse.com/
-
Cosmin Duna
- Site Admin
- Posts: 130
- Joined: Wed Dec 12, 2018 5:33 pm
Re: Support or Ignore reasoning field in response
Post by Cosmin Duna »
Hi
I wanted to inform you that Oxygen AI Positron 8.3 has been released and it includes the new OpenAI Response connector type: https://www.oxygenxml.com/doc/ug-positr ... 3c_djv_2hc
Best regards,
Cosmin
I wanted to inform you that Oxygen AI Positron 8.3 has been released and it includes the new OpenAI Response connector type: https://www.oxygenxml.com/doc/ug-positr ... 3c_djv_2hc
Best regards,
Cosmin
Cosmin Duna
<oXygen/> XML Editor
http://www.oxygenxml.com
<oXygen/> XML Editor
http://www.oxygenxml.com
-
yokota
- Posts: 14
- Joined: Wed Mar 13, 2024 4:22 am
Re: Support or Ignore reasoning field in response
Hi,
I updated my AI Positron and set reasoning "none" works now. Thanks!
Still it seems to cause error with the parameters expecting reasoning field; "high", "medium", "auto"...
Is it my settings wrong or the model specific happening?
Oxygen XML Editor is 28.1 latest at Windows11.
AI Positron version is 8.3.0.
Ollama version is 0.31.1.
A model is gemma4:31b-it-qat.
Best regards,
I updated my AI Positron and set reasoning "none" works now. Thanks!
Still it seems to cause error with the parameters expecting reasoning field; "high", "medium", "auto"...
Is it my settings wrong or the model specific happening?
Oxygen XML Editor is 28.1 latest at Windows11.
AI Positron version is 8.3.0.
Ollama version is 0.31.1.
A model is gemma4:31b-it-qat.
Best regards,
Tatsuro YOKOTA
Antenna House, Inc.
http://www.antenna.co.jp/
http://www.antennahouse.com/
Antenna House, Inc.
http://www.antenna.co.jp/
http://www.antennahouse.com/
-
Radu
- Posts: 9683
- Joined: Fri Jul 09, 2004 5:18 pm
Re: Support or Ignore reasoning field in response
Hello Tatsuro,
Can ypu find the time to enable logging in AI Positron, generate a log file while reproducing the error with the thinking params, then zip and email it to us (support@oxygenxml.com)?
https://www.oxygenxml.com/doc/ug-positr ... oting.html
Regards,
Radu
Can ypu find the time to enable logging in AI Positron, generate a log file while reproducing the error with the thinking params, then zip and email it to us (support@oxygenxml.com)?
https://www.oxygenxml.com/doc/ug-positr ... oting.html
Regards,
Radu
Radu Coravu
<oXygen/> XML Editor
http://www.oxygenxml.com
<oXygen/> XML Editor
http://www.oxygenxml.com
-
yokota
- Posts: 14
- Joined: Wed Mar 13, 2024 4:22 am
Re: Support or Ignore reasoning field in response
> Can ypu find the time to enable logging in AI Positron, generate a log file while reproducing the error with the thinking params, then zip and email it to us
The cause might be found at setting to reproduce the problem.
I had used the old settings that labeled now as "OpenAI Chat Completions". In the setting, reasoning other than "none", causes the error.
New setting with OpenAI Responses works fine without the error.
Thanks for great supports.
The cause might be found at setting to reproduce the problem.
I had used the old settings that labeled now as "OpenAI Chat Completions". In the setting, reasoning other than "none", causes the error.
New setting with OpenAI Responses works fine without the error.
Thanks for great supports.
Tatsuro YOKOTA
Antenna House, Inc.
http://www.antenna.co.jp/
http://www.antennahouse.com/
Antenna House, Inc.
http://www.antenna.co.jp/
http://www.antennahouse.com/
Return to “Artificial Intelligence (AI Positron Assistant add-on)”
Jump to
- Oxygen XML Editor/Author/Developer
- ↳ Feature Request
- ↳ Common Problems
- ↳ DITA (Editing and Publishing DITA Content)
- ↳ Artificial Intelligence (AI Positron Assistant add-on)
- ↳ SDK-API, Frameworks - Document Types
- ↳ DocBook
- ↳ TEI
- ↳ XHTML
- ↳ Other Issues
- Oxygen XML Web Author
- ↳ Feature Request
- ↳ Common Problems
- Oxygen Content Fusion
- ↳ Feature Request
- ↳ Common Problems
- Oxygen JSON Editor
- ↳ Feature Request
- ↳ Common Problems
- Oxygen PDF Chemistry
- ↳ Feature Request
- ↳ Common Problems
- Oxygen Feedback
- ↳ Feature Request
- ↳ Common Problems
- Oxygen XML WebHelp
- ↳ Feature Request
- ↳ Common Problems
- XML
- ↳ General XML Questions
- ↳ XSLT and FOP
- ↳ XML Schemas
- ↳ XQuery
- NVDL
- ↳ General NVDL Issues
- ↳ oNVDL Related Issues
- XML Services Market
- ↳ Offer a Service