fam/nanochat-omni
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: allow top_k=0 in web api to disable filtering (#458)

Browse Source 
* allow top_k=0 in web api to disable filtering

* adding a comment for clear reasoning

* adding change to docstring
This commit is contained in:
Aarushi Singh
2026-01-30 22:51:41 +05:30
committed by GitHub
parent 2e17723817
commit ace6740bdd
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
scripts/chat_web.py
+2 -2
View File
@@ -26,7 +26,7 @@ Abuse Prevention:
- Maximum 8000 characters per message - Maximum 8000 characters per message
- Maximum 32000 characters total conversation length - Maximum 32000 characters total conversation length
- Temperature clamped to 0.0-2.0 - Temperature clamped to 0.0-2.0
- Top-k clamped to 1-200 - Top-k clamped to 0-200 (0 disables top-k filtering, using full vocabulary)
- Max tokens clamped to 1-4096 - Max tokens clamped to 1-4096
""" """
@@ -55,7 +55,7 @@ MAX_MESSAGE_LENGTH = 8000
MAX_TOTAL_CONVERSATION_LENGTH = 32000 MAX_TOTAL_CONVERSATION_LENGTH = 32000
MIN_TEMPERATURE = 0.0 MIN_TEMPERATURE = 0.0
MAX_TEMPERATURE = 2.0 MAX_TEMPERATURE = 2.0
MIN_TOP_K = 1 MIN_TOP_K = 0 # 0 disables top-k filtering, using full vocabulary
MAX_TOP_K = 200 MAX_TOP_K = 200
MIN_MAX_TOKENS = 1 MIN_MAX_TOKENS = 1
MAX_MAX_TOKENS = 4096 MAX_MAX_TOKENS = 4096