JustSong
|
4a64fede39
|
feat: support max_tokens now (#52)
|
2023-05-16 16:18:35 +08:00 |
|
JustSong
|
146ab7d299
|
feat: able to set pre consumed quota now
|
2023-05-16 13:57:01 +08:00 |
|
JustSong
|
afbf20b5ba
|
fix: fix quota not consuming
|
2023-05-16 13:29:22 +08:00 |
|
JustSong
|
f43a810e8d
|
feat: automatically disable channel when error occurred (#59)
|
2023-05-15 17:34:09 +08:00 |
|
JustSong
|
4f1f170fb9
|
fix: remove version suffix for Azure (close #67)
|
2023-05-15 15:48:18 +08:00 |
|
JustSong
|
d0d3142edb
|
feat: able to test channels now (#59)
|
2023-05-15 10:48:52 +08:00 |
|
JustSong
|
511cbc117e
|
perf: use slice to improve efficiency (#57)
|
2023-05-14 12:53:03 +08:00 |
|
JustSong
|
05e460d9f8
|
fix: fix "[DONE is not valid JSON" (#57)
|
2023-05-14 12:48:42 +08:00 |
|
JustSong
|
1507dd0104
|
fix: fix Azure channel not working in stream mode (#57)
|
2023-05-14 09:39:42 +08:00 |
|
JustSong
|
9ed9eaa65f
|
feat: support specific default api version now (#57)
|
2023-05-13 12:53:57 +08:00 |
|
JustSong
|
b4bfc95297
|
fix: remove the dot in model name (#57)
|
2023-05-13 12:24:49 +08:00 |
|
JustSong
|
479ccebedb
|
fix: provide a default value for api-version if not given (#57)
|
2023-05-13 11:41:57 +08:00 |
|
JustSong
|
d97d50b14c
|
feat: Azure API supported without verification (#48, #57)
|
2023-05-13 11:36:36 +08:00 |
|
JustSong
|
049a6def02
|
feat: able to configure ratio for more models now (close #53)
|
2023-05-11 20:59:35 +08:00 |
|
JustSong
|
7bd4c0e490
|
fix: return quota to user when delete token (close #37)
|
2023-05-04 10:20:39 +08:00 |
|
JustSong
|
36605cf095
|
fix: shouldn't close c.Request.Body too soon (close #35)
|
2023-04-29 14:49:10 +08:00 |
|
JustSong
|
033e832cae
|
feat: able to configure ratio for different models (close #26)
|
2023-04-28 19:16:37 +08:00 |
|
JustSong
|
84c7ae8ad1
|
refactor: use tiktoken-go to calculate token number
|
2023-04-28 18:36:17 +08:00 |
|
JustSong
|
52877f99e8
|
fix: relay bug fix
|
2023-04-28 18:16:59 +08:00 |
|
JustSong
|
0760dcf6cc
|
feat: support configuring ratio when estimating token number in stream mode
|
2023-04-28 17:25:05 +08:00 |
|
JustSong
|
52e92554ac
|
refactor: improve relay's implementation
|
2023-04-28 17:11:57 +08:00 |
|
JustSong
|
bcdfb7d0d9
|
feat: now use token as the unit of quota (close #33)
|
2023-04-28 16:58:55 +08:00 |
|
JustSong
|
aa18ac4864
|
refactor: use quota instead of times
|
2023-04-28 14:57:20 +08:00 |
|
JustSong
|
b612efe349
|
fix: only reduce remain times when request /v1/chat/completions (close #15)
BREAKING CHANGE: now remain_times is -1 doesn't mean unlimited times anymore!
|
2023-04-26 10:45:34 +08:00 |
|
JustSong
|
541b9f2ed6
|
fix: fully support stream mode now (close #3)
|
2023-04-25 21:50:57 +08:00 |
|
JustSong
|
2ed58bb0c0
|
fix: improve the implementation of sse
|
2023-04-25 20:45:50 +08:00 |
|
JustSong
|
796cb86b58
|
fix: fixing SSE support
|
2023-04-25 20:27:53 +08:00 |
|
JustSong
|
a8eacd331b
|
fix: relay more headers
|
2023-04-25 11:30:34 +08:00 |
|
JustSong
|
7c0124451d
|
fix: only keep header Authorization & Content-Type
|
2023-04-25 10:47:25 +08:00 |
|
JustSong
|
9001415948
|
fix: fix http2: invalid Connection request header: ["upgrade"]
|
2023-04-25 10:19:00 +08:00 |
|
JustSong
|
32755d875a
|
Support custom channel now
|
2023-04-23 20:35:49 +08:00 |
|
JustSong
|
d00968d0cd
|
Fix "HTTP decompression failed"
|
2023-04-23 19:19:43 +08:00 |
|
JustSong
|
039301324f
|
Bug fix
|
2023-04-23 18:32:59 +08:00 |
|
JustSong
|
12aa6c352b
|
Relay done but not working
|
2023-04-23 18:24:11 +08:00 |
|