JustSong
05de29c830
feat: support channel ai.ls now ( close #99 )
2023-05-19 11:07:17 +08:00
quzard
d15ca33175
fix: make the token number calculation more accurate ( #101 )
...
* Make token calculation more accurate.
* fix: make the token number calculation more accurate
---------
Co-authored-by: JustSong <songquanpeng@foxmail.com >
2023-05-19 09:41:26 +08:00
JustSong
9c5bc5120b
fix: add X-Accel-Buffering header on SSE response
2023-05-18 17:16:34 +08:00
JustSong
868a6ced8c
chore: rewrite 429 prompt text ( close #96 )
2023-05-18 15:27:15 +08:00
JustSong
14662c3fde
fix: fix channel test error checking
2023-05-18 11:41:03 +08:00
JustSong
8cd4e3faa4
fix: handel error response from server correctly ( close #90 )
2023-05-18 11:11:15 +08:00
JustSong
14bba55d28
fix: fix error log not recorded ( close #83 )
2023-05-17 20:20:48 +08:00
JustSong
f122a8c53d
fix: fix stream mode checking ( #83 )
2023-05-17 20:10:09 +08:00
JustSong
a0923067dc
feat: API /models & /models/:model implemented ( close #68 )
2023-05-17 10:42:52 +08:00
JustSong
e07eb017f7
fix: limit the shown text's length ( close #80 )
2023-05-16 21:33:59 +08:00
JustSong
b77eb0c65d
perf: use max_tokens to reduce token consuming
2023-05-16 16:22:25 +08:00
JustSong
4a64fede39
feat: support max_tokens now ( #52 )
2023-05-16 16:18:35 +08:00
JustSong
146ab7d299
feat: able to set pre consumed quota now
2023-05-16 13:57:01 +08:00
JustSong
afbf20b5ba
fix: fix quota not consuming
2023-05-16 13:29:22 +08:00
JustSong
49e23ee6d6
fix: fix token quota not updated
2023-05-16 12:09:17 +08:00
JustSong
bcb4862a19
refactor: bind quota to account instead of token ( close #64 , #31 )
2023-05-16 11:26:09 +08:00
JustSong
f43a810e8d
feat: automatically disable channel when error occurred ( #59 )
2023-05-15 17:34:09 +08:00
JustSong
f46f41514c
fix: fix lock is not working
2023-05-15 16:19:39 +08:00
JustSong
4f1f170fb9
fix: remove version suffix for Azure ( close #67 )
2023-05-15 15:48:18 +08:00
JustSong
93b00d62a6
feat: able to test all enabled channels ( #59 )
2023-05-15 12:36:55 +08:00
JustSong
210952bd1e
feat: save response time & test time ( #59 )
2023-05-15 11:35:38 +08:00
JustSong
d0d3142edb
feat: able to test channels now ( #59 )
2023-05-15 10:48:52 +08:00
JustSong
6eb288260d
feat: able to customize system name & logo now
2023-05-14 19:29:02 +08:00
JustSong
511cbc117e
perf: use slice to improve efficiency ( #57 )
2023-05-14 12:53:03 +08:00
JustSong
05e460d9f8
fix: fix "[DONE is not valid JSON" ( #57 )
2023-05-14 12:48:42 +08:00
JustSong
1507dd0104
fix: fix Azure channel not working in stream mode ( #57 )
2023-05-14 09:39:42 +08:00
JustSong
80176fdfe8
feat: able to customize home page now ( #24 )
2023-05-13 21:27:49 +08:00
JustSong
bc87b023f5
feat: support batch creation of channels ( close #58 )
2023-05-13 17:08:13 +08:00
JustSong
9ed9eaa65f
feat: support specific default api version now ( #57 )
2023-05-13 12:53:57 +08:00
JustSong
b4bfc95297
fix: remove the dot in model name ( #57 )
2023-05-13 12:24:49 +08:00
JustSong
479ccebedb
fix: provide a default value for api-version if not given ( #57 )
2023-05-13 11:41:57 +08:00
JustSong
d97d50b14c
feat: Azure API supported without verification ( #48 , #57 )
2023-05-13 11:36:36 +08:00
JustSong
8f64927af2
fix: the initial quota for new token now calculated correctly ( #51 )
2023-05-11 21:29:05 +08:00
JustSong
049a6def02
feat: able to configure ratio for more models now ( close #53 )
2023-05-11 20:59:35 +08:00
JustSong
ac2a56f9cd
feat: support API /dashboard/billing/credit_grants now ( #45 )
2023-05-10 09:28:41 +08:00
JustSong
7bd4c0e490
fix: return quota to user when delete token ( close #37 )
2023-05-04 10:20:39 +08:00
JustSong
36605cf095
fix: shouldn't close c.Request.Body too soon ( close #35 )
2023-04-29 14:49:10 +08:00
JustSong
033e832cae
feat: able to configure ratio for different models ( close #26 )
2023-04-28 19:16:37 +08:00
JustSong
84c7ae8ad1
refactor: use tiktoken-go to calculate token number
2023-04-28 18:36:17 +08:00
JustSong
52877f99e8
fix: relay bug fix
2023-04-28 18:16:59 +08:00
JustSong
0760dcf6cc
feat: support configuring ratio when estimating token number in stream mode
2023-04-28 17:25:05 +08:00
JustSong
52e92554ac
refactor: improve relay's implementation
2023-04-28 17:11:57 +08:00
JustSong
bcdfb7d0d9
feat: now use token as the unit of quota ( close #33 )
2023-04-28 16:58:55 +08:00
JustSong
aa18ac4864
refactor: use quota instead of times
2023-04-28 14:57:20 +08:00
JustSong
567ff7359c
fix: check user's role when manage user ( #30 )
2023-04-28 09:47:03 +08:00
JustSong
79dc851aa1
feat: able to set top up link now
2023-04-27 16:32:21 +08:00
JustSong
9667bc86bc
fix: root user cannot demote itself now ( close #30 )
2023-04-27 14:45:12 +08:00
JustSong
9c529f9674
feat: able to set initial quota for new user ( close #22 )
2023-04-26 21:40:56 +08:00
JustSong
5a9fb6238b
feat: able to manage system vai access token ( close #12 )
2023-04-26 20:54:39 +08:00
JustSong
be2b3f3fc6
feat: now user can top up via redemption code ( close #9 )
2023-04-26 17:02:26 +08:00