Commit Graph

1079 Commits

Author SHA1 Message Date
JustSong
7a141b3ba9 fix: fix wrong implementation for /v1/models (close #128) 2023-05-31 14:43:29 +08:00
JustSong
990d1f7c63 chore: make channel test related code separated 2023-05-23 10:01:09 +08:00
JustSong
c658ce0a6c chore: only check OpenAI channel & custom channel 2023-05-23 10:00:36 +08:00
JustSong
9fbba5a1b3 feat: return user's quota with billing api (close #92) 2023-05-22 17:10:31 +08:00
JustSong
f6ae3bcbb6 fix: disable channel with a whitelist 2023-05-21 20:58:00 +08:00
JustSong
e5a17e8ec7 fix: fix unable to update custom channel's balance 2023-05-21 20:10:06 +08:00
JustSong
128c84b338 feat: support channel remain quota query (close #79) 2023-05-21 16:09:54 +08:00
JustSong
0ba5ff9d42 feat: PaLM support is WIP (#105) 2023-05-21 14:26:59 +08:00
JustSong
577daf342d fix: use gpt-3.5's encoder if not found (close #110) 2023-05-21 11:11:19 +08:00
JustSong
05de29c830 feat: support channel ai.ls now (close #99) 2023-05-19 11:07:17 +08:00
quzard
d15ca33175 fix: make the token number calculation more accurate (#101)
* Make token calculation more accurate.

* fix: make the token number calculation more accurate

---------

Co-authored-by: JustSong <songquanpeng@foxmail.com>
2023-05-19 09:41:26 +08:00
JustSong
9c5bc5120b fix: add X-Accel-Buffering header on SSE response 2023-05-18 17:16:34 +08:00
JustSong
868a6ced8c chore: rewrite 429 prompt text (close #96) 2023-05-18 15:27:15 +08:00
JustSong
14662c3fde fix: fix channel test error checking 2023-05-18 11:41:03 +08:00
JustSong
8cd4e3faa4 fix: handel error response from server correctly (close #90) 2023-05-18 11:11:15 +08:00
JustSong
14bba55d28 fix: fix error log not recorded (close #83) 2023-05-17 20:20:48 +08:00
JustSong
f122a8c53d fix: fix stream mode checking (#83) 2023-05-17 20:10:09 +08:00
JustSong
a0923067dc feat: API /models & /models/:model implemented (close #68) 2023-05-17 10:42:52 +08:00
JustSong
e07eb017f7 fix: limit the shown text's length (close #80) 2023-05-16 21:33:59 +08:00
JustSong
b77eb0c65d perf: use max_tokens to reduce token consuming 2023-05-16 16:22:25 +08:00
JustSong
4a64fede39 feat: support max_tokens now (#52) 2023-05-16 16:18:35 +08:00
JustSong
146ab7d299 feat: able to set pre consumed quota now 2023-05-16 13:57:01 +08:00
JustSong
afbf20b5ba fix: fix quota not consuming 2023-05-16 13:29:22 +08:00
JustSong
49e23ee6d6 fix: fix token quota not updated 2023-05-16 12:09:17 +08:00
JustSong
bcb4862a19 refactor: bind quota to account instead of token (close #64, #31) 2023-05-16 11:26:09 +08:00
JustSong
f43a810e8d feat: automatically disable channel when error occurred (#59) 2023-05-15 17:34:09 +08:00
JustSong
f46f41514c fix: fix lock is not working 2023-05-15 16:19:39 +08:00
JustSong
4f1f170fb9 fix: remove version suffix for Azure (close #67) 2023-05-15 15:48:18 +08:00
JustSong
93b00d62a6 feat: able to test all enabled channels (#59) 2023-05-15 12:36:55 +08:00
JustSong
210952bd1e feat: save response time & test time (#59) 2023-05-15 11:35:38 +08:00
JustSong
d0d3142edb feat: able to test channels now (#59) 2023-05-15 10:48:52 +08:00
JustSong
6eb288260d feat: able to customize system name & logo now 2023-05-14 19:29:02 +08:00
JustSong
511cbc117e perf: use slice to improve efficiency (#57) 2023-05-14 12:53:03 +08:00
JustSong
05e460d9f8 fix: fix "[DONE is not valid JSON" (#57) 2023-05-14 12:48:42 +08:00
JustSong
1507dd0104 fix: fix Azure channel not working in stream mode (#57) 2023-05-14 09:39:42 +08:00
JustSong
80176fdfe8 feat: able to customize home page now (#24) 2023-05-13 21:27:49 +08:00
JustSong
bc87b023f5 feat: support batch creation of channels (close #58) 2023-05-13 17:08:13 +08:00
JustSong
9ed9eaa65f feat: support specific default api version now (#57) 2023-05-13 12:53:57 +08:00
JustSong
b4bfc95297 fix: remove the dot in model name (#57) 2023-05-13 12:24:49 +08:00
JustSong
479ccebedb fix: provide a default value for api-version if not given (#57) 2023-05-13 11:41:57 +08:00
JustSong
d97d50b14c feat: Azure API supported without verification (#48, #57) 2023-05-13 11:36:36 +08:00
JustSong
8f64927af2 fix: the initial quota for new token now calculated correctly (#51) 2023-05-11 21:29:05 +08:00
JustSong
049a6def02 feat: able to configure ratio for more models now (close #53) 2023-05-11 20:59:35 +08:00
JustSong
ac2a56f9cd feat: support API /dashboard/billing/credit_grants now (#45) 2023-05-10 09:28:41 +08:00
JustSong
7bd4c0e490 fix: return quota to user when delete token (close #37) 2023-05-04 10:20:39 +08:00
JustSong
36605cf095 fix: shouldn't close c.Request.Body too soon (close #35) 2023-04-29 14:49:10 +08:00
JustSong
033e832cae feat: able to configure ratio for different models (close #26) 2023-04-28 19:16:37 +08:00
JustSong
84c7ae8ad1 refactor: use tiktoken-go to calculate token number 2023-04-28 18:36:17 +08:00
JustSong
52877f99e8 fix: relay bug fix 2023-04-28 18:16:59 +08:00
JustSong
0760dcf6cc feat: support configuring ratio when estimating token number in stream mode 2023-04-28 17:25:05 +08:00