Commit Graph

153 Commits (deploy/dev)

Author SHA1 Message Date
yihong 56e15d09a9
feat: mypy for all type check (#10921) 1 year ago
-LAN- 1c80941c69
fix: add FileNotFoundError to ignored errors in Sentry integration (#12023)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- c4091c4c66
fix: improve error handling for file retrieval in AwsS3Storage (#12002)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 3599751f93
chore(db): use a better way to export models and remove unused table (#11838)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 688292e6ff
chore(opendal_storage): remove unused comment (#11783)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 99f40a9682
feat: full support for opendal and sync configurations between .env and docker-compose (#11754)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
luckylhb90 38e155d819
feat: log add trace id (#11599)
Co-authored-by: hobo.l <hobo.l@binance.com>
1 year ago
yihong 180743612c
fix: better opendal tests (#11569)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
-LAN- 8d4bb9b40d
feat: integrate opendal storage (#11508)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
yihong 7b86f8f024
fix: double split error on redis port and some type hint (#11270)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
Bowen Liang 9b46b02717
refactor: assembling the app features in modular way (#9129)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
1 year ago
Bowen Liang 2feb44e2c5
chore(dep): bump flask from 3.0.1 to 3.1.0 and flask-compress to 1.17 (#11195) 1 year ago
Jyong 41c6bf5fe4
update the scheduler of update_tidb_serverless_status_task to 1/10min (#11135) 1 year ago
Bowen Liang 6c8e208ef3
chore: bump minimum supported Python version to 3.11 (#10386) 1 year ago
liuhaoran 8ff65abbc6
ext_redis.py support redis clusters --- Fixes #9538 (#9789)
Signed-off-by: root <root@localhost.localdomain>
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
1 year ago
Jyong 128efc3193
Feat/clean message records (#10588) 1 year ago
Bowen Liang 51db59622c
chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 1 year ago
fdb02983rhy 16db2c4e57
Fix: Set Celery LOG_File only when available, always log to console (#10563) 1 year ago
liuhaoran 7c2a9b0744
celery worker log format following LOG_FORMAT env#9404 (#10016)
Signed-off-by: root <root@localhost.localdomain>
Co-authored-by: root <root@localhost.localdomain>
1 year ago
ice yao dd5ffaf058
chore: use posixpath to wrapper filepath (#9976) 1 year ago
crazywoola 0a3d51e9cf
Revert "chore: improve validation and handler of logging timezone with TimezoneName" (#10077) 1 year ago
Bowen Liang bab5c54219
chore: improve validation and handler of logging timezone with TimezoneName (#9595) 1 year ago
Jyong 18106a4fc6
add tidb on qdrant type (#9831)
Co-authored-by: Zhaofeng Miao <522856232@qq.com>
1 year ago
zhuhao 5bf31e7a86
refactor: update load_stream method to directly yield file chunks (#9806) 1 year ago
ice yao e71f494839
chore: abstract common function with local storage (#9811) 1 year ago
zhuhao c9dfe1ad92
feat: support user-defined configuration of log file size and retention count (#9610) 1 year ago
-LAN- e8abbe0623
fix(storage): ensure `storage_runner` initialization within app context (#9627) 1 year ago
-LAN- b14d59e977
fix(storage): use centralized config management (#9620) 1 year ago
Bowen Liang d170d78530
chore: (#9089 followup) fix storage factory constructor (#9609) 1 year ago
Bowen Liang 4d9160ca9f
refactor: use dify_config to replace legacy usage of flask app's config (#9089) 1 year ago
zhuhao 83b2b8fe60
refactor: add logging extension module for log initialization (#9524) 1 year ago
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 1 year ago
omr 6d2c6caa23
refactor: remove unnecessary 'closing' usage for boto3 client (#9343) 1 year ago
Garfield Dai c6b74daa0a
Fix/s3 iam add region name (#7819) 1 year ago
zhuhao 7a6970e570
feat: add supabase object storage (#9229) 1 year ago
kurokobo c0b71f8286
feat: respect x-* headers for redirections (#9054) 1 year ago
Bowen Liang b360feb4c1
refactor: introduce storage factory and speed up api startup by importing storage client on demand (#9086) 1 year ago
zhuhao 2571b0c4e3
feat: add baidu obs storage (#9024) 1 year ago
zhuhao e1e2d0b364
fix: failed to open links to images generated by QR code tool when using Huawei OBS (#9034) 1 year ago
Jyong d96f5ba1ca
add storage error log (#8556) 2 years ago
swingchen01 f55e06d8bf
fix: resolve runtime error when self.folder is None (#8401)
Co-authored-by: 陈长君 <chenchangjun@shuwen.com>
2 years ago
Joe 84ac5ccc8f
fix: add before send to remove langfuse defaultErrorResponse (#8361) 2 years ago
Joe 82f7875a52
feat: add langfuse sentry ignore error (#8353) 2 years ago
Bowen Liang 40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2 years ago
Bowen Liang 292220c596
chore: apply pep8-naming rules for naming convention (#8261) 2 years ago
ice yao c8df92d0eb
add volcengine tos storage (#8164) 2 years ago
Zhi d542b15cc0
feat: support redis sentinel mode (#7756) 2 years ago
zhuhao e0d3cd91c6
support huawei cloud obs storage (#7980) (#7981) 2 years ago
Seayon 78989e9049
Add ALIYUN_OSS_PATH configuration for Aliyun OSS (#7864)
Co-authored-by: seayon <zhaoxuyang@shouqianba.com>
2 years ago
takatost 0e0a703496
chore: ignore openai error record in sentry (#7770) 2 years ago
Vimpas 4682e0ac7c
fix(storage): 🐛 HeadBucket Operation Permission (#7733)
Co-authored-by: 莫岳恒 <moyueheng@datagrand.com>
2 years ago
Vimpas 0006c6f0fd
fix(storage): 🐛 Create S3 bucket if it doesn't exist (#7514)
Co-authored-by: 莫岳恒 <moyueheng@datagrand.com>
2 years ago
-LAN- 3571292fbf
chore(api): Introduce Ruff Formatter. (#7291) 2 years ago
-LAN- feb4576ee7
chore: update SQLAlchemy configuration with custom naming convention (#6854) 2 years ago
yanghx 349ec0db77
fix tencent_cos_storage image-preview error is not a byte (#6652) 2 years ago
Jyong 7c397f5722
update celery beat scheduler time to env (#6352) 2 years ago
Jyong 988aa4b5da
update clean_unused_datasets_task timedelta (#6324) 2 years ago
Jyong 678ad6b7eb
Fix/file stream azure blob (#6196) 2 years ago
Jyong cbbe28f40d
fix azure stream download (#6063) 2 years ago
hymvp 1d3e96ffa6
add support oracle oci object storage (#5616) 2 years ago
Bowen Liang 3cc6093e4b
feat: introduce pydantic-settings for config definition and validation (#5202)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
quicksand 147a39b984
feat: support tencent cos storage (#5297) 2 years ago
Jyong d7fbae286a
add aws s3 iam check (#5174) 2 years ago
Kazuki Takamatsu 3f18369ad2
Fix: google storage init with sa and download (#5054) 2 years ago
Jyong 481e7bc6b9
Fix/azure blob new version (#5004) 2 years ago
Jyong 9cf9720efa
Fix/azure blob token expire (#4914) 2 years ago
Jyong d828a7fc35
fix azure blob token expire (#4911) 2 years ago
Charles Zhou a325a294bd
feat: opportunistic tls flag for smtp (#4794) 2 years ago
Kota-Yamaguchi 3b60b712ec
feat: Add logging warning when MAIL_TYPE is not set (#4771) 2 years ago
Jyong bdd409970f
fix the wrong env variable AZURE_BLOB_CONTAINER_NAME (#4455) 2 years ago
Kota Matsumoto e2a78888b9
Fix: setup google-storage client (#4296)
Co-authored-by: kotamat <kota1681@gmail.com>
Co-authored-by: crazywoola <427733928@qq.com>
2 years ago
S96EA 13cd409575
feat: support aliyun oss auth v4 (#3886)
Co-authored-by: owen <owen@owen.hawk-toad.ts.net>
2 years ago
Jyong 338e4669e5
add storage factory (#3922) 2 years ago
miendinh 9ad489d133
feat: Add google storage support (#3887)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
2 years ago
Henrybit 80b9507e7a
feat: add aliyun oss storage (#3690)
Co-authored-by: henrybit <qipenghui3056@sina.com>
2 years ago
LIU HONGWEI c227f3d985
feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (#3408) (#3416) 2 years ago
Bowen Liang 28089c98c1
fix: skip Celery warning by setting broker_connection_retry_on_startup config (#3188) 2 years ago
Jyong 5e66a60f1c
add embedding cache and clean embedding cache job (#3087)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong a94d86da6d
add keyword table s3 storage support (#3065)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 1716ac562c
add clean_unused_datasets_task (#3057)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Leo Q 7c8c233cf4
Add S3_ADDRESS_STYLE configuration option (#2934) 2 years ago
Bowen Liang 1f98a4fff3
improve: cache tool icons by setting max-age HTTP header and enable gzip compression SVG icons from backend (#2971) 2 years ago
Jyong 86e474fff1
Add azure blob storage support (#2919)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Laurent Magnien bdc13f9238
SMTP authentication is optional (#2765)
Co-authored-by: Laurent Magnien <laurent.magnien@adsn.fr>
2 years ago
Bowen Liang 552f319b9d
feat: support HTTP response compression in api server (#2680) 2 years ago
Bowen Liang 063191889d
chore: apply ruff's pyupgrade linter rules to modernize Python code with targeted version (#2419) 2 years ago
JonahCui 71e5828d41
feat: add support for smtp when send email (#2409) 2 years ago
Bowen Liang 843280f82b
enhancement: introduce Ruff for Python linter for reordering and removing unused imports with automated pre-commit and sytle check (#2366) 2 years ago
Bowen Liang cc9e74123c
improve: introduce isort for linting Python imports (#1983) 2 years ago
takatost 94626487db
fix: resend url optional (#1987) 2 years ago
Benjamin 1fe4e3afde
Update Resend SDK and resend api url in configuration. (#1963) 2 years ago
Jyong 2757494265
alter schedule timedelta (#1923)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
takatost d069c668f8
Model Runtime (#1858)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
2 years ago
Jyong 595e9b25ba
Add data clean schedule (#1859)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Garfield Dai 6b499b9a16
remove stripe and anthropic. (#1746) 2 years ago
takatost 41d0a8b295
feat: [backend] vision support (#1510)
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
2 years ago
Garfield Dai db43ed6f41
feat: add api-based extension & external data tool & moderation backend (#1403)
Co-authored-by: takatost <takatost@gmail.com>
2 years ago
zxhlyh 227f9fb77d
Feat/api jwt (#1212) 3 years ago
takatost 5fa2161b05
feat: server multi models support (#799) 3 years ago
KVOJJJin cd51d3323b
feat: member invitation and activation (#535)
Co-authored-by: John Wang <takatost@gmail.com>
3 years ago