Commit Graph

168 Commits (10e6b11ff66901acb35f2fca5be4dbf554d8b749)

Author SHA1 Message Date
Jiang 0c9e79cd67
Add Lindorm as a VDB choice (#10202)
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
1 year ago
-LAN- 9ac2bb30f4
Feat/add-remote-file-upload-api (#9906) 1 year ago
powerfool 878d13ef42
Added OceanBase as an option for the vector store in Dify (#10010) 1 year ago
roadgoat19 c8ef9223e5
feat: couchbase integration (#6165)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Elliot Scribner <elliot.scribner@couchbase.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
1 year ago
Jyong 18106a4fc6
add tidb on qdrant type (#9831)
Co-authored-by: Zhaofeng Miao <522856232@qq.com>
1 year ago
郭伟伟 90769ac709
feat: create_empty_dataset api add the description parameter and update api docs (#9824) 1 year ago
ice yao ceb2c4f3ef
chore: reuse existing test functions with upstash vdb (#9679) 1 year ago
Zven 8e7a752b2a
feat: add upstash as a new vector database provider (#9644) 1 year ago
-LAN- 36f66d40e5
refactor(api): simplify limit retrieval and return types (#9641) 1 year ago
-LAN- 8d8a8fe295
feat(file-upload): add support for optional file source parameter (#9554) 1 year ago
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 1 year ago
Summer-Gu 8501af298f
feat: added dataset recall testing API (#9300) 1 year ago
ice yao d15ba3939d
Add Volcengine VikingDB as new vector provider (#9287) 1 year ago
Shili Cao 2ec6ffe478
feat:support baidu vector db (#9185) 1 year ago
Jyong 42b02b3a5f
Fix/agent external knowledge retrieval (#9241) 1 year ago
Jyong 9d221a5e19
external knowledge api (#8913)
Co-authored-by: Yi <yxiaoisme@gmail.com>
2 years ago
Zhaofeng Miao 369e1e6f58
feat(website-crawl): add jina reader as additional alternative for website crawling (#8761) 2 years ago
ice yao 27e33fb15c
chore: fix wrong VectorType match case (#8857) 2 years ago
Bowen Liang a1104ab97e
chore: refurish python code by applying Pylint linter rules (#8322) 2 years ago
Bowen Liang 6613b8f2e0
chore: fix unnecessary string concatation in single line (#8311) 2 years ago
Bowen Liang 40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2 years ago
Jyong 85ff82a694
code merge error (#8183)
Co-authored-by: crazywoola <427733928@qq.com>
2 years ago
Nam Vu 2d7954c7da
Fix variable typo (#8084) 2 years ago
crazywoola c441bea4d1
fix: datasets permission is missing (#7787) 2 years ago
Garfield Dai 54b693d5b1
feat: update saas billing hint. (#7760) 2 years ago
Jiakun Xu e38334cfd2
fix: doc_language return null when document segment settings (#7719) 2 years ago
-LAN- 13be84e4d4
chore(api/controllers): Apply Ruff Formatter. (#7645) 2 years ago
crazywoola 2c427e04be
Feat/7134 use dataset api create a dataset with permission (#7508) 2 years ago
Jyong 0f90e6df75
add pgvector full text search settting (#7427) 2 years ago
feng0 2fe2e350ce
add secondary sort_key when using `order_by` and `paginate` at the same time (#7225) 2 years ago
miendinh f104b930cf
feat: support elasticsearch vector database (#3558)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2 years ago
TzuxinChen f0d10553b4
Fixed a bug where permission was clearly displaye… (#6934) 2 years ago
liuzhenghua ef616c604a
fix: The permissions issue of the editor role accessing some backend … (#6945)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2 years ago
Jyong 048bc4c06e
fix update dataset failed when embedding model is not exist (#6920) 2 years ago
tmuife 06fc1bce9e
Add search by full text when using Oracle23ai as vector DB (#6559) 2 years ago
Shoya SHIRAKI c57b3931d5
refactor(api): switch to dify_config in controllers/console (#6485) 2 years ago
Bowen Liang 7943f7f697
chore: fix legacy API usages of Query.get() by Session.get() in SqlAlchemy 2 (#6340) 2 years ago
Jyong 0de224b153
fix wrong using of RetrievalMethod Enum (#6345) 2 years ago
Zhuo Qiu 63e34e5227
feat: support MyScale vector database (#6092) 2 years ago
Joe ce930f19b9
fix dataset operator (#6064)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2 years ago
8bitpd 7c70eb87bc
feat: support AnalyticDB vector store (#5586)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2 years ago
takatost 79df8825c8
Revert "feat: knowledge admin role" (#6018) 2 years ago
Joe 5d9ad430af
feat: knowledge admin role (#5965)
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
2 years ago
Jyong 71bcf75d9a
Feat/add delete knowledge confirm (#5810) 2 years ago
Jyong 43335b5c87
delete the deprecated method (#5612) 2 years ago
kurokobo c5d64baba4
fix: correct typos (#5510) 2 years ago
tmuife 6a09409ec9
Add Oracle23ai as a vector datasource (#5342)
Co-authored-by: walter from vm <walter.jin@oracle.com>
2 years ago
Bowen Liang c923684edd
chore: extract retrival method literal values into enum (#5060) 2 years ago
baojingyu d160d1ed02
feat: support opensearch approximate k-NN (#5322) 2 years ago
Jyong ba5f8afaa8
Feat/firecrawl data source (#5232)
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
2 years ago
Charles Zhou 8bcc5a36bb
feat: new editor user permission profile (#4435)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2 years ago
quicksand 4080f7b8ad
feat: support tencent vector db (#3568) 2 years ago
Summer-Gu 7f98c2ea3f
refactor: Delete the dataset to verify whether it is in use (#5112) 2 years ago
Bowen Liang cdc08a434f
feat: support Chroma vector store (#5015) 2 years ago
Bowen Liang bdad993901
improve: generalize vector factory classes and vector type (#5033) 2 years ago
Weaxs 0797f9bc05
feat: support tidb vector (#4588) 2 years ago
Jyong 4e3b0c5aea
support rename document (#4915) 2 years ago
Moonlit 86e7c7321f
Fixed a bug where any content in the 'fetch' was converted to True (#4400) 2 years ago
LiuVaayne 875249eb00
Feat/vector db pgvector (#3879) 2 years ago
Jyong 3e9dbe3e0a
add pgvecto_rs support and upgrade SQLAlchemy (#3833) 2 years ago
羊羽 975b2fb79e
delete duplicate check get_dataset (#3966)
Co-authored-by: baxiang <baxiang@lixiang.com>
2 years ago
Jingpan Xiong 1be222af2e
fix: using api can not execute relyt vector database (#3766)
Co-authored-by: jingsi <jingsi@leadincloud.com>
2 years ago
Jyong f257f2c396
Knowledge optimization (#3755)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
2 years ago
Jyong 394ceee141
optimize question classifier prompt and support keyword hit test (#3565) 2 years ago
LIU HONGWEI c227f3d985
feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (#3408) (#3416) 2 years ago
Jyong e12a0c154c
add segment function billing check for SAAS env (#3082)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Garfield Dai 8e66b96221
Feat: Add documents limitation (#2662) 2 years ago
Jyong 5b953c1ef2
Fix some RAG bugs (#2570)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 6c4e6bf1d6
Feat/dify rag (#2528)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Bowen Liang 063191889d
chore: apply ruff's pyupgrade linter rules to modernize Python code with targeted version (#2419) 2 years ago
Bowen Liang 14a19a3da9
chore: apply ruff's pyflakes linter rules (#2420) 2 years ago
Bowen Liang 843280f82b
enhancement: introduce Ruff for Python linter for reordering and removing unused imports with automated pre-commit and sytle check (#2366) 2 years ago
takatost 9f637ead38
bump version to 0.5.3 (#2306) 2 years ago
crazywoola 828822243a
fix: multiple rows were found correctly (#2219) 2 years ago
crazywoola 1f48e3d44a
feat: support legacy doc (#2100) 2 years ago
crazywoola ec1659cba0
fix: saving error in empty dataset (#2098) 2 years ago
Bowen Liang cc9e74123c
improve: introduce isort for linting Python imports (#1983) 2 years ago
Jyong 5e75f7022f
fix data_source_detail_dict parameter error (#2000)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 4d99c689f0
prohibit enable and disable function when segment is not completed (#1954)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
2 years ago
takatost 4562e83b24
fix: hit testing throws errors cause internal server error (#1865) 2 years ago
takatost d069c668f8
Model Runtime (#1858)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
2 years ago
Jyong e91dd28a76
fix file estimate issue (#1860)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
taokuizu 10fc44e2af
fix typo (#1791) 2 years ago
Jyong 5e34f938c1
Feat/add unstructured support (#1780)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Garfield Dai 7b8a10f3ea
feat: billing enhancement 20231204 (#1691)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Garfield Dai 053102f433
Feat/dify billing (#1679)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: takatost <takatost@users.noreply.github.com>
2 years ago
Jyong 6717bb2b72
fix the error message (#1564)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 4588831bff
Feat/add retriever rerank (#1560)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
takatost 41d0a8b295
feat: [backend] vision support (#1510)
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
2 years ago
takatost 024250803a
feat: move login_required wrapper outside (#1281) 2 years ago
Jyong 5e511e01bf
Fix/dataset api key delete (#1255)
Co-authored-by: jyong <jyong@dify.ai>
3 years ago
Jyong 46154c6705
Feat/dataset service api (#1245)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
3 years ago
KVOJJJin e161c511af
Feat:csv & docx support (#1139)
Co-authored-by: jyong <jyong@dify.ai>
3 years ago
yezhwi d33a269548
refactor(file extractor): file extractor (#1059) 3 years ago
KVOJJJin c67f345d0e
Fix: disable operations of dataset when embedding unavailable (#1055)
Co-authored-by: jyong <jyong@dify.ai>
3 years ago
yezhwi 8b8e510bfe
fix: handle AttributeError for datasets and index (#1052) 3 years ago
Jyong a55ba6e614
Fix/ignore economy dataset (#1043)
Co-authored-by: jyong <jyong@dify.ai>
3 years ago
Jyong e053215155
fix document estimate parameter (#1019)
Co-authored-by: jyong <jyong@dify.ai>
3 years ago
Jyong e7199826cc
embedding model available check (#1009)
Co-authored-by: jyong <jyong@dify.ai>
3 years ago
Jyong 5397799aac
document limit (#999)
Co-authored-by: jyong <jyong@dify.ai>
3 years ago