Commit Graph

141 Commits (main)

Author SHA1 Message Date
Hiroshi Fujita 1d8385f7ac
Sync INDEXING_MAX_SEGMENTATION_TOKENS_LENGTH between API and Web (#11230) 1 year ago
Bowen Liang 6c8e208ef3
chore: bump minimum supported Python version to 3.11 (#10386) 1 year ago
jarvis2f 5ff02b469f
fix:position error when creating segments (#10706) 1 year ago
Jyong 4f1a56f0f0
update document and segment word count (#10449) 1 year ago
Jyong 888d7e6422
fix segment enable service api (#10445) 1 year ago
Cling_o3 ab127ba92e
[fix] fix the bug that modify document name not effective (#10154) 1 year ago
-LAN- 9ac2bb30f4
Feat/add-remote-file-upload-api (#9906) 1 year ago
Jyong 0154a26e0b
fix issue: update document segment setting failed (#10107) 1 year ago
Jyong af68084895
add document lock for multi-thread (#9873) 1 year ago
郭伟伟 90769ac709
feat: create_empty_dataset api add the description parameter and update api docs (#9824) 1 year ago
Jyong 42b02b3a5f
Fix/agent external knowledge retrieval (#9241) 1 year ago
crazywoola e0c8189f1a
feat: add NotFound error for dataset service (#9215) 1 year ago
Jyong 3069b5cf57
original dataset update remove unuseful parameters (#8939) 1 year ago
Jyong a651b73db0
original dataset update issue (#8935) 1 year ago
Jyong 9d221a5e19
external knowledge api (#8913)
Co-authored-by: Yi <yxiaoisme@gmail.com>
1 year ago
Vikey Chen 4f69adc8ab
fix: document_create_args_validate (#8569) 1 year ago
Bowen Liang a1104ab97e
chore: refurish python code by applying Pylint linter rules (#8322) 1 year ago
Bowen Liang 6613b8f2e0
chore: fix unnecessary string concatation in single line (#8311) 1 year ago
Bowen Liang 40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 1 year ago
Jyong 85ff82a694
code merge error (#8183)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Nam Vu 2d7954c7da
Fix variable typo (#8084) 1 year ago
KVOJJJin 14af87527f
Feat:remove estimation of embedding cost (#7950)
Co-authored-by: jyong <718720800@qq.com>
1 year ago
Jyong 8e311cc45c
fixed permission is None (#7788) 1 year ago
crazywoola 3a071b8db9
fix: datasets permission is missing (#7751) 1 year ago
Bowen Liang 17fd773a30
chore(api/services): apply ruff reformatting (#7599)
Co-authored-by: -LAN- <laipz8200@outlook.com>
1 year ago
crazywoola 2c427e04be
Feat/7134 use dataset api create a dataset with permission (#7508) 1 year ago
crazywoola 4d4af00399
fix: keywords (#7357) 1 year ago
Jyong 048bc4c06e
fix update dataset failed when embedding model is not exist (#6920) 2 years ago
Jyong 57729823a0
fix wrong method using (#6459) 2 years ago
Jyong f55876bcc5
fix web import url is too long (#6402) 2 years ago
Jyong 0de224b153
fix wrong using of RetrievalMethod Enum (#6345) 2 years ago
Jyong d320d1468d
Feat/delete file when clean document (#5882) 2 years ago
Waffle 7b225a5ab0
refactor(services/tasks): Swtich to dify_config witch Pydantic (#6203) 2 years ago
Joe ce930f19b9
fix dataset operator (#6064)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2 years ago
takatost 79df8825c8
Revert "feat: knowledge admin role" (#6018) 2 years ago
Joe 5d9ad430af
feat: knowledge admin role (#5965)
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
2 years ago
Jyong 71bcf75d9a
Feat/add delete knowledge confirm (#5810) 2 years ago
Bowen Liang dcb72e0067
chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
Bowen Liang c923684edd
chore: extract retrival method literal values into enum (#5060) 2 years ago
Jyong ba5f8afaa8
Feat/firecrawl data source (#5232)
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
2 years ago
Summer-Gu 7f98c2ea3f
refactor: Delete the dataset to verify whether it is in use (#5112) 2 years ago
takatost d1dbbc1e33
feat: backend model load balancing support (#4927) 2 years ago
Jyong 4e3b0c5aea
support rename document (#4915) 2 years ago
Bowen Liang 04ad46dd31
chore: skip unnecessary key checks prior to accessing a dictionary (#4497) 2 years ago
Jyong 591b993685
fix dataset segment update api not effect issue (#4151) 2 years ago
羊羽 13292ff73e
🦄 refactor(dataset svc): delete check none (#4101)
Co-authored-by: baxiang <baxiang@lixiang.com>
2 years ago
Charlie.Wei f62b2b5b45
optimize the knowledge failed documents query (#3870)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2 years ago
Jyong f257f2c396
Knowledge optimization (#3755)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
2 years ago
LIU HONGWEI c227f3d985
feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (#3408) (#3416) 2 years ago
Jyong 1f302990c6
add segment with keyword issue (#3351)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2 years ago
Garfield Dai 8e66b96221
Feat: Add documents limitation (#2662) 2 years ago
Bowen Liang 801d135390
generalize the generation of new collection name by dataset id (#2620) 2 years ago
Jyong 6c4e6bf1d6
Feat/dify rag (#2528)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 97fe817186
Fix/upload limit (#2521)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2 years ago
Bowen Liang 063191889d
chore: apply ruff's pyupgrade linter rules to modernize Python code with targeted version (#2419) 2 years ago
Bowen Liang 14a19a3da9
chore: apply ruff's pyflakes linter rules (#2420) 2 years ago
Bowen Liang 843280f82b
enhancement: introduce Ruff for Python linter for reordering and removing unused imports with automated pre-commit and sytle check (#2366) 2 years ago
KVOJJJin 89fcf4ea7c
Feat: chunk overlap supported (#2209)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Bowen Liang cc9e74123c
improve: introduce isort for linting Python imports (#1983) 2 years ago
takatost d069c668f8
Model Runtime (#1858)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
2 years ago
Jyong da4847c5a8
fix segment update issue (#1844)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong a71f2863ac
Annotation management (#1767)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Garfield Dai 7b8a10f3ea
feat: billing enhancement 20231204 (#1691)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Garfield Dai 053102f433
Feat/dify billing (#1679)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: takatost <takatost@users.noreply.github.com>
2 years ago
Jyong 74b2260ba6
fix score_threshold_enabled name (#1626)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 4588831bff
Feat/add retriever rerank (#1560)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 289c93d081
Feat/improve document delete logic (#1325)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Charlie.Wei 9e7efa45d4
document segmentApi Add get&update&delete operate (#1285)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
2 years ago
Jyong 46154c6705
Feat/dataset service api (#1245)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2 years ago
Jyong 269a465fc4
Feat/improve vector database logic (#1193)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
KVOJJJin c67f345d0e
Fix: disable operations of dataset when embedding unavailable (#1055)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong a55ba6e614
Fix/ignore economy dataset (#1043)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 16199e968e
fix notion import limit check (#1042)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 2d604d9330
Fix/filter empty segment (#1004)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
yezhwi c1602aafc7
refactor:cache in place & function name (#1001) 2 years ago
Jyong 5397799aac
document limit (#999)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong aee15adf1b
update document segment (#948)
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
Jyong 4b53bb1a32
Feat/token support (#909)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: jyong <jyong@dify.ai>
2 years ago
takatost 22c1aafb9b
fix: document paused at format error (#925) 2 years ago
Jyong db7156dafd
Feature/mutil embedding model (#908)
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
3 years ago
takatost 5fa2161b05
feat: server multi models support (#799) 3 years ago
Jyong 082f8b17ab
Feat/milvus support (#671)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
3 years ago
KVOJJJin cf93d8d6e2
Feat: Q&A format segmentation support (#668)
Co-authored-by: jyong <718720800@qq.com>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
3 years ago
Jyong 2c6e00174b
add document limit check (#570) 3 years ago
John Wang ed6648a41e
feat: dataset list add order by created at (#487) 3 years ago
John Wang 3241e4015b
feat: upgrade langchain (#430)
Co-authored-by: jyong <718720800@qq.com>
3 years ago
Jyong ce2996e7d4
Fix/dataset init (#409) 3 years ago
Jyong 9253f72dea
Feat/dataset notion import (#392)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
3 years ago
KVOJJJin c67f626b66
Feat: Support re-segmentation (#114)
Co-authored-by: John Wang <takatost@gmail.com>
Co-authored-by: Jyong <718720800@qq.com>
Co-authored-by: 金伟强 <iamjoel007@gmail.com>
3 years ago
Jyong e2bf18053c
Fix/dateset update rule (#177) 3 years ago
John Wang db896255d6 Initial commit 3 years ago