21 Commits (daf11f4af1ebae2e649ebe4e1cfedc0f9da481fa)

Author	SHA1	Message	Date
Jyong	d4a09805a3	improve preview document tokenizer (#13328)	1 year ago
Yeuoly	899df30bf6	Plugin/merge main to plugin/beta 20250122 (#12962) ... Signed-off-by: yihong0618 <zouzou0208@gmail.com> Signed-off-by: -LAN- <laipz8200@outlook.com> Co-authored-by: kurokobo <kuro664@gmail.com> Co-authored-by: Hiroshi Fujita <fujita-h@users.noreply.github.com> Co-authored-by: NFish <douxc512@gmail.com> Co-authored-by: Gen Sato <52241300+halogen22@users.noreply.github.com> Co-authored-by: eux <euxuuu@gmail.com> Co-authored-by: huangzhuo1949 <167434202+huangzhuo1949@users.noreply.github.com> Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com> Co-authored-by: lotsik <lotsik@mail.ru> Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com> Co-authored-by: Wu Tianwei <30284043+WTW0313@users.noreply.github.com> Co-authored-by: nite-knite <nkCoding@gmail.com> Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: gakkiyomi <gakkiyomi@aliyun.com> Co-authored-by: CN-P5 <heibai2006@gmail.com> Co-authored-by: CN-P5 <heibai2006@qq.com> Co-authored-by: Chuehnone <1897025+chuehnone@users.noreply.github.com> Co-authored-by: yihong <zouzou0208@gmail.com> Co-authored-by: Kevin9703 <51311316+Kevin9703@users.noreply.github.com> Co-authored-by: -LAN- <laipz8200@outlook.com> Co-authored-by: Boris Feld <lothiraldan@gmail.com> Co-authored-by: mbo <himabo@gmail.com> Co-authored-by: mabo <mabo@aeyes.ai> Co-authored-by: Warren Chen <warren.chen830@gmail.com> Co-authored-by: KVOJJJin <jzongcode@gmail.com> Co-authored-by: JzoNgKVO <27049666+JzoNgKVO@users.noreply.github.com> Co-authored-by: jiandanfeng <chenjh3@wangsu.com> Co-authored-by: zhu-an <70234959+xhdd123321@users.noreply.github.com> Co-authored-by: zhaoqingyu.1075 <zhaoqingyu.1075@bytedance.com> Co-authored-by: 海狸大師 <86974027+yenslife@users.noreply.github.com> Co-authored-by: Xu Song <xusong.vip@gmail.com> Co-authored-by: rayshaw001 <396301947@163.com> Co-authored-by: Ding Jiatong <dingjiatong@gmail.com> Co-authored-by: Bowen Liang <liangbowen@gf.com.cn> Co-authored-by: JasonVV <jasonwangiii@outlook.com> Co-authored-by: le0zh <newlight@qq.com> Co-authored-by: zhuxinliang <zhuxinliang@didiglobal.com> Co-authored-by: k-zaku <zaku99@outlook.jp> Co-authored-by: Joel <iamjoel007@gmail.com> Co-authored-by: luckylhb90 <luckylhb90@gmail.com> Co-authored-by: hobo.l <hobo.l@binance.com> Co-authored-by: jiangbo721 <365065261@qq.com> Co-authored-by: 刘江波 <jiangbo721@163.com> Co-authored-by: Shun Miyazawa <34241526+miya@users.noreply.github.com> Co-authored-by: EricPan <30651140+Egfly@users.noreply.github.com> Co-authored-by: crazywoola <427733928@qq.com> Co-authored-by: zxhlyh <jasonapring2015@outlook.com> Co-authored-by: sino <sino2322@gmail.com> Co-authored-by: Jhvcc <37662342+Jhvcc@users.noreply.github.com> Co-authored-by: lowell <lowell.hu@zkteco.in>	1 year ago
Jyong	b873e6349c	add child chunk preview number limit (#12309)	1 year ago
Jyong	84ac004772	py lint (#12102) ... Signed-off-by: -LAN- <laipz8200@outlook.com> Co-authored-by: -LAN- <laipz8200@outlook.com>	1 year ago
Jyong	9231fdbf4c	Feat/support parent child chunk (#12092)	1 year ago
yihong	56e15d09a9	feat: mypy for all type check (#10921)	1 year ago
Zane	14f3d44c37	refactor: improve handling of leading punctuation removal (#10761)	1 year ago
Bowen Liang	51db59622c	chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425)	1 year ago
Bowen Liang	2cf1187b32	chore(api/core): apply ruff reformatting (#7624)	2 years ago
Nam Vu	2d7954c7da	Fix variable typo (#8084)	2 years ago
Jyong	60001a62c4	fixed chunk_overlap is None (#7703)	2 years ago
Poorandy	c8f5dfcf17	refactor(rag): switch to dify_config. (#6410) ... Co-authored-by: -LAN- <laipz8200@outlook.com>	2 years ago
Jyong	b6631cd878	modify rerank and splitter code directory (#4924)	2 years ago
Jyong	233c4150d1	support images and tables extract from docx (#4619)	2 years ago
Rain Chen	c255a20d7c	allow to config max segmentation tokens length for RAG document using environment variable (#4375)	2 years ago
takatost	7753ba2d37	FEAT: NEW WORKFLOW ENGINE (#3160) ... Co-authored-by: Joel <iamjoel007@gmail.com> Co-authored-by: Yeuoly <admin@srmxy.cn> Co-authored-by: JzoNg <jzongcode@gmail.com> Co-authored-by: StyleZhang <jasonapring2015@outlook.com> Co-authored-by: jyong <jyong@dify.ai> Co-authored-by: nite-knite <nkCoding@gmail.com> Co-authored-by: jyong <718720800@qq.com>	2 years ago
listeng	696efe494e	fix: Ignore some emtpy page_content when append to split_documents (#2898)	2 years ago
Jyong	8ba38e8e74	fix overlap and splitter optimization (#2742) ... Co-authored-by: jyong <jyong@dify.ai>	2 years ago
Jyong	31070ffbca	fix qa index processor tenant id is None error (#2713) ... Co-authored-by: jyong <jyong@dify.ai>	2 years ago
Jyong	91ea6fe4ee	Fix/langchain document schema (#2539) ... Co-authored-by: jyong <jyong@dify.ai>	2 years ago
Jyong	6c4e6bf1d6	Feat/dify rag (#2528) ... Co-authored-by: jyong <jyong@dify.ai>	2 years ago