Commit Graph

78 Commits (3bdaf2dcaecb3c2b61dcc69202df7440cae3fc03)

Author SHA1 Message Date
zxhlyh 41b720502f merge main 1 year ago
Yingchun Lai 53bb37b749
fix: fix the incorrect plaintext file key when saving (#10429) 1 year ago
zxhlyh 7011a5029e merge main 1 year ago
-LAN- 8d15c8cfbf
fix: improve error handling in NotionExtractor data fetching (#12182)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
zxhlyh 6175f8c16f merge main 1 year ago
Jyong 811e4bd0cf
fix unstructured setting (#12116) 1 year ago
Jyong 84ac004772
py lint (#12102)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
1 year ago
Jyong 9231fdbf4c
Feat/support parent child chunk (#12092) 1 year ago
yihong 56e15d09a9
feat: mypy for all type check (#10921) 1 year ago
JzoNg 171cc88a0d merge main 1 year ago
yihong 36cb25b341
fix: support mdx files close #11557 (#11565)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
Yi b8f9747849 Merge branch "main" into feat/plugins 1 year ago
-LAN- 9601102885
fix(word_extractor): Fix type error and remove stream in ssrf_proxy (#11241)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Bowen Liang 6c8e208ef3
chore: bump minimum supported Python version to 3.11 (#10386) 1 year ago
Bowen Liang 51db59622c
chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 1 year ago
-LAN- a1543b7da0
fix(extractor): temporary file (#10543) 1 year ago
Leo.Wang c9f785e00f
Feat/tools/gitlab (#10407) 1 year ago
Bowen Liang 574c4a264f
chore(lint): Use logging.exception instead of logging.error (#10415) 1 year ago
Jyong 1024fc623e
fix the ssrf of docx file extractor external images (#10237) 1 year ago
virgosoy 17cacf258e
fix: wrong element object (#9868) 1 year ago
Zixuan Cheng 88dec6ef2b
Added description for .ppt, specify the reason for unstructured.io (#9452)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Jyong 5f11fe521d
remove unstructured pdf extract (#9794) 1 year ago
Jyong 3e9d271b52
nltk security issue and upgrade unstructured (#9558) 1 year ago
-LAN- 5f12c17355
fix(core): use CreatedByRole enum for role consistency (#9607) 1 year ago
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 1 year ago
Bowen Liang 240b66d737
chore: avoid implicit optional in type annotations of method (#8727) 1 year ago
Zhaofeng Miao 369e1e6f58
feat(website-crawl): add jina reader as additional alternative for website crawling (#8761) 2 years ago
crazywoola bf64ff215b
fix: . is missing in file_extension (#8736) 2 years ago
Bowen Liang a1104ab97e
chore: refurish python code by applying Pylint linter rules (#8322) 2 years ago
Bowen Liang 6613b8f2e0
chore: fix unnecessary string concatation in single line (#8311) 2 years ago
Bowen Liang 40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2 years ago
Bowen Liang c69f5b07ba
chore: apply ruff E501 line-too-long linter rule (#8275)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
takatost 56c90e212a
fix(workflow): missing content in the answer node stream output during iterations (#8292)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
Bowen Liang 0f14873255
chore: cleanup ruff flake8-simplify linter rules (#8286)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
Bowen Liang 2cf1187b32
chore(api/core): apply ruff reformatting (#7624) 2 years ago
Jyong af92f19291
filter excel empty sheet (#8194) 2 years ago
Nam Vu 2d7954c7da
Fix variable typo (#8084) 2 years ago
Jyong 01581dd35f
improve the notion table extract (#7925) 2 years ago
Jyong 6f33351eb3
ignore linked images when image id is none (#7890) 2 years ago
Bowen Liang ccb6ddd840
chore: bump Ruff to 0.5.7 (#7174) 2 years ago
Jyong 12095f8cd6
extract docx filter comment element (#7092) 2 years ago
chenxu9741 72c75b75cf
feat: Add hyperlink parsing to the DOCX document. (#7017) 2 years ago
yanghx c53875ce8c
fix #6902 .docx handles images within tables and handles cross-column tables (#6951) 2 years ago
Jyong cf258b7a67
add xlsx support hyperlink extract (#6722) 2 years ago
Yeuoly 79cb23e8ac
security/SSRF vulns (#6682) 2 years ago
灰灰 5e4ac11df3
fix: code block segmentation problem of markdown document (#6465) 2 years ago
Poorandy c8f5dfcf17
refactor(rag): switch to dify_config. (#6410)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
tangyoha 0cbbaf3f68
fix: markdown proc will remove image (#5855) 2 years ago
Matri a9ee52f2d7
Fix/firecrawl parameters issue (#6213) 2 years ago
Aurelius Huang f546db5437
fix: document truncation and loss in notion document sync (#5631)
Co-authored-by: Aurelius Huang <cm.huang@aftership.com>
2 years ago