Commit Graph

76 Commits (feat/webapp-auth-api)

Author SHA1 Message Date
Ademílson Tonato d0a21086bd
refactor: Update Firecrawl API parameters and default settings (#13082) 1 year ago
Ademílson Tonato 6024d8a42d
refactor: Update Firecrawl to use v1 API (#12574)
Co-authored-by: Ademílson Tonato <ademilson.tonato@refurbed.com>
1 year ago
Bowen Liang 166221d784
chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 1 year ago
Yingchun Lai 53bb37b749
fix: fix the incorrect plaintext file key when saving (#10429) 1 year ago
-LAN- 8d15c8cfbf
fix: improve error handling in NotionExtractor data fetching (#12182)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Jyong 811e4bd0cf
fix unstructured setting (#12116) 1 year ago
Jyong 84ac004772
py lint (#12102)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
1 year ago
Jyong 9231fdbf4c
Feat/support parent child chunk (#12092) 1 year ago
yihong 56e15d09a9
feat: mypy for all type check (#10921) 1 year ago
yihong 36cb25b341
fix: support mdx files close #11557 (#11565)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
-LAN- 9601102885
fix(word_extractor): Fix type error and remove stream in ssrf_proxy (#11241)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Bowen Liang 6c8e208ef3
chore: bump minimum supported Python version to 3.11 (#10386) 1 year ago
Bowen Liang 51db59622c
chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 1 year ago
-LAN- a1543b7da0
fix(extractor): temporary file (#10543) 1 year ago
Leo.Wang c9f785e00f
Feat/tools/gitlab (#10407) 1 year ago
Bowen Liang 574c4a264f
chore(lint): Use logging.exception instead of logging.error (#10415) 1 year ago
Jyong 1024fc623e
fix the ssrf of docx file extractor external images (#10237) 1 year ago
virgosoy 17cacf258e
fix: wrong element object (#9868) 1 year ago
Zixuan Cheng 88dec6ef2b
Added description for .ppt, specify the reason for unstructured.io (#9452)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Jyong 5f11fe521d
remove unstructured pdf extract (#9794) 1 year ago
Jyong 3e9d271b52
nltk security issue and upgrade unstructured (#9558) 1 year ago
-LAN- 5f12c17355
fix(core): use CreatedByRole enum for role consistency (#9607) 1 year ago
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 1 year ago
Bowen Liang 240b66d737
chore: avoid implicit optional in type annotations of method (#8727) 1 year ago
Zhaofeng Miao 369e1e6f58
feat(website-crawl): add jina reader as additional alternative for website crawling (#8761) 2 years ago
crazywoola bf64ff215b
fix: . is missing in file_extension (#8736) 2 years ago
Bowen Liang a1104ab97e
chore: refurish python code by applying Pylint linter rules (#8322) 2 years ago
Bowen Liang 6613b8f2e0
chore: fix unnecessary string concatation in single line (#8311) 2 years ago
Bowen Liang 40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2 years ago
Bowen Liang c69f5b07ba
chore: apply ruff E501 line-too-long linter rule (#8275)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
takatost 56c90e212a
fix(workflow): missing content in the answer node stream output during iterations (#8292)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
Bowen Liang 0f14873255
chore: cleanup ruff flake8-simplify linter rules (#8286)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
Bowen Liang 2cf1187b32
chore(api/core): apply ruff reformatting (#7624) 2 years ago
Jyong af92f19291
filter excel empty sheet (#8194) 2 years ago
Nam Vu 2d7954c7da
Fix variable typo (#8084) 2 years ago
Jyong 01581dd35f
improve the notion table extract (#7925) 2 years ago
Jyong 6f33351eb3
ignore linked images when image id is none (#7890) 2 years ago
Bowen Liang ccb6ddd840
chore: bump Ruff to 0.5.7 (#7174) 2 years ago
Jyong 12095f8cd6
extract docx filter comment element (#7092) 2 years ago
chenxu9741 72c75b75cf
feat: Add hyperlink parsing to the DOCX document. (#7017) 2 years ago
yanghx c53875ce8c
fix #6902 .docx handles images within tables and handles cross-column tables (#6951) 2 years ago
Jyong cf258b7a67
add xlsx support hyperlink extract (#6722) 2 years ago
Yeuoly 79cb23e8ac
security/SSRF vulns (#6682) 2 years ago
灰灰 5e4ac11df3
fix: code block segmentation problem of markdown document (#6465) 2 years ago
Poorandy c8f5dfcf17
refactor(rag): switch to dify_config. (#6410)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2 years ago
tangyoha 0cbbaf3f68
fix: markdown proc will remove image (#5855) 2 years ago
Matri a9ee52f2d7
Fix/firecrawl parameters issue (#6213) 2 years ago
Aurelius Huang f546db5437
fix: document truncation and loss in notion document sync (#5631)
Co-authored-by: Aurelius Huang <cm.huang@aftership.com>
2 years ago
Jyong 43335b5c87
delete the deprecated method (#5612) 2 years ago
Bowen Liang 39c14ec7c1
improve: unify Excel files parsing in either xls or xlsx file format by Pandas (#4965) 2 years ago