Commit Graph

2582 Commits (37c534df212eefc0e6717c81635ef485478ca4b6)

Author SHA1 Message Date
yunqiqiliang 37c534df21
Merge 18230d12f9 into bd43ca6275 11 months ago
Yeuoly 9237976988
fix: refine handling of constant and mixed input types in ToolManager and ToolNodeData (#22903) 11 months ago
呆萌闷油瓶 371fe7a700
fix: type error in list-operator (#22803) 11 months ago
Will a327d024e9
fix: improved conversation name (#22840) 11 months ago
jiangbo721 5a02e599e1
chore: code format model-selector use enum (#22787)
Co-authored-by: 刘江波 <jiangbo721@163.com>
11 months ago
Asuka Minato ef51678c73
orm filter -> where (#22801)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Claude <noreply@anthropic.com>
11 months ago
wanttobeamaster 8278b39f85
fix tablestore full text search bug (#22853) 11 months ago
wanttobeamaster 1c3c40db69
fix: tablestore TypeError when vector is missing (#22843)
Co-authored-by: xiaozhiqing.xzq <xiaozhiqing.xzq@alibaba-inc.com>
11 months ago
wlleiiwang b4e152f775
FEAT: Tencent Vector search supports backward compatibility with the previous score calculation approach. (#22820)
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
11 months ago
Junyan Qin (Chin) eaae79a581
feat: plugin auto upgrade strategy (#19758)
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Novice <novice12185727@gmail.com>
11 months ago
-LAN- 6b544aa0b9
feat: decouple WorkflowAppRunner from AppRunner (#21739)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
crazywoola 60c37fe492
Added a check to ensure the input `text` is a string before proceeding with parsing (#22809)
Co-authored-by: -LAN- <laipz8200@outlook.com>
11 months ago
Maries ad67094e54
feat: oauth refresh token (#22744)
Co-authored-by: Yeuoly <admin@srmxy.cn>
11 months ago
Asuka Minato 6d3e198c3c
Mapped column (#22644)
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
11 months ago
呆萌闷油瓶 5c7f0a533a
fix: #22784 (#22795) 11 months ago
Will 095bae01b2
fix: Invalid expected metadata value type error (#22793) 11 months ago
wanttobeamaster a2048fd0f4
fix: tablestore vdb support metadata filter (#22774)
Co-authored-by: xiaozhiqing.xzq <xiaozhiqing.xzq@alibaba-inc.com>
11 months ago
qfl 841e53dbbe
feat(trace): support external trace id propagation (#22623)
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
11 months ago
Novice e9c9c5d8f1
fix: single step node execution init error (#22764)
LGTM
11 months ago
Junyan Qin (Chin) 2d8eace34b
feat: plugin deprecation notice (#22685)
Co-authored-by: Wu Tianwei <30284043+WTW0313@users.noreply.github.com>
Co-authored-by: twwu <twwu@dify.ai>
11 months ago
issac2e 58d92970a9
Optimize tencent_vector knowledge base deletion error handling with batch processing support (#22726)
Co-authored-by: liuchen15 <liuchen15@gaotu.cn>
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
jiangbo721 e9893f1518
chore: use 'json_list' instead of 'json' to prevent ambiguity (#22739)
Co-authored-by: 刘江波 <jiangbo721@163.com>
11 months ago
Will 29f0a9ab94
Fix incorrect mcp method_name (#22736) 11 months ago
-LAN- 62b29b3d76
feat: update file manager and file factory implementations (#22704)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Claude <noreply@anthropic.com>
11 months ago
uply23333 ab012fe1a2
fix: improve document filtering in full text search(elasticsearch) (#22683) 11 months ago
8bitpd 9251a66a10
fix: update analyticdb vector to do filter by metadata (#22698)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
11 months ago
quicksand d45e48eed7
fix: knowledge retrieval validation error (#22682) 11 months ago
Bowen Liang 74940ad3f2
chore: code improvement for mcp_client and mcp_tools_manage_service (#22645) 11 months ago
Novice 17a8f1a0f1
fix: avoid using node_data.version for judgement tool node version (#22462)
Co-authored-by: JzoNg <jzongcode@gmail.com>
11 months ago
Aryan Raj ce794335e9
Fix/replace datetime patterns with naive utc now (#22654) 11 months ago
yunqiqiliang 18230d12f9 Auto-format: Fix code style for CI compliance
🤖 Automated formatting applied by CI test script
- Ensures 100% compliance with Python style guidelines
- No functional changes, only formatting improvements

Generated by: run_complete_ci_test.sh
11 months ago
yunqiqiliang c3851595d0 Fix MyPy type checking errors in ClickZetta vector implementation
- Add proper type annotations for Connection from clickzetta module
- Implement _ensure_connection() method to handle None connection checks
- Fix all database cursor access patterns to use proper null checking
- Add type annotation for result queue in _execute_write method
- Resolve factory method configuration issues with None value handling

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago
yunqiqiliang f57fa13f1b fix: resolve CI linting issues and add missing newlines
- Fix all line length issues (120 character limit)
- Remove all trailing whitespace
- Add missing newlines at end of files
- Add CLICKZETTA_VOLUME_DIFY_PREFIX environment variable to docker-compose.yaml
- Ensure proper code formatting for all ClickZetta files

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago
yunqiqiliang 2de316c557 feat: add ClickZetta Volume storage support
- Add three volume types: User, Table, and External Volume
- Complete file operations: upload, download, delete, list, stream
- Intelligent configuration management with fallback to vector DB settings
- Simplified user experience with 'user' as default volume type
- Comprehensive error handling and logging
- Docker integration with updated compose files
- Integration tests for all volume types
- Disabled complex permission checking for stability

🎯 Features:
- User Volume: Personal/small team use, simple configuration
- Table Volume: Enterprise multi-tenant with smart routing
- External Volume: Data lake integration with external storage
- Flexible configuration with environment variable support
- Complete file lifecycle management

🔧 Technical:
- Reuses existing ClickZetta connection configuration
- Pydantic-based configuration validation
- Comprehensive error handling and logging
- Performance-optimized with connection reuse
- Clean integration with Dify's storage architecture

🚀 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago
kurokobo a93db6d797
fix: correct tracing for workflows and chatflows for phoenix (#22547) 11 months ago
znn ed263aed9f
fix text splitter (#22596) 11 months ago
-LAN- 1f9cd99bc2
refactor: elegant event dispatch patterns (92% complexity reduction) (#22600)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Claude <noreply@anthropic.com>
11 months ago
-LAN- 460a825ef1
refactor: decouple Node and NodeData (#22581)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
11 months ago
-LAN- 1715dd4320
refactor: Fix some type error (#22594)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
-LAN- b88dd17fc1
feat(workflow_cycle_manager): Removes redundant repository methods and adds caching (#22597)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
helojo e7d80bf7bf
Fix: the pict type picture was not processed in the docx (#19305)
Co-authored-by: zqgame <zqgame@zqgame.local>
11 months ago
yunqiqiliang 8e707cace9 Fix recall testing and search functionality for ClickZetta integration
- Fix double JSON encoding issue in metadata parsing for all search methods
- Remove unnecessary dataset_id filters since each dataset has its own table
- Add robust metadata parsing with fallback for JSON decode errors
- Ensure document_id is always present for Dify's format_retrieval_documents
- Clean up debug logging while preserving essential error logs
- Support vector search, full-text search, and hybrid search in recall testing

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago
Kalo Chin 7a69b57823
Fix jinja2 variable naming inconsistencies (#22578) 11 months ago
yunqiqiliang fcf8387f52 Fix SQL statement length issues and improve batch processing
- Add SQL length monitoring and automatic batch splitting
- Reduce default batch size from 100 to 20 to prevent large SQL statements
- Add detailed error logging for SQL execution failures
- Implement recursive batch splitting for oversized SQL statements
- Set 1MB limit for SQL statement length

This resolves issues where large batches create SQL statements that
exceed database limits, causing vector insertion failures.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago
yunqiqiliang 8dea8766e9 Fix document content special characters causing SQL syntax errors
- Add specialized document content cleaning function
- Handle backticks, quotes, newlines, and control characters properly
- Replace problematic characters instead of just escaping them
- Normalize whitespace and remove control characters
- Fix "Syntax error at or near" issues from document content like shell commands

This resolves SQL syntax errors when documents contain shell scripts,
code snippets, or other text with special formatting characters.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago
yunqiqiliang f116407045 Fix SQL injection vulnerabilities and character encoding issues
- Enhanced string escaping for SQL safety (backslashes, newlines, tabs)
- Added safe JSON formatting with ensure_ascii=True
- Implemented safe doc_id validation (alphanumeric + hyphens/underscores only)
- Protected all user input: document content, metadata, IDs, search queries
- Fixed potential SQL syntax errors from special characters in document content

This addresses "Syntax error at or near 'files'" errors that occur when
document content or metadata contains special characters that break SQL syntax.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago
yunqiqiliang 9c2bf2b30f Fix SQL syntax errors with vector formatting
- Add safe vector formatting function to handle special float values
- Handle NaN, infinity values in vector embeddings
- Prevent SQL syntax errors from malformed VECTOR() statements
- Use consistent vector formatting across all SQL operations

This fixes "Syntax error at or near '{'" errors that occur when
vector embeddings contain special float values during knowledge
base construction.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago
yunqiqiliang 1b7603deb1 Fix inverted index duplicate creation issue
- Add table existence check before creating indexes
- Improve error handling for ClickZetta specific error messages
- Remove duplicate _table_exists method definition
- Prevent high-frequency index creation attempts during bulk operations

This fixes the "already has index with the same type" errors during
large knowledge base construction with 600+ documents.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago
Maries a4ef900916
Support OAuth Integration for Plugin Tools (#22550)
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
11 months ago
yunqiqiliang c4d9e5c69f Add documentation section and clean up formatting
- Add clear section header for ClickZetta configuration
- Improve code organization and readability
- All lint checks should pass with latest fixes

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
11 months ago