14 Commits

Author SHA1 Message Date
f8ada15e2a feat(components): Add IBM DB2 Vector Store component (#13237)
* feat(ibm): add DB2 Vector Store component

Add comprehensive IBM DB2 Vector Store integration for Langflow.

Components Added:
- DB2VectorStoreComponent: Main vector store component
- DB2VS: LangChain-compatible vector store implementation
- DB2 security validators: Input validation and sanitization

Features:
- Vector similarity search (Similarity, MMR, Similarity Score Threshold)
- Secure connection handling with input validation
- Metadata filtering for complex data types
- Duplicate detection support
- Batch document ingestion

Test Coverage:
- 41 unit tests (38 passing, 3 skipped)
- Component integration tests
- Security validation tests
- DB2VS class tests

Documentation:
- Comprehensive developer guidelines

* refactor(db2): simplify component to match Chroma patterns

- Remove complex data ingestion (CSV, DataFrame, dict, Message handling)
- Add _add_documents_to_vector_store() method matching Chroma
- Add similarity_score_threshold search type
- Simplify data ingestion from 220 to 45 lines (80% reduction)
- Add 5 new tests (similarity_search, mmr_search, search_with_different_types, duplicate_handling, metadata_filtering)
- All 41 tests passing (38 passed, 3 skipped)

BREAKING CHANGE: Component now only accepts Data objects for ingestion.

* ci: fix CI failures - update component index and starter projects

- Regenerate component_index.json with DB2 component
- Update all starter projects with new component registry
- Fix ruff formatting issues

* ci: trigger CI re-run to fix merge issue

* ci: add merge conflict resolution for component_index.json in autofix workflow

Handle merge conflicts in the Update Component Index job by:
- Automatically resolving component_index.json conflicts using --theirs strategy
- Failing if non-generated files have conflicts (requires manual resolution)
- Completing the merge after resolving generated file conflicts

This prevents the workflow from failing when component_index.json has conflicts
during PR updates, as this file is auto-generated and can be safely regenerated.

* fix: Remove DB2SQLComponent reference from IBM components

- Removed DB2SQLComponent from __init__.py as the db2_sql.py module doesn't exist
- This fixes the test_all_modules_importable test failure
- Fixes CI failure in Unit Tests - Python 3.14 - Group 5

* revert: Remove unrelated starter project JSON changes

* revert: Remove unrelated CI workflow and formatting changes

* docs: add DB2 Vector Store .mdx documentation following Chroma DB structure

* fix: address CodeRabbit review comments - add __init__.py docstring and implement score threshold filtering

- Added docstring to src/backend/tests/unit/components/__init__.py to fix Ruff INP001 error
- Added FloatInput score_threshold parameter (default 0.5) to DB2 Vector Store component
- Implemented threshold filtering in similarity_score_threshold search mode
- Filters results to only include documents with relevance scores >= threshold

* chore: remove auto-generated and unnecessary files from PR

- Remove uv.lock (dependency lock file - auto-generated)
- Remove src/frontend/package-lock.json (frontend lock file - auto-generated)
- Remove src/lfx/src/lfx/_assets/component_index.json (auto-generated by CI)
- Remove .secrets.baseline (security baseline - auto-generated)
- Remove starter_projects JSON (auto-generated example)
- Remove tweaks_builder.py (unrelated test helper)

Per DEVELOPMENT.md guidelines, these files should not be committed by contributors.

* chore: restore auto-generated files to keep PR focused on DB2 component

* fix(ci): update auto-generated files and fix docs build

- Update component index with new IBM DB2 components (363 components, 97 modules)
- Update frontend package-lock.json
- Fix docs build by removing reference to missing image in bundles-db2.mdx

Fixes CI failures:
- Update Component Index
- Update Starter Projects
- Test Docs Build

* feat(db2): add SSL/TLS support to DB2 Vector Store component

- Add SSL/TLS encryption support for DB2 database connections
- Add SSL certificate validation and download functionality
- Support local certificate files (.crt, .pem, .cer) and URLs
- Add optional certificate password support for encrypted keystores
- Implement automatic cleanup of temporary downloaded certificates
- Add comprehensive error handling and logging for SSL connections
- Update component_index.json with new SSL configuration inputs
- Update package-lock.json dependencies

Security improvements:
- Validate certificate paths and file permissions
- Support system default CA certificates (recommended for IBM Cloud DB2)
- Redact sensitive information in error messages
- Clean up temporary files on connection failure

This enhancement enables secure encrypted connections to DB2 databases,
which is recommended for production environments.

* [autofix.ci] apply automated fixes

* refactor(db2): minimize metadata storage in DB2 vector store

- Clear metadata before storage to reduce unnecessary data (file_path, filename, etc.)
- Return only text content during retrieval for cleaner results
- Optimize list comprehension for better performance (PERF401, RET504)

* test: remove skipped tests from DB2 vector store test suite

- Removed version compatibility tests for versions where component didn't exist
- Changed file_names_mapping to return empty list for new component
- Overrode base class version tests to prevent skips
- Fixed linting issues (hardcoded passwords, nested with statements)
- All 40 tests now pass with 0 skipped tests

* fix(tests): update DB2 vector store test description format

Fixes test_component_metadata assertion to match the actual component
description format. The test was failing due to line wrapping differences
in the multi-line description string.

Fixes CI failure in PR #13163

* [autofix.ci] apply automated fixes

* chore: trigger CI re-run to resolve flaky test failures

* fix(tests): mark OpenAI-dependent test as api_key_required to prevent CI failures

* restructure as new bundle package

* [autofix.ci] apply automated fixes

* fix(ibm): improve DB2 Vector Store component reliability and validation

* fix: implement SSL/TLS toggle functionality for DB2 Vector Store

- Add update_build_config method to dynamically show/hide SSL certificate fields
- SSL certificate path and password fields now only visible when use_ssl is enabled
- Improves UX by hiding irrelevant fields when SSL is disabled
- Update component_index.json with new component configuration
- All 38 existing tests pass

---------

Co-authored-by: Dhruv Chaturvedi <dhruv_insights@mac.lkw-in.ibm.com>
Co-authored-by: Dhruv Chaturvedi <dhruv_insights@Dhruvs-MacBook-Pro.local>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: priyanshu-krishnan1 <priyanshu.krishnan1@ibm.com>
Co-authored-by: Eric Hare <ericrhare@gmail.com>
2026-05-29 02:58:30 +00:00
19df4606ae chore: update deps (#12657)
* chore: update deps

update deps due to sec vuln

* chore: langchain-core>=1.2.28

langchain-core>=1.2.28

* chore: update pypdf

pypdf 6.10

* chore: pyarrow, openai, litellm, mem0ai, toolguard

picomatch, pyarrow, openai, litellm, mem0ai, toolguard

* chore: override litellm

* chore: match base uv.lock to root

* chore: update tool.uv position

update tool.uv position

* chore: langflow-base[complete]>=0.9.0

langflow-base[complete]>=0.9.0

* chore: revert pyarrow

revert pyarrow

* chore: revert "lfx~=0.4.0",

* chore: lfx white space

* chore: remove allow-direct-references = true

* chore: uv lock --upgrade after merge
2026-04-13 23:23:37 +00:00
b09b3ebae6 chore: update deps due to security vulnerabilities (#12371)
* chore: update deps due to security vulnerabilities

update deps due to security vulnerabilities found by mend scan done by openrag team

* chore: run npm audit fix

run npm audit fix

* chore: safe uv audit changes

safe uv audit changes

* chore: safe 2

safe 2

* chore: safe upgrades 3
safe upgrades 3

* chore: pin "langgraph-checkpoint>4.0.0,<5.0.0",

pin "langgraph-checkpoint>4.0.0,<5.0.0",
2026-03-27 23:40:12 +00:00
da6f29e37a feat: agentic UX (#10567)
* Add empty __init__.py files for agentic modules

Created empty __init__.py files in agentic, core, tools, and utils directories to initialize them as Python packages.

* Add agentic template search utilities and tests

Introduces a new agentic utilities module for Langflow, including template search, tag extraction, and template count functions. Adds a README, demo script, and comprehensive unit tests for template search functionality.

* Add Langflow Agentic MCP server with FastMCP tools

Introduces a new MCP (Model Context Protocol) server for Langflow agentic tools using FastMCP. Adds server, CLI, example usage, tests, and comprehensive documentation. Exposes four MCP tools: search_templates, get_template, list_all_tags, and count_templates, enabling AI assistants to query and filter Langflow templates programmatically.

* Handle unparameterized list types in schema inputs

Adds support for unparameterized list annotations by treating them as lists of strings when converting schemas to Langflow inputs. This ensures nullable array schemas without explicit item types are handled gracefully.

* Refactor search_templates to simplify parameters

Removed the 'tags' parameter from the search_templates function and set a default value for 'fields'. Updated the call to list_templates to match the new signature, streamlining template search functionality.

* Add output item processing for tool results

Introduced process_output_item to handle tool output items, attempting to parse text-type items as JSON. This improves downstream handling of tool outputs by converting JSON strings to dictionaries when possible.

* Refactor knowledge base path initialization

Replaces direct settings access with a lazy-loading function for the knowledge bases root path in Knowledge Ingestion and Knowledge Retrieval starter projects. This improves reliability and consistency when accessing the knowledge base directory, and updates all usages to the new helper function.

* Update component_index.json

* Add IBM watsonx.ai support to starter projects

Introduces IBM watsonx.ai as a selectable model provider in multiple starter project JSONs. Adds new input fields for 'base_url', 'project_id', and 'max_output_tokens' to support IBM watsonx.ai integration. Updates agent component code to handle new provider and its required parameters.

* Add Ollama to supported LLM providers in starter projects

Ollama has been added as a supported provider alongside Anthropic, Google Generative AI, OpenAI, and IBM watsonx.ai in all starter project JSON files. This expands the available options for LLM integration in initial setup templates.

* Update Ollama model input constants and logic

Refactored model_input_constants.py to update the OLLAMA_MODEL_INPUTS and OLLAMA_MODEL_INPUTS_MAP. Modified ollama.py to use the new input mapping and improved input handling for Ollama components.

* Add flow creation from template MCP tool

Introduces a new MCP tool for creating flows from starter templates in Langflow Agentic. Adds the utility function `create_flow_from_template_and_get_link` and exposes it via the FastMCP server, allowing users to create flows by template id and receive a UI link. Updates imports and documentation accordingly.

* Add component search utilities and MCP tools to server

Introduces new component search and retrieval tools to the MCP server, including endpoints for searching, listing, and counting components. Adds support functions in support.py for data normalization and a new component_search.py utility module. Updates the Nvidia Remix starter project to use the latest MCPToolsComponent code.

* Add flow graph visualization utilities

Introduces async utility functions for generating ASCII and text representations of flow graphs, as well as metadata summaries. These utilities support fetching flows by ID or name, error handling, and integration with Langflow's graph and logging modules.

* Add flow component operations utilities and MCP tools

Introduces flow component management utilities in `flow_component.py` for retrieving, updating, and listing component field values. Exposes new MCP tools in `server.py` for accessing component details, field values, updating fields, and listing all fields within a flow component.

* Add SystemMessageGen flow and update MCPTools

Introduces SystemMessageGen.json flow for agentic system message generation and updates MCPTools component logic in flow_component.py to support new flow structure and tool handling.

* feat: init aiButton

create an aiButton that opens the prompt modal for demoing
add multiinput mixin

* Update component_index.json

* Refactor SystemMessageGen flow and remove unused init files

Updated SystemMessageGen.json to support custom instructions, OpenAI model configuration, and improved agent settings. Removed unused __init__.py files from agentic, core, tools, and utils directories to clean up the codebase.

* update to the mcp component

* Add verify_ssl option to MCPToolsComponent

Introduces a 'verify_ssl' boolean input to MCPToolsComponent for controlling SSL certificate verification in HTTPS connections. The option is added to the server config if not present, allowing users to disable verification for development or testing with self-signed certificates.

* Optimize tool dropdown handling and output processing

Improves logic for updating tool dropdown options by checking if the server has changed and whether tool mode is active, reducing unnecessary updates. Adds a process_output_item method to parse tool output as JSON when appropriate, enhancing output handling.

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* [autofix.ci] apply automated fixes (attempt 3/3)

* feat: init onclick assistant prompt generation

first pass at on button click generate input and auto fill a field

* Replace MCPTools with Prompt Template in SystemMessageGen flow

Updated the SystemMessageGen.json flow to use the Prompt Template and Parser components instead of MCPTools. Adjusted edges, nodes, and component configurations to reflect the new prompt-based workflow, removing tool selection and execution logic in favor of prompt generation and parsing.

* Update SystemMessageGen flow and frontend dependencies

Refactored edge connections and metadata in SystemMessageGen.json to improve flow logic and updated endpoint name. Added new optional and peer dependencies to package-lock.json, including @mapbox/node-pre-gyp and related packages, to support canvas and other modules.

* Update user authentication in simplified_run_flow endpoint

Replaces the dependency on api_key_security with CurrentActiveUser for the api_key_user parameter in the simplified_run_flow endpoint. This change is part of a TODO to create a new endpoint and may affect how user authentication is handled.

* feat: hook everything up and have onclick prompt

hook up commit

* Add auto-configuration for Agentic MCP server

Introduces utilities and startup logic to automatically configure the Langflow Agentic MCP server for all users when the agentic experience is enabled. Adds a new settings flag `agentic_experience` to control this feature, and updates the main server startup to trigger configuration. This enables agentic tools for flow/component operations, template search, and graph visualization in MCP clients.

* Enable agentic MCP server and improve initialization

Set agentic_experience to True by default in settings. Refactor agentic MCP server initialization in main.py to run in the background with a delay and retry logic, improving startup reliability. Update function calls to use 'current_user' instead of 'user' in agentic_mcp.py for consistency.

* Update user authentication in simplified_run_flow

Modified the api_key_user parameter to accept either CurrentActiveUser or UserRead from api_key_security, supporting both Bearer and session authentication methods.

* revert the apikeu_user changes

* test new api endpoint

* Refactor agent flow and update component inputs

Updated SystemMessageGen.json to refactor edge connections and node IDs for agentic flow. Added 'base_url' as a required input, enabled 'ai_enabled' for agent description, and replaced static memory input handling with dynamic retrieval via get_base_inputs(). Also improved tool callback setup and updated code hash and last_updated metadata.

* Improve agentic flow creation and updating logic

Enhances the agentic flow setup to extract flow_id and endpoint_name from JSON, update existing flows by ID or endpoint_name, and create new flows if they don't exist. Adds detailed logging and ensures flows are up-to-date in the user's Langflow Assistant folder.

* chore: aibutton clean up

* chore: add assistant store

* Update SystemMessageGen.json

* Update agentic_mcp.py

* Update component_index.json

* Fix agent input extraction from Message objects

Agents now correctly extract and use the text content from Message objects, rather than passing the entire object or its string representation. This resolves issues where agents received verbose message representations instead of just the intended string input, and includes improved handling for multimodal content. Corresponding unit and integration tests have been added to verify this behavior for both OpenAI and Anthropic agents.

* Add TemplateAssistant Langflow flow definition

Introduces TemplateAssistant.json, a comprehensive Langflow flow configuration for agentic workflows. This flow integrates AstraDB, MCP Tools, and user input/output nodes, enabling document ingestion, search, and tool orchestration within the Langflow backend.

* Improve MCPToolsComponent server/tool config refresh

Refactored MCPToolsComponent to better handle tool and server config refreshes, especially when the MCP server changes. Added logic to avoid unnecessary clearing of tool inputs and options, and improved caching and UI update behavior for tool selection. Also updated related flow and starter project JSON files to reflect these changes.

* auto add Global Variables for Agentic Experience

* chore: clean up and get button working again

* cleanup .md

* fix:ruff, Refactor agentic utils and improve error handling

Introduces shared default field lists for template/component search, refactors exception handling to use logger and add finally/else blocks, and improves type hinting with TYPE_CHECKING. Updates file opening to use Path objects, enhances error logging in template search, and removes the unused test_template_search.py file.

* fix:ruff Expand exception handling in agentic MCP utilities

Broadened exception handling in agentic MCP server and variable management functions to catch specific errors such as HTTPException, SQLAlchemyError, and common system exceptions. This improves robustness and error logging during server configuration, removal, and variable initialization.

* aka-clean-up-1

* Remove duplicate process_output_item method

Deleted two redundant definitions of the process_output_item method from MCPToolsComponent to clean up the code and prevent confusion.

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* [autofix.ci] apply automated fixes (attempt 3/3)

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* [autofix.ci] apply automated fixes

* Refactor service usage and improve project deletion logging

Refactored login API to reuse a single settings service instance. Enhanced logging and error messaging when attempting to delete the Langflow Assistant folder. Minor variable usage cleanup in agentic flows setup and agent component test.

* [autofix.ci] apply automated fixes (attempt 2/3)

* Update test_template_search.py

* Handle specific exceptions in agentic flow loading

Updated the exception handling in load_agentic_flows to catch only OSError and orjson.JSONDecodeError instead of all exceptions, improving error specificity and logging.

* Update component_index.json

* [autofix.ci] apply automated fixes

* revert loading setting service

* Update login.py

* Update SystemMessageGen.json

* Update TemplateAssistant.json

* [autofix.ci] apply automated fixes

* Update constants.py

* chore: seperate templateassistant and sysmessgen

seperate templateassistant and sysmessgen frontend queries

* chore: add header feature flag

* use feature flag for all ui

* [autofix.ci] apply automated fixes

* package-lcok update

* [autofix.ci] apply automated fixes

* chore: LANGFLOW_AGENTIC_EXPERIENCE fe ff name

* Update login.py

* lint fix

* [autofix.ci] apply automated fixes

* Update component_index.json

* chore: fix adjust-screan-view click

* chore: same force issue as adjust-screen-view

* chore: playwright pass 2

* revert package-lock

* add type to langflow_modules

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes

* Handle TypeError in class-based serialization

Adds a try-except block to catch TypeError when checking issubclass for objects that are types but not proper classes, such as typing special forms. This prevents serialization errors for generic aliases and similar constructs.

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* Refactor type handling in field update and serialization

Changed 'new_value' parameter type to str in update_flow_component_field for stricter typing. Simplified exception handling in serialize by removing unnecessary try/except around issubclass checks for class-based Pydantic types.

---------

Co-authored-by: Adam Aghili <Adam.Aghili@ibm.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-11-24 02:02:01 +00:00
99fc2cf068 feat: adds streamable http instead of sse on mcp client (#10157)
* Changed SSE to Streamable_HTTP implementation on backend

* Changed SSE to Streamable HTTP on frontend

* [autofix.ci] apply automated fixes

* Added support for SSE as a fallback

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* added /sse

* updated code

* created test to test streamable http

* Test SSE fallback on HTTP/SSE tab

* Changed nvidia remix starter project

* [autofix.ci] apply automated fixes

* Added changes for backwards compatibility

* fixed issues on mcp util

* [autofix.ci] apply automated fixes

* Fixed tests to have a helper to initialize server, with health check

* updated package lock

* fixed backend tests

* fixed backend test

* [autofix.ci] apply automated fixes

* format imports

* fixed backend test

* fixed frontend tests

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* changed http to streamable http

* [autofix.ci] apply automated fixes

* fixed mcp util test

* fixed test

* ruff fix

* wait timeout on mcp server test

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-10-07 21:20:40 +00:00
56f13c918b Reorganize repo (#1971)
* chore: Update dockerfile paths and branch name in render.yaml and release.yml

* chore(readthedocs.yaml): remove .readthedocs.yaml file as it is no longer needed
chore(base.Dockerfile): remove base.Dockerfile as it is no longer used in the project
feat(cdk-docker-compose.yml): add cdk-docker-compose.yml file to set up docker-compose for backend and frontend services

* move dockerignore

* chore: Remove test-results/.last-run.json file

* chore: Cache Node.js dependencies during workflow execution

* chore: Remove npm cache from workflow and cache Node.js dependencies

* chore: Update shardIndex and shardTotal values in typescript_test.yml workflow

* chore: Update Playwright test command with shard and worker options
2024-05-27 06:55:32 -07:00
93df6b0a8b Added combobox and command 2023-11-16 10:46:29 -03:00
3c4db074e4 🔧 fix(base.py): update BASE_COMPONENTS_PATH to point to the correct directory
🔧 fix(base.py): improve readability by removing commented out code and adding line breaks
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and indentation
🔧 fix(base.py): improve readability by adding line breaks and
2023-08-17 19:30:46 +01:00
46aa816ba9 run npm install 2023-08-16 18:22:42 -03:00
1ff7dca09e feat: Add remaining icons (Slack, Wikipedia and Wolfram) 2023-07-18 18:21:03 -03:00
49c0319e91 fix(src/icons): use lib to fix svg import error 2023-07-12 18:14:12 -03:00
8d03db2834 removing package.json from root folder 2023-06-08 16:24:44 -03:00
56ca610a79 Starting migration to shadUI 2023-06-01 21:09:50 -03:00
9053eb81a0 package-lock.json update 2023-04-25 16:36:11 -03:00