DataFrame operations​
This component performs operations on DataFrame rows and columns.
To use this component in a flow, connect a component that outputs DataFrame to the DataFrame Operations component.
-This example fetches JSON data from an API. The Lambda filter component extracts and flattens the results into a tabular DataFrame. The DataFrame Operations component can then work with the retrieved data.
+This example fetches JSON data from an API. The Smart function component extracts and flattens the results into a tabular DataFrame. The DataFrame Operations component can then work with the retrieved data.
- The API Request component retrieves data with only
sourceandresultfields. For this example, the desired data is nested within theresultfield.
- - Connect a Lambda Filter to the API request component, and a Language model to the Lambda Filter. This example connects a Groq model component. +
- Connect a Smart function to the API request component, and a Language model to the Smart function. This example connects a Groq model component.
- In the Groq model component, add your Groq API key. -
- To filter the data, in the Lambda filter component, in the Instructions field, use natural language to describe how the data should be filtered. +
- To filter the data, in the Smart function component, in the Instructions field, use natural language to describe how the data should be filtered. For this example, enter:
_10I want to explode the result column out into a Data object
tip
Avoid punctuation in the Instructions field, as it can cause errors.
-
-
- To run the flow, in the Lambda Filter component, click . -
- To inspect the filtered data, in the Lambda Filter component, click . +
- To run the flow, in the Smart function component, click . +
- To inspect the filtered data, in the Smart function component, click . The result is a structured DataFrame.
_10id | name | company | username | email | address | zip_10---|------------------|----------------------|-----------------|------------------------------------|-------------------|-------_101 | Emily Johnson | ABC Corporation | emily_johnson | emily.johnson@abccorporation.com | 123 Main St | 12345_102 | Michael Williams | XYZ Corp | michael_williams| michael.williams@xyzcorp.com | 456 Elm Ave | 67890
_10| text | data |_10|:--------------------------------|:---------------------------------------------------------------------|_10| Kalani Smith - Employee Profile | {'Name': 'Kalani Smith', 'Role': 'Designer', 'Department': 'Design'} |
Parameters
Inputs
| Name | Display Name | Info |
|---|---|---|
| data_list | Data or Data List | One or multiple Data objects to transform into a DataFrame. |
Outputs
| Name | Display Name | Info |
|---|---|---|
| dataframe | DataFrame | A DataFrame built from each Data object's fields plus a text column. |
Lambda filter​
+Smart function​
This component uses an LLM to generate a Lambda function for filtering or transforming structured data.
-To use the Lambda filter component, you must connect it to a Language Model component, which the component uses to generate a function based on the natural language instructions in the Instructions field.
+To use the Smart function component, you must connect it to a Language Model component, which the component uses to generate a function based on the natural language instructions in the Instructions field.
This example gets JSON data from the https://jsonplaceholder.typicode.com/users API endpoint.
-The Instructions field in the Lambda filter component specifies the task extract emails.
+The Instructions field in the Smart function component specifies the task extract emails.
The connected LLM creates a filter based on the instructions, and successfully extracts a list of email addresses from the JSON data.
Parameters
Inputs
| Name | Display Name | Info |
|---|---|---|
| data | Data | The structured data to filter or transform using a Lambda function. |
| llm | Language Model | The connection port for a Model component. |
| filter_instruction | Instructions | The natural language instructions for how to filter or transform the data using a Lambda function, such as Filter the data to only include items where the 'status' is 'active'. |
| sample_size | Sample Size | For large datasets, the number of characters to sample from the dataset head and tail. |
| max_size | Max Size | The number of characters for the data to be considered "large", which triggers sampling by the sample_size value. |
Outputs
| Name | Display Name | Info |
|---|---|---|
| filtered_data | Filtered Data | The filtered or transformed Data object. |
| dataframe | DataFrame | The filtered data as a DataFrame. |
Select data​
important
This component is in Legacy, which means it is available for use but no longer in active development.
This component selects a single Data item from a list.
-Parameters
Inputs
| Name | Display Name | Info |
|---|---|---|
| data_list | Data List | List of data to select from |
| data_index | Data Index | Index of the data to select |
Outputs
| Name | Display Name | Info |
|---|---|---|
| selected_data | Selected Data | The selected Data object. |