Non‑nullable fields may reject NULLs from the pipe.

workspace_id, domain, key are non‑nullable. If upstream join/coalesce yields NULL, inserts will fail. Either (a) make these columns Nullable, or (b) guarantee non‑NULLs in the pipe (see suggested fallbacks in dub_lead_events_pipe.pipe).

Option A (make columns nullable):

-    `workspace_id` LowCardinality(String),
+    `workspace_id` LowCardinality(Nullable(String)),
-    `domain` String,
-    `key` String,
+    `domain` Nullable(String),
+    `key` Nullable(String),

Option B (keep non‑nullable): keep schema as‑is and adopt the pipe changes proposed earlier.

Also applies to: 11-15, 41-41

🏁 Script executed:

#!/bin/bash
# Locate and examine the datasource file
find . -name "dub_lead_events_mv.datasource" -type f 2>/dev/null | head -5

Length of output: 61

🏁 Script executed:

#!/bin/bash
# Locate and examine the pipe file
find . -name "dub_lead_events_pipe.pipe" -type f 2>/dev/null | head -5

Length of output: 51

🏁 Script executed:

#!/bin/bash
# Search for related files in tinybird datasources directory
fd -e datasource -e pipe . packages/tinybird/ 2>/dev/null | grep -E "(dub_lead|event)" | head -20

Length of output: 1066

🏁 Script executed:

#!/bin/bash
# Examine the datasource schema file
cat packages/tinybird/datasources/dub_lead_events_mv.datasource

Length of output: 1150

🏁 Script executed:

#!/bin/bash
# Examine the pipe file
cat packages/tinybird/pipes/dub_lead_events_pipe.pipe

Length of output: 1493

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Nullability mismatch between raw and MV can break ingestion.

Raw source defines workspace_id/domain/key as Nullable(String); MV has non-nullable String/LowCardinality(String). Inserts with NULLs will fail unless the pipe coerces to ''. Align schemas or coalesce in the pipe.

Option A — align MV schema:

-    `workspace_id` LowCardinality(String),
+    `workspace_id` LowCardinality(Nullable(String)),
-    `domain` String,
+    `domain` Nullable(String),
-    `key` String,
+    `key` Nullable(String),

Option B — keep MV non-nullable and coalesce upstream:

-- In the MV-building pipe
COALESCE(workspace_id, '') AS workspace_id,
COALESCE(domain, '') AS domain,
COALESCE(`key`, '') AS `key`,

Please confirm which approach you prefer; I can propose a full diff once chosen.

Also applies to: 17-19, 28-41

I'll help you verify this review comment by examining the datasource files and checking for the nullability mismatch. Let me start by exploring the codebase.

---

🏁 Script executed:

```shell
#!/bin/bash
# Find datasource files related to dub_sale_events
fd -e datasource | grep -i "dub_sale_events"

Length of output: 116

🏁 Script executed:

#!/bin/bash
# List all files in the tinybird datasources directory
fd . packages/tinybird/datasources --type f | head -20

Length of output: 786

🏁 Script executed:

#!/bin/bash
# Show the MV datasource file content
cat packages/tinybird/datasources/dub_sale_events_mv.datasource

Length of output: 1268

🏁 Script executed:

#!/bin/bash
# Look for the raw datasource file
fd "dub_sale_events" packages/tinybird/datasources --type f

Length of output: 116

🏁 Script executed:

#!/bin/bash
# Search for pipe files that might reference these datasources
fd -e pipe packages/tinybird/ | xargs grep -l "dub_sale_events" 2>/dev/null | head -5

Length of output: 377

---

🏁 Script executed:

```shell
#!/bin/bash
# Show the raw datasource file content
cat packages/tinybird/datasources/dub_sale_events.datasource

Length of output: 1929

🏁 Script executed:

#!/bin/bash
# Search for pipe files related to dub_sale_events with corrected syntax
fd . packages/tinybird --full-path '.*dub_sale_events.*\.pipe'

Length of output: 2007

🏁 Script executed:

#!/bin/bash
# List all pipe files in tinybird
fd -e pipe packages/tinybird/

Length of output: 377

🏁 Script executed:

#!/bin/bash
# Check the MV pipe definition
fd "dub_sale_events_pipe" packages/tinybird/ -e pipe

Length of output: 49

🏁 Script executed:

#!/bin/bash
# Show the pipe file content to see NULL handling
cat packages/tinybird/pipes/dub_sale_events_pipe.pipe

Length of output: 2043