Data Engineering

Quick links for data engineers using Fused.

Connect Your Data

• Local files (drag & drop)
• Cloud storage (S3/GCS)
• Databases (Snowflake, BigQuery)

Data Formats

• Reading data
• Writing data

Turn Data into APIs

• Shared tokens & endpoints
• Calling UDFs as API
• Download options

Execution

• Realtime execution
• Scaling out UDFs — parallel execution and dedicated instances

Advanced Setup

• Environment variables & secrets
• Dependencies
• Git integration
• On-prem setup

Examples

• Realtime filtering
• Dark vessel detection (AIS ingestion)