Skip to main content

Local Files

Quickly bring any local data into Fused.

Drag & Drop​

Drop files directly into the File Explorer:

Drag and drop files directly into Workbench

Upload with Python​

Install fused, authenticate & run:

fused.api.upload("my_local_file.csv", "fd://my_data/file.csv")
note

fd:// is the Fused provisioned private S3 path for your team.

Optimize Data Loading​

For files < 1GB: Use caching to speed up loading:

@fused.udf
def udf(path: str = "s3://fused-sample/demo_data/housing_2024.csv"):
    import pandas as pd
    
    @fused.cache
    def load_data(path):
        return pd.read_csv(path)

    return load_data(path)

This is especially useful for slow formats (CSV, Excel, etc.).

For files > 1GB: Use fused.ingest() to create cloud-optimized, partitioned files:

job = fused.ingest(
    input="https://www2.census.gov/geo/tiger/TIGER_RD18/LAYER/TRACT/tl_rd22_11_tract.zip",
    output="fd://census/dc_tract/",
)

job.run_batch()