Skip to main content

Local files

Quickly bring any local data into Fused.

Drag & drop​

Drop files directly into the File Explorer:

Drag and drop files directly into Workbench

Upload with Python​

Install fused, authenticate & run:

fused.api.upload("my_local_file.csv", "s3://fused-users/fused/aman/my_data/file.csv")  # change to your own path
note

Your Fused home directory is the private S3 path attached to your account.

Optimize data loading​

For files < 1GB: Use function caching to speed up loading:

@fused.udf
def udf():
    import pandas as pd
    path = "s3://fused-sample/demo_data/housing_2024.csv"

    @fused.cache
    def load_data():
        return pd.read_csv(path)

    return load_data()

This is especially useful for slow formats (CSV, Excel, etc.).

For files > 1GB: Use Geospatial Ingestion to create cloud-optimized, partitioned files:

job = fused.ingest(
    input="https://www2.census.gov/geo/tiger/TIGER_RD18/LAYER/TRACT/tl_rd22_11_tract.zip",
    output="s3://fused-users/fused/aman/census/dc_tract/",  # change to your own path
)

job.run_batch()