Skip to main content

Data Science & AI

Discover data​

Explore data with Fused:

  • Browse buckets without writing any code in File Explorer
  • Ask AI Assistant to write a simple reader for a file if you don't know how to:
Use DuckDB to open this file and return first few rows: s3://fused-sample/demo_data/housing_2024.parquet
  • Return data as a pandas.DataFrame to see a preview of the data directly in Workbench

Examples:

  • Explore the Fused demo data in File Explorer: s3://fused-sample/demo_data/

Get a sample of data locally​

Have a large dataset in the cloud, but want to explore some of it locally on your own machine? Write a simple UDF to return a subset and call it locally

(We assume you have installed fused & authenticated)

import fused

@fused.udf
def udf(path: str='s3://fused-asset/data/era5/t2m/datestr=2024-01-01/0.parquet'):
    import pandas as pd
    df = pd.read_parquet(path)

    return df.head(10)
sample = fused.run(udf)

Examples​