[DEV] VESSL Docs
  • Welcome to VESSL Docs!
  • GETTING STARTED
    • Overview
    • Quickstart
    • End-to-end Guides
      • CLI-driven Workflow
      • SDK-driven Workflow
  • USER GUIDE
    • Organization
      • Creating an Organization
      • Organization Settings
        • Add Members
        • Set Notifications
        • Configure Clusters
        • Add Integrations
        • Billing Information
    • Project
      • Creating a Project
      • Project Overview
      • Project Repository & Project Dataset
    • Clusters
      • Cluster Integrations
        • Fully Managed Cloud
        • Personal Laptops
        • On-premise Clusters
        • Private Cloud (AWS)
      • Cluster Monitoring
      • Cluster Administration
        • Resource Specs
        • Access Control
        • Quotas and Limits
        • Remove Cluster
    • Dataset
      • Adding New Datasets
      • Managing Datasets
      • Tips & Limitations
    • Experiment
      • Creating an Experiment
      • Managing Experiments
      • Experiment Results
      • Distributed Experiments
      • Local Experiments
    • Model Registry
      • Creating a Model
      • Managing Models
    • Sweep
      • Creating a Sweep
      • Sweep Results
    • Workspace
      • Creating a Workspace
      • Exploring Workspaces
      • SSH Connection
      • Downloading / Attaching Datasets
      • Running a Server Application
      • Tips & Limitations
      • Building Custom Images
    • Serve
      • Quickstart
      • Serve Web Workflow
        • Monitoring Dashboard
        • Service Logs
        • Service Revisions
        • Service Rollouts
      • Serve YAML Workflow
        • YAML Schema Reference
    • Commons
      • Running Spot Instances
      • Volume Mount
  • API REFERENCE
    • What is the VESSL CLI/SDK?
    • CLI
      • Getting Started
      • vessl run
      • vessl cluster
      • vessl dataset
      • vessl experiment
      • vessl image
      • vessl model
      • vessl organization
      • vessl project
      • vessl serve
      • vessl ssh-key
      • vessl sweep
      • vessl volume
      • vessl workspace
    • Python SDK
      • Integrations
        • Keras
        • TensorBoard
      • Utilities API
        • configure
        • vessl.init
        • vessl.log
          • vessl.Image
          • vessl.Audio
        • vessl.hp.update
        • vessl.progress
        • vessl.upload
        • vessl.finish
      • Dataset API
      • Experiment API
      • Cluster API
      • Image API
      • Model API
        • Model Serving API
      • Organization API
      • Project API
      • Serving API
      • SSH Key API
      • Sweep API
      • Volume API
      • Workspace API
    • Rate Limits
  • TROUBLESHOOTING
    • GitHub Issues
    • VESSL Flare
Powered by GitBook
On this page
  • Overview
  • Copy files within a dataset
  • Create a dataset
  • Delete a file within a dataset
  • Download dataset files
  • List all datasets
  • List dataset files
  • View information on the dataset
  • Upload files to a dataset
  1. API REFERENCE
  2. CLI

vessl dataset

Overview

Run vessl dataset --help to view the list of commands, or vessl dataset [COMMAND] --help to view individual command instructions.

Copy files within a dataset

This is not supported for externally sourced datasets.

vessl dataset copy [OPTIONS] NAME SOURCE DEST
Argument
Description

NAME

Dataset name

SOURCE

Source path within the dataset

DEST

Destination file path within

Option
Description

-r, --recursive

Required if source file is a directory

Create a dataset

vessl dataset create [OPTIONS] NAME
Argument
Description

NAME

Dataset name

Option
Description

-m, --description

Dataset description

-e, --external-path

AWS S3 or Google Cloud Storage bucket URL

--aws-role-arn

AWS Role ARN to access S3

--enable-versioning

Enable versioning

--version-path

Versioning bucket path

Delete a file within a dataset

This is not supported for externally sourced datasets.

vessl dataset delete-file [OPTIONS] NAME PATH
Argument
Description

NAME

Dataset name

PATH

File path

Option
Description

-r, --recursive

Required if file is a directory

Download dataset files

vessl dataset download [OPTIONS] NAME SOURCE DEST
Argument
Description

NAME

Dataset name

SOURCE

Source path within the dataset

DEST

Local destination path

List all datasets

vessl dataset list

List dataset files

vessl dataset list-files [OPTIONS] NAME
Argument
Description

NAME

Dataset name

Option
Description

-p, --path

Directory path to list (defaults to root)

-r, --recursive

List files recursively

View information on the dataset

vessl dataset read [OPTIONS] NAME
Argument
Description

NAME

Dataset name

Upload files to a dataset

vessl dataset upload NAME SOURCE DEST
Argument
Description

NAME

Dataset name

SOURCE

Local source path

DEST

Destination path within the dataset

Previousvessl clusterNextvessl experiment

Last updated 3 years ago