Datasets Workflows

Creating New Dataset

  1. Go to dataset view
  2. Click on new dataset button
    1. Fill Required information
      1. Name
      2. Namespace
      3. Visibility
    2. Submit
  3. Select the desired storage from the list

Upload New Files To A Dataset

  1. Go to dataset detail view
  2. Select master version
  3. (Optional) Create a folder structure
  4. Upload files using “upload” button

Migrating an existing Dataset

  1. Create a dataset.

  2. Download the created repository.

     export DATASET=https://jisap.tecnalia.com/namespace/dataset.git
 git clone $DATASET dataset

  3. Copy content of the existing dataset to dataset folder.

  4. Add the files to dvc.

    dvc add  .

  5. Version dvc files.

    git add .

  6. Create a new commit.

    git commit -m "Migrated dataset"

  7. Configure storage credentials

    dvc remote modify --local jisap-basf password $repo_token

  8. Upload figures to storage site

    dvc push

  9. Upload changes to GitLab

    git push