8  Stage The Dataset - Option 1: Bare Symlinks

Warning

NOT YET IMPLEMENTED: This page will show how to stage the dataset using bare symlinks.

This page shows the manual page contract in the context of a real staging task.

The operator must:

  1. confirm that the project is ready to receive the staged data;
  2. create the staged input location;
  3. verify that the staged path now exists and points where expected.

8.1 1. Prerequisite

Before running this page, confirm that the project already exists and that the operator is working from its root.

from pathlib import Path

assert Path("README.md").exists(), "Expected README.md to exist before staging data."
Path("data").mkdir(exist_ok=True)

8.2 2. Procedure

Record the dataset identifier and the intended staging location.

from pathlib import Path

dataset_name = "example_registered_dataset"
stage_path = Path("data") / dataset_name

Create the staged location. In a real manual this could call stagecoach or another institutional tool.

from pathlib import Path

dataset_name = "example_registered_dataset"
stage_path = Path("data") / dataset_name

stage_path.mkdir(exist_ok=True)

8.3 3. Check

from pathlib import Path

dataset_name = "example_registered_dataset"
stage_path = Path("data") / dataset_name

assert stage_path.exists(), "Expected staged dataset path to exist."
assert stage_path.is_dir(), "Expected staged dataset path to be a directory."

This page is intentionally small. It demonstrates that the framework still works when the workflow itself is simple.