Data Workspaces
1.3
Contents:
1. Introduction
2. Tutorial
3. Command Reference
4. Lineage API
5. Kits Reference
6. Resource Reference
7. Internals: Developer’s Guide
Data Workspaces
Docs
»
Index
Edit on GitHub
Index
Symbols
|
A
|
B
|
C
|
D
|
E
|
F
|
G
|
H
|
I
|
L
|
M
|
N
|
O
|
P
|
R
|
S
|
T
|
U
|
V
|
W
Symbols
--branch <branch>
dws-add-git command line option
--compute-hash
dws-add-local-files command line option
dws-add-rclone command line option
--config <config>
dws-add-rclone command line option
--create-resources <create_resources>
dws-init command line option
--format <format>
dws-lineage-graph command line option
--git-fat-attributes <git_fat_attributes>
dws-init command line option
--git-fat-port <git_fat_port>
dws-init command line option
--git-fat-remote <git_fat_remote>
dws-init command line option
--git-fat-user <git_fat_user>
dws-init command line option
--git-lfs-attributes <git_lfs_attributes>
dws-init command line option
--git-user-email <git_user_email>
dws-deploy-build command line option
--git-user-name <git_user_name>
dws-deploy-build command line option
--height <height>
dws-lineage-graph command line option
--history
dws-status command line option
--hostname <hostname>
dws-clone command line option
dws-init command line option
--image-name <image_name>
dws-deploy-build command line option
dws-deploy-run command line option
--imported
dws-add-git command line option
dws-add-local-files command line option
dws-add-rclone command line option
--leave <leave>
dws-restore command line option
--limit <limit>
dws-report-history command line option
dws-status command line option
--name <name>
dws-add-api-resource command line option
dws-add-git command line option
dws-add-local-files command line option
dws-add-rclone command line option
--no-include-resources
dws-delete-snapshot command line option
--no-mount-ssh-keys
dws-deploy-run command line option
--only <only>
dws-pull command line option
dws-push command line option
dws-restore command line option
--only-workspace
dws-pull command line option
dws-push command line option
--resource <resource>
dws-config command line option
dws-lineage-graph command line option
dws-report-results command line option
--role <role>
dws-add-api-resource command line option
dws-add-git command line option
dws-add-local-files command line option
dws-add-rclone command line option
--scratch-directory <scratch_directory>
dws-init command line option
--skip <skip>
dws-publish command line option
dws-pull command line option
dws-push command line option
--snapshot <snapshot>
dws-lineage-graph command line option
dws-report-lineage command line option
dws-report-results command line option
--strict
dws-restore command line option
--verbose
dws command line option
--width <width>
dws-lineage-graph command line option
--workspace-dir <workspace_dir>
dws-add command line option
dws-config command line option
dws-delete-snapshot command line option
dws-deploy command line option
dws-diff command line option
dws-lineage command line option
dws-publish command line option
dws-pull command line option
dws-push command line option
dws-report command line option
dws-restore command line option
dws-snapshot command line option
dws-status command line option
-b, --batch
dws command line option
-e, --export
dws-add-git command line option
dws-add-local-files command line option
dws-add-rclone command line option
-f, --force-rebuild
dws-deploy-build command line option
-m, --message <message>
dws-snapshot command line option
-r, --read-only
dws-add-git command line option
[PARAMETER_NAME]
dws-config command line option
[PARAMETER_VALUE]
dws-config command line option
A
abort() (dataworkspaces.lineage.Lineage method)
add_lineage_to_keras_model_class() (in module dataworkspaces.kits.tensorflow)
add_output_path() (dataworkspaces.lineage.Lineage method)
add_output_ref() (dataworkspaces.lineage.Lineage method)
add_param() (dataworkspaces.lineage.Lineage method)
add_resource() (dataworkspaces.workspace.Workspace method)
add_results_file() (dataworkspaces.workspace.FileResourceMixin method)
as_lineage_ws() (dataworkspaces.workspace.Workspace method)
as_results_step() (dataworkspaces.lineage.LineageBuilder method)
as_script_step() (dataworkspaces.lineage.LineageBuilder method)
as_snapshot_ws() (dataworkspaces.workspace.Workspace method)
B
batch (dataworkspaces.workspace.Workspace attribute)
BinaryClassificationMetrics (class in dataworkspaces.kits.scikit_learn)
C
CentralWorkspaceMixin (class in dataworkspaces.workspace)
CheckpointConfig (class in dataworkspaces.kits.tensorflow)
clone() (dataworkspaces.workspace.ResourceFactory method)
clone_resource() (dataworkspaces.workspace.Workspace method)
clone_workspace() (dataworkspaces.workspace.WorkspaceFactory static method)
CODE (dataworkspaces.workspace.ResourceRoles attribute)
complete() (dataworkspaces.lineage.Lineage method)
copy_imported_lineage() (dataworkspaces.workspace.SnapshotResourceMixin method)
D
dataworkspaces.api (module)
dataworkspaces.kits.jupyter (module)
dataworkspaces.kits.scikit_learn (module)
dataworkspaces.kits.tensorflow (module)
dataworkspaces.lineage (module)
dataworkspaces.workspace (module)
delete_file() (dataworkspaces.workspace.FileResourceMixin method)
delete_snapshot() (dataworkspaces.workspace.SnapshotResourceMixin method)
(dataworkspaces.workspace.SnapshotWorkspaceMixin method)
DEST
dws-add-rclone command line option
DIRECTORY
dws-clone command line option
does_subpath_exist() (dataworkspaces.workspace.FileResourceMixin method)
dws command line option
--verbose
-b, --batch
dws-add command line option
--workspace-dir <workspace_dir>
dws-add-api-resource command line option
--name <name>
--role <role>
dws-add-git command line option
--branch <branch>
--imported
--name <name>
--role <role>
-e, --export
-r, --read-only
PATH
dws-add-local-files command line option
--compute-hash
--imported
--name <name>
--role <role>
-e, --export
PATH
dws-add-rclone command line option
--compute-hash
--config <config>
--imported
--name <name>
--role <role>
-e, --export
DEST
SOURCE
dws-clone command line option
--hostname <hostname>
DIRECTORY
REPOSITORY
dws-config command line option
--resource <resource>
--workspace-dir <workspace_dir>
[PARAMETER_NAME]
[PARAMETER_VALUE]
dws-delete-snapshot command line option
--no-include-resources
--workspace-dir <workspace_dir>
TAG_OR_HASH
dws-deploy command line option
--workspace-dir <workspace_dir>
dws-deploy-build command line option
--git-user-email <git_user_email>
--git-user-name <git_user_name>
--image-name <image_name>
-f, --force-rebuild
dws-deploy-run command line option
--image-name <image_name>
--no-mount-ssh-keys
dws-diff command line option
--workspace-dir <workspace_dir>
SNAPSHOT_OR_TAG1
SNAPSHOT_OR_TAG2
dws-init command line option
--create-resources <create_resources>
--git-fat-attributes <git_fat_attributes>
--git-fat-port <git_fat_port>
--git-fat-remote <git_fat_remote>
--git-fat-user <git_fat_user>
--git-lfs-attributes <git_lfs_attributes>
--hostname <hostname>
--scratch-directory <scratch_directory>
NAME
dws-lineage command line option
--workspace-dir <workspace_dir>
dws-lineage-graph command line option
--format <format>
--height <height>
--resource <resource>
--snapshot <snapshot>
--width <width>
OUTPUT_FILE
dws-publish command line option
--skip <skip>
--workspace-dir <workspace_dir>
REMOTE_REPOSITORY
dws-pull command line option
--only <only>
--only-workspace
--skip <skip>
--workspace-dir <workspace_dir>
dws-push command line option
--only <only>
--only-workspace
--skip <skip>
--workspace-dir <workspace_dir>
dws-report command line option
--workspace-dir <workspace_dir>
dws-report-history command line option
--limit <limit>
dws-report-lineage command line option
--snapshot <snapshot>
dws-report-results command line option
--resource <resource>
--snapshot <snapshot>
dws-restore command line option
--leave <leave>
--only <only>
--strict
--workspace-dir <workspace_dir>
TAG_OR_HASH
dws-snapshot command line option
--workspace-dir <workspace_dir>
-m, --message <message>
TAG
dws-status command line option
--history
--limit <limit>
--workspace-dir <workspace_dir>
dws_version (dataworkspaces.workspace.Workspace attribute)
DwsModelCheckpoint (class in dataworkspaces.kits.tensorflow)
E
eval() (dataworkspaces.lineage.LineageBuilder method)
F
FileResourceMixin (class in dataworkspaces.workspace)
find_and_load_workspace() (in module dataworkspaces.workspace)
fit() (dataworkspaces.kits.scikit_learn.LineagePredictor method)
from_command_line() (dataworkspaces.workspace.ResourceFactory method)
from_json() (dataworkspaces.workspace.ResourceFactory method)
(dataworkspaces.workspace.SnapshotMetadata static method)
G
get_api_version() (in module dataworkspaces.api)
get_global_param() (dataworkspaces.workspace.Workspace method)
get_instance() (dataworkspaces.workspace.Workspace method)
get_lineage_store() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_local_param() (dataworkspaces.workspace.Workspace method)
get_local_params() (dataworkspaces.workspace.LocalStateResourceMixin method)
get_local_path_if_any() (dataworkspaces.workspace.LocalStateResourceMixin method)
get_most_recent_snapshot() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_names_for_resources_that_need_to_be_cloned() (dataworkspaces.workspace.Workspace method)
get_names_of_resources_with_local_state() (dataworkspaces.workspace.Workspace method)
get_next_snapshot_number() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_params() (dataworkspaces.workspace.Resource method)
get_resource() (dataworkspaces.workspace.Workspace method)
get_resource_info() (in module dataworkspaces.api)
get_resource_names() (dataworkspaces.workspace.Workspace method)
get_resource_role() (dataworkspaces.workspace.Workspace method)
get_resource_type() (dataworkspaces.workspace.Workspace method)
get_resources() (dataworkspaces.workspace.Workspace method)
get_resources_that_need_to_be_cloned() (dataworkspaces.workspace.CentralWorkspaceMixin method)
get_results() (in module dataworkspaces.api)
get_scratch_directory() (dataworkspaces.workspace.Workspace method)
get_snapshot_by_partial_hash() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_snapshot_by_tag() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_snapshot_by_tag_or_hash() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_snapshot_history() (in module dataworkspaces.api)
get_snapshot_manifest() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_snapshot_metadata() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_step_name_for_notebook() (in module dataworkspaces.kits.jupyter)
get_version() (in module dataworkspaces.api)
get_workspace_local_path_if_any() (dataworkspaces.workspace.Workspace method)
H
has_local_state() (dataworkspaces.workspace.ResourceFactory method)
has_results_role() (dataworkspaces.workspace.Resource method)
has_tag() (dataworkspaces.workspace.SnapshotMetadata method)
hashval (dataworkspaces.api.SnapshotInfo attribute)
I
init_workspace() (in module dataworkspaces.workspace)
INTERMEDIATE_DATA (dataworkspaces.workspace.ResourceRoles attribute)
is_exported() (dataworkspaces.workspace.Resource method)
is_imported() (dataworkspaces.workspace.Resource method)
is_notebook() (in module dataworkspaces.kits.jupyter)
L
Lineage (class in dataworkspaces.lineage)
LineageBuilder (class in dataworkspaces.lineage)
LineagePredictor (class in dataworkspaces.kits.scikit_learn)
list_snapshots() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
load_dataset_from_resource() (in module dataworkspaces.kits.scikit_learn)
load_workspace() (dataworkspaces.workspace.WorkspaceFactory static method)
(in module dataworkspaces.workspace)
local_path (dataworkspaces.api.ResourceInfo attribute)
LocalStateResourceMixin (class in dataworkspaces.workspace)
M
make_lineage_graph() (in module dataworkspaces.api)
make_lineage_table() (in module dataworkspaces.api)
map_local_path_to_resource() (dataworkspaces.workspace.Workspace method)
matches_partial_hash() (dataworkspaces.workspace.SnapshotMetadata method)
message (dataworkspaces.api.SnapshotInfo attribute)
Metrics (class in dataworkspaces.kits.scikit_learn)
metrics (dataworkspaces.api.SnapshotInfo attribute)
mode (dataworkspaces.kits.tensorflow.CheckpointConfig attribute)
model_name (dataworkspaces.kits.tensorflow.CheckpointConfig attribute)
monitor (dataworkspaces.kits.tensorflow.CheckpointConfig attribute)
MulticlassClassificationMetrics (class in dataworkspaces.kits.scikit_learn)
N
NAME
dws-init command line option
name (dataworkspaces.api.ResourceInfo attribute)
(dataworkspaces.workspace.Resource attribute)
(dataworkspaces.workspace.Workspace attribute)
NotebookLineageBuilder (class in dataworkspaces.kits.jupyter)
O
OUTPUT_FILE
dws-lineage-graph command line option
P
PATH
dws-add-git command line option
dws-add-local-files command line option
predict() (dataworkspaces.kits.scikit_learn.LineagePredictor method)
print_metrics() (dataworkspaces.kits.scikit_learn.BinaryClassificationMetrics method)
(dataworkspaces.kits.scikit_learn.Metrics method)
(dataworkspaces.kits.scikit_learn.MulticlassClassificationMetrics method)
publish() (dataworkspaces.workspace.SyncedWorkspaceMixin method)
pull() (dataworkspaces.workspace.LocalStateResourceMixin method)
pull_precheck() (dataworkspaces.workspace.LocalStateResourceMixin method)
pull_resources() (dataworkspaces.workspace.CentralWorkspaceMixin method)
(dataworkspaces.workspace.SyncedWorkspaceMixin method)
pull_workspace() (dataworkspaces.workspace.SyncedWorkspaceMixin method)
push() (dataworkspaces.workspace.LocalStateResourceMixin method)
(dataworkspaces.workspace.SyncedWorkspaceMixin method)
push_precheck() (dataworkspaces.workspace.LocalStateResourceMixin method)
push_resources() (dataworkspaces.workspace.CentralWorkspaceMixin method)
R
read_results_file() (dataworkspaces.workspace.FileResourceMixin method)
REMOTE_REPOSITORY
dws-publish command line option
remove_tag_from_snapshot() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
REPOSITORY
dws-clone command line option
Resource (class in dataworkspaces.workspace)
RESOURCE_ROLE_CHOICES (in module dataworkspaces.workspace)
resource_type (dataworkspaces.api.ResourceInfo attribute)
(dataworkspaces.workspace.Resource attribute)
ResourceFactory (class in dataworkspaces.workspace)
ResourceInfo (class in dataworkspaces.api)
ResourceRef (class in dataworkspaces.lineage)
ResourceRoles (class in dataworkspaces.workspace)
restore() (dataworkspaces.workspace.SnapshotResourceMixin method)
(dataworkspaces.workspace.SnapshotWorkspaceMixin method)
(in module dataworkspaces.api)
restore_precheck() (dataworkspaces.workspace.SnapshotResourceMixin method)
RESULTS (dataworkspaces.workspace.ResourceRoles attribute)
results_copy_current_files() (dataworkspaces.workspace.FileResourceMixin method)
results_move_current_files() (dataworkspaces.workspace.FileResourceMixin method)
ResultsLineage (class in dataworkspaces.lineage)
role (dataworkspaces.api.ResourceInfo attribute)
(dataworkspaces.workspace.Resource attribute)
S
save() (dataworkspaces.workspace.Workspace method)
save_best_only (dataworkspaces.kits.tensorflow.CheckpointConfig attribute)
save_freq (dataworkspaces.kits.tensorflow.CheckpointConfig attribute)
save_snapshot_metadata_and_manifest() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
score() (dataworkspaces.kits.scikit_learn.BinaryClassificationMetrics method)
(dataworkspaces.kits.scikit_learn.LineagePredictor method)
(dataworkspaces.kits.scikit_learn.Metrics method)
(dataworkspaces.kits.scikit_learn.MulticlassClassificationMetrics method)
set_global_param() (dataworkspaces.workspace.Workspace method)
set_local_param() (dataworkspaces.workspace.Workspace method)
snapshot() (dataworkspaces.workspace.SnapshotResourceMixin method)
(dataworkspaces.workspace.SnapshotWorkspaceMixin method)
snapshot_number (dataworkspaces.api.SnapshotInfo attribute)
SNAPSHOT_OR_TAG1
dws-diff command line option
SNAPSHOT_OR_TAG2
dws-diff command line option
snapshot_precheck() (dataworkspaces.workspace.SnapshotResourceMixin method)
SnapshotInfo (class in dataworkspaces.api)
SnapshotMetadata (class in dataworkspaces.workspace)
SnapshotResourceMixin (class in dataworkspaces.workspace)
SnapshotWorkspaceMixin (class in dataworkspaces.workspace)
SOURCE
dws-add-rclone command line option
SOURCE_DATA_SET (dataworkspaces.workspace.ResourceRoles attribute)
suggest_name() (dataworkspaces.workspace.ResourceFactory method)
suggest_resource_name() (dataworkspaces.workspace.Workspace method)
supports_lineage() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
SyncedWorkspaceMixin (class in dataworkspaces.workspace)
T
TAG
dws-snapshot command line option
TAG_OR_HASH
dws-delete-snapshot command line option
dws-restore command line option
tags (dataworkspaces.api.SnapshotInfo attribute)
take_snapshot() (in module dataworkspaces.api)
timestamp (dataworkspaces.api.SnapshotInfo attribute)
to_json() (dataworkspaces.workspace.SnapshotMetadata method)
U
upload_file() (dataworkspaces.workspace.FileResourceMixin method)
V
validate_local_path_for_resource() (dataworkspaces.workspace.Workspace method)
validate_resource_name() (dataworkspaces.workspace.Workspace method)
validate_subpath_exists() (dataworkspaces.workspace.LocalStateResourceMixin method)
(dataworkspaces.workspace.Resource method)
verbose (dataworkspaces.workspace.Workspace attribute)
W
with_code_path() (dataworkspaces.lineage.LineageBuilder method)
with_code_ref() (dataworkspaces.lineage.LineageBuilder method)
with_input_path() (dataworkspaces.lineage.LineageBuilder method)
with_input_paths() (dataworkspaces.lineage.LineageBuilder method)
with_input_ref() (dataworkspaces.lineage.LineageBuilder method)
with_no_inputs() (dataworkspaces.lineage.LineageBuilder method)
with_parameters() (dataworkspaces.lineage.LineageBuilder method)
with_step_name() (dataworkspaces.lineage.LineageBuilder method)
with_workspace_directory() (dataworkspaces.lineage.LineageBuilder method)
Workspace (class in dataworkspaces.workspace)
workspace (dataworkspaces.workspace.Resource attribute)
WorkspaceFactory (class in dataworkspaces.workspace)
write_export_lineage_for_snapshot() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
write_result_lineage_for_snapshot() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
write_results() (dataworkspaces.lineage.ResultsLineage method)
Read the Docs
v: 1.3
Versions
latest
stable
1.3
1.2.3
1.2.2
1.2.1
1.2.0
Downloads
On Read the Docs
Project Home
Builds
Free document hosting provided by
Read the Docs
.