Data Workspaces
stable
Contents:
1. Introduction
2. Tutorial
3. Command Reference
4. Lineage API
5. Kits Reference
6. Resource Reference
7. Internals: Developer’s Guide
Data Workspaces
Docs
»
Index
Edit on GitHub
Index
Symbols
|
A
|
B
|
C
|
D
|
E
|
F
|
G
|
H
|
I
|
L
|
M
|
N
|
O
|
P
|
R
|
S
|
T
|
U
|
V
|
W
Symbols
--batch
dws command line option
--branch
dws-add-git command line option
--compute-hash
dws-add-local-files command line option
dws-add-rclone command line option
--config
dws-add-rclone command line option
--create-resources
dws-init command line option
--export
dws-add-git command line option
dws-add-local-files command line option
dws-add-rclone command line option
--force-rebuild
dws-deploy-build command line option
--format
dws-lineage-graph command line option
--git-fat-attributes
dws-init command line option
--git-fat-port
dws-init command line option
--git-fat-remote
dws-init command line option
--git-fat-user
dws-init command line option
--git-lfs-attributes
dws-init command line option
--git-user-email
dws-deploy-build command line option
--git-user-name
dws-deploy-build command line option
--height
dws-lineage-graph command line option
--history
dws-status command line option
--hostname
dws-clone command line option
dws-init command line option
--image-name
dws-deploy-build command line option
dws-deploy-run command line option
--imported
dws-add-git command line option
dws-add-local-files command line option
dws-add-rclone command line option
--leave
dws-restore command line option
--limit
dws-report-history command line option
dws-status command line option
--master
dws-add-rclone command line option
--message
dws-snapshot command line option
--name
dws-add-api-resource command line option
dws-add-git command line option
dws-add-local-files command line option
dws-add-rclone command line option
dws-add-s3 command line option
--no-include-resources
dws-delete-snapshot command line option
--no-mount-ssh-keys
dws-deploy-run command line option
--only
dws-pull command line option
dws-push command line option
dws-restore command line option
--only-workspace
dws-pull command line option
dws-push command line option
--read-only
dws-add-git command line option
--resource
dws-config command line option
dws-lineage-graph command line option
dws-report-results command line option
--role
dws-add-api-resource command line option
dws-add-git command line option
dws-add-local-files command line option
dws-add-rclone command line option
dws-add-s3 command line option
--scratch-directory
dws-init command line option
--size-only
dws-add-rclone command line option
--skip
dws-publish command line option
dws-pull command line option
dws-push command line option
--snapshot
dws-lineage-graph command line option
dws-report-lineage command line option
dws-report-results command line option
--strict
dws-restore command line option
--sync-mode
dws-add-rclone command line option
--verbose
dws command line option
--width
dws-lineage-graph command line option
--workspace-dir
dws-add command line option
dws-config command line option
dws-delete-snapshot command line option
dws-deploy command line option
dws-diff command line option
dws-lineage command line option
dws-publish command line option
dws-pull command line option
dws-push command line option
dws-report command line option
dws-restore command line option
dws-snapshot command line option
dws-status command line option
-b
dws command line option
-e
dws-add-git command line option
dws-add-local-files command line option
dws-add-rclone command line option
-f
dws-deploy-build command line option
-m
dws-snapshot command line option
-r
dws-add-git command line option
[PARAMETER_NAME]
dws-config command line option
[PARAMETER_VALUE]
dws-config command line option
A
abort() (dataworkspaces.lineage.Lineage method)
add_lineage_to_keras_model_class() (in module dataworkspaces.kits.tensorflow)
add_output_path() (dataworkspaces.lineage.Lineage method)
add_output_ref() (dataworkspaces.lineage.Lineage method)
add_param() (dataworkspaces.lineage.Lineage method)
add_resource() (dataworkspaces.workspace.Workspace method)
add_results_file() (dataworkspaces.workspace.FileResourceMixin method)
as_lineage_ws() (dataworkspaces.workspace.Workspace method)
as_results_step() (dataworkspaces.lineage.LineageBuilder method)
as_script_step() (dataworkspaces.lineage.LineageBuilder method)
as_snapshot_ws() (dataworkspaces.workspace.Workspace method)
B
batch (dataworkspaces.workspace.Workspace attribute)
BinaryClassificationMetrics (class in dataworkspaces.kits.scikit_learn)
BUCKET_NAME
dws-add-s3 command line option
C
CentralWorkspaceMixin (class in dataworkspaces.workspace)
CheckpointConfig (class in dataworkspaces.kits.tensorflow)
clone() (dataworkspaces.workspace.ResourceFactory method)
clone_resource() (dataworkspaces.workspace.Workspace method)
clone_workspace() (dataworkspaces.workspace.WorkspaceFactory static method)
CODE (dataworkspaces.workspace.ResourceRoles attribute)
complete() (dataworkspaces.lineage.Lineage method)
copy_imported_lineage() (dataworkspaces.workspace.SnapshotResourceMixin method)
D
dataworkspaces.api
module
dataworkspaces.kits.jupyter
module
dataworkspaces.kits.scikit_learn
module
dataworkspaces.kits.tensorflow
module
dataworkspaces.lineage
module
dataworkspaces.workspace
module
delete_file() (dataworkspaces.workspace.FileResourceMixin method)
delete_snapshot() (dataworkspaces.workspace.SnapshotResourceMixin method)
(dataworkspaces.workspace.SnapshotWorkspaceMixin method)
DIRECTORY
dws-clone command line option
does_subpath_exist() (dataworkspaces.workspace.FileResourceMixin method)
dws command line option
--batch
--verbose
-b
dws-add command line option
--workspace-dir
dws-add-api-resource command line option
--name
--role
dws-add-git command line option
--branch
--export
--imported
--name
--read-only
--role
-e
-r
PATH
dws-add-local-files command line option
--compute-hash
--export
--imported
--name
--role
-e
PATH
dws-add-rclone command line option
--compute-hash
--config
--export
--imported
--master
--name
--role
--size-only
--sync-mode
-e
LOCAL_PATH
REMOTE
dws-add-s3 command line option
--name
--role
BUCKET_NAME
dws-clone command line option
--hostname
DIRECTORY
REPOSITORY
dws-config command line option
--resource
--workspace-dir
[PARAMETER_NAME]
[PARAMETER_VALUE]
dws-delete-snapshot command line option
--no-include-resources
--workspace-dir
TAG_OR_HASH
dws-deploy command line option
--workspace-dir
dws-deploy-build command line option
--force-rebuild
--git-user-email
--git-user-name
--image-name
-f
dws-deploy-run command line option
--image-name
--no-mount-ssh-keys
dws-diff command line option
--workspace-dir
SNAPSHOT_OR_TAG1
SNAPSHOT_OR_TAG2
dws-init command line option
--create-resources
--git-fat-attributes
--git-fat-port
--git-fat-remote
--git-fat-user
--git-lfs-attributes
--hostname
--scratch-directory
NAME
dws-lineage command line option
--workspace-dir
dws-lineage-graph command line option
--format
--height
--resource
--snapshot
--width
OUTPUT_FILE
dws-publish command line option
--skip
--workspace-dir
REMOTE_REPOSITORY
dws-pull command line option
--only
--only-workspace
--skip
--workspace-dir
dws-push command line option
--only
--only-workspace
--skip
--workspace-dir
dws-report command line option
--workspace-dir
dws-report-history command line option
--limit
dws-report-lineage command line option
--snapshot
dws-report-results command line option
--resource
--snapshot
dws-restore command line option
--leave
--only
--strict
--workspace-dir
TAG_OR_HASH
dws-snapshot command line option
--message
--workspace-dir
-m
TAG
dws-status command line option
--history
--limit
--workspace-dir
dws_version (dataworkspaces.workspace.Workspace attribute)
DwsModelCheckpoint (class in dataworkspaces.kits.tensorflow)
E
eval() (dataworkspaces.lineage.LineageBuilder method)
F
FileResourceMixin (class in dataworkspaces.workspace)
find_and_load_workspace() (in module dataworkspaces.workspace)
fit() (dataworkspaces.kits.scikit_learn.LineagePredictor method)
from_command_line() (dataworkspaces.workspace.ResourceFactory method)
from_json() (dataworkspaces.workspace.ResourceFactory method)
(dataworkspaces.workspace.SnapshotMetadata static method)
G
get_api_version() (in module dataworkspaces.api)
get_filesystem_for_resource() (in module dataworkspaces.api)
get_global_param() (dataworkspaces.workspace.Workspace method)
get_instance() (dataworkspaces.workspace.Workspace method)
get_lineage_store() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_local_param() (dataworkspaces.workspace.Workspace method)
get_local_params() (dataworkspaces.workspace.LocalStateResourceMixin method)
get_local_path_for_resource() (in module dataworkspaces.api)
get_local_path_if_any() (dataworkspaces.workspace.LocalStateResourceMixin method)
get_most_recent_snapshot() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_names_for_resources_that_need_to_be_cloned() (dataworkspaces.workspace.Workspace method)
get_names_of_resources_with_local_state() (dataworkspaces.workspace.Workspace method)
get_next_snapshot_number() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_params() (dataworkspaces.workspace.Resource method)
get_resource() (dataworkspaces.workspace.Workspace method)
get_resource_info() (in module dataworkspaces.api)
get_resource_names() (dataworkspaces.workspace.Workspace method)
get_resource_role() (dataworkspaces.workspace.Workspace method)
get_resource_type() (dataworkspaces.workspace.Workspace method)
get_resources() (dataworkspaces.workspace.Workspace method)
get_resources_that_need_to_be_cloned() (dataworkspaces.workspace.CentralWorkspaceMixin method)
get_results() (in module dataworkspaces.api)
get_scratch_directory() (dataworkspaces.workspace.Workspace method)
get_snapshot_by_partial_hash() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_snapshot_by_tag() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_snapshot_by_tag_or_hash() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_snapshot_history() (in module dataworkspaces.api)
get_snapshot_manifest() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_snapshot_metadata() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
get_step_name_for_notebook() (in module dataworkspaces.kits.jupyter)
get_version() (in module dataworkspaces.api)
get_workspace_local_path_if_any() (dataworkspaces.workspace.Workspace method)
H
has_local_state() (dataworkspaces.workspace.ResourceFactory method)
has_results_role() (dataworkspaces.workspace.Resource method)
has_tag() (dataworkspaces.workspace.SnapshotMetadata method)
hashval (dataworkspaces.api.SnapshotInfo property)
I
init_workspace() (in module dataworkspaces.workspace)
INTERMEDIATE_DATA (dataworkspaces.workspace.ResourceRoles attribute)
is_exported() (dataworkspaces.workspace.Resource method)
is_imported() (dataworkspaces.workspace.Resource method)
is_notebook() (in module dataworkspaces.kits.jupyter)
L
Lineage (class in dataworkspaces.lineage)
LineageBuilder (class in dataworkspaces.lineage)
LineagePredictor (class in dataworkspaces.kits.scikit_learn)
list_snapshots() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
load_dataset_from_resource() (in module dataworkspaces.kits.scikit_learn)
load_workspace() (dataworkspaces.workspace.WorkspaceFactory static method)
(in module dataworkspaces.workspace)
LOCAL_PATH
dws-add-rclone command line option
local_path (dataworkspaces.api.ResourceInfo property)
LocalStateResourceMixin (class in dataworkspaces.workspace)
ls() (dataworkspaces.workspace.FileResourceMixin method)
M
make_lineage_graph() (in module dataworkspaces.api)
make_lineage_table() (in module dataworkspaces.api)
map_local_path_to_resource() (dataworkspaces.workspace.Workspace method)
matches_partial_hash() (dataworkspaces.workspace.SnapshotMetadata method)
message (dataworkspaces.api.SnapshotInfo property)
Metrics (class in dataworkspaces.kits.scikit_learn)
metrics (dataworkspaces.api.SnapshotInfo property)
mode (dataworkspaces.kits.tensorflow.CheckpointConfig property)
model_name (dataworkspaces.kits.tensorflow.CheckpointConfig property)
module
dataworkspaces.api
dataworkspaces.kits.jupyter
dataworkspaces.kits.scikit_learn
dataworkspaces.kits.tensorflow
dataworkspaces.lineage
dataworkspaces.workspace
monitor (dataworkspaces.kits.tensorflow.CheckpointConfig property)
MulticlassClassificationMetrics (class in dataworkspaces.kits.scikit_learn)
N
NAME
dws-init command line option
name (dataworkspaces.api.ResourceInfo property)
(dataworkspaces.workspace.Resource attribute)
(dataworkspaces.workspace.Workspace attribute)
NotebookLineageBuilder (class in dataworkspaces.kits.jupyter)
O
open() (dataworkspaces.workspace.FileResourceMixin method)
OUTPUT_FILE
dws-lineage-graph command line option
P
PATH
dws-add-git command line option
dws-add-local-files command line option
predict() (dataworkspaces.kits.scikit_learn.LineagePredictor method)
print_metrics() (dataworkspaces.kits.scikit_learn.BinaryClassificationMetrics method)
(dataworkspaces.kits.scikit_learn.Metrics method)
(dataworkspaces.kits.scikit_learn.MulticlassClassificationMetrics method)
publish() (dataworkspaces.workspace.SyncedWorkspaceMixin method)
pull() (dataworkspaces.workspace.LocalStateResourceMixin method)
pull_precheck() (dataworkspaces.workspace.LocalStateResourceMixin method)
pull_resources() (dataworkspaces.workspace.CentralWorkspaceMixin method)
(dataworkspaces.workspace.SyncedWorkspaceMixin method)
pull_workspace() (dataworkspaces.workspace.SyncedWorkspaceMixin method)
push() (dataworkspaces.workspace.LocalStateResourceMixin method)
(dataworkspaces.workspace.SyncedWorkspaceMixin method)
push_precheck() (dataworkspaces.workspace.LocalStateResourceMixin method)
push_resources() (dataworkspaces.workspace.CentralWorkspaceMixin method)
R
read_results_file() (dataworkspaces.workspace.FileResourceMixin method)
REMOTE
dws-add-rclone command line option
REMOTE_REPOSITORY
dws-publish command line option
remove_tag_from_snapshot() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
REPOSITORY
dws-clone command line option
Resource (class in dataworkspaces.workspace)
RESOURCE_ROLE_CHOICES (in module dataworkspaces.workspace)
resource_type (dataworkspaces.api.ResourceInfo property)
(dataworkspaces.workspace.Resource attribute)
ResourceFactory (class in dataworkspaces.workspace)
ResourceFileSystem (class in dataworkspaces.api)
ResourceInfo (class in dataworkspaces.api)
ResourceRef (class in dataworkspaces.lineage)
ResourceRoles (class in dataworkspaces.workspace)
restore() (dataworkspaces.workspace.SnapshotResourceMixin method)
(dataworkspaces.workspace.SnapshotWorkspaceMixin method)
(in module dataworkspaces.api)
restore_precheck() (dataworkspaces.workspace.SnapshotResourceMixin method)
RESULTS (dataworkspaces.workspace.ResourceRoles attribute)
results_copy_current_files() (dataworkspaces.workspace.FileResourceMixin method)
results_move_current_files() (dataworkspaces.workspace.FileResourceMixin method)
ResultsLineage (class in dataworkspaces.lineage)
role (dataworkspaces.api.ResourceInfo property)
(dataworkspaces.workspace.Resource attribute)
S
save() (dataworkspaces.workspace.Workspace method)
save_best_only (dataworkspaces.kits.tensorflow.CheckpointConfig property)
save_freq (dataworkspaces.kits.tensorflow.CheckpointConfig property)
save_snapshot_metadata_and_manifest() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
score() (dataworkspaces.kits.scikit_learn.BinaryClassificationMetrics method)
(dataworkspaces.kits.scikit_learn.LineagePredictor method)
(dataworkspaces.kits.scikit_learn.Metrics method)
(dataworkspaces.kits.scikit_learn.MulticlassClassificationMetrics method)
set_global_param() (dataworkspaces.workspace.Workspace method)
set_local_param() (dataworkspaces.workspace.Workspace method)
snapshot() (dataworkspaces.workspace.SnapshotResourceMixin method)
(dataworkspaces.workspace.SnapshotWorkspaceMixin method)
snapshot_number (dataworkspaces.api.SnapshotInfo property)
SNAPSHOT_OR_TAG1
dws-diff command line option
SNAPSHOT_OR_TAG2
dws-diff command line option
snapshot_precheck() (dataworkspaces.workspace.SnapshotResourceMixin method)
SnapshotInfo (class in dataworkspaces.api)
SnapshotMetadata (class in dataworkspaces.workspace)
SnapshotResourceMixin (class in dataworkspaces.workspace)
SnapshotWorkspaceMixin (class in dataworkspaces.workspace)
SOURCE_DATA_SET (dataworkspaces.workspace.ResourceRoles attribute)
suggest_name() (dataworkspaces.workspace.ResourceFactory method)
suggest_resource_name() (dataworkspaces.workspace.Workspace method)
supports_lineage() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
SyncedWorkspaceMixin (class in dataworkspaces.workspace)
T
TAG
dws-snapshot command line option
TAG_OR_HASH
dws-delete-snapshot command line option
dws-restore command line option
tags (dataworkspaces.api.SnapshotInfo property)
take_snapshot() (in module dataworkspaces.api)
timestamp (dataworkspaces.api.SnapshotInfo property)
to_json() (dataworkspaces.workspace.SnapshotMetadata method)
U
upload_file() (dataworkspaces.workspace.FileResourceMixin method)
V
validate_local_path_for_resource() (dataworkspaces.workspace.Workspace method)
validate_resource_name() (dataworkspaces.workspace.Workspace method)
validate_subpath_exists() (dataworkspaces.workspace.LocalStateResourceMixin method)
(dataworkspaces.workspace.Resource method)
verbose (dataworkspaces.workspace.Workspace attribute)
W
with_code_path() (dataworkspaces.lineage.LineageBuilder method)
with_code_ref() (dataworkspaces.lineage.LineageBuilder method)
with_input_path() (dataworkspaces.lineage.LineageBuilder method)
with_input_paths() (dataworkspaces.lineage.LineageBuilder method)
with_input_ref() (dataworkspaces.lineage.LineageBuilder method)
with_no_inputs() (dataworkspaces.lineage.LineageBuilder method)
with_parameters() (dataworkspaces.lineage.LineageBuilder method)
with_step_name() (dataworkspaces.lineage.LineageBuilder method)
with_workspace_directory() (dataworkspaces.lineage.LineageBuilder method)
Workspace (class in dataworkspaces.workspace)
workspace (dataworkspaces.workspace.Resource attribute)
WorkspaceFactory (class in dataworkspaces.workspace)
write_export_lineage_for_snapshot() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
write_result_lineage_for_snapshot() (dataworkspaces.workspace.SnapshotWorkspaceMixin method)
write_results() (dataworkspaces.lineage.ResultsLineage method)
Read the Docs
v: stable
Versions
latest
stable
1.6.0
1.5.2
1.5.1
1.5.0
1.4.0
1.3
1.2.3
1.2.2
1.2.1
1.2.0
Downloads
pdf
html
epub
On Read the Docs
Project Home
Builds
Free document hosting provided by
Read the Docs
.