Skip to content

File Uploader Result

Bases: FileResult

Representation of file upload result.

Container for file paths, divided into certain categories:

  • [successful][]
  • [failed][]
  • [skipped][]
  • [missing][]

Added in 0.3.0

Examples

>>> from onetl.file import FileUploader
>>> uploader = FileUploader(target_path="/remote", ...)
>>> upload_result = uploader.run(
...     [
...         "/local/file1",
...         "/local/file2",
...         "/failed/file",
...         "/existing/file",
...         "/missing/file",
...     ]
... )
>>> upload_result
UploadResult(
    successful=FileSet([
        RemoteFile("/remote/file1"),
        RemoteFile("/remote/file2"),
    ]),
    failed=FileSet([
        FailedLocalFile("/failed/file")
    ]),
    skipped=FileSet([
        LocalPath("/existing/file")
    ]),
    missing=FileSet([
        LocalPath("/missing/file")
    ]),
)
Source code in onetl/file/file_uploader/result.py 
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
class UploadResult(FileResult):
    """
    Representation of file upload result.

    Container for file paths, divided into certain categories:

    * [successful][]
    * [failed][]
    * [skipped][]
    * [missing][]

    !!! success "Added in 0.3.0"

    Examples
    --------

    ```python
    >>> from onetl.file import FileUploader
    >>> uploader = FileUploader(target_path="/remote", ...)
    >>> upload_result = uploader.run(
    ...     [
    ...         "/local/file1",
    ...         "/local/file2",
    ...         "/failed/file",
    ...         "/existing/file",
    ...         "/missing/file",
    ...     ]
    ... )
    >>> upload_result
    UploadResult(
        successful=FileSet([
            RemoteFile("/remote/file1"),
            RemoteFile("/remote/file2"),
        ]),
        failed=FileSet([
            FailedLocalFile("/failed/file")
        ]),
        skipped=FileSet([
            LocalPath("/existing/file")
        ]),
        missing=FileSet([
            LocalPath("/missing/file")
        ]),
    )
    ```
    """

    successful: FileSet[RemoteFile] = Field(default_factory=lambda: FileSet({}))
    "File paths (remote) which were uploaded successfully"

    failed: FileSet[FailedLocalFile] = Field(default_factory=lambda: FileSet({}))
    "File paths (local) which were not uploaded because of some failure"

    skipped: FileSet[LocalPath] = Field(default_factory=lambda: FileSet({}))
    "File paths (local) which were skipped because of some reason"

    missing: FileSet[LocalPath] = Field(default_factory=lambda: FileSet({}))
    "File paths (local) which are not present in the local file system"

successful = Field(default_factory=(lambda: FileSet({}))) class-attribute instance-attribute

File paths (remote) which were uploaded successfully

failed = Field(default_factory=(lambda: FileSet({}))) class-attribute instance-attribute

File paths (local) which were not uploaded because of some failure

skipped = Field(default_factory=(lambda: FileSet({}))) class-attribute instance-attribute

File paths (local) which were skipped because of some reason

missing = Field(default_factory=(lambda: FileSet({}))) class-attribute instance-attribute

File paths (local) which are not present in the local file system